2024-09-13T02:33:14.793 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T02:33:14.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T02:33:14.914 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903081 branch: squid description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7903081' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3254 sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a sleep_before_teardown: 0 subset: 23/32 suite: upgrade suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKj6QAKroBpICPS806C49D1qffblisGh5KEgcKPhaeNQpjyNbTzGOhmUWUWZHZCnAmqhywBhI4LzX3hfIvqN4Q= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPNmCRPRCihBjzWPUQ3CieSG5TM+AQjNtQNOPWJ2chMsV5tKnN+QFOOW3DAsNJ9OXTzn9UiowCoBlzafha2r5w= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_02:08:15 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T02:33:14.914 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T02:33:14.915 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T02:33:14.915 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T02:33:14.916 INFO:teuthology.task.internal:Checking packages... 2024-09-13T02:33:14.937 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7741f7f9ee20524f89b8f61d1609b32fb3b1570a' 2024-09-13T02:33:14.937 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:33:14.937 INFO:teuthology.packaging:ref: None 2024-09-13T02:33:14.937 INFO:teuthology.packaging:tag: None 2024-09-13T02:33:14.937 INFO:teuthology.packaging:branch: squid 2024-09-13T02:33:14.937 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:33:14.938 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T02:33:15.172 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322.g7741f7f9 2024-09-13T02:33:15.174 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T02:33:15.181 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T02:33:15.181 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T02:33:15.234 INFO:teuthology.task.internal:Saving configuration 2024-09-13T02:33:15.253 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T02:33:15.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T02:33:15.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903081', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 02:28:21.158040', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKj6QAKroBpICPS806C49D1qffblisGh5KEgcKPhaeNQpjyNbTzGOhmUWUWZHZCnAmqhywBhI4LzX3hfIvqN4Q='} 2024-09-13T02:33:15.315 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903081', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 02:28:21.159438', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPNmCRPRCihBjzWPUQ3CieSG5TM+AQjNtQNOPWJ2chMsV5tKnN+QFOOW3DAsNJ9OXTzn9UiowCoBlzafha2r5w='} 2024-09-13T02:33:15.315 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T02:33:15.324 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T02:33:15.324 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T02:33:15.324 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T02:33:15.402 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faa10807ac0>, signals=[15]) 2024-09-13T02:33:15.403 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T02:33:15.409 INFO:teuthology.task.internal:Opening connections... 2024-09-13T02:33:15.409 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:33:15.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:33:15.490 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-09-13T02:33:15.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:33:15.567 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T02:33:15.574 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-13T02:33:15.592 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-13T02:33:15.593 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-13T02:33:15.651 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-13T02:33:15.651 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-13T02:33:15.651 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-13T02:33:15.651 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-13T02:33:15.651 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-13T02:33:15.651 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-13T02:33:15.651 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T02:33:15.652 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-13T02:33:15.652 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-13T02:33:15.652 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T02:33:15.652 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-13T02:33:15.652 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T02:33:15.652 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T02:33:15.652 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T02:33:15.653 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-13T02:33:15.675 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-09-13T02:33:15.693 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-09-13T02:33:15.693 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-09-13T02:33:15.750 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T02:33:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T02:33:15.752 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-09-13T02:33:15.775 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T02:33:15.784 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T02:33:15.809 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T02:33:15.809 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-13T02:33:15.811 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-09-13T02:33:15.828 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T02:33:15.833 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T02:33:15.833 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-13T02:33:15.869 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-09-13T02:33:15.927 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T02:33:15.986 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T02:33:16.000 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T02:33:16.000 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T02:33:16.000 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T02:33:16.001 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T02:33:16.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:33:16.018 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-13T02:33:16.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:33:16.019 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-13T02:33:16.075 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-503.el9.x86_64 2024-09-13T02:33:16.075 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.14.0-503.el9.x86_64 2024-09-13T02:33:16.075 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2024-09-13T02:33:16.078 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-503.el9.x86_64 2024-09-13T02:33:16.078 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-503.el9.x86_64 2024-09-13T02:33:16.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-09-13T02:33:18.695 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 9.2 MB/s | 8.2 MB 00:00 2024-09-13T02:33:19.398 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-13T02:33:22.354 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 20 MB 00:02 2024-09-13T02:33:25.190 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-13T02:33:31.571 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 1.2 MB/s | 6.5 MB 00:05 2024-09-13T02:33:32.266 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.5 MB 00:03 2024-09-13T02:33:33.029 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-13T02:33:34.133 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-13T02:33:34.475 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:01 2024-09-13T02:33:35.671 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T02:33:39.489 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T02:33:41.043 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-13T02:33:41.496 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T02:33:41.496 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T02:33:41.599 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:33:41.603 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:33:41.604 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:33:41.604 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-09-13T02:33:41.604 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:33:41.604 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 79 M 2024-09-13T02:33:41.604 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 126 M 2024-09-13T02:33:41.604 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:33:42.257 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 38 kB/s | 23 kB 00:00 2024-09-13T02:33:42.991 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T02:33:42.991 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T02:33:43.071 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:33:43.082 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:33:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-13T02:33:43.082 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:33:43.082 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:33:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T02:33:43.083 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-13T02:33:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T02:33:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T02:33:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T02:33:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:33:43.083 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:33:43.083 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:33:43.083 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-13T02:33:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:33:43.084 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 79 M 2024-09-13T02:33:43.084 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 126 M 2024-09-13T02:33:43.084 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:33:43.212 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 213 kB/s | 23 kB 00:00 2024-09-13T02:33:43.682 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 7.7 MB/s | 16 MB 00:02 2024-09-13T02:33:43.687 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 60 MB/s | 29 MB 00:00 2024-09-13T02:33:43.929 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-13T02:33:44.332 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 13 MB/s | 35 MB 00:02 2024-09-13T02:33:44.337 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-13T02:33:44.337 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:33:44.338 INFO:teuthology.orchestra.run.smithi098.stdout:Total 63 MB/s | 79 MB 00:01 2024-09-13T02:33:44.999 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 10 MB/s | 29 MB 00:02 2024-09-13T02:33:45.000 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:33:45.000 INFO:teuthology.orchestra.run.smithi142.stdout:Total 23 MB/s | 79 MB 00:03 2024-09-13T02:33:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:33:45.369 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:33:45.369 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:33:45.679 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:33:46.054 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:33:46.054 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:33:46.339 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:33:46.339 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:33:46.993 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:33:46.994 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:33:48.811 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:33:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:33:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:33:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:33:50.063 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:33:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:33:52.306 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:33:52.435 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:33:53.009 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:33:53.148 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:33:57.246 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:33:57.285 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:33:57.981 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:33:58.032 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:02.168 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:02.868 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:40.546 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:40.546 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:34:40.546 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:34:40.547 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:34:41.093 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:41.132 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:41.365 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:41.366 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:34:41.366 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:34:41.366 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T02:34:41.366 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T02:34:41.366 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T02:34:41.366 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T02:34:41.366 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:34:41.366 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:34:41.464 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:41.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:34:41.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:34:41.464 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:34:41.711 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:34:41.785 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:34:41.786 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:34:41.786 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T02:34:41.786 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T02:34:41.787 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T02:34:41.787 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T02:34:41.787 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T02:34:41.787 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:34:41.846 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:34:41.847 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:34:41.847 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2024-09-13T02:34:41.886 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2024-09-13T02:34:41.886 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.06 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 82.el9 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Group : Unspecified 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 8274670 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T02:34:41.887 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : builder@centos.org 2024-09-13T02:34:41.888 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : CentOS 2024-09-13T02:34:41.888 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T02:34:41.888 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2024-09-13T02:34:41.888 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2024-09-13T02:34:41.888 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:34:41.888 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T02:34:41.888 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T02:34:41.888 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T02:34:41.888 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2024-09-13T02:34:41.889 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:34:41.889 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T02:34:41.889 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T02:34:41.890 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 5.14.0-505.el9.x86_64 2024-09-13T02:34:41.890 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T02:34:42.310 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:34:42.310 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:34:42.311 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:34:42.311 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T02:34:42.311 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T02:34:42.311 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T02:34:42.311 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T02:34:42.312 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:34:42.312 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:34:42.483 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-13T02:34:42.669 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:34:42.760 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:34:42.761 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:34:42.761 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T02:34:42.761 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T02:34:42.761 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T02:34:42.761 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T02:34:42.761 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T02:34:42.761 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:34:42.820 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:34:42.820 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:34:42.820 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-09-13T02:34:42.862 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-09-13T02:34:42.862 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-09-13T02:34:42.862 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-09-13T02:34:42.862 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 82.el9 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8274670 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-09-13T02:34:42.863 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-09-13T02:34:42.864 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:34:42.864 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T02:34:42.864 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T02:34:42.864 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T02:34:42.864 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-09-13T02:34:42.864 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:34:42.864 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T02:34:42.865 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T02:34:42.865 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-505.el9.x86_64 2024-09-13T02:34:42.865 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T02:34:43.539 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-09-13T02:34:43.756 INFO:teuthology.orchestra.run.smithi098.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T02:34:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-13T02:34:43.778 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-13T02:34:43.794 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.pYG3Xb9LBY 2024-09-13T02:34:43.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pYG3Xb9LBY 2024-09-13T02:34:43.860 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.pYG3Xb9LBY 2024-09-13T02:34:44.006 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.pYG3Xb9LBY is 6KB 2024-09-13T02:34:44.054 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.pYG3Xb9LBY 2024-09-13T02:34:44.069 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T02:34:44.132 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T02:34:44.132 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T02:34:44.132 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T02:34:44.132 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T02:34:44.134 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T02:34:44.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-13T02:34:44.914 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T02:34:44.931 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-09-13T02:34:44.933 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-09-13T02:34:44.949 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.icfnXUQsGt 2024-09-13T02:34:44.949 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.icfnXUQsGt 2024-09-13T02:34:45.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.icfnXUQsGt 2024-09-13T02:34:45.153 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.icfnXUQsGt is 6KB 2024-09-13T02:34:45.201 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.icfnXUQsGt 2024-09-13T02:34:45.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T02:34:45.279 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T02:34:45.279 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T02:34:45.279 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T02:34:45.280 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T02:34:45.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T02:34:45.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-09-13T02:35:14.306 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T02:35:14.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-13T02:35:14.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:35:15.435 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T02:35:15.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T02:35:15.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:36:14.368 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T02:36:15.439 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T02:36:23.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-13T02:36:23.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:36:23.775 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-13T02:36:24.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-13T02:36:24.174 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T02:36:24.175 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-13T02:36:24.189 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-505.el9.x86_64 2024-09-13T02:36:24.189 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T02:36:24.189 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T02:36:24.190 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T02:36:24.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T02:36:24.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:36:25.190 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T02:36:25.191 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T02:36:25.285 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2024-09-13T02:36:25.309 DEBUG:teuthology.parallel:result is None 2024-09-13T02:36:27.987 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-13T02:36:28.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T02:36:28.368 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T02:36:28.368 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-13T02:36:28.386 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-505.el9.x86_64 2024-09-13T02:36:28.386 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T02:36:28.386 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T02:36:28.386 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T02:36:29.387 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T02:36:29.387 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T02:36:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-09-13T02:36:29.501 DEBUG:teuthology.parallel:result is None 2024-09-13T02:36:29.501 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T02:36:29.510 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T02:36:29.511 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T02:36:29.513 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T02:36:29.528 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T02:36:29.553 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T02:36:29.604 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T02:36:29.604 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T02:36:29.607 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T02:36:29.632 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T02:36:29.654 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T02:36:29.654 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T02:36:29.672 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T02:36:29.694 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:36:29.703 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:36:29.706 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:36:29.717 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:36:29.718 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T02:36:29.725 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T02:36:29.725 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T02:36:29.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T02:36:29.783 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T02:36:29.792 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T02:36:29.792 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T02:36:29.812 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T02:36:29.838 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:36:29.908 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:36:30.031 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:36:30.069 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:36:30.113 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:36:30.113 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T02:36:30.178 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:36:30.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:36:30.264 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:36:30.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:36:30.385 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:36:30.385 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T02:36:30.450 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-13T02:36:30.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-09-13T02:36:30.499 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T02:36:30.532 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T02:36:31.004 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T02:36:31.011 INFO:teuthology.task.internal:Starting timer... 2024-09-13T02:36:31.011 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T02:36:31.059 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T02:36:31.107 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-13T02:36:31.107 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-13T02:36:31.150 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-13T02:36:31.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-09-13T02:36:31.205 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-09-13T02:36:31.207 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T02:36:31.207 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-13T02:36:31.241 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-13T02:36:31.241 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-09-13T02:36:31.263 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-09-13T02:36:31.263 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-09-13T02:36:31.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T02:36:31.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:36:31.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T02:36:31.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:36:31.333 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T02:36:31.333 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-13T02:36:31.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-09-13T02:36:31.446 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T02:36:31.455 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T02:36:31.466 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T02:36:31.467 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi098.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T02:40:15.212 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-09-13T02:40:15.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-13T02:40:15.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:40:15.334 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-13T02:40:15.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-13T02:40:15.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T02:40:15.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:40:15.490 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-13T02:40:15.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-13T02:40:15.569 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T02:40:15.580 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T02:40:15.580 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T02:40:15.581 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T02:40:15.583 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T02:40:15.583 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T02:40:15.610 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T02:40:15.624 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T02:40:15.640 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T02:40:15.648 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-13T02:40:15.653 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T02:40:15.659 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-13T02:40:15.674 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T02:40:15.678 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-09-13T02:40:15.688 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T02:40:15.688 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-09-13T02:40:15.703 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T02:40:15.717 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T02:40:15.746 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-13T02:40:15.749 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T02:40:15.749 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-13T02:40:15.750 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:40:15.750 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:40:15.750 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:40:15.750 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:40:15.777 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-13T02:40:15.780 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T02:40:15.780 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-13T02:40:15.780 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:40:15.780 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:40:15.780 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:40:15.780 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:40:15.781 INFO:teuthology.run_tasks:Running task install... 2024-09-13T02:40:15.789 DEBUG:teuthology.task.install:project ceph 2024-09-13T02:40:15.789 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-13T02:40:15.789 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'} 2024-09-13T02:40:15.790 INFO:teuthology.task.install:Using flavor: default 2024-09-13T02:40:15.795 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T02:40:15.795 INFO:teuthology.task.install:extra packages: [] 2024-09-13T02:40:15.795 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-13T02:40:15.796 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T02:40:15.796 INFO:teuthology.packaging:ref: None 2024-09-13T02:40:15.796 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T02:40:15.796 INFO:teuthology.packaging:branch: None 2024-09-13T02:40:15.796 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:40:16.352 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T02:40:16.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T02:40:16.355 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-13T02:40:16.355 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T02:40:16.355 INFO:teuthology.packaging:ref: None 2024-09-13T02:40:16.355 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T02:40:16.355 INFO:teuthology.packaging:branch: None 2024-09-13T02:40:16.355 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:40:16.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T02:40:16.496 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-13T02:40:16.496 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-13T02:40:16.509 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-13T02:40:16.510 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-13T02:40:16.538 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T02:40:16.538 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:40:16.538 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T02:40:16.559 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T02:40:16.560 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:40:16.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T02:40:16.567 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T02:40:16.567 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T02:40:16.567 INFO:teuthology.packaging:ref: None 2024-09-13T02:40:16.568 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T02:40:16.568 INFO:teuthology.packaging:branch: None 2024-09-13T02:40:16.568 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:40:16.568 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T02:40:16.590 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T02:40:16.590 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T02:40:16.591 INFO:teuthology.packaging:ref: None 2024-09-13T02:40:16.591 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T02:40:16.591 INFO:teuthology.packaging:branch: None 2024-09-13T02:40:16.591 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:40:16.591 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T02:40:16.636 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T02:40:16.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T02:40:16.714 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T02:40:16.739 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T02:40:16.779 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-13T02:40:16.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-13T02:40:16.807 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-09-13T02:40:16.809 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-09-13T02:40:17.020 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-13T02:40:17.038 INFO:teuthology.orchestra.run.smithi142.stdout:45 files removed 2024-09-13T02:40:17.047 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw 2024-09-13T02:40:17.065 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw 2024-09-13T02:40:17.441 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 681 kB/s | 76 kB 00:00 2024-09-13T02:40:17.460 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 722 kB/s | 76 kB 00:00 2024-09-13T02:40:17.625 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 67 kB/s | 9.3 kB 00:00 2024-09-13T02:40:17.627 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 77 kB/s | 9.3 kB 00:00 2024-09-13T02:40:17.820 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 14 kB/s | 2.2 kB 00:00 2024-09-13T02:40:17.826 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 13 kB/s | 2.2 kB 00:00 2024-09-13T02:40:18.342 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-13T02:40:19.395 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.2 MB 00:01 2024-09-13T02:40:20.152 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-13T02:40:24.429 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T02:40:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-13T02:40:28.208 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-13T02:40:33.681 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T02:40:36.099 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:40:36.111 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:40:36.111 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-13T02:40:36.111 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:40:36.111 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:40:36.111 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-13T02:40:36.111 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-13T02:40:36.111 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-13T02:40:36.111 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T02:40:36.112 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-13T02:40:36.113 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-13T02:40:36.114 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-13T02:40:36.114 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T02:40:36.114 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T02:40:36.114 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:40:36.114 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:40:36.114 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:40:36.114 INFO:teuthology.orchestra.run.smithi098.stdout:Install 28 Packages 2024-09-13T02:40:36.114 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 2 Packages 2024-09-13T02:40:36.114 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:40:36.115 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 53 M 2024-09-13T02:40:36.115 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:40:36.424 INFO:teuthology.orchestra.run.smithi098.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 38 MB/s | 5.2 MB 00:00 2024-09-13T02:40:36.449 INFO:teuthology.orchestra.run.smithi098.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 971 kB/s | 24 kB 00:00 2024-09-13T02:40:36.483 INFO:teuthology.orchestra.run.smithi098.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 19 MB/s | 653 kB 00:00 2024-09-13T02:40:36.517 INFO:teuthology.orchestra.run.smithi098.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-13T02:40:36.609 INFO:teuthology.orchestra.run.smithi098.stdout:(5/30): librgw2-18.2.0-0.el9.x86_64.rpm 48 MB/s | 4.4 MB 00:00 2024-09-13T02:40:36.634 INFO:teuthology.orchestra.run.smithi098.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-13T02:40:36.717 INFO:teuthology.orchestra.run.smithi098.stdout:(7/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 18 MB/s | 7.6 MB 00:00 2024-09-13T02:40:36.743 INFO:teuthology.orchestra.run.smithi098.stdout:(8/30): python3-ceph-common-18.2.0-0.el9.x86_64 1.1 MB/s | 119 kB 00:00 2024-09-13T02:40:36.768 INFO:teuthology.orchestra.run.smithi098.stdout:(9/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-09-13T02:40:36.793 INFO:teuthology.orchestra.run.smithi098.stdout:(10/30): python3-rados-18.2.0-0.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2024-09-13T02:40:36.819 INFO:teuthology.orchestra.run.smithi098.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 297 kB 00:00 2024-09-13T02:40:36.844 INFO:teuthology.orchestra.run.smithi098.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-13T02:40:37.061 INFO:teuthology.orchestra.run.smithi098.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 24 MB/s | 18 MB 00:00 2024-09-13T02:40:37.194 INFO:teuthology.orchestra.run.smithi098.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 340 kB/s | 45 kB 00:00 2024-09-13T02:40:37.220 INFO:teuthology.orchestra.run.smithi098.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 267 kB/s | 107 kB 00:00 2024-09-13T02:40:37.245 INFO:teuthology.orchestra.run.smithi098.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 399 kB/s | 160 kB 00:00 2024-09-13T02:40:37.295 INFO:teuthology.orchestra.run.smithi098.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-13T02:40:37.337 INFO:teuthology.orchestra.run.smithi098.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 2.6 MB/s | 111 kB 00:00 2024-09-13T02:40:37.363 INFO:teuthology.orchestra.run.smithi098.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-13T02:40:37.388 INFO:teuthology.orchestra.run.smithi098.stdout:(20/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-13T02:40:37.430 INFO:teuthology.orchestra.run.smithi098.stdout:(21/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.2 MB/s | 308 kB 00:00 2024-09-13T02:40:37.455 INFO:teuthology.orchestra.run.smithi098.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-13T02:40:37.481 INFO:teuthology.orchestra.run.smithi098.stdout:(23/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 305 kB/s | 26 kB 00:00 2024-09-13T02:40:37.514 INFO:teuthology.orchestra.run.smithi098.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-13T02:40:37.548 INFO:teuthology.orchestra.run.smithi098.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T02:40:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-13T02:40:37.682 INFO:teuthology.orchestra.run.smithi098.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 44 MB/s | 3.3 MB 00:00 2024-09-13T02:40:37.749 INFO:teuthology.orchestra.run.smithi098.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T02:40:37.782 INFO:teuthology.orchestra.run.smithi098.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-13T02:40:37.849 INFO:teuthology.orchestra.run.smithi098.stdout:(30/30): librbd1-18.2.0-0.el9.x86_64.rpm 18 MB/s | 3.0 MB 00:00 2024-09-13T02:40:37.853 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:40:37.853 INFO:teuthology.orchestra.run.smithi098.stdout:Total 30 MB/s | 53 MB 00:01 2024-09-13T02:40:37.922 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:40:37.955 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:40:37.955 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:40:38.555 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:40:38.556 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:40:39.385 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-13T02:40:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:40:39.992 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T02:40:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T02:40:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T02:40:40.453 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T02:40:40.503 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T02:40:40.579 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T02:40:40.667 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-13T02:40:40.688 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T02:40:40.751 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T02:40:40.780 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T02:40:40.823 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-13T02:40:40.888 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-13T02:40:40.916 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T02:40:40.981 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T02:40:41.087 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T02:40:41.123 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T02:40:41.164 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T02:40:41.196 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T02:40:41.223 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T02:40:41.259 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T02:40:41.292 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T02:40:41.589 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T02:40:41.647 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-13T02:40:41.737 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-13T02:40:41.768 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-13T02:40:41.804 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T02:40:42.196 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T02:40:42.224 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-13T02:40:42.296 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-13T02:40:42.363 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-13T02:40:42.393 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-13T02:40:43.752 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T02:40:44.413 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T02:40:44.457 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T02:40:45.001 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T02:40:45.035 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-13T02:40:45.120 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-13T02:40:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T02:40:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T02:40:45.120 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:40:45.161 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T02:40:45.845 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 19 kB 00:00 2024-09-13T02:40:47.065 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T02:40:52.405 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-09-13T02:40:54.814 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:40:54.823 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:40:54.824 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-13T02:40:54.824 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:40:54.824 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:40:54.824 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-13T02:40:54.824 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-09-13T02:40:54.824 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-13T02:40:54.824 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-13T02:40:54.824 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T02:40:54.824 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T02:40:54.825 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-13T02:40:54.826 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-13T02:40:54.827 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T02:40:54.827 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T02:40:54.827 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:40:54.827 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:40:54.827 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:40:54.827 INFO:teuthology.orchestra.run.smithi142.stdout:Install 28 Packages 2024-09-13T02:40:54.827 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2024-09-13T02:40:54.827 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:40:54.828 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 53 M 2024-09-13T02:40:54.828 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:40:55.156 INFO:teuthology.orchestra.run.smithi142.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 36 MB/s | 5.2 MB 00:00 2024-09-13T02:40:55.253 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T02:40:55.253 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-13T02:40:55.253 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-13T02:40:55.253 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-13T02:40:55.253 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-13T02:40:55.253 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-13T02:40:55.253 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-13T02:40:55.253 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-13T02:40:55.253 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:40:55.306 INFO:teuthology.orchestra.run.smithi142.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 161 kB/s | 24 kB 00:00 2024-09-13T02:40:55.365 INFO:teuthology.orchestra.run.smithi142.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 11 MB/s | 653 kB 00:00 2024-09-13T02:40:55.398 INFO:teuthology.orchestra.run.smithi142.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-13T02:40:55.515 INFO:teuthology.orchestra.run.smithi142.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 15 MB/s | 7.6 MB 00:00 2024-09-13T02:40:55.540 INFO:teuthology.orchestra.run.smithi142.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-13T02:40:55.566 INFO:teuthology.orchestra.run.smithi142.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 4.7 MB/s | 119 kB 00:00 2024-09-13T02:40:55.591 INFO:teuthology.orchestra.run.smithi142.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 6.1 MB/s | 155 kB 00:00 2024-09-13T02:40:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-09-13T02:40:55.683 INFO:teuthology.orchestra.run.smithi142.stdout:(10/30): librgw2-18.2.0-0.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-13T02:40:55.708 INFO:teuthology.orchestra.run.smithi142.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 3.2 MB/s | 297 kB 00:00 2024-09-13T02:40:55.734 INFO:teuthology.orchestra.run.smithi142.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-13T02:40:55.934 INFO:teuthology.orchestra.run.smithi142.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 20 MB/s | 18 MB 00:00 2024-09-13T02:40:55.993 INFO:teuthology.orchestra.run.smithi142.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 376 kB/s | 107 kB 00:00 2024-09-13T02:40:56.007 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-13T02:40:56.018 INFO:teuthology.orchestra.run.smithi142.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 565 kB/s | 160 kB 00:00 2024-09-13T02:40:56.032 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-13T02:40:56.032 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:40:56.032 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T02:40:56.032 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:40:56.032 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:40:56.032 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:40:56.034 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T02:40:56.043 INFO:teuthology.orchestra.run.smithi142.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-13T02:40:56.085 INFO:teuthology.orchestra.run.smithi142.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-13T02:40:56.110 INFO:teuthology.orchestra.run.smithi142.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 631 kB/s | 42 kB 00:00 2024-09-13T02:40:56.118 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T02:40:56.118 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T02:40:56.136 INFO:teuthology.orchestra.run.smithi142.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-13T02:40:56.186 INFO:teuthology.orchestra.run.smithi142.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-09-13T02:40:56.211 INFO:teuthology.orchestra.run.smithi142.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-13T02:40:56.237 INFO:teuthology.orchestra.run.smithi142.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T02:40:56.262 INFO:teuthology.orchestra.run.smithi142.stdout:(23/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.0 MB/s | 308 kB 00:00 2024-09-13T02:40:56.287 INFO:teuthology.orchestra.run.smithi142.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T02:40:56.321 INFO:teuthology.orchestra.run.smithi142.stdout:(25/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-13T02:40:56.346 INFO:teuthology.orchestra.run.smithi142.stdout:(26/30): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-13T02:40:56.421 INFO:teuthology.orchestra.run.smithi142.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 44 MB/s | 3.3 MB 00:00 2024-09-13T02:40:56.472 INFO:teuthology.orchestra.run.smithi142.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-13T02:40:56.530 INFO:teuthology.orchestra.run.smithi142.stdout:(29/30): librbd1-18.2.0-0.el9.x86_64.rpm 28 MB/s | 3.0 MB 00:00 2024-09-13T02:40:56.622 INFO:teuthology.orchestra.run.smithi142.stdout:(30/30): libarrow-9.0.0-11.el9.x86_64.rpm 9.4 MB/s | 4.4 MB 00:00 2024-09-13T02:40:56.626 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:40:56.626 INFO:teuthology.orchestra.run.smithi142.stdout:Total 29 MB/s | 53 MB 00:01 2024-09-13T02:40:56.691 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:40:56.726 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:40:56.726 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:40:57.184 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T02:40:57.184 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-13T02:40:57.184 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-13T02:40:57.184 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T02:40:57.185 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T02:40:57.186 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T02:40:57.187 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T02:40:57.187 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T02:40:57.187 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-13T02:40:57.368 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:40:57.369 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:40:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T02:40:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T02:40:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T02:40:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T02:40:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T02:40:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T02:40:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T02:40:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T02:40:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T02:40:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T02:40:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T02:40:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T02:40:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-13T02:40:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T02:40:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T02:40:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:40:58.062 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:40:58.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-test 2024-09-13T02:40:58.729 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:40:58.814 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T02:40:58.843 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T02:40:58.901 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T02:40:58.973 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:25 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:40:59.114 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:40:59.115 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:40:59.116 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:40:59.116 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-13T02:40:59.116 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:40:59.116 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 40 M 2024-09-13T02:40:59.117 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 165 M 2024-09-13T02:40:59.117 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:40:59.289 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T02:40:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T02:40:59.349 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 867 kB/s | 161 kB 00:00 2024-09-13T02:40:59.434 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T02:40:59.513 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-13T02:40:59.535 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T02:40:59.598 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T02:40:59.626 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T02:40:59.669 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-13T02:40:59.725 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): ceph-test-18.2.0-0.el9.x86_64.rpm 71 MB/s | 40 MB 00:00 2024-09-13T02:40:59.744 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-13T02:40:59.771 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T02:40:59.837 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T02:40:59.951 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T02:40:59.986 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T02:41:00.032 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T02:41:00.060 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T02:41:00.087 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T02:41:00.131 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T02:41:00.165 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T02:41:00.275 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 69 kB/s | 64 kB 00:00 2024-09-13T02:41:00.463 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T02:41:00.492 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): socat-1.7.4.1-6.el9.x86_64.rpm 229 kB/s | 304 kB 00:01 2024-09-13T02:41:00.495 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:00.495 INFO:teuthology.orchestra.run.smithi098.stdout:Total 29 MB/s | 40 MB 00:01 2024-09-13T02:41:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-13T02:41:00.521 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:41:00.541 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:41:00.542 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:41:00.592 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-13T02:41:00.643 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-13T02:41:00.684 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T02:41:00.882 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:41:00.882 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:41:01.082 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T02:41:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-13T02:41:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-13T02:41:01.268 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-13T02:41:01.298 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-13T02:41:01.369 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:41:01.444 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T02:41:01.483 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T02:41:01.512 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-13T02:41:03.305 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T02:41:03.336 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T02:41:03.909 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-13T02:41:03.949 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-13T02:41:04.027 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-13T02:41:04.027 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T02:41:04.027 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T02:41:04.027 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:04.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T02:41:05.253 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-13T02:41:05.334 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-13T02:41:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-13T02:41:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-13T02:41:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-13T02:41:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T02:41:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T02:41:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:07.680 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:41:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T02:41:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:07.680 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:41:07.942 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph 2024-09-13T02:41:08.513 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:35 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:41:08.657 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:41:08.659 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-13T02:41:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T02:41:08.661 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T02:41:08.662 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout:Install 33 Packages 2024-09-13T02:41:08.663 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:08.664 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 30 M 2024-09-13T02:41:08.664 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 109 M 2024-09-13T02:41:08.664 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:41:09.027 INFO:teuthology.orchestra.run.smithi098.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 148 kB/s | 6.4 kB 00:00 2024-09-13T02:41:09.077 INFO:teuthology.orchestra.run.smithi098.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-13T02:41:09.119 INFO:teuthology.orchestra.run.smithi098.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 15 MB/s | 2.1 MB 00:00 2024-09-13T02:41:09.144 INFO:teuthology.orchestra.run.smithi098.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.4 MB/s | 240 kB 00:00 2024-09-13T02:41:09.236 INFO:teuthology.orchestra.run.smithi098.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-13T02:41:09.462 INFO:teuthology.orchestra.run.smithi098.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 46 MB/s | 18 MB 00:00 2024-09-13T02:41:09.587 INFO:teuthology.orchestra.run.smithi098.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 572 kB/s | 253 kB 00:00 2024-09-13T02:41:09.612 INFO:teuthology.orchestra.run.smithi098.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 710 kB/s | 106 kB 00:00 2024-09-13T02:41:09.662 INFO:teuthology.orchestra.run.smithi098.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-13T02:41:09.688 INFO:teuthology.orchestra.run.smithi098.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-09-13T02:41:09.755 INFO:teuthology.orchestra.run.smithi098.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-13T02:41:09.905 INFO:teuthology.orchestra.run.smithi098.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 1.8 MB/s | 1.2 MB 00:00 2024-09-13T02:41:10.069 INFO:teuthology.orchestra.run.smithi098.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 112 kB/s | 35 kB 00:00 2024-09-13T02:41:10.264 INFO:teuthology.orchestra.run.smithi098.stdout:(14/33): python3-toml-0.10.2-6.el9.noarch.rpm 208 kB/s | 42 kB 00:00 2024-09-13T02:41:10.289 INFO:teuthology.orchestra.run.smithi098.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 286 kB/s | 172 kB 00:00 2024-09-13T02:41:10.315 INFO:teuthology.orchestra.run.smithi098.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 125 kB/s | 51 kB 00:00 2024-09-13T02:41:10.373 INFO:teuthology.orchestra.run.smithi098.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 400 kB/s | 43 kB 00:00 2024-09-13T02:41:10.399 INFO:teuthology.orchestra.run.smithi098.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-13T02:41:10.424 INFO:teuthology.orchestra.run.smithi098.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-13T02:41:10.449 INFO:teuthology.orchestra.run.smithi098.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-13T02:41:10.474 INFO:teuthology.orchestra.run.smithi098.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 463 kB/s | 23 kB 00:00 2024-09-13T02:41:10.499 INFO:teuthology.orchestra.run.smithi098.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T02:41:10.525 INFO:teuthology.orchestra.run.smithi098.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-13T02:41:10.550 INFO:teuthology.orchestra.run.smithi098.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-13T02:41:10.575 INFO:teuthology.orchestra.run.smithi098.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T02:41:10.601 INFO:teuthology.orchestra.run.smithi098.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-13T02:41:10.618 INFO:teuthology.orchestra.run.smithi098.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 391 kB/s | 16 kB 00:00 2024-09-13T02:41:10.643 INFO:teuthology.orchestra.run.smithi098.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-13T02:41:10.660 INFO:teuthology.orchestra.run.smithi098.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 857 kB/s | 36 kB 00:00 2024-09-13T02:41:10.685 INFO:teuthology.orchestra.run.smithi098.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-13T02:41:10.710 INFO:teuthology.orchestra.run.smithi098.stdout:(31/33): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-13T02:41:10.735 INFO:teuthology.orchestra.run.smithi098.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2024-09-13T02:41:10.761 INFO:teuthology.orchestra.run.smithi098.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-13T02:41:10.766 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:10.766 INFO:teuthology.orchestra.run.smithi098.stdout:Total 14 MB/s | 30 MB 00:02 2024-09-13T02:41:10.890 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:41:10.927 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:41:10.927 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:41:11.328 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:41:11.329 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:41:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:41:12.622 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T02:41:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T02:41:12.687 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T02:41:12.779 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T02:41:12.868 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T02:41:12.916 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T02:41:12.955 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T02:41:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T02:41:13.031 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T02:41:13.073 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T02:41:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T02:41:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T02:41:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T02:41:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T02:41:13.289 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T02:41:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T02:41:13.509 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T02:41:13.568 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T02:41:13.608 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T02:41:13.657 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T02:41:13.721 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T02:41:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T02:41:13.954 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T02:41:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T02:41:13.958 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-09-13T02:41:13.958 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-09-13T02:41:13.958 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-09-13T02:41:13.958 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-09-13T02:41:13.958 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-09-13T02:41:13.958 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-09-13T02:41:13.958 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-09-13T02:41:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:14.024 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T02:41:14.110 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T02:41:14.145 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T02:41:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T02:41:14.430 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-13T02:41:14.464 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-13T02:41:14.490 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-13T02:41:14.490 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:14.490 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T02:41:14.490 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:41:14.490 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:41:14.490 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-13T02:41:14.707 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-13T02:41:14.707 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:14.707 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T02:41:14.707 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:41:14.708 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:41:14.708 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:14.709 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T02:41:14.784 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T02:41:14.784 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T02:41:15.961 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T02:41:15.961 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-13T02:41:15.962 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T02:41:15.963 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T02:41:15.964 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T02:41:15.964 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T02:41:15.964 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T02:41:15.964 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T02:41:15.964 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T02:41:15.964 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-13T02:41:15.964 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T02:41:15.964 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-13T02:41:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-13T02:41:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-13T02:41:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T02:41:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:41:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:41:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:16.533 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-13T02:41:16.557 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-13T02:41:16.557 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:16.557 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T02:41:16.557 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:41:16.557 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:41:16.557 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:16.767 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-13T02:41:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-13T02:41:16.791 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:16.791 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T02:41:16.791 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:41:16.791 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:41:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-13T02:41:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T02:41:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:17.161 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-09-13T02:41:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.161 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:41:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T02:41:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:17.163 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:41:17.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-test 2024-09-13T02:41:18.077 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:26 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:41:18.208 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:41:18.209 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:18.210 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-09-13T02:41:18.210 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:18.210 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 40 M 2024-09-13T02:41:18.210 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 165 M 2024-09-13T02:41:18.210 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:41:18.316 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 2.6 MB/s | 161 kB 00:00 2024-09-13T02:41:18.458 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-13T02:41:18.483 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 382 kB/s | 64 kB 00:00 2024-09-13T02:41:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-13T02:41:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-13T02:41:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-13T02:41:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-13T02:41:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-13T02:41:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-13T02:41:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-13T02:41:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T02:41:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T02:41:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T02:41:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T02:41:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T02:41:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T02:41:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T02:41:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T02:41:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T02:41:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T02:41:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T02:41:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T02:41:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T02:41:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T02:41:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T02:41:18.850 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 67 MB/s | 40 MB 00:00 2024-09-13T02:41:18.852 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:18.853 INFO:teuthology.orchestra.run.smithi142.stdout:Total 62 MB/s | 40 MB 00:00 2024-09-13T02:41:18.880 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:41:18.900 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:41:18.900 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:41:19.237 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:41:19.238 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:41:19.522 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T02:41:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:19.523 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:41:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-13T02:41:19.523 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T02:41:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T02:41:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T02:41:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T02:41:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T02:41:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T02:41:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:19.526 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:41:19.715 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:41:19.805 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T02:41:19.849 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T02:41:19.873 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-base 2024-09-13T02:41:19.877 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-13T02:41:20.445 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:41:20.536 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:41:20.577 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:41:20.578 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-13T02:41:20.578 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:41:20.644 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install cephadm 2024-09-13T02:41:21.195 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:41:21.325 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 209 k 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 200 k 2024-09-13T02:41:21.326 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:41:21.371 INFO:teuthology.orchestra.run.smithi098.stdout:cephadm-18.2.0-0.el9.noarch.rpm 4.6 MB/s | 209 kB 00:00 2024-09-13T02:41:21.372 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:21.372 INFO:teuthology.orchestra.run.smithi098.stdout:Total 4.4 MB/s | 209 kB 00:00 2024-09-13T02:41:21.372 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:41:21.377 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:41:21.377 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:41:21.380 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:41:21.380 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:41:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:41:21.883 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T02:41:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T02:41:22.342 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T02:41:22.588 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T02:41:22.589 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:22.589 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:41:22.589 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-13T02:41:22.589 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:22.589 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:41:22.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T02:41:23.355 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:41:23.488 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:41:23.489 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-13T02:41:23.489 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:23.489 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:41:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-13T02:41:23.489 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:23.489 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:41:23.490 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:23.490 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-13T02:41:23.490 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:23.490 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 142 k 2024-09-13T02:41:23.490 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 399 k 2024-09-13T02:41:23.490 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:41:23.552 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.2 MB/s | 142 kB 00:00 2024-09-13T02:41:23.553 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:23.553 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.2 MB/s | 142 kB 00:00 2024-09-13T02:41:23.553 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:41:23.560 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:41:23.561 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:41:23.593 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-13T02:41:23.619 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:41:23.619 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:41:23.675 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-13T02:41:23.761 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:41:23.862 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:41:23.886 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:41:23.887 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:23.887 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T02:41:23.887 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:24.785 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:41:24.785 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:24.785 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:41:24.785 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:24.785 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:24.785 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:41:24.995 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr 2024-09-13T02:41:25.575 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:41:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-13T02:41:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-13T02:41:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-13T02:41:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T02:41:25.670 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:41:25.712 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:41:25.713 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-13T02:41:25.713 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:41:25.775 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T02:41:25.918 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T02:41:25.918 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:25.918 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:41:25.919 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:25.919 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T02:41:25.919 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:25.919 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:41:26.198 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph 2024-09-13T02:41:26.341 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:41:26.472 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:41:26.473 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-13T02:41:26.473 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:26.473 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:41:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-13T02:41:26.473 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-13T02:41:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-13T02:41:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout:Install 7 Packages 2024-09-13T02:41:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:26.475 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 2.0 M 2024-09-13T02:41:26.475 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 8.1 M 2024-09-13T02:41:26.475 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:41:26.772 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:34 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:41:26.865 INFO:teuthology.orchestra.run.smithi098.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 435 kB/s | 23 kB 00:00 2024-09-13T02:41:26.891 INFO:teuthology.orchestra.run.smithi098.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 186 kB/s | 15 kB 00:00 2024-09-13T02:41:26.919 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:41:26.921 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:26.922 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-13T02:41:26.922 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:26.922 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:41:26.923 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-13T02:41:26.923 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T02:41:26.923 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-13T02:41:26.923 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-13T02:41:26.923 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-13T02:41:26.923 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-13T02:41:26.924 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-13T02:41:26.924 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T02:41:26.924 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T02:41:26.924 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T02:41:26.924 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T02:41:26.924 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T02:41:26.924 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T02:41:26.925 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T02:41:26.925 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T02:41:26.925 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T02:41:26.925 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T02:41:26.925 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T02:41:26.926 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T02:41:26.926 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T02:41:26.926 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T02:41:26.926 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T02:41:26.926 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T02:41:26.926 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T02:41:26.926 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T02:41:26.926 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T02:41:26.926 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:26.927 INFO:teuthology.orchestra.run.smithi142.stdout:Install 33 Packages 2024-09-13T02:41:26.928 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:26.928 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 30 M 2024-09-13T02:41:26.928 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 109 M 2024-09-13T02:41:26.928 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:41:26.933 INFO:teuthology.orchestra.run.smithi098.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-13T02:41:26.958 INFO:teuthology.orchestra.run.smithi098.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-13T02:41:26.992 INFO:teuthology.orchestra.run.smithi098.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 405 kB/s | 41 kB 00:00 2024-09-13T02:41:27.017 INFO:teuthology.orchestra.run.smithi098.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-13T02:41:27.059 INFO:teuthology.orchestra.run.smithi098.stdout:(7/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 6.9 MB/s | 1.7 MB 00:00 2024-09-13T02:41:27.062 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:27.062 INFO:teuthology.orchestra.run.smithi098.stdout:Total 3.4 MB/s | 2.0 MB 00:00 2024-09-13T02:41:27.063 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:41:27.070 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:41:27.070 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:41:27.155 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:41:27.156 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:41:27.451 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:41:27.502 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T02:41:27.509 INFO:teuthology.orchestra.run.smithi142.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 126 kB/s | 6.4 kB 00:00 2024-09-13T02:41:27.537 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T02:41:27.559 INFO:teuthology.orchestra.run.smithi142.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-13T02:41:27.591 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T02:41:27.609 INFO:teuthology.orchestra.run.smithi142.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2024-09-13T02:41:27.623 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T02:41:27.634 INFO:teuthology.orchestra.run.smithi142.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.4 MB/s | 240 kB 00:00 2024-09-13T02:41:27.651 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-13T02:41:27.720 INFO:teuthology.orchestra.run.smithi142.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-13T02:41:27.872 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-13T02:41:27.904 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-13T02:41:27.952 INFO:teuthology.orchestra.run.smithi142.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 45 MB/s | 18 MB 00:00 2024-09-13T02:41:28.360 INFO:teuthology.orchestra.run.smithi142.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 349 kB/s | 253 kB 00:00 2024-09-13T02:41:28.410 INFO:teuthology.orchestra.run.smithi142.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-09-13T02:41:28.455 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-13T02:41:28.455 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-13T02:41:28.455 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-13T02:41:28.455 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-13T02:41:28.455 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T02:41:28.455 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T02:41:28.455 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T02:41:28.469 INFO:teuthology.orchestra.run.smithi142.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-09-13T02:41:28.594 INFO:teuthology.orchestra.run.smithi142.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.7 MB/s | 215 kB 00:00 2024-09-13T02:41:28.611 INFO:teuthology.orchestra.run.smithi142.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 622 kB/s | 125 kB 00:00 2024-09-13T02:41:28.712 INFO:teuthology.orchestra.run.smithi142.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 347 kB/s | 35 kB 00:00 2024-09-13T02:41:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T02:41:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:28.719 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:41:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-13T02:41:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-13T02:41:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-13T02:41:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T02:41:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T02:41:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T02:41:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T02:41:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:28.720 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:41:28.779 INFO:teuthology.orchestra.run.smithi142.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 936 kB/s | 172 kB 00:00 2024-09-13T02:41:28.804 INFO:teuthology.orchestra.run.smithi142.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-09-13T02:41:28.829 INFO:teuthology.orchestra.run.smithi142.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-13T02:41:28.871 INFO:teuthology.orchestra.run.smithi142.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 648 kB/s | 43 kB 00:00 2024-09-13T02:41:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-13T02:41:28.930 INFO:teuthology.orchestra.run.smithi142.stdout:(18/33): python3-cherrypy-18.6.1-2.el9.noarch.r 6.2 MB/s | 358 kB 00:00 2024-09-13T02:41:28.938 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T02:41:28.947 INFO:teuthology.orchestra.run.smithi142.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 256 kB/s | 11 kB 00:00 2024-09-13T02:41:28.972 INFO:teuthology.orchestra.run.smithi142.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 422 kB/s | 18 kB 00:00 2024-09-13T02:41:28.997 INFO:teuthology.orchestra.run.smithi142.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-13T02:41:29.031 INFO:teuthology.orchestra.run.smithi142.stdout:(22/33): python3-cryptography-36.0.1-4.el9.x86_ 956 kB/s | 1.2 MB 00:01 2024-09-13T02:41:29.057 INFO:teuthology.orchestra.run.smithi142.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 232 kB/s | 19 kB 00:00 2024-09-13T02:41:29.090 INFO:teuthology.orchestra.run.smithi142.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 213 kB/s | 20 kB 00:00 2024-09-13T02:41:29.115 INFO:teuthology.orchestra.run.smithi142.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T02:41:29.132 INFO:teuthology.orchestra.run.smithi142.stdout:(26/33): python3-logutils-0.3.5-21.el9.noarch.r 459 kB/s | 46 kB 00:00 2024-09-13T02:41:29.149 INFO:teuthology.orchestra.run.smithi142.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 494 kB/s | 16 kB 00:00 2024-09-13T02:41:29.166 INFO:teuthology.orchestra.run.smithi142.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.6 MB/s | 90 kB 00:00 2024-09-13T02:41:29.183 INFO:teuthology.orchestra.run.smithi142.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2024-09-13T02:41:29.208 INFO:teuthology.orchestra.run.smithi142.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-13T02:41:29.234 INFO:teuthology.orchestra.run.smithi142.stdout:(31/33): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-13T02:41:29.250 INFO:teuthology.orchestra.run.smithi142.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 479 kB/s | 20 kB 00:00 2024-09-13T02:41:29.284 INFO:teuthology.orchestra.run.smithi142.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-13T02:41:29.289 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:29.289 INFO:teuthology.orchestra.run.smithi142.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-13T02:41:29.409 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:41:29.447 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:41:29.447 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:41:29.504 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:41:29.637 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:41:29.638 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T02:41:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T02:41:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T02:41:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T02:41:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T02:41:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:29.640 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:41:29.640 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:29.640 INFO:teuthology.orchestra.run.smithi098.stdout:Install 12 Packages 2024-09-13T02:41:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:29.641 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 38 M 2024-09-13T02:41:29.641 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 212 M 2024-09-13T02:41:29.641 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:41:29.869 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:41:29.869 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:41:30.177 INFO:teuthology.orchestra.run.smithi098.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 48 MB/s | 7.4 MB 00:00 2024-09-13T02:41:30.458 INFO:teuthology.orchestra.run.smithi098.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 115 kB/s | 33 kB 00:00 2024-09-13T02:41:30.691 INFO:teuthology.orchestra.run.smithi098.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 284 kB/s | 191 kB 00:00 2024-09-13T02:41:30.800 INFO:teuthology.orchestra.run.smithi098.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-09-13T02:41:30.826 INFO:teuthology.orchestra.run.smithi098.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 994 kB/s | 801 kB 00:00 2024-09-13T02:41:30.909 INFO:teuthology.orchestra.run.smithi098.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-13T02:41:31.109 INFO:teuthology.orchestra.run.smithi098.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-13T02:41:31.119 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:41:31.182 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T02:41:31.214 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T02:41:31.255 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T02:41:31.346 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T02:41:31.418 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T02:41:31.460 INFO:teuthology.orchestra.run.smithi098.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.0 MB/s | 3.0 MB 00:01 2024-09-13T02:41:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T02:41:31.509 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T02:41:31.548 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T02:41:31.577 INFO:teuthology.orchestra.run.smithi098.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-13T02:41:31.582 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T02:41:31.615 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T02:41:31.656 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T02:41:31.691 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T02:41:31.725 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T02:41:31.763 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T02:41:31.769 INFO:teuthology.orchestra.run.smithi098.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.7 MB/s | 5.1 MB 00:00 2024-09-13T02:41:31.845 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T02:41:31.982 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T02:41:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T02:41:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T02:41:32.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T02:41:32.228 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T02:41:32.283 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T02:41:32.444 INFO:teuthology.orchestra.run.smithi098.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.1 MB/s | 4.9 MB 00:01 2024-09-13T02:41:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T02:41:32.517 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T02:41:32.586 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T02:41:32.684 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T02:41:32.725 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T02:41:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T02:41:33.017 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-13T02:41:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-13T02:41:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-13T02:41:33.069 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:33.069 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T02:41:33.069 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:41:33.069 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:41:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-13T02:41:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-13T02:41:34.649 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:34.649 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T02:41:34.649 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:41:34.649 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:41:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:35.096 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-13T02:41:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-13T02:41:35.120 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:35.120 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T02:41:35.120 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:41:35.120 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:41:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:35.330 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-13T02:41:35.353 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-13T02:41:35.353 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:35.354 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T02:41:35.354 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:41:35.354 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:41:35.354 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:35.418 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-13T02:41:37.249 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T02:41:37.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T02:41:37.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T02:41:37.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T02:41:37.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T02:41:37.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T02:41:37.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T02:41:37.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T02:41:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T02:41:37.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T02:41:37.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T02:41:37.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T02:41:37.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T02:41:38.147 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T02:41:38.147 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T02:41:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T02:41:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:38.150 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:41:38.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-base 2024-09-13T02:41:39.092 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:41:39.183 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:41:39.224 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:41:39.225 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-13T02:41:39.225 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:41:39.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install cephadm 2024-09-13T02:41:39.865 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:41:39.997 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:41:39.997 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:39.997 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T02:41:39.997 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:39.997 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:41:39.997 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-13T02:41:39.998 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:39.998 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:41:39.998 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:39.998 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-13T02:41:39.998 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:39.998 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 209 k 2024-09-13T02:41:39.998 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 200 k 2024-09-13T02:41:39.998 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:41:40.045 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm-18.2.0-0.el9.noarch.rpm 4.4 MB/s | 209 kB 00:00 2024-09-13T02:41:40.045 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:40.045 INFO:teuthology.orchestra.run.smithi142.stdout:Total 4.3 MB/s | 209 kB 00:00 2024-09-13T02:41:40.046 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:41:40.050 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:41:40.051 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:41:40.053 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:41:40.054 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:41:40.119 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:41:40.531 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T02:41:40.624 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T02:41:40.944 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T02:41:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-13T02:41:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:41.182 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:41:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-13T02:41:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:41.182 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:41:41.409 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T02:41:41.980 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:41:42.114 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:42.115 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 142 k 2024-09-13T02:41:42.116 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 399 k 2024-09-13T02:41:42.116 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:41:42.159 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 3.2 MB/s | 142 kB 00:00 2024-09-13T02:41:42.160 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:42.161 INFO:teuthology.orchestra.run.smithi142.stdout:Total 3.1 MB/s | 142 kB 00:00 2024-09-13T02:41:42.161 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:41:42.168 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:41:42.168 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:41:42.227 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:41:42.227 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:41:42.374 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:41:42.460 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:41:42.485 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:41:42.485 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:41:42.485 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T02:41:42.486 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:43.351 INFO:teuthology.orchestra.run.smithi098.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.4 MB/s | 16 MB 00:11 2024-09-13T02:41:43.352 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:43.353 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.8 MB/s | 38 MB 00:13 2024-09-13T02:41:43.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:41:43.425 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:43.425 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:41:43.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-13T02:41:43.425 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:43.425 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:41:43.646 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr 2024-09-13T02:41:43.711 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:41:43.737 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:41:43.738 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:41:44.218 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:41:44.235 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:41:44.235 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:41:44.316 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:41:44.357 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:41:44.358 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-13T02:41:44.358 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:41:44.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T02:41:45.010 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:41:45.012 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:41:45.090 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T02:41:45.133 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:41:45.145 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:41:45.146 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:45.147 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-13T02:41:45.147 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:45.147 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:41:45.147 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:45.148 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:41:45.149 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:45.149 INFO:teuthology.orchestra.run.smithi142.stdout:Install 7 Packages 2024-09-13T02:41:45.149 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:45.149 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.0 M 2024-09-13T02:41:45.149 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 8.1 M 2024-09-13T02:41:45.149 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:41:45.241 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:41:45.276 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T02:41:45.379 INFO:teuthology.orchestra.run.smithi142.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 398 kB/s | 23 kB 00:00 2024-09-13T02:41:45.404 INFO:teuthology.orchestra.run.smithi142.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 175 kB/s | 15 kB 00:00 2024-09-13T02:41:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T02:41:45.462 INFO:teuthology.orchestra.run.smithi142.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 12 MB/s | 1.7 MB 00:00 2024-09-13T02:41:45.488 INFO:teuthology.orchestra.run.smithi142.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 83 kB/s | 9.0 kB 00:00 2024-09-13T02:41:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T02:41:45.522 INFO:teuthology.orchestra.run.smithi142.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 349 kB/s | 41 kB 00:00 2024-09-13T02:41:45.547 INFO:teuthology.orchestra.run.smithi142.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 382 kB/s | 31 kB 00:00 2024-09-13T02:41:45.571 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T02:41:45.572 INFO:teuthology.orchestra.run.smithi142.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-09-13T02:41:45.576 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:45.576 INFO:teuthology.orchestra.run.smithi142.stdout:Total 4.7 MB/s | 2.0 MB 00:00 2024-09-13T02:41:45.577 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:41:45.584 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:41:45.585 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:41:45.654 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:41:45.654 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:41:45.955 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:41:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T02:41:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T02:41:46.103 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T02:41:46.136 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T02:41:46.164 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-13T02:41:46.224 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T02:41:46.339 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T02:41:46.394 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-13T02:41:46.426 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-13T02:41:46.969 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-13T02:41:46.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-13T02:41:46.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-13T02:41:46.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-13T02:41:46.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T02:41:46.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T02:41:46.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T02:41:47.233 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T02:41:47.233 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:47.233 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:41:47.233 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-13T02:41:47.233 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-13T02:41:47.233 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-13T02:41:47.233 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T02:41:47.234 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T02:41:47.234 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T02:41:47.234 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T02:41:47.234 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:47.234 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:41:47.440 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T02:41:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:41:48.000 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:41:48.132 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:41:48.133 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:48.133 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-13T02:41:48.133 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:48.133 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:41:48.134 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-13T02:41:48.134 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T02:41:48.134 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T02:41:48.134 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T02:41:48.134 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T02:41:48.134 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:41:48.135 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:48.136 INFO:teuthology.orchestra.run.smithi142.stdout:Install 12 Packages 2024-09-13T02:41:48.136 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:48.136 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 38 M 2024-09-13T02:41:48.136 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 212 M 2024-09-13T02:41:48.136 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:41:48.470 INFO:teuthology.orchestra.run.smithi142.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 62 MB/s | 7.4 MB 00:00 2024-09-13T02:41:48.579 INFO:teuthology.orchestra.run.smithi142.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-13T02:41:48.616 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T02:41:48.650 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-13T02:41:48.829 INFO:teuthology.orchestra.run.smithi142.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-09-13T02:41:48.879 INFO:teuthology.orchestra.run.smithi142.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-13T02:41:48.929 INFO:teuthology.orchestra.run.smithi142.stdout:(5/12): libquadmath-11.5.0-2.el9.x86_64.rpm 330 kB/s | 191 kB 00:00 2024-09-13T02:41:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-13T02:41:49.014 INFO:teuthology.orchestra.run.smithi142.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-13T02:41:49.256 INFO:teuthology.orchestra.run.smithi142.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-09-13T02:41:49.289 INFO:teuthology.orchestra.run.smithi142.stdout:(9/12): libgfortran-11.5.0-2.el9.x86_64.rpm 854 kB/s | 801 kB 00:00 2024-09-13T02:41:49.315 INFO:teuthology.orchestra.run.smithi142.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 4.2 MB/s | 250 kB 00:00 2024-09-13T02:41:49.473 INFO:teuthology.orchestra.run.smithi142.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 9.1 MB/s | 4.9 MB 00:00 2024-09-13T02:41:50.223 INFO:teuthology.orchestra.run.smithi142.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-13T02:41:50.224 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:50.224 INFO:teuthology.orchestra.run.smithi142.stdout:Total 18 MB/s | 38 MB 00:02 2024-09-13T02:41:50.579 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:41:50.605 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:41:50.605 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:41:51.122 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:41:51.123 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:41:51.250 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-13T02:41:51.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-13T02:41:51.250 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:41:51.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:41:51.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T02:41:51.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T02:41:51.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T02:41:51.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T02:41:51.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T02:41:51.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T02:41:51.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:41:51.251 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T02:41:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T02:41:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:51.643 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:41:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-13T02:41:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T02:41:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T02:41:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T02:41:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T02:41:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T02:41:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T02:41:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T02:41:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T02:41:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T02:41:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T02:41:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T02:41:51.645 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:51.645 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:41:51.880 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:41:51.954 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T02:41:51.996 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-rook 2024-09-13T02:41:51.996 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:41:52.095 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:41:52.131 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T02:41:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T02:41:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T02:41:52.434 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T02:41:52.567 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:19 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:41:52.700 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:41:52.701 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-13T02:41:52.701 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T02:41:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T02:41:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T02:41:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T02:41:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T02:41:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T02:41:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:52.703 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:41:52.703 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:52.703 INFO:teuthology.orchestra.run.smithi098.stdout:Install 13 Packages 2024-09-13T02:41:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:52.704 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 2.2 M 2024-09-13T02:41:52.704 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 26 M 2024-09-13T02:41:52.704 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:41:52.926 INFO:teuthology.orchestra.run.smithi098.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 1.3 MB/s | 47 kB 00:00 2024-09-13T02:41:53.009 INFO:teuthology.orchestra.run.smithi098.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 213 kB/s | 26 kB 00:00 2024-09-13T02:41:53.043 INFO:teuthology.orchestra.run.smithi098.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 125 kB/s | 19 kB 00:00 2024-09-13T02:41:53.080 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T02:41:53.152 INFO:teuthology.orchestra.run.smithi098.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 986 kB/s | 222 kB 00:00 2024-09-13T02:41:53.177 INFO:teuthology.orchestra.run.smithi098.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-13T02:41:53.201 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T02:41:53.210 INFO:teuthology.orchestra.run.smithi098.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 915 kB/s | 54 kB 00:00 2024-09-13T02:41:53.236 INFO:teuthology.orchestra.run.smithi098.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-13T02:41:53.269 INFO:teuthology.orchestra.run.smithi098.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-13T02:41:53.303 INFO:teuthology.orchestra.run.smithi098.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 156 kB/s | 14 kB 00:00 2024-09-13T02:41:53.345 INFO:teuthology.orchestra.run.smithi098.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-13T02:41:53.387 INFO:teuthology.orchestra.run.smithi098.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 9.4 MB/s | 1.0 MB 00:00 2024-09-13T02:41:53.434 INFO:teuthology.orchestra.run.smithi098.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2024-09-13T02:41:53.471 INFO:teuthology.orchestra.run.smithi098.stdout:(13/13): python3-google-auth-2.34.0-1.el9.noarc 967 kB/s | 220 kB 00:00 2024-09-13T02:41:53.473 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:53.474 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-13T02:41:53.538 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:41:53.554 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:41:53.554 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:41:53.640 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:41:53.647 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:41:54.154 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:41:54.311 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T02:41:54.372 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T02:41:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T02:41:54.428 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:41:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T02:41:54.515 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T02:41:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T02:41:54.726 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T02:41:54.783 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T02:41:55.465 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T02:41:55.495 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-13T02:41:55.502 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T02:41:55.556 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T02:41:55.590 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T02:41:55.635 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T02:41:55.659 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-13T02:41:56.438 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T02:41:56.439 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T02:41:56.440 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T02:41:56.773 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T02:41:56.773 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:56.773 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:41:56.773 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-13T02:41:56.773 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T02:41:56.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T02:41:56.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T02:41:56.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T02:41:56.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T02:41:56.774 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T02:41:56.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T02:41:56.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T02:41:56.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T02:41:56.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T02:41:56.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T02:41:56.775 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T02:41:56.776 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:56.776 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:41:56.995 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T02:41:57.556 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:41:57.688 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:41:57.689 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-13T02:41:57.689 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:57.689 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout:Install 6 Packages 2024-09-13T02:41:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:41:57.691 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 7.0 M 2024-09-13T02:41:57.691 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 33 M 2024-09-13T02:41:57.691 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:41:57.984 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-13T02:41:57.984 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-13T02:41:57.984 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:41:57.984 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:41:57.984 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T02:41:57.984 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T02:41:57.984 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T02:41:57.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T02:41:57.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T02:41:57.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T02:41:57.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:41:57.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T02:41:58.039 INFO:teuthology.orchestra.run.smithi098.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.7 MB/s | 127 kB 00:00 2024-09-13T02:41:58.158 INFO:teuthology.orchestra.run.smithi098.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.5 MB/s | 548 kB 00:00 2024-09-13T02:41:58.191 INFO:teuthology.orchestra.run.smithi098.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-13T02:41:58.216 INFO:teuthology.orchestra.run.smithi098.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-13T02:41:58.367 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T02:41:58.367 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:58.367 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:41:58.367 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-13T02:41:58.367 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T02:41:58.367 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T02:41:58.367 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T02:41:58.367 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T02:41:58.367 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T02:41:58.368 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T02:41:58.368 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T02:41:58.368 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T02:41:58.368 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T02:41:58.368 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T02:41:58.368 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T02:41:58.368 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:58.368 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:41:58.600 INFO:teuthology.orchestra.run.smithi098.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 391 kB/s | 248 kB 00:00 2024-09-13T02:41:58.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-rook 2024-09-13T02:41:59.311 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:07 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:41:59.400 INFO:teuthology.orchestra.run.smithi098.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-09-13T02:41:59.402 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:59.403 INFO:teuthology.orchestra.run.smithi098.stdout:Total 4.1 MB/s | 7.0 MB 00:01 2024-09-13T02:41:59.445 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:41:59.446 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:59.446 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-13T02:41:59.446 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:59.446 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:41:59.446 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-13T02:41:59.446 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T02:41:59.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T02:41:59.446 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:41:59.447 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:41:59.448 INFO:teuthology.orchestra.run.smithi142.stdout:Install 13 Packages 2024-09-13T02:41:59.448 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:41:59.448 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.2 M 2024-09-13T02:41:59.448 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 26 M 2024-09-13T02:41:59.448 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:41:59.475 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:41:59.487 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:41:59.487 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:41:59.554 INFO:teuthology.orchestra.run.smithi142.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-09-13T02:41:59.587 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:41:59.588 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:41:59.646 INFO:teuthology.orchestra.run.smithi142.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 206 kB/s | 26 kB 00:00 2024-09-13T02:41:59.671 INFO:teuthology.orchestra.run.smithi142.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 128 kB/s | 19 kB 00:00 2024-09-13T02:41:59.780 INFO:teuthology.orchestra.run.smithi142.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 985 kB/s | 222 kB 00:00 2024-09-13T02:41:59.805 INFO:teuthology.orchestra.run.smithi142.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-13T02:41:59.839 INFO:teuthology.orchestra.run.smithi142.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 913 kB/s | 54 kB 00:00 2024-09-13T02:41:59.864 INFO:teuthology.orchestra.run.smithi142.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-13T02:41:59.897 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:41:59.898 INFO:teuthology.orchestra.run.smithi142.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 348 kB/s | 32 kB 00:00 2024-09-13T02:41:59.931 INFO:teuthology.orchestra.run.smithi142.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 156 kB/s | 14 kB 00:00 2024-09-13T02:41:59.965 INFO:teuthology.orchestra.run.smithi142.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-09-13T02:41:59.999 INFO:teuthology.orchestra.run.smithi142.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-13T02:42:00.024 INFO:teuthology.orchestra.run.smithi142.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.4 MB/s | 220 kB 00:00 2024-09-13T02:42:00.057 INFO:teuthology.orchestra.run.smithi142.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-13T02:42:00.058 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T02:42:00.059 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:00.060 INFO:teuthology.orchestra.run.smithi142.stdout:Total 3.6 MB/s | 2.2 MB 00:00 2024-09-13T02:42:00.110 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T02:42:00.123 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:42:00.139 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:42:00.139 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:42:00.228 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:42:00.228 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:42:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T02:42:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T02:42:00.732 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:42:00.788 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T02:42:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-13T02:42:00.896 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T02:42:00.958 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T02:42:01.022 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T02:42:01.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T02:42:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T02:42:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T02:42:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T02:42:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T02:42:01.545 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-13T02:42:01.545 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-13T02:42:01.545 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T02:42:01.545 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T02:42:01.545 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T02:42:01.546 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:01.798 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:02.023 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-fuse 2024-09-13T02:42:02.084 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T02:42:02.141 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T02:42:02.175 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T02:42:02.220 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T02:42:02.244 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-13T02:42:02.584 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:02.717 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:02.718 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:02.718 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:02.718 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:02.718 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:42:02.718 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-13T02:42:02.718 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-13T02:42:02.718 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T02:42:02.718 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:02.718 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:42:02.719 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:02.719 INFO:teuthology.orchestra.run.smithi098.stdout:Install 2 Packages 2024-09-13T02:42:02.719 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:02.719 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 914 k 2024-09-13T02:42:02.719 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 2.7 M 2024-09-13T02:42:02.719 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:42:02.803 INFO:teuthology.orchestra.run.smithi098.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 14 MB/s | 835 kB 00:00 2024-09-13T02:42:02.844 INFO:teuthology.orchestra.run.smithi098.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 802 kB/s | 80 kB 00:00 2024-09-13T02:42:02.845 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:02.845 INFO:teuthology.orchestra.run.smithi098.stdout:Total 7.0 MB/s | 914 kB 00:00 2024-09-13T02:42:02.857 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:42:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:42:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:42:02.960 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:42:02.960 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:42:03.073 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-13T02:42:03.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-13T02:42:03.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T02:42:03.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T02:42:03.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T02:42:03.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T02:42:03.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T02:42:03.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T02:42:03.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T02:42:03.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T02:42:03.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T02:42:03.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T02:42:03.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T02:42:03.144 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:42:03.292 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T02:42:03.359 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-13T02:42:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T02:42:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:03.397 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:42:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-13T02:42:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T02:42:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T02:42:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T02:42:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T02:42:03.397 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T02:42:03.398 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T02:42:03.398 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T02:42:03.398 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T02:42:03.398 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T02:42:03.398 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T02:42:03.398 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T02:42:03.398 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T02:42:03.398 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:03.398 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:03.647 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T02:42:04.022 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-13T02:42:04.022 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-13T02:42:04.244 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:12 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:04.278 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T02:42:04.278 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:04.278 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:42:04.278 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T02:42:04.278 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:04.279 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:04.385 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:04.386 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-13T02:42:04.386 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:04.386 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:42:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-13T02:42:04.386 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T02:42:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T02:42:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T02:42:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T02:42:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T02:42:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T02:42:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:04.387 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:42:04.387 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:04.387 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2024-09-13T02:42:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:04.388 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 7.0 M 2024-09-13T02:42:04.388 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 33 M 2024-09-13T02:42:04.388 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:42:04.500 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 2.0 MB/s | 127 kB 00:00 2024-09-13T02:42:04.567 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados-devel 2024-09-13T02:42:04.584 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-13T02:42:04.618 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-13T02:42:04.651 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-13T02:42:04.676 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-13T02:42:05.149 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:05.287 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 126 k 2024-09-13T02:42:05.288 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 456 k 2024-09-13T02:42:05.289 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:42:05.341 INFO:teuthology.orchestra.run.smithi098.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.4 MB/s | 126 kB 00:00 2024-09-13T02:42:05.341 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:05.342 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.3 MB/s | 126 kB 00:00 2024-09-13T02:42:05.342 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:42:05.347 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:42:05.347 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:42:05.411 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:42:05.411 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:42:05.567 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:42:05.663 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:06.035 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2024-09-13T02:42:06.037 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:06.037 INFO:teuthology.orchestra.run.smithi142.stdout:Total 4.2 MB/s | 7.0 MB 00:01 2024-09-13T02:42:06.087 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:06.107 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:42:06.118 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:42:06.119 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:42:06.219 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:42:06.219 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:42:06.330 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:06.331 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:06.331 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:42:06.331 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:06.331 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:06.331 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:42:06.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs2 2024-09-13T02:42:06.710 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T02:42:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T02:42:07.136 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:07.228 INFO:teuthology.orchestra.run.smithi098.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:07.272 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:07.273 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-13T02:42:07.273 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:07.290 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T02:42:07.337 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs-devel 2024-09-13T02:42:07.373 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T02:42:07.432 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T02:42:07.457 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-13T02:42:07.895 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:08.029 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-13T02:42:08.030 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:08.031 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 30 k 2024-09-13T02:42:08.031 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 137 k 2024-09-13T02:42:08.031 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:42:08.079 INFO:teuthology.orchestra.run.smithi098.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 633 kB/s | 30 kB 00:00 2024-09-13T02:42:08.079 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:08.080 INFO:teuthology.orchestra.run.smithi098.stdout:Total 615 kB/s | 30 kB 00:00 2024-09-13T02:42:08.080 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:42:08.083 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:42:08.084 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:42:08.100 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:42:08.100 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:42:08.194 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-13T02:42:08.194 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-13T02:42:08.194 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T02:42:08.195 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T02:42:08.195 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T02:42:08.195 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T02:42:08.197 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:42:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T02:42:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:08.462 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:42:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-13T02:42:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T02:42:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T02:42:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T02:42:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T02:42:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T02:42:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:08.463 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:08.660 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:08.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-fuse 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:09.069 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados2 2024-09-13T02:42:09.312 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:09.445 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:09.446 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:09.446 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:09.446 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:42:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-13T02:42:09.446 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-13T02:42:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T02:42:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:09.446 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:42:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2024-09-13T02:42:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 914 k 2024-09-13T02:42:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 2.7 M 2024-09-13T02:42:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:42:09.631 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:09.636 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 13 MB/s | 835 kB 00:00 2024-09-13T02:42:09.720 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:09.763 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:09.764 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-13T02:42:09.764 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:09.834 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librbd1 2024-09-13T02:42:09.945 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 215 kB/s | 80 kB 00:00 2024-09-13T02:42:09.945 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:09.946 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.8 MB/s | 914 kB 00:00 2024-09-13T02:42:09.958 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:42:09.981 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:42:09.981 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:42:10.065 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:42:10.065 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:42:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:42:10.394 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T02:42:10.460 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-13T02:42:10.483 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:10.526 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:10.526 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-13T02:42:10.527 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:10.585 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rados 2024-09-13T02:42:11.148 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:11.149 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-13T02:42:11.149 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-13T02:42:11.240 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:11.282 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:11.283 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-13T02:42:11.283 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:11.344 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rgw 2024-09-13T02:42:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T02:42:11.661 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:11.661 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:42:11.661 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T02:42:11.661 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:11.661 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:11.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados-devel 2024-09-13T02:42:11.907 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:11.997 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:12.040 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:12.041 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-13T02:42:12.041 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:12.105 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-cephfs 2024-09-13T02:42:12.273 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:20 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:12.410 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-13T02:42:12.411 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:12.411 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 126 k 2024-09-13T02:42:12.411 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 456 k 2024-09-13T02:42:12.411 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:42:12.466 INFO:teuthology.orchestra.run.smithi142.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.2 MB/s | 126 kB 00:00 2024-09-13T02:42:12.467 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:12.467 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.2 MB/s | 126 kB 00:00 2024-09-13T02:42:12.467 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:42:12.472 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:42:12.472 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:42:12.536 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:42:12.536 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:42:12.669 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:12.685 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:42:12.760 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:12.802 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:12.803 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-13T02:42:12.803 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:12.871 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rbd 2024-09-13T02:42:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:13.435 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:13.461 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:42:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:13.461 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:13.526 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:13.568 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:13.570 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-13T02:42:13.570 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:13.633 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-fuse 2024-09-13T02:42:13.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs2 2024-09-13T02:42:14.197 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:14.329 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:14.330 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 86 k 2024-09-13T02:42:14.331 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 230 k 2024-09-13T02:42:14.331 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:42:14.332 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:22 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:14.382 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.6 MB/s | 86 kB 00:00 2024-09-13T02:42:14.383 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:14.383 INFO:teuthology.orchestra.run.smithi098.stdout:Total 1.6 MB/s | 86 kB 00:00 2024-09-13T02:42:14.383 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:42:14.389 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:42:14.390 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:42:14.428 INFO:teuthology.orchestra.run.smithi142.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:14.455 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:42:14.455 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:42:14.472 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:14.473 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-13T02:42:14.473 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:14.565 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs-devel 2024-09-13T02:42:14.600 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:42:14.688 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:15.055 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:15.130 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:23 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:15.263 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:15.263 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:15.263 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:15.263 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 30 k 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 137 k 2024-09-13T02:42:15.264 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:42:15.305 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:15.305 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:15.305 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:42:15.306 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:15.306 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:15.306 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:15.311 INFO:teuthology.orchestra.run.smithi142.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 652 kB/s | 30 kB 00:00 2024-09-13T02:42:15.311 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:15.312 INFO:teuthology.orchestra.run.smithi142.stdout:Total 634 kB/s | 30 kB 00:00 2024-09-13T02:42:15.312 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:42:15.315 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:42:15.315 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:42:15.338 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:42:15.338 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:42:15.426 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:42:15.516 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-mirror 2024-09-13T02:42:15.532 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:15.915 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:16.092 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:16.134 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:16.134 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:16.134 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:42:16.134 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:16.134 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:16.134 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:16.227 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-13T02:42:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:16.229 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 3.0 M 2024-09-13T02:42:16.229 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 12 M 2024-09-13T02:42:16.229 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:42:16.318 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 33 MB/s | 3.0 MB 00:00 2024-09-13T02:42:16.319 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:16.319 INFO:teuthology.orchestra.run.smithi098.stdout:Total 33 MB/s | 3.0 MB 00:00 2024-09-13T02:42:16.320 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:42:16.328 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:42:16.328 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:42:16.332 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados2 2024-09-13T02:42:16.408 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:42:16.409 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:42:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:42:16.901 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:16.990 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:16.995 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:17.019 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:17.019 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:42:17.019 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T02:42:17.019 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:42:17.019 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:42:17.020 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:17.033 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:17.034 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-13T02:42:17.034 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:17.114 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librbd1 2024-09-13T02:42:17.678 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:25 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:17.770 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:17.813 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:17.813 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-13T02:42:17.814 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:17.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rados 2024-09-13T02:42:17.924 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:17.924 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:17.924 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:42:17.925 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:17.925 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:17.925 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:18.174 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-nbd 2024-09-13T02:42:18.466 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:18.557 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:18.599 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:18.600 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-13T02:42:18.600 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:18.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rgw 2024-09-13T02:42:18.752 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:45 ago on Fri 13 Sep 2024 02:40:33 AM UTC. 2024-09-13T02:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-13T02:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-13T02:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-13T02:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-13T02:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-13T02:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-13T02:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 169 k 2024-09-13T02:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 490 k 2024-09-13T02:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-13T02:42:18.932 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 4.0 MB/s | 169 kB 00:00 2024-09-13T02:42:18.933 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:18.933 INFO:teuthology.orchestra.run.smithi098.stdout:Total 3.8 MB/s | 169 kB 00:00 2024-09-13T02:42:18.933 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-13T02:42:18.940 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-13T02:42:18.940 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-13T02:42:19.003 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-13T02:42:19.003 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-13T02:42:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-13T02:42:19.254 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:19.346 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:19.390 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:19.391 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-13T02:42:19.391 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:19.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-cephfs 2024-09-13T02:42:19.645 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:19.909 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:19.910 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:19.910 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-13T02:42:19.910 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:19.910 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:19.910 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-13T02:42:20.056 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:20.147 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:20.164 DEBUG:teuthology.parallel:result is None 2024-09-13T02:42:20.189 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:20.190 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-13T02:42:20.190 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:20.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rbd 2024-09-13T02:42:20.835 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:20.927 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-13T02:42:20.970 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:20.971 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-13T02:42:20.971 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:21.055 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-fuse 2024-09-13T02:42:21.617 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:21.749 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:21.750 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 86 k 2024-09-13T02:42:21.751 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 230 k 2024-09-13T02:42:21.752 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:42:21.797 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.8 MB/s | 86 kB 00:00 2024-09-13T02:42:21.798 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:21.798 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.8 MB/s | 86 kB 00:00 2024-09-13T02:42:21.798 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:42:21.805 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:42:21.805 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:42:21.868 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:42:21.868 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:42:22.029 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:42:22.128 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:22.526 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:22.788 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:22.788 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:22.788 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:42:22.788 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:22.788 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:22.788 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:23.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-mirror 2024-09-13T02:42:23.632 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:23.769 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:23.769 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:23.769 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:23.769 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:23.769 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:42:23.769 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-13T02:42:23.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:23.770 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:42:23.770 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:23.770 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-13T02:42:23.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:23.770 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 3.0 M 2024-09-13T02:42:23.770 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 12 M 2024-09-13T02:42:23.770 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:42:23.850 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 36 MB/s | 3.0 MB 00:00 2024-09-13T02:42:23.851 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:23.852 INFO:teuthology.orchestra.run.smithi142.stdout:Total 36 MB/s | 3.0 MB 00:00 2024-09-13T02:42:23.852 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:42:23.861 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:42:23.861 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:42:23.940 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:42:23.940 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:42:24.369 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:42:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:24.568 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:42:24.568 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T02:42:24.568 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:42:24.569 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:42:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:25.535 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:42:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:25.535 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:25.787 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-nbd 2024-09-13T02:42:26.361 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 02:40:52 AM UTC. 2024-09-13T02:42:26.497 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-13T02:42:26.497 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:26.497 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-13T02:42:26.497 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:26.497 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-13T02:42:26.497 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-13T02:42:26.498 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:26.498 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-13T02:42:26.498 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-13T02:42:26.498 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-13T02:42:26.498 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:26.498 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 169 k 2024-09-13T02:42:26.498 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 490 k 2024-09-13T02:42:26.498 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-13T02:42:26.537 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 4.0 MB/s | 169 kB 00:00 2024-09-13T02:42:26.538 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:26.538 INFO:teuthology.orchestra.run.smithi142.stdout:Total 3.9 MB/s | 169 kB 00:00 2024-09-13T02:42:26.538 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-13T02:42:26.546 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-13T02:42:26.546 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-13T02:42:26.608 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-13T02:42:26.608 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-13T02:42:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-13T02:42:26.887 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:27.275 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-13T02:42:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:27.529 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-13T02:42:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-13T02:42:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:42:27.529 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-13T02:42:27.773 DEBUG:teuthology.parallel:result is None 2024-09-13T02:42:27.773 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T02:42:27.773 INFO:teuthology.packaging:ref: None 2024-09-13T02:42:27.773 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T02:42:27.773 INFO:teuthology.packaging:branch: None 2024-09-13T02:42:27.773 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:42:27.774 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T02:42:27.921 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T02:42:27.949 INFO:teuthology.orchestra.run.smithi098.stdout:18.2.0-0.el9 2024-09-13T02:42:27.949 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-13T02:42:27.949 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-13T02:42:27.951 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T02:42:27.951 INFO:teuthology.packaging:ref: None 2024-09-13T02:42:27.951 INFO:teuthology.packaging:tag: v18.2.0 2024-09-13T02:42:27.951 INFO:teuthology.packaging:branch: None 2024-09-13T02:42:27.951 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:42:27.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-13T02:42:28.091 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T02:42:28.113 INFO:teuthology.orchestra.run.smithi142.stdout:18.2.0-0.el9 2024-09-13T02:42:28.114 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-13T02:42:28.114 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-13T02:42:28.115 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T02:42:28.116 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:42:28.116 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T02:42:28.147 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:42:28.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T02:42:28.180 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T02:42:28.180 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:42:28.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T02:42:28.216 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T02:42:28.284 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:42:28.284 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T02:42:28.308 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T02:42:28.373 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T02:42:28.374 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:42:28.374 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T02:42:28.402 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T02:42:28.470 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:42:28.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T02:42:28.495 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T02:42:28.562 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T02:42:28.562 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:42:28.563 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T02:42:28.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T02:42:28.656 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:42:28.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T02:42:28.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T02:42:28.747 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:42:28.758 INFO:teuthology.task.print:**** done install task... 2024-09-13T02:42:28.758 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T02:42:28.882 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'} 2024-09-13T02:42:28.882 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-09-13T02:42:28.882 INFO:tasks.cephadm:Cluster fsid is d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:42:28.883 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T02:42:28.883 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T02:42:28.883 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi098': '172.21.15.98', 'mon.smithi142': '172.21.15.142'} 2024-09-13T02:42:28.883 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T02:42:28.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2024-09-13T02:42:28.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname $(hostname -s) 2024-09-13T02:42:28.936 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-13T02:42:28.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:42:29.074 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56065/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-322-g7741f7f9', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-322.g7741f7f9'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-12 21:04:56.865621', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-13T02:42:29.297 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref reef, sha1 2c01458affee2b2435cd231b6e392435c1c21661 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-13T02:42:29.299 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/x86_64/flavors/default/cephadm 2024-09-13T02:42:29.299 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/x86_64/flavors/default/cephadm 2024-09-13T02:42:29.299 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T02:42:29.676 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-r--r--. 1 ubuntu ubuntu 217218 Sep 13 02:42 /home/ubuntu/cephtest/cephadm 2024-09-13T02:42:29.676 DEBUG:teuthology.orchestra.run.smithi142:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/2c01458affee2b2435cd231b6e392435c1c21661/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T02:42:30.022 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r--. 1 ubuntu ubuntu 217218 Sep 13 02:42 /home/ubuntu/cephtest/cephadm 2024-09-13T02:42:30.022 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T02:42:30.042 DEBUG:teuthology.orchestra.run.smithi142:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T02:42:30.072 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-09-13T02:42:30.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-13T02:42:30.085 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-13T02:42:31.605 INFO:teuthology.orchestra.run.smithi098.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-13T02:42:31.734 INFO:teuthology.orchestra.run.smithi142.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-13T02:42:43.905 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:42:43.905 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-13T02:42:43.905 INFO:teuthology.orchestra.run.smithi098.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-13T02:42:43.905 INFO:teuthology.orchestra.run.smithi098.stdout: "repo_digests": [ 2024-09-13T02:42:43.905 INFO:teuthology.orchestra.run.smithi098.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-13T02:42:43.906 INFO:teuthology.orchestra.run.smithi098.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-13T02:42:43.906 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-13T02:42:43.906 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:42:44.380 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-09-13T02:42:44.380 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-13T02:42:44.381 INFO:teuthology.orchestra.run.smithi142.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-13T02:42:44.381 INFO:teuthology.orchestra.run.smithi142.stdout: "repo_digests": [ 2024-09-13T02:42:44.381 INFO:teuthology.orchestra.run.smithi142.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-13T02:42:44.381 INFO:teuthology.orchestra.run.smithi142.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-13T02:42:44.381 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-09-13T02:42:44.381 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-09-13T02:42:44.399 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2024-09-13T02:42:44.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph 2024-09-13T02:42:44.460 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2024-09-13T02:42:44.499 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /etc/ceph 2024-09-13T02:42:44.525 INFO:tasks.cephadm:Writing seed config... 2024-09-13T02:42:44.526 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T02:42:44.527 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T02:42:44.528 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T02:42:44.529 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T02:42:44.530 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-13T02:42:44.530 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T02:42:44.530 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T02:42:44.530 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:42:44.530 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T02:42:44.556 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d155f688-7179-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T02:42:44.556 DEBUG:teuthology.orchestra.run.smithi098:mon.smithi098> sudo journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098.service 2024-09-13T02:42:44.599 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T02:42:44.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid d155f688-7179-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.98 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T02:42:44.755 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:44.755 INFO:teuthology.orchestra.run.smithi098.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', 'd155f688-7179-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.98', '--skip-admin-label'] 2024-09-13T02:42:44.778 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stdout 5.2.2 2024-09-13T02:42:44.779 INFO:teuthology.orchestra.run.smithi098.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T02:42:44.779 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying podman|docker is present... 2024-09-13T02:42:44.801 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stdout 5.2.2 2024-09-13T02:42:44.801 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying lvm2 is present... 2024-09-13T02:42:44.802 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying time synchronization is in place... 2024-09-13T02:42:44.809 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T02:42:44.809 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T02:42:44.815 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T02:42:44.815 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-13T02:42:44.821 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout enabled 2024-09-13T02:42:44.828 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout active 2024-09-13T02:42:44.828 INFO:teuthology.orchestra.run.smithi098.stdout:Unit chronyd.service is enabled and running 2024-09-13T02:42:44.828 INFO:teuthology.orchestra.run.smithi098.stdout:Repeating the final host check... 2024-09-13T02:42:44.850 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stdout 5.2.2 2024-09-13T02:42:44.850 INFO:teuthology.orchestra.run.smithi098.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T02:42:44.850 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl is present 2024-09-13T02:42:44.850 INFO:teuthology.orchestra.run.smithi098.stdout:lvcreate is present 2024-09-13T02:42:44.856 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T02:42:44.856 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T02:42:44.862 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T02:42:44.862 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-13T02:42:44.869 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout enabled 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout active 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi098.stdout:Unit chronyd.service is enabled and running 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi098.stdout:Host looks OK 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi098.stdout:Cluster fsid: d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi098.stdout:Acquiring lock 139880955909456 on /run/cephadm/d155f688-7179-11ef-bceb-c7b262605968.lock 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi098.stdout:Lock 139880955909456 acquired on /run/cephadm/d155f688-7179-11ef-bceb-c7b262605968.lock 2024-09-13T02:42:44.876 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying IP 172.21.15.98 port 3300 ... 2024-09-13T02:42:44.876 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying IP 172.21.15.98 port 6789 ... 2024-09-13T02:42:44.876 INFO:teuthology.orchestra.run.smithi098.stdout:Base mon IP(s) is [172.21.15.98:3300, 172.21.15.98:6789], mon addrv is [v2:172.21.15.98:3300,v1:172.21.15.98:6789] 2024-09-13T02:42:44.879 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.98 metric 100 2024-09-13T02:42:44.879 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.98 metric 100 2024-09-13T02:42:44.882 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T02:42:44.882 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T02:42:44.882 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T02:42:44.884 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T02:42:44.884 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T02:42:44.884 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T02:42:44.885 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T02:42:44.885 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-13T02:42:44.885 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T02:42:44.885 INFO:teuthology.orchestra.run.smithi098.stdout:Mon IP `172.21.15.98` is in CIDR network `172.21.0.0/20` 2024-09-13T02:42:44.885 INFO:teuthology.orchestra.run.smithi098.stdout:Mon IP `172.21.15.98` is in CIDR network `172.21.0.0/20` 2024-09-13T02:42:44.885 INFO:teuthology.orchestra.run.smithi098.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T02:42:44.886 INFO:teuthology.orchestra.run.smithi098.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T02:42:44.886 INFO:teuthology.orchestra.run.smithi098.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-13T02:42:45.642 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-13T02:42:45.642 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-09-13T02:42:45.642 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T02:42:45.642 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-09-13T02:42:45.642 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-09-13T02:42:45.643 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-13T02:42:45.643 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T02:42:46.513 INFO:teuthology.orchestra.run.smithi098.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-13T02:42:46.513 INFO:teuthology.orchestra.run.smithi098.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-13T02:42:46.514 INFO:teuthology.orchestra.run.smithi098.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T02:42:47.402 INFO:teuthology.orchestra.run.smithi098.stdout:stat: stdout 167 167 2024-09-13T02:42:47.402 INFO:teuthology.orchestra.run.smithi098.stdout:Creating initial keys... 2024-09-13T02:42:48.300 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph-authtool: stdout AQCnpuNm7cVcKRAA64mENGM2kkflAiSTOOmp4A== 2024-09-13T02:42:49.274 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph-authtool: stdout AQCopuNm5NTGIhAATl2eZFED1PgpxhjvkFG6mQ== 2024-09-13T02:42:50.164 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph-authtool: stdout AQCppuNmHwC+IBAAXo4syoO433J6y2zVrCQQcg== 2024-09-13T02:42:50.164 INFO:teuthology.orchestra.run.smithi098.stdout:Creating initial monmap... 2024-09-13T02:42:51.037 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T02:42:51.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T02:42:51.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:42:51.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T02:42:51.038 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool for smithi098 [v2:172.21.15.98:3300,v1:172.21.15.98:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T02:42:51.038 INFO:teuthology.orchestra.run.smithi098.stdout:setting min_mon_release = pacific 2024-09-13T02:42:51.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: set fsid to d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:42:51.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T02:42:51.038 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:42:51.038 INFO:teuthology.orchestra.run.smithi098.stdout:Creating mon... 2024-09-13T02:42:51.919 INFO:teuthology.orchestra.run.smithi098.stdout:create mon.smithi098 on 2024-09-13T02:42:52.115 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T02:42:52.257 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T02:42:52.746 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d155f688-7179-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d155f688-7179-11ef-bceb-c7b262605968.target. 2024-09-13T02:42:52.746 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d155f688-7179-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d155f688-7179-11ef-bceb-c7b262605968.target. 2024-09-13T02:42:53.450 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098 2024-09-13T02:42:53.451 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098.service: Unit ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098.service not loaded. 2024-09-13T02:42:53.744 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d155f688-7179-11ef-bceb-c7b262605968.target.wants/ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098.service → /etc/systemd/system/ceph-d155f688-7179-11ef-bceb-c7b262605968@.service. 2024-09-13T02:42:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:53 smithi098 podman[27489]: 2024-09-13 02:42:53.879583718 +0000 UTC m=+0.015498399 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-09-13T02:42:55.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:54 smithi098 podman[27489]: 2024-09-13 02:42:54.883415121 +0000 UTC m=+1.019329802 container create cb73042d08694f7a2610b547f2d47264b6f5c2900dae908ae5654b083a31ae3f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_CLEAN=True, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T02:42:57.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:56 smithi098 podman[27489]: 2024-09-13 02:42:56.831641227 +0000 UTC m=+2.967555917 container init cb73042d08694f7a2610b547f2d47264b6f5c2900dae908ae5654b083a31ae3f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD) 2024-09-13T02:42:57.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:56 smithi098 podman[27489]: 2024-09-13 02:42:56.836012736 +0000 UTC m=+2.971927417 container start cb73042d08694f7a2610b547f2d47264b6f5c2900dae908ae5654b083a31ae3f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T02:42:57.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:56 smithi098 ceph-mon[27509]: mkfs d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:42:57.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:56 smithi098 ceph-mon[27509]: mon.smithi098 is new leader, mons smithi098 in quorum (ranks 0) 2024-09-13T02:42:57.696 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:42:57.696 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout disabled 2024-09-13T02:42:57.704 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:42:57.704 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-13T02:42:57.705 INFO:teuthology.orchestra.run.smithi098.stdout:firewalld.service is not enabled 2024-09-13T02:42:57.705 INFO:teuthology.orchestra.run.smithi098.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T02:42:57.705 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mon to start... 2024-09-13T02:42:57.705 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mon... 2024-09-13T02:42:57.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:57 smithi098 bash[27489]: cb73042d08694f7a2610b547f2d47264b6f5c2900dae908ae5654b083a31ae3f 2024-09-13T02:42:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:57 smithi098 systemd[1]: Started Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:42:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:57 smithi098 ceph-mon[27509]: mon.smithi098 is new leader, mons smithi098 in quorum (ranks 0) 2024-09-13T02:42:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:57 smithi098 ceph-mon[27509]: monmap e1: 1 mons at {smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0]} removed_ranks: {} 2024-09-13T02:42:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:57 smithi098 ceph-mon[27509]: fsmap 2024-09-13T02:42:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:57 smithi098 ceph-mon[27509]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T02:42:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:42:57 smithi098 ceph-mon[27509]: mgrmap e1: no daemons active 2024-09-13T02:43:01.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:01 smithi098 ceph-mon[27509]: from='client.? 172.21.15.98:0/2783403617' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T02:43:03.467 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T02:43:03.467 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout id: d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout services: 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi098 (age 4s) 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout data: 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T02:43:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.102+0000 7f2fab7ba700 1 Processor -- start 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.102+0000 7f2fab7ba700 1 -- start start 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.103+0000 7f2fab7ba700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa4079d20 0x7f2fa4108720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.103+0000 7f2fab7ba700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4108c60 con 0x7f2fa4079d20 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.103+0000 7f2fa9556700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa4079d20 0x7f2fa4108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.103+0000 7f2fa9556700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa4079d20 0x7f2fa4108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33946/0 (socket says 172.21.15.98:33946) 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.103+0000 7f2fa9556700 1 -- 172.21.15.98:0/3734404888 learned_addr learned my addr 172.21.15.98:0/3734404888 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.103+0000 7f2fa9556700 1 -- 172.21.15.98:0/3734404888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa4108da0 con 0x7f2fa4079d20 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.103+0000 7f2fa9556700 1 --2- 172.21.15.98:0/3734404888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa4079d20 0x7f2fa4108720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00098a0 tx=0x7f2fa0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e921002f46a7a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2f9bfff700 1 -- 172.21.15.98:0/3734404888 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa0004180 con 0x7f2fa4079d20 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2f9bfff700 1 -- 172.21.15.98:0/3734404888 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa00042e0 con 0x7f2fa4079d20 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2f9bfff700 1 -- 172.21.15.98:0/3734404888 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa00036a0 con 0x7f2fa4079d20 2024-09-13T02:43:03.469 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2fab7ba700 1 -- 172.21.15.98:0/3734404888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa4079d20 msgr2=0x7f2fa4108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2fab7ba700 1 --2- 172.21.15.98:0/3734404888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa4079d20 0x7f2fa4108720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00098a0 tx=0x7f2fa0009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2fab7ba700 1 -- 172.21.15.98:0/3734404888 shutdown_connections 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2fab7ba700 1 --2- 172.21.15.98:0/3734404888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa4079d20 0x7f2fa4108720 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2fab7ba700 1 -- 172.21.15.98:0/3734404888 >> 172.21.15.98:0/3734404888 conn(0x7f2fa41000f0 msgr2=0x7f2fa4102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2fab7ba700 1 -- 172.21.15.98:0/3734404888 shutdown_connections 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.104+0000 7f2fab7ba700 1 -- 172.21.15.98:0/3734404888 wait complete. 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.105+0000 7f2fab7ba700 1 Processor -- start 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.105+0000 7f2fab7ba700 1 -- start start 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.105+0000 7f2fab7ba700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa41990a0 0x7f2fa41994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.105+0000 7f2fab7ba700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa41999f0 con 0x7f2fa41990a0 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.105+0000 7f2fa9556700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa41990a0 0x7f2fa41994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:03.470 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.105+0000 7f2fa9556700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa41990a0 0x7f2fa41994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33956/0 (socket says 172.21.15.98:33956) 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.105+0000 7f2fa9556700 1 -- 172.21.15.98:0/2783403617 learned_addr learned my addr 172.21.15.98:0/2783403617 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.105+0000 7f2fa9556700 1 -- 172.21.15.98:0/2783403617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa0009550 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.105+0000 7f2fa9556700 1 --2- 172.21.15.98:0/2783403617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa41990a0 0x7f2fa41994b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0004000 tx=0x7f2fa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.106+0000 7f2f9a7fc700 1 -- 172.21.15.98:0/2783403617 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa0003ce0 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.106+0000 7f2f9a7fc700 1 -- 172.21.15.98:0/2783403617 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa0020070 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.106+0000 7f2fab7ba700 1 -- 172.21.15.98:0/2783403617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa4199bf0 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.106+0000 7f2f9a7fc700 1 -- 172.21.15.98:0/2783403617 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa0011630 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.106+0000 7f2fab7ba700 1 -- 172.21.15.98:0/2783403617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa419c850 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.106+0000 7f2f9a7fc700 1 -- 172.21.15.98:0/2783403617 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2fa0022030 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.106+0000 7f2f9a7fc700 1 -- 172.21.15.98:0/2783403617 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2fa0025d40 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.107+0000 7f2fab7ba700 1 -- 172.21.15.98:0/2783403617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa4192e70 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.109+0000 7f2f9a7fc700 1 -- 172.21.15.98:0/2783403617 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f2fa0025480 con 0x7f2fa41990a0 2024-09-13T02:43:03.471 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.178+0000 7f2fab7ba700 1 -- 172.21.15.98:0/2783403617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f2fa4079d20 con 0x7f2fa41990a0 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.178+0000 7f2f9a7fc700 1 -- 172.21.15.98:0/2783403617 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+318 (secure 0 0 0) 0x7f2fa0011c20 con 0x7f2fa41990a0 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.179+0000 7f2fab7ba700 1 -- 172.21.15.98:0/2783403617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa41990a0 msgr2=0x7f2fa41994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.179+0000 7f2fab7ba700 1 --2- 172.21.15.98:0/2783403617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa41990a0 0x7f2fa41994b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0004000 tx=0x7f2fa0004750 comp rx=0 tx=0).stop 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.179+0000 7f2fab7ba700 1 -- 172.21.15.98:0/2783403617 shutdown_connections 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.179+0000 7f2fab7ba700 1 --2- 172.21.15.98:0/2783403617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fa41990a0 0x7f2fa41994b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.179+0000 7f2fab7ba700 1 -- 172.21.15.98:0/2783403617 >> 172.21.15.98:0/2783403617 conn(0x7f2fa41000f0 msgr2=0x7f2fa4101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.179+0000 7f2fab7ba700 1 -- 172.21.15.98:0/2783403617 shutdown_connections 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:01.179+0000 7f2fab7ba700 1 -- 172.21.15.98:0/2783403617 wait complete. 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:mon is available 2024-09-13T02:43:03.472 INFO:teuthology.orchestra.run.smithi098.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T02:43:04.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:03 smithi098 ceph-mon[27509]: from='client.? 172.21.15.98:0/1612386738' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T02:43:04.082 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:03 smithi098 ceph-mon[27509]: from='client.? 172.21.15.98:0/1612386738' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T02:43:04.475 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:04.475 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T02:43:04.475 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout fsid = d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:43:04.475 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.98:3300,v1:172.21.15.98:6789] 2024-09-13T02:43:04.475 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T02:43:04.475 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T02:43:04.476 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T02:43:04.476 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T02:43:04.476 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:04.476 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T02:43:04.476 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T02:43:04.476 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:04.476 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.861+0000 7fecad6d5700 1 Processor -- start 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.861+0000 7fecad6d5700 1 -- start start 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.861+0000 7fecad6d5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca8104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.861+0000 7fecad6d5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca81053d0 con 0x7feca8104a80 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.862+0000 7feca6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca8104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.862+0000 7feca6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca8104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33962/0 (socket says 172.21.15.98:33962) 2024-09-13T02:43:04.477 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.862+0000 7feca6ffd700 1 -- 172.21.15.98:0/2994414143 learned_addr learned my addr 172.21.15.98:0/2994414143 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.862+0000 7feca6ffd700 1 -- 172.21.15.98:0/2994414143 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8105510 con 0x7feca8104a80 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.862+0000 7feca6ffd700 1 --2- 172.21.15.98:0/2994414143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca8104e90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fec9800bb40 tx=0x7fec9800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cd22049db78a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.862+0000 7feca5ffb700 1 -- 172.21.15.98:0/2994414143 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec9800dc00 con 0x7feca8104a80 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.862+0000 7feca5ffb700 1 -- 172.21.15.98:0/2994414143 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800dd60 con 0x7feca8104a80 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.862+0000 7feca5ffb700 1 -- 172.21.15.98:0/2994414143 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec980041a0 con 0x7feca8104a80 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.863+0000 7fecad6d5700 1 -- 172.21.15.98:0/2994414143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 msgr2=0x7feca8104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.863+0000 7fecad6d5700 1 --2- 172.21.15.98:0/2994414143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca8104e90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fec9800bb40 tx=0x7fec9800be50 comp rx=0 tx=0).stop 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.863+0000 7fecad6d5700 1 -- 172.21.15.98:0/2994414143 shutdown_connections 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.863+0000 7fecad6d5700 1 --2- 172.21.15.98:0/2994414143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca8104e90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.863+0000 7fecad6d5700 1 -- 172.21.15.98:0/2994414143 >> 172.21.15.98:0/2994414143 conn(0x7feca8100110 msgr2=0x7feca8102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.863+0000 7fecad6d5700 1 -- 172.21.15.98:0/2994414143 shutdown_connections 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.863+0000 7fecad6d5700 1 -- 172.21.15.98:0/2994414143 wait complete. 2024-09-13T02:43:04.478 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.864+0000 7fecad6d5700 1 Processor -- start 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.864+0000 7fecad6d5700 1 -- start start 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.864+0000 7fecad6d5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca819b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.864+0000 7fecad6d5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca819b7e0 con 0x7feca8104a80 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.864+0000 7feca6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca819b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.864+0000 7feca6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca819b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33970/0 (socket says 172.21.15.98:33970) 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.864+0000 7feca6ffd700 1 -- 172.21.15.98:0/1612386738 learned_addr learned my addr 172.21.15.98:0/1612386738 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.865+0000 7feca6ffd700 1 -- 172.21.15.98:0/1612386738 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9800b7f0 con 0x7feca8104a80 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.865+0000 7feca6ffd700 1 --2- 172.21.15.98:0/1612386738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca819b2a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fec9800b340 tx=0x7fec98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.865+0000 7fec9ffff700 1 -- 172.21.15.98:0/1612386738 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec98003c60 con 0x7feca8104a80 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.865+0000 7fec9ffff700 1 -- 172.21.15.98:0/1612386738 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec98003dc0 con 0x7feca8104a80 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.865+0000 7fec9ffff700 1 -- 172.21.15.98:0/1612386738 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec98010600 con 0x7feca8104a80 2024-09-13T02:43:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.865+0000 7fecad6d5700 1 -- 172.21.15.98:0/1612386738 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca819b9e0 con 0x7feca8104a80 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.865+0000 7fecad6d5700 1 -- 172.21.15.98:0/1612386738 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca819be00 con 0x7feca8104a80 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.865+0000 7fec9ffff700 1 -- 172.21.15.98:0/1612386738 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fec98010b00 con 0x7feca8104a80 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.865+0000 7fec9ffff700 1 -- 172.21.15.98:0/1612386738 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fec98023440 con 0x7feca8104a80 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.866+0000 7fecad6d5700 1 -- 172.21.15.98:0/1612386738 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca8190720 con 0x7feca8104a80 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.870+0000 7fec9ffff700 1 -- 172.21.15.98:0/1612386738 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fec9802c440 con 0x7feca8104a80 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.940+0000 7fecad6d5700 1 -- 172.21.15.98:0/1612386738 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7feca802ceb0 con 0x7feca8104a80 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.945+0000 7fec9ffff700 1 -- 172.21.15.98:0/1612386738 <== mon.0 v2:172.21.15.98:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fec9802c5e0 con 0x7feca8104a80 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.945+0000 7fec9ffff700 1 -- 172.21.15.98:0/1612386738 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fec98023600 con 0x7feca8104a80 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.946+0000 7fecad6d5700 1 -- 172.21.15.98:0/1612386738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 msgr2=0x7feca819b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.946+0000 7fecad6d5700 1 --2- 172.21.15.98:0/1612386738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca819b2a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fec9800b340 tx=0x7fec98004750 comp rx=0 tx=0).stop 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.946+0000 7fecad6d5700 1 -- 172.21.15.98:0/1612386738 shutdown_connections 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.946+0000 7fecad6d5700 1 --2- 172.21.15.98:0/1612386738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feca8104a80 0x7feca819b2a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:04.480 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.946+0000 7fecad6d5700 1 -- 172.21.15.98:0/1612386738 >> 172.21.15.98:0/1612386738 conn(0x7feca8100110 msgr2=0x7feca8102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:04.481 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.946+0000 7fecad6d5700 1 -- 172.21.15.98:0/1612386738 shutdown_connections 2024-09-13T02:43:04.481 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:03.946+0000 7fecad6d5700 1 -- 172.21.15.98:0/1612386738 wait complete. 2024-09-13T02:43:04.481 INFO:teuthology.orchestra.run.smithi098.stdout:Generating new minimal ceph.conf... 2024-09-13T02:43:05.071 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:04 smithi098 ceph-mon[27509]: from='client.? 172.21.15.98:0/2979302168' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:43:05.587 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.917+0000 7f84ff0bf700 1 Processor -- start 2024-09-13T02:43:05.587 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.917+0000 7f84ff0bf700 1 -- start start 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.917+0000 7f84ff0bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f810aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.917+0000 7f84ff0bf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8106590 con 0x7f84f8079d00 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.917+0000 7f84fce5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f810aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.917+0000 7f84fce5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f810aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47360/0 (socket says 172.21.15.98:47360) 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.917+0000 7f84fce5b700 1 -- 172.21.15.98:0/1350983753 learned_addr learned my addr 172.21.15.98:0/1350983753 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.918+0000 7f84fce5b700 1 -- 172.21.15.98:0/1350983753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f810b0e0 con 0x7f84f8079d00 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.918+0000 7f84fce5b700 1 --2- 172.21.15.98:0/1350983753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f810aba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0098a0 tx=0x7f84ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a2b1daf80e4760 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.918+0000 7f84f77fe700 1 -- 172.21.15.98:0/1350983753 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84ec004180 con 0x7f84f8079d00 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.918+0000 7f84f77fe700 1 -- 172.21.15.98:0/1350983753 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f84ec0042e0 con 0x7f84f8079d00 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.918+0000 7f84f77fe700 1 -- 172.21.15.98:0/1350983753 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84ec011a50 con 0x7f84f8079d00 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.918+0000 7f84ff0bf700 1 -- 172.21.15.98:0/1350983753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 msgr2=0x7f84f810aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:05.588 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.918+0000 7f84ff0bf700 1 --2- 172.21.15.98:0/1350983753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f810aba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0098a0 tx=0x7f84ec009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.918+0000 7f84ff0bf700 1 -- 172.21.15.98:0/1350983753 shutdown_connections 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.918+0000 7f84ff0bf700 1 --2- 172.21.15.98:0/1350983753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f810aba0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.919+0000 7f84ff0bf700 1 -- 172.21.15.98:0/1350983753 >> 172.21.15.98:0/1350983753 conn(0x7f84f8100130 msgr2=0x7f84f8102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.919+0000 7f84ff0bf700 1 -- 172.21.15.98:0/1350983753 shutdown_connections 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.919+0000 7f84ff0bf700 1 -- 172.21.15.98:0/1350983753 wait complete. 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.919+0000 7f84ff0bf700 1 Processor -- start 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.919+0000 7f84ff0bf700 1 -- start start 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.919+0000 7f84ff0bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.919+0000 7f84ff0bf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f819c090 con 0x7f84f8079d00 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84fce5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84fce5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f819bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47364/0 (socket says 172.21.15.98:47364) 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84fce5b700 1 -- 172.21.15.98:0/2979302168 learned_addr learned my addr 172.21.15.98:0/2979302168 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84fce5b700 1 -- 172.21.15.98:0/2979302168 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec009550 con 0x7f84f8079d00 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84fce5b700 1 --2- 172.21.15.98:0/2979302168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f819bb50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84ec011a00 tx=0x7f84ec011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84f5ffb700 1 -- 172.21.15.98:0/2979302168 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84ec003970 con 0x7f84f8079d00 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84f5ffb700 1 -- 172.21.15.98:0/2979302168 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f84ec003ad0 con 0x7f84f8079d00 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84ff0bf700 1 -- 172.21.15.98:0/2979302168 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f819c290 con 0x7f84f8079d00 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84f5ffb700 1 -- 172.21.15.98:0/2979302168 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84ec024800 con 0x7f84f8079d00 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84ff0bf700 1 -- 172.21.15.98:0/2979302168 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f819c6b0 con 0x7f84f8079d00 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.920+0000 7f84f5ffb700 1 -- 172.21.15.98:0/2979302168 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f84ec02d3f0 con 0x7f84f8079d00 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.921+0000 7f84f5ffb700 1 -- 172.21.15.98:0/2979302168 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f84ec0193c0 con 0x7f84f8079d00 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.921+0000 7f84ff0bf700 1 -- 172.21.15.98:0/2979302168 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f810be90 con 0x7f84f8079d00 2024-09-13T02:43:05.590 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.923+0000 7f84f5ffb700 1 -- 172.21.15.98:0/2979302168 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f84ec01aba0 con 0x7f84f8079d00 2024-09-13T02:43:05.591 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.991+0000 7f84ff0bf700 1 -- 172.21.15.98:0/2979302168 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f84f810c080 con 0x7f84f8079d00 2024-09-13T02:43:05.591 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.991+0000 7f84f5ffb700 1 -- 172.21.15.98:0/2979302168 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f84ec01a430 con 0x7f84f8079d00 2024-09-13T02:43:05.591 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.992+0000 7f84ff0bf700 1 -- 172.21.15.98:0/2979302168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 msgr2=0x7f84f819bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:05.591 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.992+0000 7f84ff0bf700 1 --2- 172.21.15.98:0/2979302168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f819bb50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84ec011a00 tx=0x7f84ec011ae0 comp rx=0 tx=0).stop 2024-09-13T02:43:05.591 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.992+0000 7f84ff0bf700 1 -- 172.21.15.98:0/2979302168 shutdown_connections 2024-09-13T02:43:05.591 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.992+0000 7f84ff0bf700 1 --2- 172.21.15.98:0/2979302168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f8079d00 0x7f84f819bb50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:05.591 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.992+0000 7f84ff0bf700 1 -- 172.21.15.98:0/2979302168 >> 172.21.15.98:0/2979302168 conn(0x7f84f8100130 msgr2=0x7f84f81017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:05.591 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.992+0000 7f84ff0bf700 1 -- 172.21.15.98:0/2979302168 shutdown_connections 2024-09-13T02:43:05.591 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:04.992+0000 7f84ff0bf700 1 -- 172.21.15.98:0/2979302168 wait complete. 2024-09-13T02:43:05.592 INFO:teuthology.orchestra.run.smithi098.stdout:Restarting the monitor... 2024-09-13T02:43:05.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:05 smithi098 systemd[1]: Stopping Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:43:05.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:05 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[27505]: 2024-09-13T02:43:05.841+0000 7f919f7f2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi098 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:43:05.975 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:05 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[27505]: 2024-09-13T02:43:05.841+0000 7f919f7f2700 -1 mon.smithi098@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T02:43:06.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:05 smithi098 podman[27764]: 2024-09-13 02:43:05.974676416 +0000 UTC m=+0.229372236 container died cb73042d08694f7a2610b547f2d47264b6f5c2900dae908ae5654b083a31ae3f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T02:43:06.649 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:06 smithi098 podman[27764]: 2024-09-13 02:43:06.25827295 +0000 UTC m=+0.512968771 container cleanup cb73042d08694f7a2610b547f2d47264b6f5c2900dae908ae5654b083a31ae3f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS) 2024-09-13T02:43:06.649 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:06 smithi098 bash[27764]: ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098 2024-09-13T02:43:06.649 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:06 smithi098 podman[27776]: 2024-09-13 02:43:06.417388245 +0000 UTC m=+0.440665485 container remove cb73042d08694f7a2610b547f2d47264b6f5c2900dae908ae5654b083a31ae3f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=HEAD) 2024-09-13T02:43:06.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:06 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098.service: Deactivated successfully. 2024-09-13T02:43:06.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:06 smithi098 systemd[1]: Stopped Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:43:06.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:06 smithi098 systemd[1]: Starting Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:43:06.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:06 smithi098 podman[27868]: 2024-09-13 02:43:06.767980645 +0000 UTC m=+0.015586347 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-09-13T02:43:06.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:06 smithi098 podman[27868]: 2024-09-13 02:43:06.876605704 +0000 UTC m=+0.124211405 container create 19714ab6c54b070612134b22b1702980c84286be172daf17b42cc7f0d02ac390 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, RELEASE=HEAD, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T02:43:07.175 INFO:teuthology.orchestra.run.smithi098.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T02:43:07.379 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 podman[27868]: 2024-09-13 02:43:07.087990912 +0000 UTC m=+0.335596621 container init 19714ab6c54b070612134b22b1702980c84286be172daf17b42cc7f0d02ac390 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T02:43:07.379 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 podman[27868]: 2024-09-13 02:43:07.09127111 +0000 UTC m=+0.338876813 container start 19714ab6c54b070612134b22b1702980c84286be172daf17b42cc7f0d02ac390 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1) 2024-09-13T02:43:07.379 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T02:43:07.379 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: pidfile_write: ignore empty --pid-file 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: load: jerasure load: lrc 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: RocksDB version: 7.9.2 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Git sha 0 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Compile date 2023-08-03 19:21:13 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: DB SUMMARY 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: DB Session ID: X6946KAVRHPB5G5E798N 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: CURRENT file: CURRENT 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi098/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi098/store.db: 000009.log size: 99567 ; 2024-09-13T02:43:07.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.error_if_exists: 0 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.create_if_missing: 0 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.paranoid_checks: 1 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.env: 0x55f73bfa1720 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.info_log: 0x55f73d9ad2c0 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.statistics: (nil) 2024-09-13T02:43:07.381 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.use_fsync: 0 2024-09-13T02:43:07.382 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_log_file_size: 0 2024-09-13T02:43:07.382 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T02:43:07.382 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T02:43:07.382 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T02:43:07.382 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.allow_fallocate: 1 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.use_direct_reads: 0 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.db_log_dir: 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.wal_dir: 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T02:43:07.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.write_buffer_manager: 0x55f73cc3c5a0 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.unordered_write: 0 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T02:43:07.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.row_cache: None 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.wal_filter: None 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.two_write_queues: 0 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.wal_compression: 0 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.atomic_flush: 0 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T02:43:07.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.log_readahead_size: 0 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_background_jobs: 2 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_background_compactions: -1 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_subcompactions: 1 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T02:43:07.386 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_open_files: -1 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_background_flushes: -1 2024-09-13T02:43:07.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Compression algorithms supported: 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: kZSTD supported: 0 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: kXpressCompression supported: 0 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: kZlibCompression supported: 1 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: kSnappyCompression supported: 1 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: kLZ4Compression supported: 1 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: kBZip2Compression supported: 0 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T02:43:07.388 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000010 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.merge_operator: 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_filter: None 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f73d9ad3c0) 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: cache_index_and_filter_blocks: 1 2024-09-13T02:43:07.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: pin_top_level_index_and_filter: 1 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: index_type: 0 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: data_block_index_type: 0 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: index_shortening: 1 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: checksum: 4 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: no_block_cache: 0 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache: 0x55f73ccbf1f0 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache_name: BinnedLRUCache 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache_options: 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: capacity : 536870912 2024-09-13T02:43:07.390 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: num_shard_bits : 4 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: strict_capacity_limit : 0 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: high_pri_pool_ratio: 0.000 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache_compressed: (nil) 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: persistent_cache: (nil) 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_size: 4096 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_size_deviation: 10 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_restart_interval: 16 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: index_block_restart_interval: 1 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: metadata_block_size: 4096 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: partition_filters: 0 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: use_delta_encoding: 1 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: filter_policy: bloomfilter 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: whole_key_filtering: 1 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: verify_compression: 0 2024-09-13T02:43:07.391 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: read_amp_bytes_per_bit: 0 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: format_version: 5 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: enable_index_compression: 1 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_align: 0 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: max_auto_readahead_size: 262144 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: prepopulate_block_cache: 0 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: initial_auto_readahead_size: 8192 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression: NoCompression 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T02:43:07.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.num_levels: 7 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:43:07.393 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T02:43:07.394 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T02:43:07.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T02:43:07.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T02:43:07.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T02:43:07.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T02:43:07.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T02:43:07.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T02:43:07.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T02:43:07.395 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T02:43:07.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T02:43:07.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T02:43:07.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T02:43:07.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T02:43:07.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T02:43:07.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T02:43:07.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T02:43:07.397 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.table_properties_collectors: 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.inplace_update_support: 0 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.bloom_locality: 0 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.max_successive_merges: 0 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T02:43:07.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.ttl: 2592000 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.enable_blob_files: false 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.min_blob_size: 0 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T02:43:07.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca04e896-ed11-4a52-9723-2d559823971e 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195387120064, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195387121059, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94421, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 331, "table_properties": {"data_size": 92427, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13747, "raw_average_key_size": 49, "raw_value_size": 84896, "raw_average_value_size": 305, "num_data_blocks": 11, "num_entries": 278, "num_filter_entries": 278, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726195387, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ca04e896-ed11-4a52-9723-2d559823971e", "db_session_id": "X6946KAVRHPB5G5E798N", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195387121141, "job": 1, "event": "recovery_finished"} 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T02:43:07.400 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi098/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f73cd5c000 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: DB pointer 0x55f73cd48000 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** DB Stats ** 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:43:07.401 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: L0 2/0 94.08 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Sum 2/0 94.08 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 141.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:43:07.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative compaction: 0.00 GB write, 29.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval compaction: 0.00 GB write, 29.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Block cache BinnedLRUCache@0x55f73ccbf1f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-13T02:43:07.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: starting mon.smithi098 rank 0 at public addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] at bind addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi098 fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mon.smithi098@-1(???) e1 preinit fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mon.smithi098@-1(???).mds e1 new map 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mon.smithi098@-1(???).mds e1 print_map 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: e1 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: legacy client fscid: -1 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: No filesystems configured 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mon.smithi098@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mon.smithi098@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:43:07.404 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mon.smithi098@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mon.smithi098@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mon.smithi098@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta expand map: {default=false} 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta from 'false' to 'false' 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta expanded map: {default=false} 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta expand map: {default=info} 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta from 'info' to 'info' 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta expanded map: {default=info} 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta expand map: {default=daemon} 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta from 'daemon' to 'daemon' 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta expanded map: {default=daemon} 2024-09-13T02:43:07.405 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta expand map: {default=debug} 2024-09-13T02:43:07.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta from 'debug' to 'debug' 2024-09-13T02:43:07.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: expand_channel_meta expanded map: {default=debug} 2024-09-13T02:43:07.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 bash[27868]: 19714ab6c54b070612134b22b1702980c84286be172daf17b42cc7f0d02ac390 2024-09-13T02:43:07.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 systemd[1]: Started Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:43:07.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mon.smithi098 is new leader, mons smithi098 in quorum (ranks 0) 2024-09-13T02:43:07.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: monmap e1: 1 mons at {smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0]} removed_ranks: {} 2024-09-13T02:43:07.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: fsmap 2024-09-13T02:43:07.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T02:43:07.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:07 smithi098 ceph-mon[27886]: mgrmap e1: no daemons active 2024-09-13T02:43:08.490 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.585+0000 7fcd35804700 1 Processor -- start 2024-09-13T02:43:08.494 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.585+0000 7fcd35804700 1 -- start start 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.586+0000 7fcd35804700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd30104eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.586+0000 7fcd35804700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd301053f0 con 0x7fcd30104aa0 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.586+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd30104eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.586+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd30104eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47374/0 (socket says 172.21.15.98:47374) 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.586+0000 7fcd2effd700 1 -- 172.21.15.98:0/4016822830 learned_addr learned my addr 172.21.15.98:0/4016822830 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.586+0000 7fcd2effd700 1 -- 172.21.15.98:0/4016822830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd30105530 con 0x7fcd30104aa0 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.586+0000 7fcd2effd700 1 --2- 172.21.15.98:0/4016822830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd30104eb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098a0 tx=0x7fcd20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a47d0fa58b586 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.586+0000 7fcd2e7fc700 1 -- 172.21.15.98:0/4016822830 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd20004180 con 0x7fcd30104aa0 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.587+0000 7fcd2e7fc700 1 -- 172.21.15.98:0/4016822830 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcd200042e0 con 0x7fcd30104aa0 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.587+0000 7fcd2e7fc700 1 -- 172.21.15.98:0/4016822830 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd20011a50 con 0x7fcd30104aa0 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.587+0000 7fcd35804700 1 -- 172.21.15.98:0/4016822830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 msgr2=0x7fcd30104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.587+0000 7fcd35804700 1 --2- 172.21.15.98:0/4016822830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd30104eb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098a0 tx=0x7fcd20009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:08.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.587+0000 7fcd35804700 1 -- 172.21.15.98:0/4016822830 shutdown_connections 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.587+0000 7fcd35804700 1 --2- 172.21.15.98:0/4016822830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd30104eb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.587+0000 7fcd35804700 1 -- 172.21.15.98:0/4016822830 >> 172.21.15.98:0/4016822830 conn(0x7fcd30100150 msgr2=0x7fcd30102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.587+0000 7fcd35804700 1 -- 172.21.15.98:0/4016822830 shutdown_connections 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.587+0000 7fcd35804700 1 -- 172.21.15.98:0/4016822830 wait complete. 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.588+0000 7fcd35804700 1 Processor -- start 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.588+0000 7fcd35804700 1 -- start start 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.588+0000 7fcd35804700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd301998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.588+0000 7fcd35804700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30199e10 con 0x7fcd30104aa0 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.588+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd301998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.588+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd301998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47390/0 (socket says 172.21.15.98:47390) 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.588+0000 7fcd2effd700 1 -- 172.21.15.98:0/391190994 learned_addr learned my addr 172.21.15.98:0/391190994 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.589+0000 7fcd2effd700 1 -- 172.21.15.98:0/391190994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20009550 con 0x7fcd30104aa0 2024-09-13T02:43:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.589+0000 7fcd2effd700 1 --2- 172.21.15.98:0/391190994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd301998d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd20000c00 tx=0x7fcd20011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.589+0000 7fcd34802700 1 -- 172.21.15.98:0/391190994 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd20003b90 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.589+0000 7fcd34802700 1 -- 172.21.15.98:0/391190994 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcd200248b0 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.589+0000 7fcd35804700 1 -- 172.21.15.98:0/391190994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3019a010 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.589+0000 7fcd34802700 1 -- 172.21.15.98:0/391190994 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd2001a8e0 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.589+0000 7fcd35804700 1 -- 172.21.15.98:0/391190994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3019a430 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.589+0000 7fcd34802700 1 -- 172.21.15.98:0/391190994 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcd2002d3f0 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.589+0000 7fcd34802700 1 -- 172.21.15.98:0/391190994 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcd200194a0 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.590+0000 7fcd35804700 1 -- 172.21.15.98:0/391190994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd30062380 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.592+0000 7fcd34802700 1 -- 172.21.15.98:0/391190994 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fcd20024db0 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.659+0000 7fcd35804700 1 -- 172.21.15.98:0/391190994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fcd30106910 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.664+0000 7fcd34802700 1 -- 172.21.15.98:0/391190994 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcd20024a20 con 0x7fcd30104aa0 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.665+0000 7fcd35804700 1 -- 172.21.15.98:0/391190994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 msgr2=0x7fcd301998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:08.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.665+0000 7fcd35804700 1 --2- 172.21.15.98:0/391190994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd301998d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd20000c00 tx=0x7fcd20011ab0 comp rx=0 tx=0).stop 2024-09-13T02:43:08.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.665+0000 7fcd35804700 1 -- 172.21.15.98:0/391190994 shutdown_connections 2024-09-13T02:43:08.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.665+0000 7fcd35804700 1 --2- 172.21.15.98:0/391190994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd30104aa0 0x7fcd301998d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:08.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.665+0000 7fcd35804700 1 -- 172.21.15.98:0/391190994 >> 172.21.15.98:0/391190994 conn(0x7fcd30100150 msgr2=0x7fcd30079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:08.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.665+0000 7fcd35804700 1 -- 172.21.15.98:0/391190994 shutdown_connections 2024-09-13T02:43:08.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:07.665+0000 7fcd35804700 1 -- 172.21.15.98:0/391190994 wait complete. 2024-09-13T02:43:08.498 INFO:teuthology.orchestra.run.smithi098.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T02:43:08.729 INFO:teuthology.orchestra.run.smithi098.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T02:43:08.729 INFO:teuthology.orchestra.run.smithi098.stdout:Creating mgr... 2024-09-13T02:43:08.729 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T02:43:08.730 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T02:43:08.730 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T02:43:08.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:08 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/391190994' entity='client.admin' 2024-09-13T02:43:09.835 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d155f688-7179-11ef-bceb-c7b262605968@mgr.smithi098.ukgenf 2024-09-13T02:43:09.835 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d155f688-7179-11ef-bceb-c7b262605968@mgr.smithi098.ukgenf.service: Unit ceph-d155f688-7179-11ef-bceb-c7b262605968@mgr.smithi098.ukgenf.service not loaded. 2024-09-13T02:43:10.102 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d155f688-7179-11ef-bceb-c7b262605968.target.wants/ceph-d155f688-7179-11ef-bceb-c7b262605968@mgr.smithi098.ukgenf.service → /etc/systemd/system/ceph-d155f688-7179-11ef-bceb-c7b262605968@.service. 2024-09-13T02:43:10.665 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:43:10.665 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout disabled 2024-09-13T02:43:10.672 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:43:10.672 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-13T02:43:10.673 INFO:teuthology.orchestra.run.smithi098.stdout:firewalld.service is not enabled 2024-09-13T02:43:10.673 INFO:teuthology.orchestra.run.smithi098.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T02:43:10.681 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:43:10.681 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout disabled 2024-09-13T02:43:10.688 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:43:10.688 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-13T02:43:10.688 INFO:teuthology.orchestra.run.smithi098.stdout:firewalld.service is not enabled 2024-09-13T02:43:10.688 INFO:teuthology.orchestra.run.smithi098.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T02:43:10.688 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mgr to start... 2024-09-13T02:43:10.689 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mgr... 2024-09-13T02:43:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:11 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3105559613' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T02:43:11.871 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsid": "d155f688-7179-11ef-bceb-c7b262605968", 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T02:43:11.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 0 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "smithi098" 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:11.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T02:43:11.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:11.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T02:43:11.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T02:43:11.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T02:43:11.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T02:43:11.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T02:43:11.884 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T02:42:56.882121+0000", 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:11.885 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.144+0000 7f284e187700 1 Processor -- start 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.144+0000 7f284e187700 1 -- start start 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.144+0000 7f284e187700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f28481048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.144+0000 7f284e187700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2848074440 con 0x7f28481044e0 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.145+0000 7f28477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f28481048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.145+0000 7f28477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f28481048f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47422/0 (socket says 172.21.15.98:47422) 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.145+0000 7f28477fe700 1 -- 172.21.15.98:0/3090413871 learned_addr learned my addr 172.21.15.98:0/3090413871 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.145+0000 7f28477fe700 1 -- 172.21.15.98:0/3090413871 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848074580 con 0x7f28481044e0 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.145+0000 7f28477fe700 1 --2- 172.21.15.98:0/3090413871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f28481048f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f28300098a0 tx=0x7f2830009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883bd84580fa6be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.145+0000 7f28467fc700 1 -- 172.21.15.98:0/3090413871 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2830004180 con 0x7f28481044e0 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.145+0000 7f28467fc700 1 -- 172.21.15.98:0/3090413871 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f28300042e0 con 0x7f28481044e0 2024-09-13T02:43:11.886 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.145+0000 7f28467fc700 1 -- 172.21.15.98:0/3090413871 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2830011a50 con 0x7f28481044e0 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.146+0000 7f284e187700 1 -- 172.21.15.98:0/3090413871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 msgr2=0x7f28481048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.146+0000 7f284e187700 1 --2- 172.21.15.98:0/3090413871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f28481048f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f28300098a0 tx=0x7f2830009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.146+0000 7f284e187700 1 -- 172.21.15.98:0/3090413871 shutdown_connections 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.146+0000 7f284e187700 1 --2- 172.21.15.98:0/3090413871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f28481048f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.146+0000 7f284e187700 1 -- 172.21.15.98:0/3090413871 >> 172.21.15.98:0/3090413871 conn(0x7f2848100110 msgr2=0x7f2848102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.146+0000 7f284e187700 1 -- 172.21.15.98:0/3090413871 shutdown_connections 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.146+0000 7f284e187700 1 -- 172.21.15.98:0/3090413871 wait complete. 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.147+0000 7f284e187700 1 Processor -- start 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.147+0000 7f284e187700 1 -- start start 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.147+0000 7f284e187700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f284819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:11.887 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.147+0000 7f284e187700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284819c040 con 0x7f28481044e0 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.147+0000 7f28477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f284819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.147+0000 7f28477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f284819bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47432/0 (socket says 172.21.15.98:47432) 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.147+0000 7f28477fe700 1 -- 172.21.15.98:0/3105559613 learned_addr learned my addr 172.21.15.98:0/3105559613 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.148+0000 7f28477fe700 1 -- 172.21.15.98:0/3105559613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830009550 con 0x7f28481044e0 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.148+0000 7f28477fe700 1 --2- 172.21.15.98:0/3105559613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f284819bb00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2830000c00 tx=0x7f2830011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.148+0000 7f2844ff9700 1 -- 172.21.15.98:0/3105559613 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2830003b90 con 0x7f28481044e0 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.148+0000 7f2844ff9700 1 -- 172.21.15.98:0/3105559613 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f28300248b0 con 0x7f28481044e0 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.148+0000 7f284e187700 1 -- 172.21.15.98:0/3105559613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284819c240 con 0x7f28481044e0 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.148+0000 7f2844ff9700 1 -- 172.21.15.98:0/3105559613 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f283001a8e0 con 0x7f28481044e0 2024-09-13T02:43:11.888 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.148+0000 7f284e187700 1 -- 172.21.15.98:0/3105559613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284819c660 con 0x7f28481044e0 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.148+0000 7f2844ff9700 1 -- 172.21.15.98:0/3105559613 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f283002d3f0 con 0x7f28481044e0 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.148+0000 7f2844ff9700 1 -- 172.21.15.98:0/3105559613 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2830019570 con 0x7f28481044e0 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.149+0000 7f284e187700 1 -- 172.21.15.98:0/3105559613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2848195340 con 0x7f28481044e0 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.151+0000 7f2844ff9700 1 -- 172.21.15.98:0/3105559613 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f2830024a20 con 0x7f28481044e0 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.245+0000 7f284e187700 1 -- 172.21.15.98:0/3105559613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f284802ce70 con 0x7f28481044e0 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.246+0000 7f2844ff9700 1 -- 172.21.15.98:0/3105559613 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f2830024bc0 con 0x7f28481044e0 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.247+0000 7f284e187700 1 -- 172.21.15.98:0/3105559613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 msgr2=0x7f284819bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.247+0000 7f284e187700 1 --2- 172.21.15.98:0/3105559613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f284819bb00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2830000c00 tx=0x7f2830011ab0 comp rx=0 tx=0).stop 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.247+0000 7f284e187700 1 -- 172.21.15.98:0/3105559613 shutdown_connections 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.247+0000 7f284e187700 1 --2- 172.21.15.98:0/3105559613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28481044e0 0x7f284819bb00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.247+0000 7f284e187700 1 -- 172.21.15.98:0/3105559613 >> 172.21.15.98:0/3105559613 conn(0x7f2848100110 msgr2=0x7f28481900a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.247+0000 7f284e187700 1 -- 172.21.15.98:0/3105559613 shutdown_connections 2024-09-13T02:43:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:11.247+0000 7f284e187700 1 -- 172.21.15.98:0/3105559613 wait complete. 2024-09-13T02:43:11.890 INFO:teuthology.orchestra.run.smithi098.stdout:mgr not available, waiting (1/15)... 2024-09-13T02:43:14.555 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:14 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/429948332' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T02:43:14.954 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:14.954 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:43:14.954 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsid": "d155f688-7179-11ef-bceb-c7b262605968", 2024-09-13T02:43:14.954 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T02:43:14.954 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T02:43:14.954 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T02:43:14.954 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T02:43:14.954 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:14.954 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 0 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "smithi098" 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T02:43:14.955 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:14.956 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T02:43:14.956 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:14.956 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T02:43:14.956 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T02:43:14.956 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T02:43:14.956 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T02:43:14.956 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T02:43:14.956 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T02:43:14.956 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:14.957 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T02:43:14.957 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T02:43:14.957 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T02:43:14.957 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T02:43:14.957 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T02:43:14.957 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T02:43:14.958 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T02:42:56.882121+0000", 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.282+0000 7fd5a6d91700 1 Processor -- start 2024-09-13T02:43:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.282+0000 7fd5a6d91700 1 -- start start 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.283+0000 7fd5a6d91700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.283+0000 7fd5a6d91700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00744a0 con 0x7fd5a0106690 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.283+0000 7fd5a4b2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.283+0000 7fd5a4b2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47438/0 (socket says 172.21.15.98:47438) 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.283+0000 7fd5a4b2d700 1 -- 172.21.15.98:0/661978488 learned_addr learned my addr 172.21.15.98:0/661978488 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.283+0000 7fd5a4b2d700 1 -- 172.21.15.98:0/661978488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a00745e0 con 0x7fd5a0106690 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.284+0000 7fd5a4b2d700 1 --2- 172.21.15.98:0/661978488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0108a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd5940098a0 tx=0x7fd594009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47e11328f418c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.284+0000 7fd59f7fe700 1 -- 172.21.15.98:0/661978488 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd594004180 con 0x7fd5a0106690 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.284+0000 7fd59f7fe700 1 -- 172.21.15.98:0/661978488 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd5940042e0 con 0x7fd5a0106690 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.284+0000 7fd59f7fe700 1 -- 172.21.15.98:0/661978488 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd594011a50 con 0x7fd5a0106690 2024-09-13T02:43:14.960 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.284+0000 7fd5a6d91700 1 -- 172.21.15.98:0/661978488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 msgr2=0x7fd5a0108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.284+0000 7fd5a6d91700 1 --2- 172.21.15.98:0/661978488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0108a70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd5940098a0 tx=0x7fd594009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.284+0000 7fd5a6d91700 1 -- 172.21.15.98:0/661978488 shutdown_connections 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.284+0000 7fd5a6d91700 1 --2- 172.21.15.98:0/661978488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0108a70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.284+0000 7fd5a6d91700 1 -- 172.21.15.98:0/661978488 >> 172.21.15.98:0/661978488 conn(0x7fd5a0100110 msgr2=0x7fd5a0102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.285+0000 7fd5a6d91700 1 -- 172.21.15.98:0/661978488 shutdown_connections 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.285+0000 7fd5a6d91700 1 -- 172.21.15.98:0/661978488 wait complete. 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.285+0000 7fd5a6d91700 1 Processor -- start 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.285+0000 7fd5a6d91700 1 -- start start 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.285+0000 7fd5a6d91700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.285+0000 7fd5a6d91700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0199e60 con 0x7fd5a0106690 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.285+0000 7fd5a4b2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:14.961 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.285+0000 7fd5a4b2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47452/0 (socket says 172.21.15.98:47452) 2024-09-13T02:43:14.962 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.285+0000 7fd5a4b2d700 1 -- 172.21.15.98:0/429948332 learned_addr learned my addr 172.21.15.98:0/429948332 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:14.962 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.286+0000 7fd5a4b2d700 1 -- 172.21.15.98:0/429948332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd594009550 con 0x7fd5a0106690 2024-09-13T02:43:14.962 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.286+0000 7fd5a4b2d700 1 --2- 172.21.15.98:0/429948332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0199920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd594006af0 tx=0x7fd594011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:14.962 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.286+0000 7fd59dffb700 1 -- 172.21.15.98:0/429948332 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd594003b90 con 0x7fd5a0106690 2024-09-13T02:43:14.962 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.286+0000 7fd5a6d91700 1 -- 172.21.15.98:0/429948332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a019a060 con 0x7fd5a0106690 2024-09-13T02:43:14.962 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.286+0000 7fd5a6d91700 1 -- 172.21.15.98:0/429948332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a019a480 con 0x7fd5a0106690 2024-09-13T02:43:14.962 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.286+0000 7fd59dffb700 1 -- 172.21.15.98:0/429948332 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd59401a8a0 con 0x7fd5a0106690 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.286+0000 7fd59dffb700 1 -- 172.21.15.98:0/429948332 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd594019880 con 0x7fd5a0106690 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.286+0000 7fd59dffb700 1 -- 172.21.15.98:0/429948332 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd59402d440 con 0x7fd5a0106690 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.286+0000 7fd59dffb700 1 -- 172.21.15.98:0/429948332 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd594024820 con 0x7fd5a0106690 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.287+0000 7fd5a6d91700 1 -- 172.21.15.98:0/429948332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd584005320 con 0x7fd5a0106690 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.289+0000 7fd59dffb700 1 -- 172.21.15.98:0/429948332 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fd59401aa10 con 0x7fd5a0106690 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.362+0000 7fd5a6d91700 1 -- 172.21.15.98:0/429948332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd584005190 con 0x7fd5a0106690 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.362+0000 7fd59dffb700 1 -- 172.21.15.98:0/429948332 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fd59401abb0 con 0x7fd5a0106690 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.363+0000 7fd5a6d91700 1 -- 172.21.15.98:0/429948332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 msgr2=0x7fd5a0199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.363+0000 7fd5a6d91700 1 --2- 172.21.15.98:0/429948332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0199920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd594006af0 tx=0x7fd594011a90 comp rx=0 tx=0).stop 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.363+0000 7fd5a6d91700 1 -- 172.21.15.98:0/429948332 shutdown_connections 2024-09-13T02:43:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.363+0000 7fd5a6d91700 1 --2- 172.21.15.98:0/429948332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5a0106690 0x7fd5a0199920 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:14.964 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.363+0000 7fd5a6d91700 1 -- 172.21.15.98:0/429948332 >> 172.21.15.98:0/429948332 conn(0x7fd5a0100110 msgr2=0x7fd5a01017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:14.964 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.364+0000 7fd5a6d91700 1 -- 172.21.15.98:0/429948332 shutdown_connections 2024-09-13T02:43:14.964 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:14.364+0000 7fd5a6d91700 1 -- 172.21.15.98:0/429948332 wait complete. 2024-09-13T02:43:14.964 INFO:teuthology.orchestra.run.smithi098.stdout:mgr not available, waiting (2/15)... 2024-09-13T02:43:18.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsid": "d155f688-7179-11ef-bceb-c7b262605968", 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 0 2024-09-13T02:43:18.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "smithi098" 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T02:43:18.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T02:43:18.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T02:43:18.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T02:42:56.882121+0000", 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.390+0000 7f13f7e7b700 1 Processor -- start 2024-09-13T02:43:18.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.390+0000 7f13f7e7b700 1 -- start start 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.390+0000 7f13f7e7b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f007a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.390+0000 7f13f7e7b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f007a860 con 0x7f13f007be20 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.391+0000 7f13f5c17700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f007a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.391+0000 7f13f5c17700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f007a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55250/0 (socket says 172.21.15.98:55250) 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.391+0000 7f13f5c17700 1 -- 172.21.15.98:0/608698071 learned_addr learned my addr 172.21.15.98:0/608698071 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.391+0000 7f13f5c17700 1 -- 172.21.15.98:0/608698071 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f007a9a0 con 0x7f13f007be20 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.391+0000 7f13f5c17700 1 --2- 172.21.15.98:0/608698071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f007a320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f13e40098a0 tx=0x7f13e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3f86cf605adfd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.391+0000 7f13f4c15700 1 -- 172.21.15.98:0/608698071 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13e4004180 con 0x7f13f007be20 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.391+0000 7f13f4c15700 1 -- 172.21.15.98:0/608698071 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f13e40042e0 con 0x7f13f007be20 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.391+0000 7f13f4c15700 1 -- 172.21.15.98:0/608698071 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13e4011a50 con 0x7f13f007be20 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.392+0000 7f13f7e7b700 1 -- 172.21.15.98:0/608698071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 msgr2=0x7f13f007a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:18.080 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.392+0000 7f13f7e7b700 1 --2- 172.21.15.98:0/608698071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f007a320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f13e40098a0 tx=0x7f13e4009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.392+0000 7f13f7e7b700 1 -- 172.21.15.98:0/608698071 shutdown_connections 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.392+0000 7f13f7e7b700 1 --2- 172.21.15.98:0/608698071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f007a320 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.392+0000 7f13f7e7b700 1 -- 172.21.15.98:0/608698071 >> 172.21.15.98:0/608698071 conn(0x7f13f01012b0 msgr2=0x7f13f01036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.392+0000 7f13f7e7b700 1 -- 172.21.15.98:0/608698071 shutdown_connections 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.392+0000 7f13f7e7b700 1 -- 172.21.15.98:0/608698071 wait complete. 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.392+0000 7f13f7e7b700 1 Processor -- start 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f7e7b700 1 -- start start 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f7e7b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f019bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f7e7b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f019c0a0 con 0x7f13f007be20 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f5c17700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f019bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f5c17700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f019bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55260/0 (socket says 172.21.15.98:55260) 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f5c17700 1 -- 172.21.15.98:0/809846288 learned_addr learned my addr 172.21.15.98:0/809846288 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:18.081 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f5c17700 1 -- 172.21.15.98:0/809846288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e4009550 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f5c17700 1 --2- 172.21.15.98:0/809846288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f019bb60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13e4003de0 tx=0x7f13e4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13e2ffd700 1 -- 172.21.15.98:0/809846288 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13e4003930 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13e2ffd700 1 -- 172.21.15.98:0/809846288 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f13e4003a90 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f7e7b700 1 -- 172.21.15.98:0/809846288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f019c2a0 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13e2ffd700 1 -- 172.21.15.98:0/809846288 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13e40196c0 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.393+0000 7f13f7e7b700 1 -- 172.21.15.98:0/809846288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f019c6c0 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.394+0000 7f13e2ffd700 1 -- 172.21.15.98:0/809846288 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 2) v1 ==== 44840+0+0 (secure 0 0 0) 0x7f13e401a430 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.394+0000 7f13f7e7b700 1 -- 172.21.15.98:0/809846288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f010bf10 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.394+0000 7f13e2ffd700 1 -- 172.21.15.98:0/809846288 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f13e404bcc0 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.397+0000 7f13e2ffd700 1 -- 172.21.15.98:0/809846288 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f13e401abc0 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.467+0000 7f13f7e7b700 1 -- 172.21.15.98:0/809846288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f13f019f520 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.467+0000 7f13e2ffd700 1 -- 172.21.15.98:0/809846288 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f13e40281c0 con 0x7f13f007be20 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.468+0000 7f13f7e7b700 1 -- 172.21.15.98:0/809846288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 msgr2=0x7f13f019bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.468+0000 7f13f7e7b700 1 --2- 172.21.15.98:0/809846288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f019bb60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13e4003de0 tx=0x7f13e4011ab0 comp rx=0 tx=0).stop 2024-09-13T02:43:18.082 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.468+0000 7f13f7e7b700 1 -- 172.21.15.98:0/809846288 shutdown_connections 2024-09-13T02:43:18.083 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.468+0000 7f13f7e7b700 1 --2- 172.21.15.98:0/809846288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f007be20 0x7f13f019bb60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:18.083 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.468+0000 7f13f7e7b700 1 -- 172.21.15.98:0/809846288 >> 172.21.15.98:0/809846288 conn(0x7f13f01012b0 msgr2=0x7f13f0102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:18.083 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.468+0000 7f13f7e7b700 1 -- 172.21.15.98:0/809846288 shutdown_connections 2024-09-13T02:43:18.083 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:17.468+0000 7f13f7e7b700 1 -- 172.21.15.98:0/809846288 wait complete. 2024-09-13T02:43:18.083 INFO:teuthology.orchestra.run.smithi098.stdout:mgr not available, waiting (3/15)... 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: Activating manager daemon smithi098.ukgenf 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: mgrmap e2: smithi098.ukgenf(active, starting, since 0.00291251s) 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: Manager daemon smithi098.ukgenf is now available 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:43:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/trash_purge_schedule"}]: dispatch 2024-09-13T02:43:18.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:18.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:18.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='mgr.14100 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:18.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:18 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/809846288' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T02:43:19.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:19 smithi098 ceph-mon[27886]: mgrmap e3: smithi098.ukgenf(active, since 1.00621s) 2024-09-13T02:43:20.440 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:20 smithi098 ceph-mon[27886]: mgrmap e4: smithi098.ukgenf(active, since 2s) 2024-09-13T02:43:21.391 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:21.391 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:43:21.391 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsid": "d155f688-7179-11ef-bceb-c7b262605968", 2024-09-13T02:43:21.391 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T02:43:21.391 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T02:43:21.391 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T02:43:21.391 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 0 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "smithi098" 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T02:43:21.392 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:21.393 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T02:43:21.393 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:21.393 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T02:43:21.393 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T02:43:21.393 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T02:43:21.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T02:43:21.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T02:42:56.882121+0000", 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.456+0000 7f4178eaa700 1 Processor -- start 2024-09-13T02:43:21.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.456+0000 7f4178eaa700 1 -- start start 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.456+0000 7f4178eaa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f4174108b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.456+0000 7f4178eaa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4174079d60 con 0x7f4174106730 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.456+0000 7f417259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f4174108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.456+0000 7f417259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f4174108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55270/0 (socket says 172.21.15.98:55270) 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.456+0000 7f417259c700 1 -- 172.21.15.98:0/2551476635 learned_addr learned my addr 172.21.15.98:0/2551476635 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.457+0000 7f417259c700 1 -- 172.21.15.98:0/2551476635 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174079ea0 con 0x7f4174106730 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.457+0000 7f417259c700 1 --2- 172.21.15.98:0/2551476635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f4174108b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f41640098a0 tx=0x7f4164009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9453816f9b9cd79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.457+0000 7f417159a700 1 -- 172.21.15.98:0/2551476635 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4164004180 con 0x7f4174106730 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.457+0000 7f417159a700 1 -- 172.21.15.98:0/2551476635 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f41640042e0 con 0x7f4174106730 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.457+0000 7f417159a700 1 -- 172.21.15.98:0/2551476635 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4164011a50 con 0x7f4174106730 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.457+0000 7f4178eaa700 1 -- 172.21.15.98:0/2551476635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 msgr2=0x7f4174108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.457+0000 7f4178eaa700 1 --2- 172.21.15.98:0/2551476635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f4174108b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f41640098a0 tx=0x7f4164009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:21.404 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.458+0000 7f4178eaa700 1 -- 172.21.15.98:0/2551476635 shutdown_connections 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.458+0000 7f4178eaa700 1 --2- 172.21.15.98:0/2551476635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f4174108b10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.458+0000 7f4178eaa700 1 -- 172.21.15.98:0/2551476635 >> 172.21.15.98:0/2551476635 conn(0x7f4174100130 msgr2=0x7f4174102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.458+0000 7f4178eaa700 1 -- 172.21.15.98:0/2551476635 shutdown_connections 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.458+0000 7f4178eaa700 1 -- 172.21.15.98:0/2551476635 wait complete. 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.458+0000 7f4178eaa700 1 Processor -- start 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.458+0000 7f4178eaa700 1 -- start start 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f4178eaa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f41741998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f4178eaa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4174199df0 con 0x7f4174106730 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f417259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f41741998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f417259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f41741998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55278/0 (socket says 172.21.15.98:55278) 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f417259c700 1 -- 172.21.15.98:0/3329921763 learned_addr learned my addr 172.21.15.98:0/3329921763 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:21.405 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f417259c700 1 -- 172.21.15.98:0/3329921763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4164009550 con 0x7f4174106730 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f417259c700 1 --2- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f41741998b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4164006af0 tx=0x7f4164011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f41637fe700 1 -- 172.21.15.98:0/3329921763 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4164003b90 con 0x7f4174106730 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f41637fe700 1 -- 172.21.15.98:0/3329921763 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f416401a8a0 con 0x7f4174106730 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417419a050 con 0x7f4174106730 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f41637fe700 1 -- 172.21.15.98:0/3329921763 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4164019880 con 0x7f4174106730 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.459+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417419a4d0 con 0x7f4174106730 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.460+0000 7f41637fe700 1 -- 172.21.15.98:0/3329921763 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f4164019af0 con 0x7f4174106730 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.460+0000 7f41637fe700 1 --2- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f415c038400 0x7f415c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.460+0000 7f41637fe700 1 -- 172.21.15.98:0/3329921763 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f416404d490 con 0x7f4174106730 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.460+0000 7f4171d9b700 1 --2- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f415c038400 0x7f415c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.461+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4174109c70 con 0x7f4174106730 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.461+0000 7f4171d9b700 1 --2- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f415c038400 0x7f415c03a8b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4168006fd0 tx=0x7f4168006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:21.406 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.466+0000 7f41637fe700 1 -- 172.21.15.98:0/3329921763 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f416402c3a0 con 0x7f4174106730 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.770+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4174109e60 con 0x7f4174106730 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.771+0000 7f41637fe700 1 -- 172.21.15.98:0/3329921763 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f416404a020 con 0x7f4174106730 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f415c038400 msgr2=0x7f415c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 --2- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f415c038400 0x7f415c03a8b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4168006fd0 tx=0x7f4168006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 msgr2=0x7f41741998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 --2- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f41741998b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4164006af0 tx=0x7f4164011a90 comp rx=0 tx=0).stop 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 shutdown_connections 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 --2- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f415c038400 0x7f415c03a8b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 --2- 172.21.15.98:0/3329921763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4174106730 0x7f41741998b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 >> 172.21.15.98:0/3329921763 conn(0x7f4174100130 msgr2=0x7f4174100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 shutdown_connections 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:20.773+0000 7f4178eaa700 1 -- 172.21.15.98:0/3329921763 wait complete. 2024-09-13T02:43:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:mgr is available 2024-09-13T02:43:21.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:21 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3329921763' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T02:43:22.610 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:22 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2448607238' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T02:43:22.619 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:22.619 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T02:43:22.619 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout fsid = d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:43:22.619 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T02:43:22.620 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.794+0000 7fbb19eb5700 1 Processor -- start 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.794+0000 7fbb19eb5700 1 -- start start 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.794+0000 7fbb19eb5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb14108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.794+0000 7fbb19eb5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14074440 con 0x7fbb141066f0 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.794+0000 7fbb137fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb14108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.794+0000 7fbb137fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb14108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55288/0 (socket says 172.21.15.98:55288) 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.794+0000 7fbb137fe700 1 -- 172.21.15.98:0/4149819344 learned_addr learned my addr 172.21.15.98:0/4149819344 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.794+0000 7fbb137fe700 1 -- 172.21.15.98:0/4149819344 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14074580 con 0x7fbb141066f0 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb137fe700 1 --2- 172.21.15.98:0/4149819344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb14108ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbb040098a0 tx=0x7fbb04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d27862ae7158b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb12ffd700 1 -- 172.21.15.98:0/4149819344 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb04004180 con 0x7fbb141066f0 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb12ffd700 1 -- 172.21.15.98:0/4149819344 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbb040042e0 con 0x7fbb141066f0 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb12ffd700 1 -- 172.21.15.98:0/4149819344 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb04011a50 con 0x7fbb141066f0 2024-09-13T02:43:22.621 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb19eb5700 1 -- 172.21.15.98:0/4149819344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 msgr2=0x7fbb14108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb19eb5700 1 --2- 172.21.15.98:0/4149819344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb14108ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbb040098a0 tx=0x7fbb04009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb19eb5700 1 -- 172.21.15.98:0/4149819344 shutdown_connections 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb19eb5700 1 --2- 172.21.15.98:0/4149819344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb14108ad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb19eb5700 1 -- 172.21.15.98:0/4149819344 >> 172.21.15.98:0/4149819344 conn(0x7fbb14100110 msgr2=0x7fbb14102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb19eb5700 1 -- 172.21.15.98:0/4149819344 shutdown_connections 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.795+0000 7fbb19eb5700 1 -- 172.21.15.98:0/4149819344 wait complete. 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.796+0000 7fbb19eb5700 1 Processor -- start 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.796+0000 7fbb19eb5700 1 -- start start 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.796+0000 7fbb19eb5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb141998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.796+0000 7fbb19eb5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14199e00 con 0x7fbb141066f0 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.796+0000 7fbb137fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb141998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.796+0000 7fbb137fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb141998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55300/0 (socket says 172.21.15.98:55300) 2024-09-13T02:43:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.796+0000 7fbb137fe700 1 -- 172.21.15.98:0/2448607238 learned_addr learned my addr 172.21.15.98:0/2448607238 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.797+0000 7fbb137fe700 1 -- 172.21.15.98:0/2448607238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04009550 con 0x7fbb141066f0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.797+0000 7fbb137fe700 1 --2- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb141998c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb04006af0 tx=0x7fbb04011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.797+0000 7fbb117fa700 1 -- 172.21.15.98:0/2448607238 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb04003b90 con 0x7fbb141066f0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.797+0000 7fbb117fa700 1 -- 172.21.15.98:0/2448607238 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbb0401a8a0 con 0x7fbb141066f0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.797+0000 7fbb117fa700 1 -- 172.21.15.98:0/2448607238 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb04019880 con 0x7fbb141066f0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.797+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1419a000 con 0x7fbb141066f0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.797+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1419a420 con 0x7fbb141066f0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.798+0000 7fbb117fa700 1 -- 172.21.15.98:0/2448607238 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7fbb0401a430 con 0x7fbb141066f0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.798+0000 7fbb117fa700 1 --2- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb00038360 0x7fbb0003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.798+0000 7fbb117fa700 1 -- 172.21.15.98:0/2448607238 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbb0404c7c0 con 0x7fbb141066f0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.798+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb14062380 con 0x7fbb141066f0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.798+0000 7fbb0bfff700 1 --2- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb00038360 0x7fbb0003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:22.623 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.798+0000 7fbb0bfff700 1 --2- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb00038360 0x7fbb0003a810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbafc006fd0 tx=0x7fbafc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.803+0000 7fbb117fa700 1 -- 172.21.15.98:0/2448607238 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbb040189a0 con 0x7fbb141066f0 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.992+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fbb1419e670 con 0x7fbb141066f0 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.993+0000 7fbb117fa700 1 -- 172.21.15.98:0/2448607238 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fbb04018350 con 0x7fbb141066f0 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb00038360 msgr2=0x7fbb0003a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 --2- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb00038360 0x7fbb0003a810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbafc006fd0 tx=0x7fbafc006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 msgr2=0x7fbb141998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 --2- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb141998c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb04006af0 tx=0x7fbb04011a90 comp rx=0 tx=0).stop 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 shutdown_connections 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 --2- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb00038360 0x7fbb0003a810 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 --2- 172.21.15.98:0/2448607238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb141066f0 0x7fbb141998c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 >> 172.21.15.98:0/2448607238 conn(0x7fbb14100110 msgr2=0x7fbb14101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 shutdown_connections 2024-09-13T02:43:22.624 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:21.995+0000 7fbb19eb5700 1 -- 172.21.15.98:0/2448607238 wait complete. 2024-09-13T02:43:22.625 INFO:teuthology.orchestra.run.smithi098.stdout:Enabling cephadm module... 2024-09-13T02:43:23.593 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:23 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1059785558' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T02:43:23.843 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.027+0000 7f7b9062d700 1 Processor -- start 2024-09-13T02:43:23.843 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.027+0000 7f7b9062d700 1 -- start start 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.027+0000 7f7b9062d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b88106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.027+0000 7f7b9062d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88106590 con 0x7f7b88105c40 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.028+0000 7f7b8e3c9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b88106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.028+0000 7f7b8e3c9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b88106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55312/0 (socket says 172.21.15.98:55312) 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.028+0000 7f7b8e3c9700 1 -- 172.21.15.98:0/2043415371 learned_addr learned my addr 172.21.15.98:0/2043415371 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.028+0000 7f7b8e3c9700 1 -- 172.21.15.98:0/2043415371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b881066d0 con 0x7f7b88105c40 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.028+0000 7f7b8e3c9700 1 --2- 172.21.15.98:0/2043415371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b88106050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009e80 tx=0x7f7b7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2b84a57376d0fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.028+0000 7f7b8d3c7700 1 -- 172.21.15.98:0/2043415371 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b7800e070 con 0x7f7b88105c40 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.028+0000 7f7b8d3c7700 1 -- 172.21.15.98:0/2043415371 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7b78003e90 con 0x7f7b88105c40 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.028+0000 7f7b8d3c7700 1 -- 172.21.15.98:0/2043415371 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b78004380 con 0x7f7b88105c40 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.029+0000 7f7b9062d700 1 -- 172.21.15.98:0/2043415371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 msgr2=0x7f7b88106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:23.844 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.029+0000 7f7b9062d700 1 --2- 172.21.15.98:0/2043415371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b88106050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009e80 tx=0x7f7b7800b330 comp rx=0 tx=0).stop 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.029+0000 7f7b9062d700 1 -- 172.21.15.98:0/2043415371 shutdown_connections 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.029+0000 7f7b9062d700 1 --2- 172.21.15.98:0/2043415371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b88106050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.029+0000 7f7b9062d700 1 -- 172.21.15.98:0/2043415371 >> 172.21.15.98:0/2043415371 conn(0x7f7b881012b0 msgr2=0x7f7b881036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.029+0000 7f7b9062d700 1 -- 172.21.15.98:0/2043415371 shutdown_connections 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.029+0000 7f7b9062d700 1 -- 172.21.15.98:0/2043415371 wait complete. 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b9062d700 1 Processor -- start 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b9062d700 1 -- start start 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b9062d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b8807bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b9062d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8807c1b0 con 0x7f7b88105c40 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b8e3c9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b8807bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b8e3c9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b8807bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55328/0 (socket says 172.21.15.98:55328) 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b8e3c9700 1 -- 172.21.15.98:0/1059785558 learned_addr learned my addr 172.21.15.98:0/1059785558 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:23.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b8e3c9700 1 -- 172.21.15.98:0/1059785558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009b30 con 0x7f7b88105c40 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b8e3c9700 1 --2- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b8807bc70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800d010 tx=0x7f7b78004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.030+0000 7f7b877fe700 1 -- 172.21.15.98:0/1059785558 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b7800e040 con 0x7f7b88105c40 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.031+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8807a2c0 con 0x7f7b88105c40 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.031+0000 7f7b877fe700 1 -- 172.21.15.98:0/1059785558 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7b78003c30 con 0x7f7b88105c40 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.031+0000 7f7b877fe700 1 -- 172.21.15.98:0/1059785558 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b7801b790 con 0x7f7b88105c40 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.031+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8807a740 con 0x7f7b88105c40 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.031+0000 7f7b877fe700 1 -- 172.21.15.98:0/1059785558 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f7b78019040 con 0x7f7b88105c40 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.032+0000 7f7b877fe700 1 --2- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f7b700383b0 0x7f7b7003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.032+0000 7f7b877fe700 1 -- 172.21.15.98:0/1059785558 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7b7804bef0 con 0x7f7b88105c40 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.032+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b88062380 con 0x7f7b88105c40 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.032+0000 7f7b8dbc8700 1 --2- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f7b700383b0 0x7f7b7003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.032+0000 7f7b8dbc8700 1 --2- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f7b700383b0 0x7f7b7003a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c006fd0 tx=0x7f7b7c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:23.846 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.036+0000 7f7b877fe700 1 -- 172.21.15.98:0/1059785558 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7b78023ba0 con 0x7f7b88105c40 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.278+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f7b88107b00 con 0x7f7b88105c40 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.282+0000 7f7b877fe700 1 -- 172.21.15.98:0/1059785558 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7b7801a390 con 0x7f7b88105c40 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.284+0000 7f7b877fe700 1 -- 172.21.15.98:0/1059785558 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f7b7801ba00 con 0x7f7b88105c40 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f7b700383b0 msgr2=0x7f7b7003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 --2- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f7b700383b0 0x7f7b7003a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c006fd0 tx=0x7f7b7c006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 msgr2=0x7f7b8807bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 --2- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b8807bc70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800d010 tx=0x7f7b78004430 comp rx=0 tx=0).stop 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 shutdown_connections 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 --2- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f7b700383b0 0x7f7b7003a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 --2- 172.21.15.98:0/1059785558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b88105c40 0x7f7b8807bc70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 >> 172.21.15.98:0/1059785558 conn(0x7f7b881012b0 msgr2=0x7f7b88102070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 shutdown_connections 2024-09-13T02:43:23.847 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:23.286+0000 7f7b9062d700 1 -- 172.21.15.98:0/1059785558 wait complete. 2024-09-13T02:43:24.561 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:24 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1059785558' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T02:43:24.561 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:24 smithi098 ceph-mon[27886]: mgrmap e5: smithi098.ukgenf(active, since 6s) 2024-09-13T02:43:25.233 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "active_name": "smithi098.ukgenf", 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.297+0000 7f9c0e686700 1 Processor -- start 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.297+0000 7f9c0e686700 1 -- start start 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.297+0000 7f9c0e686700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c081042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.297+0000 7f9c0e686700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c081047f0 con 0x7f9c08103ea0 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.297+0000 7f9c07fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c081042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:25.234 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.297+0000 7f9c07fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c081042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55364/0 (socket says 172.21.15.98:55364) 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.297+0000 7f9c07fff700 1 -- 172.21.15.98:0/2807152832 learned_addr learned my addr 172.21.15.98:0/2807152832 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.297+0000 7f9c07fff700 1 -- 172.21.15.98:0/2807152832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08104930 con 0x7f9c08103ea0 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.297+0000 7f9c07fff700 1 --2- 172.21.15.98:0/2807152832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c081042b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80098a0 tx=0x7f9bf8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9475da5038cab099 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c06ffd700 1 -- 172.21.15.98:0/2807152832 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf8004180 con 0x7f9c08103ea0 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c06ffd700 1 -- 172.21.15.98:0/2807152832 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9bf80042e0 con 0x7f9c08103ea0 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c06ffd700 1 -- 172.21.15.98:0/2807152832 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf8011a50 con 0x7f9c08103ea0 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c0e686700 1 -- 172.21.15.98:0/2807152832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 msgr2=0x7f9c081042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c0e686700 1 --2- 172.21.15.98:0/2807152832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c081042b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80098a0 tx=0x7f9bf8009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c0e686700 1 -- 172.21.15.98:0/2807152832 shutdown_connections 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c0e686700 1 --2- 172.21.15.98:0/2807152832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c081042b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c0e686700 1 -- 172.21.15.98:0/2807152832 >> 172.21.15.98:0/2807152832 conn(0x7f9c080ff880 msgr2=0x7f9c08101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c0e686700 1 -- 172.21.15.98:0/2807152832 shutdown_connections 2024-09-13T02:43:25.235 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.298+0000 7f9c0e686700 1 -- 172.21.15.98:0/2807152832 wait complete. 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.299+0000 7f9c0e686700 1 Processor -- start 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.299+0000 7f9c0e686700 1 -- start start 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.299+0000 7f9c0e686700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c08106830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.299+0000 7f9c0e686700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c08106d70 con 0x7f9c08103ea0 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.299+0000 7f9c07fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c08106830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.299+0000 7f9c07fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c08106830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55372/0 (socket says 172.21.15.98:55372) 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.299+0000 7f9c07fff700 1 -- 172.21.15.98:0/3784728271 learned_addr learned my addr 172.21.15.98:0/3784728271 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.300+0000 7f9c07fff700 1 -- 172.21.15.98:0/3784728271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf8009550 con 0x7f9c08103ea0 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.300+0000 7f9c07fff700 1 --2- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c08106830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8000c00 tx=0x7f9bf8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.300+0000 7f9c057fa700 1 -- 172.21.15.98:0/3784728271 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf8003b90 con 0x7f9c08103ea0 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.300+0000 7f9c057fa700 1 -- 172.21.15.98:0/3784728271 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9bf80248b0 con 0x7f9c08103ea0 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.300+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08104e80 con 0x7f9c08103ea0 2024-09-13T02:43:25.236 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.300+0000 7f9c057fa700 1 -- 172.21.15.98:0/3784728271 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf801a8e0 con 0x7f9c08103ea0 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.300+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c081052a0 con 0x7f9c08103ea0 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.301+0000 7f9c057fa700 1 -- 172.21.15.98:0/3784728271 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9bf801ab50 con 0x7f9c08103ea0 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.301+0000 7f9c057fa700 1 --2- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bf0038440 0x7f9bf003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.301+0000 7f9c057fa700 1 -- 172.21.15.98:0/3784728271 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9bf804bff0 con 0x7f9c08103ea0 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.301+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c08107a60 con 0x7f9c08103ea0 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.301+0000 7f9c077fe700 1 -- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bf0038440 msgr2=0x7f9bf003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.301+0000 7f9c077fe700 1 --2- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bf0038440 0x7f9bf003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.306+0000 7f9c057fa700 1 -- 172.21.15.98:0/3784728271 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9bf80233a0 con 0x7f9c08103ea0 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.502+0000 7f9c077fe700 1 -- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bf0038440 msgr2=0x7f9bf003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.502+0000 7f9c077fe700 1 --2- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bf0038440 0x7f9bf003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.560+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9c08105d00 con 0x7f9c08103ea0 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.560+0000 7f9c057fa700 1 -- 172.21.15.98:0/3784728271 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f9bf8018b00 con 0x7f9c08103ea0 2024-09-13T02:43:25.237 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bf0038440 msgr2=0x7f9bf003a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 --2- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bf0038440 0x7f9bf003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 msgr2=0x7f9c08106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 --2- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c08106830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8000c00 tx=0x7f9bf8011ab0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 shutdown_connections 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 --2- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bf0038440 0x7f9bf003a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 --2- 172.21.15.98:0/3784728271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c08103ea0 0x7f9c08106830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 >> 172.21.15.98:0/3784728271 conn(0x7f9c080ff880 msgr2=0x7f9c08100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 shutdown_connections 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:24.562+0000 7f9c0e686700 1 -- 172.21.15.98:0/3784728271 wait complete. 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for the mgr to restart... 2024-09-13T02:43:25.238 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mgr epoch 5... 2024-09-13T02:43:25.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:25 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3784728271' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T02:43:30.208 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: Active manager daemon smithi098.ukgenf restarted 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: Activating manager daemon smithi098.ukgenf 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: mgrmap e6: smithi098.ukgenf(active, starting, since 0.00324478s) 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: Manager daemon smithi098.ukgenf is now available 2024-09-13T02:43:30.209 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:30.210 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:30.210 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:43:30.210 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:43:30.210 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:43:30.210 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:43:30.210 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:29 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/trash_purge_schedule"}]: dispatch 2024-09-13T02:43:31.207 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:30 smithi098 ceph-mon[27886]: Found migration_current of "None". Setting to last migration. 2024-09-13T02:43:31.207 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:30 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:31.207 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:30 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:31.207 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:30 smithi098 ceph-mon[27886]: mgrmap e7: smithi098.ukgenf(active, since 1.00548s) 2024-09-13T02:43:31.442 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:43:31.442 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T02:43:31.442 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T02:43:31.442 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:43:31.442 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.720+0000 7f22e53d1700 1 Processor -- start 2024-09-13T02:43:31.442 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.720+0000 7f22e53d1700 1 -- start start 2024-09-13T02:43:31.442 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.720+0000 7f22e53d1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:31.442 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.720+0000 7f22e53d1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0079d60 con 0x7f22e01066d0 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.720+0000 7f22deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.720+0000 7f22deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45038/0 (socket says 172.21.15.98:45038) 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.720+0000 7f22deffd700 1 -- 172.21.15.98:0/758227917 learned_addr learned my addr 172.21.15.98:0/758227917 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.721+0000 7f22deffd700 1 -- 172.21.15.98:0/758227917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0079ea0 con 0x7f22e01066d0 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.721+0000 7f22deffd700 1 --2- 172.21.15.98:0/758227917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0108ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22d00098a0 tx=0x7f22d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0851b7ca38d69be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.721+0000 7f22ddffb700 1 -- 172.21.15.98:0/758227917 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22d0004180 con 0x7f22e01066d0 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.721+0000 7f22ddffb700 1 -- 172.21.15.98:0/758227917 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f22d00042e0 con 0x7f22e01066d0 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.721+0000 7f22ddffb700 1 -- 172.21.15.98:0/758227917 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22d0011a50 con 0x7f22e01066d0 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.722+0000 7f22e53d1700 1 -- 172.21.15.98:0/758227917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 msgr2=0x7f22e0108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.722+0000 7f22e53d1700 1 --2- 172.21.15.98:0/758227917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0108ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22d00098a0 tx=0x7f22d0009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.722+0000 7f22e53d1700 1 -- 172.21.15.98:0/758227917 shutdown_connections 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.722+0000 7f22e53d1700 1 --2- 172.21.15.98:0/758227917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0108ab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:31.443 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.722+0000 7f22e53d1700 1 -- 172.21.15.98:0/758227917 >> 172.21.15.98:0/758227917 conn(0x7f22e01000f0 msgr2=0x7f22e0102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.722+0000 7f22e53d1700 1 -- 172.21.15.98:0/758227917 shutdown_connections 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.722+0000 7f22e53d1700 1 -- 172.21.15.98:0/758227917 wait complete. 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.722+0000 7f22e53d1700 1 Processor -- start 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.722+0000 7f22e53d1700 1 -- start start 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22e53d1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0106030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22e53d1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0106570 con 0x7f22e01066d0 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22deffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45052/0 (socket says 172.21.15.98:45052) 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22deffd700 1 -- 172.21.15.98:0/2074470698 learned_addr learned my addr 172.21.15.98:0/2074470698 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22deffd700 1 -- 172.21.15.98:0/2074470698 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0009550 con 0x7f22e01066d0 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22deffd700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0106030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22d0000c00 tx=0x7f22d0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22d0003b90 con 0x7f22e01066d0 2024-09-13T02:43:31.444 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f22d00248b0 con 0x7f22e01066d0 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e01046e0 con 0x7f22e01066d0 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22d001a8e0 con 0x7f22e01066d0 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.723+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e0104b60 con 0x7f22e01066d0 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.724+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f22d001aba0 con 0x7f22e01066d0 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.724+0000 7f22c7fff700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.724+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22e0109bb0 con 0x7f22c80383f0 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.725+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f22d0024440 con 0x7f22e01066d0 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.725+0000 7f22de7fc700 1 -- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 msgr2=0x7f22c803a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.725+0000 7f22de7fc700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.926+0000 7f22de7fc700 1 -- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 msgr2=0x7f22c803a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:25.926+0000 7f22de7fc700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:26.327+0000 7f22de7fc700 1 -- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 msgr2=0x7f22c803a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:43:31.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:26.327+0000 7f22de7fc700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:27.128+0000 7f22de7fc700 1 -- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 msgr2=0x7f22c803a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:27.128+0000 7f22de7fc700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:28.729+0000 7f22de7fc700 1 -- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 msgr2=0x7f22c803a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:28.729+0000 7f22de7fc700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:29.910+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7f22d002dc90 con 0x7f22e01066d0 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:29.910+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 msgr2=0x7f22c803a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:29.910+0000 7f22c7fff700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.911+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f22d002a2a0 con 0x7f22e01066d0 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.911+0000 7f22c7fff700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.911+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22e0109bb0 con 0x7f22c80383f0 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.912+0000 7f22de7fc700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.913+0000 7f22de7fc700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f22d4003a10 tx=0x7f22d4009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.913+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f22e0109bb0 con 0x7f22c80383f0 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f22e0105bd0 con 0x7f22c80383f0 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22c7fff700 1 -- 172.21.15.98:0/2074470698 <== mgr.14120 v2:172.21.15.98:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f22e0105bd0 con 0x7f22c80383f0 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 msgr2=0x7f22c803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f22d4003a10 tx=0x7f22d4009290 comp rx=0 tx=0).stop 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 msgr2=0x7f22e0106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0106030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22d0000c00 tx=0x7f22d0011ab0 comp rx=0 tx=0).stop 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 shutdown_connections 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f22c80383f0 0x7f22c803a8a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 --2- 172.21.15.98:0/2074470698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01066d0 0x7f22e0106030 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 >> 172.21.15.98:0/2074470698 conn(0x7f22e01000f0 msgr2=0x7f22e0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 shutdown_connections 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:30.924+0000 7f22e53d1700 1 -- 172.21.15.98:0/2074470698 wait complete. 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:mgr epoch 5 is available 2024-09-13T02:43:31.447 INFO:teuthology.orchestra.run.smithi098.stdout:Setting orchestrator backend to cephadm... 2024-09-13T02:43:32.112 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:31 smithi098 ceph-mon[27886]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T02:43:32.113 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:31 smithi098 ceph-mon[27886]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T02:43:32.113 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:31 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:43:32.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.884+0000 7fb398c22700 1 Processor -- start 2024-09-13T02:43:32.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.884+0000 7fb398c22700 1 -- start start 2024-09-13T02:43:32.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.884+0000 7fb398c22700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb394104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.884+0000 7fb398c22700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3941053d0 con 0x7fb394104a80 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.884+0000 7fb39259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb394104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.884+0000 7fb39259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb394104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45114/0 (socket says 172.21.15.98:45114) 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.884+0000 7fb39259c700 1 -- 172.21.15.98:0/1643941582 learned_addr learned my addr 172.21.15.98:0/1643941582 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.884+0000 7fb39259c700 1 -- 172.21.15.98:0/1643941582 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb394105510 con 0x7fb394104a80 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb39259c700 1 --2- 172.21.15.98:0/1643941582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb394104e90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb3840098a0 tx=0x7fb384009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe87c1b68b95419 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb39159a700 1 -- 172.21.15.98:0/1643941582 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb384004180 con 0x7fb394104a80 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb39159a700 1 -- 172.21.15.98:0/1643941582 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb3840042e0 con 0x7fb394104a80 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb39159a700 1 -- 172.21.15.98:0/1643941582 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb384011a50 con 0x7fb394104a80 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb398c22700 1 -- 172.21.15.98:0/1643941582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 msgr2=0x7fb394104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb398c22700 1 --2- 172.21.15.98:0/1643941582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb394104e90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb3840098a0 tx=0x7fb384009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb398c22700 1 -- 172.21.15.98:0/1643941582 shutdown_connections 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb398c22700 1 --2- 172.21.15.98:0/1643941582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb394104e90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb398c22700 1 -- 172.21.15.98:0/1643941582 >> 172.21.15.98:0/1643941582 conn(0x7fb3941000f0 msgr2=0x7fb394102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb398c22700 1 -- 172.21.15.98:0/1643941582 shutdown_connections 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.885+0000 7fb398c22700 1 -- 172.21.15.98:0/1643941582 wait complete. 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.886+0000 7fb398c22700 1 Processor -- start 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.886+0000 7fb398c22700 1 -- start start 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.886+0000 7fb398c22700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb3941998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.886+0000 7fb398c22700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb394199e10 con 0x7fb394104a80 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb39259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb3941998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb39259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb3941998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45116/0 (socket says 172.21.15.98:45116) 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb39259c700 1 -- 172.21.15.98:0/1009546394 learned_addr learned my addr 172.21.15.98:0/1009546394 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb39259c700 1 -- 172.21.15.98:0/1009546394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009550 con 0x7fb394104a80 2024-09-13T02:43:32.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb39259c700 1 --2- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb3941998d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb384000c00 tx=0x7fb384011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb3837fe700 1 -- 172.21.15.98:0/1009546394 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb384003b90 con 0x7fb394104a80 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb3837fe700 1 -- 172.21.15.98:0/1009546394 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb3840248b0 con 0x7fb394104a80 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39419a010 con 0x7fb394104a80 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb3837fe700 1 -- 172.21.15.98:0/1009546394 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb38401a8e0 con 0x7fb394104a80 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.887+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39419a430 con 0x7fb394104a80 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.888+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb394108f10 con 0x7fb394104a80 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.889+0000 7fb3837fe700 1 -- 172.21.15.98:0/1009546394 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7fb384024a20 con 0x7fb394104a80 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.889+0000 7fb3837fe700 1 --2- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb37c038320 0x7fb37c03a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.889+0000 7fb3837fe700 1 -- 172.21.15.98:0/1009546394 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb38404c470 con 0x7fb394104a80 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.889+0000 7fb391d9b700 1 --2- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb37c038320 0x7fb37c03a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.889+0000 7fb391d9b700 1 --2- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb37c038320 0x7fb37c03a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb388006fd0 tx=0x7fb388006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:32.717 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.894+0000 7fb3837fe700 1 -- 172.21.15.98:0/1009546394 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb384024db0 con 0x7fb394104a80 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:31.966+0000 7fb3837fe700 1 -- 172.21.15.98:0/1009546394 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fb38404b400 con 0x7fb394104a80 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.100+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3941022b0 con 0x7fb37c038320 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.108+0000 7fb3837fe700 1 -- 172.21.15.98:0/1009546394 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb3941022b0 con 0x7fb37c038320 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb37c038320 msgr2=0x7fb37c03a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 --2- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb37c038320 0x7fb37c03a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb388006fd0 tx=0x7fb388006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 msgr2=0x7fb3941998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 --2- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb3941998d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb384000c00 tx=0x7fb384011ab0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 shutdown_connections 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 --2- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb37c038320 0x7fb37c03a7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 --2- 172.21.15.98:0/1009546394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb394104a80 0x7fb3941998d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 >> 172.21.15.98:0/1009546394 conn(0x7fb3941000f0 msgr2=0x7fb394079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 shutdown_connections 2024-09-13T02:43:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:32.111+0000 7fb398c22700 1 -- 172.21.15.98:0/1009546394 wait complete. 2024-09-13T02:43:33.076 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:32 smithi098 ceph-mon[27886]: [13/Sep/2024:02:43:31] ENGINE Bus STARTING 2024-09-13T02:43:33.076 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:32 smithi098 ceph-mon[27886]: [13/Sep/2024:02:43:31] ENGINE Serving on http://172.21.15.98:8765 2024-09-13T02:43:33.076 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:32 smithi098 ceph-mon[27886]: [13/Sep/2024:02:43:31] ENGINE Serving on https://172.21.15.98:7150 2024-09-13T02:43:33.076 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:32 smithi098 ceph-mon[27886]: [13/Sep/2024:02:43:31] ENGINE Bus STARTED 2024-09-13T02:43:33.076 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:32 smithi098 ceph-mon[27886]: mgrmap e8: smithi098.ukgenf(active, since 2s) 2024-09-13T02:43:33.076 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:32 smithi098 ceph-mon[27886]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:33.076 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:32 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:33.077 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:32 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:43:33.862 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T02:43:33.862 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.104+0000 7f0ba8cb5700 1 Processor -- start 2024-09-13T02:43:33.862 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.105+0000 7f0ba8cb5700 1 -- start start 2024-09-13T02:43:33.862 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.105+0000 7f0ba8cb5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba4106490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:33.862 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.105+0000 7f0ba8cb5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba41069d0 con 0x7f0ba4106080 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.105+0000 7f0ba259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba4106490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.105+0000 7f0ba259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba4106490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45130/0 (socket says 172.21.15.98:45130) 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.105+0000 7f0ba259c700 1 -- 172.21.15.98:0/584022802 learned_addr learned my addr 172.21.15.98:0/584022802 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.105+0000 7f0ba259c700 1 -- 172.21.15.98:0/584022802 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4106b10 con 0x7f0ba4106080 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba259c700 1 --2- 172.21.15.98:0/584022802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba4106490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0b940098a0 tx=0x7f0b94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b241cd47b313b134 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba159a700 1 -- 172.21.15.98:0/584022802 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b94004180 con 0x7f0ba4106080 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba159a700 1 -- 172.21.15.98:0/584022802 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0b940042e0 con 0x7f0ba4106080 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba159a700 1 -- 172.21.15.98:0/584022802 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b94011a50 con 0x7f0ba4106080 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/584022802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 msgr2=0x7f0ba4106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba8cb5700 1 --2- 172.21.15.98:0/584022802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba4106490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0b940098a0 tx=0x7f0b94009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/584022802 shutdown_connections 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba8cb5700 1 --2- 172.21.15.98:0/584022802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba4106490 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/584022802 >> 172.21.15.98:0/584022802 conn(0x7f0ba40ff870 msgr2=0x7f0ba4101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:33.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/584022802 shutdown_connections 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.106+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/584022802 wait complete. 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.107+0000 7f0ba8cb5700 1 Processor -- start 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.107+0000 7f0ba8cb5700 1 -- start start 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.107+0000 7f0ba8cb5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba41998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.107+0000 7f0ba8cb5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba4199e20 con 0x7f0ba4106080 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0ba259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba41998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0ba259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba41998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45142/0 (socket says 172.21.15.98:45142) 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0ba259c700 1 -- 172.21.15.98:0/3594905242 learned_addr learned my addr 172.21.15.98:0/3594905242 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0ba259c700 1 -- 172.21.15.98:0/3594905242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b94009550 con 0x7f0ba4106080 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0ba259c700 1 --2- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba41998e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0b940119e0 tx=0x7f0b94011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0b9b7fe700 1 -- 172.21.15.98:0/3594905242 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b94003b90 con 0x7f0ba4106080 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0b9b7fe700 1 -- 172.21.15.98:0/3594905242 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0b9401a8a0 con 0x7f0ba4106080 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba419a020 con 0x7f0ba4106080 2024-09-13T02:43:33.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0b9b7fe700 1 -- 172.21.15.98:0/3594905242 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b94019930 con 0x7f0ba4106080 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.108+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba419a440 con 0x7f0ba4106080 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.109+0000 7f0b9b7fe700 1 -- 172.21.15.98:0/3594905242 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f0b94019ba0 con 0x7f0ba4106080 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.109+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba4105900 con 0x7f0ba4106080 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.109+0000 7f0b9b7fe700 1 --2- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0b90038400 0x7f0b9003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.109+0000 7f0b9b7fe700 1 -- 172.21.15.98:0/3594905242 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f0b9404c940 con 0x7f0ba4106080 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.109+0000 7f0ba1d9b700 1 --2- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0b90038400 0x7f0b9003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.110+0000 7f0ba1d9b700 1 --2- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0b90038400 0x7f0b9003a8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c006fd0 tx=0x7f0b8c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.114+0000 7f0b9b7fe700 1 -- 172.21.15.98:0/3594905242 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0b9402b700 con 0x7f0ba4106080 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.303+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ba419d2a0 con 0x7f0b90038400 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.304+0000 7f0b9b7fe700 1 -- 172.21.15.98:0/3594905242 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f0ba419d2a0 con 0x7f0b90038400 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0b90038400 msgr2=0x7f0b9003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 --2- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0b90038400 0x7f0b9003a8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c006fd0 tx=0x7f0b8c006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:33.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 msgr2=0x7f0ba41998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:33.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 --2- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba41998e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0b940119e0 tx=0x7f0b94011ac0 comp rx=0 tx=0).stop 2024-09-13T02:43:33.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 shutdown_connections 2024-09-13T02:43:33.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 --2- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0b90038400 0x7f0b9003a8b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:33.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 --2- 172.21.15.98:0/3594905242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ba4106080 0x7f0ba41998e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:33.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 >> 172.21.15.98:0/3594905242 conn(0x7f0ba40ff870 msgr2=0x7f0ba41045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:33.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 shutdown_connections 2024-09-13T02:43:33.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:33.306+0000 7f0ba8cb5700 1 -- 172.21.15.98:0/3594905242 wait complete. 2024-09-13T02:43:33.866 INFO:teuthology.orchestra.run.smithi098.stdout:Generating ssh key... 2024-09-13T02:43:34.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:33 smithi098 ceph-mon[27886]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.306+0000 7f695d943700 1 Processor -- start 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.306+0000 7f695d943700 1 -- start start 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.306+0000 7f695d943700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695807a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.306+0000 7f695d943700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695807a820 con 0x7f695807bde0 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.307+0000 7f6956ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695807a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.307+0000 7f6956ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695807a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45152/0 (socket says 172.21.15.98:45152) 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.307+0000 7f6956ffd700 1 -- 172.21.15.98:0/3034628289 learned_addr learned my addr 172.21.15.98:0/3034628289 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.307+0000 7f6956ffd700 1 -- 172.21.15.98:0/3034628289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695807a960 con 0x7f695807bde0 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.307+0000 7f6956ffd700 1 --2- 172.21.15.98:0/3034628289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695807a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6950009e80 tx=0x7f695000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b458f1a7a80dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:35.244 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.307+0000 7f6955ffb700 1 -- 172.21.15.98:0/3034628289 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f695000e070 con 0x7f695807bde0 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.307+0000 7f6955ffb700 1 -- 172.21.15.98:0/3034628289 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6950003e90 con 0x7f695807bde0 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.307+0000 7f6955ffb700 1 -- 172.21.15.98:0/3034628289 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6950004380 con 0x7f695807bde0 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.308+0000 7f695d943700 1 -- 172.21.15.98:0/3034628289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 msgr2=0x7f695807a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.308+0000 7f695d943700 1 --2- 172.21.15.98:0/3034628289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695807a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6950009e80 tx=0x7f695000b330 comp rx=0 tx=0).stop 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.308+0000 7f695d943700 1 -- 172.21.15.98:0/3034628289 shutdown_connections 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.308+0000 7f695d943700 1 --2- 172.21.15.98:0/3034628289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695807a2e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.308+0000 7f695d943700 1 -- 172.21.15.98:0/3034628289 >> 172.21.15.98:0/3034628289 conn(0x7f6958101220 msgr2=0x7f6958103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.308+0000 7f695d943700 1 -- 172.21.15.98:0/3034628289 shutdown_connections 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.308+0000 7f695d943700 1 -- 172.21.15.98:0/3034628289 wait complete. 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.308+0000 7f695d943700 1 Processor -- start 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f695d943700 1 -- start start 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f695d943700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:35.245 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f695d943700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695819c030 con 0x7f695807bde0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f6956ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f6956ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695819baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45156/0 (socket says 172.21.15.98:45156) 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f6956ffd700 1 -- 172.21.15.98:0/1016904152 learned_addr learned my addr 172.21.15.98:0/1016904152 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f6956ffd700 1 -- 172.21.15.98:0/1016904152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950009b30 con 0x7f695807bde0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f6956ffd700 1 --2- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695819baf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f695000b7b0 tx=0x7f6950004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f695c941700 1 -- 172.21.15.98:0/1016904152 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f695000e040 con 0x7f695807bde0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f695c941700 1 -- 172.21.15.98:0/1016904152 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6950003c70 con 0x7f695807bde0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695819c230 con 0x7f695807bde0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f695c941700 1 -- 172.21.15.98:0/1016904152 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f695001b730 con 0x7f695807bde0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.309+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695819c6b0 con 0x7f695807bde0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.310+0000 7f695c941700 1 -- 172.21.15.98:0/1016904152 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6950019040 con 0x7f695807bde0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.310+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69580623f0 con 0x7f695807bde0 2024-09-13T02:43:35.246 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.310+0000 7f695c941700 1 --2- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f69440383b0 0x7f694403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.310+0000 7f695c941700 1 -- 172.21.15.98:0/1016904152 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f695004bde0 con 0x7f695807bde0 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.311+0000 7f69567fc700 1 --2- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f69440383b0 0x7f694403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.311+0000 7f69567fc700 1 --2- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f69440383b0 0x7f694403a860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6940006fd0 tx=0x7f6940006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.315+0000 7f695c941700 1 -- 172.21.15.98:0/1016904152 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f69580623f0 con 0x7f695807bde0 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.506+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f69580623f0 con 0x7f69440383b0 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.680+0000 7f695c941700 1 -- 172.21.15.98:0/1016904152 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f69580623f0 con 0x7f69440383b0 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.682+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f69440383b0 msgr2=0x7f694403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.682+0000 7f695d943700 1 --2- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f69440383b0 0x7f694403a860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6940006fd0 tx=0x7f6940006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.682+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 msgr2=0x7f695819baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.682+0000 7f695d943700 1 --2- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695819baf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f695000b7b0 tx=0x7f6950004430 comp rx=0 tx=0).stop 2024-09-13T02:43:35.247 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.682+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 shutdown_connections 2024-09-13T02:43:35.248 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.682+0000 7f695d943700 1 --2- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f69440383b0 0x7f694403a860 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:35.248 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.682+0000 7f695d943700 1 --2- 172.21.15.98:0/1016904152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f695807bde0 0x7f695819baf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:35.248 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.682+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 >> 172.21.15.98:0/1016904152 conn(0x7f6958101220 msgr2=0x7f6958102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:35.248 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.683+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 shutdown_connections 2024-09-13T02:43:35.248 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:34.683+0000 7f695d943700 1 -- 172.21.15.98:0/1016904152 wait complete. 2024-09-13T02:43:35.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:35 smithi098 ceph-mon[27886]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:35 smithi098 ceph-mon[27886]: Generating ssh key... 2024-09-13T02:43:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:35 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:35 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:36.384 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCc6rPghG+rSH4yz4aqzY3ZpPtKSgDUT7BrrOEnEKh/fBIAzeeRtLYXJCId2twMmBH6qX1omL+dZbHEF3cEZVQnpOAUJSQ6vaxYGrRgXH5Q8xVjsAh1+nFDrj7Fhu6DldI45/+Jo6kIjmyKRpwN/u966JzQ4wCWgYXqw9ndGfuC5MbQeExcLQhdENFrfwq+cjzjIKRDi7yv4Tg+2nwqSk8TchC0EHeoyZHTkqUF5wfqZTl6C3A8C4kiX1A1ZHETnpQ/b1pLQqz/expCGP0gkWtyTS/9otfDJFHPOFXHHzbaJNJYeT0dRsBheIpJoPVVJ92/db2sviHWZXXEwfAemR7hnJH5eEVk4FWxaEYhNLtephBf9chzyaXWRM/cJ8kVr9IV9gNE+q+auMJu5ODS1QP+HnqMgwgeYK02eiIi0Sz/XkfIZjvMXR0M53s6HBtMdJw1ebFpBF1EaauYiH8dPrrqCBxAlTiXY8Qe0kQ8vqnCzlnyR55X3W0PyvvC7laotc= ceph-d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:43:36.384 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.596+0000 7f564e34a700 1 Processor -- start 2024-09-13T02:43:36.384 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.596+0000 7f564e34a700 1 -- start start 2024-09-13T02:43:36.384 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.596+0000 7f564e34a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f5648108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:36.384 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.596+0000 7f564e34a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648079d40 con 0x7f56481066f0 2024-09-13T02:43:36.384 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.596+0000 7f5647fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f5648108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.596+0000 7f5647fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f5648108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43430/0 (socket says 172.21.15.98:43430) 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.596+0000 7f5647fff700 1 -- 172.21.15.98:0/1869052539 learned_addr learned my addr 172.21.15.98:0/1869052539 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.596+0000 7f5647fff700 1 -- 172.21.15.98:0/1869052539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648079e80 con 0x7f56481066f0 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f5647fff700 1 --2- 172.21.15.98:0/1869052539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f5648108ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f56380098a0 tx=0x7f5638009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613d88bb18c2e30b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f5646ffd700 1 -- 172.21.15.98:0/1869052539 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5638004180 con 0x7f56481066f0 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f5646ffd700 1 -- 172.21.15.98:0/1869052539 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f56380042e0 con 0x7f56481066f0 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f5646ffd700 1 -- 172.21.15.98:0/1869052539 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5638011a50 con 0x7f56481066f0 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f564e34a700 1 -- 172.21.15.98:0/1869052539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 msgr2=0x7f5648108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f564e34a700 1 --2- 172.21.15.98:0/1869052539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f5648108ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f56380098a0 tx=0x7f5638009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f564e34a700 1 -- 172.21.15.98:0/1869052539 shutdown_connections 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f564e34a700 1 --2- 172.21.15.98:0/1869052539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f5648108ad0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f564e34a700 1 -- 172.21.15.98:0/1869052539 >> 172.21.15.98:0/1869052539 conn(0x7f56481000f0 msgr2=0x7f5648102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:36.385 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f564e34a700 1 -- 172.21.15.98:0/1869052539 shutdown_connections 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.597+0000 7f564e34a700 1 -- 172.21.15.98:0/1869052539 wait complete. 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.598+0000 7f564e34a700 1 Processor -- start 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.598+0000 7f564e34a700 1 -- start start 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.598+0000 7f564e34a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f56481998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.598+0000 7f564e34a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648199e20 con 0x7f56481066f0 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.598+0000 7f5647fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f56481998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.598+0000 7f5647fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f56481998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43440/0 (socket says 172.21.15.98:43440) 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.598+0000 7f5647fff700 1 -- 172.21.15.98:0/3428371905 learned_addr learned my addr 172.21.15.98:0/3428371905 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.599+0000 7f5647fff700 1 -- 172.21.15.98:0/3428371905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009550 con 0x7f56481066f0 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.599+0000 7f5647fff700 1 --2- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f56481998e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5638000c00 tx=0x7f5638011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.599+0000 7f56457fa700 1 -- 172.21.15.98:0/3428371905 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5638003b90 con 0x7f56481066f0 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.599+0000 7f56457fa700 1 -- 172.21.15.98:0/3428371905 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f56380248b0 con 0x7f56481066f0 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.599+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564819a020 con 0x7f56481066f0 2024-09-13T02:43:36.386 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.599+0000 7f56457fa700 1 -- 172.21.15.98:0/3428371905 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f563801a8e0 con 0x7f56481066f0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.599+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564819a440 con 0x7f56481066f0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.600+0000 7f56457fa700 1 -- 172.21.15.98:0/3428371905 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f5638024a20 con 0x7f56481066f0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.600+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5648109c00 con 0x7f56481066f0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.600+0000 7f56457fa700 1 --2- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f56300383f0 0x7f563003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.600+0000 7f56457fa700 1 -- 172.21.15.98:0/3428371905 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f563804c4e0 con 0x7f56481066f0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.600+0000 7f56477fe700 1 --2- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f56300383f0 0x7f563003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.601+0000 7f56477fe700 1 --2- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f56300383f0 0x7f563003a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f563c006fd0 tx=0x7f563c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.605+0000 7f56457fa700 1 -- 172.21.15.98:0/3428371905 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5638024440 con 0x7f56481066f0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.799+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f564819d2a0 con 0x7f56300383f0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.799+0000 7f56457fa700 1 -- 172.21.15.98:0/3428371905 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f564819d2a0 con 0x7f56300383f0 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.801+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f56300383f0 msgr2=0x7f563003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.801+0000 7f564e34a700 1 --2- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f56300383f0 0x7f563003a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f563c006fd0 tx=0x7f563c006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.801+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 msgr2=0x7f56481998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:36.387 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.801+0000 7f564e34a700 1 --2- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f56481998e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5638000c00 tx=0x7f5638011ab0 comp rx=0 tx=0).stop 2024-09-13T02:43:36.388 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.801+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 shutdown_connections 2024-09-13T02:43:36.388 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.801+0000 7f564e34a700 1 --2- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f56300383f0 0x7f563003a8a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:36.388 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.801+0000 7f564e34a700 1 --2- 172.21.15.98:0/3428371905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56481066f0 0x7f56481998e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:36.388 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.801+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 >> 172.21.15.98:0/3428371905 conn(0x7f56481000f0 msgr2=0x7f5648101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:36.388 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.802+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 shutdown_connections 2024-09-13T02:43:36.388 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:35.802+0000 7f564e34a700 1 -- 172.21.15.98:0/3428371905 wait complete. 2024-09-13T02:43:36.388 INFO:teuthology.orchestra.run.smithi098.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T02:43:36.388 INFO:teuthology.orchestra.run.smithi098.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T02:43:36.389 INFO:teuthology.orchestra.run.smithi098.stdout:Adding host smithi098... 2024-09-13T02:43:36.967 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:36 smithi098 ceph-mon[27886]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:38.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:38 smithi098 ceph-mon[27886]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "addr": "172.21.15.98", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:39.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:39 smithi098 ceph-mon[27886]: Deploying cephadm binary to smithi098 2024-09-13T02:43:39.850 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Added host 'smithi098' with addr '172.21.15.98' 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.767+0000 7fb8feb59700 1 Processor -- start 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.767+0000 7fb8feb59700 1 -- start start 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.767+0000 7fb8feb59700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f8079d20 0x7fb8f810ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.767+0000 7fb8feb59700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8106510 con 0x7fb8f8079d20 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.767+0000 7fb8fc8f5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f8079d20 0x7fb8f810ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.767+0000 7fb8fc8f5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f8079d20 0x7fb8f810ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43452/0 (socket says 172.21.15.98:43452) 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.767+0000 7fb8fc8f5700 1 -- 172.21.15.98:0/2291279741 learned_addr learned my addr 172.21.15.98:0/2291279741 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.767+0000 7fb8fc8f5700 1 -- 172.21.15.98:0/2291279741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f810b060 con 0x7fb8f8079d20 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8fc8f5700 1 --2- 172.21.15.98:0/2291279741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f8079d20 0x7fb8f810ab20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0098a0 tx=0x7fb8ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e271e5d3becc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8f77fe700 1 -- 172.21.15.98:0/2291279741 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8ec004180 con 0x7fb8f8079d20 2024-09-13T02:43:39.851 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8f77fe700 1 -- 172.21.15.98:0/2291279741 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb8ec0042e0 con 0x7fb8f8079d20 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8f77fe700 1 -- 172.21.15.98:0/2291279741 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8ec011a50 con 0x7fb8f8079d20 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8feb59700 1 -- 172.21.15.98:0/2291279741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f8079d20 msgr2=0x7fb8f810ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8feb59700 1 --2- 172.21.15.98:0/2291279741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f8079d20 0x7fb8f810ab20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0098a0 tx=0x7fb8ec009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8feb59700 1 -- 172.21.15.98:0/2291279741 shutdown_connections 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8feb59700 1 --2- 172.21.15.98:0/2291279741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f8079d20 0x7fb8f810ab20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8feb59700 1 -- 172.21.15.98:0/2291279741 >> 172.21.15.98:0/2291279741 conn(0x7fb8f81000f0 msgr2=0x7fb8f8102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.768+0000 7fb8feb59700 1 -- 172.21.15.98:0/2291279741 shutdown_connections 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.769+0000 7fb8feb59700 1 -- 172.21.15.98:0/2291279741 wait complete. 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.769+0000 7fb8feb59700 1 Processor -- start 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.769+0000 7fb8feb59700 1 -- start start 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.769+0000 7fb8feb59700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f819bb00 0x7fb8f819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:39.852 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.769+0000 7fb8feb59700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f819c450 con 0x7fb8f819bb00 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.769+0000 7fb8fc8f5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f819bb00 0x7fb8f819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.769+0000 7fb8fc8f5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f819bb00 0x7fb8f819bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43466/0 (socket says 172.21.15.98:43466) 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.769+0000 7fb8fc8f5700 1 -- 172.21.15.98:0/2917963801 learned_addr learned my addr 172.21.15.98:0/2917963801 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.770+0000 7fb8fc8f5700 1 -- 172.21.15.98:0/2917963801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec009550 con 0x7fb8f819bb00 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.770+0000 7fb8fc8f5700 1 --2- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f819bb00 0x7fb8f819bf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec000c00 tx=0x7fb8ec011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.770+0000 7fb8f5ffb700 1 -- 172.21.15.98:0/2917963801 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8ec003b90 con 0x7fb8f819bb00 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.770+0000 7fb8f5ffb700 1 -- 172.21.15.98:0/2917963801 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb8ec0248b0 con 0x7fb8f819bb00 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.770+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f819c650 con 0x7fb8f819bb00 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.770+0000 7fb8f5ffb700 1 -- 172.21.15.98:0/2917963801 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8ec01a8e0 con 0x7fb8f819bb00 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.770+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f819f2b0 con 0x7fb8f819bb00 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.771+0000 7fb8f5ffb700 1 -- 172.21.15.98:0/2917963801 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fb8ec01aba0 con 0x7fb8f819bb00 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.771+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f8079d20 con 0x7fb8f819bb00 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.771+0000 7fb8f5ffb700 1 --2- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb8e80383f0 0x7fb8e803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:39.853 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.771+0000 7fb8f5ffb700 1 -- 172.21.15.98:0/2917963801 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb8ec04c640 con 0x7fb8f819bb00 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.771+0000 7fb8f7fff700 1 --2- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb8e80383f0 0x7fb8e803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.772+0000 7fb8f7fff700 1 --2- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb8e80383f0 0x7fb8e803a8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4006fd0 tx=0x7fb8e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.776+0000 7fb8f5ffb700 1 -- 172.21.15.98:0/2917963801 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb8ec018ca0 con 0x7fb8f819bb00 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:36.965+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi098", "addr": "172.21.15.98", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f8102440 con 0x7fb8e80383f0 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.282+0000 7fb8f5ffb700 1 -- 172.21.15.98:0/2917963801 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fb8f8102440 con 0x7fb8e80383f0 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.284+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb8e80383f0 msgr2=0x7fb8e803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.284+0000 7fb8feb59700 1 --2- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb8e80383f0 0x7fb8e803a8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4006fd0 tx=0x7fb8e4006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.284+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f819bb00 msgr2=0x7fb8f819bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.284+0000 7fb8feb59700 1 --2- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f819bb00 0x7fb8f819bf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec000c00 tx=0x7fb8ec011ab0 comp rx=0 tx=0).stop 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.284+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 shutdown_connections 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.284+0000 7fb8feb59700 1 --2- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb8e80383f0 0x7fb8e803a8a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.284+0000 7fb8feb59700 1 --2- 172.21.15.98:0/2917963801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8f819bb00 0x7fb8f819bf10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.284+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 >> 172.21.15.98:0/2917963801 conn(0x7fb8f81000f0 msgr2=0x7fb8f8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:39.855 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.284+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 shutdown_connections 2024-09-13T02:43:39.855 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:39.285+0000 7fb8feb59700 1 -- 172.21.15.98:0/2917963801 wait complete. 2024-09-13T02:43:39.855 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying mon service with default placement... 2024-09-13T02:43:40.514 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:40 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:40.515 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:40 smithi098 ceph-mon[27886]: Added host smithi098 2024-09-13T02:43:40.515 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:40 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:43:41.420 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T02:43:41.420 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.288+0000 7f261b9d0700 1 Processor -- start 2024-09-13T02:43:41.420 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f261b9d0700 1 -- start start 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f261b9d0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f2614104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f261b9d0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26141053d0 con 0x7f2614104a80 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f261976c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f2614104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f261976c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f2614104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43472/0 (socket says 172.21.15.98:43472) 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f261976c700 1 -- 172.21.15.98:0/270921832 learned_addr learned my addr 172.21.15.98:0/270921832 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f261976c700 1 -- 172.21.15.98:0/270921832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614105510 con 0x7f2614104a80 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f261976c700 1 --2- 172.21.15.98:0/270921832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f2614104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f260c0098a0 tx=0x7f260c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e0442cddba7e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f2613fff700 1 -- 172.21.15.98:0/270921832 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f260c004180 con 0x7f2614104a80 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f2613fff700 1 -- 172.21.15.98:0/270921832 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f260c0042e0 con 0x7f2614104a80 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.289+0000 7f2613fff700 1 -- 172.21.15.98:0/270921832 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f260c011a50 con 0x7f2614104a80 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.290+0000 7f261b9d0700 1 -- 172.21.15.98:0/270921832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 msgr2=0x7f2614104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.290+0000 7f261b9d0700 1 --2- 172.21.15.98:0/270921832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f2614104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f260c0098a0 tx=0x7f260c009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.421 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.290+0000 7f261b9d0700 1 -- 172.21.15.98:0/270921832 shutdown_connections 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.290+0000 7f261b9d0700 1 --2- 172.21.15.98:0/270921832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f2614104e90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.290+0000 7f261b9d0700 1 -- 172.21.15.98:0/270921832 >> 172.21.15.98:0/270921832 conn(0x7f26141000f0 msgr2=0x7f2614102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.290+0000 7f261b9d0700 1 -- 172.21.15.98:0/270921832 shutdown_connections 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.290+0000 7f261b9d0700 1 -- 172.21.15.98:0/270921832 wait complete. 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.291+0000 7f261b9d0700 1 Processor -- start 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.291+0000 7f261b9d0700 1 -- start start 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.291+0000 7f261b9d0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f26141998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.291+0000 7f261b9d0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614199e10 con 0x7f2614104a80 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.291+0000 7f261976c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f26141998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.291+0000 7f261976c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f26141998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43480/0 (socket says 172.21.15.98:43480) 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.291+0000 7f261976c700 1 -- 172.21.15.98:0/767898847 learned_addr learned my addr 172.21.15.98:0/767898847 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.291+0000 7f261976c700 1 -- 172.21.15.98:0/767898847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c009550 con 0x7f2614104a80 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.291+0000 7f261976c700 1 --2- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f26141998d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f260c0119e0 tx=0x7f260c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:41.422 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.292+0000 7f26127fc700 1 -- 172.21.15.98:0/767898847 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f260c003b90 con 0x7f2614104a80 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.292+0000 7f26127fc700 1 -- 172.21.15.98:0/767898847 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f260c01a8a0 con 0x7f2614104a80 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.292+0000 7f26127fc700 1 -- 172.21.15.98:0/767898847 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f260c019930 con 0x7f2614104a80 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.292+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261419a010 con 0x7f2614104a80 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.292+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261419a430 con 0x7f2614104a80 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.292+0000 7f26127fc700 1 -- 172.21.15.98:0/767898847 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f260c01aa10 con 0x7f2614104a80 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.292+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2614062380 con 0x7f2614104a80 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.293+0000 7f26127fc700 1 --2- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f25fc038400 0x7f25fc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.293+0000 7f26127fc700 1 -- 172.21.15.98:0/767898847 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f260c04c6a0 con 0x7f2614104a80 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.293+0000 7f2618f6b700 1 --2- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f25fc038400 0x7f25fc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.293+0000 7f2618f6b700 1 --2- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f25fc038400 0x7f25fc03a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2608006fd0 tx=0x7f2608006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.297+0000 7f26127fc700 1 -- 172.21.15.98:0/767898847 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f260c019ba0 con 0x7f2614104a80 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.508+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f261419d290 con 0x7f25fc038400 2024-09-13T02:43:41.423 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.513+0000 7f26127fc700 1 -- 172.21.15.98:0/767898847 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f261419d290 con 0x7f25fc038400 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f25fc038400 msgr2=0x7f25fc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 --2- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f25fc038400 0x7f25fc03a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2608006fd0 tx=0x7f2608006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 msgr2=0x7f26141998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 --2- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f26141998d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f260c0119e0 tx=0x7f260c011ac0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 shutdown_connections 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 --2- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f25fc038400 0x7f25fc03a8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 --2- 172.21.15.98:0/767898847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2614104a80 0x7f26141998d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 >> 172.21.15.98:0/767898847 conn(0x7f26141000f0 msgr2=0x7f2614079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 shutdown_connections 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:40.515+0000 7f261b9d0700 1 -- 172.21.15.98:0/767898847 wait complete. 2024-09-13T02:43:41.424 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying mgr service with default placement... 2024-09-13T02:43:41.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:41 smithi098 ceph-mon[27886]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:41.732 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:41 smithi098 ceph-mon[27886]: Saving service mon spec with placement count:5 2024-09-13T02:43:41.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:41 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:42.871 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T02:43:42.871 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.835+0000 7f9bbb806700 1 Processor -- start 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.835+0000 7f9bbb806700 1 -- start start 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.835+0000 7f9bbb806700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.835+0000 7f9bbb806700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41053d0 con 0x7f9bb4104a80 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.836+0000 7f9bb95a2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.836+0000 7f9bb95a2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43494/0 (socket says 172.21.15.98:43494) 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.836+0000 7f9bb95a2700 1 -- 172.21.15.98:0/3580009989 learned_addr learned my addr 172.21.15.98:0/3580009989 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.836+0000 7f9bb95a2700 1 -- 172.21.15.98:0/3580009989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4105510 con 0x7f9bb4104a80 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.836+0000 7f9bb95a2700 1 --2- 172.21.15.98:0/3580009989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4104e90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9bb00098a0 tx=0x7f9bb0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d1d446c2491234 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.836+0000 7f9babfff700 1 -- 172.21.15.98:0/3580009989 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bb0004180 con 0x7f9bb4104a80 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.836+0000 7f9babfff700 1 -- 172.21.15.98:0/3580009989 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9bb00042e0 con 0x7f9bb4104a80 2024-09-13T02:43:42.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.836+0000 7f9babfff700 1 -- 172.21.15.98:0/3580009989 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bb0011a50 con 0x7f9bb4104a80 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.837+0000 7f9bbb806700 1 -- 172.21.15.98:0/3580009989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 msgr2=0x7f9bb4104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.837+0000 7f9bbb806700 1 --2- 172.21.15.98:0/3580009989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4104e90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9bb00098a0 tx=0x7f9bb0009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.837+0000 7f9bbb806700 1 -- 172.21.15.98:0/3580009989 shutdown_connections 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.837+0000 7f9bbb806700 1 --2- 172.21.15.98:0/3580009989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4104e90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.837+0000 7f9bbb806700 1 -- 172.21.15.98:0/3580009989 >> 172.21.15.98:0/3580009989 conn(0x7f9bb41000f0 msgr2=0x7f9bb4102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.837+0000 7f9bbb806700 1 -- 172.21.15.98:0/3580009989 shutdown_connections 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.837+0000 7f9bbb806700 1 -- 172.21.15.98:0/3580009989 wait complete. 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.837+0000 7f9bbb806700 1 Processor -- start 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.837+0000 7f9bbb806700 1 -- start start 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9bbb806700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4079b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9bbb806700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb419c620 con 0x7f9bb4104a80 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9bb95a2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4079b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:42.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9bb95a2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4079b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43502/0 (socket says 172.21.15.98:43502) 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9bb95a2700 1 -- 172.21.15.98:0/3537376697 learned_addr learned my addr 172.21.15.98:0/3537376697 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9bb95a2700 1 -- 172.21.15.98:0/3537376697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb0009550 con 0x7f9bb4104a80 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9bb95a2700 1 --2- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4079b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9baa7fc700 1 -- 172.21.15.98:0/3537376697 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bb0003b90 con 0x7f9bb4104a80 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9baa7fc700 1 -- 172.21.15.98:0/3537376697 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9bb00248b0 con 0x7f9bb4104a80 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb419c760 con 0x7f9bb4104a80 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9baa7fc700 1 -- 172.21.15.98:0/3537376697 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bb001a8e0 con 0x7f9bb4104a80 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.838+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb419cb80 con 0x7f9bb4104a80 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.839+0000 7f9baa7fc700 1 -- 172.21.15.98:0/3537376697 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9bb0024a20 con 0x7f9bb4104a80 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.839+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb4108f10 con 0x7f9bb4104a80 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.839+0000 7f9baa7fc700 1 --2- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9ba00383f0 0x7f9ba003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:42.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.839+0000 7f9baa7fc700 1 -- 172.21.15.98:0/3537376697 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9bb004c640 con 0x7f9bb4104a80 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.839+0000 7f9bb8da1700 1 --2- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9ba00383f0 0x7f9ba003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.840+0000 7f9bb8da1700 1 --2- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9ba00383f0 0x7f9ba003a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4006fd0 tx=0x7f9ba4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:41.844+0000 7f9baa7fc700 1 -- 172.21.15.98:0/3537376697 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9bb0018db0 con 0x7f9bb4104a80 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.050+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bb4102390 con 0x7f9ba00383f0 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.054+0000 7f9baa7fc700 1 -- 172.21.15.98:0/3537376697 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9bb4102390 con 0x7f9ba00383f0 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.056+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9ba00383f0 msgr2=0x7f9ba003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.056+0000 7f9bbb806700 1 --2- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9ba00383f0 0x7f9ba003a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4006fd0 tx=0x7f9ba4006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.056+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 msgr2=0x7f9bb4079b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.056+0000 7f9bbb806700 1 --2- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4079b50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb0011ab0 comp rx=0 tx=0).stop 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.056+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 shutdown_connections 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.056+0000 7f9bbb806700 1 --2- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9ba00383f0 0x7f9ba003a8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.056+0000 7f9bbb806700 1 --2- 172.21.15.98:0/3537376697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9bb4104a80 0x7f9bb4079b50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:42.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.056+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 >> 172.21.15.98:0/3537376697 conn(0x7f9bb41000f0 msgr2=0x7f9bb4101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:42.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.057+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 shutdown_connections 2024-09-13T02:43:42.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:42.057+0000 7f9bbb806700 1 -- 172.21.15.98:0/3537376697 wait complete. 2024-09-13T02:43:42.876 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying crash service with default placement... 2024-09-13T02:43:43.284 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:43 smithi098 ceph-mon[27886]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:43.284 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:43 smithi098 ceph-mon[27886]: Saving service mgr spec with placement count:2 2024-09-13T02:43:43.284 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:43 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:43.284 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:43 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:43.284 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:43 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.291+0000 7f9e12d20700 1 Processor -- start 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.291+0000 7f9e12d20700 1 -- start start 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.292+0000 7f9e12d20700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c1048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.292+0000 7f9e12d20700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c074460 con 0x7f9e0c1044c0 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.292+0000 7f9e10abc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c1048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.292+0000 7f9e10abc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c1048d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43504/0 (socket says 172.21.15.98:43504) 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.292+0000 7f9e10abc700 1 -- 172.21.15.98:0/2165943552 learned_addr learned my addr 172.21.15.98:0/2165943552 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.292+0000 7f9e10abc700 1 -- 172.21.15.98:0/2165943552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0745a0 con 0x7f9e0c1044c0 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.292+0000 7f9e10abc700 1 --2- 172.21.15.98:0/2165943552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c1048d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e000098a0 tx=0x7f9e00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b499ea68fa92e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.293+0000 7f9e0b7fe700 1 -- 172.21.15.98:0/2165943552 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e00004180 con 0x7f9e0c1044c0 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.293+0000 7f9e0b7fe700 1 -- 172.21.15.98:0/2165943552 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e000042e0 con 0x7f9e0c1044c0 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.293+0000 7f9e0b7fe700 1 -- 172.21.15.98:0/2165943552 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e00011af0 con 0x7f9e0c1044c0 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.293+0000 7f9e12d20700 1 -- 172.21.15.98:0/2165943552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 msgr2=0x7f9e0c1048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.293+0000 7f9e12d20700 1 --2- 172.21.15.98:0/2165943552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c1048d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e000098a0 tx=0x7f9e00009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.294+0000 7f9e12d20700 1 -- 172.21.15.98:0/2165943552 shutdown_connections 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.294+0000 7f9e12d20700 1 --2- 172.21.15.98:0/2165943552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c1048d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.294+0000 7f9e12d20700 1 -- 172.21.15.98:0/2165943552 >> 172.21.15.98:0/2165943552 conn(0x7f9e0c100110 msgr2=0x7f9e0c102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.294+0000 7f9e12d20700 1 -- 172.21.15.98:0/2165943552 shutdown_connections 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.294+0000 7f9e12d20700 1 -- 172.21.15.98:0/2165943552 wait complete. 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.294+0000 7f9e12d20700 1 Processor -- start 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.294+0000 7f9e12d20700 1 -- start start 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.294+0000 7f9e12d20700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.294+0000 7f9e12d20700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c19c000 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e10abc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e10abc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c19bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43520/0 (socket says 172.21.15.98:43520) 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e10abc700 1 -- 172.21.15.98:0/2477242997 learned_addr learned my addr 172.21.15.98:0/2477242997 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e10abc700 1 -- 172.21.15.98:0/2477242997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00009550 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e10abc700 1 --2- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c19bac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e00006ba0 tx=0x7f9e00011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e09ffb700 1 -- 172.21.15.98:0/2477242997 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e00003b00 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c19c260 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e09ffb700 1 -- 172.21.15.98:0/2477242997 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e0001a8e0 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e09ffb700 1 -- 172.21.15.98:0/2477242997 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e00019990 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.295+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c19c6e0 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.296+0000 7f9e09ffb700 1 -- 172.21.15.98:0/2477242997 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9e00019c50 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.296+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c195320 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.297+0000 7f9e09ffb700 1 --2- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9dfc0383a0 0x7f9dfc03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.297+0000 7f9e09ffb700 1 -- 172.21.15.98:0/2477242997 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9e0004c5f0 con 0x7f9e0c1044c0 2024-09-13T02:43:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.297+0000 7f9e0bfff700 1 --2- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9dfc0383a0 0x7f9dfc03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.297+0000 7f9e0bfff700 1 --2- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9dfc0383a0 0x7f9dfc03a850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9df8006fd0 tx=0x7f9df8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.302+0000 7f9e09ffb700 1 -- 172.21.15.98:0/2477242997 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9e0002b700 con 0x7f9e0c1044c0 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.533+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e0c061190 con 0x7f9dfc0383a0 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.537+0000 7f9e09ffb700 1 -- 172.21.15.98:0/2477242997 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f9e0c061190 con 0x7f9dfc0383a0 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.539+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9dfc0383a0 msgr2=0x7f9dfc03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.539+0000 7f9e12d20700 1 --2- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9dfc0383a0 0x7f9dfc03a850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9df8006fd0 tx=0x7f9df8006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.539+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 msgr2=0x7f9e0c19bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.539+0000 7f9e12d20700 1 --2- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c19bac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e00006ba0 tx=0x7f9e00011b50 comp rx=0 tx=0).stop 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.539+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 shutdown_connections 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.539+0000 7f9e12d20700 1 --2- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9dfc0383a0 0x7f9dfc03a850 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.539+0000 7f9e12d20700 1 --2- 172.21.15.98:0/2477242997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e0c1044c0 0x7f9e0c19bac0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.539+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 >> 172.21.15.98:0/2477242997 conn(0x7f9e0c100110 msgr2=0x7f9e0c190080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.540+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 shutdown_connections 2024-09-13T02:43:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:43.540+0000 7f9e12d20700 1 -- 172.21.15.98:0/2477242997 wait complete. 2024-09-13T02:43:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying ceph-exporter service with default placement... 2024-09-13T02:43:44.809 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:44 smithi098 ceph-mon[27886]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:44.809 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:44 smithi098 ceph-mon[27886]: Saving service crash spec with placement * 2024-09-13T02:43:44.809 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:44 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:45.855 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.110+0000 7ffbb5cf3700 1 Processor -- start 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.110+0000 7ffbb5cf3700 1 -- start start 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.110+0000 7ffbb5cf3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb0105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.110+0000 7ffbb5cf3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb01064c0 con 0x7ffbb0105b70 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.110+0000 7ffbaf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb0105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.110+0000 7ffbaf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb0105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56942/0 (socket says 172.21.15.98:56942) 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.110+0000 7ffbaf7fe700 1 -- 172.21.15.98:0/1398602348 learned_addr learned my addr 172.21.15.98:0/1398602348 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.110+0000 7ffbaf7fe700 1 -- 172.21.15.98:0/1398602348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb0106600 con 0x7ffbb0105b70 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.110+0000 7ffbaf7fe700 1 --2- 172.21.15.98:0/1398602348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb0105f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffba00098a0 tx=0x7ffba0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82afce803d7f8298 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:45.856 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbae7fc700 1 -- 172.21.15.98:0/1398602348 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffba0004180 con 0x7ffbb0105b70 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbae7fc700 1 -- 172.21.15.98:0/1398602348 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffba00042e0 con 0x7ffbb0105b70 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbae7fc700 1 -- 172.21.15.98:0/1398602348 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffba0011af0 con 0x7ffbb0105b70 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1398602348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 msgr2=0x7ffbb0105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbb5cf3700 1 --2- 172.21.15.98:0/1398602348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb0105f80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffba00098a0 tx=0x7ffba0009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1398602348 shutdown_connections 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbb5cf3700 1 --2- 172.21.15.98:0/1398602348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb0105f80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1398602348 >> 172.21.15.98:0/1398602348 conn(0x7ffbb0101220 msgr2=0x7ffbb0103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1398602348 shutdown_connections 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.111+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1398602348 wait complete. 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.112+0000 7ffbb5cf3700 1 Processor -- start 2024-09-13T02:43:45.857 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.112+0000 7ffbb5cf3700 1 -- start start 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.112+0000 7ffbb5cf3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb01998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.112+0000 7ffbb5cf3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb0199e30 con 0x7ffbb0105b70 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.112+0000 7ffbaf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb01998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.112+0000 7ffbaf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb01998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56952/0 (socket says 172.21.15.98:56952) 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.112+0000 7ffbaf7fe700 1 -- 172.21.15.98:0/1012777859 learned_addr learned my addr 172.21.15.98:0/1012777859 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.113+0000 7ffbaf7fe700 1 -- 172.21.15.98:0/1012777859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0009550 con 0x7ffbb0105b70 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.113+0000 7ffbaf7fe700 1 --2- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb01998f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffba0006ba0 tx=0x7ffba0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.113+0000 7ffbacff9700 1 -- 172.21.15.98:0/1012777859 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffba0003b00 con 0x7ffbb0105b70 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.113+0000 7ffbacff9700 1 -- 172.21.15.98:0/1012777859 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffba001a8e0 con 0x7ffbb0105b70 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.113+0000 7ffbacff9700 1 -- 172.21.15.98:0/1012777859 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffba00199c0 con 0x7ffbb0105b70 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.113+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb019a030 con 0x7ffbb0105b70 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.113+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb019a450 con 0x7ffbb0105b70 2024-09-13T02:43:45.858 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.114+0000 7ffbacff9700 1 -- 172.21.15.98:0/1012777859 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ffba0019c80 con 0x7ffbb0105b70 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.114+0000 7ffbacff9700 1 --2- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb980383a0 0x7ffb9803a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.114+0000 7ffbacff9700 1 -- 172.21.15.98:0/1012777859 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ffba004c600 con 0x7ffbb0105b70 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.114+0000 7ffbaeffd700 1 --2- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb980383a0 0x7ffb9803a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.114+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb010a000 con 0x7ffbb0105b70 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.115+0000 7ffbaeffd700 1 --2- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb980383a0 0x7ffb9803a850 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffba4006fd0 tx=0x7ffba4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.119+0000 7ffbacff9700 1 -- 172.21.15.98:0/1012777859 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffba002b930 con 0x7ffbb0105b70 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.326+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbb0102700 con 0x7ffb980383a0 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.330+0000 7ffbacff9700 1 -- 172.21.15.98:0/1012777859 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7ffbb0102700 con 0x7ffb980383a0 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.332+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb980383a0 msgr2=0x7ffb9803a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.332+0000 7ffbb5cf3700 1 --2- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb980383a0 0x7ffb9803a850 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffba4006fd0 tx=0x7ffba4006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.332+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 msgr2=0x7ffbb01998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:45.859 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.332+0000 7ffbb5cf3700 1 --2- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb01998f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffba0006ba0 tx=0x7ffba0011b50 comp rx=0 tx=0).stop 2024-09-13T02:43:45.860 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.333+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 shutdown_connections 2024-09-13T02:43:45.860 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.333+0000 7ffbb5cf3700 1 --2- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb980383a0 0x7ffb9803a850 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:45.860 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.333+0000 7ffbb5cf3700 1 --2- 172.21.15.98:0/1012777859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb0105b70 0x7ffbb01998f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:45.860 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.333+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 >> 172.21.15.98:0/1012777859 conn(0x7ffbb0101220 msgr2=0x7ffbb0101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:45.860 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.333+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 shutdown_connections 2024-09-13T02:43:45.860 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:45.333+0000 7ffbb5cf3700 1 -- 172.21.15.98:0/1012777859 wait complete. 2024-09-13T02:43:45.860 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying prometheus service with default placement... 2024-09-13T02:43:45.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:45 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:45.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:45 smithi098 ceph-mon[27886]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:45.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:45 smithi098 ceph-mon[27886]: Saving service ceph-exporter spec with placement * 2024-09-13T02:43:45.949 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:45 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:47.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:47 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:47.392 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:47 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:47.693 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T02:43:47.693 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.255+0000 7ffa3f8c5700 1 Processor -- start 2024-09-13T02:43:47.693 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.255+0000 7ffa3f8c5700 1 -- start start 2024-09-13T02:43:47.693 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.255+0000 7ffa3f8c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa381075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:47.693 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.255+0000 7ffa3f8c5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38107af0 con 0x7ffa381071a0 2024-09-13T02:43:47.693 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.255+0000 7ffa3d661700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa381075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:47.693 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.255+0000 7ffa3d661700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa381075b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56962/0 (socket says 172.21.15.98:56962) 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.255+0000 7ffa3d661700 1 -- 172.21.15.98:0/1485348988 learned_addr learned my addr 172.21.15.98:0/1485348988 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.255+0000 7ffa3d661700 1 -- 172.21.15.98:0/1485348988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa38107c30 con 0x7ffa381071a0 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.256+0000 7ffa3d661700 1 --2- 172.21.15.98:0/1485348988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa381075b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa340098a0 tx=0x7ffa34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595552837be486be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.256+0000 7ffa2ffff700 1 -- 172.21.15.98:0/1485348988 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa34004180 con 0x7ffa381071a0 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.256+0000 7ffa2ffff700 1 -- 172.21.15.98:0/1485348988 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa340042e0 con 0x7ffa381071a0 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.256+0000 7ffa2ffff700 1 -- 172.21.15.98:0/1485348988 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa34011af0 con 0x7ffa381071a0 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.257+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/1485348988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 msgr2=0x7ffa381075b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.257+0000 7ffa3f8c5700 1 --2- 172.21.15.98:0/1485348988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa381075b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa340098a0 tx=0x7ffa34009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.257+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/1485348988 shutdown_connections 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.257+0000 7ffa3f8c5700 1 --2- 172.21.15.98:0/1485348988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa381075b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.257+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/1485348988 >> 172.21.15.98:0/1485348988 conn(0x7ffa380ff870 msgr2=0x7ffa38101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.257+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/1485348988 shutdown_connections 2024-09-13T02:43:47.694 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.257+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/1485348988 wait complete. 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.257+0000 7ffa3f8c5700 1 Processor -- start 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.257+0000 7ffa3f8c5700 1 -- start start 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa3f8c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa38199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa3f8c5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38199e40 con 0x7ffa381071a0 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa3d661700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa38199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa3d661700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa38199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56968/0 (socket says 172.21.15.98:56968) 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa3d661700 1 -- 172.21.15.98:0/726167303 learned_addr learned my addr 172.21.15.98:0/726167303 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa3d661700 1 -- 172.21.15.98:0/726167303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34009550 con 0x7ffa381071a0 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa3d661700 1 --2- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa38199900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa34006ba0 tx=0x7ffa34011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa2e7fc700 1 -- 172.21.15.98:0/726167303 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa34003b00 con 0x7ffa381071a0 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3819a040 con 0x7ffa381071a0 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa2e7fc700 1 -- 172.21.15.98:0/726167303 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa3401a8e0 con 0x7ffa381071a0 2024-09-13T02:43:47.695 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3819a460 con 0x7ffa381071a0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.258+0000 7ffa2e7fc700 1 -- 172.21.15.98:0/726167303 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa340199c0 con 0x7ffa381071a0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.259+0000 7ffa2e7fc700 1 -- 172.21.15.98:0/726167303 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ffa34019c80 con 0x7ffa381071a0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.259+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa38104700 con 0x7ffa381071a0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.260+0000 7ffa2e7fc700 1 --2- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa240383a0 0x7ffa2403a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.260+0000 7ffa2e7fc700 1 -- 172.21.15.98:0/726167303 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ffa3404c8a0 con 0x7ffa381071a0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.260+0000 7ffa3ce60700 1 --2- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa240383a0 0x7ffa2403a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.260+0000 7ffa3ce60700 1 --2- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa240383a0 0x7ffa2403a850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa28006fd0 tx=0x7ffa28006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.264+0000 7ffa2e7fc700 1 -- 172.21.15.98:0/726167303 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffa3402b700 con 0x7ffa381071a0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.483+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa3819d2c0 con 0x7ffa240383a0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.488+0000 7ffa2e7fc700 1 -- 172.21.15.98:0/726167303 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7ffa3819d2c0 con 0x7ffa240383a0 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa240383a0 msgr2=0x7ffa2403a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 --2- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa240383a0 0x7ffa2403a850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa28006fd0 tx=0x7ffa28006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:47.696 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 msgr2=0x7ffa38199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 --2- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa38199900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa34006ba0 tx=0x7ffa34011b50 comp rx=0 tx=0).stop 2024-09-13T02:43:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 shutdown_connections 2024-09-13T02:43:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 --2- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa240383a0 0x7ffa2403a850 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 --2- 172.21.15.98:0/726167303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa381071a0 0x7ffa38199900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 >> 172.21.15.98:0/726167303 conn(0x7ffa380ff870 msgr2=0x7ffa38100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 shutdown_connections 2024-09-13T02:43:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:46.490+0000 7ffa3f8c5700 1 -- 172.21.15.98:0/726167303 wait complete. 2024-09-13T02:43:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying grafana service with default placement... 2024-09-13T02:43:48.351 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:48 smithi098 ceph-mon[27886]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:48.352 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:48 smithi098 ceph-mon[27886]: Saving service prometheus spec with placement count:1 2024-09-13T02:43:49.030 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T02:43:49.036 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.130+0000 7f8eb1423700 1 Processor -- start 2024-09-13T02:43:49.036 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.130+0000 7f8eb1423700 1 -- start start 2024-09-13T02:43:49.036 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.130+0000 7f8eb1423700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:49.036 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.130+0000 7f8eb1423700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac079d40 con 0x7f8eac1066f0 2024-09-13T02:43:49.036 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.131+0000 7f8eaaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:49.036 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.131+0000 7f8eaaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56974/0 (socket says 172.21.15.98:56974) 2024-09-13T02:43:49.036 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.131+0000 7f8eaaffd700 1 -- 172.21.15.98:0/2824981570 learned_addr learned my addr 172.21.15.98:0/2824981570 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:49.037 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.131+0000 7f8eaaffd700 1 -- 172.21.15.98:0/2824981570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac079e80 con 0x7f8eac1066f0 2024-09-13T02:43:49.037 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.131+0000 7f8eaaffd700 1 --2- 172.21.15.98:0/2824981570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac108ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0098a0 tx=0x7f8e9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d1896c5fe7a693 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:49.037 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.131+0000 7f8eaa7fc700 1 -- 172.21.15.98:0/2824981570 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e9c004180 con 0x7f8eac1066f0 2024-09-13T02:43:49.037 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.131+0000 7f8eaa7fc700 1 -- 172.21.15.98:0/2824981570 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e9c0042e0 con 0x7f8eac1066f0 2024-09-13T02:43:49.037 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.131+0000 7f8eaa7fc700 1 -- 172.21.15.98:0/2824981570 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e9c011af0 con 0x7f8eac1066f0 2024-09-13T02:43:49.037 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.132+0000 7f8eb1423700 1 -- 172.21.15.98:0/2824981570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 msgr2=0x7f8eac108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:49.037 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.132+0000 7f8eb1423700 1 --2- 172.21.15.98:0/2824981570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac108ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0098a0 tx=0x7f8e9c009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:49.037 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.132+0000 7f8eb1423700 1 -- 172.21.15.98:0/2824981570 shutdown_connections 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.132+0000 7f8eb1423700 1 --2- 172.21.15.98:0/2824981570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac108ad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.132+0000 7f8eb1423700 1 -- 172.21.15.98:0/2824981570 >> 172.21.15.98:0/2824981570 conn(0x7f8eac1000f0 msgr2=0x7f8eac102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.132+0000 7f8eb1423700 1 -- 172.21.15.98:0/2824981570 shutdown_connections 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.132+0000 7f8eb1423700 1 -- 172.21.15.98:0/2824981570 wait complete. 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.133+0000 7f8eb1423700 1 Processor -- start 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.133+0000 7f8eb1423700 1 -- start start 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.133+0000 7f8eb1423700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac106050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.133+0000 7f8eb1423700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac106590 con 0x7f8eac1066f0 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.133+0000 7f8eaaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.133+0000 7f8eaaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56990/0 (socket says 172.21.15.98:56990) 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.133+0000 7f8eaaffd700 1 -- 172.21.15.98:0/2278052771 learned_addr learned my addr 172.21.15.98:0/2278052771 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.133+0000 7f8eaaffd700 1 -- 172.21.15.98:0/2278052771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c009550 con 0x7f8eac1066f0 2024-09-13T02:43:49.038 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.133+0000 7f8eaaffd700 1 --2- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac106050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c006ba0 tx=0x7f8e9c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.135+0000 7f8ea8ff9700 1 -- 172.21.15.98:0/2278052771 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e9c003b00 con 0x7f8eac1066f0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.135+0000 7f8ea8ff9700 1 -- 172.21.15.98:0/2278052771 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e9c01a8e0 con 0x7f8eac1066f0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.135+0000 7f8ea8ff9700 1 -- 172.21.15.98:0/2278052771 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e9c019990 con 0x7f8eac1066f0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.135+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac1046a0 con 0x7f8eac1066f0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.135+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac104ac0 con 0x7f8eac1066f0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.135+0000 7f8ea8ff9700 1 -- 172.21.15.98:0/2278052771 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8e9c019c00 con 0x7f8eac1066f0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.136+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac109c70 con 0x7f8eac1066f0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.136+0000 7f8ea8ff9700 1 --2- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8e980383f0 0x7f8e9803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.136+0000 7f8ea8ff9700 1 -- 172.21.15.98:0/2278052771 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8e9c04c560 con 0x7f8eac1066f0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.136+0000 7f8ea3fff700 1 --2- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8e980383f0 0x7f8e9803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.136+0000 7f8ea3fff700 1 --2- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8e980383f0 0x7f8e9803a8a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006fd0 tx=0x7f8e94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.141+0000 7f8ea8ff9700 1 -- 172.21.15.98:0/2278052771 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8e9c02d440 con 0x7f8eac1066f0 2024-09-13T02:43:49.039 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.350+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eac1023b0 con 0x7f8e980383f0 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.355+0000 7f8ea8ff9700 1 -- 172.21.15.98:0/2278052771 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f8eac1023b0 con 0x7f8e980383f0 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8e980383f0 msgr2=0x7f8e9803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 --2- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8e980383f0 0x7f8e9803a8a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006fd0 tx=0x7f8e94006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 msgr2=0x7f8eac106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 --2- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac106050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c006ba0 tx=0x7f8e9c011b50 comp rx=0 tx=0).stop 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 shutdown_connections 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 --2- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8e980383f0 0x7f8e9803a8a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 --2- 172.21.15.98:0/2278052771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eac1066f0 0x7f8eac106050 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 >> 172.21.15.98:0/2278052771 conn(0x7f8eac1000f0 msgr2=0x7f8eac101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 shutdown_connections 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:48.357+0000 7f8eb1423700 1 -- 172.21.15.98:0/2278052771 wait complete. 2024-09-13T02:43:49.040 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying node-exporter service with default placement... 2024-09-13T02:43:49.629 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:49 smithi098 ceph-mon[27886]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:49.629 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:49 smithi098 ceph-mon[27886]: Saving service grafana spec with placement count:1 2024-09-13T02:43:49.629 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:49 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:50.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T02:43:50.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.458+0000 7ff446efe700 1 Processor -- start 2024-09-13T02:43:50.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.458+0000 7ff446efe700 1 -- start start 2024-09-13T02:43:50.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.458+0000 7ff446efe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff4401053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:50.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.458+0000 7ff446efe700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff440105900 con 0x7ff440104fb0 2024-09-13T02:43:50.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.458+0000 7ff444c9a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff4401053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.458+0000 7ff444c9a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff4401053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56994/0 (socket says 172.21.15.98:56994) 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.458+0000 7ff444c9a700 1 -- 172.21.15.98:0/364709508 learned_addr learned my addr 172.21.15.98:0/364709508 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.459+0000 7ff444c9a700 1 -- 172.21.15.98:0/364709508 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440105a40 con 0x7ff440104fb0 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.459+0000 7ff444c9a700 1 --2- 172.21.15.98:0/364709508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff4401053c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4340098a0 tx=0x7ff434009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74495a53266f9cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.459+0000 7ff43f7fe700 1 -- 172.21.15.98:0/364709508 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff434004180 con 0x7ff440104fb0 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.459+0000 7ff43f7fe700 1 -- 172.21.15.98:0/364709508 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff4340042e0 con 0x7ff440104fb0 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.459+0000 7ff43f7fe700 1 -- 172.21.15.98:0/364709508 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff434011af0 con 0x7ff440104fb0 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.459+0000 7ff446efe700 1 -- 172.21.15.98:0/364709508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 msgr2=0x7ff4401053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.459+0000 7ff446efe700 1 --2- 172.21.15.98:0/364709508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff4401053c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4340098a0 tx=0x7ff434009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff446efe700 1 -- 172.21.15.98:0/364709508 shutdown_connections 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff446efe700 1 --2- 172.21.15.98:0/364709508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff4401053c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff446efe700 1 -- 172.21.15.98:0/364709508 >> 172.21.15.98:0/364709508 conn(0x7ff4400ff880 msgr2=0x7ff440101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff446efe700 1 -- 172.21.15.98:0/364709508 shutdown_connections 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff446efe700 1 -- 172.21.15.98:0/364709508 wait complete. 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff446efe700 1 Processor -- start 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff446efe700 1 -- start start 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff446efe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff440198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff446efe700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff440198d70 con 0x7ff440104fb0 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.460+0000 7ff444c9a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff440198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.461+0000 7ff444c9a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff440198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57010/0 (socket says 172.21.15.98:57010) 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.461+0000 7ff444c9a700 1 -- 172.21.15.98:0/1693766323 learned_addr learned my addr 172.21.15.98:0/1693766323 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.461+0000 7ff444c9a700 1 -- 172.21.15.98:0/1693766323 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434009550 con 0x7ff440104fb0 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.461+0000 7ff444c9a700 1 --2- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff440198830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff434006ba0 tx=0x7ff434011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.461+0000 7ff43dffb700 1 -- 172.21.15.98:0/1693766323 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff434003b00 con 0x7ff440104fb0 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.461+0000 7ff43dffb700 1 -- 172.21.15.98:0/1693766323 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff43401a8e0 con 0x7ff440104fb0 2024-09-13T02:43:50.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.461+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff440198f70 con 0x7ff440104fb0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.461+0000 7ff43dffb700 1 -- 172.21.15.98:0/1693766323 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff434019990 con 0x7ff440104fb0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.461+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff440199390 con 0x7ff440104fb0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.462+0000 7ff43dffb700 1 -- 172.21.15.98:0/1693766323 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff434019c00 con 0x7ff440104fb0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.462+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff440062380 con 0x7ff440104fb0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.462+0000 7ff43dffb700 1 --2- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4300383f0 0x7ff43003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.462+0000 7ff43dffb700 1 -- 172.21.15.98:0/1693766323 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff43404c590 con 0x7ff440104fb0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.463+0000 7ff43ffff700 1 --2- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4300383f0 0x7ff43003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.463+0000 7ff43ffff700 1 --2- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4300383f0 0x7ff43003a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff42c006fd0 tx=0x7ff42c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.467+0000 7ff43dffb700 1 -- 172.21.15.98:0/1693766323 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff43402d440 con 0x7ff440104fb0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.685+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7ff440101b40 con 0x7ff4300383f0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.690+0000 7ff43dffb700 1 -- 172.21.15.98:0/1693766323 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7ff440101b40 con 0x7ff4300383f0 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.692+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4300383f0 msgr2=0x7ff43003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.692+0000 7ff446efe700 1 --2- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4300383f0 0x7ff43003a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff42c006fd0 tx=0x7ff42c006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.692+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 msgr2=0x7ff440198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:50.163 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.692+0000 7ff446efe700 1 --2- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff440198830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff434006ba0 tx=0x7ff434011b50 comp rx=0 tx=0).stop 2024-09-13T02:43:50.163 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.693+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 shutdown_connections 2024-09-13T02:43:50.163 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.693+0000 7ff446efe700 1 --2- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4300383f0 0x7ff43003a8a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:50.163 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.693+0000 7ff446efe700 1 --2- 172.21.15.98:0/1693766323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff440104fb0 0x7ff440198830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:50.163 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.693+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 >> 172.21.15.98:0/1693766323 conn(0x7ff4400ff880 msgr2=0x7ff440100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:50.163 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.693+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 shutdown_connections 2024-09-13T02:43:50.163 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:49.693+0000 7ff446efe700 1 -- 172.21.15.98:0/1693766323 wait complete. 2024-09-13T02:43:50.163 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying alertmanager service with default placement... 2024-09-13T02:43:50.789 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:50 smithi098 ceph-mon[27886]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:50.789 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:50 smithi098 ceph-mon[27886]: Saving service node-exporter spec with placement * 2024-09-13T02:43:50.790 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:50 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:50.790 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:50 smithi098 ceph-mon[27886]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:51.340 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T02:43:51.340 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.561+0000 7ff3bf2b4700 1 Processor -- start 2024-09-13T02:43:51.340 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.561+0000 7ff3bf2b4700 1 -- start start 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.561+0000 7ff3bf2b4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.561+0000 7ff3bf2b4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8079da0 con 0x7ff3b8106690 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.561+0000 7ff3bd050700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.561+0000 7ff3bd050700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57020/0 (socket says 172.21.15.98:57020) 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.561+0000 7ff3bd050700 1 -- 172.21.15.98:0/4219555638 learned_addr learned my addr 172.21.15.98:0/4219555638 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.561+0000 7ff3bd050700 1 -- 172.21.15.98:0/4219555638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8079ee0 con 0x7ff3b8106690 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3bd050700 1 --2- 172.21.15.98:0/4219555638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8108a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40098a0 tx=0x7ff3b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f760de0e1457e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3affff700 1 -- 172.21.15.98:0/4219555638 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3b4004180 con 0x7ff3b8106690 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3affff700 1 -- 172.21.15.98:0/4219555638 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff3b40042e0 con 0x7ff3b8106690 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3affff700 1 -- 172.21.15.98:0/4219555638 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3b4011af0 con 0x7ff3b8106690 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/4219555638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 msgr2=0x7ff3b8108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:51.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3bf2b4700 1 --2- 172.21.15.98:0/4219555638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8108a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40098a0 tx=0x7ff3b4009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/4219555638 shutdown_connections 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3bf2b4700 1 --2- 172.21.15.98:0/4219555638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8108a70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/4219555638 >> 172.21.15.98:0/4219555638 conn(0x7ff3b81000f0 msgr2=0x7ff3b8102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/4219555638 shutdown_connections 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.562+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/4219555638 wait complete. 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.563+0000 7ff3bf2b4700 1 Processor -- start 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.563+0000 7ff3bf2b4700 1 -- start start 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.563+0000 7ff3bf2b4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.563+0000 7ff3bf2b4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8199ea0 con 0x7ff3b8106690 2024-09-13T02:43:51.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.563+0000 7ff3bd050700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.563+0000 7ff3bd050700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57024/0 (socket says 172.21.15.98:57024) 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.563+0000 7ff3bd050700 1 -- 172.21.15.98:0/2751299868 learned_addr learned my addr 172.21.15.98:0/2751299868 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.563+0000 7ff3bd050700 1 -- 172.21.15.98:0/2751299868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b4009550 con 0x7ff3b8106690 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.564+0000 7ff3bd050700 1 --2- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8199960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4000c00 tx=0x7ff3b4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.564+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/2751299868 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3b4003a70 con 0x7ff3b8106690 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.564+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b819a0a0 con 0x7ff3b8106690 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.564+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/2751299868 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff3b4003bd0 con 0x7ff3b8106690 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.564+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/2751299868 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3b40238c0 con 0x7ff3b8106690 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.564+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b819a4c0 con 0x7ff3b8106690 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.565+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/2751299868 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff3b4023b30 con 0x7ff3b8106690 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.565+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b8062380 con 0x7ff3b8106690 2024-09-13T02:43:51.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.565+0000 7ff3ae7fc700 1 --2- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff3a4038440 0x7ff3a403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.565+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/2751299868 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff3b404c220 con 0x7ff3b8106690 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.565+0000 7ff3bc84f700 1 --2- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff3a4038440 0x7ff3a403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.565+0000 7ff3bc84f700 1 --2- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff3a4038440 0x7ff3a403a8f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8006fd0 tx=0x7ff3a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.570+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/2751299868 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff3b4010380 con 0x7ff3b8106690 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.770+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3b81023f0 con 0x7ff3a4038440 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.775+0000 7ff3ae7fc700 1 -- 172.21.15.98:0/2751299868 <== mgr.14120 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7ff3b81023f0 con 0x7ff3a4038440 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff3a4038440 msgr2=0x7ff3a403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 --2- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff3a4038440 0x7ff3a403a8f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8006fd0 tx=0x7ff3a8006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 msgr2=0x7ff3b8199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 --2- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8199960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4000c00 tx=0x7ff3b4011b50 comp rx=0 tx=0).stop 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 shutdown_connections 2024-09-13T02:43:51.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 --2- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff3a4038440 0x7ff3a403a8f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:51.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 --2- 172.21.15.98:0/2751299868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3b8106690 0x7ff3b8199960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:51.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 >> 172.21.15.98:0/2751299868 conn(0x7ff3b81000f0 msgr2=0x7ff3b8101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:51.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 shutdown_connections 2024-09-13T02:43:51.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:50.777+0000 7ff3bf2b4700 1 -- 172.21.15.98:0/2751299868 wait complete. 2024-09-13T02:43:51.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:51 smithi098 ceph-mon[27886]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:43:51.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:51 smithi098 ceph-mon[27886]: Saving service alertmanager spec with placement count:1 2024-09-13T02:43:51.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:51 smithi098 ceph-mon[27886]: from='mgr.14120 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:43:52.530 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.746+0000 7fa622db8700 1 Processor -- start 2024-09-13T02:43:52.530 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.746+0000 7fa622db8700 1 -- start start 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.746+0000 7fa622db8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.746+0000 7fa622db8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1053d0 con 0x7fa61c104a80 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.746+0000 7fa620b54700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.746+0000 7fa620b54700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57032/0 (socket says 172.21.15.98:57032) 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.746+0000 7fa620b54700 1 -- 172.21.15.98:0/497375188 learned_addr learned my addr 172.21.15.98:0/497375188 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.746+0000 7fa620b54700 1 -- 172.21.15.98:0/497375188 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c105510 con 0x7fa61c104a80 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.746+0000 7fa620b54700 1 --2- 172.21.15.98:0/497375188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c104e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa6100098a0 tx=0x7fa610009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25abeee1df252a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa61b7fe700 1 -- 172.21.15.98:0/497375188 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa610004180 con 0x7fa61c104a80 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa61b7fe700 1 -- 172.21.15.98:0/497375188 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa6100042e0 con 0x7fa61c104a80 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa61b7fe700 1 -- 172.21.15.98:0/497375188 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa610011af0 con 0x7fa61c104a80 2024-09-13T02:43:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa622db8700 1 -- 172.21.15.98:0/497375188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 msgr2=0x7fa61c104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa622db8700 1 --2- 172.21.15.98:0/497375188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c104e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa6100098a0 tx=0x7fa610009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa622db8700 1 -- 172.21.15.98:0/497375188 shutdown_connections 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa622db8700 1 --2- 172.21.15.98:0/497375188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c104e90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa622db8700 1 -- 172.21.15.98:0/497375188 >> 172.21.15.98:0/497375188 conn(0x7fa61c1000f0 msgr2=0x7fa61c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa622db8700 1 -- 172.21.15.98:0/497375188 shutdown_connections 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.747+0000 7fa622db8700 1 -- 172.21.15.98:0/497375188 wait complete. 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.748+0000 7fa622db8700 1 Processor -- start 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.748+0000 7fa622db8700 1 -- start start 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.748+0000 7fa622db8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c18fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.748+0000 7fa622db8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1901a0 con 0x7fa61c104a80 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.748+0000 7fa620b54700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c18fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.748+0000 7fa620b54700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c18fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57040/0 (socket says 172.21.15.98:57040) 2024-09-13T02:43:52.532 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.748+0000 7fa620b54700 1 -- 172.21.15.98:0/2915608569 learned_addr learned my addr 172.21.15.98:0/2915608569 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.748+0000 7fa620b54700 1 -- 172.21.15.98:0/2915608569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610009550 con 0x7fa61c104a80 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.749+0000 7fa620b54700 1 --2- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c18fc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa610011ad0 tx=0x7fa610011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.749+0000 7fa619ffb700 1 -- 172.21.15.98:0/2915608569 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa610003ab0 con 0x7fa61c104a80 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.749+0000 7fa619ffb700 1 -- 172.21.15.98:0/2915608569 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa610003c10 con 0x7fa61c104a80 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.749+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c18e2b0 con 0x7fa61c104a80 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.749+0000 7fa619ffb700 1 -- 172.21.15.98:0/2915608569 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6100198e0 con 0x7fa61c104a80 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.749+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c18e6d0 con 0x7fa61c104a80 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.750+0000 7fa619ffb700 1 -- 172.21.15.98:0/2915608569 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fa610019ba0 con 0x7fa61c104a80 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.750+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c062380 con 0x7fa61c104a80 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.750+0000 7fa619ffb700 1 --2- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa60c0383f0 0x7fa60c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.750+0000 7fa619ffb700 1 -- 172.21.15.98:0/2915608569 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa61004c1a0 con 0x7fa61c104a80 2024-09-13T02:43:52.533 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.750+0000 7fa61bfff700 1 --2- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa60c0383f0 0x7fa60c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.750+0000 7fa61bfff700 1 --2- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa60c0383f0 0x7fa60c03a8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa608006fd0 tx=0x7fa608006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.755+0000 7fa619ffb700 1 -- 172.21.15.98:0/2915608569 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa610010380 con 0x7fa61c104a80 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.945+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fa61c106980 con 0x7fa61c104a80 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.948+0000 7fa619ffb700 1 -- 172.21.15.98:0/2915608569 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fa61002c7b0 con 0x7fa61c104a80 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa60c0383f0 msgr2=0x7fa60c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 --2- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa60c0383f0 0x7fa60c03a8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa608006fd0 tx=0x7fa608006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 msgr2=0x7fa61c18fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 --2- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c18fc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa610011ad0 tx=0x7fa610011bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 shutdown_connections 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 --2- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa60c0383f0 0x7fa60c03a8a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 --2- 172.21.15.98:0/2915608569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa61c104a80 0x7fa61c18fc60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 >> 172.21.15.98:0/2915608569 conn(0x7fa61c1000f0 msgr2=0x7fa61c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:52.534 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 shutdown_connections 2024-09-13T02:43:52.535 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:51.951+0000 7fa622db8700 1 -- 172.21.15.98:0/2915608569 wait complete. 2024-09-13T02:43:53.092 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:52 smithi098 ceph-mon[27886]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:53.092 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:52 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2915608569' entity='client.admin' 2024-09-13T02:43:53.712 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.892+0000 7f64a97aa700 1 Processor -- start 2024-09-13T02:43:53.712 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.892+0000 7f64a97aa700 1 -- start start 2024-09-13T02:43:53.712 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.892+0000 7f64a97aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a4104950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:53.712 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.892+0000 7f64a97aa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a4079d40 con 0x7f64a4104540 2024-09-13T02:43:53.712 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.892+0000 7f64a2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a4104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:53.712 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.892+0000 7f64a2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a4104950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57050/0 (socket says 172.21.15.98:57050) 2024-09-13T02:43:53.712 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.893+0000 7f64a2ffd700 1 -- 172.21.15.98:0/1222989503 learned_addr learned my addr 172.21.15.98:0/1222989503 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:53.712 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.893+0000 7f64a2ffd700 1 -- 172.21.15.98:0/1222989503 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4079e80 con 0x7f64a4104540 2024-09-13T02:43:53.712 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.893+0000 7f64a2ffd700 1 --2- 172.21.15.98:0/1222989503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a4104950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64940098a0 tx=0x7f6494009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a972cb90395c42a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.893+0000 7f64a27fc700 1 -- 172.21.15.98:0/1222989503 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6494004180 con 0x7f64a4104540 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.893+0000 7f64a27fc700 1 -- 172.21.15.98:0/1222989503 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f64940042e0 con 0x7f64a4104540 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.893+0000 7f64a27fc700 1 -- 172.21.15.98:0/1222989503 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6494011af0 con 0x7f64a4104540 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.894+0000 7f64a97aa700 1 -- 172.21.15.98:0/1222989503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 msgr2=0x7f64a4104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.894+0000 7f64a97aa700 1 --2- 172.21.15.98:0/1222989503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a4104950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64940098a0 tx=0x7f6494009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.894+0000 7f64a97aa700 1 -- 172.21.15.98:0/1222989503 shutdown_connections 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.894+0000 7f64a97aa700 1 --2- 172.21.15.98:0/1222989503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a4104950 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.894+0000 7f64a97aa700 1 -- 172.21.15.98:0/1222989503 >> 172.21.15.98:0/1222989503 conn(0x7f64a4100130 msgr2=0x7f64a4102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.894+0000 7f64a97aa700 1 -- 172.21.15.98:0/1222989503 shutdown_connections 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.894+0000 7f64a97aa700 1 -- 172.21.15.98:0/1222989503 wait complete. 2024-09-13T02:43:53.713 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.894+0000 7f64a97aa700 1 Processor -- start 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.894+0000 7f64a97aa700 1 -- start start 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a97aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a97aa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a419c0c0 con 0x7f64a4104540 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a419bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57064/0 (socket says 172.21.15.98:57064) 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a2ffd700 1 -- 172.21.15.98:0/2456291831 learned_addr learned my addr 172.21.15.98:0/2456291831 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a2ffd700 1 -- 172.21.15.98:0/2456291831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494009550 con 0x7f64a4104540 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a2ffd700 1 --2- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a419bb80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6494006ba0 tx=0x7f6494011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a0ff9700 1 -- 172.21.15.98:0/2456291831 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6494003b00 con 0x7f64a4104540 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a0ff9700 1 -- 172.21.15.98:0/2456291831 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f649401a8e0 con 0x7f64a4104540 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a419c2c0 con 0x7f64a4104540 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a0ff9700 1 -- 172.21.15.98:0/2456291831 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6494019990 con 0x7f64a4104540 2024-09-13T02:43:53.714 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.895+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a419c6e0 con 0x7f64a4104540 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.896+0000 7f64a0ff9700 1 -- 172.21.15.98:0/2456291831 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6494019c50 con 0x7f64a4104540 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.896+0000 7f64a0ff9700 1 --2- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f64900383a0 0x7f649003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.896+0000 7f64a0ff9700 1 -- 172.21.15.98:0/2456291831 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f649404c630 con 0x7f64a4104540 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.896+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a4195390 con 0x7f64a4104540 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.896+0000 7f649a7fc700 1 --2- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f64900383a0 0x7f649003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.897+0000 7f649a7fc700 1 --2- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f64900383a0 0x7f649003a850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f648c006fd0 tx=0x7f648c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:52.901+0000 7f64a0ff9700 1 -- 172.21.15.98:0/2456291831 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f649402b930 con 0x7f64a4104540 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.091+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f64a402cc30 con 0x7f64a4104540 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.095+0000 7f64a0ff9700 1 -- 172.21.15.98:0/2456291831 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f649402b340 con 0x7f64a4104540 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.097+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f64900383a0 msgr2=0x7f649003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.097+0000 7f64a97aa700 1 --2- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f64900383a0 0x7f649003a850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f648c006fd0 tx=0x7f648c006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.097+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 msgr2=0x7f64a419bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:53.715 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.097+0000 7f64a97aa700 1 --2- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a419bb80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6494006ba0 tx=0x7f6494011b50 comp rx=0 tx=0).stop 2024-09-13T02:43:53.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.097+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 shutdown_connections 2024-09-13T02:43:53.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.097+0000 7f64a97aa700 1 --2- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f64900383a0 0x7f649003a850 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:53.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.097+0000 7f64a97aa700 1 --2- 172.21.15.98:0/2456291831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a4104540 0x7f64a419bb80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:53.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.097+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 >> 172.21.15.98:0/2456291831 conn(0x7f64a4100130 msgr2=0x7f64a4190100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:53.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.097+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 shutdown_connections 2024-09-13T02:43:53.716 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:53.098+0000 7f64a97aa700 1 -- 172.21.15.98:0/2456291831 wait complete. 2024-09-13T02:43:53.716 INFO:teuthology.orchestra.run.smithi098.stdout:Enabling the dashboard module... 2024-09-13T02:43:54.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:54 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2456291831' entity='client.admin' 2024-09-13T02:43:55.357 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:55 smithi098 ceph-mon[27886]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:55.357 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:55 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1855900183' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T02:43:55.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.179+0000 7f0572ec1700 1 Processor -- start 2024-09-13T02:43:55.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.179+0000 7f0572ec1700 1 -- start start 2024-09-13T02:43:55.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.179+0000 7f0572ec1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c1048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:55.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.179+0000 7f0572ec1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c079d60 con 0x7f056c1044c0 2024-09-13T02:43:55.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.179+0000 7f0570c5d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c1048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:55.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.179+0000 7f0570c5d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c1048d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57066/0 (socket says 172.21.15.98:57066) 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.179+0000 7f0570c5d700 1 -- 172.21.15.98:0/2843333514 learned_addr learned my addr 172.21.15.98:0/2843333514 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.179+0000 7f0570c5d700 1 -- 172.21.15.98:0/2843333514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c079ea0 con 0x7f056c1044c0 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f0570c5d700 1 --2- 172.21.15.98:0/2843333514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c1048d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05600098a0 tx=0x7f0560009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bd23b95bf7ace1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f056b7fe700 1 -- 172.21.15.98:0/2843333514 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0560004180 con 0x7f056c1044c0 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f056b7fe700 1 -- 172.21.15.98:0/2843333514 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f05600042e0 con 0x7f056c1044c0 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f056b7fe700 1 -- 172.21.15.98:0/2843333514 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0560011af0 con 0x7f056c1044c0 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f0572ec1700 1 -- 172.21.15.98:0/2843333514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 msgr2=0x7f056c1048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f0572ec1700 1 --2- 172.21.15.98:0/2843333514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c1048d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05600098a0 tx=0x7f0560009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f0572ec1700 1 -- 172.21.15.98:0/2843333514 shutdown_connections 2024-09-13T02:43:55.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f0572ec1700 1 --2- 172.21.15.98:0/2843333514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c1048d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f0572ec1700 1 -- 172.21.15.98:0/2843333514 >> 172.21.15.98:0/2843333514 conn(0x7f056c1000f0 msgr2=0x7f056c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f0572ec1700 1 -- 172.21.15.98:0/2843333514 shutdown_connections 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.180+0000 7f0572ec1700 1 -- 172.21.15.98:0/2843333514 wait complete. 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.181+0000 7f0572ec1700 1 Processor -- start 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.181+0000 7f0572ec1700 1 -- start start 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.181+0000 7f0572ec1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.181+0000 7f0572ec1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c19c040 con 0x7f056c1044c0 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.181+0000 7f0570c5d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.181+0000 7f0570c5d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c19bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57072/0 (socket says 172.21.15.98:57072) 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.181+0000 7f0570c5d700 1 -- 172.21.15.98:0/1855900183 learned_addr learned my addr 172.21.15.98:0/1855900183 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:55.739 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.181+0000 7f0570c5d700 1 -- 172.21.15.98:0/1855900183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560009550 con 0x7f056c1044c0 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.182+0000 7f0570c5d700 1 --2- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c19bb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0560000c00 tx=0x7f0560011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.182+0000 7f0569ffb700 1 -- 172.21.15.98:0/1855900183 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0560003a70 con 0x7f056c1044c0 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.182+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c19c2a0 con 0x7f056c1044c0 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.182+0000 7f0569ffb700 1 -- 172.21.15.98:0/1855900183 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0560003bd0 con 0x7f056c1044c0 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.182+0000 7f0569ffb700 1 -- 172.21.15.98:0/1855900183 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05600238c0 con 0x7f056c1044c0 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.182+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c19c720 con 0x7f056c1044c0 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.183+0000 7f0569ffb700 1 -- 172.21.15.98:0/1855900183 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f0560023b80 con 0x7f056c1044c0 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.183+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c1952f0 con 0x7f056c1044c0 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.183+0000 7f0569ffb700 1 --2- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f055c0383f0 0x7f055c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:55.740 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.183+0000 7f0569ffb700 1 -- 172.21.15.98:0/1855900183 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f056004c380 con 0x7f056c1044c0 2024-09-13T02:43:55.741 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.183+0000 7f056bfff700 1 --2- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f055c0383f0 0x7f055c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:55.741 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.183+0000 7f056bfff700 1 --2- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f055c0383f0 0x7f055c03a8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0558006fd0 tx=0x7f0558006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:55.741 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.188+0000 7f0569ffb700 1 -- 172.21.15.98:0/1855900183 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f056002b300 con 0x7f056c1044c0 2024-09-13T02:43:55.741 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:54.431+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f056c02cc30 con 0x7f056c1044c0 2024-09-13T02:43:55.741 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.097+0000 7f0569ffb700 1 -- 172.21.15.98:0/1855900183 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f0560019c60 con 0x7f056c1044c0 2024-09-13T02:43:55.741 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.099+0000 7f0569ffb700 1 -- 172.21.15.98:0/1855900183 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f056001ad00 con 0x7f056c1044c0 2024-09-13T02:43:55.741 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f055c0383f0 msgr2=0x7f055c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:55.741 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 --2- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f055c0383f0 0x7f055c03a8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0558006fd0 tx=0x7f0558006e40 comp rx=0 tx=0).stop 2024-09-13T02:43:55.741 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 msgr2=0x7f056c19bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 --2- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c19bb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0560000c00 tx=0x7f0560011b50 comp rx=0 tx=0).stop 2024-09-13T02:43:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 shutdown_connections 2024-09-13T02:43:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 --2- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f055c0383f0 0x7f055c03a8a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 --2- 172.21.15.98:0/1855900183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f056c1044c0 0x7f056c19bb00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 >> 172.21.15.98:0/1855900183 conn(0x7f056c1000f0 msgr2=0x7f056c190080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 shutdown_connections 2024-09-13T02:43:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:55.102+0000 7f0572ec1700 1 -- 172.21.15.98:0/1855900183 wait complete. 2024-09-13T02:43:56.369 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:56 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1855900183' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T02:43:56.370 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:56 smithi098 ceph-mon[27886]: mgrmap e9: smithi098.ukgenf(active, since 25s) 2024-09-13T02:43:56.970 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:43:56.970 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T02:43:56.970 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T02:43:56.970 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "active_name": "smithi098.ukgenf", 2024-09-13T02:43:56.970 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T02:43:56.970 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:43:56.970 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.189+0000 7f1733933700 1 Processor -- start 2024-09-13T02:43:56.970 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.190+0000 7f1733933700 1 -- start start 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.190+0000 7f1733933700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c107600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.190+0000 7f1733933700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c107b40 con 0x7f172c1071f0 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.190+0000 7f17316cf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c107600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.190+0000 7f17316cf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c107600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47676/0 (socket says 172.21.15.98:47676) 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.190+0000 7f17316cf700 1 -- 172.21.15.98:0/2542544250 learned_addr learned my addr 172.21.15.98:0/2542544250 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.191+0000 7f17316cf700 1 -- 172.21.15.98:0/2542544250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c107c80 con 0x7f172c1071f0 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.191+0000 7f17316cf700 1 --2- 172.21.15.98:0/2542544250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c107600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f17280098a0 tx=0x7f1728009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a4e1c07f3231db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.191+0000 7f1723fff700 1 -- 172.21.15.98:0/2542544250 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1728004180 con 0x7f172c1071f0 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.191+0000 7f1723fff700 1 -- 172.21.15.98:0/2542544250 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17280042e0 con 0x7f172c1071f0 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.191+0000 7f1723fff700 1 -- 172.21.15.98:0/2542544250 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1728011af0 con 0x7f172c1071f0 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.192+0000 7f1733933700 1 -- 172.21.15.98:0/2542544250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 msgr2=0x7f172c107600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.192+0000 7f1733933700 1 --2- 172.21.15.98:0/2542544250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c107600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f17280098a0 tx=0x7f1728009bb0 comp rx=0 tx=0).stop 2024-09-13T02:43:56.971 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.192+0000 7f1733933700 1 -- 172.21.15.98:0/2542544250 shutdown_connections 2024-09-13T02:43:56.972 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.192+0000 7f1733933700 1 --2- 172.21.15.98:0/2542544250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c107600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:56.972 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.192+0000 7f1733933700 1 -- 172.21.15.98:0/2542544250 >> 172.21.15.98:0/2542544250 conn(0x7f172c0ff880 msgr2=0x7f172c101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:56.972 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.192+0000 7f1733933700 1 -- 172.21.15.98:0/2542544250 shutdown_connections 2024-09-13T02:43:56.972 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.192+0000 7f1733933700 1 -- 172.21.15.98:0/2542544250 wait complete. 2024-09-13T02:43:56.972 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.192+0000 7f1733933700 1 Processor -- start 2024-09-13T02:43:56.972 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.192+0000 7f1733933700 1 -- start start 2024-09-13T02:43:56.972 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f1733933700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:56.972 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f1733933700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c199e20 con 0x7f172c1071f0 2024-09-13T02:43:56.972 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f17316cf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f17316cf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c1998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47682/0 (socket says 172.21.15.98:47682) 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f17316cf700 1 -- 172.21.15.98:0/4138505622 learned_addr learned my addr 172.21.15.98:0/4138505622 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f17316cf700 1 -- 172.21.15.98:0/4138505622 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728009550 con 0x7f172c1071f0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f17316cf700 1 --2- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c1998e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1728006ba0 tx=0x7f1728011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f17227fc700 1 -- 172.21.15.98:0/4138505622 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1728003b00 con 0x7f172c1071f0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f17227fc700 1 -- 172.21.15.98:0/4138505622 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f172801a8e0 con 0x7f172c1071f0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c19a020 con 0x7f172c1071f0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f17227fc700 1 -- 172.21.15.98:0/4138505622 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17280199c0 con 0x7f172c1071f0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.193+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c19a440 con 0x7f172c1071f0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.194+0000 7f17227fc700 1 -- 172.21.15.98:0/4138505622 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f1728019c30 con 0x7f172c1071f0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.194+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c062380 con 0x7f172c1071f0 2024-09-13T02:43:56.973 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.194+0000 7f17227fc700 1 --2- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1718038440 0x7f171803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.195+0000 7f17227fc700 1 -- 172.21.15.98:0/4138505622 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f172804c5c0 con 0x7f172c1071f0 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.195+0000 7f1730ece700 1 -- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1718038440 msgr2=0x7f171803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.195+0000 7f1730ece700 1 --2- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1718038440 0x7f171803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.199+0000 7f17227fc700 1 -- 172.21.15.98:0/4138505622 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f172801a430 con 0x7f172c1071f0 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.396+0000 7f1730ece700 1 -- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1718038440 msgr2=0x7f171803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.396+0000 7f1730ece700 1 --2- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1718038440 0x7f171803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.451+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f172c19d5c0 con 0x7f172c1071f0 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.451+0000 7f17227fc700 1 -- 172.21.15.98:0/4138505622 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f1728018b40 con 0x7f172c1071f0 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1718038440 msgr2=0x7f171803a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:43:56.974 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 --2- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1718038440 0x7f171803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 msgr2=0x7f172c1998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 --2- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c1998e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1728006ba0 tx=0x7f1728011b50 comp rx=0 tx=0).stop 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 shutdown_connections 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 --2- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1718038440 0x7f171803a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 --2- 172.21.15.98:0/4138505622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f172c1071f0 0x7f172c1998e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 >> 172.21.15.98:0/4138505622 conn(0x7f172c0ff880 msgr2=0x7f172c100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 shutdown_connections 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:56.453+0000 7f1733933700 1 -- 172.21.15.98:0/4138505622 wait complete. 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for the mgr to restart... 2024-09-13T02:43:56.975 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mgr epoch 9... 2024-09-13T02:43:57.371 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:43:57 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/4138505622' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T02:44:02.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: Active manager daemon smithi098.ukgenf restarted 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: Activating manager daemon smithi098.ukgenf 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: mgrmap e10: smithi098.ukgenf(active, starting, since 0.00378795s) 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: Manager daemon smithi098.ukgenf is now available 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:44:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:44:02.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:44:02.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:01 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/trash_purge_schedule"}]: dispatch 2024-09-13T02:44:03.219 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:03 smithi098 ceph-mon[27886]: [13/Sep/2024:02:44:02] ENGINE Bus STARTING 2024-09-13T02:44:03.220 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:03 smithi098 ceph-mon[27886]: mgrmap e11: smithi098.ukgenf(active, since 1.00577s) 2024-09-13T02:44:03.495 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.406+0000 7fba53919700 1 Processor -- start 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.406+0000 7fba53919700 1 -- start start 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.406+0000 7fba53919700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c108b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.406+0000 7fba53919700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c079d60 con 0x7fba4c106730 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.406+0000 7fba516b5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.406+0000 7fba516b5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47684/0 (socket says 172.21.15.98:47684) 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.406+0000 7fba516b5700 1 -- 172.21.15.98:0/1574471573 learned_addr learned my addr 172.21.15.98:0/1574471573 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.407+0000 7fba516b5700 1 -- 172.21.15.98:0/1574471573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c079ea0 con 0x7fba4c106730 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.407+0000 7fba516b5700 1 --2- 172.21.15.98:0/1574471573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c108b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba480098a0 tx=0x7fba48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452f3fa4ad3ae09d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.407+0000 7fba43fff700 1 -- 172.21.15.98:0/1574471573 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba48004180 con 0x7fba4c106730 2024-09-13T02:44:03.496 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.407+0000 7fba43fff700 1 -- 172.21.15.98:0/1574471573 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba480042e0 con 0x7fba4c106730 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.407+0000 7fba43fff700 1 -- 172.21.15.98:0/1574471573 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba48011af0 con 0x7fba4c106730 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 -- 172.21.15.98:0/1574471573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 msgr2=0x7fba4c108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 --2- 172.21.15.98:0/1574471573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c108b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba480098a0 tx=0x7fba48009bb0 comp rx=0 tx=0).stop 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 -- 172.21.15.98:0/1574471573 shutdown_connections 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 --2- 172.21.15.98:0/1574471573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c108b10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 -- 172.21.15.98:0/1574471573 >> 172.21.15.98:0/1574471573 conn(0x7fba4c100130 msgr2=0x7fba4c102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 -- 172.21.15.98:0/1574471573 shutdown_connections 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 -- 172.21.15.98:0/1574471573 wait complete. 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 Processor -- start 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 -- start start 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.408+0000 7fba53919700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c106090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:03.497 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba53919700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c1065d0 con 0x7fba4c106730 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba516b5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c106090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba516b5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c106090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47690/0 (socket says 172.21.15.98:47690) 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba516b5700 1 -- 172.21.15.98:0/3109514352 learned_addr learned my addr 172.21.15.98:0/3109514352 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba516b5700 1 -- 172.21.15.98:0/3109514352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48009550 con 0x7fba4c106730 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba516b5700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c106090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba48000c00 tx=0x7fba48011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba48003a70 con 0x7fba4c106730 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba48003bd0 con 0x7fba4c106730 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c104740 con 0x7fba4c106730 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba480238c0 con 0x7fba4c106730 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.409+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c104bc0 con 0x7fba4c106730 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.410+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fba48023b30 con 0x7fba4c106730 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.410+0000 7fba427fc700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:03.498 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.410+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba4c109c40 con 0x7fba38038490 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.410+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fba4804c1e0 con 0x7fba4c106730 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.410+0000 7fba50eb4700 1 -- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 msgr2=0x7fba3803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.410+0000 7fba50eb4700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.611+0000 7fba50eb4700 1 -- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 msgr2=0x7fba3803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:57.611+0000 7fba50eb4700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:58.012+0000 7fba50eb4700 1 -- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 msgr2=0x7fba3803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:58.012+0000 7fba50eb4700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:58.813+0000 7fba50eb4700 1 -- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 msgr2=0x7fba3803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:43:58.813+0000 7fba50eb4700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:00.414+0000 7fba50eb4700 1 -- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 msgr2=0x7fba3803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:00.414+0000 7fba50eb4700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:01.817+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7fba4801ad00 con 0x7fba4c106730 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:01.817+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 msgr2=0x7fba3803a940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:01.817+0000 7fba427fc700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:03.499 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.818+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7fba48019c60 con 0x7fba4c106730 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.818+0000 7fba427fc700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.818+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba4c109c40 con 0x7fba38038490 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.819+0000 7fba50eb4700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.819+0000 7fba50eb4700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fba3c003a10 tx=0x7fba3c009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.820+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 <== mgr.14164 v2:172.21.15.98:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fba4c109c40 con 0x7fba38038490 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.826+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fba4c105c30 con 0x7fba38038490 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.826+0000 7fba427fc700 1 -- 172.21.15.98:0/3109514352 <== mgr.14164 v2:172.21.15.98:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fba4c105c30 con 0x7fba38038490 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 msgr2=0x7fba3803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fba3c003a10 tx=0x7fba3c009270 comp rx=0 tx=0).stop 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 msgr2=0x7fba4c106090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c106090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba48000c00 tx=0x7fba48011b50 comp rx=0 tx=0).stop 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 shutdown_connections 2024-09-13T02:44:03.500 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fba38038490 0x7fba3803a940 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:03.501 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 --2- 172.21.15.98:0/3109514352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba4c106730 0x7fba4c106090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:03.501 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 >> 172.21.15.98:0/3109514352 conn(0x7fba4c100130 msgr2=0x7fba4c100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:03.501 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 shutdown_connections 2024-09-13T02:44:03.501 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:02.827+0000 7fba53919700 1 -- 172.21.15.98:0/3109514352 wait complete. 2024-09-13T02:44:03.501 INFO:teuthology.orchestra.run.smithi098.stdout:mgr epoch 9 is available 2024-09-13T02:44:03.501 INFO:teuthology.orchestra.run.smithi098.stdout:Generating a dashboard self-signed certificate... 2024-09-13T02:44:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:04 smithi098 ceph-mon[27886]: [13/Sep/2024:02:44:02] ENGINE Serving on https://172.21.15.98:7150 2024-09-13T02:44:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:04 smithi098 ceph-mon[27886]: [13/Sep/2024:02:44:02] ENGINE Serving on http://172.21.15.98:8765 2024-09-13T02:44:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:04 smithi098 ceph-mon[27886]: [13/Sep/2024:02:44:02] ENGINE Bus STARTED 2024-09-13T02:44:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:04 smithi098 ceph-mon[27886]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T02:44:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:04 smithi098 ceph-mon[27886]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T02:44:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:04 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:04.734 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T02:44:04.734 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.922+0000 7f446ad8c700 1 Processor -- start 2024-09-13T02:44:04.734 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.922+0000 7f446ad8c700 1 -- start start 2024-09-13T02:44:04.734 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.922+0000 7f446ad8c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.922+0000 7f446ad8c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4464106590 con 0x7f4464105c40 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.923+0000 7f4468b28700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.923+0000 7f4468b28700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47764/0 (socket says 172.21.15.98:47764) 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.923+0000 7f4468b28700 1 -- 172.21.15.98:0/3179740656 learned_addr learned my addr 172.21.15.98:0/3179740656 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.923+0000 7f4468b28700 1 -- 172.21.15.98:0/3179740656 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44641066d0 con 0x7f4464105c40 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.923+0000 7f4468b28700 1 --2- 172.21.15.98:0/3179740656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464106050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44580098a0 tx=0x7f4458009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424683b5bdc93d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.923+0000 7f44637fe700 1 -- 172.21.15.98:0/3179740656 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4458004180 con 0x7f4464105c40 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.923+0000 7f44637fe700 1 -- 172.21.15.98:0/3179740656 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44580042e0 con 0x7f4464105c40 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.923+0000 7f44637fe700 1 -- 172.21.15.98:0/3179740656 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4458011af0 con 0x7f4464105c40 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.924+0000 7f446ad8c700 1 -- 172.21.15.98:0/3179740656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 msgr2=0x7f4464106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.924+0000 7f446ad8c700 1 --2- 172.21.15.98:0/3179740656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464106050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44580098a0 tx=0x7f4458009bb0 comp rx=0 tx=0).stop 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.924+0000 7f446ad8c700 1 -- 172.21.15.98:0/3179740656 shutdown_connections 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.924+0000 7f446ad8c700 1 --2- 172.21.15.98:0/3179740656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464106050 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:04.735 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.924+0000 7f446ad8c700 1 -- 172.21.15.98:0/3179740656 >> 172.21.15.98:0/3179740656 conn(0x7f44641012b0 msgr2=0x7f44641036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.924+0000 7f446ad8c700 1 -- 172.21.15.98:0/3179740656 shutdown_connections 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.924+0000 7f446ad8c700 1 -- 172.21.15.98:0/3179740656 wait complete. 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.925+0000 7f446ad8c700 1 Processor -- start 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.925+0000 7f446ad8c700 1 -- start start 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.925+0000 7f446ad8c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.925+0000 7f446ad8c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4464199ea0 con 0x7f4464105c40 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.925+0000 7f4468b28700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.925+0000 7f4468b28700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47772/0 (socket says 172.21.15.98:47772) 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.925+0000 7f4468b28700 1 -- 172.21.15.98:0/3402234852 learned_addr learned my addr 172.21.15.98:0/3402234852 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.925+0000 7f4468b28700 1 -- 172.21.15.98:0/3402234852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458009550 con 0x7f4464105c40 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.925+0000 7f4468b28700 1 --2- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464199960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4458011670 tx=0x7f4458011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:04.736 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.926+0000 7f4461ffb700 1 -- 172.21.15.98:0/3402234852 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4458003a40 con 0x7f4464105c40 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.926+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446419a0a0 con 0x7f4464105c40 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.926+0000 7f4461ffb700 1 -- 172.21.15.98:0/3402234852 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4458003ba0 con 0x7f4464105c40 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.926+0000 7f4461ffb700 1 -- 172.21.15.98:0/3402234852 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4458024790 con 0x7f4464105c40 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.926+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446419a4c0 con 0x7f4464105c40 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.927+0000 7f4461ffb700 1 -- 172.21.15.98:0/3402234852 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7f445801a430 con 0x7f4464105c40 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.927+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4464062380 con 0x7f4464105c40 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.927+0000 7f4461ffb700 1 --2- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4454038320 0x7f445403a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.927+0000 7f4461ffb700 1 -- 172.21.15.98:0/3402234852 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f445804c440 con 0x7f4464105c40 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.927+0000 7f4463fff700 1 --2- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4454038320 0x7f445403a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.927+0000 7f4463fff700 1 --2- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4454038320 0x7f445403a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4450006fd0 tx=0x7f4450006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:03.936+0000 7f4461ffb700 1 -- 172.21.15.98:0/3402234852 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4458010380 con 0x7f4464105c40 2024-09-13T02:44:04.737 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.136+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f446410a0e0 con 0x7f4454038320 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.265+0000 7f4461ffb700 1 -- 172.21.15.98:0/3402234852 <== mgr.14164 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f446410a0e0 con 0x7f4454038320 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4454038320 msgr2=0x7f445403a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 --2- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4454038320 0x7f445403a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4450006fd0 tx=0x7f4450006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 msgr2=0x7f4464199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 --2- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464199960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4458011670 tx=0x7f4458011b50 comp rx=0 tx=0).stop 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 shutdown_connections 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 --2- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4454038320 0x7f445403a7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 --2- 172.21.15.98:0/3402234852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4464105c40 0x7f4464199960 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 >> 172.21.15.98:0/3402234852 conn(0x7f44641012b0 msgr2=0x7f44641029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 shutdown_connections 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:04.267+0000 7f446ad8c700 1 -- 172.21.15.98:0/3402234852 wait complete. 2024-09-13T02:44:04.738 INFO:teuthology.orchestra.run.smithi098.stdout:Creating initial admin user... 2024-09-13T02:44:05.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:05 smithi098 ceph-mon[27886]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:44:05.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:05 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:05 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:05 smithi098 ceph-mon[27886]: mgrmap e12: smithi098.ukgenf(active, since 2s) 2024-09-13T02:44:06.360 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$IcOE9XPmt2i/MRcjuxC.G.sym6cPMYkT7m9MLQvUBKJvivOZQfbay", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726195445, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T02:44:06.360 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.130+0000 7f60ecc77700 1 Processor -- start 2024-09-13T02:44:06.360 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.130+0000 7f60ecc77700 1 -- start start 2024-09-13T02:44:06.360 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.130+0000 7f60ecc77700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8104280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:06.360 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.130+0000 7f60ecc77700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81047c0 con 0x7f60e8103e70 2024-09-13T02:44:06.360 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.130+0000 7f60e659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:06.360 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.130+0000 7f60e659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8104280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56798/0 (socket says 172.21.15.98:56798) 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.130+0000 7f60e659c700 1 -- 172.21.15.98:0/1779099522 learned_addr learned my addr 172.21.15.98:0/1779099522 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.131+0000 7f60e659c700 1 -- 172.21.15.98:0/1779099522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8104900 con 0x7f60e8103e70 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.131+0000 7f60e659c700 1 --2- 172.21.15.98:0/1779099522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8104280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0098a0 tx=0x7f60dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6926e3994be012c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.131+0000 7f60e559a700 1 -- 172.21.15.98:0/1779099522 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60dc004180 con 0x7f60e8103e70 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.131+0000 7f60e559a700 1 -- 172.21.15.98:0/1779099522 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60dc0042e0 con 0x7f60e8103e70 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.131+0000 7f60e559a700 1 -- 172.21.15.98:0/1779099522 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60dc011af0 con 0x7f60e8103e70 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.132+0000 7f60ecc77700 1 -- 172.21.15.98:0/1779099522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 msgr2=0x7f60e8104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.132+0000 7f60ecc77700 1 --2- 172.21.15.98:0/1779099522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8104280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0098a0 tx=0x7f60dc009bb0 comp rx=0 tx=0).stop 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.132+0000 7f60ecc77700 1 -- 172.21.15.98:0/1779099522 shutdown_connections 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.132+0000 7f60ecc77700 1 --2- 172.21.15.98:0/1779099522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8104280 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.132+0000 7f60ecc77700 1 -- 172.21.15.98:0/1779099522 >> 172.21.15.98:0/1779099522 conn(0x7f60e80ff870 msgr2=0x7f60e8101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.132+0000 7f60ecc77700 1 -- 172.21.15.98:0/1779099522 shutdown_connections 2024-09-13T02:44:06.361 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.132+0000 7f60ecc77700 1 -- 172.21.15.98:0/1779099522 wait complete. 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.132+0000 7f60ecc77700 1 Processor -- start 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60ecc77700 1 -- start start 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60ecc77700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60ecc77700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8199e90 con 0x7f60e8103e70 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60e659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60e659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56800/0 (socket says 172.21.15.98:56800) 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60e659c700 1 -- 172.21.15.98:0/2060220867 learned_addr learned my addr 172.21.15.98:0/2060220867 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60e659c700 1 -- 172.21.15.98:0/2060220867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc009550 con 0x7f60e8103e70 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60e659c700 1 --2- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8199950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60dc000c00 tx=0x7f60dc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60d77fe700 1 -- 172.21.15.98:0/2060220867 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60dc003a70 con 0x7f60e8103e70 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60d77fe700 1 -- 172.21.15.98:0/2060220867 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60dc003bd0 con 0x7f60e8103e70 2024-09-13T02:44:06.362 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e819a090 con 0x7f60e8103e70 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60d77fe700 1 -- 172.21.15.98:0/2060220867 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60dc0238c0 con 0x7f60e8103e70 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.133+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e819a4b0 con 0x7f60e8103e70 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.134+0000 7f60d77fe700 1 -- 172.21.15.98:0/2060220867 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f60dc023b80 con 0x7f60e8103e70 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.134+0000 7f60d77fe700 1 --2- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f60d0038440 0x7f60d003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.135+0000 7f60d77fe700 1 -- 172.21.15.98:0/2060220867 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f60dc04c2e0 con 0x7f60e8103e70 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.135+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e8062380 con 0x7f60e8103e70 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.135+0000 7f60e5d9b700 1 --2- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f60d0038440 0x7f60d003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.135+0000 7f60e5d9b700 1 --2- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f60d0038440 0x7f60d003a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60d8006fd0 tx=0x7f60d8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.143+0000 7f60d77fe700 1 -- 172.21.15.98:0/2060220867 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f60dc02b300 con 0x7f60e8103e70 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.374+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f60e80621a0 con 0x7f60d0038440 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.604+0000 7f60d77fe700 1 -- 172.21.15.98:0/2060220867 <== mgr.14164 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f60e80621a0 con 0x7f60d0038440 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f60d0038440 msgr2=0x7f60d003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:06.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 --2- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f60d0038440 0x7f60d003a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60d8006fd0 tx=0x7f60d8006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:06.364 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 msgr2=0x7f60e8199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:06.364 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 --2- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8199950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60dc000c00 tx=0x7f60dc011b50 comp rx=0 tx=0).stop 2024-09-13T02:44:06.364 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 shutdown_connections 2024-09-13T02:44:06.364 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 --2- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f60d0038440 0x7f60d003a8f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:06.364 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 --2- 172.21.15.98:0/2060220867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e8103e70 0x7f60e8199950 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:06.364 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 >> 172.21.15.98:0/2060220867 conn(0x7f60e80ff870 msgr2=0x7f60e8100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:06.364 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 shutdown_connections 2024-09-13T02:44:06.364 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:05.607+0000 7f60ecc77700 1 -- 172.21.15.98:0/2060220867 wait complete. 2024-09-13T02:44:06.364 INFO:teuthology.orchestra.run.smithi098.stdout:Fetching dashboard port number... 2024-09-13T02:44:06.579 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:06 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:06.579 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:06 smithi098 ceph-mon[27886]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:44:06.579 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:06 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:07.513 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:07 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3765582055' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T02:44:07.519 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T02:44:07.519 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.793+0000 7f636ec8b700 1 Processor -- start 2024-09-13T02:44:07.519 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.793+0000 7f636ec8b700 1 -- start start 2024-09-13T02:44:07.520 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.793+0000 7f636ec8b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:07.520 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.793+0000 7f636ec8b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6368079d60 con 0x7f63681066d0 2024-09-13T02:44:07.520 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.793+0000 7f636ca27700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:07.520 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.793+0000 7f636ca27700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56814/0 (socket says 172.21.15.98:56814) 2024-09-13T02:44:07.520 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.793+0000 7f636ca27700 1 -- 172.21.15.98:0/284359579 learned_addr learned my addr 172.21.15.98:0/284359579 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:07.520 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f636ca27700 1 -- 172.21.15.98:0/284359579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6368079ea0 con 0x7f63681066d0 2024-09-13T02:44:07.520 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f636ca27700 1 --2- 172.21.15.98:0/284359579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368108ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f635c0098a0 tx=0x7f635c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458ca13711270cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:07.521 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f63677fe700 1 -- 172.21.15.98:0/284359579 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f635c004180 con 0x7f63681066d0 2024-09-13T02:44:07.521 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f63677fe700 1 -- 172.21.15.98:0/284359579 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f635c0042e0 con 0x7f63681066d0 2024-09-13T02:44:07.521 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f63677fe700 1 -- 172.21.15.98:0/284359579 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f635c011af0 con 0x7f63681066d0 2024-09-13T02:44:07.521 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f636ec8b700 1 -- 172.21.15.98:0/284359579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 msgr2=0x7f6368108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:07.521 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f636ec8b700 1 --2- 172.21.15.98:0/284359579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368108ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f635c0098a0 tx=0x7f635c009bb0 comp rx=0 tx=0).stop 2024-09-13T02:44:07.521 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f636ec8b700 1 -- 172.21.15.98:0/284359579 shutdown_connections 2024-09-13T02:44:07.521 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f636ec8b700 1 --2- 172.21.15.98:0/284359579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368108ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:07.521 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f636ec8b700 1 -- 172.21.15.98:0/284359579 >> 172.21.15.98:0/284359579 conn(0x7f63681000f0 msgr2=0x7f6368102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:07.521 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.794+0000 7f636ec8b700 1 -- 172.21.15.98:0/284359579 shutdown_connections 2024-09-13T02:44:07.522 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.795+0000 7f636ec8b700 1 -- 172.21.15.98:0/284359579 wait complete. 2024-09-13T02:44:07.522 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.795+0000 7f636ec8b700 1 Processor -- start 2024-09-13T02:44:07.522 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.795+0000 7f636ec8b700 1 -- start start 2024-09-13T02:44:07.522 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.795+0000 7f636ec8b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:07.522 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.795+0000 7f636ec8b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6368199e50 con 0x7f63681066d0 2024-09-13T02:44:07.522 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.795+0000 7f636ca27700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:07.522 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.795+0000 7f636ca27700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56826/0 (socket says 172.21.15.98:56826) 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.795+0000 7f636ca27700 1 -- 172.21.15.98:0/3765582055 learned_addr learned my addr 172.21.15.98:0/3765582055 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.796+0000 7f636ca27700 1 -- 172.21.15.98:0/3765582055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c009550 con 0x7f63681066d0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.796+0000 7f636ca27700 1 --2- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368199910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f635c006ba0 tx=0x7f635c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.796+0000 7f6365ffb700 1 -- 172.21.15.98:0/3765582055 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f635c003b00 con 0x7f63681066d0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.796+0000 7f6365ffb700 1 -- 172.21.15.98:0/3765582055 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f635c01a8e0 con 0x7f63681066d0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.796+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636819a0b0 con 0x7f63681066d0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.796+0000 7f6365ffb700 1 -- 172.21.15.98:0/3765582055 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f635c019990 con 0x7f63681066d0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.796+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636819a530 con 0x7f63681066d0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.797+0000 7f6365ffb700 1 -- 172.21.15.98:0/3765582055 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f635c019c50 con 0x7f63681066d0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.797+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6368109bf0 con 0x7f63681066d0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.797+0000 7f6365ffb700 1 --2- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f63580383f0 0x7f635803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.797+0000 7f6365ffb700 1 -- 172.21.15.98:0/3765582055 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f635c04c6a0 con 0x7f63681066d0 2024-09-13T02:44:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.797+0000 7f6367fff700 1 --2- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f63580383f0 0x7f635803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.798+0000 7f6367fff700 1 --2- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f63580383f0 0x7f635803a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6354006fd0 tx=0x7f6354006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:06.802+0000 7f6365ffb700 1 -- 172.21.15.98:0/3765582055 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f635c02b700 con 0x7f63681066d0 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.000+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f6368109de0 con 0x7f63681066d0 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.001+0000 7f6365ffb700 1 -- 172.21.15.98:0/3765582055 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f635c02b340 con 0x7f63681066d0 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f63580383f0 msgr2=0x7f635803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 --2- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f63580383f0 0x7f635803a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6354006fd0 tx=0x7f6354006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 msgr2=0x7f6368199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 --2- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368199910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f635c006ba0 tx=0x7f635c011b50 comp rx=0 tx=0).stop 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 shutdown_connections 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 --2- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f63580383f0 0x7f635803a8a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 --2- 172.21.15.98:0/3765582055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63681066d0 0x7f6368199910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 >> 172.21.15.98:0/3765582055 conn(0x7f63681000f0 msgr2=0x7f6368101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:07.525 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 shutdown_connections 2024-09-13T02:44:07.525 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:07.003+0000 7f636ec8b700 1 -- 172.21.15.98:0/3765582055 wait complete. 2024-09-13T02:44:07.525 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:44:07.525 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout disabled 2024-09-13T02:44:07.533 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:44:07.533 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-13T02:44:07.533 INFO:teuthology.orchestra.run.smithi098.stdout:firewalld.service is not enabled 2024-09-13T02:44:07.533 INFO:teuthology.orchestra.run.smithi098.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T02:44:07.534 INFO:teuthology.orchestra.run.smithi098.stdout:Ceph Dashboard is now available at: 2024-09-13T02:44:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: URL: https://smithi098.front.sepia.ceph.com:8443/ 2024-09-13T02:44:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: User: admin 2024-09-13T02:44:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: Password: 5ouwk599qq 2024-09-13T02:44:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:07.535 INFO:teuthology.orchestra.run.smithi098.stdout:Saving cluster configuration to /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config directory 2024-09-13T02:44:07.535 INFO:teuthology.orchestra.run.smithi098.stdout:Enabling autotune for osd_memory_target 2024-09-13T02:44:09.053 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.145+0000 7f23fa166700 1 Processor -- start 2024-09-13T02:44:09.053 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.145+0000 7f23fa166700 1 -- start start 2024-09-13T02:44:09.053 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.145+0000 7f23fa166700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f407a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:09.053 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.145+0000 7f23fa166700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f407a880 con 0x7f23f407be40 2024-09-13T02:44:09.053 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.145+0000 7f23f37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f407a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:09.053 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.145+0000 7f23f37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f407a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56832/0 (socket says 172.21.15.98:56832) 2024-09-13T02:44:09.053 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.145+0000 7f23f37fe700 1 -- 172.21.15.98:0/1311500601 learned_addr learned my addr 172.21.15.98:0/1311500601 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:09.053 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.146+0000 7f23f37fe700 1 -- 172.21.15.98:0/1311500601 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f407a9c0 con 0x7f23f407be40 2024-09-13T02:44:09.053 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.146+0000 7f23f37fe700 1 --2- 172.21.15.98:0/1311500601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f407a340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23e40098a0 tx=0x7f23e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9b1327f5a1b197 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.146+0000 7f23f27fc700 1 -- 172.21.15.98:0/1311500601 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23e4004180 con 0x7f23f407be40 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.146+0000 7f23f27fc700 1 -- 172.21.15.98:0/1311500601 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23e40042e0 con 0x7f23f407be40 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.146+0000 7f23f27fc700 1 -- 172.21.15.98:0/1311500601 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23e4011af0 con 0x7f23f407be40 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.147+0000 7f23fa166700 1 -- 172.21.15.98:0/1311500601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 msgr2=0x7f23f407a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.147+0000 7f23fa166700 1 --2- 172.21.15.98:0/1311500601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f407a340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23e40098a0 tx=0x7f23e4009bb0 comp rx=0 tx=0).stop 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.147+0000 7f23fa166700 1 -- 172.21.15.98:0/1311500601 shutdown_connections 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.147+0000 7f23fa166700 1 --2- 172.21.15.98:0/1311500601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f407a340 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.147+0000 7f23fa166700 1 -- 172.21.15.98:0/1311500601 >> 172.21.15.98:0/1311500601 conn(0x7f23f4101220 msgr2=0x7f23f4103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.147+0000 7f23fa166700 1 -- 172.21.15.98:0/1311500601 shutdown_connections 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.147+0000 7f23fa166700 1 -- 172.21.15.98:0/1311500601 wait complete. 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.147+0000 7f23fa166700 1 Processor -- start 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.147+0000 7f23fa166700 1 -- start start 2024-09-13T02:44:09.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23fa166700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23fa166700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f419c0e0 con 0x7f23f407be40 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23f37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23f37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f419bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56848/0 (socket says 172.21.15.98:56848) 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23f37fe700 1 -- 172.21.15.98:0/906193858 learned_addr learned my addr 172.21.15.98:0/906193858 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23f37fe700 1 -- 172.21.15.98:0/906193858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4009550 con 0x7f23f407be40 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23f37fe700 1 --2- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f419bba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000c00 tx=0x7f23e4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23f0ff9700 1 -- 172.21.15.98:0/906193858 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23e4003a70 con 0x7f23f407be40 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23f0ff9700 1 -- 172.21.15.98:0/906193858 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23e4003bd0 con 0x7f23f407be40 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f419c2e0 con 0x7f23f407be40 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23f0ff9700 1 -- 172.21.15.98:0/906193858 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23e40238c0 con 0x7f23f407be40 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.148+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f419c700 con 0x7f23f407be40 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.149+0000 7f23f0ff9700 1 -- 172.21.15.98:0/906193858 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f23e4023b80 con 0x7f23f407be40 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.149+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f410be80 con 0x7f23f407be40 2024-09-13T02:44:09.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.150+0000 7f23f0ff9700 1 --2- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f23dc038440 0x7f23dc03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.150+0000 7f23f0ff9700 1 -- 172.21.15.98:0/906193858 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f23e404c4d0 con 0x7f23f407be40 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.150+0000 7f23f2ffd700 1 --2- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f23dc038440 0x7f23dc03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.150+0000 7f23f2ffd700 1 --2- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f23dc038440 0x7f23dc03a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f23e8006fd0 tx=0x7f23e8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.154+0000 7f23f0ff9700 1 -- 172.21.15.98:0/906193858 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f23e402b300 con 0x7f23f407be40 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.263+0000 7f23f0ff9700 1 -- 172.21.15.98:0/906193858 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f23e4019c60 con 0x7f23f407be40 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.350+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f23f419f560 con 0x7f23f407be40 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.351+0000 7f23f0ff9700 1 -- 172.21.15.98:0/906193858 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f23e401ad00 con 0x7f23f407be40 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f23dc038440 msgr2=0x7f23dc03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 --2- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f23dc038440 0x7f23dc03a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f23e8006fd0 tx=0x7f23e8006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:09.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 msgr2=0x7f23f419bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:09.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 --2- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f419bba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000c00 tx=0x7f23e4011b50 comp rx=0 tx=0).stop 2024-09-13T02:44:09.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 shutdown_connections 2024-09-13T02:44:09.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 --2- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f23dc038440 0x7f23dc03a8f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:09.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 --2- 172.21.15.98:0/906193858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23f407be40 0x7f23f419bba0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:09.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 >> 172.21.15.98:0/906193858 conn(0x7f23f4101220 msgr2=0x7f23f4102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:09.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 shutdown_connections 2024-09-13T02:44:09.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:08.353+0000 7f23fa166700 1 -- 172.21.15.98:0/906193858 wait complete. 2024-09-13T02:44:09.432 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:09 smithi098 ceph-mon[27886]: mgrmap e13: smithi098.ukgenf(active, since 6s) 2024-09-13T02:44:10.302 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.457+0000 7f863858e700 1 Processor -- start 2024-09-13T02:44:10.302 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.458+0000 7f863858e700 1 -- start start 2024-09-13T02:44:10.302 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.458+0000 7f863858e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630105390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:10.302 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.458+0000 7f863858e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86301058d0 con 0x7f8630104f80 2024-09-13T02:44:10.302 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.458+0000 7f863632a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630105390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:10.302 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.458+0000 7f863632a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630105390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56858/0 (socket says 172.21.15.98:56858) 2024-09-13T02:44:10.302 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.458+0000 7f863632a700 1 -- 172.21.15.98:0/3021555796 learned_addr learned my addr 172.21.15.98:0/3021555796 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:10.302 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.458+0000 7f863632a700 1 -- 172.21.15.98:0/3021555796 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630105a10 con 0x7f8630104f80 2024-09-13T02:44:10.302 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.458+0000 7f863632a700 1 --2- 172.21.15.98:0/3021555796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630105390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86200098a0 tx=0x7f8620009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b4f0d9738e3872 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f8635328700 1 -- 172.21.15.98:0/3021555796 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8620004180 con 0x7f8630104f80 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f8635328700 1 -- 172.21.15.98:0/3021555796 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f86200042e0 con 0x7f8630104f80 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f8635328700 1 -- 172.21.15.98:0/3021555796 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8620011af0 con 0x7f8630104f80 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f863858e700 1 -- 172.21.15.98:0/3021555796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 msgr2=0x7f8630105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f863858e700 1 --2- 172.21.15.98:0/3021555796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630105390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86200098a0 tx=0x7f8620009bb0 comp rx=0 tx=0).stop 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f863858e700 1 -- 172.21.15.98:0/3021555796 shutdown_connections 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f863858e700 1 --2- 172.21.15.98:0/3021555796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630105390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f863858e700 1 -- 172.21.15.98:0/3021555796 >> 172.21.15.98:0/3021555796 conn(0x7f86300ff870 msgr2=0x7f8630101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f863858e700 1 -- 172.21.15.98:0/3021555796 shutdown_connections 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.459+0000 7f863858e700 1 -- 172.21.15.98:0/3021555796 wait complete. 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.460+0000 7f863858e700 1 Processor -- start 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.460+0000 7f863858e700 1 -- start start 2024-09-13T02:44:10.303 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.460+0000 7f863858e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630104740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.460+0000 7f863858e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863019c5e0 con 0x7f8630104f80 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.460+0000 7f863632a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630104740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.460+0000 7f863632a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630104740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56872/0 (socket says 172.21.15.98:56872) 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.460+0000 7f863632a700 1 -- 172.21.15.98:0/2552017125 learned_addr learned my addr 172.21.15.98:0/2552017125 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.460+0000 7f863632a700 1 -- 172.21.15.98:0/2552017125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620009550 con 0x7f8630104f80 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.461+0000 7f863632a700 1 --2- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630104740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8620006ba0 tx=0x7f8620011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.461+0000 7f86277fe700 1 -- 172.21.15.98:0/2552017125 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8620003b00 con 0x7f8630104f80 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.461+0000 7f86277fe700 1 -- 172.21.15.98:0/2552017125 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f862001a8e0 con 0x7f8630104f80 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.461+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863019c720 con 0x7f8630104f80 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.461+0000 7f86277fe700 1 -- 172.21.15.98:0/2552017125 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8620019990 con 0x7f8630104f80 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.461+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863019cb40 con 0x7f8630104f80 2024-09-13T02:44:10.304 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.462+0000 7f86277fe700 1 -- 172.21.15.98:0/2552017125 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f8620019c00 con 0x7f8630104f80 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.462+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8630062380 con 0x7f8630104f80 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.462+0000 7f86277fe700 1 --2- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f861c0384e0 0x7f861c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.462+0000 7f86277fe700 1 -- 172.21.15.98:0/2552017125 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f862004c700 con 0x7f8630104f80 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.462+0000 7f8635b29700 1 --2- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f861c0384e0 0x7f861c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.462+0000 7f8635b29700 1 --2- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f861c0384e0 0x7f861c03a990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f862c006fd0 tx=0x7f862c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.467+0000 7f86277fe700 1 -- 172.21.15.98:0/2552017125 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f862001a430 con 0x7f8630104f80 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.760+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f86301069a0 con 0x7f8630104f80 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.765+0000 7f86277fe700 1 -- 172.21.15.98:0/2552017125 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8620018b40 con 0x7f8630104f80 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f861c0384e0 msgr2=0x7f861c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 --2- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f861c0384e0 0x7f861c03a990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f862c006fd0 tx=0x7f862c006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 msgr2=0x7f8630104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 --2- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630104740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8620006ba0 tx=0x7f8620011b50 comp rx=0 tx=0).stop 2024-09-13T02:44:10.305 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 shutdown_connections 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 --2- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f861c0384e0 0x7f861c03a990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 --2- 172.21.15.98:0/2552017125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8630104f80 0x7f8630104740 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 >> 172.21.15.98:0/2552017125 conn(0x7f86300ff870 msgr2=0x7f8630100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 shutdown_connections 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-13T02:44:09.767+0000 7f863858e700 1 -- 172.21.15.98:0/2552017125 wait complete. 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T02:44:10.306 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:10.307 INFO:teuthology.orchestra.run.smithi098.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T02:44:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: ceph telemetry on 2024-09-13T02:44:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:10.307 INFO:teuthology.orchestra.run.smithi098.stdout:For more information see: 2024-09-13T02:44:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T02:44:10.307 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:10.307 INFO:teuthology.orchestra.run.smithi098.stdout:Bootstrap complete. 2024-09-13T02:44:10.332 INFO:tasks.cephadm:Fetching config... 2024-09-13T02:44:10.333 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:44:10.333 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T02:44:10.349 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T02:44:10.349 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:44:10.349 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T02:44:10.405 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T02:44:10.405 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:44:10.405 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/keyring of=/dev/stdout 2024-09-13T02:44:10.470 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T02:44:10.470 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:44:10.470 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T02:44:10.525 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T02:44:10.526 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCc6rPghG+rSH4yz4aqzY3ZpPtKSgDUT7BrrOEnEKh/fBIAzeeRtLYXJCId2twMmBH6qX1omL+dZbHEF3cEZVQnpOAUJSQ6vaxYGrRgXH5Q8xVjsAh1+nFDrj7Fhu6DldI45/+Jo6kIjmyKRpwN/u966JzQ4wCWgYXqw9ndGfuC5MbQeExcLQhdENFrfwq+cjzjIKRDi7yv4Tg+2nwqSk8TchC0EHeoyZHTkqUF5wfqZTl6C3A8C4kiX1A1ZHETnpQ/b1pLQqz/expCGP0gkWtyTS/9otfDJFHPOFXHHzbaJNJYeT0dRsBheIpJoPVVJ92/db2sviHWZXXEwfAemR7hnJH5eEVk4FWxaEYhNLtephBf9chzyaXWRM/cJ8kVr9IV9gNE+q+auMJu5ODS1QP+HnqMgwgeYK02eiIi0Sz/XkfIZjvMXR0M53s6HBtMdJw1ebFpBF1EaauYiH8dPrrqCBxAlTiXY8Qe0kQ8vqnCzlnyR55X3W0PyvvC7laotc= ceph-d155f688-7179-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T02:44:10.611 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCc6rPghG+rSH4yz4aqzY3ZpPtKSgDUT7BrrOEnEKh/fBIAzeeRtLYXJCId2twMmBH6qX1omL+dZbHEF3cEZVQnpOAUJSQ6vaxYGrRgXH5Q8xVjsAh1+nFDrj7Fhu6DldI45/+Jo6kIjmyKRpwN/u966JzQ4wCWgYXqw9ndGfuC5MbQeExcLQhdENFrfwq+cjzjIKRDi7yv4Tg+2nwqSk8TchC0EHeoyZHTkqUF5wfqZTl6C3A8C4kiX1A1ZHETnpQ/b1pLQqz/expCGP0gkWtyTS/9otfDJFHPOFXHHzbaJNJYeT0dRsBheIpJoPVVJ92/db2sviHWZXXEwfAemR7hnJH5eEVk4FWxaEYhNLtephBf9chzyaXWRM/cJ8kVr9IV9gNE+q+auMJu5ODS1QP+HnqMgwgeYK02eiIi0Sz/XkfIZjvMXR0M53s6HBtMdJw1ebFpBF1EaauYiH8dPrrqCBxAlTiXY8Qe0kQ8vqnCzlnyR55X3W0PyvvC7laotc= ceph-d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:44:10.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCc6rPghG+rSH4yz4aqzY3ZpPtKSgDUT7BrrOEnEKh/fBIAzeeRtLYXJCId2twMmBH6qX1omL+dZbHEF3cEZVQnpOAUJSQ6vaxYGrRgXH5Q8xVjsAh1+nFDrj7Fhu6DldI45/+Jo6kIjmyKRpwN/u966JzQ4wCWgYXqw9ndGfuC5MbQeExcLQhdENFrfwq+cjzjIKRDi7yv4Tg+2nwqSk8TchC0EHeoyZHTkqUF5wfqZTl6C3A8C4kiX1A1ZHETnpQ/b1pLQqz/expCGP0gkWtyTS/9otfDJFHPOFXHHzbaJNJYeT0dRsBheIpJoPVVJ92/db2sviHWZXXEwfAemR7hnJH5eEVk4FWxaEYhNLtephBf9chzyaXWRM/cJ8kVr9IV9gNE+q+auMJu5ODS1QP+HnqMgwgeYK02eiIi0Sz/XkfIZjvMXR0M53s6HBtMdJw1ebFpBF1EaauYiH8dPrrqCBxAlTiXY8Qe0kQ8vqnCzlnyR55X3W0PyvvC7laotc= ceph-d155f688-7179-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T02:44:10.757 INFO:teuthology.orchestra.run.smithi142.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCc6rPghG+rSH4yz4aqzY3ZpPtKSgDUT7BrrOEnEKh/fBIAzeeRtLYXJCId2twMmBH6qX1omL+dZbHEF3cEZVQnpOAUJSQ6vaxYGrRgXH5Q8xVjsAh1+nFDrj7Fhu6DldI45/+Jo6kIjmyKRpwN/u966JzQ4wCWgYXqw9ndGfuC5MbQeExcLQhdENFrfwq+cjzjIKRDi7yv4Tg+2nwqSk8TchC0EHeoyZHTkqUF5wfqZTl6C3A8C4kiX1A1ZHETnpQ/b1pLQqz/expCGP0gkWtyTS/9otfDJFHPOFXHHzbaJNJYeT0dRsBheIpJoPVVJ92/db2sviHWZXXEwfAemR7hnJH5eEVk4FWxaEYhNLtephBf9chzyaXWRM/cJ8kVr9IV9gNE+q+auMJu5ODS1QP+HnqMgwgeYK02eiIi0Sz/XkfIZjvMXR0M53s6HBtMdJw1ebFpBF1EaauYiH8dPrrqCBxAlTiXY8Qe0kQ8vqnCzlnyR55X3W0PyvvC7laotc= ceph-d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:44:10.770 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T02:44:10.983 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:44:10.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:10 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2552017125' entity='client.admin' 2024-09-13T02:44:12.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:12 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:12.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:12 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:12.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:12 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:44:12.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:12 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:12.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:12 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:44:12.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:12 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T02:44:12.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:12 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:12.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:12 smithi098 ceph-mon[27886]: Deploying daemon ceph-exporter.smithi098 on smithi098 2024-09-13T02:44:13.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.211+0000 7ffa95b9b700 1 -- 172.21.15.98:0/2038416737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 msgr2=0x7ffa90100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:13.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.211+0000 7ffa95b9b700 1 --2- 172.21.15.98:0/2038416737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 0x7ffa90100240 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009910 tx=0x7ffa80009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:13.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.211+0000 7ffa95b9b700 1 -- 172.21.15.98:0/2038416737 shutdown_connections 2024-09-13T02:44:13.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.211+0000 7ffa95b9b700 1 --2- 172.21.15.98:0/2038416737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 0x7ffa90100240 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.211+0000 7ffa95b9b700 1 -- 172.21.15.98:0/2038416737 >> 172.21.15.98:0/2038416737 conn(0x7ffa900fb3c0 msgr2=0x7ffa900fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.211+0000 7ffa95b9b700 1 -- 172.21.15.98:0/2038416737 shutdown_connections 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.211+0000 7ffa95b9b700 1 -- 172.21.15.98:0/2038416737 wait complete. 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.212+0000 7ffa95b9b700 1 Processor -- start 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.212+0000 7ffa95b9b700 1 -- start start 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.212+0000 7ffa95b9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 0x7ffa90194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.212+0000 7ffa95b9b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa901954c0 con 0x7ffa900ffe30 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa8f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 0x7ffa90194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa8f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 0x7ffa90194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56882/0 (socket says 172.21.15.98:56882) 2024-09-13T02:44:13.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa8f7fe700 1 -- 172.21.15.98:0/1303316290 learned_addr learned my addr 172.21.15.98:0/1303316290 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa8f7fe700 1 -- 172.21.15.98:0/1303316290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800095f0 con 0x7ffa900ffe30 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa8f7fe700 1 --2- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 0x7ffa90194f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa80005b40 tx=0x7ffa80004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa8cff9700 1 -- 172.21.15.98:0/1303316290 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa8001d070 con 0x7ffa900ffe30 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa8cff9700 1 -- 172.21.15.98:0/1303316290 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa8000be10 con 0x7ffa900ffe30 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa8cff9700 1 -- 172.21.15.98:0/1303316290 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa8000f460 con 0x7ffa900ffe30 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa901956c0 con 0x7ffa900ffe30 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.213+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa90195b60 con 0x7ffa900ffe30 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.214+0000 7ffa8cff9700 1 -- 172.21.15.98:0/1303316290 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ffa8000f6d0 con 0x7ffa900ffe30 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.214+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9018ea90 con 0x7ffa900ffe30 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.214+0000 7ffa8cff9700 1 --2- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa78038490 0x7ffa7803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:13.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.214+0000 7ffa8cff9700 1 -- 172.21.15.98:0/1303316290 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ffa8004c210 con 0x7ffa900ffe30 2024-09-13T02:44:13.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.214+0000 7ffa8effd700 1 --2- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa78038490 0x7ffa7803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:13.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.215+0000 7ffa8effd700 1 --2- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa78038490 0x7ffa7803a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa84006fd0 tx=0x7ffa84006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:13.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.219+0000 7ffa8cff9700 1 -- 172.21.15.98:0/1303316290 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffa80020730 con 0x7ffa900ffe30 2024-09-13T02:44:13.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.420+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ffa901008c0 con 0x7ffa900ffe30 2024-09-13T02:44:13.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.424+0000 7ffa8cff9700 1 -- 172.21.15.98:0/1303316290 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ffa901008c0 con 0x7ffa900ffe30 2024-09-13T02:44:13.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa78038490 msgr2=0x7ffa7803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 --2- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa78038490 0x7ffa7803a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffa84006fd0 tx=0x7ffa84006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 msgr2=0x7ffa90194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 --2- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 0x7ffa90194f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa80005b40 tx=0x7ffa80004740 comp rx=0 tx=0).stop 2024-09-13T02:44:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 shutdown_connections 2024-09-13T02:44:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 --2- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffa78038490 0x7ffa7803a940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 --2- 172.21.15.98:0/1303316290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa900ffe30 0x7ffa90194f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 >> 172.21.15.98:0/1303316290 conn(0x7ffa900fb3c0 msgr2=0x7ffa900fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 shutdown_connections 2024-09-13T02:44:13.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:13.426+0000 7ffa95b9b700 1 -- 172.21.15.98:0/1303316290 wait complete. 2024-09-13T02:44:13.956 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T02:44:13.957 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T02:44:14.523 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:14 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1303316290' entity='client.admin' 2024-09-13T02:44:14.820 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.078+0000 7fbd8675b700 1 -- 172.21.15.98:0/4088207686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 msgr2=0x7fbd800fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.078+0000 7fbd8675b700 1 --2- 172.21.15.98:0/4088207686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 0x7fbd800fe4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009910 tx=0x7fbd70009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.078+0000 7fbd8675b700 1 -- 172.21.15.98:0/4088207686 shutdown_connections 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.078+0000 7fbd8675b700 1 --2- 172.21.15.98:0/4088207686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 0x7fbd800fe4f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.078+0000 7fbd8675b700 1 -- 172.21.15.98:0/4088207686 >> 172.21.15.98:0/4088207686 conn(0x7fbd800f9af0 msgr2=0x7fbd800fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.078+0000 7fbd8675b700 1 -- 172.21.15.98:0/4088207686 shutdown_connections 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.078+0000 7fbd8675b700 1 -- 172.21.15.98:0/4088207686 wait complete. 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.079+0000 7fbd8675b700 1 Processor -- start 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.079+0000 7fbd8675b700 1 -- start start 2024-09-13T02:44:17.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.079+0000 7fbd8675b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 0x7fbd80194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.079+0000 7fbd8675b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd801954d0 con 0x7fbd800fe0e0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.079+0000 7fbd7ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 0x7fbd80194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.079+0000 7fbd7ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 0x7fbd80194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42792/0 (socket says 172.21.15.98:42792) 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.079+0000 7fbd7ffff700 1 -- 172.21.15.98:0/2098042884 learned_addr learned my addr 172.21.15.98:0/2098042884 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.079+0000 7fbd7ffff700 1 -- 172.21.15.98:0/2098042884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd700095f0 con 0x7fbd800fe0e0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.080+0000 7fbd7ffff700 1 --2- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 0x7fbd80194f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd70005b40 tx=0x7fbd70004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.080+0000 7fbd7d7fa700 1 -- 172.21.15.98:0/2098042884 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd7001d070 con 0x7fbd800fe0e0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.080+0000 7fbd7d7fa700 1 -- 172.21.15.98:0/2098042884 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd7000be10 con 0x7fbd800fe0e0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.080+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd801956d0 con 0x7fbd800fe0e0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.080+0000 7fbd7d7fa700 1 -- 172.21.15.98:0/2098042884 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd7000f460 con 0x7fbd800fe0e0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.080+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd80195b70 con 0x7fbd800fe0e0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.081+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8018ea80 con 0x7fbd800fe0e0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.081+0000 7fbd7d7fa700 1 -- 172.21.15.98:0/2098042884 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fbd7000f5c0 con 0x7fbd800fe0e0 2024-09-13T02:44:17.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.081+0000 7fbd7d7fa700 1 --2- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbd680384e0 0x7fbd6803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.082+0000 7fbd7d7fa700 1 -- 172.21.15.98:0/2098042884 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fbd7004c590 con 0x7fbd800fe0e0 2024-09-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.082+0000 7fbd7f7fe700 1 --2- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbd680384e0 0x7fbd6803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:17.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.082+0000 7fbd7f7fe700 1 --2- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbd680384e0 0x7fbd6803a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd74006fd0 tx=0x7fbd74006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:17.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.087+0000 7fbd7d7fa700 1 -- 172.21.15.98:0/2098042884 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbd7002a360 con 0x7fbd800fe0e0 2024-09-13T02:44:17.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.287+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd80061220 con 0x7fbd680384e0 2024-09-13T02:44:17.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.291+0000 7fbd7d7fa700 1 -- 172.21.15.98:0/2098042884 <== mgr.14164 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbd80061220 con 0x7fbd680384e0 2024-09-13T02:44:17.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbd680384e0 msgr2=0x7fbd6803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:17.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 --2- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbd680384e0 0x7fbd6803a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd74006fd0 tx=0x7fbd74006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:17.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 msgr2=0x7fbd80194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:17.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 --2- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 0x7fbd80194f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd70005b40 tx=0x7fbd70004740 comp rx=0 tx=0).stop 2024-09-13T02:44:17.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 shutdown_connections 2024-09-13T02:44:17.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 --2- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbd680384e0 0x7fbd6803a990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:17.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 --2- 172.21.15.98:0/2098042884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd800fe0e0 0x7fbd80194f90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:17.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 >> 172.21.15.98:0/2098042884 conn(0x7fbd800f9af0 msgr2=0x7fbd800fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:17.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 shutdown_connections 2024-09-13T02:44:17.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:17.293+0000 7fbd8675b700 1 -- 172.21.15.98:0/2098042884 wait complete. 2024-09-13T02:44:18.143 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi142 2024-09-13T02:44:18.144 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:44:18.144 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/etc/ceph/ceph.conf 2024-09-13T02:44:18.163 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:44:18.163 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:44:18.222 INFO:tasks.cephadm:Adding host smithi142 to orchestrator... 2024-09-13T02:44:18.222 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch host add smithi142 2024-09-13T02:44:18.567 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:44:18.567 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:18.567 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:18.568 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:18.568 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:18.568 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:18.568 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:44:18.568 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T02:44:18.568 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:18.568 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:18 smithi098 ceph-mon[27886]: Deploying daemon crash.smithi098 on smithi098 2024-09-13T02:44:19.183 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:44:20.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.652+0000 7fa25a544700 1 -- 172.21.15.98:0/2754242599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 msgr2=0x7fa254100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.652+0000 7fa25a544700 1 --2- 172.21.15.98:0/2754242599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 0x7fa254100230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa244009910 tx=0x7fa244009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.652+0000 7fa25a544700 1 -- 172.21.15.98:0/2754242599 shutdown_connections 2024-09-13T02:44:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.652+0000 7fa25a544700 1 --2- 172.21.15.98:0/2754242599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 0x7fa254100230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.652+0000 7fa25a544700 1 -- 172.21.15.98:0/2754242599 >> 172.21.15.98:0/2754242599 conn(0x7fa2540fb3d0 msgr2=0x7fa2540fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.652+0000 7fa25a544700 1 -- 172.21.15.98:0/2754242599 shutdown_connections 2024-09-13T02:44:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.652+0000 7fa25a544700 1 -- 172.21.15.98:0/2754242599 wait complete. 2024-09-13T02:44:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.653+0000 7fa25a544700 1 Processor -- start 2024-09-13T02:44:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.653+0000 7fa25a544700 1 -- start start 2024-09-13T02:44:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.653+0000 7fa25a544700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 0x7fa254194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.653+0000 7fa25a544700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2541954c0 con 0x7fa2540ffe20 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.653+0000 7fa253fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 0x7fa254194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.653+0000 7fa253fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 0x7fa254194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42814/0 (socket says 172.21.15.98:42814) 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.653+0000 7fa253fff700 1 -- 172.21.15.98:0/2381606960 learned_addr learned my addr 172.21.15.98:0/2381606960 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.653+0000 7fa253fff700 1 -- 172.21.15.98:0/2381606960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2440095f0 con 0x7fa2540ffe20 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.653+0000 7fa253fff700 1 --2- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 0x7fa254194f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa244005b40 tx=0x7fa244004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.654+0000 7fa2517fa700 1 -- 172.21.15.98:0/2381606960 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa24401d070 con 0x7fa2540ffe20 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.654+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2541956c0 con 0x7fa2540ffe20 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.654+0000 7fa2517fa700 1 -- 172.21.15.98:0/2381606960 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa24400be10 con 0x7fa2540ffe20 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.654+0000 7fa2517fa700 1 -- 172.21.15.98:0/2381606960 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa24400f460 con 0x7fa2540ffe20 2024-09-13T02:44:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.654+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa254195b60 con 0x7fa2540ffe20 2024-09-13T02:44:20.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.655+0000 7fa2517fa700 1 -- 172.21.15.98:0/2381606960 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fa24400f6d0 con 0x7fa2540ffe20 2024-09-13T02:44:20.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.655+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25418ea80 con 0x7fa2540ffe20 2024-09-13T02:44:20.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.655+0000 7fa2517fa700 1 --2- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa23c038490 0x7fa23c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:20.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.655+0000 7fa2517fa700 1 -- 172.21.15.98:0/2381606960 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fa24404c450 con 0x7fa2540ffe20 2024-09-13T02:44:20.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.655+0000 7fa2537fe700 1 --2- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa23c038490 0x7fa23c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:20.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.655+0000 7fa2537fe700 1 --2- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa23c038490 0x7fa23c03a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa248006fd0 tx=0x7fa248006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:20.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.660+0000 7fa2517fa700 1 -- 172.21.15.98:0/2381606960 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa244020730 con 0x7fa2540ffe20 2024-09-13T02:44:20.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:20.862+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2541008b0 con 0x7fa23c038490 2024-09-13T02:44:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:22 smithi098 ceph-mon[27886]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:44:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:22 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:22 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:22 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:22 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:22 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:23.337 INFO:teuthology.orchestra.run.smithi098.stdout:Added host 'smithi142' with addr '172.21.15.142' 2024-09-13T02:44:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.334+0000 7fa2517fa700 1 -- 172.21.15.98:0/2381606960 <== mgr.14164 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa2541008b0 con 0x7fa23c038490 2024-09-13T02:44:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa23c038490 msgr2=0x7fa23c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 --2- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa23c038490 0x7fa23c03a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa248006fd0 tx=0x7fa248006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 msgr2=0x7fa254194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 --2- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 0x7fa254194f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa244005b40 tx=0x7fa244004740 comp rx=0 tx=0).stop 2024-09-13T02:44:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 shutdown_connections 2024-09-13T02:44:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 --2- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa23c038490 0x7fa23c03a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 --2- 172.21.15.98:0/2381606960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2540ffe20 0x7fa254194f80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:23.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 >> 172.21.15.98:0/2381606960 conn(0x7fa2540fb3d0 msgr2=0x7fa2540fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:23.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 shutdown_connections 2024-09-13T02:44:23.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:23.337+0000 7fa25a544700 1 -- 172.21.15.98:0/2381606960 wait complete. 2024-09-13T02:44:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:23 smithi098 ceph-mon[27886]: Deploying daemon node-exporter.smithi098 on smithi098 2024-09-13T02:44:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:23 smithi098 ceph-mon[27886]: Deploying cephadm binary to smithi142 2024-09-13T02:44:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:23 smithi098 ceph-mon[27886]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:24.329 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T02:44:24.627 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:24 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:24.628 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:24 smithi098 ceph-mon[27886]: Added host smithi142 2024-09-13T02:44:24.628 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:24 smithi098 ceph-mon[27886]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:25.000 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:44:26.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:26 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:26.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:26 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:26.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:26 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:26.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:26 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:26.087 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:26 smithi098 ceph-mon[27886]: Deploying daemon alertmanager.smithi098 on smithi098 2024-09-13T02:44:26.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.701+0000 7fdd3cab1700 1 -- 172.21.15.98:0/2563044549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 msgr2=0x7fdd380ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.701+0000 7fdd3cab1700 1 --2- 172.21.15.98:0/2563044549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 0x7fdd380ff130 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009910 tx=0x7fdd28009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.701+0000 7fdd3cab1700 1 -- 172.21.15.98:0/2563044549 shutdown_connections 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.701+0000 7fdd3cab1700 1 --2- 172.21.15.98:0/2563044549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 0x7fdd380ff130 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.701+0000 7fdd3cab1700 1 -- 172.21.15.98:0/2563044549 >> 172.21.15.98:0/2563044549 conn(0x7fdd380fa2b0 msgr2=0x7fdd380fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.701+0000 7fdd3cab1700 1 -- 172.21.15.98:0/2563044549 shutdown_connections 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.701+0000 7fdd3cab1700 1 -- 172.21.15.98:0/2563044549 wait complete. 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.702+0000 7fdd3cab1700 1 Processor -- start 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.702+0000 7fdd3cab1700 1 -- start start 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.702+0000 7fdd3cab1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 0x7fdd38194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.702+0000 7fdd3cab1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38195500 con 0x7fdd380fed20 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.702+0000 7fdd3659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 0x7fdd38194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:26.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.702+0000 7fdd3659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 0x7fdd38194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53018/0 (socket says 172.21.15.98:53018) 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.702+0000 7fdd3659c700 1 -- 172.21.15.98:0/4253204459 learned_addr learned my addr 172.21.15.98:0/4253204459 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.702+0000 7fdd3659c700 1 -- 172.21.15.98:0/4253204459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280095f0 con 0x7fdd380fed20 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.702+0000 7fdd3659c700 1 --2- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 0x7fdd38194fc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdd28005b40 tx=0x7fdd28004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.703+0000 7fdd277fe700 1 -- 172.21.15.98:0/4253204459 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd2801d070 con 0x7fdd380fed20 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.703+0000 7fdd277fe700 1 -- 172.21.15.98:0/4253204459 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd2800be10 con 0x7fdd380fed20 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.703+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd38195700 con 0x7fdd380fed20 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.703+0000 7fdd277fe700 1 -- 172.21.15.98:0/4253204459 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd2800f460 con 0x7fdd380fed20 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.703+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd38195ba0 con 0x7fdd380fed20 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.704+0000 7fdd277fe700 1 -- 172.21.15.98:0/4253204459 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fdd2800f6d0 con 0x7fdd380fed20 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.704+0000 7fdd277fe700 1 --2- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdd20038490 0x7fdd2003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.704+0000 7fdd277fe700 1 -- 172.21.15.98:0/4253204459 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fdd2804c3c0 con 0x7fdd380fed20 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.704+0000 7fdd35d9b700 1 --2- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdd20038490 0x7fdd2003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:26.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.704+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3818ea10 con 0x7fdd380fed20 2024-09-13T02:44:26.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.705+0000 7fdd35d9b700 1 --2- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdd20038490 0x7fdd2003a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c006fd0 tx=0x7fdd2c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:26.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.711+0000 7fdd277fe700 1 -- 172.21.15.98:0/4253204459 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdd28045e60 con 0x7fdd380fed20 2024-09-13T02:44:26.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.956+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd38061190 con 0x7fdd20038490 2024-09-13T02:44:26.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.957+0000 7fdd277fe700 1 -- 172.21.15.98:0/4253204459 <== mgr.14164 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fdd38061190 con 0x7fdd20038490 2024-09-13T02:44:26.958 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:44:26.958 INFO:teuthology.orchestra.run.smithi098.stdout:[{"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}, {"addr": "172.21.15.142", "hostname": "smithi142", "labels": [], "status": ""}] 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdd20038490 msgr2=0x7fdd2003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 --2- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdd20038490 0x7fdd2003a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c006fd0 tx=0x7fdd2c006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 msgr2=0x7fdd38194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 --2- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 0x7fdd38194fc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdd28005b40 tx=0x7fdd28004740 comp rx=0 tx=0).stop 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 shutdown_connections 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 --2- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdd20038490 0x7fdd2003a940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 --2- 172.21.15.98:0/4253204459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd380fed20 0x7fdd38194fc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 >> 172.21.15.98:0/4253204459 conn(0x7fdd380fa2b0 msgr2=0x7fdd380687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 shutdown_connections 2024-09-13T02:44:26.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:26.959+0000 7fdd3cab1700 1 -- 172.21.15.98:0/4253204459 wait complete. 2024-09-13T02:44:27.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:27 smithi098 ceph-mon[27886]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:27.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:27 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:27.889 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T02:44:27.889 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T02:44:28.090 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:44:28.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:28 smithi098 ceph-mon[27886]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:44:29.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:29 smithi098 ceph-mon[27886]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:31.420 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:31 smithi098 ceph-mon[27886]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:32.379 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:32 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2482646085' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T02:44:32.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.209+0000 7fd09d235700 1 -- 172.21.15.98:0/3359428953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 msgr2=0x7fd098101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:32.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.209+0000 7fd09d235700 1 --2- 172.21.15.98:0/3359428953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 0x7fd098101890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd088009910 tx=0x7fd088009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.210+0000 7fd09d235700 1 -- 172.21.15.98:0/3359428953 shutdown_connections 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.210+0000 7fd09d235700 1 --2- 172.21.15.98:0/3359428953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 0x7fd098101890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.210+0000 7fd09d235700 1 -- 172.21.15.98:0/3359428953 >> 172.21.15.98:0/3359428953 conn(0x7fd0980f9af0 msgr2=0x7fd0980fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.210+0000 7fd09d235700 1 -- 172.21.15.98:0/3359428953 shutdown_connections 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.210+0000 7fd09d235700 1 -- 172.21.15.98:0/3359428953 wait complete. 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.210+0000 7fd09d235700 1 Processor -- start 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.210+0000 7fd09d235700 1 -- start start 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.211+0000 7fd09d235700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 0x7fd098100b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.211+0000 7fd09d235700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981010c0 con 0x7fd098101480 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.211+0000 7fd096d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 0x7fd098100b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:32.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.211+0000 7fd096d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 0x7fd098100b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53042/0 (socket says 172.21.15.98:53042) 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.211+0000 7fd096d9d700 1 -- 172.21.15.98:0/2482646085 learned_addr learned my addr 172.21.15.98:0/2482646085 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.211+0000 7fd096d9d700 1 -- 172.21.15.98:0/2482646085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880095f0 con 0x7fd098101480 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.211+0000 7fd096d9d700 1 --2- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 0x7fd098100b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd088005b40 tx=0x7fd088004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.211+0000 7fd07ffff700 1 -- 172.21.15.98:0/2482646085 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd08801d070 con 0x7fd098101480 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.211+0000 7fd07ffff700 1 -- 172.21.15.98:0/2482646085 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd08800be10 con 0x7fd098101480 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.212+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0980ff1d0 con 0x7fd098101480 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.212+0000 7fd07ffff700 1 -- 172.21.15.98:0/2482646085 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd08800f460 con 0x7fd098101480 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.212+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0980ff670 con 0x7fd098101480 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.213+0000 7fd07ffff700 1 -- 172.21.15.98:0/2482646085 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd08800f6d0 con 0x7fd098101480 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.213+0000 7fd07ffff700 1 --2- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd080038490 0x7fd08003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.213+0000 7fd07ffff700 1 -- 172.21.15.98:0/2482646085 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fd08804c3c0 con 0x7fd098101480 2024-09-13T02:44:32.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.213+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd098062380 con 0x7fd098101480 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.213+0000 7fd09659c700 1 --2- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd080038490 0x7fd08003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.213+0000 7fd09659c700 1 --2- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd080038490 0x7fd08003a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd08c006fd0 tx=0x7fd08c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.222+0000 7fd07ffff700 1 -- 172.21.15.98:0/2482646085 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd088045e60 con 0x7fd098101480 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:31.418+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd09819b000 con 0x7fd098101480 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.148+0000 7fd07ffff700 1 -- 172.21.15.98:0/2482646085 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd08804a090 con 0x7fd098101480 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd080038490 msgr2=0x7fd08003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 --2- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd080038490 0x7fd08003a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd08c006fd0 tx=0x7fd08c006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 msgr2=0x7fd098100b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 --2- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 0x7fd098100b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd088005b40 tx=0x7fd088004740 comp rx=0 tx=0).stop 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 shutdown_connections 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 --2- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd080038490 0x7fd08003a940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 --2- 172.21.15.98:0/2482646085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd098101480 0x7fd098100b80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:32.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 >> 172.21.15.98:0/2482646085 conn(0x7fd0980f9af0 msgr2=0x7fd0980fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:32.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 shutdown_connections 2024-09-13T02:44:32.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:44:32.150+0000 7fd09d235700 1 -- 172.21.15.98:0/2482646085 wait complete. 2024-09-13T02:44:32.945 INFO:teuthology.orchestra.run.smithi098.stderr:adjusted tunables profile to default 2024-09-13T02:44:33.203 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:33 smithi098 ceph-mon[27886]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:33.203 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:33 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2482646085' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T02:44:33.203 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:33 smithi098 ceph-mon[27886]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T02:44:33.511 INFO:tasks.cephadm:Adding mon.smithi098 on smithi098 2024-09-13T02:44:33.511 INFO:tasks.cephadm:Adding mon.smithi142 on smithi142 2024-09-13T02:44:33.511 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi098:172.21.15.98=smithi098;smithi142:172.21.15.142=smithi142' 2024-09-13T02:44:33.707 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:33.766 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:35.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:35 smithi098 ceph-mon[27886]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:35.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:35 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:35.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:35 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:35.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:35 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:35.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:35 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.262+0000 7f839e999700 1 -- 172.21.15.142:0/412301867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 msgr2=0x7f83980ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.262+0000 7f839e999700 1 --2- 172.21.15.142:0/412301867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 0x7f83980ff130 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8388009910 tx=0x7f8388009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.262+0000 7f839e999700 1 -- 172.21.15.142:0/412301867 shutdown_connections 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.262+0000 7f839e999700 1 --2- 172.21.15.142:0/412301867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 0x7f83980ff130 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.262+0000 7f839e999700 1 -- 172.21.15.142:0/412301867 >> 172.21.15.142:0/412301867 conn(0x7f83980fa2b0 msgr2=0x7f83980fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.262+0000 7f839e999700 1 -- 172.21.15.142:0/412301867 shutdown_connections 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.262+0000 7f839e999700 1 -- 172.21.15.142:0/412301867 wait complete. 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.263+0000 7f839e999700 1 Processor -- start 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.263+0000 7f839e999700 1 -- start start 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.263+0000 7f839e999700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 0x7f8398194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.263+0000 7f839e999700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8398195500 con 0x7f83980fed20 2024-09-13T02:44:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.263+0000 7f8397fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 0x7f8398194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.263+0000 7f8397fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 0x7f8398194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:55406/0 (socket says 172.21.15.142:55406) 2024-09-13T02:44:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.263+0000 7f8397fff700 1 -- 172.21.15.142:0/998292563 learned_addr learned my addr 172.21.15.142:0/998292563 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:44:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.264+0000 7f8397fff700 1 -- 172.21.15.142:0/998292563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880095f0 con 0x7f83980fed20 2024-09-13T02:44:35.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.264+0000 7f8397fff700 1 --2- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 0x7f8398194fc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8388005b40 tx=0x7f8388004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:35.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.264+0000 7f83957fa700 1 -- 172.21.15.142:0/998292563 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f838801d070 con 0x7f83980fed20 2024-09-13T02:44:35.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.264+0000 7f83957fa700 1 -- 172.21.15.142:0/998292563 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f838800be10 con 0x7f83980fed20 2024-09-13T02:44:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.264+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8398195700 con 0x7f83980fed20 2024-09-13T02:44:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.264+0000 7f83957fa700 1 -- 172.21.15.142:0/998292563 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f838800f460 con 0x7f83980fed20 2024-09-13T02:44:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.264+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8398195ba0 con 0x7f83980fed20 2024-09-13T02:44:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.265+0000 7f83957fa700 1 -- 172.21.15.142:0/998292563 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f838800f6d0 con 0x7f83980fed20 2024-09-13T02:44:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.265+0000 7f83957fa700 1 --2- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8380038490 0x7f838003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.265+0000 7f83957fa700 1 -- 172.21.15.142:0/998292563 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f838804c3e0 con 0x7f83980fed20 2024-09-13T02:44:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.265+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398104b50 con 0x7f83980fed20 2024-09-13T02:44:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.265+0000 7f83977fe700 1 --2- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8380038490 0x7f838003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.266+0000 7f83977fe700 1 --2- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8380038490 0x7f838003a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f838c006fd0 tx=0x7f838c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:35.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.270+0000 7f83957fa700 1 -- 172.21.15.142:0/998292563 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8388027030 con 0x7f83980fed20 2024-09-13T02:44:35.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.467+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi098:172.21.15.98=smithi098;smithi142:172.21.15.142=smithi142", "target": ["mon-mgr", ""]}) v1 -- 0x7f83980fbb80 con 0x7f8380038490 2024-09-13T02:44:35.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.474+0000 7f83957fa700 1 -- 172.21.15.142:0/998292563 <== mgr.14164 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f83980fbb80 con 0x7f8380038490 2024-09-13T02:44:35.475 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled mon update... 2024-09-13T02:44:35.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8380038490 msgr2=0x7f838003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:35.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 --2- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8380038490 0x7f838003a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f838c006fd0 tx=0x7f838c006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:35.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 msgr2=0x7f8398194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:35.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 --2- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 0x7f8398194fc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8388005b40 tx=0x7f8388004740 comp rx=0 tx=0).stop 2024-09-13T02:44:35.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 shutdown_connections 2024-09-13T02:44:35.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 --2- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8380038490 0x7f838003a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:35.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 --2- 172.21.15.142:0/998292563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83980fed20 0x7f8398194fc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:35.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 >> 172.21.15.142:0/998292563 conn(0x7f83980fa2b0 msgr2=0x7f83980faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:35.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 shutdown_connections 2024-09-13T02:44:35.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:35.476+0000 7f839e999700 1 -- 172.21.15.142:0/998292563 wait complete. 2024-09-13T02:44:36.028 DEBUG:teuthology.orchestra.run.smithi142:mon.smithi142> sudo journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi142.service 2024-09-13T02:44:36.030 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:44:36.030 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:44:36.251 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:36.296 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:36.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:36 smithi098 ceph-mon[27886]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-13T02:44:36.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:36 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:36.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:36 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:36.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:36 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T02:44:36.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:36 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:36.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:36 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:37.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:37 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T02:44:37.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:37 smithi098 ceph-mon[27886]: Deploying daemon grafana.smithi098 on smithi098 2024-09-13T02:44:37.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:37 smithi098 ceph-mon[27886]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi098:172.21.15.98=smithi098;smithi142:172.21.15.142=smithi142", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:44:37.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:37 smithi098 ceph-mon[27886]: Saving service mon spec with placement smithi098:172.21.15.98=smithi098;smithi142:172.21.15.142=smithi142;count:2 2024-09-13T02:44:37.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:37 smithi098 ceph-mon[27886]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:37.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:37 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:37.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.699+0000 7fa395a7b700 1 -- 172.21.15.142:0/1987559951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 msgr2=0x7fa390100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:37.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.699+0000 7fa395a7b700 1 --2- 172.21.15.142:0/1987559951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 0x7fa390100240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa380009910 tx=0x7fa380009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:37.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.699+0000 7fa395a7b700 1 -- 172.21.15.142:0/1987559951 shutdown_connections 2024-09-13T02:44:37.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.699+0000 7fa395a7b700 1 --2- 172.21.15.142:0/1987559951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 0x7fa390100240 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:37.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.699+0000 7fa395a7b700 1 -- 172.21.15.142:0/1987559951 >> 172.21.15.142:0/1987559951 conn(0x7fa3900fb3c0 msgr2=0x7fa3900fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:37.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.699+0000 7fa395a7b700 1 -- 172.21.15.142:0/1987559951 shutdown_connections 2024-09-13T02:44:37.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.699+0000 7fa395a7b700 1 -- 172.21.15.142:0/1987559951 wait complete. 2024-09-13T02:44:37.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.700+0000 7fa395a7b700 1 Processor -- start 2024-09-13T02:44:37.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.700+0000 7fa395a7b700 1 -- start start 2024-09-13T02:44:37.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.700+0000 7fa395a7b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 0x7fa390074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:37.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.700+0000 7fa395a7b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa390075030 con 0x7fa3900ffe30 2024-09-13T02:44:37.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.700+0000 7fa38f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 0x7fa390074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:37.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.700+0000 7fa38f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 0x7fa390074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:55420/0 (socket says 172.21.15.142:55420) 2024-09-13T02:44:37.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.700+0000 7fa38f7fe700 1 -- 172.21.15.142:0/1243017113 learned_addr learned my addr 172.21.15.142:0/1243017113 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:44:37.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.701+0000 7fa38f7fe700 1 -- 172.21.15.142:0/1243017113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800095f0 con 0x7fa3900ffe30 2024-09-13T02:44:37.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.701+0000 7fa38f7fe700 1 --2- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 0x7fa390074af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa380005b40 tx=0x7fa380004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:37.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.701+0000 7fa38d7fa700 1 -- 172.21.15.142:0/1243017113 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa38001d070 con 0x7fa3900ffe30 2024-09-13T02:44:37.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.701+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa390073140 con 0x7fa3900ffe30 2024-09-13T02:44:37.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.701+0000 7fa38d7fa700 1 -- 172.21.15.142:0/1243017113 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa38000be10 con 0x7fa3900ffe30 2024-09-13T02:44:37.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.701+0000 7fa38d7fa700 1 -- 172.21.15.142:0/1243017113 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa38000f460 con 0x7fa3900ffe30 2024-09-13T02:44:37.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.701+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3900735e0 con 0x7fa3900ffe30 2024-09-13T02:44:37.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.702+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa390062380 con 0x7fa3900ffe30 2024-09-13T02:44:37.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.702+0000 7fa38d7fa700 1 -- 172.21.15.142:0/1243017113 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fa3800227e0 con 0x7fa3900ffe30 2024-09-13T02:44:37.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.702+0000 7fa38d7fa700 1 --2- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa37c038490 0x7fa37c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:37.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.702+0000 7fa38d7fa700 1 -- 172.21.15.142:0/1243017113 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fa38004c300 con 0x7fa3900ffe30 2024-09-13T02:44:37.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.702+0000 7fa387fff700 1 --2- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa37c038490 0x7fa37c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:37.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.703+0000 7fa387fff700 1 --2- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa37c038490 0x7fa37c03a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa378006fd0 tx=0x7fa378006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:37.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.708+0000 7fa38d7fa700 1 -- 172.21.15.142:0/1243017113 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa38002b590 con 0x7fa3900ffe30 2024-09-13T02:44:37.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.972+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa39018e470 con 0x7fa3900ffe30 2024-09-13T02:44:37.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.972+0000 7fa38d7fa700 1 -- 172.21.15.142:0/1243017113 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa380027070 con 0x7fa3900ffe30 2024-09-13T02:44:37.974 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:44:37.974 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:44:37.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa37c038490 msgr2=0x7fa37c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:37.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 --2- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa37c038490 0x7fa37c03a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa378006fd0 tx=0x7fa378006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:37.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 msgr2=0x7fa390074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:37.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 --2- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 0x7fa390074af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa380005b40 tx=0x7fa380004740 comp rx=0 tx=0).stop 2024-09-13T02:44:37.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 shutdown_connections 2024-09-13T02:44:37.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 --2- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa37c038490 0x7fa37c03a940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:37.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 --2- 172.21.15.142:0/1243017113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3900ffe30 0x7fa390074af0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:37.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 >> 172.21.15.142:0/1243017113 conn(0x7fa3900fb3c0 msgr2=0x7fa3900fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:37.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 shutdown_connections 2024-09-13T02:44:37.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:37.974+0000 7fa395a7b700 1 -- 172.21.15.142:0/1243017113 wait complete. 2024-09-13T02:44:37.977 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:44:38.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:38 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/1243017113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:44:39.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:39 smithi098 ceph-mon[27886]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:39.607 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:44:39.608 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:44:39.803 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:39.847 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:41.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.307+0000 7fa9d41be700 1 -- 172.21.15.142:0/3476829749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 msgr2=0x7fa9cc100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:41.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.307+0000 7fa9d41be700 1 --2- 172.21.15.142:0/3476829749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 0x7fa9cc100230 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009910 tx=0x7fa9bc009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:41.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.307+0000 7fa9d41be700 1 -- 172.21.15.142:0/3476829749 shutdown_connections 2024-09-13T02:44:41.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.307+0000 7fa9d41be700 1 --2- 172.21.15.142:0/3476829749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 0x7fa9cc100230 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:41.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.307+0000 7fa9d41be700 1 -- 172.21.15.142:0/3476829749 >> 172.21.15.142:0/3476829749 conn(0x7fa9cc0fb3d0 msgr2=0x7fa9cc0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.307+0000 7fa9d41be700 1 -- 172.21.15.142:0/3476829749 shutdown_connections 2024-09-13T02:44:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.307+0000 7fa9d41be700 1 -- 172.21.15.142:0/3476829749 wait complete. 2024-09-13T02:44:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.308+0000 7fa9d41be700 1 Processor -- start 2024-09-13T02:44:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.308+0000 7fa9d41be700 1 -- start start 2024-09-13T02:44:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.308+0000 7fa9d41be700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 0x7fa9cc194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.308+0000 7fa9d41be700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc1954a0 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.308+0000 7fa9d1f5a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 0x7fa9cc194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.308+0000 7fa9d1f5a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 0x7fa9cc194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:45588/0 (socket says 172.21.15.142:45588) 2024-09-13T02:44:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.308+0000 7fa9d1f5a700 1 -- 172.21.15.142:0/2287151312 learned_addr learned my addr 172.21.15.142:0/2287151312 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:44:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.309+0000 7fa9d1f5a700 1 -- 172.21.15.142:0/2287151312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc0095f0 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.309+0000 7fa9d1f5a700 1 --2- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 0x7fa9cc194f60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc005b40 tx=0x7fa9bc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.309+0000 7fa9c2ffd700 1 -- 172.21.15.142:0/2287151312 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9bc01d070 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.309+0000 7fa9c2ffd700 1 -- 172.21.15.142:0/2287151312 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9bc00be10 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.309+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc1956a0 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.309+0000 7fa9c2ffd700 1 -- 172.21.15.142:0/2287151312 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9bc00f460 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.309+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc195b40 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.310+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc18ea80 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.310+0000 7fa9c2ffd700 1 -- 172.21.15.142:0/2287151312 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fa9bc0227e0 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.311+0000 7fa9c2ffd700 1 --2- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9b80384e0 0x7fa9b803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:41.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.311+0000 7fa9c2ffd700 1 -- 172.21.15.142:0/2287151312 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fa9bc04c280 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.311+0000 7fa9d1759700 1 --2- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9b80384e0 0x7fa9b803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:41.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.311+0000 7fa9d1759700 1 --2- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9b80384e0 0x7fa9b803a990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8006fd0 tx=0x7fa9c8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.316+0000 7fa9c2ffd700 1 -- 172.21.15.142:0/2287151312 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa9bc02b3b0 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:41 smithi098 ceph-mon[27886]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.584+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa9cc1008b0 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.586 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.585+0000 7fa9c2ffd700 1 -- 172.21.15.142:0/2287151312 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa9cc1008b0 con 0x7fa9cc0ffe20 2024-09-13T02:44:41.586 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:44:41.587 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9b80384e0 msgr2=0x7fa9b803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 --2- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9b80384e0 0x7fa9b803a990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8006fd0 tx=0x7fa9c8006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 msgr2=0x7fa9cc194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 --2- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 0x7fa9cc194f60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc005b40 tx=0x7fa9bc004740 comp rx=0 tx=0).stop 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 shutdown_connections 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 --2- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9b80384e0 0x7fa9b803a990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 --2- 172.21.15.142:0/2287151312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9cc0ffe20 0x7fa9cc194f60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 >> 172.21.15.142:0/2287151312 conn(0x7fa9cc0fb3d0 msgr2=0x7fa9cc0fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 shutdown_connections 2024-09-13T02:44:41.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:41.587+0000 7fa9d41be700 1 -- 172.21.15.142:0/2287151312 wait complete. 2024-09-13T02:44:41.590 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:44:42.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:42 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/2287151312' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:44:43.202 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:44:43.203 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:44:43.398 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:43.442 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:43.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:43 smithi098 ceph-mon[27886]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:44.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.779+0000 7f8476a06700 1 -- 172.21.15.142:0/1923401809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 msgr2=0x7f8470100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.779+0000 7f8476a06700 1 --2- 172.21.15.142:0/1923401809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 0x7f8470100230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8460009910 tx=0x7f8460009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.779+0000 7f8476a06700 1 -- 172.21.15.142:0/1923401809 shutdown_connections 2024-09-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.779+0000 7f8476a06700 1 --2- 172.21.15.142:0/1923401809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 0x7f8470100230 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.780+0000 7f8476a06700 1 -- 172.21.15.142:0/1923401809 >> 172.21.15.142:0/1923401809 conn(0x7f84700fb3d0 msgr2=0x7f84700fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.780+0000 7f8476a06700 1 -- 172.21.15.142:0/1923401809 shutdown_connections 2024-09-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.780+0000 7f8476a06700 1 -- 172.21.15.142:0/1923401809 wait complete. 2024-09-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.780+0000 7f8476a06700 1 Processor -- start 2024-09-13T02:44:44.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.780+0000 7f8476a06700 1 -- start start 2024-09-13T02:44:44.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.781+0000 7f8476a06700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 0x7f8470194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.781+0000 7f8476a06700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84701954a0 con 0x7f84700ffe20 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.781+0000 7f846ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 0x7f8470194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.781+0000 7f846ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 0x7f8470194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:45608/0 (socket says 172.21.15.142:45608) 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.781+0000 7f846ffff700 1 -- 172.21.15.142:0/1904445170 learned_addr learned my addr 172.21.15.142:0/1904445170 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.781+0000 7f846ffff700 1 -- 172.21.15.142:0/1904445170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600095f0 con 0x7f84700ffe20 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.781+0000 7f846ffff700 1 --2- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 0x7f8470194f60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8460005b40 tx=0x7f8460004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.782+0000 7f846d7fa700 1 -- 172.21.15.142:0/1904445170 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f846001d070 con 0x7f84700ffe20 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.782+0000 7f846d7fa700 1 -- 172.21.15.142:0/1904445170 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f846000be10 con 0x7f84700ffe20 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.782+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84701956a0 con 0x7f84700ffe20 2024-09-13T02:44:44.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.782+0000 7f846d7fa700 1 -- 172.21.15.142:0/1904445170 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f846000f460 con 0x7f84700ffe20 2024-09-13T02:44:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.782+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8470195b40 con 0x7f84700ffe20 2024-09-13T02:44:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.783+0000 7f846d7fa700 1 -- 172.21.15.142:0/1904445170 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f84600224e0 con 0x7f84700ffe20 2024-09-13T02:44:44.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.783+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847018ea80 con 0x7f84700ffe20 2024-09-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.783+0000 7f846d7fa700 1 --2- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f84580384e0 0x7f845803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.783+0000 7f846d7fa700 1 -- 172.21.15.142:0/1904445170 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f846004c1e0 con 0x7f84700ffe20 2024-09-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.783+0000 7f846f7fe700 1 --2- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f84580384e0 0x7f845803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:44.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.784+0000 7f846f7fe700 1 --2- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f84580384e0 0x7f845803a990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8464006fd0 tx=0x7f8464006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:44.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:44.788+0000 7f846d7fa700 1 -- 172.21.15.142:0/1904445170 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f846002ba00 con 0x7f84700ffe20 2024-09-13T02:44:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.055+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f847002cc30 con 0x7f84700ffe20 2024-09-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.055+0000 7f846d7fa700 1 -- 172.21.15.142:0/1904445170 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8460027020 con 0x7f84700ffe20 2024-09-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:44:45.057 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.057+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f84580384e0 msgr2=0x7f845803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.057+0000 7f8476a06700 1 --2- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f84580384e0 0x7f845803a990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8464006fd0 tx=0x7f8464006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.057+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 msgr2=0x7f8470194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.057+0000 7f8476a06700 1 --2- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 0x7f8470194f60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8460005b40 tx=0x7f8460004740 comp rx=0 tx=0).stop 2024-09-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.058+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 shutdown_connections 2024-09-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.058+0000 7f8476a06700 1 --2- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f84580384e0 0x7f845803a990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.058+0000 7f8476a06700 1 --2- 172.21.15.142:0/1904445170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84700ffe20 0x7f8470194f60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:45.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.058+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 >> 172.21.15.142:0/1904445170 conn(0x7f84700fb3d0 msgr2=0x7f84700fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:45.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.058+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 shutdown_connections 2024-09-13T02:44:45.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:45.058+0000 7f8476a06700 1 -- 172.21.15.142:0/1904445170 wait complete. 2024-09-13T02:44:45.060 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:44:45.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:45 smithi098 ceph-mon[27886]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:45.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:45 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/1904445170' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:44:46.630 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:44:46.630 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:44:46.827 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:46.871 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:47 smithi098 ceph-mon[27886]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:47 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:47 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:47 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:47 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:47 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:47 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:47.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:47 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:48.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.167+0000 7fb58ddc6700 1 -- 172.21.15.142:0/578641614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 msgr2=0x7fb588100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.167+0000 7fb58ddc6700 1 --2- 172.21.15.142:0/578641614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 0x7fb588100230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb578009910 tx=0x7fb578009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.167+0000 7fb58ddc6700 1 -- 172.21.15.142:0/578641614 shutdown_connections 2024-09-13T02:44:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.167+0000 7fb58ddc6700 1 --2- 172.21.15.142:0/578641614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 0x7fb588100230 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.167+0000 7fb58ddc6700 1 -- 172.21.15.142:0/578641614 >> 172.21.15.142:0/578641614 conn(0x7fb5880fb3d0 msgr2=0x7fb5880fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.167+0000 7fb58ddc6700 1 -- 172.21.15.142:0/578641614 shutdown_connections 2024-09-13T02:44:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.167+0000 7fb58ddc6700 1 -- 172.21.15.142:0/578641614 wait complete. 2024-09-13T02:44:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.167+0000 7fb58ddc6700 1 Processor -- start 2024-09-13T02:44:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.168+0000 7fb58ddc6700 1 -- start start 2024-09-13T02:44:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.168+0000 7fb58ddc6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 0x7fb588194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.168+0000 7fb58ddc6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5881954a0 con 0x7fb5880ffe20 2024-09-13T02:44:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.168+0000 7fb5877fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 0x7fb588194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.168+0000 7fb5877fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 0x7fb588194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:42554/0 (socket says 172.21.15.142:42554) 2024-09-13T02:44:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.168+0000 7fb5877fe700 1 -- 172.21.15.142:0/4112663294 learned_addr learned my addr 172.21.15.142:0/4112663294 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:44:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.168+0000 7fb5877fe700 1 -- 172.21.15.142:0/4112663294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5780095f0 con 0x7fb5880ffe20 2024-09-13T02:44:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.168+0000 7fb5877fe700 1 --2- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 0x7fb588194f60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb578005b40 tx=0x7fb578004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.169+0000 7fb584ff9700 1 -- 172.21.15.142:0/4112663294 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57801d070 con 0x7fb5880ffe20 2024-09-13T02:44:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.169+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5881956a0 con 0x7fb5880ffe20 2024-09-13T02:44:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.169+0000 7fb584ff9700 1 -- 172.21.15.142:0/4112663294 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb57800be10 con 0x7fb5880ffe20 2024-09-13T02:44:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.169+0000 7fb584ff9700 1 -- 172.21.15.142:0/4112663294 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57800f460 con 0x7fb5880ffe20 2024-09-13T02:44:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.169+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb588195b40 con 0x7fb5880ffe20 2024-09-13T02:44:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.170+0000 7fb584ff9700 1 -- 172.21.15.142:0/4112663294 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fb57800f6d0 con 0x7fb5880ffe20 2024-09-13T02:44:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.170+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58818ea80 con 0x7fb5880ffe20 2024-09-13T02:44:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.170+0000 7fb584ff9700 1 --2- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb570038490 0x7fb57003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.170+0000 7fb584ff9700 1 -- 172.21.15.142:0/4112663294 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fb57804c430 con 0x7fb5880ffe20 2024-09-13T02:44:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.170+0000 7fb586ffd700 1 --2- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb570038490 0x7fb57003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.170+0000 7fb586ffd700 1 --2- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb570038490 0x7fb57003a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb57c006fd0 tx=0x7fb57c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:48.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.175+0000 7fb584ff9700 1 -- 172.21.15.142:0/4112663294 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb578020730 con 0x7fb5880ffe20 2024-09-13T02:44:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.441+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb58802cc30 con 0x7fb5880ffe20 2024-09-13T02:44:48.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.441+0000 7fb584ff9700 1 -- 172.21.15.142:0/4112663294 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb578027020 con 0x7fb5880ffe20 2024-09-13T02:44:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:44:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb570038490 msgr2=0x7fb57003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 --2- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb570038490 0x7fb57003a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb57c006fd0 tx=0x7fb57c006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 msgr2=0x7fb588194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 --2- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 0x7fb588194f60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb578005b40 tx=0x7fb578004740 comp rx=0 tx=0).stop 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 shutdown_connections 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 --2- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb570038490 0x7fb57003a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 --2- 172.21.15.142:0/4112663294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5880ffe20 0x7fb588194f60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 >> 172.21.15.142:0/4112663294 conn(0x7fb5880fb3d0 msgr2=0x7fb5880fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 shutdown_connections 2024-09-13T02:44:48.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:48.443+0000 7fb58ddc6700 1 -- 172.21.15.142:0/4112663294 wait complete. 2024-09-13T02:44:48.446 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:44:48.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:48 smithi098 ceph-mon[27886]: Deploying daemon prometheus.smithi098 on smithi098 2024-09-13T02:44:49.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:49 smithi098 ceph-mon[27886]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:49.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:49 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/4112663294' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:44:50.018 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:44:50.018 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:44:50.203 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:50.248 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:51.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:51 smithi098 ceph-mon[27886]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:51.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.668+0000 7f8806d0d700 1 -- 172.21.15.142:0/1311388645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 msgr2=0x7f88000ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:51.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.668+0000 7f8806d0d700 1 --2- 172.21.15.142:0/1311388645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 0x7f88000ff130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009910 tx=0x7f87f4009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:51.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.668+0000 7f8806d0d700 1 -- 172.21.15.142:0/1311388645 shutdown_connections 2024-09-13T02:44:51.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.668+0000 7f8806d0d700 1 --2- 172.21.15.142:0/1311388645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 0x7f88000ff130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:51.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.668+0000 7f8806d0d700 1 -- 172.21.15.142:0/1311388645 >> 172.21.15.142:0/1311388645 conn(0x7f88000fa2b0 msgr2=0x7f88000fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:51.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.668+0000 7f8806d0d700 1 -- 172.21.15.142:0/1311388645 shutdown_connections 2024-09-13T02:44:51.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.668+0000 7f8806d0d700 1 -- 172.21.15.142:0/1311388645 wait complete. 2024-09-13T02:44:51.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f8806d0d700 1 Processor -- start 2024-09-13T02:44:51.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f8806d0d700 1 -- start start 2024-09-13T02:44:51.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f8806d0d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 0x7f88000fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:51.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f8806d0d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000fc7a0 con 0x7f88000fed20 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f8804aa9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 0x7f88000fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f8804aa9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 0x7f88000fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:42570/0 (socket says 172.21.15.142:42570) 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f8804aa9700 1 -- 172.21.15.142:0/2302273904 learned_addr learned my addr 172.21.15.142:0/2302273904 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f8804aa9700 1 -- 172.21.15.142:0/2302273904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40095f0 con 0x7f88000fed20 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f8804aa9700 1 --2- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 0x7f88000fc260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005b40 tx=0x7f87f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.669+0000 7f87fdffb700 1 -- 172.21.15.142:0/2302273904 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87f401d070 con 0x7f88000fed20 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.670+0000 7f87fdffb700 1 -- 172.21.15.142:0/2302273904 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87f400be10 con 0x7f88000fed20 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.670+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88000fa8b0 con 0x7f88000fed20 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.670+0000 7f87fdffb700 1 -- 172.21.15.142:0/2302273904 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87f400f460 con 0x7f88000fed20 2024-09-13T02:44:51.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.670+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88000fad50 con 0x7f88000fed20 2024-09-13T02:44:51.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.671+0000 7f87fdffb700 1 -- 172.21.15.142:0/2302273904 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f87f400f6d0 con 0x7f88000fed20 2024-09-13T02:44:51.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.671+0000 7f87fdffb700 1 --2- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f87f0038490 0x7f87f003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:51.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.671+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8800062380 con 0x7f88000fed20 2024-09-13T02:44:51.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.671+0000 7f87fdffb700 1 -- 172.21.15.142:0/2302273904 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f87f404c490 con 0x7f88000fed20 2024-09-13T02:44:51.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.671+0000 7f87fffff700 1 --2- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f87f0038490 0x7f87f003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:51.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.671+0000 7f87fffff700 1 --2- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f87f0038490 0x7f87f003a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f87ec006fd0 tx=0x7f87ec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:51.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.677+0000 7f87fdffb700 1 -- 172.21.15.142:0/2302273904 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f87f4027030 con 0x7f88000fed20 2024-09-13T02:44:51.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.941+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f880018e3f0 con 0x7f88000fed20 2024-09-13T02:44:51.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.942+0000 7f87fdffb700 1 -- 172.21.15.142:0/2302273904 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f87f402c440 con 0x7f88000fed20 2024-09-13T02:44:51.943 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:44:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:44:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f87f0038490 msgr2=0x7f87f003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 --2- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f87f0038490 0x7f87f003a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f87ec006fd0 tx=0x7f87ec006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 msgr2=0x7f88000fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 --2- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 0x7f88000fc260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005b40 tx=0x7f87f4004740 comp rx=0 tx=0).stop 2024-09-13T02:44:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 shutdown_connections 2024-09-13T02:44:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 --2- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f87f0038490 0x7f87f003a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 --2- 172.21.15.142:0/2302273904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88000fed20 0x7f88000fc260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 >> 172.21.15.142:0/2302273904 conn(0x7f88000fa2b0 msgr2=0x7f88000687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:51.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 shutdown_connections 2024-09-13T02:44:51.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:51.944+0000 7f8806d0d700 1 -- 172.21.15.142:0/2302273904 wait complete. 2024-09-13T02:44:51.946 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:44:52.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:52 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/2302273904' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:44:53.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:53 smithi098 ceph-mon[27886]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:53.512 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:44:53.512 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:44:53.701 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:53.745 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:54.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:54 smithi098 ceph-mon[27886]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.099+0000 7fde9bbab700 1 -- 172.21.15.142:0/724045588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 msgr2=0x7fde94100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.099+0000 7fde9bbab700 1 --2- 172.21.15.142:0/724045588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 0x7fde94100230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde9000b0a0 tx=0x7fde9000b3b0 comp rx=0 tx=0).stop 2024-09-13T02:44:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.099+0000 7fde9bbab700 1 -- 172.21.15.142:0/724045588 shutdown_connections 2024-09-13T02:44:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.099+0000 7fde9bbab700 1 --2- 172.21.15.142:0/724045588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 0x7fde94100230 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.099+0000 7fde9bbab700 1 -- 172.21.15.142:0/724045588 >> 172.21.15.142:0/724045588 conn(0x7fde940fb3d0 msgr2=0x7fde940fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.099+0000 7fde9bbab700 1 -- 172.21.15.142:0/724045588 shutdown_connections 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.099+0000 7fde9bbab700 1 -- 172.21.15.142:0/724045588 wait complete. 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.099+0000 7fde9bbab700 1 Processor -- start 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.099+0000 7fde9bbab700 1 -- start start 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde9bbab700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 0x7fde94194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde9bbab700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde941954a0 con 0x7fde940ffe20 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde99947700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 0x7fde94194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde99947700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 0x7fde94194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:42586/0 (socket says 172.21.15.142:42586) 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde99947700 1 -- 172.21.15.142:0/2156469553 learned_addr learned my addr 172.21.15.142:0/2156469553 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde99947700 1 -- 172.21.15.142:0/2156469553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90009d00 con 0x7fde940ffe20 2024-09-13T02:44:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde99947700 1 --2- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 0x7fde94194f60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fde90015040 tx=0x7fde9000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde8affd700 1 -- 172.21.15.142:0/2156469553 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde9000e040 con 0x7fde940ffe20 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde941956a0 con 0x7fde940ffe20 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde8affd700 1 -- 172.21.15.142:0/2156469553 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fde9001d930 con 0x7fde940ffe20 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde8affd700 1 -- 172.21.15.142:0/2156469553 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde900129d0 con 0x7fde940ffe20 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.100+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde94195ac0 con 0x7fde940ffe20 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.101+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9418ea80 con 0x7fde940ffe20 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.101+0000 7fde8affd700 1 -- 172.21.15.142:0/2156469553 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fde90012c90 con 0x7fde940ffe20 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.101+0000 7fde8affd700 1 --2- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fde80038490 0x7fde8003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.102+0000 7fde8affd700 1 -- 172.21.15.142:0/2156469553 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fde9004c720 con 0x7fde940ffe20 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.102+0000 7fde99146700 1 --2- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fde80038490 0x7fde8003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.102+0000 7fde99146700 1 --2- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fde80038490 0x7fde8003a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde84006fd0 tx=0x7fde84006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:55.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.107+0000 7fde8affd700 1 -- 172.21.15.142:0/2156469553 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fde9001c3e0 con 0x7fde940ffe20 2024-09-13T02:44:55.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.372+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fde94062380 con 0x7fde940ffe20 2024-09-13T02:44:55.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.373+0000 7fde8affd700 1 -- 172.21.15.142:0/2156469553 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fde9001c3e0 con 0x7fde940ffe20 2024-09-13T02:44:55.374 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:44:55.374 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:44:55.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fde80038490 msgr2=0x7fde8003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:55.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 --2- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fde80038490 0x7fde8003a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde84006fd0 tx=0x7fde84006e40 comp rx=0 tx=0).stop 2024-09-13T02:44:55.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 msgr2=0x7fde94194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:55.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 --2- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 0x7fde94194f60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fde90015040 tx=0x7fde9000bb10 comp rx=0 tx=0).stop 2024-09-13T02:44:55.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 shutdown_connections 2024-09-13T02:44:55.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 --2- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fde80038490 0x7fde8003a940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:55.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 --2- 172.21.15.142:0/2156469553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde940ffe20 0x7fde94194f60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:55.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 >> 172.21.15.142:0/2156469553 conn(0x7fde940fb3d0 msgr2=0x7fde940fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:55.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 shutdown_connections 2024-09-13T02:44:55.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:55.375+0000 7fde9bbab700 1 -- 172.21.15.142:0/2156469553 wait complete. 2024-09-13T02:44:55.377 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:44:55.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:55 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/2156469553' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:44:56.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:56 smithi098 ceph-mon[27886]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:56.923 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:44:56.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:44:57.121 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:57.165 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:44:58.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:58 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:58.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:58 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:58.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:58 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:44:58.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:58 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T02:44:58.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:58 smithi098 ceph-mon[27886]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:58.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.682+0000 7ffb74f47700 1 -- 172.21.15.142:0/2812892020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 msgr2=0x7ffb700fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:58.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.682+0000 7ffb74f47700 1 --2- 172.21.15.142:0/2812892020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 0x7ffb700fe4f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009910 tx=0x7ffb60009c20 comp rx=0 tx=0).stop 2024-09-13T02:44:58.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.682+0000 7ffb74f47700 1 -- 172.21.15.142:0/2812892020 shutdown_connections 2024-09-13T02:44:58.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.682+0000 7ffb74f47700 1 --2- 172.21.15.142:0/2812892020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 0x7ffb700fe4f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:58.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.682+0000 7ffb74f47700 1 -- 172.21.15.142:0/2812892020 >> 172.21.15.142:0/2812892020 conn(0x7ffb700f9a50 msgr2=0x7ffb700fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:58.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.682+0000 7ffb74f47700 1 -- 172.21.15.142:0/2812892020 shutdown_connections 2024-09-13T02:44:58.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.682+0000 7ffb74f47700 1 -- 172.21.15.142:0/2812892020 wait complete. 2024-09-13T02:44:58.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.682+0000 7ffb74f47700 1 Processor -- start 2024-09-13T02:44:58.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb74f47700 1 -- start start 2024-09-13T02:44:58.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb74f47700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 0x7ffb70194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:58.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb74f47700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb701954f0 con 0x7ffb700fe0e0 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb6e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 0x7ffb70194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb6e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 0x7ffb70194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:58244/0 (socket says 172.21.15.142:58244) 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb6e59c700 1 -- 172.21.15.142:0/3828320385 learned_addr learned my addr 172.21.15.142:0/3828320385 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb6e59c700 1 -- 172.21.15.142:0/3828320385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb600095f0 con 0x7ffb700fe0e0 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb6e59c700 1 --2- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 0x7ffb70194fb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005b40 tx=0x7ffb60004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb5f7fe700 1 -- 172.21.15.142:0/3828320385 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb6001d070 con 0x7ffb700fe0e0 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb5f7fe700 1 -- 172.21.15.142:0/3828320385 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb6000be10 con 0x7ffb700fe0e0 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb701956f0 con 0x7ffb700fe0e0 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.683+0000 7ffb5f7fe700 1 -- 172.21.15.142:0/3828320385 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb6000f460 con 0x7ffb700fe0e0 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.684+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb70195b90 con 0x7ffb700fe0e0 2024-09-13T02:44:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.684+0000 7ffb5f7fe700 1 -- 172.21.15.142:0/3828320385 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7ffb6000b960 con 0x7ffb700fe0e0 2024-09-13T02:44:58.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.684+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7018eb00 con 0x7ffb700fe0e0 2024-09-13T02:44:58.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.685+0000 7ffb5f7fe700 1 --2- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb580384e0 0x7ffb5803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:58.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.685+0000 7ffb5f7fe700 1 -- 172.21.15.142:0/3828320385 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ffb6004c4c0 con 0x7ffb700fe0e0 2024-09-13T02:44:58.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.685+0000 7ffb6dd9b700 1 -- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb580384e0 msgr2=0x7ffb5803a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:44:58.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.685+0000 7ffb6dd9b700 1 --2- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb580384e0 0x7ffb5803a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:44:58.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.689+0000 7ffb5f7fe700 1 -- 172.21.15.142:0/3828320385 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffb6002a360 con 0x7ffb700fe0e0 2024-09-13T02:44:58.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.886+0000 7ffb6dd9b700 1 -- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb580384e0 msgr2=0x7ffb5803a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:44:58.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.886+0000 7ffb6dd9b700 1 --2- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb580384e0 0x7ffb5803a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:44:58.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.958+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffb7002cc30 con 0x7ffb700fe0e0 2024-09-13T02:44:58.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.958+0000 7ffb5f7fe700 1 -- 172.21.15.142:0/3828320385 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ffb60027030 con 0x7ffb700fe0e0 2024-09-13T02:44:58.960 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:44:58.960 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:44:58.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.960+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb580384e0 msgr2=0x7ffb5803a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.960+0000 7ffb74f47700 1 --2- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb580384e0 0x7ffb5803a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.960+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 msgr2=0x7ffb70194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.960+0000 7ffb74f47700 1 --2- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 0x7ffb70194fb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005b40 tx=0x7ffb60004740 comp rx=0 tx=0).stop 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.960+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 shutdown_connections 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.960+0000 7ffb74f47700 1 --2- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffb580384e0 0x7ffb5803a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.960+0000 7ffb74f47700 1 --2- 172.21.15.142:0/3828320385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb700fe0e0 0x7ffb70194fb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.960+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 >> 172.21.15.142:0/3828320385 conn(0x7ffb700f9a50 msgr2=0x7ffb700fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.961+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 shutdown_connections 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:44:58.961+0000 7ffb74f47700 1 -- 172.21.15.142:0/3828320385 wait complete. 2024-09-13T02:44:58.963 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:44:59.449 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:59 smithi098 ceph-mon[27886]: from='mgr.14164 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T02:44:59.449 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:59 smithi098 ceph-mon[27886]: mgrmap e14: smithi098.ukgenf(active, since 56s) 2024-09-13T02:44:59.449 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:44:59 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/3828320385' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:00.563 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:45:00.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:45:00.760 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:45:00.803 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:45:02.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.188+0000 7fb0c26cb700 1 -- 172.21.15.142:0/3525994196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 msgr2=0x7fb0bc0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:02.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.188+0000 7fb0c26cb700 1 --2- 172.21.15.142:0/3525994196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 0x7fb0bc0ff140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009910 tx=0x7fb0b0009c20 comp rx=0 tx=0).stop 2024-09-13T02:45:02.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.188+0000 7fb0c26cb700 1 -- 172.21.15.142:0/3525994196 shutdown_connections 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.188+0000 7fb0c26cb700 1 --2- 172.21.15.142:0/3525994196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 0x7fb0bc0ff140 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.188+0000 7fb0c26cb700 1 -- 172.21.15.142:0/3525994196 >> 172.21.15.142:0/3525994196 conn(0x7fb0bc0fa2c0 msgr2=0x7fb0bc0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.188+0000 7fb0c26cb700 1 -- 172.21.15.142:0/3525994196 shutdown_connections 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.188+0000 7fb0c26cb700 1 -- 172.21.15.142:0/3525994196 wait complete. 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.189+0000 7fb0c26cb700 1 Processor -- start 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.189+0000 7fb0c26cb700 1 -- start start 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.189+0000 7fb0c26cb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 0x7fb0bc1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.189+0000 7fb0c26cb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc197720 con 0x7fb0bc0fed30 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.189+0000 7fb0bbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 0x7fb0bc1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.189+0000 7fb0bbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 0x7fb0bc1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:58268/0 (socket says 172.21.15.142:58268) 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.189+0000 7fb0bbfff700 1 -- 172.21.15.142:0/412998275 learned_addr learned my addr 172.21.15.142:0/412998275 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:45:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.190+0000 7fb0bbfff700 1 -- 172.21.15.142:0/412998275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00095f0 con 0x7fb0bc0fed30 2024-09-13T02:45:02.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.190+0000 7fb0bbfff700 1 --2- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 0x7fb0bc1971e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005950 tx=0x7fb0b0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:02.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.190+0000 7fb0b97fa700 1 -- 172.21.15.142:0/412998275 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0b001d070 con 0x7fb0bc0fed30 2024-09-13T02:45:02.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.190+0000 7fb0b97fa700 1 -- 172.21.15.142:0/412998275 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb0b000be10 con 0x7fb0bc0fed30 2024-09-13T02:45:02.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.190+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0bc197920 con 0x7fb0bc0fed30 2024-09-13T02:45:02.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.190+0000 7fb0b97fa700 1 -- 172.21.15.142:0/412998275 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0b000f460 con 0x7fb0bc0fed30 2024-09-13T02:45:02.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.190+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0bc197dc0 con 0x7fb0bc0fed30 2024-09-13T02:45:02.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.191+0000 7fb0b97fa700 1 -- 172.21.15.142:0/412998275 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7fb0b000f5c0 con 0x7fb0bc0fed30 2024-09-13T02:45:02.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.191+0000 7fb0b97fa700 1 --2- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb0a4038530 0x7fb0a403a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:02.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.191+0000 7fb0b97fa700 1 -- 172.21.15.142:0/412998275 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fb0b004c420 con 0x7fb0bc0fed30 2024-09-13T02:45:02.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.191+0000 7fb0bb7fe700 1 -- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb0a4038530 msgr2=0x7fb0a403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:45:02.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.191+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0bc190e20 con 0x7fb0bc0fed30 2024-09-13T02:45:02.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.191+0000 7fb0bb7fe700 1 --2- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb0a4038530 0x7fb0a403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:45:02.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.196+0000 7fb0b97fa700 1 -- 172.21.15.142:0/412998275 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb0b0027070 con 0x7fb0bc0fed30 2024-09-13T02:45:02.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.392+0000 7fb0bb7fe700 1 -- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb0a4038530 msgr2=0x7fb0a403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2 2024-09-13T02:45:02.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.392+0000 7fb0bb7fe700 1 --2- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb0a4038530 0x7fb0a403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:45:02.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.461+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb0bc02cc30 con 0x7fb0bc0fed30 2024-09-13T02:45:02.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.462+0000 7fb0b97fa700 1 -- 172.21.15.142:0/412998275 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb0b002c440 con 0x7fb0bc0fed30 2024-09-13T02:45:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:45:02.463 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:45:02.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb0a4038530 msgr2=0x7fb0a403a9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:45:02.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 --2- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb0a4038530 0x7fb0a403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 msgr2=0x7fb0bc1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 --2- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 0x7fb0bc1971e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005950 tx=0x7fb0b0009e60 comp rx=0 tx=0).stop 2024-09-13T02:45:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 shutdown_connections 2024-09-13T02:45:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 --2- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb0a4038530 0x7fb0a403a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 --2- 172.21.15.142:0/412998275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0bc0fed30 0x7fb0bc1971e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 >> 172.21.15.142:0/412998275 conn(0x7fb0bc0fa2c0 msgr2=0x7fb0bc069070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 shutdown_connections 2024-09-13T02:45:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:02.464+0000 7fb0c26cb700 1 -- 172.21.15.142:0/412998275 wait complete. 2024-09-13T02:45:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:45:03.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:03 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/412998275' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:04.048 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:45:04.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:45:04.244 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:45:04.288 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: Active manager daemon smithi098.ukgenf restarted 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: Activating manager daemon smithi098.ukgenf 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: mgrmap e15: smithi098.ukgenf(active, starting, since 0.00315654s) 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: Manager daemon smithi098.ukgenf is now available 2024-09-13T02:45:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:05.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:05.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:05.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:05.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.872+0000 7fc614c4a700 1 -- 172.21.15.142:0/2122463624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 msgr2=0x7fc6100ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:05.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.872+0000 7fc614c4a700 1 --2- 172.21.15.142:0/2122463624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 0x7fc6100ff130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc60000b0a0 tx=0x7fc60000b3b0 comp rx=0 tx=0).stop 2024-09-13T02:45:05.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.872+0000 7fc614c4a700 1 -- 172.21.15.142:0/2122463624 shutdown_connections 2024-09-13T02:45:05.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.872+0000 7fc614c4a700 1 --2- 172.21.15.142:0/2122463624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 0x7fc6100ff130 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:05.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.872+0000 7fc614c4a700 1 -- 172.21.15.142:0/2122463624 >> 172.21.15.142:0/2122463624 conn(0x7fc6100fa2b0 msgr2=0x7fc6100fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:05.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.872+0000 7fc614c4a700 1 -- 172.21.15.142:0/2122463624 shutdown_connections 2024-09-13T02:45:05.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.872+0000 7fc614c4a700 1 -- 172.21.15.142:0/2122463624 wait complete. 2024-09-13T02:45:05.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.873+0000 7fc614c4a700 1 Processor -- start 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.873+0000 7fc614c4a700 1 -- start start 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.873+0000 7fc614c4a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 0x7fc6100fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.873+0000 7fc614c4a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100fc7a0 con 0x7fc6100fed20 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc60e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 0x7fc6100fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc60e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 0x7fc6100fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:58280/0 (socket says 172.21.15.142:58280) 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc60e59c700 1 -- 172.21.15.142:0/1988840282 learned_addr learned my addr 172.21.15.142:0/1988840282 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc60e59c700 1 -- 172.21.15.142:0/1988840282 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600009d00 con 0x7fc6100fed20 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc60e59c700 1 --2- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 0x7fc6100fc260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc60000b830 tx=0x7fc60000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc6077fe700 1 -- 172.21.15.142:0/1988840282 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc60000e040 con 0x7fc6100fed20 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc6077fe700 1 -- 172.21.15.142:0/1988840282 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc600012af0 con 0x7fc6100fed20 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6100fa8b0 con 0x7fc6100fed20 2024-09-13T02:45:05.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc6077fe700 1 -- 172.21.15.142:0/1988840282 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc60001d9f0 con 0x7fc6100fed20 2024-09-13T02:45:05.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.874+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6100facd0 con 0x7fc6100fed20 2024-09-13T02:45:05.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.875+0000 7fc6077fe700 1 -- 172.21.15.142:0/1988840282 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) v1 ==== 45005+0+0 (secure 0 0 0) 0x7fc60001dc60 con 0x7fc6100fed20 2024-09-13T02:45:05.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.875+0000 7fc6077fe700 1 --2- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc5fc038380 0x7fc5fc03a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:05.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.875+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6100fb6e0 con 0x7fc6100fed20 2024-09-13T02:45:05.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.875+0000 7fc6077fe700 1 -- 172.21.15.142:0/1988840282 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fc60004c6c0 con 0x7fc6100fed20 2024-09-13T02:45:05.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.875+0000 7fc60dd9b700 1 --2- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc5fc038380 0x7fc5fc03a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:05.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.876+0000 7fc60dd9b700 1 --2- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc5fc038380 0x7fc5fc03a830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8006fd0 tx=0x7fc5f8006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:05.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:05.880+0000 7fc6077fe700 1 -- 172.21.15.142:0/1988840282 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc60001c3e0 con 0x7fc6100fed20 2024-09-13T02:45:05.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:45:05.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/trash_purge_schedule"}]: dispatch 2024-09-13T02:45:05.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:05.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:05 smithi098 ceph-mon[27886]: mgrmap e16: smithi098.ukgenf(active, since 1.00569s) 2024-09-13T02:45:06.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.174+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc61018e3f0 con 0x7fc6100fed20 2024-09-13T02:45:06.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.174+0000 7fc6077fe700 1 -- 172.21.15.142:0/1988840282 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc600045090 con 0x7fc6100fed20 2024-09-13T02:45:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:45:06.176 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc5fc038380 msgr2=0x7fc5fc03a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 --2- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc5fc038380 0x7fc5fc03a830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8006fd0 tx=0x7fc5f8006e40 comp rx=0 tx=0).stop 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 msgr2=0x7fc6100fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 --2- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 0x7fc6100fc260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc60000b830 tx=0x7fc60000bd40 comp rx=0 tx=0).stop 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 shutdown_connections 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 --2- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc5fc038380 0x7fc5fc03a830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 --2- 172.21.15.142:0/1988840282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6100fed20 0x7fc6100fc260 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 >> 172.21.15.142:0/1988840282 conn(0x7fc6100fa2b0 msgr2=0x7fc6100687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 shutdown_connections 2024-09-13T02:45:06.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:06.177+0000 7fc614c4a700 1 -- 172.21.15.142:0/1988840282 wait complete. 2024-09-13T02:45:06.180 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:45:07.363 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:06 smithi098 ceph-mon[27886]: [13/Sep/2024:02:45:05] ENGINE Bus STARTING 2024-09-13T02:45:07.364 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:06 smithi098 ceph-mon[27886]: [13/Sep/2024:02:45:05] ENGINE Serving on http://172.21.15.98:8765 2024-09-13T02:45:07.364 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:06 smithi098 ceph-mon[27886]: [13/Sep/2024:02:45:05] ENGINE Serving on https://172.21.15.98:7150 2024-09-13T02:45:07.364 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:06 smithi098 ceph-mon[27886]: [13/Sep/2024:02:45:05] ENGINE Bus STARTED 2024-09-13T02:45:07.364 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:06 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:07.364 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:06 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/1988840282' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:07.364 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:06 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:07.813 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:45:07.813 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:45:08.233 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:45:08.383 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:08 smithi098 ceph-mon[27886]: mgrmap e17: smithi098.ukgenf(active, since 2s) 2024-09-13T02:45:08.625 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:45:10.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:10.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.869+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/2286319105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 msgr2=0x7f0c58100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.869+0000 7f0c5eb9e700 1 --2- 172.21.15.142:0/2286319105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 0x7f0c58100230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009910 tx=0x7f0c4c009c20 comp rx=0 tx=0).stop 2024-09-13T02:45:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.869+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/2286319105 shutdown_connections 2024-09-13T02:45:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.869+0000 7f0c5eb9e700 1 --2- 172.21.15.142:0/2286319105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 0x7f0c58100230 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.869+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/2286319105 >> 172.21.15.142:0/2286319105 conn(0x7f0c580fb3d0 msgr2=0x7f0c580fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:10.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.870+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/2286319105 shutdown_connections 2024-09-13T02:45:10.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.870+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/2286319105 wait complete. 2024-09-13T02:45:10.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.870+0000 7f0c5eb9e700 1 Processor -- start 2024-09-13T02:45:10.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.870+0000 7f0c5eb9e700 1 -- start start 2024-09-13T02:45:10.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.870+0000 7f0c5eb9e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 0x7f0c58074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:10.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c5eb9e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58075030 con 0x7f0c580ffe20 2024-09-13T02:45:10.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c5c93a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 0x7f0c58074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:10.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c5c93a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 0x7f0c58074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:57724/0 (socket says 172.21.15.142:57724) 2024-09-13T02:45:10.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c5c93a700 1 -- 172.21.15.142:0/1187716593 learned_addr learned my addr 172.21.15.142:0/1187716593 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:45:10.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c5c93a700 1 -- 172.21.15.142:0/1187716593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0095f0 con 0x7f0c580ffe20 2024-09-13T02:45:10.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c5c93a700 1 --2- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 0x7f0c58074af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005b40 tx=0x7f0c4c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:10.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c55ffb700 1 -- 172.21.15.142:0/1187716593 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c4c01d070 con 0x7f0c580ffe20 2024-09-13T02:45:10.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c55ffb700 1 -- 172.21.15.142:0/1187716593 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0c4c00be10 con 0x7f0c580ffe20 2024-09-13T02:45:10.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c58073140 con 0x7f0c580ffe20 2024-09-13T02:45:10.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.871+0000 7f0c55ffb700 1 -- 172.21.15.142:0/1187716593 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c4c00f460 con 0x7f0c580ffe20 2024-09-13T02:45:10.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.872+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c580735e0 con 0x7f0c580ffe20 2024-09-13T02:45:10.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.873+0000 7f0c55ffb700 1 -- 172.21.15.142:0/1187716593 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f0c4c00f6d0 con 0x7f0c580ffe20 2024-09-13T02:45:10.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.873+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c58062380 con 0x7f0c580ffe20 2024-09-13T02:45:10.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.873+0000 7f0c55ffb700 1 --2- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0c48038580 0x7f0c4803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:10.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.873+0000 7f0c55ffb700 1 -- 172.21.15.142:0/1187716593 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f0c4c04c6e0 con 0x7f0c580ffe20 2024-09-13T02:45:10.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.873+0000 7f0c57fff700 1 --2- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0c48038580 0x7f0c4803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:10.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.874+0000 7f0c57fff700 1 --2- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0c48038580 0x7f0c4803aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c44006fd0 tx=0x7f0c44006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:10.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:10.878+0000 7f0c55ffb700 1 -- 172.21.15.142:0/1187716593 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0c4c020970 con 0x7f0c580ffe20 2024-09-13T02:45:11.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.164+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0c5818e460 con 0x7f0c580ffe20 2024-09-13T02:45:11.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.164+0000 7f0c55ffb700 1 -- 172.21.15.142:0/1187716593 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f0c4c027030 con 0x7f0c580ffe20 2024-09-13T02:45:11.166 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:45:11.166 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:45:11.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0c48038580 msgr2=0x7f0c4803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:11.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 --2- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0c48038580 0x7f0c4803aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c44006fd0 tx=0x7f0c44006e40 comp rx=0 tx=0).stop 2024-09-13T02:45:11.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 msgr2=0x7f0c58074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:11.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 --2- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 0x7f0c58074af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005b40 tx=0x7f0c4c004740 comp rx=0 tx=0).stop 2024-09-13T02:45:11.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 shutdown_connections 2024-09-13T02:45:11.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 --2- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0c48038580 0x7f0c4803aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:11.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 --2- 172.21.15.142:0/1187716593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c580ffe20 0x7f0c58074af0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:11.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 >> 172.21.15.142:0/1187716593 conn(0x7f0c580fb3d0 msgr2=0x7f0c580fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:11.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 shutdown_connections 2024-09-13T02:45:11.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:11.167+0000 7f0c5eb9e700 1 -- 172.21.15.142:0/1187716593 wait complete. 2024-09-13T02:45:11.169 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:11.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:45:11.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T02:45:11.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:11 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:12.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:12 smithi098 ceph-mon[27886]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:45:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:12 smithi098 ceph-mon[27886]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:45:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:12 smithi098 ceph-mon[27886]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:45:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:12 smithi098 ceph-mon[27886]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:45:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:12 smithi098 ceph-mon[27886]: Deploying daemon ceph-exporter.smithi142 on smithi142 2024-09-13T02:45:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:12 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/1187716593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:12.773 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:45:12.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:45:13.016 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:14.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.991+0000 7fcfc32f3700 1 -- 172.21.15.142:0/2703531914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 msgr2=0x7fcfbc0ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.991+0000 7fcfc32f3700 1 --2- 172.21.15.142:0/2703531914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 0x7fcfbc0ff390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009910 tx=0x7fcfac009c20 comp rx=0 tx=0).stop 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.991+0000 7fcfc32f3700 1 -- 172.21.15.142:0/2703531914 shutdown_connections 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.991+0000 7fcfc32f3700 1 --2- 172.21.15.142:0/2703531914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 0x7fcfbc0ff390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.991+0000 7fcfc32f3700 1 -- 172.21.15.142:0/2703531914 >> 172.21.15.142:0/2703531914 conn(0x7fcfbc074af0 msgr2=0x7fcfbc074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.991+0000 7fcfc32f3700 1 -- 172.21.15.142:0/2703531914 shutdown_connections 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.991+0000 7fcfc32f3700 1 -- 172.21.15.142:0/2703531914 wait complete. 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.992+0000 7fcfc32f3700 1 Processor -- start 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.992+0000 7fcfc32f3700 1 -- start start 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.992+0000 7fcfc32f3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 0x7fcfbc1962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:14.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.992+0000 7fcfc32f3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc196800 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfc108f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 0x7fcfbc1962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfc108f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 0x7fcfbc1962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:57750/0 (socket says 172.21.15.142:57750) 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfc108f700 1 -- 172.21.15.142:0/926240239 learned_addr learned my addr 172.21.15.142:0/926240239 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfc108f700 1 -- 172.21.15.142:0/926240239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0095f0 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfc108f700 1 --2- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 0x7fcfbc1962c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005b40 tx=0x7fcfac004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfb27fc700 1 -- 172.21.15.142:0/926240239 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfac01d070 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc196a00 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfb27fc700 1 -- 172.21.15.142:0/926240239 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcfac0044d0 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfb27fc700 1 -- 172.21.15.142:0/926240239 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfac003930 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.993+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc196dc0 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.994+0000 7fcfb27fc700 1 -- 172.21.15.142:0/926240239 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fcfac003bf0 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.994+0000 7fcfb27fc700 1 --2- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfa8038580 0x7fcfa803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:14.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.995+0000 7fcfb27fc700 1 -- 172.21.15.142:0/926240239 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fcfac04c410 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.995+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc107240 con 0x7fcfbc0fefc0 2024-09-13T02:45:14.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.995+0000 7fcfc088e700 1 --2- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfa8038580 0x7fcfa803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:14.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:14.995+0000 7fcfc088e700 1 --2- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfa8038580 0x7fcfa803aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8006fd0 tx=0x7fcfb8006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:15.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.000+0000 7fcfb27fc700 1 -- 172.21.15.142:0/926240239 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcfac02a540 con 0x7fcfbc0fefc0 2024-09-13T02:45:15.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.288+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcfbc109100 con 0x7fcfbc0fefc0 2024-09-13T02:45:15.290 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.288+0000 7fcfb27fc700 1 -- 172.21.15.142:0/926240239 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fcfac02a360 con 0x7fcfbc0fefc0 2024-09-13T02:45:15.290 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:45:15.290 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:45:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfa8038580 msgr2=0x7fcfa803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 --2- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfa8038580 0x7fcfa803aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8006fd0 tx=0x7fcfb8006e40 comp rx=0 tx=0).stop 2024-09-13T02:45:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 msgr2=0x7fcfbc1962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 --2- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 0x7fcfbc1962c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005b40 tx=0x7fcfac004c80 comp rx=0 tx=0).stop 2024-09-13T02:45:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 shutdown_connections 2024-09-13T02:45:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 --2- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfa8038580 0x7fcfa803aa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 --2- 172.21.15.142:0/926240239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfbc0fefc0 0x7fcfbc1962c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 >> 172.21.15.142:0/926240239 conn(0x7fcfbc074af0 msgr2=0x7fcfbc1031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:15.292 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 shutdown_connections 2024-09-13T02:45:15.293 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:15.290+0000 7fcfc32f3700 1 -- 172.21.15.142:0/926240239 wait complete. 2024-09-13T02:45:15.293 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:45:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:45:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T02:45:16.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:16.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: Deploying daemon crash.smithi142 on smithi142 2024-09-13T02:45:16.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:16.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:15 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/926240239' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:17.004 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:45:17.004 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:45:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:18.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:18.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:18.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:18.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:18.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:18 smithi098 ceph-mon[27886]: Deploying daemon node-exporter.smithi142 on smithi142 2024-09-13T02:45:19.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.175+0000 7fcdbcaac700 1 -- 172.21.15.142:0/3174875160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 msgr2=0x7fcdb8100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:19.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.175+0000 7fcdbcaac700 1 --2- 172.21.15.142:0/3174875160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 0x7fcdb8100480 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009910 tx=0x7fcda8009c20 comp rx=0 tx=0).stop 2024-09-13T02:45:19.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.175+0000 7fcdbcaac700 1 -- 172.21.15.142:0/3174875160 shutdown_connections 2024-09-13T02:45:19.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.175+0000 7fcdbcaac700 1 --2- 172.21.15.142:0/3174875160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 0x7fcdb8100480 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:19.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.175+0000 7fcdbcaac700 1 -- 172.21.15.142:0/3174875160 >> 172.21.15.142:0/3174875160 conn(0x7fcdb80fb970 msgr2=0x7fcdb80fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:19.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.176+0000 7fcdbcaac700 1 -- 172.21.15.142:0/3174875160 shutdown_connections 2024-09-13T02:45:19.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.176+0000 7fcdbcaac700 1 -- 172.21.15.142:0/3174875160 wait complete. 2024-09-13T02:45:19.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.176+0000 7fcdbcaac700 1 Processor -- start 2024-09-13T02:45:19.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.176+0000 7fcdbcaac700 1 -- start start 2024-09-13T02:45:19.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.177+0000 7fcdbcaac700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 0x7fcdb8195320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:19.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.177+0000 7fcdbcaac700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8195860 con 0x7fcdb81000b0 2024-09-13T02:45:19.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.177+0000 7fcdb659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 0x7fcdb8195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:19.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.177+0000 7fcdb659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 0x7fcdb8195320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:52964/0 (socket says 172.21.15.142:52964) 2024-09-13T02:45:19.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.177+0000 7fcdb659c700 1 -- 172.21.15.142:0/334932496 learned_addr learned my addr 172.21.15.142:0/334932496 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:45:19.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.178+0000 7fcdb659c700 1 -- 172.21.15.142:0/334932496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda80095f0 con 0x7fcdb81000b0 2024-09-13T02:45:19.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.178+0000 7fcdb659c700 1 --2- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 0x7fcdb8195320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005b40 tx=0x7fcda8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:19.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.178+0000 7fcda77fe700 1 -- 172.21.15.142:0/334932496 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcda801d070 con 0x7fcdb81000b0 2024-09-13T02:45:19.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.178+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb8195a60 con 0x7fcdb81000b0 2024-09-13T02:45:19.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.178+0000 7fcda77fe700 1 -- 172.21.15.142:0/334932496 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcda80044d0 con 0x7fcdb81000b0 2024-09-13T02:45:19.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.178+0000 7fcda77fe700 1 -- 172.21.15.142:0/334932496 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcda8003930 con 0x7fcdb81000b0 2024-09-13T02:45:19.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.179+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb8195e20 con 0x7fcdb81000b0 2024-09-13T02:45:19.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.179+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb8062380 con 0x7fcdb81000b0 2024-09-13T02:45:19.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.180+0000 7fcda77fe700 1 -- 172.21.15.142:0/334932496 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fcda800b960 con 0x7fcdb81000b0 2024-09-13T02:45:19.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.180+0000 7fcda77fe700 1 --2- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcda0038580 0x7fcda003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:19.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.180+0000 7fcda77fe700 1 -- 172.21.15.142:0/334932496 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fcda804ca30 con 0x7fcdb81000b0 2024-09-13T02:45:19.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.180+0000 7fcdb5d9b700 1 --2- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcda0038580 0x7fcda003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:19.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.181+0000 7fcdb5d9b700 1 --2- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcda0038580 0x7fcda003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcdac006fd0 tx=0x7fcdac006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:19.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.184+0000 7fcda77fe700 1 -- 172.21.15.142:0/334932496 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcda800e5c0 con 0x7fcdb81000b0 2024-09-13T02:45:19.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.473+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcdb8107e10 con 0x7fcdb81000b0 2024-09-13T02:45:19.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.474+0000 7fcda77fe700 1 -- 172.21.15.142:0/334932496 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fcda8033300 con 0x7fcdb81000b0 2024-09-13T02:45:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:45:19.477 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:45:19.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcda0038580 msgr2=0x7fcda003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 --2- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcda0038580 0x7fcda003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcdac006fd0 tx=0x7fcdac006e40 comp rx=0 tx=0).stop 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 msgr2=0x7fcdb8195320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 --2- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 0x7fcdb8195320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005b40 tx=0x7fcda8004c80 comp rx=0 tx=0).stop 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 shutdown_connections 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 --2- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcda0038580 0x7fcda003aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 --2- 172.21.15.142:0/334932496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdb81000b0 0x7fcdb8195320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 >> 172.21.15.142:0/334932496 conn(0x7fcdb80fb970 msgr2=0x7fcdb8104290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 shutdown_connections 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:19.476+0000 7fcdbcaac700 1 -- 172.21.15.142:0/334932496 wait complete. 2024-09-13T02:45:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:45:19.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:19 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/334932496' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:21.084 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:45:21.231 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:45:21.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:20 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:21.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:20 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:21.443 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.153+0000 7fab2dfe6700 1 -- 172.21.15.142:0/2015170460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 msgr2=0x7fab28101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.153+0000 7fab2dfe6700 1 --2- 172.21.15.142:0/2015170460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 0x7fab28101300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fab18009910 tx=0x7fab18009c20 comp rx=0 tx=0).stop 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.153+0000 7fab2dfe6700 1 -- 172.21.15.142:0/2015170460 shutdown_connections 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.153+0000 7fab2dfe6700 1 --2- 172.21.15.142:0/2015170460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 0x7fab28101300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.153+0000 7fab2dfe6700 1 -- 172.21.15.142:0/2015170460 >> 172.21.15.142:0/2015170460 conn(0x7fab28074af0 msgr2=0x7fab28074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.153+0000 7fab2dfe6700 1 -- 172.21.15.142:0/2015170460 shutdown_connections 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.153+0000 7fab2dfe6700 1 -- 172.21.15.142:0/2015170460 wait complete. 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.154+0000 7fab2dfe6700 1 Processor -- start 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.154+0000 7fab2dfe6700 1 -- start start 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.154+0000 7fab2dfe6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 0x7fab28195390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:24.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.154+0000 7fab2dfe6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab281958d0 con 0x7fab28100f30 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.155+0000 7fab277fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 0x7fab28195390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.155+0000 7fab277fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 0x7fab28195390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:52990/0 (socket says 172.21.15.142:52990) 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.155+0000 7fab277fe700 1 -- 172.21.15.142:0/3915454939 learned_addr learned my addr 172.21.15.142:0/3915454939 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.155+0000 7fab277fe700 1 -- 172.21.15.142:0/3915454939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab180095f0 con 0x7fab28100f30 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.155+0000 7fab277fe700 1 --2- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 0x7fab28195390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fab18005b40 tx=0x7fab18004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.155+0000 7fab24ff9700 1 -- 172.21.15.142:0/3915454939 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab1801d070 con 0x7fab28100f30 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.156+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab28195ad0 con 0x7fab28100f30 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.156+0000 7fab24ff9700 1 -- 172.21.15.142:0/3915454939 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab180044d0 con 0x7fab28100f30 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.156+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab28195e90 con 0x7fab28100f30 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.156+0000 7fab24ff9700 1 -- 172.21.15.142:0/3915454939 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab180039a0 con 0x7fab28100f30 2024-09-13T02:45:24.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.157+0000 7fab24ff9700 1 -- 172.21.15.142:0/3915454939 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fab18003b00 con 0x7fab28100f30 2024-09-13T02:45:24.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.157+0000 7fab24ff9700 1 --2- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fab10038580 0x7fab1003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:24.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.157+0000 7fab24ff9700 1 -- 172.21.15.142:0/3915454939 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fab1804d2e0 con 0x7fab28100f30 2024-09-13T02:45:24.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.157+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab28062380 con 0x7fab28100f30 2024-09-13T02:45:24.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.157+0000 7fab26ffd700 1 --2- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fab10038580 0x7fab1003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:24.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.157+0000 7fab26ffd700 1 --2- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fab10038580 0x7fab1003aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab1c006fd0 tx=0x7fab1c006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:24.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.162+0000 7fab24ff9700 1 -- 172.21.15.142:0/3915454939 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fab1802a950 con 0x7fab28100f30 2024-09-13T02:45:24.445 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.443+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fab28107130 con 0x7fab28100f30 2024-09-13T02:45:24.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.444+0000 7fab24ff9700 1 -- 172.21.15.142:0/3915454939 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fab1802a360 con 0x7fab28100f30 2024-09-13T02:45:24.446 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:45:24.446 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:45:24.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fab10038580 msgr2=0x7fab1003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:24.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 --2- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fab10038580 0x7fab1003aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab1c006fd0 tx=0x7fab1c006e40 comp rx=0 tx=0).stop 2024-09-13T02:45:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 msgr2=0x7fab28195390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 --2- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 0x7fab28195390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fab18005b40 tx=0x7fab18004c80 comp rx=0 tx=0).stop 2024-09-13T02:45:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 shutdown_connections 2024-09-13T02:45:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 --2- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fab10038580 0x7fab1003aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 --2- 172.21.15.142:0/3915454939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab28100f30 0x7fab28195390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 >> 172.21.15.142:0/3915454939 conn(0x7fab28074af0 msgr2=0x7fab28104750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 shutdown_connections 2024-09-13T02:45:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:24.446+0000 7fab2dfe6700 1 -- 172.21.15.142:0/3915454939 wait complete. 2024-09-13T02:45:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: Deploying daemon mgr.smithi142.jutrvi on smithi142 2024-09-13T02:45:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:24 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/3915454939' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:26.030 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:45:26.030 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:45:26.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:25 smithi098 ceph-mon[27886]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:25 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:26.711 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:27 smithi098 ceph-mon[27886]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:45:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:27 smithi098 ceph-mon[27886]: Deploying daemon mon.smithi142 on smithi142 2024-09-13T02:45:29.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.260+0000 7f420de83700 1 -- 172.21.15.142:0/2649421637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 msgr2=0x7f42080ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:29.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.260+0000 7f420de83700 1 --2- 172.21.15.142:0/2649421637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 0x7f42080ff390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009910 tx=0x7f41fc009c20 comp rx=0 tx=0).stop 2024-09-13T02:45:29.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.260+0000 7f420de83700 1 -- 172.21.15.142:0/2649421637 shutdown_connections 2024-09-13T02:45:29.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.260+0000 7f420de83700 1 --2- 172.21.15.142:0/2649421637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 0x7f42080ff390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.260+0000 7f420de83700 1 -- 172.21.15.142:0/2649421637 >> 172.21.15.142:0/2649421637 conn(0x7f4208074af0 msgr2=0x7f4208074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.260+0000 7f420de83700 1 -- 172.21.15.142:0/2649421637 shutdown_connections 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.260+0000 7f420de83700 1 -- 172.21.15.142:0/2649421637 wait complete. 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.261+0000 7f420de83700 1 Processor -- start 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.261+0000 7f420de83700 1 -- start start 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.261+0000 7f420de83700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 0x7f4208197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.261+0000 7f420de83700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4208197a90 con 0x7f42080fefc0 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f42077fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 0x7f4208197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f42077fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 0x7f4208197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:55858/0 (socket says 172.21.15.142:55858) 2024-09-13T02:45:29.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f42077fe700 1 -- 172.21.15.142:0/739204296 learned_addr learned my addr 172.21.15.142:0/739204296 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:45:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f42077fe700 1 -- 172.21.15.142:0/739204296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc0095f0 con 0x7f42080fefc0 2024-09-13T02:45:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f42077fe700 1 --2- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 0x7f4208197550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41fc005b40 tx=0x7f41fc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f4204ff9700 1 -- 172.21.15.142:0/739204296 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41fc01d070 con 0x7f42080fefc0 2024-09-13T02:45:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4208197c90 con 0x7f42080fefc0 2024-09-13T02:45:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f4204ff9700 1 -- 172.21.15.142:0/739204296 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f41fc0044d0 con 0x7f42080fefc0 2024-09-13T02:45:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f4204ff9700 1 -- 172.21.15.142:0/739204296 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41fc003930 con 0x7f42080fefc0 2024-09-13T02:45:29.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.262+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4208198050 con 0x7f42080fefc0 2024-09-13T02:45:29.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.263+0000 7f4204ff9700 1 -- 172.21.15.142:0/739204296 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f41fc003bf0 con 0x7f42080fefc0 2024-09-13T02:45:29.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.264+0000 7f4204ff9700 1 --2- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f41f0038570 0x7f41f003aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:29.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.264+0000 7f4204ff9700 1 -- 172.21.15.142:0/739204296 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f41fc04c490 con 0x7f42080fefc0 2024-09-13T02:45:29.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.264+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4208062380 con 0x7f42080fefc0 2024-09-13T02:45:29.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.264+0000 7f4206ffd700 1 --2- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f41f0038570 0x7f41f003aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:29.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.264+0000 7f4206ffd700 1 --2- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f41f0038570 0x7f41f003aa20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41f8006fd0 tx=0x7f41f8006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:29.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.269+0000 7f4204ff9700 1 -- 172.21.15.142:0/739204296 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f41fc02a950 con 0x7f42080fefc0 2024-09-13T02:45:29.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.555+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4208106cf0 con 0x7f42080fefc0 2024-09-13T02:45:29.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.556+0000 7f4204ff9700 1 -- 172.21.15.142:0/739204296 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f41fc02a360 con 0x7f42080fefc0 2024-09-13T02:45:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:45:29.558 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:42:50.485860Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.558+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f41f0038570 msgr2=0x7f41f003aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.558+0000 7f420de83700 1 --2- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f41f0038570 0x7f41f003aa20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41f8006fd0 tx=0x7f41f8006e40 comp rx=0 tx=0).stop 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.558+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 msgr2=0x7f4208197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.558+0000 7f420de83700 1 --2- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 0x7f4208197550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41fc005b40 tx=0x7f41fc004c80 comp rx=0 tx=0).stop 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.558+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 shutdown_connections 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.558+0000 7f420de83700 1 --2- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f41f0038570 0x7f41f003aa20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.558+0000 7f420de83700 1 --2- 172.21.15.142:0/739204296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42080fefc0 0x7f4208197550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.558+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 >> 172.21.15.142:0/739204296 conn(0x7f4208074af0 msgr2=0x7f42081031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.559+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 shutdown_connections 2024-09-13T02:45:29.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:29.559+0000 7f420de83700 1 -- 172.21.15.142:0/739204296 wait complete. 2024-09-13T02:45:29.561 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-13T02:45:30.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:29 smithi098 ceph-mon[27886]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:29 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/739204296' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:29 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:31.175 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:45:31.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:45:31.405 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi142/config 2024-09-13T02:45:32.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:31 smithi098 ceph-mon[27886]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:33.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.253+0000 7fb183831700 1 -- 172.21.15.142:0/1458494651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 msgr2=0x7fb17c0ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:33.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.253+0000 7fb183831700 1 --2- 172.21.15.142:0/1458494651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 0x7fb17c0ff570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb178009910 tx=0x7fb178009c20 comp rx=0 tx=0).stop 2024-09-13T02:45:33.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.253+0000 7fb183831700 1 -- 172.21.15.142:0/1458494651 shutdown_connections 2024-09-13T02:45:33.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.253+0000 7fb183831700 1 --2- 172.21.15.142:0/1458494651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 0x7fb17c0ff570 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:33.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.253+0000 7fb183831700 1 -- 172.21.15.142:0/1458494651 >> 172.21.15.142:0/1458494651 conn(0x7fb17c074c10 msgr2=0x7fb17c075010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:33.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.253+0000 7fb183831700 1 -- 172.21.15.142:0/1458494651 shutdown_connections 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.253+0000 7fb183831700 1 -- 172.21.15.142:0/1458494651 wait complete. 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.254+0000 7fb183831700 1 Processor -- start 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.254+0000 7fb183831700 1 -- start start 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.254+0000 7fb183831700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 0x7fb17c197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.254+0000 7fb183831700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c197b80 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb1815cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 0x7fb17c197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb1815cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 0x7fb17c197640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:55882/0 (socket says 172.21.15.142:55882) 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb1815cd700 1 -- 172.21.15.142:0/332764638 learned_addr learned my addr 172.21.15.142:0/332764638 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb1815cd700 1 -- 172.21.15.142:0/332764638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780095f0 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb1815cd700 1 --2- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 0x7fb17c197640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb178005b40 tx=0x7fb178004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb1727fc700 1 -- 172.21.15.142:0/332764638 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb17801d070 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb1727fc700 1 -- 172.21.15.142:0/332764638 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb1780044d0 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c197d80 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c198140 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.255+0000 7fb1727fc700 1 -- 172.21.15.142:0/332764638 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb178003930 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.256+0000 7fb1727fc700 1 -- 172.21.15.142:0/332764638 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fb178003c70 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.256+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c062380 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.257+0000 7fb1727fc700 1 --2- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb168038580 0x7fb16803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.257+0000 7fb1727fc700 1 -- 172.21.15.142:0/332764638 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fb17804c430 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.257+0000 7fb180dcc700 1 --2- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb168038580 0x7fb16803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:33.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.257+0000 7fb180dcc700 1 --2- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb168038580 0x7fb16803aa30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb16c006fd0 tx=0x7fb16c006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:33.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.262+0000 7fb1727fc700 1 -- 172.21.15.142:0/332764638 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb17802a950 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.382+0000 7fb1727fc700 1 -- 172.21.15.142:0/332764638 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb17802a950 con 0x7fb17c0ff1a0 2024-09-13T02:45:33.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:33 smithi142 systemd[1]: Started Ceph mon.smithi142 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:45:33.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:33.541+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb17c105ee0 con 0x7fb17c0ff1a0 2024-09-13T02:45:38.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.393+0000 7fb1727fc700 1 -- 172.21.15.142:0/332764638 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7fb17802a360 con 0x7fb17c0ff1a0 2024-09-13T02:45:38.395 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:45:38.395 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":2,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:33.382234Z","created":"2024-09-13T02:42:50.485860Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi098","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb168038580 msgr2=0x7fb16803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 --2- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb168038580 0x7fb16803aa30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb16c006fd0 tx=0x7fb16c006e40 comp rx=0 tx=0).stop 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 msgr2=0x7fb17c197640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 --2- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 0x7fb17c197640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb178005b40 tx=0x7fb178004c80 comp rx=0 tx=0).stop 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 shutdown_connections 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 --2- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb168038580 0x7fb16803aa30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 --2- 172.21.15.142:0/332764638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb17c0ff1a0 0x7fb17c197640 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 >> 172.21.15.142:0/332764638 conn(0x7fb17c074c10 msgr2=0x7fb17c103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 shutdown_connections 2024-09-13T02:45:38.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:45:38.396+0000 7fb183831700 1 -- 172.21.15.142:0/332764638 wait complete. 2024-09-13T02:45:38.399 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 2 2024-09-13T02:45:38.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:45:38.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: mon.smithi098 calling monitor election 2024-09-13T02:45:38.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/332764638' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:38.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/817262228' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:45:38.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:38.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: mon.smithi142 calling monitor election 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: mon.smithi098 is new leader, mons smithi098,smithi142 in quorum (ranks 0,1) 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: monmap e2: 2 mons at {smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0],smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: fsmap 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: mgrmap e17: smithi098.ukgenf(active, since 33s) 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:45:38.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/817262228' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:45:38.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: overall HEALTH_OK 2024-09-13T02:45:38.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/817262228' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:45:38.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/817262228' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:45:38.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:38.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:38.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:38.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:38.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: mon.smithi098 calling monitor election 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='client.? 172.21.15.142:0/332764638' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/817262228' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: mon.smithi142 calling monitor election 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: mon.smithi098 is new leader, mons smithi098,smithi142 in quorum (ranks 0,1) 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: monmap e2: 2 mons at {smithi098=[v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0],smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: fsmap 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: mgrmap e17: smithi098.ukgenf(active, since 33s) 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/817262228' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: overall HEALTH_OK 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/817262228' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:45:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/817262228' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:45:38.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:38.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:38.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:38.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:38.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:39.010 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T02:45:39.010 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T02:45:39.222 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:45:39.604 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:39 smithi098 ceph-mon[27886]: mgrmap e18: smithi098.ukgenf(active, since 33s), standbys: smithi142.jutrvi 2024-09-13T02:45:39.605 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:39 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi142.jutrvi", "id": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:45:39.605 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:39 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:39.605 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:39 smithi098 ceph-mon[27886]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:39.605 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:39 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:39.723 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:39 smithi142 ceph-mon[33443]: mgrmap e18: smithi098.ukgenf(active, since 33s), standbys: smithi142.jutrvi 2024-09-13T02:45:39.723 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:39 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi142.jutrvi", "id": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:45:39.724 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:39 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:39.724 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:39 smithi142 ceph-mon[33443]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:39.724 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:39 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:45:40.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.893+0000 7f1574ab7700 1 -- 172.21.15.98:0/2201843623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1570100f30 msgr2=0x7f1570101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:40.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.893+0000 7f1574ab7700 1 --2- 172.21.15.98:0/2201843623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1570100f30 0x7f1570101300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1560009910 tx=0x7f1560009c20 comp rx=0 tx=0).stop 2024-09-13T02:45:40.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.893+0000 7f1574ab7700 1 -- 172.21.15.98:0/2201843623 shutdown_connections 2024-09-13T02:45:40.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.893+0000 7f1574ab7700 1 --2- 172.21.15.98:0/2201843623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1570100f30 0x7f1570101300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:40.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.893+0000 7f1574ab7700 1 -- 172.21.15.98:0/2201843623 >> 172.21.15.98:0/2201843623 conn(0x7f1570074af0 msgr2=0x7f1570074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:40.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.893+0000 7f1574ab7700 1 -- 172.21.15.98:0/2201843623 shutdown_connections 2024-09-13T02:45:40.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.893+0000 7f1574ab7700 1 -- 172.21.15.98:0/2201843623 wait complete. 2024-09-13T02:45:40.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.893+0000 7f1574ab7700 1 Processor -- start 2024-09-13T02:45:40.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f1574ab7700 1 -- start start 2024-09-13T02:45:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f1574ab7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1570100f30 0x7f15700fed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f1574ab7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15700ff2a0 0x7f15700ff710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f1574ab7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15701a1710 con 0x7f15700ff2a0 2024-09-13T02:45:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f1574ab7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15701a1850 con 0x7f1570100f30 2024-09-13T02:45:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f156dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15700ff2a0 0x7f15700ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f156dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15700ff2a0 0x7f15700ff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50388/0 (socket says 172.21.15.98:50388) 2024-09-13T02:45:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f156dd9b700 1 -- 172.21.15.98:0/1095090307 learned_addr learned my addr 172.21.15.98:0/1095090307 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:45:40.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f156e59c700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1570100f30 0x7f15700fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f156dd9b700 1 -- 172.21.15.98:0/1095090307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1570100f30 msgr2=0x7f15700fed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f156dd9b700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1570100f30 0x7f15700fed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f156dd9b700 1 -- 172.21.15.98:0/1095090307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15600095f0 con 0x7f15700ff2a0 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f156dd9b700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15700ff2a0 0x7f15700ff710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f156400b700 tx=0x7f156400bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.894+0000 7f155f7fe700 1 -- 172.21.15.98:0/1095090307 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1564011800 con 0x7f15700ff2a0 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.895+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15701a19f0 con 0x7f15700ff2a0 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.895+0000 7f155f7fe700 1 -- 172.21.15.98:0/1095090307 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1564011e10 con 0x7f15700ff2a0 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.895+0000 7f155f7fe700 1 -- 172.21.15.98:0/1095090307 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f156400f2e0 con 0x7f15700ff2a0 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.895+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15701a1f40 con 0x7f15700ff2a0 2024-09-13T02:45:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.896+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1570107750 con 0x7f15700ff2a0 2024-09-13T02:45:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.896+0000 7f155f7fe700 1 -- 172.21.15.98:0/1095090307 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f1564011960 con 0x7f15700ff2a0 2024-09-13T02:45:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.897+0000 7f155f7fe700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f155806c760 0x7f155806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.897+0000 7f155f7fe700 1 -- 172.21.15.98:0/1095090307 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f156408a3b0 con 0x7f15700ff2a0 2024-09-13T02:45:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.897+0000 7f156e59c700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f155806c760 0x7f155806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.897+0000 7f156e59c700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f155806c760 0x7f155806ec10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f156000b5c0 tx=0x7f1560005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:40.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:40.903+0000 7f155f7fe700 1 -- 172.21.15.98:0/1095090307 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1564055c20 con 0x7f15700ff2a0 2024-09-13T02:45:41.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.107+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f157002ccf0 con 0x7f15700ff2a0 2024-09-13T02:45:41.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.107+0000 7f155f7fe700 1 -- 172.21.15.98:0/1095090307 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f1564015100 con 0x7f15700ff2a0 2024-09-13T02:45:41.109 INFO:teuthology.orchestra.run.smithi098.stdout:# minimal ceph.conf for d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:45:41.109 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-13T02:45:41.109 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:45:41.109 INFO:teuthology.orchestra.run.smithi098.stdout: mon_host = [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-09-13T02:45:41.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f155806c760 msgr2=0x7f155806ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:41.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f155806c760 0x7f155806ec10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f156000b5c0 tx=0x7f1560005a90 comp rx=0 tx=0).stop 2024-09-13T02:45:41.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15700ff2a0 msgr2=0x7f15700ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:41.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15700ff2a0 0x7f15700ff710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f156400b700 tx=0x7f156400bac0 comp rx=0 tx=0).stop 2024-09-13T02:45:41.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 shutdown_connections 2024-09-13T02:45:41.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f155806c760 0x7f155806ec10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:41.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1570100f30 0x7f15700fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:41.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 --2- 172.21.15.98:0/1095090307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15700ff2a0 0x7f15700ff710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:41.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 >> 172.21.15.98:0/1095090307 conn(0x7f1570074af0 msgr2=0x7f1570104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:41.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 shutdown_connections 2024-09-13T02:45:41.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:41.109+0000 7f1574ab7700 1 -- 172.21.15.98:0/1095090307 wait complete. 2024-09-13T02:45:41.112 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:40 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.112 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:40 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.112 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:40 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.112 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:40 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:41.112 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:40 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:41.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:40 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:40 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:40 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:40 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:41.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:40 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:41.741 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T02:45:41.742 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:45:41.742 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T02:45:41.768 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:45:41.768 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:45:41.832 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:45:41.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T02:45:41.863 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:45:41.864 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:45:41.930 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T02:45:41.930 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:45:41.930 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T02:45:41.946 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T02:45:41.946 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-13T02:45:41.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-13T02:45:41.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-13T02:45:41.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:41.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:41.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:41.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1095090307' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:41.972 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: Reconfiguring mon.smithi098 (unknown last config time)... 2024-09-13T02:45:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:45:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:45:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:41.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:41 smithi098 ceph-mon[27886]: Reconfiguring daemon mon.smithi098 on smithi098 2024-09-13T02:45:41.988 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T02:45:41.988 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:45:41.989 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T02:45:41.989 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:45:41.989 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:45:41.989 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-13 02:44:56.527779616 +0000 2024-09-13T02:45:41.989 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-13 02:39:56.200039697 +0000 2024-09-13T02:45:41.989 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-13 02:39:56.200039697 +0000 2024-09-13T02:45:41.989 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-13 02:39:56.200039697 +0000 2024-09-13T02:45:41.989 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T02:45:42.051 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-13T02:45:42.052 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-13T02:45:42.052 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000247514 s, 2.1 MB/s 2024-09-13T02:45:42.053 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T02:45:42.110 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-13T02:45:42.165 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T02:45:42.165 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:45:42.166 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T02:45:42.166 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:45:42.166 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:45:42.166 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-13 02:44:56.527779616 +0000 2024-09-13T02:45:42.166 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-13 02:39:56.530035386 +0000 2024-09-13T02:45:42.166 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-13 02:39:56.530035386 +0000 2024-09-13T02:45:42.166 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-13 02:39:56.530035386 +0000 2024-09-13T02:45:42.166 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T02:45:42.228 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-13T02:45:42.228 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-13T02:45:42.228 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000226156 s, 2.3 MB/s 2024-09-13T02:45:42.229 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T02:45:42.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1095090307' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:42.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: Reconfiguring mon.smithi098 (unknown last config time)... 2024-09-13T02:45:42.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:45:42.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:45:42.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:42.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:41 smithi142 ceph-mon[33443]: Reconfiguring daemon mon.smithi098 on smithi098 2024-09-13T02:45:42.287 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-13T02:45:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T02:45:42.342 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:45:42.342 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T02:45:42.342 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:45:42.342 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:45:42.343 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-13 02:44:56.528779603 +0000 2024-09-13T02:45:42.343 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-13 02:39:56.862031048 +0000 2024-09-13T02:45:42.343 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-13 02:39:56.862031048 +0000 2024-09-13T02:45:42.343 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-13 02:39:56.862031048 +0000 2024-09-13T02:45:42.343 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T02:45:42.405 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-13T02:45:42.405 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-13T02:45:42.406 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00019832 s, 2.6 MB/s 2024-09-13T02:45:42.407 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T02:45:42.463 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-13T02:45:42.518 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T02:45:42.518 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:45:42.518 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-13T02:45:42.518 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:45:42.519 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:45:42.519 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-13 02:44:56.528779603 +0000 2024-09-13T02:45:42.519 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-13 02:39:57.192026737 +0000 2024-09-13T02:45:42.519 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-13 02:39:57.192026737 +0000 2024-09-13T02:45:42.519 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-13 02:39:57.192026737 +0000 2024-09-13T02:45:42.519 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T02:45:42.581 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-13T02:45:42.582 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-13T02:45:42.582 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00017137 s, 3.0 MB/s 2024-09-13T02:45:42.583 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T02:45:42.640 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:45:42.640 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T02:45:42.656 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T02:45:42.656 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-09-13T02:45:42.711 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T02:45:42.712 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:45:42.712 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T02:45:42.712 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:45:42.712 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:45:42.712 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-13 02:45:31.360762762 +0000 2024-09-13T02:45:42.713 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-13 02:39:56.204094209 +0000 2024-09-13T02:45:42.713 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-13 02:39:56.204094209 +0000 2024-09-13T02:45:42.713 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-13 02:39:56.204094209 +0000 2024-09-13T02:45:42.713 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T02:45:42.776 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-13T02:45:42.776 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-13T02:45:42.776 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000202627 s, 2.5 MB/s 2024-09-13T02:45:42.777 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T02:45:42.834 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-09-13T02:45:42.889 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T02:45:42.890 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:45:42.890 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T02:45:42.890 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:45:42.890 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:45:42.890 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-13 02:45:31.360762762 +0000 2024-09-13T02:45:42.890 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-13 02:39:56.531087784 +0000 2024-09-13T02:45:42.890 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-13 02:39:56.532087764 +0000 2024-09-13T02:45:42.890 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-13 02:39:56.531087784 +0000 2024-09-13T02:45:42.890 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T02:45:42.953 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-13T02:45:42.953 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-13T02:45:42.954 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000245016 s, 2.1 MB/s 2024-09-13T02:45:42.955 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T02:45:43.011 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-09-13T02:45:43.067 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T02:45:43.067 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:45:43.067 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-13T02:45:43.068 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:45:43.068 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:45:43.068 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-13 02:45:31.360762762 +0000 2024-09-13T02:45:43.068 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-13 02:39:56.858081358 +0000 2024-09-13T02:45:43.068 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-13 02:39:56.858081358 +0000 2024-09-13T02:45:43.068 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-13 02:39:56.858081358 +0000 2024-09-13T02:45:43.068 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T02:45:43.131 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-13T02:45:43.131 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-13T02:45:43.131 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000215555 s, 2.4 MB/s 2024-09-13T02:45:43.132 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T02:45:43.190 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-09-13T02:45:43.246 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T02:45:43.246 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:45:43.246 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-13T02:45:43.246 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:45:43.246 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:45:43.246 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-13 02:45:31.361762743 +0000 2024-09-13T02:45:43.246 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-13 02:39:57.201074618 +0000 2024-09-13T02:45:43.246 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-13 02:39:57.201074618 +0000 2024-09-13T02:45:43.246 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-13 02:39:57.201074618 +0000 2024-09-13T02:45:43.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T02:45:43.309 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-13T02:45:43.309 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-13T02:45:43.309 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000190035 s, 2.7 MB/s 2024-09-13T02:45:43.310 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T02:45:43.367 INFO:tasks.cephadm:Deploying osd.0 on smithi098 with /dev/vg_nvme/lv_4... 2024-09-13T02:45:43.367 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T02:45:44.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:43 smithi098 ceph-mon[27886]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:44.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:43 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:44.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:43 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:44.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:43 smithi098 ceph-mon[27886]: Reconfiguring mgr.smithi098.ukgenf (unknown last config time)... 2024-09-13T02:45:44.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:43 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.ukgenf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:45:44.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:43 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:45:44.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:43 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:44.199 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:43 smithi098 ceph-mon[27886]: Reconfiguring daemon mgr.smithi098.ukgenf on smithi098 2024-09-13T02:45:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:45:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:43 smithi142 ceph-mon[33443]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:43 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:43 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:43 smithi142 ceph-mon[33443]: Reconfiguring mgr.smithi098.ukgenf (unknown last config time)... 2024-09-13T02:45:44.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:43 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.ukgenf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:45:44.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:43 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:45:44.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:43 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:44.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:43 smithi142 ceph-mon[33443]: Reconfiguring daemon mgr.smithi098.ukgenf on smithi098 2024-09-13T02:45:45.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:45.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:45.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:45:45.389 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:45.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:45.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:45.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:45:45.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:46.461 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:46 smithi098 ceph-mon[27886]: Reconfiguring ceph-exporter.smithi098 (monmap changed)... 2024-09-13T02:45:46.461 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:46 smithi098 ceph-mon[27886]: Reconfiguring daemon ceph-exporter.smithi098 on smithi098 2024-09-13T02:45:46.461 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:46 smithi098 ceph-mon[27886]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:46.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:46 smithi142 ceph-mon[33443]: Reconfiguring ceph-exporter.smithi098 (monmap changed)... 2024-09-13T02:45:46.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:46 smithi142 ceph-mon[33443]: Reconfiguring daemon ceph-exporter.smithi098 on smithi098 2024-09-13T02:45:46.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:46 smithi142 ceph-mon[33443]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:47.428 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:47 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:47.428 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:47 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:47.428 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:47 smithi098 ceph-mon[27886]: Reconfiguring crash.smithi098 (monmap changed)... 2024-09-13T02:45:47.428 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:47 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:45:47.428 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:47 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:47.429 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:47 smithi098 ceph-mon[27886]: Reconfiguring daemon crash.smithi098 on smithi098 2024-09-13T02:45:47.429 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:47 smithi098 ceph-mon[27886]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:47.707 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:45:47.726 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2024-09-13T02:45:47.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:47 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:47.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:47 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:47.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:47 smithi142 ceph-mon[33443]: Reconfiguring crash.smithi098 (monmap changed)... 2024-09-13T02:45:47.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:47 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:45:47.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:47 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:47.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:47 smithi142 ceph-mon[33443]: Reconfiguring daemon crash.smithi098 on smithi098 2024-09-13T02:45:47.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:47 smithi142 ceph-mon[33443]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:48.848 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:45:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:49 smithi142 ceph-mon[33443]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:49 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:49 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:49 smithi142 ceph-mon[33443]: Reconfiguring alertmanager.smithi098 (dependencies changed)... 2024-09-13T02:45:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:49 smithi142 ceph-mon[33443]: Reconfiguring daemon alertmanager.smithi098 on smithi098 2024-09-13T02:45:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:49 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:50.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:49 smithi098 ceph-mon[27886]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:50.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:49 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:50.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:49 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:50.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:49 smithi098 ceph-mon[27886]: Reconfiguring alertmanager.smithi098 (dependencies changed)... 2024-09-13T02:45:50.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:49 smithi098 ceph-mon[27886]: Reconfiguring daemon alertmanager.smithi098 on smithi098 2024-09-13T02:45:50.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:49 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:50.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.929+0000 7f191dec3700 1 -- 172.21.15.98:0/528832989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 msgr2=0x7f1918101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:50.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.929+0000 7f191dec3700 1 --2- 172.21.15.98:0/528832989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 0x7f1918101890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1900009910 tx=0x7f1900009c20 comp rx=0 tx=0).stop 2024-09-13T02:45:50.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.929+0000 7f191dec3700 1 -- 172.21.15.98:0/528832989 shutdown_connections 2024-09-13T02:45:50.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.929+0000 7f191dec3700 1 --2- 172.21.15.98:0/528832989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 0x7f1918101890 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:50.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.929+0000 7f191dec3700 1 --2- 172.21.15.98:0/528832989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1918100240 0x7f1918100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:50.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.929+0000 7f191dec3700 1 -- 172.21.15.98:0/528832989 >> 172.21.15.98:0/528832989 conn(0x7f19180fb7f0 msgr2=0x7f19180fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:50.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.929+0000 7f191dec3700 1 -- 172.21.15.98:0/528832989 shutdown_connections 2024-09-13T02:45:50.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.929+0000 7f191dec3700 1 -- 172.21.15.98:0/528832989 wait complete. 2024-09-13T02:45:50.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f191dec3700 1 Processor -- start 2024-09-13T02:45:50.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f191dec3700 1 -- start start 2024-09-13T02:45:50.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f191dec3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1918100240 0x7f1918195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:50.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f191dec3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 0x7f19181960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:50.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f191dec3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19181966e0 con 0x7f1918101440 2024-09-13T02:45:50.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f191dec3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918196820 con 0x7f1918100240 2024-09-13T02:45:50.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f190effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 0x7f19181960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:50.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f190effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 0x7f19181960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42988/0 (socket says 172.21.15.98:42988) 2024-09-13T02:45:50.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f190effd700 1 -- 172.21.15.98:0/1733115807 learned_addr learned my addr 172.21.15.98:0/1733115807 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f19177fe700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1918100240 0x7f1918195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f190effd700 1 -- 172.21.15.98:0/1733115807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1918100240 msgr2=0x7f1918195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f190effd700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1918100240 0x7f1918195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.930+0000 7f190effd700 1 -- 172.21.15.98:0/1733115807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000095f0 con 0x7f1918101440 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.931+0000 7f190effd700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 0x7f19181960c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1900006010 tx=0x7f190000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.931+0000 7f19157fa700 1 -- 172.21.15.98:0/1733115807 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190001d070 con 0x7f1918101440 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.931+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191819b270 con 0x7f1918101440 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.931+0000 7f19157fa700 1 -- 172.21.15.98:0/1733115807 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f190000f460 con 0x7f1918101440 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.931+0000 7f19157fa700 1 -- 172.21.15.98:0/1733115807 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1900021640 con 0x7f1918101440 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.931+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191819b760 con 0x7f1918101440 2024-09-13T02:45:50.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.932+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1918108e30 con 0x7f1918101440 2024-09-13T02:45:50.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.932+0000 7f19157fa700 1 -- 172.21.15.98:0/1733115807 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f190000fab0 con 0x7f1918101440 2024-09-13T02:45:50.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.933+0000 7f19157fa700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f190406c600 0x7f190406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:50.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.933+0000 7f19157fa700 1 -- 172.21.15.98:0/1733115807 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f190008bba0 con 0x7f1918101440 2024-09-13T02:45:50.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.933+0000 7f19177fe700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f190406c600 0x7f190406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:50.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.933+0000 7f19177fe700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f190406c600 0x7f190406eab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1908006fd0 tx=0x7f1908008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:50.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:50.937+0000 7f19157fa700 1 -- 172.21.15.98:0/1733115807 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f190005aea0 con 0x7f1918101440 2024-09-13T02:45:51.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:45:51.141+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1918105d90 con 0x7f190406c600 2024-09-13T02:45:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:51 smithi098 ceph-mon[27886]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:51 smithi098 ceph-mon[27886]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:45:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:45:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:51 smithi142 ceph-mon[33443]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:51 smithi142 ceph-mon[33443]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:52.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:45:52.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:45:52.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:54.482 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:54 smithi098 ceph-mon[27886]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:54.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:54 smithi142 ceph-mon[33443]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:56.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:56 smithi098 ceph-mon[27886]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:56.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:56.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:56.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:56 smithi142 ceph-mon[33443]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:56.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:56.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:45:57.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:57 smithi098 ceph-mon[27886]: Reconfiguring grafana.smithi098 (dependencies changed)... 2024-09-13T02:45:57.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:57 smithi098 ceph-mon[27886]: Reconfiguring daemon grafana.smithi098 on smithi098 2024-09-13T02:45:57.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:57 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2102317686' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "839bea7c-d0d5-4a63-9fbd-4bb3570e27f7"}]: dispatch 2024-09-13T02:45:57.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:57 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2102317686' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "839bea7c-d0d5-4a63-9fbd-4bb3570e27f7"}]': finished 2024-09-13T02:45:57.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:57 smithi098 ceph-mon[27886]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T02:45:57.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:45:57.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:57 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2196124826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:45:57.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:57 smithi142 ceph-mon[33443]: Reconfiguring grafana.smithi098 (dependencies changed)... 2024-09-13T02:45:57.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:57 smithi142 ceph-mon[33443]: Reconfiguring daemon grafana.smithi098 on smithi098 2024-09-13T02:45:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:57 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2102317686' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "839bea7c-d0d5-4a63-9fbd-4bb3570e27f7"}]: dispatch 2024-09-13T02:45:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:57 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2102317686' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "839bea7c-d0d5-4a63-9fbd-4bb3570e27f7"}]': finished 2024-09-13T02:45:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:57 smithi142 ceph-mon[33443]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T02:45:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:45:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:57 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2196124826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:45:58.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:45:58 smithi098 ceph-mon[27886]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:58.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:45:58 smithi142 ceph-mon[33443]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:00.442 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:00 smithi098 ceph-mon[27886]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:00.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:00 smithi142 ceph-mon[33443]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:02.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:02 smithi098 ceph-mon[27886]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:02.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:02 smithi142 ceph-mon[33443]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:04.186 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:04 smithi098 ceph-mon[27886]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:04.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:04 smithi142 ceph-mon[33443]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:05.465 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:05.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:05 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:06.271 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:06 smithi098 ceph-mon[27886]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:06.271 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:06 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:06.271 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:06 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:06.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:06 smithi142 ceph-mon[33443]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:06.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:06 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:06.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:06 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:07.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:07 smithi098 ceph-mon[27886]: Reconfiguring prometheus.smithi098 (dependencies changed)... 2024-09-13T02:46:07.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:07 smithi098 ceph-mon[27886]: Reconfiguring daemon prometheus.smithi098 on smithi098 2024-09-13T02:46:07.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:07 smithi142 ceph-mon[33443]: Reconfiguring prometheus.smithi098 (dependencies changed)... 2024-09-13T02:46:07.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:07 smithi142 ceph-mon[33443]: Reconfiguring daemon prometheus.smithi098 on smithi098 2024-09-13T02:46:08.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:08 smithi098 ceph-mon[27886]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:08.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:46:08.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:08.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:08 smithi098 ceph-mon[27886]: Deploying daemon osd.0 on smithi098 2024-09-13T02:46:08.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:08 smithi142 ceph-mon[33443]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:08.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:46:08.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:08.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:08 smithi142 ceph-mon[33443]: Deploying daemon osd.0 on smithi098 2024-09-13T02:46:10.429 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:10 smithi098 ceph-mon[27886]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:10.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:10 smithi142 ceph-mon[33443]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:12 smithi098 ceph-mon[27886]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:12 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:12 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:12 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:46:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:12 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:12.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:12 smithi142 ceph-mon[33443]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:12.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:12 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:12.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:12 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:12.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:12 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:46:12.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:12 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:13.460 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:13 smithi142 ceph-mon[33443]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-09-13T02:46:13.460 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:13 smithi142 ceph-mon[33443]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-09-13T02:46:13.460 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:13.460 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:13.460 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:46:13.460 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:13.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:13 smithi098 ceph-mon[27886]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-09-13T02:46:13.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:13 smithi098 ceph-mon[27886]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-09-13T02:46:13.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:13.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:13.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:46:13.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:14.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:14 smithi098 ceph-mon[27886]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:14.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:14 smithi098 ceph-mon[27886]: Reconfiguring crash.smithi142 (monmap changed)... 2024-09-13T02:46:14.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:14 smithi098 ceph-mon[27886]: Reconfiguring daemon crash.smithi142 on smithi142 2024-09-13T02:46:14.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:14.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:14.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:46:14.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:46:14.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:14 smithi142 ceph-mon[33443]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:14 smithi142 ceph-mon[33443]: Reconfiguring crash.smithi142 (monmap changed)... 2024-09-13T02:46:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:14 smithi142 ceph-mon[33443]: Reconfiguring daemon crash.smithi142 on smithi142 2024-09-13T02:46:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:46:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:46:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:15.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:15 smithi098 ceph-mon[27886]: Reconfiguring mgr.smithi142.jutrvi (monmap changed)... 2024-09-13T02:46:15.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:15 smithi098 ceph-mon[27886]: Reconfiguring daemon mgr.smithi142.jutrvi on smithi142 2024-09-13T02:46:15.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:15 smithi142 ceph-mon[33443]: Reconfiguring mgr.smithi142.jutrvi (monmap changed)... 2024-09-13T02:46:15.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:15 smithi142 ceph-mon[33443]: Reconfiguring daemon mgr.smithi142.jutrvi on smithi142 2024-09-13T02:46:16.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:16 smithi142 ceph-mon[33443]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:16.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:16 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:16.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:16 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:16.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:16 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:46:16.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:16 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:46:16.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:16 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:16.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:16 smithi098 ceph-mon[27886]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:16.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:16 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:16.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:16 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:16.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:16 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:46:16.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:16 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:46:16.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:16 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:17.254 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: Reconfiguring mon.smithi142 (monmap changed)... 2024-09-13T02:46:17.254 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: Reconfiguring daemon mon.smithi142 on smithi142 2024-09-13T02:46:17.254 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi098.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi098.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi098.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.255 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:17.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: Reconfiguring mon.smithi142 (monmap changed)... 2024-09-13T02:46:17.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: Reconfiguring daemon mon.smithi142 on smithi142 2024-09-13T02:46:17.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:46:17.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi098.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:46:17.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:46:17.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi098.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:46:17.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:46:17.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi098.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:46:17.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:17.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:18.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:18 smithi098 ceph-mon[27886]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:18.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:18 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:46:18.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:18 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi098.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:46:18.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:18 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:46:18.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:18 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi098.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:46:18.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:18 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:46:18.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:18 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi098.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:46:18.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:18 smithi142 ceph-mon[33443]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:18 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:46:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:18 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi098.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:46:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:18 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:46:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:18 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi098.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:46:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:18 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:46:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:18 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi098.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:46:19.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.689+0000 7f19157fa700 1 -- 172.21.15.98:0/1733115807 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1918105d90 con 0x7f190406c600 2024-09-13T02:46:19.691 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 0 on host 'smithi098' 2024-09-13T02:46:19.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f190406c600 msgr2=0x7f190406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:19.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f190406c600 0x7f190406eab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1908006fd0 tx=0x7f1908008040 comp rx=0 tx=0).stop 2024-09-13T02:46:19.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 msgr2=0x7f19181960c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:19.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 0x7f19181960c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1900006010 tx=0x7f190000be20 comp rx=0 tx=0).stop 2024-09-13T02:46:19.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 shutdown_connections 2024-09-13T02:46:19.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f190406c600 0x7f190406eab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:19.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1918100240 0x7f1918195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:19.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 --2- 172.21.15.98:0/1733115807 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1918101440 0x7f19181960c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:19.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 >> 172.21.15.98:0/1733115807 conn(0x7f19180fb7f0 msgr2=0x7f1918104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:19.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.691+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 shutdown_connections 2024-09-13T02:46:19.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:19.692+0000 7f191dec3700 1 -- 172.21.15.98:0/1733115807 wait complete. 2024-09-13T02:46:19.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:19 smithi098 ceph-mon[27886]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:19.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:19 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:19.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:19 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:19.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:19 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:19.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:19 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:19 smithi142 ceph-mon[33443]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:19 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:19 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:19 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:19 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:20.354 DEBUG:teuthology.orchestra.run.smithi098:osd.0> sudo journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T02:46:20.357 INFO:tasks.cephadm:Deploying osd.1 on smithi098 with /dev/vg_nvme/lv_3... 2024-09-13T02:46:20.357 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T02:46:20.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:20 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:20.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:20 smithi098 ceph-mon[27886]: from='osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:46:21.020 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:46:21.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:20 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:20 smithi142 ceph-mon[33443]: from='osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:46:22.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:21 smithi098 ceph-mon[27886]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:21 smithi098 ceph-mon[27886]: from='osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:46:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:21 smithi098 ceph-mon[27886]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T02:46:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:21 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:21 smithi098 ceph-mon[27886]: from='osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:46:22.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:46:21 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[42809]: 2024-09-13T02:46:21.835+0000 7f55958de700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T02:46:22.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:46:21 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[42809]: 2024-09-13T02:46:21.839+0000 7f5591ed4700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:46:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:21 smithi142 ceph-mon[33443]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:21 smithi142 ceph-mon[33443]: from='osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:46:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:21 smithi142 ceph-mon[33443]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T02:46:22.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:21 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:22.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:21 smithi142 ceph-mon[33443]: from='osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:46:23.141 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:22 smithi098 ceph-mon[27886]: from='osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-13T02:46:23.165 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:22 smithi098 ceph-mon[27886]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T02:46:23.165 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:23.165 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:23.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:22 smithi142 ceph-mon[33443]: from='osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-13T02:46:23.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:22 smithi142 ceph-mon[33443]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T02:46:23.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:24.179 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:23 smithi098 ceph-mon[27886]: purged_snaps scrub starts 2024-09-13T02:46:24.179 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:23 smithi098 ceph-mon[27886]: purged_snaps scrub ok 2024-09-13T02:46:24.179 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:23 smithi098 ceph-mon[27886]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:24.179 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:23 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:24.179 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:23 smithi098 ceph-mon[27886]: osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] boot 2024-09-13T02:46:24.180 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:23 smithi098 ceph-mon[27886]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T02:46:24.180 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:23 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:23 smithi142 ceph-mon[33443]: purged_snaps scrub starts 2024-09-13T02:46:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:23 smithi142 ceph-mon[33443]: purged_snaps scrub ok 2024-09-13T02:46:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:23 smithi142 ceph-mon[33443]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:23 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:23 smithi142 ceph-mon[33443]: osd.0 [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] boot 2024-09-13T02:46:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:23 smithi142 ceph-mon[33443]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T02:46:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:23 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:46:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:46:25.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2024-09-13T02:46:25.373 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:46:25.440 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:25 smithi142 ceph-mon[33443]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T02:46:25.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:25 smithi098 ceph-mon[27886]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T02:46:26.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:26 smithi098 ceph-mon[27886]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:26.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:26 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:26.396 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:26 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:26.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:26 smithi142 ceph-mon[33443]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:26.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:26 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:26.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:26 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:27.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.876+0000 7f8ff33a8700 1 -- 172.21.15.98:0/171836211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec0ff150 msgr2=0x7f8fec0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:27.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.876+0000 7f8ff33a8700 1 --2- 172.21.15.98:0/171836211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec0ff150 0x7f8fec0ff560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009910 tx=0x7f8fe8009c20 comp rx=0 tx=0).stop 2024-09-13T02:46:27.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.876+0000 7f8ff33a8700 1 -- 172.21.15.98:0/171836211 shutdown_connections 2024-09-13T02:46:27.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.876+0000 7f8ff33a8700 1 --2- 172.21.15.98:0/171836211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fec100350 0x7f8fec1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:27.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.876+0000 7f8ff33a8700 1 --2- 172.21.15.98:0/171836211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec0ff150 0x7f8fec0ff560 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:27.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.876+0000 7f8ff33a8700 1 -- 172.21.15.98:0/171836211 >> 172.21.15.98:0/171836211 conn(0x7f8fec0fa700 msgr2=0x7f8fec0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:27.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.876+0000 7f8ff33a8700 1 -- 172.21.15.98:0/171836211 shutdown_connections 2024-09-13T02:46:27.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.876+0000 7f8ff33a8700 1 -- 172.21.15.98:0/171836211 wait complete. 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff33a8700 1 Processor -- start 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff33a8700 1 -- start start 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff33a8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fec0ff150 0x7f8fec069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff33a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec100350 0x7f8fec19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff33a8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec19ae10 con 0x7f8fec100350 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff33a8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec19af50 con 0x7f8fec0ff150 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff0943700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec100350 0x7f8fec19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff0943700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec100350 0x7f8fec19a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38316/0 (socket says 172.21.15.98:38316) 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff0943700 1 -- 172.21.15.98:0/1716702943 learned_addr learned my addr 172.21.15.98:0/1716702943 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.877+0000 7f8ff1144700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fec0ff150 0x7f8fec069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.878+0000 7f8ff0943700 1 -- 172.21.15.98:0/1716702943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fec0ff150 msgr2=0x7f8fec069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.878+0000 7f8ff0943700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fec0ff150 0x7f8fec069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:27.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.878+0000 7f8ff0943700 1 -- 172.21.15.98:0/1716702943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe80095f0 con 0x7f8fec100350 2024-09-13T02:46:27.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.878+0000 7f8ff0943700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec100350 0x7f8fec19a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00d8d0 tx=0x7f8fdc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:27.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.878+0000 7f8fe27fc700 1 -- 172.21.15.98:0/1716702943 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fdc0098a0 con 0x7f8fec100350 2024-09-13T02:46:27.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.878+0000 7f8fe27fc700 1 -- 172.21.15.98:0/1716702943 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc010460 con 0x7f8fec100350 2024-09-13T02:46:27.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.878+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec19b230 con 0x7f8fec100350 2024-09-13T02:46:27.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.878+0000 7f8fe27fc700 1 -- 172.21.15.98:0/1716702943 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fdc00f5f0 con 0x7f8fec100350 2024-09-13T02:46:27.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.878+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec19b780 con 0x7f8fec100350 2024-09-13T02:46:27.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.879+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec107ca0 con 0x7f8fec100350 2024-09-13T02:46:27.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.879+0000 7f8fe27fc700 1 -- 172.21.15.98:0/1716702943 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f8fdc009a00 con 0x7f8fec100350 2024-09-13T02:46:27.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.880+0000 7f8fe27fc700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8fd806c600 0x7f8fd806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:27.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.880+0000 7f8fe27fc700 1 -- 172.21.15.98:0/1716702943 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1810+0+0 (secure 0 0 0) 0x7f8fdc08a710 con 0x7f8fec100350 2024-09-13T02:46:27.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.880+0000 7f8ff1144700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8fd806c600 0x7f8fd806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:27.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.880+0000 7f8ff1144700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8fd806c600 0x7f8fd806eab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8006010 tx=0x7f8fe800b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:27.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:27.884+0000 7f8fe27fc700 1 -- 172.21.15.98:0/1716702943 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8fdc059820 con 0x7f8fec100350 2024-09-13T02:46:28.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:28.089+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fec104ca0 con 0x7f8fd806c600 2024-09-13T02:46:28.555 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:28 smithi098 ceph-mon[27886]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:28.556 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:28 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:46:28.556 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:28 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:46:28.556 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:28 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:28.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:28 smithi142 ceph-mon[33443]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:28.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:28 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:46:28.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:28 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:46:28.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:28 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:29.615 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:29 smithi098 ceph-mon[27886]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:29.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:29 smithi142 ceph-mon[33443]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: Detected new or changed devices on smithi098 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: Adjusting osd_memory_target on smithi098 to 11840M 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:30.375 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:30.376 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:30.579 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:30.579 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: Detected new or changed devices on smithi098 2024-09-13T02:46:30.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:30.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:30.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:30.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: Adjusting osd_memory_target on smithi098 to 11840M 2024-09-13T02:46:30.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:30.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:30.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:30.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:30.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:31.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:31 smithi142 ceph-mon[33443]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:31.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:31 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2796703512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b7dd80-b8d0-4577-a86b-0e2e031e664a"}]: dispatch 2024-09-13T02:46:31.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:31 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2796703512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20b7dd80-b8d0-4577-a86b-0e2e031e664a"}]': finished 2024-09-13T02:46:31.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:31 smithi142 ceph-mon[33443]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T02:46:31.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:31 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:31.664 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:31 smithi098 ceph-mon[27886]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:31.664 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:31 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2796703512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20b7dd80-b8d0-4577-a86b-0e2e031e664a"}]: dispatch 2024-09-13T02:46:31.664 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:31 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2796703512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20b7dd80-b8d0-4577-a86b-0e2e031e664a"}]': finished 2024-09-13T02:46:31.665 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:31 smithi098 ceph-mon[27886]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T02:46:31.665 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:31 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:32.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:32 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:32.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:32 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:32.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:32 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2789236166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:46:33.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:32 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:33.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:32 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:33.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:32 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2789236166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:46:33.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:33 smithi098 ceph-mon[27886]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:34.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:33 smithi142 ceph-mon[33443]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:35.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:35.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:35.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:35.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:35.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:35.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:35 smithi098 ceph-mon[27886]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:35.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:35.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:35.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:35.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:35.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:35.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:35.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:35 smithi142 ceph-mon[33443]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:35.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:38.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:38 smithi098 ceph-mon[27886]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:38.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:38 smithi142 ceph-mon[33443]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:39.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:39 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:46:39.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:39 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:39.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:39 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:46:39.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:39 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:40.318 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:40 smithi098 ceph-mon[27886]: Deploying daemon osd.1 on smithi098 2024-09-13T02:46:40.318 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:40 smithi098 ceph-mon[27886]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:40.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:40 smithi142 ceph-mon[33443]: Deploying daemon osd.1 on smithi098 2024-09-13T02:46:40.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:40 smithi142 ceph-mon[33443]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:42.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:42 smithi098 ceph-mon[27886]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:42.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:42 smithi142 ceph-mon[33443]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:44.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:44 smithi098 ceph-mon[27886]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:44.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:44 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:44.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:44 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:44.387 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:44 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:44.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:44 smithi142 ceph-mon[33443]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:44.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:44 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:44.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:44 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:44.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:44 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:46.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:46 smithi098 ceph-mon[27886]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:46.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:46 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:46.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:46 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:46.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:46 smithi142 ceph-mon[33443]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:46.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:46 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:46.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:46 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:47.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.038+0000 7f8fe27fc700 1 -- 172.21.15.98:0/1716702943 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8fec104ca0 con 0x7f8fd806c600 2024-09-13T02:46:47.040 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 1 on host 'smithi098' 2024-09-13T02:46:47.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.040+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8fd806c600 msgr2=0x7f8fd806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:47.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.040+0000 7f8ff33a8700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8fd806c600 0x7f8fd806eab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8006010 tx=0x7f8fe800b540 comp rx=0 tx=0).stop 2024-09-13T02:46:47.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.040+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec100350 msgr2=0x7f8fec19a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:47.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.040+0000 7f8ff33a8700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec100350 0x7f8fec19a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00d8d0 tx=0x7f8fdc00dbe0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.040+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 shutdown_connections 2024-09-13T02:46:47.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.040+0000 7f8ff33a8700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f8fd806c600 0x7f8fd806eab0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.040+0000 7f8ff33a8700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fec0ff150 0x7f8fec069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.040+0000 7f8ff33a8700 1 --2- 172.21.15.98:0/1716702943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fec100350 0x7f8fec19a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.040+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 >> 172.21.15.98:0/1716702943 conn(0x7f8fec0fa700 msgr2=0x7f8fec103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:47.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.041+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 shutdown_connections 2024-09-13T02:46:47.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:47.041+0000 7f8ff33a8700 1 -- 172.21.15.98:0/1716702943 wait complete. 2024-09-13T02:46:48.048 DEBUG:teuthology.orchestra.run.smithi098:osd.1> sudo journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T02:46:48.050 INFO:tasks.cephadm:Deploying osd.2 on smithi098 with /dev/vg_nvme/lv_2... 2024-09-13T02:46:48.050 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T02:46:48.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:48 smithi098 ceph-mon[27886]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:48 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:48 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:48 smithi098 ceph-mon[27886]: from='osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:46:48.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:48 smithi142 ceph-mon[33443]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:48.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:48 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:48.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:48 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:48.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:48 smithi142 ceph-mon[33443]: from='osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:46:49.081 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:46:49.243 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:49 smithi098 ceph-mon[27886]: from='osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:46:49.243 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:49 smithi098 ceph-mon[27886]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T02:46:49.243 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:49 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:49.244 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:49 smithi098 ceph-mon[27886]: from='osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:46:49.244 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:46:49 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[48296]: 2024-09-13T02:46:49.225+0000 7f059d5ce700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T02:46:49.244 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:46:49 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[48296]: 2024-09-13T02:46:49.229+0000 7f05973bf700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:46:49.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:49 smithi142 ceph-mon[33443]: from='osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:46:49.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:49 smithi142 ceph-mon[33443]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T02:46:49.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:49 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:49.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:49 smithi142 ceph-mon[33443]: from='osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:46:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:50 smithi098 ceph-mon[27886]: purged_snaps scrub starts 2024-09-13T02:46:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:50 smithi098 ceph-mon[27886]: purged_snaps scrub ok 2024-09-13T02:46:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:50 smithi098 ceph-mon[27886]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:50 smithi098 ceph-mon[27886]: from='osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-13T02:46:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:50 smithi098 ceph-mon[27886]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T02:46:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:50.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:50 smithi142 ceph-mon[33443]: purged_snaps scrub starts 2024-09-13T02:46:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:50 smithi142 ceph-mon[33443]: purged_snaps scrub ok 2024-09-13T02:46:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:50 smithi142 ceph-mon[33443]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:50 smithi142 ceph-mon[33443]: from='osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-13T02:46:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:50 smithi142 ceph-mon[33443]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T02:46:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:51.379 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:51 smithi098 ceph-mon[27886]: osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] boot 2024-09-13T02:46:51.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:51 smithi098 ceph-mon[27886]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T02:46:51.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:51.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:51 smithi142 ceph-mon[33443]: osd.1 [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] boot 2024-09-13T02:46:51.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:51 smithi142 ceph-mon[33443]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T02:46:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:46:52.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:52 smithi098 ceph-mon[27886]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:52.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:52 smithi098 ceph-mon[27886]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T02:46:52.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:52 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:52.475 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:52 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:52.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:52 smithi142 ceph-mon[33443]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:46:52.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:52 smithi142 ceph-mon[33443]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T02:46:52.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:52 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:52.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:52 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:53.102 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:46:53.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2024-09-13T02:46:53.558 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:46:54.303 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:54 smithi098 ceph-mon[27886]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:46:54.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:54 smithi142 ceph-mon[33443]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:46:56.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.164+0000 7f68dc067700 1 -- 172.21.15.98:0/1501381832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d41003d0 msgr2=0x7f68d4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:56.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.164+0000 7f68dc067700 1 --2- 172.21.15.98:0/1501381832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d41003d0 0x7f68d4100840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009910 tx=0x7f68c4009c20 comp rx=0 tx=0).stop 2024-09-13T02:46:56.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 -- 172.21.15.98:0/1501381832 shutdown_connections 2024-09-13T02:46:56.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 --2- 172.21.15.98:0/1501381832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d41003d0 0x7f68d4100840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:56.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 --2- 172.21.15.98:0/1501381832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68d40ff130 0x7f68d40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:56.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 -- 172.21.15.98:0/1501381832 >> 172.21.15.98:0/1501381832 conn(0x7f68d40fa780 msgr2=0x7f68d40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:56.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 -- 172.21.15.98:0/1501381832 shutdown_connections 2024-09-13T02:46:56.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 -- 172.21.15.98:0/1501381832 wait complete. 2024-09-13T02:46:56.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 Processor -- start 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 -- start start 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40ff130 0x7f68d4069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68d41003d0 0x7f68d419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d419ad80 con 0x7f68d40ff130 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.165+0000 7f68dc067700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d419aec0 con 0x7f68d41003d0 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68d9e03700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40ff130 0x7f68d4069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68d9e03700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40ff130 0x7f68d4069100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42688/0 (socket says 172.21.15.98:42688) 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68d9e03700 1 -- 172.21.15.98:0/751782547 learned_addr learned my addr 172.21.15.98:0/751782547 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68d9602700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68d41003d0 0x7f68d419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68d9e03700 1 -- 172.21.15.98:0/751782547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68d41003d0 msgr2=0x7f68d419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68d9e03700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68d41003d0 0x7f68d419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:56.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68d9e03700 1 -- 172.21.15.98:0/751782547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40095f0 con 0x7f68d40ff130 2024-09-13T02:46:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68d9e03700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40ff130 0x7f68d4069100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f68d000e920 tx=0x7f68d000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68caffd700 1 -- 172.21.15.98:0/751782547 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68d000c9d0 con 0x7f68d40ff130 2024-09-13T02:46:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d419b1a0 con 0x7f68d40ff130 2024-09-13T02:46:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68caffd700 1 -- 172.21.15.98:0/751782547 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f68d0010430 con 0x7f68d40ff130 2024-09-13T02:46:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68caffd700 1 -- 172.21.15.98:0/751782547 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68d0018650 con 0x7f68d40ff130 2024-09-13T02:46:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.166+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d419b6f0 con 0x7f68d40ff130 2024-09-13T02:46:56.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.167+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d4107c10 con 0x7f68d40ff130 2024-09-13T02:46:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.168+0000 7f68caffd700 1 -- 172.21.15.98:0/751782547 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f68d00105a0 con 0x7f68d40ff130 2024-09-13T02:46:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.168+0000 7f68caffd700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f68c006c610 0x7f68c006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.168+0000 7f68d9602700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f68c006c610 0x7f68c006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.168+0000 7f68caffd700 1 -- 172.21.15.98:0/751782547 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2242+0+0 (secure 0 0 0) 0x7f68d0014070 con 0x7f68d40ff130 2024-09-13T02:46:56.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.169+0000 7f68d9602700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f68c006c610 0x7f68c006eac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f68c400b6f0 tx=0x7f68c4005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:56.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.172+0000 7f68caffd700 1 -- 172.21.15.98:0/751782547 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f68d0051720 con 0x7f68d40ff130 2024-09-13T02:46:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:46:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: Detected new or changed devices on smithi098 2024-09-13T02:46:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:56.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: Adjusting osd_memory_target on smithi098 to 5920M 2024-09-13T02:46:56.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:56.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:56.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:56.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:56.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:56 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:56.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:46:56.396+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f68d4104d20 con 0x7f68c006c610 2024-09-13T02:46:56.469 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:46:56.469 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: Detected new or changed devices on smithi098 2024-09-13T02:46:56.469 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:56.469 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:56.469 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:56.469 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:56.469 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: Adjusting osd_memory_target on smithi098 to 5920M 2024-09-13T02:46:56.469 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:56.469 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:56.470 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:56.470 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:56.470 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:56 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:57.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:46:57.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:46:57.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:57.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:57.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:46:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:46:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:57.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:46:58.457 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:58 smithi098 ceph-mon[27886]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:58.457 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:46:58 smithi098 ceph-mon[27886]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:46:58.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:58 smithi142 ceph-mon[33443]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:58.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:46:58 smithi142 ceph-mon[33443]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:00.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:00 smithi098 ceph-mon[27886]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:00.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:00 smithi142 ceph-mon[33443]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:01.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:01 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3185938569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fe12d84-20a5-4109-b87a-037c8084682a"}]: dispatch 2024-09-13T02:47:01.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:01 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3185938569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fe12d84-20a5-4109-b87a-037c8084682a"}]': finished 2024-09-13T02:47:01.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:01 smithi098 ceph-mon[27886]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T02:47:01.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:01 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:01.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:01 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3317766776' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:47:01.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:01 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3185938569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fe12d84-20a5-4109-b87a-037c8084682a"}]: dispatch 2024-09-13T02:47:01.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:01 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3185938569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fe12d84-20a5-4109-b87a-037c8084682a"}]': finished 2024-09-13T02:47:01.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:01 smithi142 ceph-mon[33443]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T02:47:01.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:01 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:01.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:01 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3317766776' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:47:02.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:02 smithi098 ceph-mon[27886]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:02.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:02 smithi142 ceph-mon[33443]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:04.365 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:04 smithi098 ceph-mon[27886]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:04.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:04 smithi142 ceph-mon[33443]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:05.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:05.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:05 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:06.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:06 smithi098 ceph-mon[27886]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:06.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:06 smithi142 ceph-mon[33443]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:08.302 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:08 smithi098 ceph-mon[27886]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:08.302 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:47:08.302 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:08.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:08 smithi142 ceph-mon[33443]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:08.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:47:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:09.442 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:09 smithi098 ceph-mon[27886]: Deploying daemon osd.2 on smithi098 2024-09-13T02:47:09.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:09 smithi142 ceph-mon[33443]: Deploying daemon osd.2 on smithi098 2024-09-13T02:47:10.431 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:10 smithi098 ceph-mon[27886]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:10.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:10 smithi142 ceph-mon[33443]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:12.363 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:12 smithi098 ceph-mon[27886]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:12.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:12 smithi142 ceph-mon[33443]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:13.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:13.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:13.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:13.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:13 smithi098 ceph-mon[27886]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:14.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:14.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:14.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:14.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:13 smithi142 ceph-mon[33443]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:15 smithi098 ceph-mon[27886]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:15 smithi142 ceph-mon[33443]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:16.808 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 2 on host 'smithi098' 2024-09-13T02:47:16.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.807+0000 7f68caffd700 1 -- 172.21.15.98:0/751782547 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f68d4104d20 con 0x7f68c006c610 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f68c006c610 msgr2=0x7f68c006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f68c006c610 0x7f68c006eac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f68c400b6f0 tx=0x7f68c4005a90 comp rx=0 tx=0).stop 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40ff130 msgr2=0x7f68d4069100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40ff130 0x7f68d4069100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f68d000e920 tx=0x7f68d000ec30 comp rx=0 tx=0).stop 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 shutdown_connections 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f68c006c610 0x7f68c006eac0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68d40ff130 0x7f68d4069100 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 --2- 172.21.15.98:0/751782547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68d41003d0 0x7f68d419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 >> 172.21.15.98:0/751782547 conn(0x7f68d40fa780 msgr2=0x7f68d4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 shutdown_connections 2024-09-13T02:47:16.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:47:16.809+0000 7f68dc067700 1 -- 172.21.15.98:0/751782547 wait complete. 2024-09-13T02:47:17.130 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:16 smithi098 ceph-mon[27886]: from='osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:47:17.130 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:16 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:17.130 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:16 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:17.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:16 smithi142 ceph-mon[33443]: from='osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:47:17.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:16 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:17.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:16 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:18.024 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:17 smithi098 ceph-mon[27886]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:18.024 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:17 smithi098 ceph-mon[27886]: from='osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:47:18.024 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:17 smithi098 ceph-mon[27886]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T02:47:18.024 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:17 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:18.024 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:17 smithi098 ceph-mon[27886]: from='osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:47:18.025 DEBUG:teuthology.orchestra.run.smithi098:osd.2> sudo journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T02:47:18.028 INFO:tasks.cephadm:Deploying osd.3 on smithi142 with /dev/vg_nvme/lv_4... 2024-09-13T02:47:18.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T02:47:18.236 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi142/config 2024-09-13T02:47:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:17 smithi142 ceph-mon[33443]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:17 smithi142 ceph-mon[33443]: from='osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:47:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:17 smithi142 ceph-mon[33443]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T02:47:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:17 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:17 smithi142 ceph-mon[33443]: from='osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:47:19.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:18 smithi142 ceph-mon[33443]: from='osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-13T02:47:19.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:18 smithi142 ceph-mon[33443]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T02:47:19.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:18 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:19.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:18 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:19.153 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:18 smithi098 ceph-mon[27886]: from='osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-13T02:47:19.154 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:18 smithi098 ceph-mon[27886]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T02:47:19.154 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:19.154 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:20.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:19 smithi098 ceph-mon[27886]: purged_snaps scrub starts 2024-09-13T02:47:20.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:19 smithi098 ceph-mon[27886]: purged_snaps scrub ok 2024-09-13T02:47:20.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:19 smithi098 ceph-mon[27886]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:20.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:19 smithi098 ceph-mon[27886]: osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] boot 2024-09-13T02:47:20.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:19 smithi098 ceph-mon[27886]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T02:47:20.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:19 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:20.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:19 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:20.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:19 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:20.192 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:19 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:19 smithi142 ceph-mon[33443]: purged_snaps scrub starts 2024-09-13T02:47:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:19 smithi142 ceph-mon[33443]: purged_snaps scrub ok 2024-09-13T02:47:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:19 smithi142 ceph-mon[33443]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T02:47:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:19 smithi142 ceph-mon[33443]: osd.2 [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] boot 2024-09-13T02:47:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:19 smithi142 ceph-mon[33443]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T02:47:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:19 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:47:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:19 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:19 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:19 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:47:20.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi142:vg_nvme/lv_4 2024-09-13T02:47:20.856 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi142/config 2024-09-13T02:47:21.820 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:21 smithi142 ceph-mon[33443]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T02:47:21.820 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:21 smithi142 ceph-mon[33443]: pgmap v76: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:21.820 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:21 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T02:47:21.859 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:21 smithi098 ceph-mon[27886]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T02:47:21.859 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:21 smithi098 ceph-mon[27886]: pgmap v76: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:21.860 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:21 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T02:47:22.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.354+0000 7f1da4d0c700 1 -- 172.21.15.142:0/3426567944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 msgr2=0x7f1da0100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.354+0000 7f1da4d0c700 1 --2- 172.21.15.142:0/3426567944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 0x7f1da0100860 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009910 tx=0x7f1d94009c20 comp rx=0 tx=0).stop 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.354+0000 7f1da4d0c700 1 -- 172.21.15.142:0/3426567944 shutdown_connections 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.354+0000 7f1da4d0c700 1 --2- 172.21.15.142:0/3426567944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 0x7f1da0100860 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.354+0000 7f1da4d0c700 1 --2- 172.21.15.142:0/3426567944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1da00ff150 0x7f1da00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.354+0000 7f1da4d0c700 1 -- 172.21.15.142:0/3426567944 >> 172.21.15.142:0/3426567944 conn(0x7f1da00fa7a0 msgr2=0x7f1da00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.354+0000 7f1da4d0c700 1 -- 172.21.15.142:0/3426567944 shutdown_connections 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.354+0000 7f1da4d0c700 1 -- 172.21.15.142:0/3426567944 wait complete. 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1da4d0c700 1 Processor -- start 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1da4d0c700 1 -- start start 2024-09-13T02:47:22.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1da4d0c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1da00ff150 0x7f1da0069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1da4d0c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 0x7f1da019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1da4d0c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da019b0c0 con 0x7f1da00ff150 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1da4d0c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da019b230 con 0x7f1da01003f0 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1d9dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 0x7f1da019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1d9dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 0x7f1da019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39764/0 (socket says 172.21.15.142:39764) 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1d9dd9b700 1 -- 172.21.15.142:0/2180152762 learned_addr learned my addr 172.21.15.142:0/2180152762 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.355+0000 7f1d9e59c700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1da00ff150 0x7f1da0069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.356+0000 7f1d9dd9b700 1 -- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1da00ff150 msgr2=0x7f1da0069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.356+0000 7f1d9dd9b700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1da00ff150 0x7f1da0069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.356+0000 7f1d9dd9b700 1 -- 172.21.15.142:0/2180152762 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940095f0 con 0x7f1da01003f0 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.356+0000 7f1d9dd9b700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 0x7f1da019aaf0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1d94006010 tx=0x7f1d9400bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:22.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.356+0000 7f1d8f7fe700 1 -- 172.21.15.142:0/2180152762 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d9401d070 con 0x7f1da01003f0 2024-09-13T02:47:22.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.356+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da019b4b0 con 0x7f1da01003f0 2024-09-13T02:47:22.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.356+0000 7f1d8f7fe700 1 -- 172.21.15.142:0/2180152762 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d9400f460 con 0x7f1da01003f0 2024-09-13T02:47:22.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.356+0000 7f1d8f7fe700 1 -- 172.21.15.142:0/2180152762 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d94021640 con 0x7f1da01003f0 2024-09-13T02:47:22.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.356+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da019b950 con 0x7f1da01003f0 2024-09-13T02:47:22.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.357+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da0068ab0 con 0x7f1da01003f0 2024-09-13T02:47:22.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.358+0000 7f1d8f7fe700 1 -- 172.21.15.142:0/2180152762 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f1d9400fab0 con 0x7f1da01003f0 2024-09-13T02:47:22.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.358+0000 7f1d8f7fe700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1d8806c600 0x7f1d8806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:22.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.358+0000 7f1d8f7fe700 1 -- 172.21.15.142:0/2180152762 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3049+0+0 (secure 0 0 0) 0x7f1d9408c080 con 0x7f1da01003f0 2024-09-13T02:47:22.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.358+0000 7f1d9e59c700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1d8806c600 0x7f1d8806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:22.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.359+0000 7f1d9e59c700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1d8806c600 0x7f1d8806eab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d90005950 tx=0x7f1d9000a300 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:22.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.363+0000 7f1d8f7fe700 1 -- 172.21.15.142:0/2180152762 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1d9405acf0 con 0x7f1da01003f0 2024-09-13T02:47:22.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:22.573+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1da0104e40 con 0x7f1d8806c600 2024-09-13T02:47:22.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: Detected new or changed devices on smithi098 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: Adjusting osd_memory_target on smithi098 to 3946M 2024-09-13T02:47:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:22.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:22.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:22.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:22.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:22 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:22.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T02:47:22.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T02:47:22.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T02:47:22.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: Detected new or changed devices on smithi098 2024-09-13T02:47:22.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:22.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:22.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:22.938 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:22.939 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:22.939 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: Adjusting osd_memory_target on smithi098 to 3946M 2024-09-13T02:47:22.939 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:22.939 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:22.939 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:22.939 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:22.939 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:22 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:23.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56192]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:47:23.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56192]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:23.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56192]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:23.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56192]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:23.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:23 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T02:47:23.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:23 smithi142 ceph-mon[33443]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T02:47:23.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:23 smithi142 ceph-mon[33443]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:23.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:23 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:47:23.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:23 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:47:23.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:23 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:23.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:23 smithi142 ceph-mon[33443]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:23.925 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56293]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:47:23.926 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:23.926 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56293]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:23.926 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56293]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:23.926 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:23 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T02:47:23.926 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:23 smithi098 ceph-mon[27886]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T02:47:23.926 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:23 smithi098 ceph-mon[27886]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:23.926 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:23 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:47:23.926 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:23 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:47:23.927 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:23 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:23.927 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:23 smithi098 ceph-mon[27886]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:24.184 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56316]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:47:24.184 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56316]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:24.184 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56316]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:24.184 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:47:23 smithi098 sudo[56316]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:24.443 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56322]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:47:24.443 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56322]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:24.443 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56322]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:24.443 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56322]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:24.706 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:24 smithi098 ceph-mon[27886]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T02:47:24.706 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:24 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:24.706 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56370]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:47:24.706 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56370]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:24.706 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56370]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:24.706 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56370]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:24.865 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:24 smithi142 ceph-mon[33443]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T02:47:24.865 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:24 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:24.956 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56397]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:47:24.956 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56397]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:24.956 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56397]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:24.956 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56397]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:25.221 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56400]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:47:25.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56400]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:25.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56400]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:25.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:24 smithi098 sudo[56400]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:25.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 sudo[56447]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:47:25.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 sudo[56447]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:25.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 sudo[56447]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:25.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 sudo[56447]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:25.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 sudo[37208]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:47:25.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 sudo[37208]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:25.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 sudo[37208]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:25.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 sudo[37208]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:25.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:25.737+0000 7f1d8f7fe700 1 -- 172.21.15.142:0/2180152762 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1d94057630 con 0x7f1da01003f0 2024-09-13T02:47:26.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 sudo[37211]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 sudo[37211]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 sudo[37211]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 sudo[37211]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='client.? 172.21.15.142:0/3510939132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c435dee9-b72b-4e78-a776-3dd6389cc070"}]: dispatch 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c435dee9-b72b-4e78-a776-3dd6389cc070"}]: dispatch 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c435dee9-b72b-4e78-a776-3dd6389cc070"}]': finished 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:47:26.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:25 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:47:26.014 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:47:26.014 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:26.014 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/3510939132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c435dee9-b72b-4e78-a776-3dd6389cc070"}]: dispatch 2024-09-13T02:47:26.014 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:47:26.014 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:47:26.015 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c435dee9-b72b-4e78-a776-3dd6389cc070"}]: dispatch 2024-09-13T02:47:26.015 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:47:26.015 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c435dee9-b72b-4e78-a776-3dd6389cc070"}]': finished 2024-09-13T02:47:26.015 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T02:47:26.015 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:26.015 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:47:26.015 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:25 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:47:27.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:26 smithi098 ceph-mon[27886]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:47:27.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:26 smithi098 ceph-mon[27886]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:47:27.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:26 smithi098 ceph-mon[27886]: mgrmap e19: smithi098.ukgenf(active, since 2m), standbys: smithi142.jutrvi 2024-09-13T02:47:27.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:26 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:27.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:26 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/3443230050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:47:27.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:26 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:27.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:26 smithi142 ceph-mon[33443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:47:27.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:26 smithi142 ceph-mon[33443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:47:27.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:26 smithi142 ceph-mon[33443]: mgrmap e19: smithi098.ukgenf(active, since 2m), standbys: smithi142.jutrvi 2024-09-13T02:47:27.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:26 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:27.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:26 smithi142 ceph-mon[33443]: from='client.? 172.21.15.142:0/3443230050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:47:27.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:26 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:27.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:27.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:27 smithi098 ceph-mon[27886]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:27.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:27.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:27.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:27 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:27 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:27 smithi142 ceph-mon[33443]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:27 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:27 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:27 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:29.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:29 smithi098 ceph-mon[27886]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:30.124 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:29 smithi142 ceph-mon[33443]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:31 smithi098 ceph-mon[27886]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:31 smithi142 ceph-mon[33443]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:33.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:33 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:47:33.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:33 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:33.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:33 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:47:33.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:33 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:34.420 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:34 smithi142 ceph-mon[33443]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:34.421 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:34 smithi142 ceph-mon[33443]: Deploying daemon osd.3 on smithi142 2024-09-13T02:47:34.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:34 smithi098 ceph-mon[27886]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:34.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:34 smithi098 ceph-mon[27886]: Deploying daemon osd.3 on smithi142 2024-09-13T02:47:35.478 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:35.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:36.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:36 smithi098 ceph-mon[27886]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:36.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:36 smithi142 ceph-mon[33443]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:38.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:38 smithi098 ceph-mon[27886]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:38.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:38.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:38.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:38.485 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:38 smithi142 ceph-mon[33443]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:38.485 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:38.485 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:38.485 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:40.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:40 smithi098 ceph-mon[27886]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:40.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:40 smithi142 ceph-mon[33443]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:41.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.838+0000 7f1d8f7fe700 1 -- 172.21.15.142:0/2180152762 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1da0104e40 con 0x7f1d8806c600 2024-09-13T02:47:41.840 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 3 on host 'smithi142' 2024-09-13T02:47:41.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1d8806c600 msgr2=0x7f1d8806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:41.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1d8806c600 0x7f1d8806eab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d90005950 tx=0x7f1d9000a300 comp rx=0 tx=0).stop 2024-09-13T02:47:41.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 msgr2=0x7f1da019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 0x7f1da019aaf0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1d94006010 tx=0x7f1d9400bd70 comp rx=0 tx=0).stop 2024-09-13T02:47:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 shutdown_connections 2024-09-13T02:47:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f1d8806c600 0x7f1d8806eab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1da00ff150 0x7f1da0069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 --2- 172.21.15.142:0/2180152762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da01003f0 0x7f1da019aaf0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 >> 172.21.15.142:0/2180152762 conn(0x7f1da00fa7a0 msgr2=0x7f1da01036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 shutdown_connections 2024-09-13T02:47:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:41.841+0000 7f1da4d0c700 1 -- 172.21.15.142:0/2180152762 wait complete. 2024-09-13T02:47:42.150 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:42.150 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.150 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.150 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:42.150 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:42.150 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.150 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.150 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.151 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:42.151 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='osd.3 [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:47:42.151 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:41 smithi142 ceph-mon[33443]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='osd.3 [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:47:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:41 smithi098 ceph-mon[27886]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:47:42.454 DEBUG:teuthology.orchestra.run.smithi142:osd.3> sudo journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T02:47:42.456 INFO:tasks.cephadm:Deploying osd.4 on smithi142 with /dev/vg_nvme/lv_3... 2024-09-13T02:47:42.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T02:47:43.902 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:43 smithi142 ceph-mon[33443]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:47:43.902 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:43 smithi142 ceph-mon[33443]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T02:47:43.902 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:43 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:43.902 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:43 smithi142 ceph-mon[33443]: from='osd.3 [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:47:43.902 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:43 smithi142 ceph-mon[33443]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:47:43.902 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:43 smithi142 ceph-mon[33443]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:43.903 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:47:43 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[39284]: 2024-09-13T02:47:43.808+0000 7f853b7fd700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T02:47:43.903 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:47:43 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[39284]: 2024-09-13T02:47:43.813+0000 7f8537df3700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:47:44.100 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi142/config 2024-09-13T02:47:44.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:43 smithi098 ceph-mon[27886]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:47:44.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:43 smithi098 ceph-mon[27886]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T02:47:44.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:43 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:44.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:43 smithi098 ceph-mon[27886]: from='osd.3 [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:47:44.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:43 smithi098 ceph-mon[27886]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:47:44.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:43 smithi098 ceph-mon[27886]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T02:47:45.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:44 smithi142 ceph-mon[33443]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-13T02:47:45.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:44 smithi142 ceph-mon[33443]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T02:47:45.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:44 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:45.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:44 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:45.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:44 smithi142 ceph-mon[33443]: osd.3 [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] boot 2024-09-13T02:47:45.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:44 smithi142 ceph-mon[33443]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T02:47:45.174 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:44 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:45.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:44 smithi098 ceph-mon[27886]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-13T02:47:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:44 smithi098 ceph-mon[27886]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T02:47:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:44 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:44 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:44 smithi098 ceph-mon[27886]: osd.3 [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] boot 2024-09-13T02:47:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:44 smithi098 ceph-mon[27886]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T02:47:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:44 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:47:45.919 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: purged_snaps scrub starts 2024-09-13T02:47:45.919 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: purged_snaps scrub ok 2024-09-13T02:47:45.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:47:45.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:45.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:45.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:45.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:45.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:45.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:45.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:45.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:45 smithi142 ceph-mon[33443]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T02:47:46.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: purged_snaps scrub starts 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: purged_snaps scrub ok 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:47:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:45 smithi098 ceph-mon[27886]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T02:47:47.042 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:46 smithi142 ceph-mon[33443]: Detected new or changed devices on smithi142 2024-09-13T02:47:47.042 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:46 smithi142 ceph-mon[33443]: Adjusting osd_memory_target on smithi142 to 14912M 2024-09-13T02:47:47.042 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:46 smithi142 ceph-mon[33443]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T02:47:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:47:47.065 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi142:vg_nvme/lv_3 2024-09-13T02:47:47.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:46 smithi098 ceph-mon[27886]: Detected new or changed devices on smithi142 2024-09-13T02:47:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:46 smithi098 ceph-mon[27886]: Adjusting osd_memory_target on smithi142 to 14912M 2024-09-13T02:47:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:46 smithi098 ceph-mon[27886]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T02:47:47.265 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi142/config 2024-09-13T02:47:48.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:48 smithi142 ceph-mon[33443]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:47:48.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:48 smithi142 ceph-mon[33443]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T02:47:48.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:48 smithi098 ceph-mon[27886]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:47:48.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:48 smithi098 ceph-mon[27886]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T02:47:48.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.770+0000 7fb73256f700 1 -- 172.21.15.142:0/2715113175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb72c103330 msgr2=0x7fb72c105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:48.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.770+0000 7fb73256f700 1 --2- 172.21.15.142:0/2715113175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb72c103330 0x7fb72c105790 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb720009910 tx=0x7fb720009c20 comp rx=0 tx=0).stop 2024-09-13T02:47:48.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.770+0000 7fb73256f700 1 -- 172.21.15.142:0/2715113175 shutdown_connections 2024-09-13T02:47:48.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.770+0000 7fb73256f700 1 --2- 172.21.15.142:0/2715113175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb72c103330 0x7fb72c105790 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:48.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.770+0000 7fb73256f700 1 --2- 172.21.15.142:0/2715113175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb72c069250 0x7fb72c102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.770+0000 7fb73256f700 1 -- 172.21.15.142:0/2715113175 >> 172.21.15.142:0/2715113175 conn(0x7fb72c0fa780 msgr2=0x7fb72c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.770+0000 7fb73256f700 1 -- 172.21.15.142:0/2715113175 shutdown_connections 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.770+0000 7fb73256f700 1 -- 172.21.15.142:0/2715113175 wait complete. 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.770+0000 7fb73256f700 1 Processor -- start 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb73256f700 1 -- start start 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb73256f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb72c069250 0x7fb72c195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb73256f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb72c103330 0x7fb72c196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb73256f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c196650 con 0x7fb72c103330 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb73256f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c196790 con 0x7fb72c069250 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb72b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb72c103330 0x7fb72c196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb72b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb72c103330 0x7fb72c196030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.142:42586/0 (socket says 172.21.15.142:42586) 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb72b7fe700 1 -- 172.21.15.142:0/3942353516 learned_addr learned my addr 172.21.15.142:0/3942353516 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:47:48.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb72bfff700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb72c069250 0x7fb72c195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb72bfff700 1 -- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb72c103330 msgr2=0x7fb72c196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb72bfff700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb72c103330 0x7fb72c196030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb72bfff700 1 -- 172.21.15.142:0/3942353516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200095f0 con 0x7fb72c069250 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.771+0000 7fb72b7fe700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb72c103330 0x7fb72c196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.772+0000 7fb72bfff700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb72c069250 0x7fb72c195af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb72c068f80 tx=0x7fb71c00d980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.772+0000 7fb7297fa700 1 -- 172.21.15.142:0/3942353516 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb71c0041f0 con 0x7fb72c069250 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.772+0000 7fb7297fa700 1 -- 172.21.15.142:0/3942353516 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb71c004ce0 con 0x7fb72c069250 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.772+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72c19b240 con 0x7fb72c069250 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.772+0000 7fb7297fa700 1 -- 172.21.15.142:0/3942353516 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb71c00f690 con 0x7fb72c069250 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.772+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c19b790 con 0x7fb72c069250 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.773+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72c18fc10 con 0x7fb72c069250 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.773+0000 7fb7297fa700 1 -- 172.21.15.142:0/3942353516 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb71c004350 con 0x7fb72c069250 2024-09-13T02:47:48.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.774+0000 7fb7297fa700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb71406c680 0x7fb71406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:48.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.774+0000 7fb7297fa700 1 -- 172.21.15.142:0/3942353516 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3602+0+0 (secure 0 0 0) 0x7fb71c08ac60 con 0x7fb72c069250 2024-09-13T02:47:48.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.774+0000 7fb72b7fe700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb71406c680 0x7fb71406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:48.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.774+0000 7fb72b7fe700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb71406c680 0x7fb71406eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb720006010 tx=0x7fb72000b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:48.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.778+0000 7fb7297fa700 1 -- 172.21.15.142:0/3942353516 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb71c059510 con 0x7fb72c069250 2024-09-13T02:47:48.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:47:48.976+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb72c061190 con 0x7fb71406c680 2024-09-13T02:47:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:49 smithi142 ceph-mon[33443]: osdmap e31: 4 total, 4 up, 4 in 2024-09-13T02:47:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:49 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:47:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:49 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:47:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:49 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:49.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:49 smithi098 ceph-mon[27886]: osdmap e31: 4 total, 4 up, 4 in 2024-09-13T02:47:49.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:49 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:47:49.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:49 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:47:49.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:49 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:50 smithi098 ceph-mon[27886]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:47:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:50 smithi098 ceph-mon[27886]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:50.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:50 smithi142 ceph-mon[33443]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:47:50.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:50 smithi142 ceph-mon[33443]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:50.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:52.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:52 smithi098 ceph-mon[27886]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:47:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:52 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/802849280' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ddffc4c-ab6b-45d7-8bd2-df32ac88e84a"}]: dispatch 2024-09-13T02:47:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:52 smithi098 ceph-mon[27886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ddffc4c-ab6b-45d7-8bd2-df32ac88e84a"}]: dispatch 2024-09-13T02:47:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:52 smithi098 ceph-mon[27886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ddffc4c-ab6b-45d7-8bd2-df32ac88e84a"}]': finished 2024-09-13T02:47:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:52 smithi098 ceph-mon[27886]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T02:47:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:52 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:47:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:52 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/2918218558' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:47:52.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:52 smithi142 ceph-mon[33443]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:47:52.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:52 smithi142 ceph-mon[33443]: from='client.? 172.21.15.142:0/802849280' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ddffc4c-ab6b-45d7-8bd2-df32ac88e84a"}]: dispatch 2024-09-13T02:47:52.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:52 smithi142 ceph-mon[33443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ddffc4c-ab6b-45d7-8bd2-df32ac88e84a"}]: dispatch 2024-09-13T02:47:52.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:52 smithi142 ceph-mon[33443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ddffc4c-ab6b-45d7-8bd2-df32ac88e84a"}]': finished 2024-09-13T02:47:52.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:52 smithi142 ceph-mon[33443]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T02:47:52.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:52 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:47:52.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:52 smithi142 ceph-mon[33443]: from='client.? 172.21.15.142:0/2918218558' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:47:54.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:54 smithi098 ceph-mon[27886]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T02:47:54.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:54 smithi142 ceph-mon[33443]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T02:47:56.542 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:56 smithi142 ceph-mon[33443]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-13T02:47:56.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:56 smithi098 ceph-mon[27886]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-13T02:47:58.369 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:58 smithi142 ceph-mon[33443]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-13T02:47:58.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:58 smithi098 ceph-mon[27886]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-13T02:47:59.422 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:59 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:47:59.422 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:47:59 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:59.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:59 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:47:59.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:47:59 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:00.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:00 smithi142 ceph-mon[33443]: Deploying daemon osd.4 on smithi142 2024-09-13T02:48:00.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:00 smithi142 ceph-mon[33443]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T02:48:00.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:00 smithi098 ceph-mon[27886]: Deploying daemon osd.4 on smithi142 2024-09-13T02:48:00.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:00 smithi098 ceph-mon[27886]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T02:48:02.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:02 smithi142 ceph-mon[33443]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T02:48:02.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:02 smithi098 ceph-mon[27886]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T02:48:04.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:04 smithi142 ceph-mon[33443]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:48:04.570 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:04 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:04.570 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:04 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:04.570 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:04 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:04.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:04 smithi098 ceph-mon[27886]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:48:04.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:04.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:04.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:05.545 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:05 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:05.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:06.656 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:06 smithi142 ceph-mon[33443]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:48:06.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:06 smithi098 ceph-mon[27886]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:48:07.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.689+0000 7fb7297fa700 1 -- 172.21.15.142:0/3942353516 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb72c061190 con 0x7fb71406c680 2024-09-13T02:48:07.691 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 4 on host 'smithi142' 2024-09-13T02:48:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.691+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb71406c680 msgr2=0x7fb71406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.691+0000 7fb73256f700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb71406c680 0x7fb71406eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb720006010 tx=0x7fb72000b540 comp rx=0 tx=0).stop 2024-09-13T02:48:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.691+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb72c069250 msgr2=0x7fb72c195af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.691+0000 7fb73256f700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb72c069250 0x7fb72c195af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb72c068f80 tx=0x7fb71c00d980 comp rx=0 tx=0).stop 2024-09-13T02:48:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.692+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 shutdown_connections 2024-09-13T02:48:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.692+0000 7fb73256f700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb71406c680 0x7fb71406eb30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.692+0000 7fb73256f700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb72c069250 0x7fb72c195af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:07.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.692+0000 7fb73256f700 1 --2- 172.21.15.142:0/3942353516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb72c103330 0x7fb72c196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:07.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.692+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 >> 172.21.15.142:0/3942353516 conn(0x7fb72c0fa780 msgr2=0x7fb72c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:07.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.692+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 shutdown_connections 2024-09-13T02:48:07.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:07.692+0000 7fb73256f700 1 -- 172.21.15.142:0/3942353516 wait complete. 2024-09-13T02:48:08.322 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:08 smithi142 ceph-mon[33443]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:48:08.322 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:08.322 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:08.322 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:08 smithi142 ceph-mon[33443]: from='osd.4 [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:48:08.322 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:08 smithi142 ceph-mon[33443]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:48:08.343 DEBUG:teuthology.orchestra.run.smithi142:osd.4> sudo journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T02:48:08.346 INFO:tasks.cephadm:Deploying osd.5 on smithi142 with /dev/vg_nvme/lv_2... 2024-09-13T02:48:08.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T02:48:08.589 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi142/config 2024-09-13T02:48:08.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:08 smithi098 ceph-mon[27886]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:48:09.029 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:09.029 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:09.029 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:08 smithi098 ceph-mon[27886]: from='osd.4 [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:48:09.029 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:08 smithi098 ceph-mon[27886]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:48:09.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:09.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:09.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-mon[33443]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T02:48:09.663 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-mon[33443]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T02:48:09.663 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:48:09.663 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-mon[33443]: from='osd.4 [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:48:09.663 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-mon[33443]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:48:09.663 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-mon[33443]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:48:09.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:09 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:09.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:09 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:09.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:09 smithi098 ceph-mon[27886]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T02:48:09.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:09 smithi098 ceph-mon[27886]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T02:48:09.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:09 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:48:09.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:09 smithi098 ceph-mon[27886]: from='osd.4 [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:48:09.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:09 smithi098 ceph-mon[27886]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:48:09.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:09 smithi098 ceph-mon[27886]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T02:48:09.994 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[43929]: 2024-09-13T02:48:09.681+0000 7fb088abe700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T02:48:09.994 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 02:48:09 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[43929]: 2024-09-13T02:48:09.691+0000 7fb0850b4700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:48:10.970 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:10 smithi142 ceph-mon[33443]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-13T02:48:10.970 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:10 smithi142 ceph-mon[33443]: osdmap e34: 5 total, 4 up, 5 in 2024-09-13T02:48:10.971 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:48:10.971 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:48:10.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:10 smithi098 ceph-mon[27886]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-13T02:48:10.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:10 smithi098 ceph-mon[27886]: osdmap e34: 5 total, 4 up, 5 in 2024-09-13T02:48:10.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:48:10.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:48:11.966 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:11 smithi142 ceph-mon[33443]: purged_snaps scrub starts 2024-09-13T02:48:11.966 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:11 smithi142 ceph-mon[33443]: purged_snaps scrub ok 2024-09-13T02:48:11.967 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:11 smithi142 ceph-mon[33443]: osd.4 [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] boot 2024-09-13T02:48:11.967 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:11 smithi142 ceph-mon[33443]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T02:48:11.967 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:11 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:48:11.967 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:11 smithi142 ceph-mon[33443]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:11.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:11 smithi098 ceph-mon[27886]: purged_snaps scrub starts 2024-09-13T02:48:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:11 smithi098 ceph-mon[27886]: purged_snaps scrub ok 2024-09-13T02:48:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:11 smithi098 ceph-mon[27886]: osd.4 [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] boot 2024-09-13T02:48:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:11 smithi098 ceph-mon[27886]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T02:48:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:11 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:48:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:11 smithi098 ceph-mon[27886]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:12.212 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-13T02:48:12.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi142:vg_nvme/lv_2 2024-09-13T02:48:12.749 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi142/config 2024-09-13T02:48:12.870 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:12 smithi142 ceph-mon[33443]: osdmap e36: 5 total, 5 up, 5 in 2024-09-13T02:48:12.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:12 smithi098 ceph-mon[27886]: osdmap e36: 5 total, 5 up, 5 in 2024-09-13T02:48:13.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:13 smithi098 ceph-mon[27886]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:13.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:13.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:13.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:13.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:13.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:13.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:13.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:13 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:14.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:13 smithi142 ceph-mon[33443]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:13 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:14.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.953+0000 7f4acaa79700 1 -- 172.21.15.142:0/2931415045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 msgr2=0x7f4ac40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:14.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.953+0000 7f4acaa79700 1 --2- 172.21.15.142:0/2931415045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 0x7f4ac40ff540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009910 tx=0x7f4ab8009c20 comp rx=0 tx=0).stop 2024-09-13T02:48:14.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.953+0000 7f4acaa79700 1 -- 172.21.15.142:0/2931415045 shutdown_connections 2024-09-13T02:48:14.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.953+0000 7f4acaa79700 1 --2- 172.21.15.142:0/2931415045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ac41003d0 0x7f4ac4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:14.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.953+0000 7f4acaa79700 1 --2- 172.21.15.142:0/2931415045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 0x7f4ac40ff540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:14.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.953+0000 7f4acaa79700 1 -- 172.21.15.142:0/2931415045 >> 172.21.15.142:0/2931415045 conn(0x7f4ac40fa780 msgr2=0x7f4ac40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:14.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.953+0000 7f4acaa79700 1 -- 172.21.15.142:0/2931415045 shutdown_connections 2024-09-13T02:48:14.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.953+0000 7f4acaa79700 1 -- 172.21.15.142:0/2931415045 wait complete. 2024-09-13T02:48:14.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4acaa79700 1 Processor -- start 2024-09-13T02:48:14.956 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:14 smithi142 ceph-mon[33443]: Detected new or changed devices on smithi142 2024-09-13T02:48:14.956 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:14 smithi142 ceph-mon[33443]: Adjusting osd_memory_target on smithi142 to 7456M 2024-09-13T02:48:14.956 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:14.956 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:14.956 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:14.956 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:14.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4acaa79700 1 -- start start 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4acaa79700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 0x7f4ac4103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4acaa79700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ac41003d0 0x7f4ac41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4acaa79700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4101cf0 con 0x7f4ac41003d0 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4acaa79700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4101e30 con 0x7f4ac40ff130 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4ac8815700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 0x7f4ac4103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4ac8815700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 0x7f4ac4103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43482/0 (socket says 172.21.15.142:43482) 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4ac8815700 1 -- 172.21.15.142:0/4091917022 learned_addr learned my addr 172.21.15.142:0/4091917022 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4ac3fff700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ac41003d0 0x7f4ac41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:14.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4ac8815700 1 -- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ac41003d0 msgr2=0x7f4ac41017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4ac8815700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ac41003d0 0x7f4ac41017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.954+0000 7f4ac8815700 1 -- 172.21.15.142:0/4091917022 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80095f0 con 0x7f4ac40ff130 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.955+0000 7f4ac8815700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 0x7f4ac4103160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8006010 tx=0x7f4ab800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.955+0000 7f4ac1ffb700 1 -- 172.21.15.142:0/4091917022 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab801d070 con 0x7f4ac40ff130 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.955+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac41020b0 con 0x7f4ac40ff130 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.955+0000 7f4ac1ffb700 1 -- 172.21.15.142:0/4091917022 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ab800f460 con 0x7f4ac40ff130 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.955+0000 7f4ac1ffb700 1 -- 172.21.15.142:0/4091917022 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab8021640 con 0x7f4ac40ff130 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.955+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac41025a0 con 0x7f4ac40ff130 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.956+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac4107c90 con 0x7f4ac40ff130 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.957+0000 7f4ac1ffb700 1 -- 172.21.15.142:0/4091917022 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4ab800fab0 con 0x7f4ac40ff130 2024-09-13T02:48:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.957+0000 7f4ac1ffb700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4ab406c680 0x7f4ab406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:14.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.957+0000 7f4ac1ffb700 1 -- 172.21.15.142:0/4091917022 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4034+0+0 (secure 0 0 0) 0x7f4ab808caf0 con 0x7f4ac40ff130 2024-09-13T02:48:14.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.957+0000 7f4ac3fff700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4ab406c680 0x7f4ab406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:14.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.958+0000 7f4ac3fff700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4ab406c680 0x7f4ab406eb30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0006fd0 tx=0x7f4ab0008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:14.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:14.961+0000 7f4ac1ffb700 1 -- 172.21.15.142:0/4091917022 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4ab805b310 con 0x7f4ac40ff130 2024-09-13T02:48:14.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:14 smithi098 ceph-mon[27886]: Detected new or changed devices on smithi142 2024-09-13T02:48:14.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:14 smithi098 ceph-mon[27886]: Adjusting osd_memory_target on smithi142 to 7456M 2024-09-13T02:48:14.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:14.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:14.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:14.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:14.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:15.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:15.165+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ac419dfe0 con 0x7f4ab406c680 2024-09-13T02:48:15.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:15 smithi142 ceph-mon[33443]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:15.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:15 smithi142 ceph-mon[33443]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:15.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:15 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:48:15.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:15 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:48:15.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:15 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:15.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:15 smithi098 ceph-mon[27886]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:15 smithi098 ceph-mon[27886]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:48:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:48:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:15 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:18 smithi098 ceph-mon[27886]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:18 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/2281131447' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31f66bd8-23e2-46b3-8954-3f0fe8ea329c"}]: dispatch 2024-09-13T02:48:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:18 smithi098 ceph-mon[27886]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31f66bd8-23e2-46b3-8954-3f0fe8ea329c"}]: dispatch 2024-09-13T02:48:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:18 smithi098 ceph-mon[27886]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31f66bd8-23e2-46b3-8954-3f0fe8ea329c"}]': finished 2024-09-13T02:48:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:18 smithi098 ceph-mon[27886]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T02:48:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:18 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/3358895782' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:48:18.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:18 smithi142 ceph-mon[33443]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:18 smithi142 ceph-mon[33443]: from='client.? 172.21.15.142:0/2281131447' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31f66bd8-23e2-46b3-8954-3f0fe8ea329c"}]: dispatch 2024-09-13T02:48:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:18 smithi142 ceph-mon[33443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31f66bd8-23e2-46b3-8954-3f0fe8ea329c"}]: dispatch 2024-09-13T02:48:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:18 smithi142 ceph-mon[33443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31f66bd8-23e2-46b3-8954-3f0fe8ea329c"}]': finished 2024-09-13T02:48:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:18 smithi142 ceph-mon[33443]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T02:48:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:18 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:18.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:18 smithi142 ceph-mon[33443]: from='client.? 172.21.15.142:0/3358895782' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:48:20.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:20 smithi098 ceph-mon[27886]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:20.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:20 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:20.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:20 smithi142 ceph-mon[33443]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:20.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:20 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:22.481 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:22 smithi142 ceph-mon[33443]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:22.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:22 smithi098 ceph-mon[27886]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:24.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:24 smithi142 ceph-mon[33443]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:24.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:24 smithi098 ceph-mon[27886]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:25.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:25 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:48:25.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:25 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:25.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:25 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:48:25.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:25 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:26.468 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:26 smithi142 ceph-mon[33443]: Deploying daemon osd.5 on smithi142 2024-09-13T02:48:26.468 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:26 smithi142 ceph-mon[33443]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:26.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:26 smithi098 ceph-mon[27886]: Deploying daemon osd.5 on smithi142 2024-09-13T02:48:26.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:26 smithi098 ceph-mon[27886]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:28.413 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:28 smithi142 ceph-mon[33443]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:28.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:28 smithi098 ceph-mon[27886]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:30.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:30 smithi142 ceph-mon[33443]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:30.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:30.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:30.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:30 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:30.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:30 smithi098 ceph-mon[27886]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:30.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:30.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:30.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:30 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:32.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:32 smithi142 ceph-mon[33443]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:32.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:32 smithi098 ceph-mon[27886]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:33.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.129+0000 7f4ac1ffb700 1 -- 172.21.15.142:0/4091917022 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4ac419dfe0 con 0x7f4ab406c680 2024-09-13T02:48:33.131 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 5 on host 'smithi142' 2024-09-13T02:48:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4ab406c680 msgr2=0x7f4ab406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4ab406c680 0x7f4ab406eb30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0006fd0 tx=0x7f4ab0008040 comp rx=0 tx=0).stop 2024-09-13T02:48:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 msgr2=0x7f4ac4103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 0x7f4ac4103160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8006010 tx=0x7f4ab800be20 comp rx=0 tx=0).stop 2024-09-13T02:48:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 shutdown_connections 2024-09-13T02:48:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f4ab406c680 0x7f4ab406eb30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ac40ff130 0x7f4ac4103160 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 --2- 172.21.15.142:0/4091917022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ac41003d0 0x7f4ac41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 >> 172.21.15.142:0/4091917022 conn(0x7f4ac40fa780 msgr2=0x7f4ac4068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 shutdown_connections 2024-09-13T02:48:33.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:33.131+0000 7f4acaa79700 1 -- 172.21.15.142:0/4091917022 wait complete. 2024-09-13T02:48:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:34 smithi142 ceph-mon[33443]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:34 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:34 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:34 smithi142 ceph-mon[33443]: from='osd.5 [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:48:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:34 smithi142 ceph-mon[33443]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:48:34.286 DEBUG:teuthology.orchestra.run.smithi142:osd.5> sudo journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T02:48:34.288 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T02:48:34.289 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T02:48:34.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:34 smithi098 ceph-mon[27886]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:34.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:34 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:34.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:34 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:34.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:34 smithi098 ceph-mon[27886]: from='osd.5 [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:48:34.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:34 smithi098 ceph-mon[27886]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:48:34.506 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:35.460 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[48554]: 2024-09-13T02:48:35.251+0000 7f10c9fba700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T02:48:35.460 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[48554]: 2024-09-13T02:48:35.259+0000 7f10c65b0700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:48:35.461 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-mon[33443]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T02:48:35.461 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-mon[33443]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T02:48:35.461 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:35.461 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-mon[33443]: from='osd.5 [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:48:35.461 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-mon[33443]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:48:35.461 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:35.461 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:35.462 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:35.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:35 smithi098 ceph-mon[27886]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T02:48:35.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:35 smithi098 ceph-mon[27886]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T02:48:35.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:35.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:35 smithi098 ceph-mon[27886]: from='osd.5 [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:48:35.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:35 smithi098 ceph-mon[27886]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:48:35.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:35.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:35.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:36.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.177+0000 7f10c966f700 1 -- 172.21.15.98:0/2332614532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c4100750 msgr2=0x7f10c4100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:36.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.177+0000 7f10c966f700 1 --2- 172.21.15.98:0/2332614532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c4100750 0x7f10c4100b60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009910 tx=0x7f10b8009c20 comp rx=0 tx=0).stop 2024-09-13T02:48:36.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.177+0000 7f10c966f700 1 -- 172.21.15.98:0/2332614532 shutdown_connections 2024-09-13T02:48:36.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.177+0000 7f10c966f700 1 --2- 172.21.15.98:0/2332614532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c40ff3b0 0x7f10c40ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.177+0000 7f10c966f700 1 --2- 172.21.15.98:0/2332614532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c4100750 0x7f10c4100b60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.177+0000 7f10c966f700 1 -- 172.21.15.98:0/2332614532 >> 172.21.15.98:0/2332614532 conn(0x7f10c40f9e50 msgr2=0x7f10c40fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:36.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.177+0000 7f10c966f700 1 -- 172.21.15.98:0/2332614532 shutdown_connections 2024-09-13T02:48:36.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.177+0000 7f10c966f700 1 -- 172.21.15.98:0/2332614532 wait complete. 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c966f700 1 Processor -- start 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c966f700 1 -- start start 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c966f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c40ff3b0 0x7f10c40fee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c966f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c4100750 0x7f10c419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c966f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c419aeb0 con 0x7f10c40ff3b0 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c966f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c419aff0 con 0x7f10c4100750 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c40ff3b0 0x7f10c40fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c40ff3b0 0x7f10c40fee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47884/0 (socket says 172.21.15.98:47884) 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c2ffd700 1 -- 172.21.15.98:0/3692467980 learned_addr learned my addr 172.21.15.98:0/3692467980 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c2ffd700 1 -- 172.21.15.98:0/3692467980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c4100750 msgr2=0x7f10c419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c27fc700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c4100750 0x7f10c419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c2ffd700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c4100750 0x7f10c419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c2ffd700 1 -- 172.21.15.98:0/3692467980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b80095f0 con 0x7f10c40ff3b0 2024-09-13T02:48:36.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.178+0000 7f10c27fc700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c4100750 0x7f10c419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:48:36.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.179+0000 7f10c2ffd700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c40ff3b0 0x7f10c40fee60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f10b800bda0 tx=0x7f10b800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:36.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.179+0000 7f10abfff700 1 -- 172.21.15.98:0/3692467980 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b801d070 con 0x7f10c40ff3b0 2024-09-13T02:48:36.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.179+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c419b270 con 0x7f10c40ff3b0 2024-09-13T02:48:36.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.179+0000 7f10abfff700 1 -- 172.21.15.98:0/3692467980 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f10b8004c50 con 0x7f10c40ff3b0 2024-09-13T02:48:36.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.179+0000 7f10abfff700 1 -- 172.21.15.98:0/3692467980 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b800f690 con 0x7f10c40ff3b0 2024-09-13T02:48:36.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.179+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c419b760 con 0x7f10c40ff3b0 2024-09-13T02:48:36.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.180+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c4107d20 con 0x7f10c40ff3b0 2024-09-13T02:48:36.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.180+0000 7f10abfff700 1 -- 172.21.15.98:0/3692467980 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f10b800f810 con 0x7f10c40ff3b0 2024-09-13T02:48:36.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.181+0000 7f10abfff700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f10ac06c680 0x7f10ac06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:36.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.181+0000 7f10abfff700 1 -- 172.21.15.98:0/3692467980 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4186+0+0 (secure 0 0 0) 0x7f10b808cae0 con 0x7f10c40ff3b0 2024-09-13T02:48:36.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.181+0000 7f10c27fc700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f10ac06c680 0x7f10ac06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:36.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.181+0000 7f10c27fc700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f10ac06c680 0x7f10ac06eb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10b4007900 tx=0x7f10b4008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:36.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.185+0000 7f10abfff700 1 -- 172.21.15.98:0/3692467980 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f10b805b200 con 0x7f10c40ff3b0 2024-09-13T02:48:36.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.383+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f10c419bda0 con 0x7f10c40ff3b0 2024-09-13T02:48:36.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.383+0000 7f10abfff700 1 -- 172.21.15.98:0/3692467980 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f10b80270a0 con 0x7f10c40ff3b0 2024-09-13T02:48:36.385 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:48:36.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f10ac06c680 msgr2=0x7f10ac06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:36.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f10ac06c680 0x7f10ac06eb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10b4007900 tx=0x7f10b4008040 comp rx=0 tx=0).stop 2024-09-13T02:48:36.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c40ff3b0 msgr2=0x7f10c40fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:36.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c40ff3b0 0x7f10c40fee60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f10b800bda0 tx=0x7f10b800be80 comp rx=0 tx=0).stop 2024-09-13T02:48:36.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 shutdown_connections 2024-09-13T02:48:36.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f10ac06c680 0x7f10ac06eb30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10c40ff3b0 0x7f10c40fee60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 --2- 172.21.15.98:0/3692467980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c4100750 0x7f10c419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 >> 172.21.15.98:0/3692467980 conn(0x7f10c40f9e50 msgr2=0x7f10c41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:36.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 shutdown_connections 2024-09-13T02:48:36.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:36.386+0000 7f10c966f700 1 -- 172.21.15.98:0/3692467980 wait complete. 2024-09-13T02:48:36.497 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:36 smithi098 ceph-mon[27886]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:36.497 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:36 smithi098 ceph-mon[27886]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-13T02:48:36.498 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:36 smithi098 ceph-mon[27886]: osdmap e39: 6 total, 5 up, 6 in 2024-09-13T02:48:36.498 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:36 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:36.498 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:36 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:36.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:36 smithi142 ceph-mon[33443]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:36.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:36 smithi142 ceph-mon[33443]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-13T02:48:36.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:36 smithi142 ceph-mon[33443]: osdmap e39: 6 total, 5 up, 6 in 2024-09-13T02:48:36.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:36 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:36.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:36 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:36.943 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726195716,"num_in_osds":6,"osd_in_since":1726195697,"num_remapped_pgs":0} 2024-09-13T02:48:36.944 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T02:48:37.151 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:37.346 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:37 smithi142 ceph-mon[33443]: purged_snaps scrub starts 2024-09-13T02:48:37.346 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:37 smithi142 ceph-mon[33443]: purged_snaps scrub ok 2024-09-13T02:48:37.346 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:37 smithi142 ceph-mon[33443]: osd.5 [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] boot 2024-09-13T02:48:37.346 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:37 smithi142 ceph-mon[33443]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T02:48:37.346 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:37 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:37.346 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:37 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3692467980' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:48:37.509 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:37 smithi098 ceph-mon[27886]: purged_snaps scrub starts 2024-09-13T02:48:37.509 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:37 smithi098 ceph-mon[27886]: purged_snaps scrub ok 2024-09-13T02:48:37.509 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:37 smithi098 ceph-mon[27886]: osd.5 [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] boot 2024-09-13T02:48:37.509 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:37 smithi098 ceph-mon[27886]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T02:48:37.509 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:37 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:48:37.509 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:37 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3692467980' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:48:38.602 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:38.602 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T02:48:38.602 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.602 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.602 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:38.602 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:38.602 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:38.602 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.603 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:38.603 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:38.603 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.603 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:38.603 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:38.603 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:38.603 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:38 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.703+0000 7ff4c6381700 1 -- 172.21.15.98:0/2126631763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ffd60 msgr2=0x7ff4c0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:38.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.703+0000 7ff4c6381700 1 --2- 172.21.15.98:0/2126631763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ffd60 0x7ff4c0103d30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009910 tx=0x7ff4b4009c20 comp rx=0 tx=0).stop 2024-09-13T02:48:38.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.703+0000 7ff4c6381700 1 -- 172.21.15.98:0/2126631763 shutdown_connections 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.703+0000 7ff4c6381700 1 --2- 172.21.15.98:0/2126631763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ffd60 0x7ff4c0103d30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.703+0000 7ff4c6381700 1 --2- 172.21.15.98:0/2126631763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c00ff3c0 0x7ff4c00ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.703+0000 7ff4c6381700 1 -- 172.21.15.98:0/2126631763 >> 172.21.15.98:0/2126631763 conn(0x7ff4c00fac60 msgr2=0x7ff4c00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.703+0000 7ff4c6381700 1 -- 172.21.15.98:0/2126631763 shutdown_connections 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.703+0000 7ff4c6381700 1 -- 172.21.15.98:0/2126631763 wait complete. 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4c6381700 1 Processor -- start 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4c6381700 1 -- start start 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4c6381700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ff3c0 0x7ff4c0195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4c6381700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c00ffd60 0x7ff4c0196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4c6381700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0196b50 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4c6381700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c019a8e0 con 0x7ff4c00ffd60 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4bffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ff3c0 0x7ff4c0195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4bffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ff3c0 0x7ff4c0195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47902/0 (socket says 172.21.15.98:47902) 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4bffff700 1 -- 172.21.15.98:0/4162198284 learned_addr learned my addr 172.21.15.98:0/4162198284 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.704+0000 7ff4bf7fe700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c00ffd60 0x7ff4c0196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.705+0000 7ff4bffff700 1 -- 172.21.15.98:0/4162198284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c00ffd60 msgr2=0x7ff4c0196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.705+0000 7ff4bffff700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c00ffd60 0x7ff4c0196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.705+0000 7ff4bffff700 1 -- 172.21.15.98:0/4162198284 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40095f0 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.705+0000 7ff4bffff700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ff3c0 0x7ff4c0195f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000d8d0 tx=0x7ff4b000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.705+0000 7ff4bd7fa700 1 -- 172.21.15.98:0/4162198284 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b00098a0 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.705+0000 7ff4bd7fa700 1 -- 172.21.15.98:0/4162198284 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff4b0010460 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.705+0000 7ff4bd7fa700 1 -- 172.21.15.98:0/4162198284 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b000f5f0 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.705+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c019abc0 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.705+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c019b110 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.706+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c004f2a0 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.707+0000 7ff4bd7fa700 1 -- 172.21.15.98:0/4162198284 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff4b0009a00 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.707+0000 7ff4bd7fa700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4a806c680 0x7ff4a806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:38.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.707+0000 7ff4bd7fa700 1 -- 172.21.15.98:0/4162198284 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ff4b008b380 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.707+0000 7ff4bf7fe700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4a806c680 0x7ff4a806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:38.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.707+0000 7ff4bf7fe700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4a806c680 0x7ff4a806eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0197550 tx=0x7ff4b401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:38.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.711+0000 7ff4bd7fa700 1 -- 172.21.15.98:0/4162198284 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff4b0055e40 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T02:48:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T02:48:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:38 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:48:38.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.901+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4c019b3d0 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.902+0000 7ff4bd7fa700 1 -- 172.21.15.98:0/4162198284 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11024 (secure 0 0 0) 0x7ff4b0059460 con 0x7ff4c00ff3c0 2024-09-13T02:48:38.904 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:48:38.904 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":41,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","created":"2024-09-13T02:42:56.881586+0000","modified":"2024-09-13T02:48:37.254064+0000","last_up_change":"2024-09-13T02:48:36.249061+0000","last_in_change":"2024-09-13T02:48:17.507975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T02:47:21.117522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"839bea7c-d0d5-4a63-9fbd-4bb3570e27f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6803","nonce":922771257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6805","nonce":922771257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6809","nonce":922771257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6807","nonce":922771257}]},"public_addr":"172.21.15.98:6803/922771257","cluster_addr":"172.21.15.98:6805/922771257","heartbeat_back_addr":"172.21.15.98:6809/922771257","heartbeat_front_addr":"172.21.15.98:6807/922771257","state":["exists","up"]},{"osd":1,"uuid":"20b7dd80-b8d0-4577-a86b-0e2e031e664a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6811","nonce":4064465963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6813","nonce":4064465963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6817","nonce":4064465963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6815","nonce":4064465963}]},"public_addr":"172.21.15.98:6811/4064465963","cluster_addr":"172.21.15.98:6813/4064465963","heartbeat_back_addr":"172.21.15.98:6817/4064465963","heartbeat_front_addr":"172.21.15.98:6815/4064465963","state":["exists","up"]},{"osd":2,"uuid":"3fe12d84-20a5-4109-b87a-037c8084682a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6819","nonce":14531122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6821","nonce":14531122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6825","nonce":14531122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6823","nonce":14531122}]},"public_addr":"172.21.15.98:6819/14531122","cluster_addr":"172.21.15.98:6821/14531122","heartbeat_back_addr":"172.21.15.98:6825/14531122","heartbeat_front_addr":"172.21.15.98:6823/14531122","state":["exists","up"]},{"osd":3,"uuid":"c435dee9-b72b-4e78-a776-3dd6389cc070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6801","nonce":1321061843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6803","nonce":1321061843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6807","nonce":1321061843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6805","nonce":1321061843}]},"public_addr":"172.21.15.142:6801/1321061843","cluster_addr":"172.21.15.142:6803/1321061843","heartbeat_back_addr":"172.21.15.142:6807/1321061843","heartbeat_front_addr":"172.21.15.142:6805/1321061843","state":["exists","up"]},{"osd":4,"uuid":"4ddffc4c-ab6b-45d7-8bd2-df32ac88e84a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6809","nonce":2471092963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6811","nonce":2471092963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6815","nonce":2471092963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6813","nonce":2471092963}]},"public_addr":"172.21.15.142:6809/2471092963","cluster_addr":"172.21.15.142:6811/2471092963","heartbeat_back_addr":"172.21.15.142:6815/2471092963","heartbeat_front_addr":"172.21.15.142:6813/2471092963","state":["exists","up"]},{"osd":5,"uuid":"31f66bd8-23e2-46b3-8954-3f0fe8ea329c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6817","nonce":316032849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6819","nonce":316032849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6823","nonce":316032849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6821","nonce":316032849}]},"public_addr":"172.21.15.142:6817/316032849","cluster_addr":"172.21.15.142:6819/316032849","heartbeat_back_addr":"172.21.15.142:6823/316032849","heartbeat_front_addr":"172.21.15.142:6821/316032849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:21.245089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:48.225836+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:47:17.670294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:47:42.843953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:08.794154+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:34.866245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/1295276362":"2024-09-14T02:45:04.801424+0000","172.21.15.98:0/4087496474":"2024-09-14T02:45:04.801424+0000","172.21.15.98:0/196160400":"2024-09-14T02:45:04.801424+0000","172.21.15.98:0/3235715432":"2024-09-14T02:44:01.815636+0000","172.21.15.98:6801/2":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/1656599610":"2024-09-14T02:44:01.815636+0000","172.21.15.98:0/4007119820":"2024-09-14T02:43:29.909353+0000","172.21.15.98:6800/2":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/4034603056":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/1707764380":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/2190764559":"2024-09-14T02:44:01.815636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T02:48:38.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4a806c680 msgr2=0x7ff4a806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:38.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4a806c680 0x7ff4a806eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0197550 tx=0x7ff4b401a040 comp rx=0 tx=0).stop 2024-09-13T02:48:38.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ff3c0 msgr2=0x7ff4c0195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:38.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ff3c0 0x7ff4c0195f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000d8d0 tx=0x7ff4b000dbe0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 shutdown_connections 2024-09-13T02:48:38.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ff4a806c680 0x7ff4a806eb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4c00ff3c0 0x7ff4c0195f30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 --2- 172.21.15.98:0/4162198284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4c00ffd60 0x7ff4c0196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 >> 172.21.15.98:0/4162198284 conn(0x7ff4c00fac60 msgr2=0x7ff4c0103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:38.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 shutdown_connections 2024-09-13T02:48:38.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:38.904+0000 7ff4c6381700 1 -- 172.21.15.98:0/4162198284 wait complete. 2024-09-13T02:48:39.607 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:39 smithi098 ceph-mon[27886]: Detected new or changed devices on smithi142 2024-09-13T02:48:39.607 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:39 smithi098 ceph-mon[27886]: Adjusting osd_memory_target on smithi142 to 4970M 2024-09-13T02:48:39.607 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:39 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/4162198284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:48:39.629 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T02:47:21.117522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T02:48:39.629 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T02:48:39.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:39 smithi142 ceph-mon[33443]: Detected new or changed devices on smithi142 2024-09-13T02:48:39.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:39 smithi142 ceph-mon[33443]: Adjusting osd_memory_target on smithi142 to 4970M 2024-09-13T02:48:39.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:39 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/4162198284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:48:39.829 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:40.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:40 smithi142 ceph-mon[33443]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:40.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:40 smithi098 ceph-mon[27886]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:41.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.439+0000 7fc36c55a700 1 -- 172.21.15.98:0/2765484478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ff350 msgr2=0x7fc3640ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:41.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.439+0000 7fc36c55a700 1 --2- 172.21.15.98:0/2765484478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ff350 0x7fc3640ff720 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc360009910 tx=0x7fc360009c20 comp rx=0 tx=0).stop 2024-09-13T02:48:41.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.439+0000 7fc36c55a700 1 -- 172.21.15.98:0/2765484478 shutdown_connections 2024-09-13T02:48:41.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.439+0000 7fc36c55a700 1 --2- 172.21.15.98:0/2765484478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ffc60 0x7fc36410a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.439+0000 7fc36c55a700 1 --2- 172.21.15.98:0/2765484478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ff350 0x7fc3640ff720 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.439+0000 7fc36c55a700 1 -- 172.21.15.98:0/2765484478 >> 172.21.15.98:0/2765484478 conn(0x7fc3640748b0 msgr2=0x7fc364074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.439+0000 7fc36c55a700 1 -- 172.21.15.98:0/2765484478 shutdown_connections 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.439+0000 7fc36c55a700 1 -- 172.21.15.98:0/2765484478 wait complete. 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc36c55a700 1 Processor -- start 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc36c55a700 1 -- start start 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc36c55a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ff350 0x7fc364195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc36c55a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ffc60 0x7fc364196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc36c55a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364196b40 con 0x7fc3640ffc60 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc36c55a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36419a8d0 con 0x7fc3640ff350 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc369af5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ffc60 0x7fc364196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc369af5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ffc60 0x7fc364196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47914/0 (socket says 172.21.15.98:47914) 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc369af5700 1 -- 172.21.15.98:0/2103912711 learned_addr learned my addr 172.21.15.98:0/2103912711 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc36a2f6700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ff350 0x7fc364195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc369af5700 1 -- 172.21.15.98:0/2103912711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ff350 msgr2=0x7fc364195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc369af5700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ff350 0x7fc364195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc369af5700 1 -- 172.21.15.98:0/2103912711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600095f0 con 0x7fc3640ffc60 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc36a2f6700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ff350 0x7fc364195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.440+0000 7fc369af5700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ffc60 0x7fc364196460 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc35400d900 tx=0x7fc35400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.441+0000 7fc35b7fe700 1 -- 172.21.15.98:0/2103912711 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc354004a00 con 0x7fc3640ffc60 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.441+0000 7fc35b7fe700 1 -- 172.21.15.98:0/2103912711 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3540054d0 con 0x7fc3640ffc60 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.441+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36419abb0 con 0x7fc3640ffc60 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.441+0000 7fc35b7fe700 1 -- 172.21.15.98:0/2103912711 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc354009d60 con 0x7fc3640ffc60 2024-09-13T02:48:41.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.441+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36419b100 con 0x7fc3640ffc60 2024-09-13T02:48:41.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.442+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc364107dd0 con 0x7fc3640ffc60 2024-09-13T02:48:41.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.442+0000 7fc35b7fe700 1 -- 172.21.15.98:0/2103912711 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc354005020 con 0x7fc3640ffc60 2024-09-13T02:48:41.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.443+0000 7fc35b7fe700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc35006c680 0x7fc35006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:41.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.443+0000 7fc35b7fe700 1 -- 172.21.15.98:0/2103912711 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc35408b670 con 0x7fc3640ffc60 2024-09-13T02:48:41.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.443+0000 7fc36a2f6700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc35006c680 0x7fc35006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:41.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.443+0000 7fc36a2f6700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc35006c680 0x7fc35006eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc360005b40 tx=0x7fc36001a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:41.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.447+0000 7fc35b7fe700 1 -- 172.21.15.98:0/2103912711 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc354056130 con 0x7fc3640ffc60 2024-09-13T02:48:41.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.636+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc36419b320 con 0x7fc3640ffc60 2024-09-13T02:48:41.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.637+0000 7fc35b7fe700 1 -- 172.21.15.98:0/2103912711 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3540170a0 con 0x7fc3640ffc60 2024-09-13T02:48:41.638 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2024-09-13T02:48:41.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc35006c680 msgr2=0x7fc35006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:41.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc35006c680 0x7fc35006eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc360005b40 tx=0x7fc36001a040 comp rx=0 tx=0).stop 2024-09-13T02:48:41.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ffc60 msgr2=0x7fc364196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:41.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ffc60 0x7fc364196460 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc35400d900 tx=0x7fc35400dcc0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 shutdown_connections 2024-09-13T02:48:41.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc35006c680 0x7fc35006eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3640ff350 0x7fc364195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 --2- 172.21.15.98:0/2103912711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640ffc60 0x7fc364196460 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 >> 172.21.15.98:0/2103912711 conn(0x7fc3640748b0 msgr2=0x7fc364104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:41.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 shutdown_connections 2024-09-13T02:48:41.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:41.639+0000 7fc36c55a700 1 -- 172.21.15.98:0/2103912711 wait complete. 2024-09-13T02:48:42.288 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T02:48:42.289 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T02:48:42.494 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:42.567 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:42 smithi142 ceph-mon[33443]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:42.568 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:42 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2103912711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T02:48:42.615 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:42 smithi098 ceph-mon[27886]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:42.615 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:42 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2103912711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T02:48:44.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.197+0000 7f229e0ef700 1 -- 172.21.15.98:0/4172282414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 msgr2=0x7f22980ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:44.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.197+0000 7f229e0ef700 1 --2- 172.21.15.98:0/4172282414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 0x7f22980ff540 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f228800b0a0 tx=0x7f228800b3b0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.197+0000 7f229e0ef700 1 -- 172.21.15.98:0/4172282414 shutdown_connections 2024-09-13T02:48:44.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.197+0000 7f229e0ef700 1 --2- 172.21.15.98:0/4172282414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22981003d0 0x7f2298100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.197+0000 7f229e0ef700 1 --2- 172.21.15.98:0/4172282414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 0x7f22980ff540 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.197+0000 7f229e0ef700 1 -- 172.21.15.98:0/4172282414 >> 172.21.15.98:0/4172282414 conn(0x7f22980fa780 msgr2=0x7f22980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:44.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.197+0000 7f229e0ef700 1 -- 172.21.15.98:0/4172282414 shutdown_connections 2024-09-13T02:48:44.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.197+0000 7f229e0ef700 1 -- 172.21.15.98:0/4172282414 wait complete. 2024-09-13T02:48:44.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f229e0ef700 1 Processor -- start 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f229e0ef700 1 -- start start 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f229e0ef700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 0x7f22981949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f229e0ef700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22981003d0 0x7f2298194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f229e0ef700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298195510 con 0x7f22980ff130 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f229e0ef700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298195650 con 0x7f22981003d0 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f22977fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 0x7f22981949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f22977fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 0x7f22981949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47936/0 (socket says 172.21.15.98:47936) 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f22977fe700 1 -- 172.21.15.98:0/1496194218 learned_addr learned my addr 172.21.15.98:0/1496194218 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.198+0000 7f2296ffd700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22981003d0 0x7f2298194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.199+0000 7f22977fe700 1 -- 172.21.15.98:0/1496194218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22981003d0 msgr2=0x7f2298194ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.199+0000 7f22977fe700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22981003d0 0x7f2298194ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.199+0000 7f22977fe700 1 -- 172.21.15.98:0/1496194218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2288009d00 con 0x7f22980ff130 2024-09-13T02:48:44.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.199+0000 7f22977fe700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 0x7f22981949b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f22880077b0 tx=0x7f2288009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.199+0000 7f2294ff9700 1 -- 172.21.15.98:0/1496194218 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228800e040 con 0x7f22980ff130 2024-09-13T02:48:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.199+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2298068540 con 0x7f22980ff130 2024-09-13T02:48:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.199+0000 7f2294ff9700 1 -- 172.21.15.98:0/1496194218 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2288003c10 con 0x7f22980ff130 2024-09-13T02:48:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.199+0000 7f2294ff9700 1 -- 172.21.15.98:0/1496194218 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2288012660 con 0x7f22980ff130 2024-09-13T02:48:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.199+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2298068a90 con 0x7f22980ff130 2024-09-13T02:48:44.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.200+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2298107c10 con 0x7f22980ff130 2024-09-13T02:48:44.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.200+0000 7f2294ff9700 1 -- 172.21.15.98:0/1496194218 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2288004580 con 0x7f22980ff130 2024-09-13T02:48:44.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.201+0000 7f2294ff9700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f228406c680 0x7f228406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:44.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.201+0000 7f2294ff9700 1 -- 172.21.15.98:0/1496194218 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f228808e400 con 0x7f22980ff130 2024-09-13T02:48:44.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.201+0000 7f2296ffd700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f228406c680 0x7f228406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:44.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.201+0000 7f2296ffd700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f228406c680 0x7f228406eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2280007be0 tx=0x7f22800073d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.206+0000 7f2294ff9700 1 -- 172.21.15.98:0/1496194218 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f228805c950 con 0x7f22980ff130 2024-09-13T02:48:44.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.472+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f2298069380 con 0x7f22980ff130 2024-09-13T02:48:44.474 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:44 smithi098 ceph-mon[27886]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:44.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.476+0000 7f2294ff9700 1 -- 172.21.15.98:0/1496194218 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f2288017070 con 0x7f22980ff130 2024-09-13T02:48:44.478 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-13T02:48:44.478 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAMqONmUmVGHBAAjvw1zhtBcSVuzRJcgagglg== 2024-09-13T02:48:44.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.478+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f228406c680 msgr2=0x7f228406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:44.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.478+0000 7f229e0ef700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f228406c680 0x7f228406eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2280007be0 tx=0x7f22800073d0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.478+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 msgr2=0x7f22981949b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:44.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.478+0000 7f229e0ef700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 0x7f22981949b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f22880077b0 tx=0x7f2288009760 comp rx=0 tx=0).stop 2024-09-13T02:48:44.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.479+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 shutdown_connections 2024-09-13T02:48:44.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.479+0000 7f229e0ef700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f228406c680 0x7f228406eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.479+0000 7f229e0ef700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22980ff130 0x7f22981949b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.479+0000 7f229e0ef700 1 --2- 172.21.15.98:0/1496194218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22981003d0 0x7f2298194ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.479+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 >> 172.21.15.98:0/1496194218 conn(0x7f22980fa780 msgr2=0x7f2298103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:44.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.479+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 shutdown_connections 2024-09-13T02:48:44.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:44.479+0000 7f229e0ef700 1 -- 172.21.15.98:0/1496194218 wait complete. 2024-09-13T02:48:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:44 smithi142 ceph-mon[33443]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:45.106 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:48:45.106 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T02:48:45.106 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T02:48:45.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T02:48:45.357 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi142/config 2024-09-13T02:48:45.477 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:45 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1496194218' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:48:45.478 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:45 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1496194218' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:48:45.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:45 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1496194218' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:48:45.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:45 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1496194218' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:48:46.553 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:46 smithi142 ceph-mon[33443]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:46.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:46 smithi098 ceph-mon[27886]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.862+0000 7f666e637700 1 -- 172.21.15.142:0/2290761190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66681003d0 msgr2=0x7f6668100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.862+0000 7f666e637700 1 --2- 172.21.15.142:0/2290761190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66681003d0 0x7f6668100840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6650009910 tx=0x7f6650009c20 comp rx=0 tx=0).stop 2024-09-13T02:48:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.862+0000 7f666e637700 1 -- 172.21.15.142:0/2290761190 shutdown_connections 2024-09-13T02:48:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.862+0000 7f666e637700 1 --2- 172.21.15.142:0/2290761190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66681003d0 0x7f6668100840 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.862+0000 7f666e637700 1 --2- 172.21.15.142:0/2290761190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66680ff130 0x7f66680ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.862+0000 7f666e637700 1 -- 172.21.15.142:0/2290761190 >> 172.21.15.142:0/2290761190 conn(0x7f66680fa780 msgr2=0x7f66680fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.862+0000 7f666e637700 1 -- 172.21.15.142:0/2290761190 shutdown_connections 2024-09-13T02:48:46.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.862+0000 7f666e637700 1 -- 172.21.15.142:0/2290761190 wait complete. 2024-09-13T02:48:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f666e637700 1 Processor -- start 2024-09-13T02:48:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f666e637700 1 -- start start 2024-09-13T02:48:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f666e637700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66680ff130 0x7f6668195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f666e637700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66681003d0 0x7f6668196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f666e637700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6668196680 con 0x7f66681003d0 2024-09-13T02:48:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f666e637700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66681967c0 con 0x7f66680ff130 2024-09-13T02:48:46.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f6667fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66680ff130 0x7f6668195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f6667fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66680ff130 0x7f6668195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49064/0 (socket says 172.21.15.142:49064) 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f6667fff700 1 -- 172.21.15.142:0/1225590101 learned_addr learned my addr 172.21.15.142:0/1225590101 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f665ffff700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66681003d0 0x7f6668196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f6667fff700 1 -- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66681003d0 msgr2=0x7f6668196060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f6667fff700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66681003d0 0x7f6668196060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.863+0000 7f6667fff700 1 -- 172.21.15.142:0/1225590101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66500095f0 con 0x7f66680ff130 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.864+0000 7f6667fff700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66680ff130 0x7f6668195b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f665800b4b0 tx=0x7f665800b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.864+0000 7f6665ffb700 1 -- 172.21.15.142:0/1225590101 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6658011800 con 0x7f66680ff130 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.864+0000 7f6665ffb700 1 -- 172.21.15.142:0/1225590101 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6658011e10 con 0x7f66680ff130 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.864+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666819b270 con 0x7f66680ff130 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.864+0000 7f6665ffb700 1 -- 172.21.15.142:0/1225590101 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f665800f2e0 con 0x7f66680ff130 2024-09-13T02:48:46.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.864+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666819b7c0 con 0x7f66680ff130 2024-09-13T02:48:46.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.865+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6668107c90 con 0x7f66680ff130 2024-09-13T02:48:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.865+0000 7f6665ffb700 1 -- 172.21.15.142:0/1225590101 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6658010380 con 0x7f66680ff130 2024-09-13T02:48:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.866+0000 7f6665ffb700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f665406c680 0x7f665406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.866+0000 7f6665ffb700 1 -- 172.21.15.142:0/1225590101 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f665808af80 con 0x7f66680ff130 2024-09-13T02:48:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.866+0000 7f665ffff700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f665406c680 0x7f665406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:46.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.866+0000 7f665ffff700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f665406c680 0x7f665406eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6650006010 tx=0x7f665000b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:46.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:46.870+0000 7f6665ffb700 1 -- 172.21.15.142:0/1225590101 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6658059600 con 0x7f66680ff130 2024-09-13T02:48:47.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.132+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f666819be50 con 0x7f66680ff130 2024-09-13T02:48:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.138+0000 7f6665ffb700 1 -- 172.21.15.142:0/1225590101 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f6658059190 con 0x7f66680ff130 2024-09-13T02:48:47.140 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2024-09-13T02:48:47.140 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAPqONm8nsbCBAAfxn+yGwmnyBA1unm4zCXdw== 2024-09-13T02:48:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f665406c680 msgr2=0x7f665406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f665406c680 0x7f665406eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6650006010 tx=0x7f665000b540 comp rx=0 tx=0).stop 2024-09-13T02:48:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66680ff130 msgr2=0x7f6668195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66680ff130 0x7f6668195b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f665800b4b0 tx=0x7f665800b7c0 comp rx=0 tx=0).stop 2024-09-13T02:48:47.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 shutdown_connections 2024-09-13T02:48:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f665406c680 0x7f665406eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66680ff130 0x7f6668195b20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 --2- 172.21.15.142:0/1225590101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66681003d0 0x7f6668196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 >> 172.21.15.142:0/1225590101 conn(0x7f66680fa780 msgr2=0x7f6668068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 shutdown_connections 2024-09-13T02:48:47.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:48:47.140+0000 7f666e637700 1 -- 172.21.15.142:0/1225590101 wait complete. 2024-09-13T02:48:47.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:47 smithi142 ceph-mon[33443]: from='client.? 172.21.15.142:0/1225590101' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:48:47.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:47 smithi142 ceph-mon[33443]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:48:47.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:47 smithi142 ceph-mon[33443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:48:47.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:47 smithi098 ceph-mon[27886]: from='client.? 172.21.15.142:0/1225590101' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:48:47.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:47 smithi098 ceph-mon[27886]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:48:47.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:47 smithi098 ceph-mon[27886]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:48:47.789 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:48:47.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T02:48:47.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T02:48:47.828 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T02:48:47.828 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T02:48:47.828 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T02:48:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:48.472 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:48 smithi098 ceph-mon[27886]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:48.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:48 smithi142 ceph-mon[33443]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:49.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.630+0000 7fe6244a9700 1 -- 172.21.15.98:0/3267929024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c100e80 msgr2=0x7fe61c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:49.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.630+0000 7fe6244a9700 1 --2- 172.21.15.98:0/3267929024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c100e80 0x7fe61c104e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009910 tx=0x7fe60c009c20 comp rx=0 tx=0).stop 2024-09-13T02:48:49.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.630+0000 7fe6244a9700 1 -- 172.21.15.98:0/3267929024 shutdown_connections 2024-09-13T02:48:49.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.630+0000 7fe6244a9700 1 --2- 172.21.15.98:0/3267929024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c100e80 0x7fe61c104e50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.630+0000 7fe6244a9700 1 --2- 172.21.15.98:0/3267929024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c1004e0 0x7fe61c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.630+0000 7fe6244a9700 1 -- 172.21.15.98:0/3267929024 >> 172.21.15.98:0/3267929024 conn(0x7fe61c0fbda0 msgr2=0x7fe61c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.630+0000 7fe6244a9700 1 -- 172.21.15.98:0/3267929024 shutdown_connections 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.630+0000 7fe6244a9700 1 -- 172.21.15.98:0/3267929024 wait complete. 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.630+0000 7fe6244a9700 1 Processor -- start 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe6244a9700 1 -- start start 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe6244a9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c1004e0 0x7fe61c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe6244a9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c100e80 0x7fe61c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe6244a9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c196b30 con 0x7fe61c1004e0 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe6244a9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c19a8c0 con 0x7fe61c100e80 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe622245700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c1004e0 0x7fe61c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:49.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe622245700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c1004e0 0x7fe61c195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42762/0 (socket says 172.21.15.98:42762) 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe622245700 1 -- 172.21.15.98:0/1239580693 learned_addr learned my addr 172.21.15.98:0/1239580693 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe621a44700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c100e80 0x7fe61c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe622245700 1 -- 172.21.15.98:0/1239580693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c100e80 msgr2=0x7fe61c196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe622245700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c100e80 0x7fe61c196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe622245700 1 -- 172.21.15.98:0/1239580693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0095f0 con 0x7fe61c1004e0 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe622245700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c1004e0 0x7fe61c195f10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe6180060b0 tx=0x7fe61800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe6137fe700 1 -- 172.21.15.98:0/1239580693 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe61800dda0 con 0x7fe61c1004e0 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe6137fe700 1 -- 172.21.15.98:0/1239580693 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe61800f040 con 0x7fe61c1004e0 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe6137fe700 1 -- 172.21.15.98:0/1239580693 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe618014790 con 0x7fe61c1004e0 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.631+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c19aba0 con 0x7fe61c1004e0 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.632+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c19b0a0 con 0x7fe61c1004e0 2024-09-13T02:48:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.632+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c108850 con 0x7fe61c1004e0 2024-09-13T02:48:49.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.633+0000 7fe6137fe700 1 -- 172.21.15.98:0/1239580693 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe6180148f0 con 0x7fe61c1004e0 2024-09-13T02:48:49.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.633+0000 7fe6137fe700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe60806c680 0x7fe60806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:49.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.633+0000 7fe6137fe700 1 -- 172.21.15.98:0/1239580693 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe61808af50 con 0x7fe61c1004e0 2024-09-13T02:48:49.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.633+0000 7fe621a44700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe60806c680 0x7fe60806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:49.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.634+0000 7fe621a44700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe60806c680 0x7fe60806eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe61c197530 tx=0x7fe60c01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:49.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.638+0000 7fe6137fe700 1 -- 172.21.15.98:0/1239580693 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe61804f720 con 0x7fe61c1004e0 2024-09-13T02:48:49.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.902+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe61c04f2a0 con 0x7fe61c1004e0 2024-09-13T02:48:49.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.905+0000 7fe6137fe700 1 -- 172.21.15.98:0/1239580693 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172827 (secure 0 0 0) 0x7fe61804e330 con 0x7fe61c1004e0 2024-09-13T02:48:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:48:49.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe60806c680 msgr2=0x7fe60806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:49.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe60806c680 0x7fe60806eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe61c197530 tx=0x7fe60c01a040 comp rx=0 tx=0).stop 2024-09-13T02:48:49.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c1004e0 msgr2=0x7fe61c195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:49.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c1004e0 0x7fe61c195f10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe6180060b0 tx=0x7fe61800d3b0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 shutdown_connections 2024-09-13T02:48:49.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe60806c680 0x7fe60806eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe61c1004e0 0x7fe61c195f10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 --2- 172.21.15.98:0/1239580693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c100e80 0x7fe61c196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 >> 172.21.15.98:0/1239580693 conn(0x7fe61c0fbda0 msgr2=0x7fe61c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:49.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 shutdown_connections 2024-09-13T02:48:49.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:49.908+0000 7fe6244a9700 1 -- 172.21.15.98:0/1239580693 wait complete. 2024-09-13T02:48:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:50 smithi098 ceph-mon[27886]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:50.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:50 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1239580693' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T02:48:50.633 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":19,"active_gid":14211,"active_name":"smithi098.ukgenf","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2},{"type":"v1","addr":"172.21.15.98:6801","nonce":2}]},"active_addr":"172.21.15.98:6801/2","active_change":"2024-09-13T02:45:04.801567+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14234,"name":"smithi142.jutrvi","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.98:8443/","prometheus":"http://172.21.15.98:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":2898837321}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":301321840}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":3693008660}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":3787037935}]}]} 2024-09-13T02:48:50.637 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T02:48:50.637 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T02:48:50.637 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T02:48:50.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:50 smithi142 ceph-mon[33443]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:50.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:50.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:50 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1239580693' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T02:48:50.836 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:52.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.324+0000 7f796c5e5700 1 -- 172.21.15.98:0/208823651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 msgr2=0x7f79640ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:52.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.324+0000 7f796c5e5700 1 --2- 172.21.15.98:0/208823651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 0x7f79640ff720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7960009910 tx=0x7f7960009c20 comp rx=0 tx=0).stop 2024-09-13T02:48:52.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.325+0000 7f796c5e5700 1 -- 172.21.15.98:0/208823651 shutdown_connections 2024-09-13T02:48:52.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.325+0000 7f796c5e5700 1 --2- 172.21.15.98:0/208823651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79640ffc60 0x7f796410a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:52.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.325+0000 7f796c5e5700 1 --2- 172.21.15.98:0/208823651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 0x7f79640ff720 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.325+0000 7f796c5e5700 1 -- 172.21.15.98:0/208823651 >> 172.21.15.98:0/208823651 conn(0x7f79640748b0 msgr2=0x7f7964074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.325+0000 7f796c5e5700 1 -- 172.21.15.98:0/208823651 shutdown_connections 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.325+0000 7f796c5e5700 1 -- 172.21.15.98:0/208823651 wait complete. 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.325+0000 7f796c5e5700 1 Processor -- start 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.325+0000 7f796c5e5700 1 -- start start 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796c5e5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 0x7f7964195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796c5e5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79640ffc60 0x7f7964196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796c5e5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7964196be0 con 0x7f79640ff350 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796c5e5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796419a970 con 0x7f79640ffc60 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796a381700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 0x7f7964195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:52.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796a381700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 0x7f7964195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42790/0 (socket says 172.21.15.98:42790) 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796a381700 1 -- 172.21.15.98:0/1110944109 learned_addr learned my addr 172.21.15.98:0/1110944109 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f7969b80700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79640ffc60 0x7f7964196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796a381700 1 -- 172.21.15.98:0/1110944109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79640ffc60 msgr2=0x7f7964196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796a381700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79640ffc60 0x7f7964196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796a381700 1 -- 172.21.15.98:0/1110944109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600095f0 con 0x7f79640ff350 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f7969b80700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79640ffc60 0x7f7964196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796a381700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 0x7f7964195fc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79600092e0 tx=0x7f796000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f795b7fe700 1 -- 172.21.15.98:0/1110944109 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f796001d070 con 0x7f79640ff350 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f795b7fe700 1 -- 172.21.15.98:0/1110944109 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7960022470 con 0x7f79640ff350 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796419abf0 con 0x7f79640ff350 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f795b7fe700 1 -- 172.21.15.98:0/1110944109 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f796000f690 con 0x7f79640ff350 2024-09-13T02:48:52.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.326+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796419b0e0 con 0x7f79640ff350 2024-09-13T02:48:52.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.327+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7964107dd0 con 0x7f79640ff350 2024-09-13T02:48:52.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.328+0000 7f795b7fe700 1 -- 172.21.15.98:0/1110944109 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f79600225e0 con 0x7f79640ff350 2024-09-13T02:48:52.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.328+0000 7f795b7fe700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f795006c680 0x7f795006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:52.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.328+0000 7f795b7fe700 1 -- 172.21.15.98:0/1110944109 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f796008c9f0 con 0x7f79640ff350 2024-09-13T02:48:52.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.328+0000 7f7969b80700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f795006c680 0x7f795006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:52.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.329+0000 7f7969b80700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f795006c680 0x7f795006eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f79641975e0 tx=0x7f7954008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:52.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.333+0000 7f795b7fe700 1 -- 172.21.15.98:0/1110944109 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f796008ee60 con 0x7f79640ff350 2024-09-13T02:48:52.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:52 smithi098 ceph-mon[27886]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.525+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f796404f2a0 con 0x7f79640ff350 2024-09-13T02:48:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.525+0000 7f795b7fe700 1 -- 172.21.15.98:0/1110944109 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11024 (secure 0 0 0) 0x7f796006ee60 con 0x7f79640ff350 2024-09-13T02:48:52.527 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:48:52.527 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":41,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","created":"2024-09-13T02:42:56.881586+0000","modified":"2024-09-13T02:48:37.254064+0000","last_up_change":"2024-09-13T02:48:36.249061+0000","last_in_change":"2024-09-13T02:48:17.507975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T02:47:21.117522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"839bea7c-d0d5-4a63-9fbd-4bb3570e27f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6803","nonce":922771257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6805","nonce":922771257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6809","nonce":922771257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6807","nonce":922771257}]},"public_addr":"172.21.15.98:6803/922771257","cluster_addr":"172.21.15.98:6805/922771257","heartbeat_back_addr":"172.21.15.98:6809/922771257","heartbeat_front_addr":"172.21.15.98:6807/922771257","state":["exists","up"]},{"osd":1,"uuid":"20b7dd80-b8d0-4577-a86b-0e2e031e664a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6811","nonce":4064465963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6813","nonce":4064465963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6817","nonce":4064465963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6815","nonce":4064465963}]},"public_addr":"172.21.15.98:6811/4064465963","cluster_addr":"172.21.15.98:6813/4064465963","heartbeat_back_addr":"172.21.15.98:6817/4064465963","heartbeat_front_addr":"172.21.15.98:6815/4064465963","state":["exists","up"]},{"osd":2,"uuid":"3fe12d84-20a5-4109-b87a-037c8084682a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6819","nonce":14531122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6821","nonce":14531122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6825","nonce":14531122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6823","nonce":14531122}]},"public_addr":"172.21.15.98:6819/14531122","cluster_addr":"172.21.15.98:6821/14531122","heartbeat_back_addr":"172.21.15.98:6825/14531122","heartbeat_front_addr":"172.21.15.98:6823/14531122","state":["exists","up"]},{"osd":3,"uuid":"c435dee9-b72b-4e78-a776-3dd6389cc070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6801","nonce":1321061843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6803","nonce":1321061843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6807","nonce":1321061843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6805","nonce":1321061843}]},"public_addr":"172.21.15.142:6801/1321061843","cluster_addr":"172.21.15.142:6803/1321061843","heartbeat_back_addr":"172.21.15.142:6807/1321061843","heartbeat_front_addr":"172.21.15.142:6805/1321061843","state":["exists","up"]},{"osd":4,"uuid":"4ddffc4c-ab6b-45d7-8bd2-df32ac88e84a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6809","nonce":2471092963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6811","nonce":2471092963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6815","nonce":2471092963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6813","nonce":2471092963}]},"public_addr":"172.21.15.142:6809/2471092963","cluster_addr":"172.21.15.142:6811/2471092963","heartbeat_back_addr":"172.21.15.142:6815/2471092963","heartbeat_front_addr":"172.21.15.142:6813/2471092963","state":["exists","up"]},{"osd":5,"uuid":"31f66bd8-23e2-46b3-8954-3f0fe8ea329c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6817","nonce":316032849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6819","nonce":316032849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6823","nonce":316032849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6821","nonce":316032849}]},"public_addr":"172.21.15.142:6817/316032849","cluster_addr":"172.21.15.142:6819/316032849","heartbeat_back_addr":"172.21.15.142:6823/316032849","heartbeat_front_addr":"172.21.15.142:6821/316032849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:21.245089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:48.225836+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:47:17.670294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:47:42.843953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:08.794154+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:34.866245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/1295276362":"2024-09-14T02:45:04.801424+0000","172.21.15.98:0/4087496474":"2024-09-14T02:45:04.801424+0000","172.21.15.98:0/196160400":"2024-09-14T02:45:04.801424+0000","172.21.15.98:0/3235715432":"2024-09-14T02:44:01.815636+0000","172.21.15.98:6801/2":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/1656599610":"2024-09-14T02:44:01.815636+0000","172.21.15.98:0/4007119820":"2024-09-14T02:43:29.909353+0000","172.21.15.98:6800/2":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/4034603056":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/1707764380":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/2190764559":"2024-09-14T02:44:01.815636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T02:48:52.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f795006c680 msgr2=0x7f795006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:52.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f795006c680 0x7f795006eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f79641975e0 tx=0x7f7954008040 comp rx=0 tx=0).stop 2024-09-13T02:48:52.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 msgr2=0x7f7964195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:52.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 0x7f7964195fc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79600092e0 tx=0x7f796000be20 comp rx=0 tx=0).stop 2024-09-13T02:48:52.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 shutdown_connections 2024-09-13T02:48:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f795006c680 0x7f795006eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79640ff350 0x7f7964195fc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 --2- 172.21.15.98:0/1110944109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79640ffc60 0x7f7964196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 >> 172.21.15.98:0/1110944109 conn(0x7f79640748b0 msgr2=0x7f7964104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 shutdown_connections 2024-09-13T02:48:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:52.528+0000 7f796c5e5700 1 -- 172.21.15.98:0/1110944109 wait complete. 2024-09-13T02:48:52.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:52 smithi142 ceph-mon[33443]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:53.141 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T02:48:53.142 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T02:48:53.341 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:53.462 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:53 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1110944109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:48:53.588 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:53 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1110944109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:48:54.588 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:54 smithi098 ceph-mon[27886]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:54.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:54 smithi142 ceph-mon[33443]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:54.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.936+0000 7f6ada855700 1 -- 172.21.15.98:0/3324752148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 msgr2=0x7f6ad4104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:54.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.936+0000 7f6ada855700 1 --2- 172.21.15.98:0/3324752148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 0x7f6ad4104500 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009910 tx=0x7f6abc009c20 comp rx=0 tx=0).stop 2024-09-13T02:48:54.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.936+0000 7f6ada855700 1 -- 172.21.15.98:0/3324752148 shutdown_connections 2024-09-13T02:48:54.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.936+0000 7f6ada855700 1 --2- 172.21.15.98:0/3324752148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ad40ffbd0 0x7f6ad4100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:54.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.936+0000 7f6ada855700 1 --2- 172.21.15.98:0/3324752148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 0x7f6ad4104500 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:54.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.936+0000 7f6ada855700 1 -- 172.21.15.98:0/3324752148 >> 172.21.15.98:0/3324752148 conn(0x7f6ad4075130 msgr2=0x7f6ad4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:54.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.936+0000 7f6ada855700 1 -- 172.21.15.98:0/3324752148 shutdown_connections 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.936+0000 7f6ada855700 1 -- 172.21.15.98:0/3324752148 wait complete. 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ada855700 1 Processor -- start 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ada855700 1 -- start start 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ada855700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ad40ffbd0 0x7f6ad4195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ada855700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 0x7f6ad4196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ada855700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4196af0 con 0x7f6ad4104130 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ada855700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad419a880 con 0x7f6ad40ffbd0 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ad37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 0x7f6ad4196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ad37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 0x7f6ad4196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35970/0 (socket says 172.21.15.98:35970) 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ad37fe700 1 -- 172.21.15.98:0/922761459 learned_addr learned my addr 172.21.15.98:0/922761459 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.937+0000 7f6ad3fff700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ad40ffbd0 0x7f6ad4195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.938+0000 7f6ad37fe700 1 -- 172.21.15.98:0/922761459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ad40ffbd0 msgr2=0x7f6ad4195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:54.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.938+0000 7f6ad37fe700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ad40ffbd0 0x7f6ad4195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.938+0000 7f6ad37fe700 1 -- 172.21.15.98:0/922761459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0095f0 con 0x7f6ad4104130 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.938+0000 7f6ad37fe700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 0x7f6ad4196410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400b4b0 tx=0x7f6ac400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.938+0000 7f6ad17fa700 1 -- 172.21.15.98:0/922761459 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ac4011800 con 0x7f6ad4104130 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.938+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad419ab60 con 0x7f6ad4104130 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.938+0000 7f6ad17fa700 1 -- 172.21.15.98:0/922761459 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6ac4011e10 con 0x7f6ad4104130 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.938+0000 7f6ad17fa700 1 -- 172.21.15.98:0/922761459 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ac400f2e0 con 0x7f6ad4104130 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.938+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad419b0b0 con 0x7f6ad4104130 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.939+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad41086a0 con 0x7f6ad4104130 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.939+0000 7f6ad17fa700 1 -- 172.21.15.98:0/922761459 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6ac4010380 con 0x7f6ad4104130 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.940+0000 7f6ad17fa700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f6ac006c680 0x7f6ac006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.940+0000 7f6ad17fa700 1 -- 172.21.15.98:0/922761459 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f6ac408b110 con 0x7f6ad4104130 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.940+0000 7f6ad3fff700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f6ac006c680 0x7f6ac006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.940+0000 7f6ad3fff700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f6ac006c680 0x7f6ac006eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00b5c0 tx=0x7f6abc01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:54.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:54.944+0000 7f6ad17fa700 1 -- 172.21.15.98:0/922761459 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6ac4055bd0 con 0x7f6ad4104130 2024-09-13T02:48:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.138+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ad419b330 con 0x7f6ad4104130 2024-09-13T02:48:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.139+0000 7f6ad17fa700 1 -- 172.21.15.98:0/922761459 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11024 (secure 0 0 0) 0x7f6ac40591f0 con 0x7f6ad4104130 2024-09-13T02:48:55.140 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:48:55.141 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":41,"fsid":"d155f688-7179-11ef-bceb-c7b262605968","created":"2024-09-13T02:42:56.881586+0000","modified":"2024-09-13T02:48:37.254064+0000","last_up_change":"2024-09-13T02:48:36.249061+0000","last_in_change":"2024-09-13T02:48:17.507975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T02:47:21.117522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"839bea7c-d0d5-4a63-9fbd-4bb3570e27f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6803","nonce":922771257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6805","nonce":922771257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6809","nonce":922771257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":922771257},{"type":"v1","addr":"172.21.15.98:6807","nonce":922771257}]},"public_addr":"172.21.15.98:6803/922771257","cluster_addr":"172.21.15.98:6805/922771257","heartbeat_back_addr":"172.21.15.98:6809/922771257","heartbeat_front_addr":"172.21.15.98:6807/922771257","state":["exists","up"]},{"osd":1,"uuid":"20b7dd80-b8d0-4577-a86b-0e2e031e664a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6811","nonce":4064465963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6813","nonce":4064465963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6817","nonce":4064465963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4064465963},{"type":"v1","addr":"172.21.15.98:6815","nonce":4064465963}]},"public_addr":"172.21.15.98:6811/4064465963","cluster_addr":"172.21.15.98:6813/4064465963","heartbeat_back_addr":"172.21.15.98:6817/4064465963","heartbeat_front_addr":"172.21.15.98:6815/4064465963","state":["exists","up"]},{"osd":2,"uuid":"3fe12d84-20a5-4109-b87a-037c8084682a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6819","nonce":14531122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6821","nonce":14531122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6825","nonce":14531122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":14531122},{"type":"v1","addr":"172.21.15.98:6823","nonce":14531122}]},"public_addr":"172.21.15.98:6819/14531122","cluster_addr":"172.21.15.98:6821/14531122","heartbeat_back_addr":"172.21.15.98:6825/14531122","heartbeat_front_addr":"172.21.15.98:6823/14531122","state":["exists","up"]},{"osd":3,"uuid":"c435dee9-b72b-4e78-a776-3dd6389cc070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6801","nonce":1321061843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6803","nonce":1321061843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6807","nonce":1321061843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1321061843},{"type":"v1","addr":"172.21.15.142:6805","nonce":1321061843}]},"public_addr":"172.21.15.142:6801/1321061843","cluster_addr":"172.21.15.142:6803/1321061843","heartbeat_back_addr":"172.21.15.142:6807/1321061843","heartbeat_front_addr":"172.21.15.142:6805/1321061843","state":["exists","up"]},{"osd":4,"uuid":"4ddffc4c-ab6b-45d7-8bd2-df32ac88e84a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6809","nonce":2471092963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6811","nonce":2471092963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6815","nonce":2471092963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2471092963},{"type":"v1","addr":"172.21.15.142:6813","nonce":2471092963}]},"public_addr":"172.21.15.142:6809/2471092963","cluster_addr":"172.21.15.142:6811/2471092963","heartbeat_back_addr":"172.21.15.142:6815/2471092963","heartbeat_front_addr":"172.21.15.142:6813/2471092963","state":["exists","up"]},{"osd":5,"uuid":"31f66bd8-23e2-46b3-8954-3f0fe8ea329c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6817","nonce":316032849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6819","nonce":316032849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6823","nonce":316032849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":316032849},{"type":"v1","addr":"172.21.15.142:6821","nonce":316032849}]},"public_addr":"172.21.15.142:6817/316032849","cluster_addr":"172.21.15.142:6819/316032849","heartbeat_back_addr":"172.21.15.142:6823/316032849","heartbeat_front_addr":"172.21.15.142:6821/316032849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:21.245089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:48.225836+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:47:17.670294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:47:42.843953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:08.794154+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:34.866245+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/1295276362":"2024-09-14T02:45:04.801424+0000","172.21.15.98:0/4087496474":"2024-09-14T02:45:04.801424+0000","172.21.15.98:0/196160400":"2024-09-14T02:45:04.801424+0000","172.21.15.98:0/3235715432":"2024-09-14T02:44:01.815636+0000","172.21.15.98:6801/2":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/1656599610":"2024-09-14T02:44:01.815636+0000","172.21.15.98:0/4007119820":"2024-09-14T02:43:29.909353+0000","172.21.15.98:6800/2":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/4034603056":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/1707764380":"2024-09-14T02:43:29.909353+0000","172.21.15.98:0/2190764559":"2024-09-14T02:44:01.815636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T02:48:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f6ac006c680 msgr2=0x7f6ac006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f6ac006c680 0x7f6ac006eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00b5c0 tx=0x7f6abc01a040 comp rx=0 tx=0).stop 2024-09-13T02:48:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 msgr2=0x7f6ad4196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 0x7f6ad4196410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400b4b0 tx=0x7f6ac400b870 comp rx=0 tx=0).stop 2024-09-13T02:48:55.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 shutdown_connections 2024-09-13T02:48:55.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f6ac006c680 0x7f6ac006eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:55.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ad40ffbd0 0x7f6ad4195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:55.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 --2- 172.21.15.98:0/922761459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad4104130 0x7f6ad4196410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:55.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 >> 172.21.15.98:0/922761459 conn(0x7f6ad4075130 msgr2=0x7f6ad40fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:55.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 shutdown_connections 2024-09-13T02:48:55.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:55.141+0000 7f6ada855700 1 -- 172.21.15.98:0/922761459 wait complete. 2024-09-13T02:48:55.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:55 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/922761459' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:48:55.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:55 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/922761459' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:48:55.801 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T02:48:55.801 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T02:48:55.801 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T02:48:55.802 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T02:48:55.802 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T02:48:55.803 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T02:48:56.052 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:56.095 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:56.458 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:56 smithi098 ceph-mon[27886]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:56.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:56 smithi142 ceph-mon[33443]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:57.838 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:57.838 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:58.048 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:58.352 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:48:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.386+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/2053337063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 msgr2=0x7fe3e40ff5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.386+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/2053337063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 0x7fe3e40ff5e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009910 tx=0x7fe3d4009c20 comp rx=0 tx=0).stop 2024-09-13T02:48:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.386+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/2053337063 shutdown_connections 2024-09-13T02:48:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.386+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/2053337063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3e40ffb20 0x7fe3e4104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.386+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/2053337063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 0x7fe3e40ff5e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.386+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/2053337063 >> 172.21.15.98:0/2053337063 conn(0x7fe3e40fac80 msgr2=0x7fe3e40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:58.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.386+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/2053337063 shutdown_connections 2024-09-13T02:48:58.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.386+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/2053337063 wait complete. 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.387+0000 7fe3ea4cf700 1 Processor -- start 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.387+0000 7fe3ea4cf700 1 -- start start 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.387+0000 7fe3ea4cf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 0x7fe3e419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.387+0000 7fe3ea4cf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3e40ffb20 0x7fe3e419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.387+0000 7fe3ea4cf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e419d060 con 0x7fe3e40ff210 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.387+0000 7fe3ea4cf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e41a0df0 con 0x7fe3e40ffb20 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.387+0000 7fe3e3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 0x7fe3e419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.387+0000 7fe3e3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 0x7fe3e419c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35984/0 (socket says 172.21.15.98:35984) 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.387+0000 7fe3e3fff700 1 -- 172.21.15.98:0/1613747417 learned_addr learned my addr 172.21.15.98:0/1613747417 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3e3fff700 1 -- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3e40ffb20 msgr2=0x7fe3e419c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3e37fe700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3e40ffb20 0x7fe3e419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:58.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3e3fff700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3e40ffb20 0x7fe3e419c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3e3fff700 1 -- 172.21.15.98:0/1613747417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d40095f0 con 0x7fe3e40ff210 2024-09-13T02:48:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3e3fff700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 0x7fe3e419c440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40092e0 tx=0x7fe3d400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3e17fa700 1 -- 172.21.15.98:0/1613747417 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3d401d070 con 0x7fe3e40ff210 2024-09-13T02:48:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3e17fa700 1 -- 172.21.15.98:0/1613747417 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe3d40050d0 con 0x7fe3e40ff210 2024-09-13T02:48:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e41a1070 con 0x7fe3e40ff210 2024-09-13T02:48:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3e17fa700 1 -- 172.21.15.98:0/1613747417 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3d4017630 con 0x7fe3e40ff210 2024-09-13T02:48:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.388+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e41a1560 con 0x7fe3e40ff210 2024-09-13T02:48:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.389+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3e4113c30 con 0x7fe3e40ff210 2024-09-13T02:48:58.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.389+0000 7fe3e17fa700 1 -- 172.21.15.98:0/1613747417 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe3d4003680 con 0x7fe3e40ff210 2024-09-13T02:48:58.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.390+0000 7fe3e17fa700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe3cc06c680 0x7fe3cc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:58.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.390+0000 7fe3e17fa700 1 -- 172.21.15.98:0/1613747417 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe3d408c7a0 con 0x7fe3e40ff210 2024-09-13T02:48:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.390+0000 7fe3e37fe700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe3cc06c680 0x7fe3cc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.390+0000 7fe3e17fa700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] conn(0x7fe3cc072210 0x7fe3cc074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.390+0000 7fe3e17fa700 1 -- 172.21.15.98:0/1613747417 --> [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3cc074cd0 con 0x7fe3cc072210 2024-09-13T02:48:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.390+0000 7fe3e17fa700 1 -- 172.21.15.98:0/1613747417 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3d40912a0 con 0x7fe3e40ff210 2024-09-13T02:48:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.390+0000 7fe3e37fe700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe3cc06c680 0x7fe3cc06eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3e419da60 tx=0x7fe3d8009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.390+0000 7fe3e8a6c700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] conn(0x7fe3cc072210 0x7fe3cc074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.391+0000 7fe3e8a6c700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] conn(0x7fe3cc072210 0x7fe3cc074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:58.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.392+0000 7fe3e17fa700 1 -- 172.21.15.98:0/1613747417 <== osd.4 v2:172.21.15.142:6808/2471092963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe3cc074cd0 con 0x7fe3cc072210 2024-09-13T02:48:58.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.408+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 --> [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3e404f2a0 con 0x7fe3cc072210 2024-09-13T02:48:58.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.408+0000 7fe3e17fa700 1 -- 172.21.15.98:0/1613747417 <== osd.4 v2:172.21.15.142:6808/2471092963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe3e404f2a0 con 0x7fe3cc072210 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.408+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] conn(0x7fe3cc072210 msgr2=0x7fe3cc074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.408+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] conn(0x7fe3cc072210 0x7fe3cc074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.408+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe3cc06c680 msgr2=0x7fe3cc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe3cc06c680 0x7fe3cc06eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3e419da60 tx=0x7fe3d8009260 comp rx=0 tx=0).stop 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 msgr2=0x7fe3e419c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 0x7fe3e419c440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40092e0 tx=0x7fe3d400f740 comp rx=0 tx=0).stop 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 shutdown_connections 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:6808/2471092963,v1:172.21.15.142:6809/2471092963] conn(0x7fe3cc072210 0x7fe3cc074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe3cc06c680 0x7fe3cc06eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe3e40ff210 0x7fe3e419c440 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 --2- 172.21.15.98:0/1613747417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3e40ffb20 0x7fe3e419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 >> 172.21.15.98:0/1613747417 conn(0x7fe3e40fac80 msgr2=0x7fe3e4110680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:58.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 shutdown_connections 2024-09-13T02:48:58.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:48:58.409+0000 7fe3ea4cf700 1 -- 172.21.15.98:0/1613747417 wait complete. 2024-09-13T02:48:58.650 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:48:58 smithi098 ceph-mon[27886]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:48:58.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:48:58 smithi142 ceph-mon[33443]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:00.276 INFO:teuthology.orchestra.run.smithi098.stdout:150323855372 2024-09-13T02:49:00.431 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T02:49:00.505 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:00 smithi098 ceph-mon[27886]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:00.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:00 smithi142 ceph-mon[33443]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:01.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.259+0000 7fc15db86700 1 -- 172.21.15.98:0/587705181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 msgr2=0x7fc1581016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:01.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.259+0000 7fc15db86700 1 --2- 172.21.15.98:0/587705181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 0x7fc1581016c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc148009910 tx=0x7fc148009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:01.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.259+0000 7fc15db86700 1 -- 172.21.15.98:0/587705181 shutdown_connections 2024-09-13T02:49:01.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.259+0000 7fc15db86700 1 --2- 172.21.15.98:0/587705181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc158101c90 0x7fc15810a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.259+0000 7fc15db86700 1 --2- 172.21.15.98:0/587705181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 0x7fc1581016c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.259+0000 7fc15db86700 1 -- 172.21.15.98:0/587705181 >> 172.21.15.98:0/587705181 conn(0x7fc1580fac80 msgr2=0x7fc1580fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:01.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.260+0000 7fc15db86700 1 -- 172.21.15.98:0/587705181 shutdown_connections 2024-09-13T02:49:01.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.260+0000 7fc15db86700 1 -- 172.21.15.98:0/587705181 wait complete. 2024-09-13T02:49:01.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.260+0000 7fc15db86700 1 Processor -- start 2024-09-13T02:49:01.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.260+0000 7fc15db86700 1 -- start start 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc15db86700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 0x7fc158195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc15db86700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc158101c90 0x7fc1581963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc15db86700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158196ac0 con 0x7fc1581012f0 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc15db86700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15819a800 con 0x7fc158101c90 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc1577fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 0x7fc158195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc1577fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 0x7fc158195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36010/0 (socket says 172.21.15.98:36010) 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc1577fe700 1 -- 172.21.15.98:0/2338914855 learned_addr learned my addr 172.21.15.98:0/2338914855 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc156ffd700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc158101c90 0x7fc1581963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc1577fe700 1 -- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc158101c90 msgr2=0x7fc1581963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc1577fe700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc158101c90 0x7fc1581963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc1577fe700 1 -- 172.21.15.98:0/2338914855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1480095f0 con 0x7fc1581012f0 2024-09-13T02:49:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc1577fe700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 0x7fc158195ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc148000c00 tx=0x7fc1480056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc154ff9700 1 -- 172.21.15.98:0/2338914855 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc14801d070 con 0x7fc1581012f0 2024-09-13T02:49:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc154ff9700 1 -- 172.21.15.98:0/2338914855 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc14800f460 con 0x7fc1581012f0 2024-09-13T02:49:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15819aa80 con 0x7fc1581012f0 2024-09-13T02:49:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc154ff9700 1 -- 172.21.15.98:0/2338914855 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc148021640 con 0x7fc1581012f0 2024-09-13T02:49:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.261+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15819afd0 con 0x7fc1581012f0 2024-09-13T02:49:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.262+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc15810d5e0 con 0x7fc1581012f0 2024-09-13T02:49:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.263+0000 7fc154ff9700 1 -- 172.21.15.98:0/2338914855 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc14800f5d0 con 0x7fc1581012f0 2024-09-13T02:49:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.263+0000 7fc154ff9700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc14006c680 0x7fc14006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.263+0000 7fc156ffd700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc14006c680 0x7fc14006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.263+0000 7fc154ff9700 1 -- 172.21.15.98:0/2338914855 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc14808c740 con 0x7fc1581012f0 2024-09-13T02:49:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.263+0000 7fc154ff9700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] conn(0x7fc140072210 0x7fc140074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.263+0000 7fc154ff9700 1 -- 172.21.15.98:0/2338914855 --> [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc140074cd0 con 0x7fc140072210 2024-09-13T02:49:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.263+0000 7fc154ff9700 1 -- 172.21.15.98:0/2338914855 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc14808ee10 con 0x7fc1581012f0 2024-09-13T02:49:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.264+0000 7fc157fff700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] conn(0x7fc140072210 0x7fc140074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.264+0000 7fc156ffd700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc14006c680 0x7fc14006eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc158197470 tx=0x7fc14c005cf0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.264+0000 7fc157fff700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] conn(0x7fc140072210 0x7fc140074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.265+0000 7fc154ff9700 1 -- 172.21.15.98:0/2338914855 <== osd.5 v2:172.21.15.142:6816/316032849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc140074cd0 con 0x7fc140072210 2024-09-13T02:49:01.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.281+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 --> [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc15804f2a0 con 0x7fc140072210 2024-09-13T02:49:01.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.281+0000 7fc154ff9700 1 -- 172.21.15.98:0/2338914855 <== osd.5 v2:172.21.15.142:6816/316032849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc15804f2a0 con 0x7fc140072210 2024-09-13T02:49:01.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.281+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] conn(0x7fc140072210 msgr2=0x7fc140074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:01.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.281+0000 7fc15db86700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] conn(0x7fc140072210 0x7fc140074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.281+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc14006c680 msgr2=0x7fc14006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:01.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.281+0000 7fc15db86700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc14006c680 0x7fc14006eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc158197470 tx=0x7fc14c005cf0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.281+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 msgr2=0x7fc158195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.281+0000 7fc15db86700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 0x7fc158195ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc148000c00 tx=0x7fc1480056a0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.282+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 shutdown_connections 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.282+0000 7fc15db86700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:6816/316032849,v1:172.21.15.142:6817/316032849] conn(0x7fc140072210 0x7fc140074620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.282+0000 7fc15db86700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fc14006c680 0x7fc14006eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.282+0000 7fc15db86700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1581012f0 0x7fc158195ea0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.282+0000 7fc15db86700 1 --2- 172.21.15.98:0/2338914855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc158101c90 0x7fc1581963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.282+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 >> 172.21.15.98:0/2338914855 conn(0x7fc1580fac80 msgr2=0x7fc158104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.282+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 shutdown_connections 2024-09-13T02:49:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:01.282+0000 7fc15db86700 1 -- 172.21.15.98:0/2338914855 wait complete. 2024-09-13T02:49:02.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:02 smithi098 ceph-mon[27886]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:02.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:02 smithi142 ceph-mon[33443]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.464+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/1256623705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d981004e0 msgr2=0x7f5d981008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.464+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/1256623705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d981004e0 0x7f5d981008b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009910 tx=0x7f5d88009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.464+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/1256623705 shutdown_connections 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.464+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/1256623705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d98100e80 0x7f5d98104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.464+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/1256623705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d981004e0 0x7f5d981008b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.464+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/1256623705 >> 172.21.15.98:0/1256623705 conn(0x7f5d980fbda0 msgr2=0x7f5d980fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.465+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/1256623705 shutdown_connections 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.465+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/1256623705 wait complete. 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.465+0000 7f5d9d3fd700 1 Processor -- start 2024-09-13T02:49:03.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d9d3fd700 1 -- start start 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d9d3fd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d981004e0 0x7f5d98073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d9d3fd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d98100e80 0x7f5d98073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d9d3fd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98073ad0 con 0x7f5d98100e80 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d9d3fd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98073c10 con 0x7f5d981004e0 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d967fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d98100e80 0x7f5d98073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d967fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d98100e80 0x7f5d98073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36022/0 (socket says 172.21.15.98:36022) 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d967fc700 1 -- 172.21.15.98:0/4114507549 learned_addr learned my addr 172.21.15.98:0/4114507549 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d96ffd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d981004e0 0x7f5d98073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d967fc700 1 -- 172.21.15.98:0/4114507549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d981004e0 msgr2=0x7f5d98073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d967fc700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d981004e0 0x7f5d98073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d967fc700 1 -- 172.21.15.98:0/4114507549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880095f0 con 0x7f5d98100e80 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.466+0000 7f5d967fc700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d98100e80 0x7f5d98073590 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00b480 tx=0x7f5d8c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:03.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.467+0000 7f5d7ffff700 1 -- 172.21.15.98:0/4114507549 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d8c0118c0 con 0x7f5d98100e80 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.467+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d981a2140 con 0x7f5d98100e80 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.467+0000 7f5d7ffff700 1 -- 172.21.15.98:0/4114507549 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d8c010380 con 0x7f5d98100e80 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.467+0000 7f5d7ffff700 1 -- 172.21.15.98:0/4114507549 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d8c00f4f0 con 0x7f5d98100e80 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.467+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d981a2550 con 0x7f5d98100e80 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.467+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d9810d6f0 con 0x7f5d98100e80 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.468+0000 7f5d7ffff700 1 -- 172.21.15.98:0/4114507549 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5d8c0104f0 con 0x7f5d98100e80 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.468+0000 7f5d7ffff700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5d8006c680 0x7f5d8006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.469+0000 7f5d96ffd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5d8006c680 0x7f5d8006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.469+0000 7f5d7ffff700 1 -- 172.21.15.98:0/4114507549 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f5d8c08b0e0 con 0x7f5d98100e80 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.469+0000 7f5d7ffff700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] conn(0x7f5d80072210 0x7f5d80074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.469+0000 7f5d7ffff700 1 -- 172.21.15.98:0/4114507549 --> [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d80074cd0 con 0x7f5d80072210 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.469+0000 7f5d7ffff700 1 -- 172.21.15.98:0/4114507549 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d8c08d7b0 con 0x7f5d98100e80 2024-09-13T02:49:03.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.469+0000 7f5d977fe700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] conn(0x7f5d80072210 0x7f5d80074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:03.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.469+0000 7f5d96ffd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5d8006c680 0x7f5d8006eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800b5c0 tx=0x7f5d88005960 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:03.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.469+0000 7f5d977fe700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] conn(0x7f5d80072210 0x7f5d80074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:03.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.470+0000 7f5d7ffff700 1 -- 172.21.15.98:0/4114507549 <== osd.1 v2:172.21.15.98:6810/4064465963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5d80074cd0 con 0x7f5d80072210 2024-09-13T02:49:03.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.485+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 --> [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d9804f2a0 con 0x7f5d80072210 2024-09-13T02:49:03.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d7ffff700 1 -- 172.21.15.98:0/4114507549 <== osd.1 v2:172.21.15.98:6810/4064465963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d9804f2a0 con 0x7f5d80072210 2024-09-13T02:49:03.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] conn(0x7f5d80072210 msgr2=0x7f5d80074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:03.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] conn(0x7f5d80072210 0x7f5d80074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:03.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5d8006c680 msgr2=0x7f5d8006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:03.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5d8006c680 0x7f5d8006eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800b5c0 tx=0x7f5d88005960 comp rx=0 tx=0).stop 2024-09-13T02:49:03.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d98100e80 msgr2=0x7f5d98073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:03.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d98100e80 0x7f5d98073590 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00b480 tx=0x7f5d8c00b840 comp rx=0 tx=0).stop 2024-09-13T02:49:03.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 shutdown_connections 2024-09-13T02:49:03.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6810/4064465963,v1:172.21.15.98:6811/4064465963] conn(0x7f5d80072210 0x7f5d80074620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:03.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5d8006c680 0x7f5d8006eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:03.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d981004e0 0x7f5d98073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:03.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 --2- 172.21.15.98:0/4114507549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d98100e80 0x7f5d98073590 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:03.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 >> 172.21.15.98:0/4114507549 conn(0x7f5d980fbda0 msgr2=0x7f5d980fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:03.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 shutdown_connections 2024-09-13T02:49:03.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:03.486+0000 7f5d9d3fd700 1 -- 172.21.15.98:0/4114507549 wait complete. 2024-09-13T02:49:03.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:03 smithi098 ceph-mon[27886]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:03.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:03 smithi142 ceph-mon[33443]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:04.389 INFO:teuthology.orchestra.run.smithi098.stdout:171798691847 2024-09-13T02:49:04.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T02:49:05.067 INFO:teuthology.orchestra.run.smithi098.stdout:60129542173 2024-09-13T02:49:05.067 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T02:49:05.159 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:04 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:05.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:04 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:05.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:05 smithi098 ceph-mon[27886]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:06.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.217+0000 7f5116b12700 1 -- 172.21.15.98:0/154250131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51101004e0 msgr2=0x7f51101008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.217+0000 7f5116b12700 1 --2- 172.21.15.98:0/154250131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51101004e0 0x7f51101008b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5104009910 tx=0x7f5104009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.217+0000 7f5116b12700 1 -- 172.21.15.98:0/154250131 shutdown_connections 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.217+0000 7f5116b12700 1 --2- 172.21.15.98:0/154250131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5110100e80 0x7f5110104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.217+0000 7f5116b12700 1 --2- 172.21.15.98:0/154250131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f51101004e0 0x7f51101008b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.217+0000 7f5116b12700 1 -- 172.21.15.98:0/154250131 >> 172.21.15.98:0/154250131 conn(0x7f51100fbda0 msgr2=0x7f51100fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.217+0000 7f5116b12700 1 -- 172.21.15.98:0/154250131 shutdown_connections 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.217+0000 7f5116b12700 1 -- 172.21.15.98:0/154250131 wait complete. 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.218+0000 7f5116b12700 1 Processor -- start 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.218+0000 7f5116b12700 1 -- start start 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.218+0000 7f5116b12700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51101004e0 0x7f5110198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:06.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.218+0000 7f5116b12700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5110100e80 0x7f51101986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.218+0000 7f5116b12700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5110198d90 con 0x7f5110100e80 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.218+0000 7f5116b12700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511019cb20 con 0x7f51101004e0 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.218+0000 7f510ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5110100e80 0x7f51101986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.218+0000 7f510ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5110100e80 0x7f51101986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50396/0 (socket says 172.21.15.98:50396) 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.218+0000 7f510ffff700 1 -- 172.21.15.98:0/809231670 learned_addr learned my addr 172.21.15.98:0/809231670 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f51148ae700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51101004e0 0x7f5110198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f510ffff700 1 -- 172.21.15.98:0/809231670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51101004e0 msgr2=0x7f5110198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f510ffff700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51101004e0 0x7f5110198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f510ffff700 1 -- 172.21.15.98:0/809231670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51040095f0 con 0x7f5110100e80 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f510ffff700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5110100e80 0x7f51101986b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b480 tx=0x7f50fc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f510dffb700 1 -- 172.21.15.98:0/809231670 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50fc0118c0 con 0x7f5110100e80 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f510dffb700 1 -- 172.21.15.98:0/809231670 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f50fc010380 con 0x7f5110100e80 2024-09-13T02:49:06.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511019ce00 con 0x7f5110100e80 2024-09-13T02:49:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f510dffb700 1 -- 172.21.15.98:0/809231670 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50fc00f4f0 con 0x7f5110100e80 2024-09-13T02:49:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.219+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511019d350 con 0x7f5110100e80 2024-09-13T02:49:06.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.220+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f511010d6f0 con 0x7f5110100e80 2024-09-13T02:49:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.220+0000 7f510dffb700 1 -- 172.21.15.98:0/809231670 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f50fc0104f0 con 0x7f5110100e80 2024-09-13T02:49:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.221+0000 7f510dffb700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f510006c680 0x7f510006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.221+0000 7f510dffb700 1 -- 172.21.15.98:0/809231670 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f50fc08b0e0 con 0x7f5110100e80 2024-09-13T02:49:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.221+0000 7f51148ae700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f510006c680 0x7f510006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.221+0000 7f510dffb700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] conn(0x7f5100072210 0x7f5100074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:06.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.221+0000 7f510dffb700 1 -- 172.21.15.98:0/809231670 --> [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5100074cd0 con 0x7f5100072210 2024-09-13T02:49:06.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.221+0000 7f510dffb700 1 -- 172.21.15.98:0/809231670 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50fc08d7b0 con 0x7f5110100e80 2024-09-13T02:49:06.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.221+0000 7f51150af700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] conn(0x7f5100072210 0x7f5100074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:06.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.221+0000 7f51148ae700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f510006c680 0x7f510006eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f510400b5c0 tx=0x7f510401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:06.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.222+0000 7f51150af700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] conn(0x7f5100072210 0x7f5100074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:06.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.222+0000 7f510dffb700 1 -- 172.21.15.98:0/809231670 <== osd.2 v2:172.21.15.98:6818/14531122 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5100074cd0 con 0x7f5100072210 2024-09-13T02:49:06.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 --> [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f511004f2a0 con 0x7f5100072210 2024-09-13T02:49:06.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f510dffb700 1 -- 172.21.15.98:0/809231670 <== osd.2 v2:172.21.15.98:6818/14531122 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f511004f2a0 con 0x7f5100072210 2024-09-13T02:49:06.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] conn(0x7f5100072210 msgr2=0x7f5100074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] conn(0x7f5100072210 0x7f5100074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f510006c680 msgr2=0x7f510006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f510006c680 0x7f510006eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f510400b5c0 tx=0x7f510401a040 comp rx=0 tx=0).stop 2024-09-13T02:49:06.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5110100e80 msgr2=0x7f51101986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5110100e80 0x7f51101986b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b480 tx=0x7f50fc00b840 comp rx=0 tx=0).stop 2024-09-13T02:49:06.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 shutdown_connections 2024-09-13T02:49:06.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6818/14531122,v1:172.21.15.98:6819/14531122] conn(0x7f5100072210 0x7f5100074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f510006c680 0x7f510006eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51101004e0 0x7f5110198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 --2- 172.21.15.98:0/809231670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5110100e80 0x7f51101986b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 >> 172.21.15.98:0/809231670 conn(0x7f51100fbda0 msgr2=0x7f51100fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:06.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.238+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 shutdown_connections 2024-09-13T02:49:06.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.239+0000 7f5116b12700 1 -- 172.21.15.98:0/809231670 wait complete. 2024-09-13T02:49:06.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:05 smithi142 ceph-mon[33443]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:06.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.417+0000 7f3445b04700 1 -- 172.21.15.98:0/3901441251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ffc60 msgr2=0x7f344010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.417+0000 7f3445b04700 1 --2- 172.21.15.98:0/3901441251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ffc60 0x7f344010a6d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3434009910 tx=0x7f3434009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.417+0000 7f3445b04700 1 -- 172.21.15.98:0/3901441251 shutdown_connections 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.417+0000 7f3445b04700 1 --2- 172.21.15.98:0/3901441251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ffc60 0x7f344010a6d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.417+0000 7f3445b04700 1 --2- 172.21.15.98:0/3901441251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400ff350 0x7f34400ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.417+0000 7f3445b04700 1 -- 172.21.15.98:0/3901441251 >> 172.21.15.98:0/3901441251 conn(0x7f34400748b0 msgr2=0x7f3440074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.417+0000 7f3445b04700 1 -- 172.21.15.98:0/3901441251 shutdown_connections 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.417+0000 7f3445b04700 1 -- 172.21.15.98:0/3901441251 wait complete. 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.418+0000 7f3445b04700 1 Processor -- start 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.418+0000 7f3445b04700 1 -- start start 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.418+0000 7f3445b04700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ff350 0x7f3440195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:06.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.418+0000 7f3445b04700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400ffc60 0x7f3440196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.418+0000 7f3445b04700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440196b50 con 0x7f34400ff350 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.418+0000 7f3445b04700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344019a8e0 con 0x7f34400ffc60 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.418+0000 7f343f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ff350 0x7f3440195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.418+0000 7f343f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ff350 0x7f3440195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50412/0 (socket says 172.21.15.98:50412) 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.418+0000 7f343f7fe700 1 -- 172.21.15.98:0/2059457417 learned_addr learned my addr 172.21.15.98:0/2059457417 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f343effd700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400ffc60 0x7f3440196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f343f7fe700 1 -- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400ffc60 msgr2=0x7f3440196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f343f7fe700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400ffc60 0x7f3440196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f343f7fe700 1 -- 172.21.15.98:0/2059457417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34340095f0 con 0x7f34400ff350 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f343f7fe700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ff350 0x7f3440195f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f343000b480 tx=0x7f343000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f343cff9700 1 -- 172.21.15.98:0/2059457417 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3430011800 con 0x7f34400ff350 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344019abc0 con 0x7f34400ff350 2024-09-13T02:49:06.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f343cff9700 1 -- 172.21.15.98:0/2059457417 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3430011e10 con 0x7f34400ff350 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f343cff9700 1 -- 172.21.15.98:0/2059457417 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3430010ea0 con 0x7f34400ff350 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.419+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344019b110 con 0x7f34400ff350 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.420+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f344010d7d0 con 0x7f34400ff350 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.421+0000 7f343cff9700 1 -- 172.21.15.98:0/2059457417 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3430010380 con 0x7f34400ff350 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.421+0000 7f343cff9700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f342806c680 0x7f342806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.421+0000 7f343cff9700 1 -- 172.21.15.98:0/2059457417 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f343008b000 con 0x7f34400ff350 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.421+0000 7f343effd700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f342806c680 0x7f342806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.421+0000 7f343cff9700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] conn(0x7f3428072210 0x7f3428074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.421+0000 7f343cff9700 1 -- 172.21.15.98:0/2059457417 --> [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3428074cd0 con 0x7f3428072210 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.421+0000 7f343cff9700 1 -- 172.21.15.98:0/2059457417 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f343008d6d0 con 0x7f34400ff350 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.421+0000 7f343effd700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f342806c680 0x7f342806eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3440197550 tx=0x7f343401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.422+0000 7f343ffff700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] conn(0x7f3428072210 0x7f3428074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:06.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.422+0000 7f343ffff700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] conn(0x7f3428072210 0x7f3428074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:06.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.423+0000 7f343cff9700 1 -- 172.21.15.98:0/2059457417 <== osd.3 v2:172.21.15.142:6800/1321061843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3428074cd0 con 0x7f3428072210 2024-09-13T02:49:06.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.438+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 --> [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f344004f2a0 con 0x7f3428072210 2024-09-13T02:49:06.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.439+0000 7f343cff9700 1 -- 172.21.15.98:0/2059457417 <== osd.3 v2:172.21.15.142:6800/1321061843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f344004f2a0 con 0x7f3428072210 2024-09-13T02:49:06.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.439+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] conn(0x7f3428072210 msgr2=0x7f3428074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.439+0000 7f3445b04700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] conn(0x7f3428072210 0x7f3428074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.439+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f342806c680 msgr2=0x7f342806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.439+0000 7f3445b04700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f342806c680 0x7f342806eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3440197550 tx=0x7f343401a040 comp rx=0 tx=0).stop 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.439+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ff350 msgr2=0x7f3440195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.439+0000 7f3445b04700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ff350 0x7f3440195f30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f343000b480 tx=0x7f343000b790 comp rx=0 tx=0).stop 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.440+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 shutdown_connections 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.440+0000 7f3445b04700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:6800/1321061843,v1:172.21.15.142:6801/1321061843] conn(0x7f3428072210 0x7f3428074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.440+0000 7f3445b04700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f342806c680 0x7f342806eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.440+0000 7f3445b04700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34400ff350 0x7f3440195f30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.440+0000 7f3445b04700 1 --2- 172.21.15.98:0/2059457417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34400ffc60 0x7f3440196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.440+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 >> 172.21.15.98:0/2059457417 conn(0x7f34400748b0 msgr2=0x7f3440104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.440+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 shutdown_connections 2024-09-13T02:49:06.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:06.440+0000 7f3445b04700 1 -- 172.21.15.98:0/2059457417 wait complete. 2024-09-13T02:49:07.556 INFO:teuthology.orchestra.run.smithi098.stdout:81604378649 2024-09-13T02:49:07.557 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T02:49:07.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.771+0000 7fe3279c0700 1 -- 172.21.15.98:0/2760982774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 msgr2=0x7fe320104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.771+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2760982774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 0x7fe320104500 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009990 tx=0x7fe31c009ca0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.771+0000 7fe3279c0700 1 -- 172.21.15.98:0/2760982774 shutdown_connections 2024-09-13T02:49:07.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.771+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2760982774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3200ffbd0 0x7fe320100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.771+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2760982774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 0x7fe320104500 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.771+0000 7fe3279c0700 1 -- 172.21.15.98:0/2760982774 >> 172.21.15.98:0/2760982774 conn(0x7fe320075130 msgr2=0x7fe320075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.771+0000 7fe3279c0700 1 -- 172.21.15.98:0/2760982774 shutdown_connections 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.771+0000 7fe3279c0700 1 -- 172.21.15.98:0/2760982774 wait complete. 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.771+0000 7fe3279c0700 1 Processor -- start 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe3279c0700 1 -- start start 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe3279c0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3200ffbd0 0x7fe320199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe3279c0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 0x7fe320199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe3279c0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe320193a40 con 0x7fe320104130 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe3279c0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe320193bb0 con 0x7fe3200ffbd0 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe324f5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 0x7fe320199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe324f5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 0x7fe320199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50432/0 (socket says 172.21.15.98:50432) 2024-09-13T02:49:07.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe324f5b700 1 -- 172.21.15.98:0/2601779667 learned_addr learned my addr 172.21.15.98:0/2601779667 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe32575c700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3200ffbd0 0x7fe320199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe324f5b700 1 -- 172.21.15.98:0/2601779667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3200ffbd0 msgr2=0x7fe320199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe324f5b700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3200ffbd0 0x7fe320199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe324f5b700 1 -- 172.21.15.98:0/2601779667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0095f0 con 0x7fe320104130 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.772+0000 7fe324f5b700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 0x7fe320199f90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe31000d8d0 tx=0x7fe31000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.773+0000 7fe3167fc700 1 -- 172.21.15.98:0/2601779667 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3100098a0 con 0x7fe320104130 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.773+0000 7fe3167fc700 1 -- 172.21.15.98:0/2601779667 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe310010460 con 0x7fe320104130 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.773+0000 7fe3167fc700 1 -- 172.21.15.98:0/2601779667 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe31000f5f0 con 0x7fe320104130 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.773+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe320193e90 con 0x7fe320104130 2024-09-13T02:49:07.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.773+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3201943e0 con 0x7fe320104130 2024-09-13T02:49:07.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.774+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe32004f2a0 con 0x7fe320104130 2024-09-13T02:49:07.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.774+0000 7fe3167fc700 1 -- 172.21.15.98:0/2601779667 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe310009a00 con 0x7fe320104130 2024-09-13T02:49:07.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.775+0000 7fe3167fc700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe30c06c680 0x7fe30c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.775+0000 7fe3167fc700 1 -- 172.21.15.98:0/2601779667 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe31008b920 con 0x7fe320104130 2024-09-13T02:49:07.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.775+0000 7fe32575c700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe30c06c680 0x7fe30c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.775+0000 7fe3167fc700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] conn(0x7fe30c072210 0x7fe30c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.775+0000 7fe3167fc700 1 -- 172.21.15.98:0/2601779667 --> [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe30c074cd0 con 0x7fe30c072210 2024-09-13T02:49:07.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.775+0000 7fe3167fc700 1 -- 172.21.15.98:0/2601779667 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe31008bd20 con 0x7fe320104130 2024-09-13T02:49:07.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.775+0000 7fe325f5d700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] conn(0x7fe30c072210 0x7fe30c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.776+0000 7fe325f5d700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] conn(0x7fe30c072210 0x7fe30c074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:07.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.776+0000 7fe32575c700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe30c06c680 0x7fe30c06eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c009ee0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:07.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.776+0000 7fe3167fc700 1 -- 172.21.15.98:0/2601779667 <== osd.0 v2:172.21.15.98:6802/922771257 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe30c074cd0 con 0x7fe30c072210 2024-09-13T02:49:07.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.797+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 --> [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe32010b470 con 0x7fe30c072210 2024-09-13T02:49:07.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.797+0000 7fe3167fc700 1 -- 172.21.15.98:0/2601779667 <== osd.0 v2:172.21.15.98:6802/922771257 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe32010b470 con 0x7fe30c072210 2024-09-13T02:49:07.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.797+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] conn(0x7fe30c072210 msgr2=0x7fe30c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.797+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] conn(0x7fe30c072210 0x7fe30c074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.797+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe30c06c680 msgr2=0x7fe30c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.797+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe30c06c680 0x7fe30c06eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c009ee0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.797+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 msgr2=0x7fe320199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.797+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 0x7fe320199f90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe31000d8d0 tx=0x7fe31000dbe0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.798+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 shutdown_connections 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.798+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6802/922771257,v1:172.21.15.98:6803/922771257] conn(0x7fe30c072210 0x7fe30c074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.798+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe30c06c680 0x7fe30c06eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.798+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3200ffbd0 0x7fe320199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.798+0000 7fe3279c0700 1 --2- 172.21.15.98:0/2601779667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe320104130 0x7fe320199f90 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe31000d8d0 tx=0x7fe31000dbe0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.798+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 >> 172.21.15.98:0/2601779667 conn(0x7fe320075130 msgr2=0x7fe3200feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:07.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.798+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 shutdown_connections 2024-09-13T02:49:07.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:07.798+0000 7fe3279c0700 1 -- 172.21.15.98:0/2601779667 wait complete. 2024-09-13T02:49:08.116 INFO:teuthology.orchestra.run.smithi098.stdout:115964117011 2024-09-13T02:49:08.117 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T02:49:08.373 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:08.385 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:08 smithi098 ceph-mon[27886]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:08.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:08 smithi142 ceph-mon[33443]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:08.909 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:08.909 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:08.936 INFO:teuthology.orchestra.run.smithi098.stdout:38654705700 2024-09-13T02:49:08.937 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T02:49:10.478 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:10 smithi098 ceph-mon[27886]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:10.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:10 smithi142 ceph-mon[33443]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:11.840 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:11.840 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:12.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:12 smithi098 ceph-mon[27886]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:12.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:12 smithi142 ceph-mon[33443]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:13.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.012+0000 7f731a15f700 1 -- 172.21.15.98:0/1716922605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ff3c0 msgr2=0x7f73140ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:13.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.012+0000 7f731a15f700 1 --2- 172.21.15.98:0/1716922605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ff3c0 0x7f73140ff790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7304009910 tx=0x7f7304009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:13.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.012+0000 7f731a15f700 1 -- 172.21.15.98:0/1716922605 shutdown_connections 2024-09-13T02:49:13.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.012+0000 7f731a15f700 1 --2- 172.21.15.98:0/1716922605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140ffd60 0x7f7314103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.012+0000 7f731a15f700 1 --2- 172.21.15.98:0/1716922605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ff3c0 0x7f73140ff790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.012+0000 7f731a15f700 1 -- 172.21.15.98:0/1716922605 >> 172.21.15.98:0/1716922605 conn(0x7f73140fac80 msgr2=0x7f73140fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:13.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.012+0000 7f731a15f700 1 -- 172.21.15.98:0/1716922605 shutdown_connections 2024-09-13T02:49:13.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.012+0000 7f731a15f700 1 -- 172.21.15.98:0/1716922605 wait complete. 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f731a15f700 1 Processor -- start 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f731a15f700 1 -- start start 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f731a15f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140ff3c0 0x7f7314194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f731a15f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ffd60 0x7f73141952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f731a15f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73141959a0 con 0x7f73140ffd60 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f731a15f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7314199730 con 0x7f73140ff3c0 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f7312ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ffd60 0x7f73141952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f7312ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ffd60 0x7f73141952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50454/0 (socket says 172.21.15.98:50454) 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f7312ffd700 1 -- 172.21.15.98:0/1768028074 learned_addr learned my addr 172.21.15.98:0/1768028074 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f73137fe700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140ff3c0 0x7f7314194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:13.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f7312ffd700 1 -- 172.21.15.98:0/1768028074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140ff3c0 msgr2=0x7f7314194d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:13.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f7312ffd700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140ff3c0 0x7f7314194d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.013+0000 7f7312ffd700 1 -- 172.21.15.98:0/1768028074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040095f0 con 0x7f73140ffd60 2024-09-13T02:49:13.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.014+0000 7f7312ffd700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ffd60 0x7f73141952c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f730800d900 tx=0x7f730800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:13.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.014+0000 7f7310ff9700 1 -- 172.21.15.98:0/1768028074 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7308009900 con 0x7f73140ffd60 2024-09-13T02:49:13.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.014+0000 7f7310ff9700 1 -- 172.21.15.98:0/1768028074 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7308010460 con 0x7f73140ffd60 2024-09-13T02:49:13.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.014+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7314199a10 con 0x7f73140ffd60 2024-09-13T02:49:13.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.014+0000 7f7310ff9700 1 -- 172.21.15.98:0/1768028074 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730800f5f0 con 0x7f73140ffd60 2024-09-13T02:49:13.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.014+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7314199f60 con 0x7f73140ffd60 2024-09-13T02:49:13.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.015+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73141076d0 con 0x7f73140ffd60 2024-09-13T02:49:13.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.015+0000 7f7310ff9700 1 -- 172.21.15.98:0/1768028074 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f730800f870 con 0x7f73140ffd60 2024-09-13T02:49:13.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.016+0000 7f7310ff9700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f72fc06c680 0x7f72fc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:13.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.016+0000 7f73137fe700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f72fc06c680 0x7f72fc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:13.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.016+0000 7f7310ff9700 1 -- 172.21.15.98:0/1768028074 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f730808b0a0 con 0x7f73140ffd60 2024-09-13T02:49:13.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.016+0000 7f73137fe700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f72fc06c680 0x7f72fc06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7304006010 tx=0x7f730401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:13.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.020+0000 7f7310ff9700 1 -- 172.21.15.98:0/1768028074 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7308055c40 con 0x7f73140ffd60 2024-09-13T02:49:13.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.216+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f731419a180 con 0x7f73140ffd60 2024-09-13T02:49:13.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.217+0000 7f7310ff9700 1 -- 172.21.15.98:0/1768028074 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7308059260 con 0x7f73140ffd60 2024-09-13T02:49:13.218 INFO:teuthology.orchestra.run.smithi098.stdout:81604378650 2024-09-13T02:49:13.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f72fc06c680 msgr2=0x7f72fc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:13.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f72fc06c680 0x7f72fc06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7304006010 tx=0x7f730401a040 comp rx=0 tx=0).stop 2024-09-13T02:49:13.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ffd60 msgr2=0x7f73141952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:13.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ffd60 0x7f73141952c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f730800d900 tx=0x7f730800dc10 comp rx=0 tx=0).stop 2024-09-13T02:49:13.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 shutdown_connections 2024-09-13T02:49:13.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f72fc06c680 0x7f72fc06eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73140ff3c0 0x7f7314194d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 --2- 172.21.15.98:0/1768028074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73140ffd60 0x7f73141952c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 >> 172.21.15.98:0/1768028074 conn(0x7f73140fac80 msgr2=0x7f73140fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:13.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 shutdown_connections 2024-09-13T02:49:13.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.219+0000 7f731a15f700 1 -- 172.21.15.98:0/1768028074 wait complete. 2024-09-13T02:49:13.439 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:13 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1768028074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T02:49:13.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:13 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1768028074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T02:49:14.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.232+0000 7fcfdaae4700 1 -- 172.21.15.98:0/3353151325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd40ffbd0 msgr2=0x7fcfd4100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.232+0000 7fcfdaae4700 1 --2- 172.21.15.98:0/3353151325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd40ffbd0 0x7fcfd4100040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009910 tx=0x7fcfc0009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.233+0000 7fcfdaae4700 1 -- 172.21.15.98:0/3353151325 shutdown_connections 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.233+0000 7fcfdaae4700 1 --2- 172.21.15.98:0/3353151325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd40ffbd0 0x7fcfd4100040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.233+0000 7fcfdaae4700 1 --2- 172.21.15.98:0/3353151325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd4104130 0x7fcfd4104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.233+0000 7fcfdaae4700 1 -- 172.21.15.98:0/3353151325 >> 172.21.15.98:0/3353151325 conn(0x7fcfd4075130 msgr2=0x7fcfd4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.233+0000 7fcfdaae4700 1 -- 172.21.15.98:0/3353151325 shutdown_connections 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.233+0000 7fcfdaae4700 1 -- 172.21.15.98:0/3353151325 wait complete. 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfdaae4700 1 Processor -- start 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfdaae4700 1 -- start start 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfdaae4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd40ffbd0 0x7fcfd4196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:14.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfdaae4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4104130 0x7fcfd4197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfdaae4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4197860 con 0x7fcfd4104130 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfdaae4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd41979a0 con 0x7fcfd40ffbd0 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfd3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4104130 0x7fcfd4197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfd8880700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd40ffbd0 0x7fcfd4196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfd3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4104130 0x7fcfd4197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50474/0 (socket says 172.21.15.98:50474) 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.234+0000 7fcfd3fff700 1 -- 172.21.15.98:0/1539430237 learned_addr learned my addr 172.21.15.98:0/1539430237 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfd3fff700 1 -- 172.21.15.98:0/1539430237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd40ffbd0 msgr2=0x7fcfd4196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfd3fff700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd40ffbd0 0x7fcfd4196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfd3fff700 1 -- 172.21.15.98:0/1539430237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00095f0 con 0x7fcfd4104130 2024-09-13T02:49:14.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfd8880700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd40ffbd0 0x7fcfd4196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfd3fff700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4104130 0x7fcfd4197180 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0000c00 tx=0x7fcfc000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfd1ffb700 1 -- 172.21.15.98:0/1539430237 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc001d070 con 0x7fcfd4104130 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfd1ffb700 1 -- 172.21.15.98:0/1539430237 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcfc0005dc0 con 0x7fcfd4104130 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd419fcb0 con 0x7fcfd4104130 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfd1ffb700 1 -- 172.21.15.98:0/1539430237 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc0022470 con 0x7fcfd4104130 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.235+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd41a00d0 con 0x7fcfd4104130 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.236+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd404f2a0 con 0x7fcfd4104130 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.237+0000 7fcfd1ffb700 1 -- 172.21.15.98:0/1539430237 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcfc000f9f0 con 0x7fcfd4104130 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.238+0000 7fcfd1ffb700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfc406c680 0x7fcfc406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:14.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.238+0000 7fcfd8880700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfc406c680 0x7fcfc406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:14.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.238+0000 7fcfd1ffb700 1 -- 172.21.15.98:0/1539430237 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fcfc008c8c0 con 0x7fcfd4104130 2024-09-13T02:49:14.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.238+0000 7fcfd8880700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfc406c680 0x7fcfc406eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8011490 tx=0x7fcfc8009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:14.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.242+0000 7fcfd1ffb700 1 -- 172.21.15.98:0/1539430237 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcfc0057380 con 0x7fcfd4104130 2024-09-13T02:49:14.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.437+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcfd41a03d0 con 0x7fcfd4104130 2024-09-13T02:49:14.037 INFO:teuthology.orchestra.run.smithi098.stdout:60129542175 2024-09-13T02:49:14.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.438+0000 7fcfd1ffb700 1 -- 172.21.15.98:0/1539430237 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfc005a9a0 con 0x7fcfd4104130 2024-09-13T02:49:14.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfc406c680 msgr2=0x7fcfc406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:14.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfc406c680 0x7fcfc406eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8011490 tx=0x7fcfc8009260 comp rx=0 tx=0).stop 2024-09-13T02:49:14.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4104130 msgr2=0x7fcfd4197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:14.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4104130 0x7fcfd4197180 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0000c00 tx=0x7fcfc000f690 comp rx=0 tx=0).stop 2024-09-13T02:49:14.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 shutdown_connections 2024-09-13T02:49:14.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcfc406c680 0x7fcfc406eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:14.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd40ffbd0 0x7fcfd4196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:14.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 --2- 172.21.15.98:0/1539430237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcfd4104130 0x7fcfd4197180 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:14.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 >> 172.21.15.98:0/1539430237 conn(0x7fcfd4075130 msgr2=0x7fcfd40feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:14.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 shutdown_connections 2024-09-13T02:49:14.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:13.440+0000 7fcfdaae4700 1 -- 172.21.15.98:0/1539430237 wait complete. 2024-09-13T02:49:14.462 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:14 smithi098 ceph-mon[27886]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:14.462 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:14 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1539430237' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T02:49:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:14 smithi142 ceph-mon[33443]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:14 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1539430237' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T02:49:14.648 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542175 for osd.1 2024-09-13T02:49:14.649 DEBUG:teuthology.parallel:result is None 2024-09-13T02:49:15.361 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378650 for osd.2 2024-09-13T02:49:15.361 DEBUG:teuthology.parallel:result is None 2024-09-13T02:49:15.612 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:15.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.799+0000 7f93efc7b700 1 -- 172.21.15.98:0/2590944045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 msgr2=0x7f93e80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:15.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.799+0000 7f93efc7b700 1 --2- 172.21.15.98:0/2590944045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 0x7f93e80689b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009910 tx=0x7f93d8009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:15.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 -- 172.21.15.98:0/2590944045 shutdown_connections 2024-09-13T02:49:15.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 --2- 172.21.15.98:0/2590944045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 0x7f93e80689b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 --2- 172.21.15.98:0/2590944045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e8101000 0x7f93e81013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 -- 172.21.15.98:0/2590944045 >> 172.21.15.98:0/2590944045 conn(0x7f93e8075130 msgr2=0x7f93e8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 -- 172.21.15.98:0/2590944045 shutdown_connections 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 -- 172.21.15.98:0/2590944045 wait complete. 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 Processor -- start 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 -- start start 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 0x7f93e8198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e8101000 0x7f93e81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8198c90 con 0x7f93e8068540 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.800+0000 7f93efc7b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e819ca20 con 0x7f93e8101000 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93eda17700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 0x7f93e8198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:15.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93eda17700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 0x7f93e8198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48924/0 (socket says 172.21.15.98:48924) 2024-09-13T02:49:15.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93eda17700 1 -- 172.21.15.98:0/1240059785 learned_addr learned my addr 172.21.15.98:0/1240059785 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:15.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93ed216700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e8101000 0x7f93e81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:15.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93eda17700 1 -- 172.21.15.98:0/1240059785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e8101000 msgr2=0x7f93e81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:15.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93eda17700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e8101000 0x7f93e81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:15.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93eda17700 1 -- 172.21.15.98:0/1240059785 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80095f0 con 0x7f93e8068540 2024-09-13T02:49:15.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93eda17700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 0x7f93e8198070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93e400d8d0 tx=0x7f93e400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:15.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93deffd700 1 -- 172.21.15.98:0/1240059785 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e40098a0 con 0x7f93e8068540 2024-09-13T02:49:15.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93deffd700 1 -- 172.21.15.98:0/1240059785 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f93e4010460 con 0x7f93e8068540 2024-09-13T02:49:15.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e819cd00 con 0x7f93e8068540 2024-09-13T02:49:15.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93deffd700 1 -- 172.21.15.98:0/1240059785 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e400f5f0 con 0x7f93e8068540 2024-09-13T02:49:15.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.801+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e819d220 con 0x7f93e8068540 2024-09-13T02:49:15.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.802+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e804f2a0 con 0x7f93e8068540 2024-09-13T02:49:15.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.803+0000 7f93deffd700 1 -- 172.21.15.98:0/1240059785 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f93e4009a00 con 0x7f93e8068540 2024-09-13T02:49:15.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.803+0000 7f93deffd700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f93d406c680 0x7f93d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:15.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.803+0000 7f93deffd700 1 -- 172.21.15.98:0/1240059785 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f93e408b2d0 con 0x7f93e8068540 2024-09-13T02:49:15.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.803+0000 7f93ed216700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f93d406c680 0x7f93d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:15.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.804+0000 7f93ed216700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f93d406c680 0x7f93d406eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f93d800b5c0 tx=0x7f93d801a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:15.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:15.808+0000 7f93deffd700 1 -- 172.21.15.98:0/1240059785 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f93e4055e10 con 0x7f93e8068540 2024-09-13T02:49:16.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.002+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f93e819d530 con 0x7f93e8068540 2024-09-13T02:49:16.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.002+0000 7f93deffd700 1 -- 172.21.15.98:0/1240059785 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93e4059430 con 0x7f93e8068540 2024-09-13T02:49:16.004 INFO:teuthology.orchestra.run.smithi098.stdout:115964117013 2024-09-13T02:49:16.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f93d406c680 msgr2=0x7f93d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:16.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f93d406c680 0x7f93d406eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f93d800b5c0 tx=0x7f93d801a040 comp rx=0 tx=0).stop 2024-09-13T02:49:16.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 msgr2=0x7f93e8198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:16.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 0x7f93e8198070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93e400d8d0 tx=0x7f93e400dbe0 comp rx=0 tx=0).stop 2024-09-13T02:49:16.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 shutdown_connections 2024-09-13T02:49:16.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f93d406c680 0x7f93d406eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:16.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93e8068540 0x7f93e8198070 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:16.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 --2- 172.21.15.98:0/1240059785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93e8101000 0x7f93e81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:16.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 >> 172.21.15.98:0/1240059785 conn(0x7f93e8075130 msgr2=0x7f93e80fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:16.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 shutdown_connections 2024-09-13T02:49:16.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:16.005+0000 7f93efc7b700 1 -- 172.21.15.98:0/1240059785 wait complete. 2024-09-13T02:49:16.342 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:16 smithi098 ceph-mon[27886]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:16.342 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:16 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1240059785' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T02:49:16.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:16 smithi142 ceph-mon[33443]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:16.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:16 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1240059785' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T02:49:17.268 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117013 for osd.3 2024-09-13T02:49:17.268 DEBUG:teuthology.parallel:result is None 2024-09-13T02:49:18.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:18 smithi142 ceph-mon[33443]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:18.553 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:18 smithi098 ceph-mon[27886]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:19.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.404+0000 7fa433765700 1 -- 172.21.15.98:0/3348475405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 msgr2=0x7fa42c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:19.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.404+0000 7fa433765700 1 --2- 172.21.15.98:0/3348475405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 0x7fa42c100040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009910 tx=0x7fa41c009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:19.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.404+0000 7fa433765700 1 -- 172.21.15.98:0/3348475405 shutdown_connections 2024-09-13T02:49:19.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.404+0000 7fa433765700 1 --2- 172.21.15.98:0/3348475405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 0x7fa42c100040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:19.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.404+0000 7fa433765700 1 --2- 172.21.15.98:0/3348475405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42c104130 0x7fa42c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:19.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.404+0000 7fa433765700 1 -- 172.21.15.98:0/3348475405 >> 172.21.15.98:0/3348475405 conn(0x7fa42c075130 msgr2=0x7fa42c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:19.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.404+0000 7fa433765700 1 -- 172.21.15.98:0/3348475405 shutdown_connections 2024-09-13T02:49:19.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.404+0000 7fa433765700 1 -- 172.21.15.98:0/3348475405 wait complete. 2024-09-13T02:49:19.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.404+0000 7fa433765700 1 Processor -- start 2024-09-13T02:49:19.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa433765700 1 -- start start 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa433765700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 0x7fa42c195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa433765700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42c104130 0x7fa42c196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa433765700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c196a20 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa433765700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c19a7b0 con 0x7fa42c104130 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa431501700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 0x7fa42c195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa431501700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 0x7fa42c195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48954/0 (socket says 172.21.15.98:48954) 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa431501700 1 -- 172.21.15.98:0/2126767754 learned_addr learned my addr 172.21.15.98:0/2126767754 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa430d00700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42c104130 0x7fa42c196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa431501700 1 -- 172.21.15.98:0/2126767754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42c104130 msgr2=0x7fa42c196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:19.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa431501700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42c104130 0x7fa42c196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:19.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa431501700 1 -- 172.21.15.98:0/2126767754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0095f0 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa431501700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 0x7fa42c195e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c8a0 tx=0x7fa42800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:19.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.405+0000 7fa4227fc700 1 -- 172.21.15.98:0/2126767754 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4280078e0 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.406+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c19aa90 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.406+0000 7fa4227fc700 1 -- 172.21.15.98:0/2126767754 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa42800f450 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.406+0000 7fa4227fc700 1 -- 172.21.15.98:0/2126767754 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42800e5e0 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.406+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c19afe0 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.407+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c04f2a0 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.407+0000 7fa4227fc700 1 -- 172.21.15.98:0/2126767754 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa42800f5c0 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.407+0000 7fa4227fc700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa41806c680 0x7fa41806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:19.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.408+0000 7fa4227fc700 1 -- 172.21.15.98:0/2126767754 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa42808b490 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.408+0000 7fa430d00700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa41806c680 0x7fa41806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:19.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.408+0000 7fa430d00700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa41806c680 0x7fa41806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa42c197420 tx=0x7fa41c01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:19.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.413+0000 7fa4227fc700 1 -- 172.21.15.98:0/2126767754 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa428055f50 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.613+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa42c19b230 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.614+0000 7fa4227fc700 1 -- 172.21.15.98:0/2126767754 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa428059570 con 0x7fa42c0ffbd0 2024-09-13T02:49:19.616 INFO:teuthology.orchestra.run.smithi098.stdout:171798691851 2024-09-13T02:49:19.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa41806c680 msgr2=0x7fa41806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa41806c680 0x7fa41806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa42c197420 tx=0x7fa41c01a040 comp rx=0 tx=0).stop 2024-09-13T02:49:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 msgr2=0x7fa42c195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 0x7fa42c195e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c8a0 tx=0x7fa42800cbb0 comp rx=0 tx=0).stop 2024-09-13T02:49:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 shutdown_connections 2024-09-13T02:49:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa41806c680 0x7fa41806eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:19.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c0ffbd0 0x7fa42c195e00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 --2- 172.21.15.98:0/2126767754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa42c104130 0x7fa42c196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 >> 172.21.15.98:0/2126767754 conn(0x7fa42c075130 msgr2=0x7fa42c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 shutdown_connections 2024-09-13T02:49:19.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:19.617+0000 7fa433765700 1 -- 172.21.15.98:0/2126767754 wait complete. 2024-09-13T02:49:20.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.025+0000 7f19da63f700 1 -- 172.21.15.98:0/1879934434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 msgr2=0x7f19d4104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:20.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.025+0000 7f19da63f700 1 --2- 172.21.15.98:0/1879934434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 0x7f19d4104e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009910 tx=0x7f19bc009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:20.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.025+0000 7f19da63f700 1 -- 172.21.15.98:0/1879934434 shutdown_connections 2024-09-13T02:49:20.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.025+0000 7f19da63f700 1 --2- 172.21.15.98:0/1879934434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 0x7f19d4104e50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.025+0000 7f19da63f700 1 --2- 172.21.15.98:0/1879934434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19d41004e0 0x7f19d41008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.025+0000 7f19da63f700 1 -- 172.21.15.98:0/1879934434 >> 172.21.15.98:0/1879934434 conn(0x7f19d40fbda0 msgr2=0x7f19d40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:20.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.025+0000 7f19da63f700 1 -- 172.21.15.98:0/1879934434 shutdown_connections 2024-09-13T02:49:20.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.025+0000 7f19da63f700 1 -- 172.21.15.98:0/1879934434 wait complete. 2024-09-13T02:49:20.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.026+0000 7f19da63f700 1 Processor -- start 2024-09-13T02:49:20.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.026+0000 7f19da63f700 1 -- start start 2024-09-13T02:49:20.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.026+0000 7f19da63f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19d41004e0 0x7f19d4195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:20.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.026+0000 7f19da63f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 0x7f19d4196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:20.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.026+0000 7f19da63f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4196ac0 con 0x7f19d4100e80 2024-09-13T02:49:20.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.026+0000 7f19da63f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4196c00 con 0x7f19d41004e0 2024-09-13T02:49:20.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.026+0000 7f19cbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 0x7f19d4196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:20.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19cbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 0x7f19d4196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48974/0 (socket says 172.21.15.98:48974) 2024-09-13T02:49:20.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19cbfff700 1 -- 172.21.15.98:0/3095149855 learned_addr learned my addr 172.21.15.98:0/3095149855 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:20.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19d3fff700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19d41004e0 0x7f19d4195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:20.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19cbfff700 1 -- 172.21.15.98:0/3095149855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19d41004e0 msgr2=0x7f19d4195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:20.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19cbfff700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19d41004e0 0x7f19d4195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19cbfff700 1 -- 172.21.15.98:0/3095149855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc0095f0 con 0x7f19d4100e80 2024-09-13T02:49:20.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19cbfff700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 0x7f19d4196470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00bda0 tx=0x7f19bc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:20.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19d1ffb700 1 -- 172.21.15.98:0/3095149855 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19bc01d070 con 0x7f19d4100e80 2024-09-13T02:49:20.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19d1ffb700 1 -- 172.21.15.98:0/3095149855 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19bc022470 con 0x7f19d4100e80 2024-09-13T02:49:20.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d419a9f0 con 0x7f19d4100e80 2024-09-13T02:49:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19d1ffb700 1 -- 172.21.15.98:0/3095149855 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19bc00f690 con 0x7f19d4100e80 2024-09-13T02:49:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.027+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d419aee0 con 0x7f19d4100e80 2024-09-13T02:49:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.028+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d404f2a0 con 0x7f19d4100e80 2024-09-13T02:49:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.029+0000 7f19d1ffb700 1 -- 172.21.15.98:0/3095149855 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f19bc022b00 con 0x7f19d4100e80 2024-09-13T02:49:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.029+0000 7f19d1ffb700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f19c006c680 0x7f19c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:20.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.029+0000 7f19d1ffb700 1 -- 172.21.15.98:0/3095149855 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f19bc08c9e0 con 0x7f19d4100e80 2024-09-13T02:49:20.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.029+0000 7f19d3fff700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f19c006c680 0x7f19c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:20.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.029+0000 7f19d3fff700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f19c006c680 0x7f19c006eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f19c4005ea0 tx=0x7f19c4005e30 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:20.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.033+0000 7f19d1ffb700 1 -- 172.21.15.98:0/3095149855 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f19bc057550 con 0x7f19d4100e80 2024-09-13T02:49:20.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.228+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19d4108230 con 0x7f19d4100e80 2024-09-13T02:49:20.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.228+0000 7f19d1ffb700 1 -- 172.21.15.98:0/3095149855 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f19bc027020 con 0x7f19d4100e80 2024-09-13T02:49:20.230 INFO:teuthology.orchestra.run.smithi098.stdout:38654705702 2024-09-13T02:49:20.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f19c006c680 msgr2=0x7f19c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:20.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f19c006c680 0x7f19c006eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f19c4005ea0 tx=0x7f19c4005e30 comp rx=0 tx=0).stop 2024-09-13T02:49:20.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 msgr2=0x7f19d4196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:20.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 0x7f19d4196470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00bda0 tx=0x7f19bc00be80 comp rx=0 tx=0).stop 2024-09-13T02:49:20.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 shutdown_connections 2024-09-13T02:49:20.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f19c006c680 0x7f19c006eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19d41004e0 0x7f19d4195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 --2- 172.21.15.98:0/3095149855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19d4100e80 0x7f19d4196470 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 >> 172.21.15.98:0/3095149855 conn(0x7f19d40fbda0 msgr2=0x7f19d40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:20.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 shutdown_connections 2024-09-13T02:49:20.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.230+0000 7f19da63f700 1 -- 172.21.15.98:0/3095149855 wait complete. 2024-09-13T02:49:20.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:20 smithi098 ceph-mon[27886]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:20.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:20 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2126767754' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T02:49:20.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:20 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:20.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:20 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3095149855' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T02:49:20.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:20 smithi142 ceph-mon[33443]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:20.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:20 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2126767754' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T02:49:20.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:20 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:20.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:20 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3095149855' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T02:49:20.510 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691847 got 171798691851 for osd.5 2024-09-13T02:49:20.510 DEBUG:teuthology.parallel:result is None 2024-09-13T02:49:20.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.706+0000 7fb259167700 1 -- 172.21.15.98:0/3262327746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb254100e80 msgr2=0x7fb254104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:20.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.706+0000 7fb259167700 1 --2- 172.21.15.98:0/3262327746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb254100e80 0x7fb254104e50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb244009910 tx=0x7fb244009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:20.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.706+0000 7fb259167700 1 -- 172.21.15.98:0/3262327746 shutdown_connections 2024-09-13T02:49:20.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.706+0000 7fb259167700 1 --2- 172.21.15.98:0/3262327746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb254100e80 0x7fb254104e50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.706+0000 7fb259167700 1 --2- 172.21.15.98:0/3262327746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2541004e0 0x7fb2541008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.706+0000 7fb259167700 1 -- 172.21.15.98:0/3262327746 >> 172.21.15.98:0/3262327746 conn(0x7fb2540fbda0 msgr2=0x7fb2540fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:20.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.706+0000 7fb259167700 1 -- 172.21.15.98:0/3262327746 shutdown_connections 2024-09-13T02:49:20.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.706+0000 7fb259167700 1 -- 172.21.15.98:0/3262327746 wait complete. 2024-09-13T02:49:20.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.706+0000 7fb259167700 1 Processor -- start 2024-09-13T02:49:20.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb259167700 1 -- start start 2024-09-13T02:49:20.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb259167700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2541004e0 0x7fb254195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb259167700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb254100e80 0x7fb254196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb259167700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb254196b50 con 0x7fb2541004e0 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb259167700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25419a8e0 con 0x7fb254100e80 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb252d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2541004e0 0x7fb254195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb252d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2541004e0 0x7fb254195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48980/0 (socket says 172.21.15.98:48980) 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb252d9d700 1 -- 172.21.15.98:0/141891330 learned_addr learned my addr 172.21.15.98:0/141891330 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb252d9d700 1 -- 172.21.15.98:0/141891330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb254100e80 msgr2=0x7fb254196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb252d9d700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb254100e80 0x7fb254196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.707+0000 7fb252d9d700 1 -- 172.21.15.98:0/141891330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440095f0 con 0x7fb2541004e0 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.708+0000 7fb252d9d700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2541004e0 0x7fb254195f30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb24800d8d0 tx=0x7fb24800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.708+0000 7fb23bfff700 1 -- 172.21.15.98:0/141891330 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb248009940 con 0x7fb2541004e0 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.708+0000 7fb23bfff700 1 -- 172.21.15.98:0/141891330 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb248010460 con 0x7fb2541004e0 2024-09-13T02:49:20.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.708+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25419abc0 con 0x7fb2541004e0 2024-09-13T02:49:20.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.708+0000 7fb23bfff700 1 -- 172.21.15.98:0/141891330 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb24800f5f0 con 0x7fb2541004e0 2024-09-13T02:49:20.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.708+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25419b110 con 0x7fb2541004e0 2024-09-13T02:49:20.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.709+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb254108850 con 0x7fb2541004e0 2024-09-13T02:49:20.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.709+0000 7fb23bfff700 1 -- 172.21.15.98:0/141891330 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb2480105d0 con 0x7fb2541004e0 2024-09-13T02:49:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.710+0000 7fb23bfff700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb23c06c680 0x7fb23c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.710+0000 7fb23bfff700 1 -- 172.21.15.98:0/141891330 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb24808b4a0 con 0x7fb2541004e0 2024-09-13T02:49:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.710+0000 7fb25259c700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb23c06c680 0x7fb23c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.710+0000 7fb25259c700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb23c06c680 0x7fb23c06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb24400b5c0 tx=0x7fb244005960 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.714+0000 7fb23bfff700 1 -- 172.21.15.98:0/141891330 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb248055f60 con 0x7fb2541004e0 2024-09-13T02:49:20.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.909+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb25404f2a0 con 0x7fb2541004e0 2024-09-13T02:49:20.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.909+0000 7fb23bfff700 1 -- 172.21.15.98:0/141891330 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb248059580 con 0x7fb2541004e0 2024-09-13T02:49:20.911 INFO:teuthology.orchestra.run.smithi098.stdout:150323855376 2024-09-13T02:49:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb23c06c680 msgr2=0x7fb23c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb23c06c680 0x7fb23c06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb24400b5c0 tx=0x7fb244005960 comp rx=0 tx=0).stop 2024-09-13T02:49:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2541004e0 msgr2=0x7fb254195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2541004e0 0x7fb254195f30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb24800d8d0 tx=0x7fb24800dc90 comp rx=0 tx=0).stop 2024-09-13T02:49:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 shutdown_connections 2024-09-13T02:49:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb23c06c680 0x7fb23c06eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2541004e0 0x7fb254195f30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 --2- 172.21.15.98:0/141891330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb254100e80 0x7fb254196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 >> 172.21.15.98:0/141891330 conn(0x7fb2540fbda0 msgr2=0x7fb2540fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.911+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 shutdown_connections 2024-09-13T02:49:20.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:20.912+0000 7fb259167700 1 -- 172.21.15.98:0/141891330 wait complete. 2024-09-13T02:49:21.351 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:21 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/141891330' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T02:49:21.372 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-09-13T02:49:21.372 DEBUG:teuthology.parallel:result is None 2024-09-13T02:49:21.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:21 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/141891330' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T02:49:22.004 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855372 got 150323855376 for osd.4 2024-09-13T02:49:22.004 DEBUG:teuthology.parallel:result is None 2024-09-13T02:49:22.005 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T02:49:22.005 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T02:49:22.208 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:22.551 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:22 smithi098 ceph-mon[27886]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:22.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:22 smithi142 ceph-mon[33443]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:23.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.852+0000 7f2c494ad700 1 -- 172.21.15.98:0/1767944806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 msgr2=0x7f2c441063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:23.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.852+0000 7f2c494ad700 1 --2- 172.21.15.98:0/1767944806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 0x7f2c441063b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009910 tx=0x7f2c34009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:23.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.853+0000 7f2c494ad700 1 -- 172.21.15.98:0/1767944806 shutdown_connections 2024-09-13T02:49:23.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.853+0000 7f2c494ad700 1 --2- 172.21.15.98:0/1767944806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c440ff720 0x7f2c440ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:23.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.853+0000 7f2c494ad700 1 --2- 172.21.15.98:0/1767944806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 0x7f2c441063b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:23.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.853+0000 7f2c494ad700 1 -- 172.21.15.98:0/1767944806 >> 172.21.15.98:0/1767944806 conn(0x7f2c440748b0 msgr2=0x7f2c44074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:23.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.853+0000 7f2c494ad700 1 -- 172.21.15.98:0/1767944806 shutdown_connections 2024-09-13T02:49:23.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.853+0000 7f2c494ad700 1 -- 172.21.15.98:0/1767944806 wait complete. 2024-09-13T02:49:23.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.853+0000 7f2c494ad700 1 Processor -- start 2024-09-13T02:49:23.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.853+0000 7f2c494ad700 1 -- start start 2024-09-13T02:49:23.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c494ad700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 0x7f2c4419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:23.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c494ad700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c440ff720 0x7f2c4419c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:23.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c494ad700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4419d0b0 con 0x7f2c440ff350 2024-09-13T02:49:23.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c494ad700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c441a0e40 con 0x7f2c440ff720 2024-09-13T02:49:23.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c42ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 0x7f2c4419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:23.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c42ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 0x7f2c4419c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48986/0 (socket says 172.21.15.98:48986) 2024-09-13T02:49:23.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c42ffd700 1 -- 172.21.15.98:0/916085787 learned_addr learned my addr 172.21.15.98:0/916085787 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:23.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c427fc700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c440ff720 0x7f2c4419c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:23.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c42ffd700 1 -- 172.21.15.98:0/916085787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c440ff720 msgr2=0x7f2c4419c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:23.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c42ffd700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c440ff720 0x7f2c4419c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:23.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c42ffd700 1 -- 172.21.15.98:0/916085787 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c340095f0 con 0x7f2c440ff350 2024-09-13T02:49:23.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c42ffd700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 0x7f2c4419c490 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c34006010 tx=0x7f2c3400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:23.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c2bfff700 1 -- 172.21.15.98:0/916085787 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c3401d070 con 0x7f2c440ff350 2024-09-13T02:49:23.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c2bfff700 1 -- 172.21.15.98:0/916085787 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c3400f460 con 0x7f2c440ff350 2024-09-13T02:49:23.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c441a10c0 con 0x7f2c440ff350 2024-09-13T02:49:23.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c2bfff700 1 -- 172.21.15.98:0/916085787 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c34021640 con 0x7f2c440ff350 2024-09-13T02:49:23.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.854+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c441a1610 con 0x7f2c440ff350 2024-09-13T02:49:23.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.855+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c44103ae0 con 0x7f2c440ff350 2024-09-13T02:49:23.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.856+0000 7f2c2bfff700 1 -- 172.21.15.98:0/916085787 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2c3400faf0 con 0x7f2c440ff350 2024-09-13T02:49:23.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.856+0000 7f2c2bfff700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2c2c06c680 0x7f2c2c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:23.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.856+0000 7f2c2bfff700 1 -- 172.21.15.98:0/916085787 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f2c3408c890 con 0x7f2c440ff350 2024-09-13T02:49:23.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.856+0000 7f2c427fc700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2c2c06c680 0x7f2c2c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:23.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.857+0000 7f2c427fc700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2c2c06c680 0x7f2c2c06eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c38006fd0 tx=0x7f2c38008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:23.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:23.861+0000 7f2c2bfff700 1 -- 172.21.15.98:0/916085787 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2c34057350 con 0x7f2c440ff350 2024-09-13T02:49:24.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.048+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c441a18f0 con 0x7f2c2c06c680 2024-09-13T02:49:24.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.049+0000 7f2c2bfff700 1 -- 172.21.15.98:0/916085787 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28178 (secure 0 0 0) 0x7f2c441a18f0 con 0x7f2c2c06c680 2024-09-13T02:49:24.051 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:49:24.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.051+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2c2c06c680 msgr2=0x7f2c2c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:24.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.051+0000 7f2c494ad700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2c2c06c680 0x7f2c2c06eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2c38006fd0 tx=0x7f2c38008040 comp rx=0 tx=0).stop 2024-09-13T02:49:24.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.051+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 msgr2=0x7f2c4419c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:24.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.051+0000 7f2c494ad700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 0x7f2c4419c490 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c34006010 tx=0x7f2c3400be20 comp rx=0 tx=0).stop 2024-09-13T02:49:24.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.051+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 shutdown_connections 2024-09-13T02:49:24.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.051+0000 7f2c494ad700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2c2c06c680 0x7f2c2c06eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:24.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.051+0000 7f2c494ad700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c440ff350 0x7f2c4419c490 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:24.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.051+0000 7f2c494ad700 1 --2- 172.21.15.98:0/916085787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c440ff720 0x7f2c4419c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:24.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.052+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 >> 172.21.15.98:0/916085787 conn(0x7f2c440748b0 msgr2=0x7f2c440fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:24.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.052+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 shutdown_connections 2024-09-13T02:49:24.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:24.052+0000 7f2c494ad700 1 -- 172.21.15.98:0/916085787 wait complete. 2024-09-13T02:49:24.054 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-13T02:49:24.347 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:24 smithi098 ceph-mon[27886]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:24.636 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-13T02:49:22.848336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002197"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":187,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T02:48:36.252103+0000","last_change":"2024-09-13T02:48:10.678743+0000","last_active":"2024-09-13T02:48:36.252103+0000","last_peered":"2024-09-13T02:48:36.252103+0000","last_clean":"2024-09-13T02:48:36.252103+0000","last_became_active":"2024-09-13T02:48:10.678451+0000","last_became_peered":"2024-09-13T02:48:10.678451+0000","last_unstale":"2024-09-13T02:48:36.252103+0000","last_undegraded":"2024-09-13T02:48:36.252103+0000","last_fullsized":"2024-09-13T02:48:36.252103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T02:47:21.545818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T02:47:21.545818+0000","last_clean_scrub_stamp":"2024-09-13T02:47:21.545818+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:27.332821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Sep 13 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Sep 13 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:48:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Sep 13 02:48:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.49099999999999999}]},{"osd":2,"last update":"Fri Sep 13 02:48:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Sep 13 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Sep 13 02:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:48:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Sep 13 02:49:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.443},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 02:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.318,"15min":0.313},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Sep 13 02:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 02:48:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.623}]},{"osd":4,"last update":"Fri Sep 13 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:48:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.29899999999999999,"15min":0.29199999999999998},"min":{"1min":0.23899999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.30599999999999999,"15min":0.29799999999999999},"min":{"1min":0.252,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.316}]},{"osd":2,"last update":"Fri Sep 13 02:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:48:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Sep 13 02:49:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T02:49:24.638 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T02:49:24.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:24 smithi142 ceph-mon[33443]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:24.835 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:25.571 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:25 smithi142 ceph-mon[33443]: from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:49:25.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:25 smithi098 ceph-mon[27886]: from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:49:26.479 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:26 smithi098 ceph-mon[27886]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:26.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 -- 172.21.15.98:0/3319956614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 msgr2=0x7f9e5c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:26.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 --2- 172.21.15.98:0/3319956614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 0x7f9e5c0ff720 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009910 tx=0x7f9e50009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:26.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 -- 172.21.15.98:0/3319956614 shutdown_connections 2024-09-13T02:49:26.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 --2- 172.21.15.98:0/3319956614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c10a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:26.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 --2- 172.21.15.98:0/3319956614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 0x7f9e5c0ff720 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:26.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 -- 172.21.15.98:0/3319956614 >> 172.21.15.98:0/3319956614 conn(0x7f9e5c0748b0 msgr2=0x7f9e5c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:26.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 -- 172.21.15.98:0/3319956614 shutdown_connections 2024-09-13T02:49:26.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 -- 172.21.15.98:0/3319956614 wait complete. 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 Processor -- start 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.580+0000 7f9e62c34700 1 -- start start 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e62c34700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 0x7f9e5c195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e62c34700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e62c34700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c196ac0 con 0x7f9e5c0ff350 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e62c34700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c19a850 con 0x7f9e5c0ffc60 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e609d0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 0x7f9e5c195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e609d0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 0x7f9e5c195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53606/0 (socket says 172.21.15.98:53606) 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e609d0700 1 -- 172.21.15.98:0/3041968677 learned_addr learned my addr 172.21.15.98:0/3041968677 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:26.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e5bfff700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e609d0700 1 -- 172.21.15.98:0/3041968677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e5c0ffc60 msgr2=0x7f9e5c1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e609d0700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e609d0700 1 -- 172.21.15.98:0/3041968677 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e500095f0 con 0x7f9e5c0ff350 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e5bfff700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e609d0700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 0x7f9e5c195ea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9e500092e0 tx=0x7f9e5000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e59ffb700 1 -- 172.21.15.98:0/3041968677 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e5001d070 con 0x7f9e5c0ff350 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e59ffb700 1 -- 172.21.15.98:0/3041968677 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e50022470 con 0x7f9e5c0ff350 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e59ffb700 1 -- 172.21.15.98:0/3041968677 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e5000f690 con 0x7f9e5c0ff350 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.581+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c19aad0 con 0x7f9e5c0ff350 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.582+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5c19afc0 con 0x7f9e5c0ff350 2024-09-13T02:49:26.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.582+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5c107dd0 con 0x7f9e5c0ff350 2024-09-13T02:49:26.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.583+0000 7f9e59ffb700 1 -- 172.21.15.98:0/3041968677 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9e500225e0 con 0x7f9e5c0ff350 2024-09-13T02:49:26.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.583+0000 7f9e59ffb700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9e4c06c680 0x7f9e4c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:26.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.583+0000 7f9e59ffb700 1 -- 172.21.15.98:0/3041968677 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f9e5008c910 con 0x7f9e5c0ff350 2024-09-13T02:49:26.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.583+0000 7f9e5bfff700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9e4c06c680 0x7f9e4c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:26.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.584+0000 7f9e5bfff700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9e4c06c680 0x7f9e4c06eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c1974c0 tx=0x7f9e48005f50 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:26.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.588+0000 7f9e59ffb700 1 -- 172.21.15.98:0/3041968677 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9e50057500 con 0x7f9e5c0ff350 2024-09-13T02:49:26.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:26 smithi142 ceph-mon[33443]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:26.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.776+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e5c02cca0 con 0x7f9e4c06c680 2024-09-13T02:49:26.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.778+0000 7f9e59ffb700 1 -- 172.21.15.98:0/3041968677 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28178 (secure 0 0 0) 0x7f9e5c02cca0 con 0x7f9e4c06c680 2024-09-13T02:49:26.780 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:49:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9e4c06c680 msgr2=0x7f9e4c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9e4c06c680 0x7f9e4c06eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c1974c0 tx=0x7f9e48005f50 comp rx=0 tx=0).stop 2024-09-13T02:49:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 msgr2=0x7f9e5c195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 0x7f9e5c195ea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9e500092e0 tx=0x7f9e5000be20 comp rx=0 tx=0).stop 2024-09-13T02:49:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 shutdown_connections 2024-09-13T02:49:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9e4c06c680 0x7f9e4c06eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e5c0ff350 0x7f9e5c195ea0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 --2- 172.21.15.98:0/3041968677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e5c0ffc60 0x7f9e5c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 >> 172.21.15.98:0/3041968677 conn(0x7f9e5c0748b0 msgr2=0x7f9e5c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 shutdown_connections 2024-09-13T02:49:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:26.780+0000 7f9e62c34700 1 -- 172.21.15.98:0/3041968677 wait complete. 2024-09-13T02:49:26.783 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-13T02:49:27.507 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T02:49:24.848597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002201"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":187,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T02:48:36.252103+0000","last_change":"2024-09-13T02:48:10.678743+0000","last_active":"2024-09-13T02:48:36.252103+0000","last_peered":"2024-09-13T02:48:36.252103+0000","last_clean":"2024-09-13T02:48:36.252103+0000","last_became_active":"2024-09-13T02:48:10.678451+0000","last_became_peered":"2024-09-13T02:48:10.678451+0000","last_unstale":"2024-09-13T02:48:36.252103+0000","last_undegraded":"2024-09-13T02:48:36.252103+0000","last_fullsized":"2024-09-13T02:48:36.252103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T02:47:21.545818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T02:47:21.545818+0000","last_clean_scrub_stamp":"2024-09-13T02:47:21.545818+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:35:27.332821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Sep 13 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Sep 13 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:48:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Sep 13 02:48:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Sep 13 02:48:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Sep 13 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Sep 13 02:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:48:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Sep 13 02:49:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.443},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 02:48:53 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.318,"15min":0.313},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Fri Sep 13 02:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.253}]},{"osd":3,"last update":"Fri Sep 13 02:48:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Sep 13 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:48:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.29899999999999999,"15min":0.29199999999999998},"min":{"1min":0.23899999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.30599999999999999,"15min":0.29799999999999999},"min":{"1min":0.252,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.316}]},{"osd":2,"last update":"Fri Sep 13 02:48:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:48:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Sep 13 02:49:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T02:49:27.508 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T02:49:27.508 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T02:49:27.508 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T02:49:27.509 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T02:49:27.707 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:28 smithi098 ceph-mon[27886]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:49:28.333 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:28 smithi098 ceph-mon[27886]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:28.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:28 smithi142 ceph-mon[33443]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:49:28.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:28 smithi142 ceph-mon[33443]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:29.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.196+0000 7f5287a47700 1 -- 172.21.15.98:0/1503050729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ffc60 msgr2=0x7f528010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:29.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.196+0000 7f5287a47700 1 --2- 172.21.15.98:0/1503050729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ffc60 0x7f528010a6d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f527c009910 tx=0x7f527c009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:29.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.196+0000 7f5287a47700 1 -- 172.21.15.98:0/1503050729 shutdown_connections 2024-09-13T02:49:29.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.196+0000 7f5287a47700 1 --2- 172.21.15.98:0/1503050729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ffc60 0x7f528010a6d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:29.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.196+0000 7f5287a47700 1 --2- 172.21.15.98:0/1503050729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800ff350 0x7f52800ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:29.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.196+0000 7f5287a47700 1 -- 172.21.15.98:0/1503050729 >> 172.21.15.98:0/1503050729 conn(0x7f52800748b0 msgr2=0x7f5280074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.197+0000 7f5287a47700 1 -- 172.21.15.98:0/1503050729 shutdown_connections 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.197+0000 7f5287a47700 1 -- 172.21.15.98:0/1503050729 wait complete. 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.197+0000 7f5287a47700 1 Processor -- start 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.197+0000 7f5287a47700 1 -- start start 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.197+0000 7f5287a47700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ff350 0x7f5280100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.197+0000 7f5287a47700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800ffc60 0x7f5280100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.197+0000 7f5287a47700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280100fb0 con 0x7f52800ff350 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.197+0000 7f5287a47700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52801010f0 con 0x7f52800ffc60 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52857e3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ff350 0x7f5280100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:29.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52857e3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ff350 0x7f5280100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53626/0 (socket says 172.21.15.98:53626) 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52857e3700 1 -- 172.21.15.98:0/2350868841 learned_addr learned my addr 172.21.15.98:0/2350868841 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f5284fe2700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800ffc60 0x7f5280100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52857e3700 1 -- 172.21.15.98:0/2350868841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800ffc60 msgr2=0x7f5280100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52857e3700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800ffc60 0x7f5280100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52857e3700 1 -- 172.21.15.98:0/2350868841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0095f0 con 0x7f52800ff350 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52857e3700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ff350 0x7f5280100530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f527400b4b0 tx=0x7f527400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52727fc700 1 -- 172.21.15.98:0/2350868841 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5274011800 con 0x7f52800ff350 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52727fc700 1 -- 172.21.15.98:0/2350868841 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5274011e10 con 0x7f52800ff350 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52801a1fe0 con 0x7f52800ff350 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f52727fc700 1 -- 172.21.15.98:0/2350868841 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f527400f2e0 con 0x7f52800ff350 2024-09-13T02:49:29.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.198+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52801a23f0 con 0x7f52800ff350 2024-09-13T02:49:29.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.199+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5280107dd0 con 0x7f52800ff350 2024-09-13T02:49:29.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.200+0000 7f52727fc700 1 -- 172.21.15.98:0/2350868841 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5274010380 con 0x7f52800ff350 2024-09-13T02:49:29.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.200+0000 7f52727fc700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f526c06c680 0x7f526c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:29.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.200+0000 7f52727fc700 1 -- 172.21.15.98:0/2350868841 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f527408b070 con 0x7f52800ff350 2024-09-13T02:49:29.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.200+0000 7f5284fe2700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f526c06c680 0x7f526c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:29.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.201+0000 7f5284fe2700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f526c06c680 0x7f526c06eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5280101d20 tx=0x7f527c01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:29.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.205+0000 7f52727fc700 1 -- 172.21.15.98:0/2350868841 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5274055b30 con 0x7f52800ff350 2024-09-13T02:49:29.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.436+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f528004f2a0 con 0x7f52800ff350 2024-09-13T02:49:29.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.437+0000 7f52727fc700 1 -- 172.21.15.98:0/2350868841 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5274059150 con 0x7f52800ff350 2024-09-13T02:49:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:49:29.439 INFO:teuthology.orchestra.run.smithi098.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T02:49:29.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f526c06c680 msgr2=0x7f526c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f526c06c680 0x7f526c06eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5280101d20 tx=0x7f527c01a040 comp rx=0 tx=0).stop 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ff350 msgr2=0x7f5280100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ff350 0x7f5280100530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f527400b4b0 tx=0x7f527400b7c0 comp rx=0 tx=0).stop 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 shutdown_connections 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f526c06c680 0x7f526c06eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52800ff350 0x7f5280100530 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 --2- 172.21.15.98:0/2350868841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800ffc60 0x7f5280100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 >> 172.21.15.98:0/2350868841 conn(0x7f52800748b0 msgr2=0x7f5280104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 shutdown_connections 2024-09-13T02:49:29.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:29.439+0000 7f5287a47700 1 -- 172.21.15.98:0/2350868841 wait complete. 2024-09-13T02:49:30.106 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T02:49:30.106 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T02:49:30.107 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:49:30.116 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-09-13T02:49:30.116 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:49:30.142 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:49:30.142 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T02:49:30.342 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:30.581 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:30 smithi098 ceph-mon[27886]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:30.940 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:30 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2350868841' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T02:49:30.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:30 smithi142 ceph-mon[33443]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:30.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:30 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2350868841' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T02:49:32.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 -- 172.21.15.98:0/310806644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c100240 msgr2=0x7fbb7c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:32.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 --2- 172.21.15.98:0/310806644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c100240 0x7fbb7c100650 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009910 tx=0x7fbb6c009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:32.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 -- 172.21.15.98:0/310806644 shutdown_connections 2024-09-13T02:49:32.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 --2- 172.21.15.98:0/310806644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c101440 0x7fbb7c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:32.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 --2- 172.21.15.98:0/310806644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c100240 0x7fbb7c100650 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 -- 172.21.15.98:0/310806644 >> 172.21.15.98:0/310806644 conn(0x7fbb7c0fb7f0 msgr2=0x7fbb7c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 -- 172.21.15.98:0/310806644 shutdown_connections 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 -- 172.21.15.98:0/310806644 wait complete. 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 Processor -- start 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.087+0000 7fbb818ac700 1 -- start start 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb818ac700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c100240 0x7fbb7c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb818ac700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c101440 0x7fbb7c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb818ac700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c073680 con 0x7fbb7c101440 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb818ac700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0737c0 con 0x7fbb7c100240 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb727fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c101440 0x7fbb7c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:32.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb727fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c101440 0x7fbb7c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53656/0 (socket says 172.21.15.98:53656) 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb727fc700 1 -- 172.21.15.98:0/1865661537 learned_addr learned my addr 172.21.15.98:0/1865661537 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb7affd700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c100240 0x7fbb7c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb727fc700 1 -- 172.21.15.98:0/1865661537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c100240 msgr2=0x7fbb7c074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb727fc700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c100240 0x7fbb7c074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb727fc700 1 -- 172.21.15.98:0/1865661537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c0095f0 con 0x7fbb7c101440 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb727fc700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c101440 0x7fbb7c073140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400d8d0 tx=0x7fbb6400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb808aa700 1 -- 172.21.15.98:0/1865661537 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb640098a0 con 0x7fbb7c101440 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb808aa700 1 -- 172.21.15.98:0/1865661537 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb64010460 con 0x7fbb7c101440 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb808aa700 1 -- 172.21.15.98:0/1865661537 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb6400f5f0 con 0x7fbb7c101440 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.088+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c073aa0 con 0x7fbb7c101440 2024-09-13T02:49:32.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.089+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c19db30 con 0x7fbb7c101440 2024-09-13T02:49:32.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.089+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7c108d90 con 0x7fbb7c101440 2024-09-13T02:49:32.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.090+0000 7fbb808aa700 1 -- 172.21.15.98:0/1865661537 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbb64009a00 con 0x7fbb7c101440 2024-09-13T02:49:32.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.090+0000 7fbb808aa700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb6806c680 0x7fbb6806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:32.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.091+0000 7fbb808aa700 1 -- 172.21.15.98:0/1865661537 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fbb6408b2d0 con 0x7fbb7c101440 2024-09-13T02:49:32.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.091+0000 7fbb7affd700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb6806c680 0x7fbb6806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:32.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.091+0000 7fbb7affd700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb6806c680 0x7fbb6806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c006010 tx=0x7fbb6c00b560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:32.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.095+0000 7fbb808aa700 1 -- 172.21.15.98:0/1865661537 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbb640598a0 con 0x7fbb7c101440 2024-09-13T02:49:32.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.287+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fbb7c108f50 con 0x7fbb7c101440 2024-09-13T02:49:32.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.291+0000 7fbb808aa700 1 -- 172.21.15.98:0/1865661537 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fbb64059430 con 0x7fbb7c101440 2024-09-13T02:49:32.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb6806c680 msgr2=0x7fbb6806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb6806c680 0x7fbb6806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c006010 tx=0x7fbb6c00b560 comp rx=0 tx=0).stop 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c101440 msgr2=0x7fbb7c073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c101440 0x7fbb7c073140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400d8d0 tx=0x7fbb6400dbe0 comp rx=0 tx=0).stop 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 shutdown_connections 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fbb6806c680 0x7fbb6806eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c100240 0x7fbb7c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 --2- 172.21.15.98:0/1865661537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb7c101440 0x7fbb7c073140 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 >> 172.21.15.98:0/1865661537 conn(0x7fbb7c0fb7f0 msgr2=0x7fbb7c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 shutdown_connections 2024-09-13T02:49:32.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:32.294+0000 7fbb818ac700 1 -- 172.21.15.98:0/1865661537 wait complete. 2024-09-13T02:49:32.667 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:32 smithi098 ceph-mon[27886]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:32.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:32 smithi142 ceph-mon[33443]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:33.073 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:49:33.083 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T02:49:33.083 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:49:33.109 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:49:33.110 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T02:49:33.310 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:33.430 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:33 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1865661537' entity='client.admin' 2024-09-13T02:49:33.431 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:33 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:33.431 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:33 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:33.431 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:33 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:33.431 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:33 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:33.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:33 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1865661537' entity='client.admin' 2024-09-13T02:49:33.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:33 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:33.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:33 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:33.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:33 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:33.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:33 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:34.645 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:34 smithi098 ceph-mon[27886]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:34.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:34 smithi142 ceph-mon[33443]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:35.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.015+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1887822164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 msgr2=0x7f9a501030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:35.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.015+0000 7f9a57dbf700 1 --2- 172.21.15.98:0/1887822164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 0x7f9a501030c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009910 tx=0x7f9a4c009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:35.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.015+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1887822164 shutdown_connections 2024-09-13T02:49:35.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.015+0000 7f9a57dbf700 1 --2- 172.21.15.98:0/1887822164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a50103600 0x7f9a501059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.015+0000 7f9a57dbf700 1 --2- 172.21.15.98:0/1887822164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 0x7f9a501030c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.015+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1887822164 >> 172.21.15.98:0/1887822164 conn(0x7f9a500fa700 msgr2=0x7f9a500fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.015+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1887822164 shutdown_connections 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.015+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1887822164 wait complete. 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a57dbf700 1 Processor -- start 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a57dbf700 1 -- start start 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a57dbf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 0x7f9a50100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a57dbf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a50103600 0x7f9a500fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a57dbf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500ff1d0 con 0x7f9a50100ce0 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a57dbf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500ff310 con 0x7f9a50103600 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a55b5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 0x7f9a50100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:35.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a55b5b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 0x7f9a50100640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48456/0 (socket says 172.21.15.98:48456) 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a55b5b700 1 -- 172.21.15.98:0/1927732404 learned_addr learned my addr 172.21.15.98:0/1927732404 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a5535a700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a50103600 0x7f9a500fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a55b5b700 1 -- 172.21.15.98:0/1927732404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a50103600 msgr2=0x7f9a500fec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a55b5b700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a50103600 0x7f9a500fec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a55b5b700 1 -- 172.21.15.98:0/1927732404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c0095f0 con 0x7f9a50100ce0 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a55b5b700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 0x7f9a50100640 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c005b40 tx=0x7f9a4c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.016+0000 7f9a46ffd700 1 -- 172.21.15.98:0/1927732404 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a4c01d070 con 0x7f9a50100ce0 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.017+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a500ff590 con 0x7f9a50100ce0 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.017+0000 7f9a46ffd700 1 -- 172.21.15.98:0/1927732404 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9a4c022470 con 0x7f9a50100ce0 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.017+0000 7f9a46ffd700 1 -- 172.21.15.98:0/1927732404 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a4c00f690 con 0x7f9a50100ce0 2024-09-13T02:49:35.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.017+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a500ffa80 con 0x7f9a50100ce0 2024-09-13T02:49:35.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.017+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5018fc70 con 0x7f9a50100ce0 2024-09-13T02:49:35.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.018+0000 7f9a46ffd700 1 -- 172.21.15.98:0/1927732404 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9a4c0225e0 con 0x7f9a50100ce0 2024-09-13T02:49:35.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.018+0000 7f9a46ffd700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9a3c06c680 0x7f9a3c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:35.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.019+0000 7f9a46ffd700 1 -- 172.21.15.98:0/1927732404 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f9a4c08cc90 con 0x7f9a50100ce0 2024-09-13T02:49:35.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.019+0000 7f9a5535a700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9a3c06c680 0x7f9a3c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:35.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.019+0000 7f9a5535a700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9a3c06c680 0x7f9a3c06eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005ea0 tx=0x7f9a40005e30 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:35.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.023+0000 7f9a46ffd700 1 -- 172.21.15.98:0/1927732404 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9a4c05b260 con 0x7f9a50100ce0 2024-09-13T02:49:35.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.229+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a50061190 con 0x7f9a3c06c680 2024-09-13T02:49:35.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.230+0000 7f9a46ffd700 1 -- 172.21.15.98:0/1927732404 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9a50061190 con 0x7f9a3c06c680 2024-09-13T02:49:35.231 INFO:teuthology.orchestra.run.smithi098.stdout:Backend: cephadm 2024-09-13T02:49:35.231 INFO:teuthology.orchestra.run.smithi098.stdout:Available: Yes 2024-09-13T02:49:35.231 INFO:teuthology.orchestra.run.smithi098.stdout:Paused: No 2024-09-13T02:49:35.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9a3c06c680 msgr2=0x7f9a3c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:35.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9a3c06c680 0x7f9a3c06eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005ea0 tx=0x7f9a40005e30 comp rx=0 tx=0).stop 2024-09-13T02:49:35.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 msgr2=0x7f9a50100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:35.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 0x7f9a50100640 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c005b40 tx=0x7f9a4c00be20 comp rx=0 tx=0).stop 2024-09-13T02:49:35.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 shutdown_connections 2024-09-13T02:49:35.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9a3c06c680 0x7f9a3c06eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:35.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a50100ce0 0x7f9a50100640 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:35.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 --2- 172.21.15.98:0/1927732404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a50103600 0x7f9a500fec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:35.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 >> 172.21.15.98:0/1927732404 conn(0x7f9a500fa700 msgr2=0x7f9a500fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:35.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 shutdown_connections 2024-09-13T02:49:35.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:35.232+0000 7f9a57dbf700 1 -- 172.21.15.98:0/1927732404 wait complete. 2024-09-13T02:49:35.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:35.647 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:35.862 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T02:49:36.061 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:36.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:36 smithi098 ceph-mon[27886]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:36.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:36 smithi098 ceph-mon[27886]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:36.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:36 smithi142 ceph-mon[33443]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:36.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:36 smithi142 ceph-mon[33443]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:37.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.670+0000 7fdcd6373700 1 -- 172.21.15.98:0/2922269349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0100240 msgr2=0x7fdcd0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:37.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.670+0000 7fdcd6373700 1 --2- 172.21.15.98:0/2922269349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0100240 0x7fdcd0100650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009910 tx=0x7fdcc0009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:37.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.670+0000 7fdcd6373700 1 -- 172.21.15.98:0/2922269349 shutdown_connections 2024-09-13T02:49:37.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.670+0000 7fdcd6373700 1 --2- 172.21.15.98:0/2922269349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0101440 0x7fdcd0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.670+0000 7fdcd6373700 1 --2- 172.21.15.98:0/2922269349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0100240 0x7fdcd0100650 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.671+0000 7fdcd6373700 1 -- 172.21.15.98:0/2922269349 >> 172.21.15.98:0/2922269349 conn(0x7fdcd00fb7f0 msgr2=0x7fdcd00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:37.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.671+0000 7fdcd6373700 1 -- 172.21.15.98:0/2922269349 shutdown_connections 2024-09-13T02:49:37.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.671+0000 7fdcd6373700 1 -- 172.21.15.98:0/2922269349 wait complete. 2024-09-13T02:49:37.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.671+0000 7fdcd6373700 1 Processor -- start 2024-09-13T02:49:37.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.671+0000 7fdcd6373700 1 -- start start 2024-09-13T02:49:37.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdcd6373700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0100240 0x7fdcd0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:37.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdcd6373700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0101440 0x7fdcd0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:37.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdcd6373700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd0073680 con 0x7fdcd0101440 2024-09-13T02:49:37.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdcd6373700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00737c0 con 0x7fdcd0100240 2024-09-13T02:49:37.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0101440 0x7fdcd0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:37.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0101440 0x7fdcd0073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48474/0 (socket says 172.21.15.98:48474) 2024-09-13T02:49:37.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccf7fe700 1 -- 172.21.15.98:0/1985458443 learned_addr learned my addr 172.21.15.98:0/1985458443 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccffff700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0100240 0x7fdcd0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccf7fe700 1 -- 172.21.15.98:0/1985458443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0100240 msgr2=0x7fdcd0074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccf7fe700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0100240 0x7fdcd0074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccf7fe700 1 -- 172.21.15.98:0/1985458443 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00095f0 con 0x7fdcd0101440 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccf7fe700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0101440 0x7fdcd0073140 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400b4b0 tx=0x7fdcc400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccd7fa700 1 -- 172.21.15.98:0/1985458443 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcc4011800 con 0x7fdcd0101440 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd0073aa0 con 0x7fdcd0101440 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccd7fa700 1 -- 172.21.15.98:0/1985458443 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdcc4011e10 con 0x7fdcd0101440 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.672+0000 7fdccd7fa700 1 -- 172.21.15.98:0/1985458443 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcc400f2e0 con 0x7fdcd0101440 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.673+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd019dbc0 con 0x7fdcd0101440 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.673+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd0108e10 con 0x7fdcd0101440 2024-09-13T02:49:37.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.674+0000 7fdccd7fa700 1 -- 172.21.15.98:0/1985458443 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdcc4010380 con 0x7fdcd0101440 2024-09-13T02:49:37.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.674+0000 7fdccd7fa700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdcb806c680 0x7fdcb806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:37.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.674+0000 7fdccd7fa700 1 -- 172.21.15.98:0/1985458443 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fdcc408aff0 con 0x7fdcd0101440 2024-09-13T02:49:37.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.674+0000 7fdccffff700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdcb806c680 0x7fdcb806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:37.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.675+0000 7fdccffff700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdcb806c680 0x7fdcb806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0006010 tx=0x7fdcc0005920 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:37.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.679+0000 7fdccd7fa700 1 -- 172.21.15.98:0/1985458443 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdcc4059670 con 0x7fdcd0101440 2024-09-13T02:49:37.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.878+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcd0105d90 con 0x7fdcb806c680 2024-09-13T02:49:37.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.887+0000 7fdccd7fa700 1 -- 172.21.15.98:0/1985458443 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7fdcd0105d90 con 0x7fdcb806c680 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (3m) 2m ago 5m 26.1M - 0.25.0 c8568f914cd2 babcc5d689b7 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (5m) 2m ago 5m 7004k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (4m) 63s ago 4m 6953k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (5m) 2m ago 5m 6660k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (4m) 63s ago 4m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (3m) 2m ago 4m 78.7M - 9.4.7 954c08fa6188 6b3b619a7e20 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:9283,8765,8443 running (6m) 2m ago 6m 476M - 18.2.0 dc2bc1663786 230c0046ad07 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (4m) 63s ago 4m 439M - 18.2.0 dc2bc1663786 980f7ae983de 2024-09-13T02:49:37.889 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (6m) 2m ago 6m 46.4M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (4m) 63s ago 4m 40.4M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (5m) 2m ago 5m 16.0M - 1.5.0 0da6a335fe13 5c48ece10527 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (4m) 63s ago 4m 15.2M - 1.5.0 0da6a335fe13 b2fc832c8f17 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (3m) 2m ago 3m 38.6M 3946M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (2m) 2m ago 2m 37.3M 3946M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (2m) 2m ago 2m 35.5M 3946M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (2m) 63s ago 2m 40.6M 4970M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (94s) 63s ago 94s 37.8M 4970M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (68s) 63s ago 67s 13.8M 4970M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:49:37.890 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (3m) 2m ago 4m 40.3M - 2.43.0 a07b618ecd1d fc785e775830 2024-09-13T02:49:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdcb806c680 msgr2=0x7fdcb806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdcb806c680 0x7fdcb806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0006010 tx=0x7fdcc0005920 comp rx=0 tx=0).stop 2024-09-13T02:49:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0101440 msgr2=0x7fdcd0073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0101440 0x7fdcd0073140 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400b4b0 tx=0x7fdcc400b870 comp rx=0 tx=0).stop 2024-09-13T02:49:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 shutdown_connections 2024-09-13T02:49:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdcb806c680 0x7fdcb806eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0100240 0x7fdcd0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 --2- 172.21.15.98:0/1985458443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcd0101440 0x7fdcd0073140 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 >> 172.21.15.98:0/1985458443 conn(0x7fdcd00fb7f0 msgr2=0x7fdcd0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:37.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 shutdown_connections 2024-09-13T02:49:37.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:37.890+0000 7fdcd6373700 1 -- 172.21.15.98:0/1985458443 wait complete. 2024-09-13T02:49:38.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:38 smithi098 ceph-mon[27886]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:38.555 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T02:49:38.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:38 smithi142 ceph-mon[33443]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:38.760 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:39.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:39 smithi098 ceph-mon[27886]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:39.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:39 smithi142 ceph-mon[33443]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:40.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.253+0000 7fa9f4430700 1 -- 172.21.15.98:0/144706574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec069270 msgr2=0x7fa9ec102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.253+0000 7fa9f4430700 1 --2- 172.21.15.98:0/144706574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec069270 0x7fa9ec102dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa9e400b0a0 tx=0x7fa9e400b3b0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.253+0000 7fa9f4430700 1 -- 172.21.15.98:0/144706574 shutdown_connections 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.253+0000 7fa9f4430700 1 --2- 172.21.15.98:0/144706574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9ec103310 0x7fa9ec105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.253+0000 7fa9f4430700 1 --2- 172.21.15.98:0/144706574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec069270 0x7fa9ec102dd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.253+0000 7fa9f4430700 1 -- 172.21.15.98:0/144706574 >> 172.21.15.98:0/144706574 conn(0x7fa9ec0fa780 msgr2=0x7fa9ec0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.253+0000 7fa9f4430700 1 -- 172.21.15.98:0/144706574 shutdown_connections 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.253+0000 7fa9f4430700 1 -- 172.21.15.98:0/144706574 wait complete. 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f4430700 1 Processor -- start 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f4430700 1 -- start start 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f4430700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9ec103310 0x7fa9ec195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f4430700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec196000 0x7fa9ec19b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f4430700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec196500 con 0x7fa9ec196000 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f4430700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec196670 con 0x7fa9ec103310 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f19cb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec196000 0x7fa9ec19b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f19cb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec196000 0x7fa9ec19b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48494/0 (socket says 172.21.15.98:48494) 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f19cb700 1 -- 172.21.15.98:0/2441537708 learned_addr learned my addr 172.21.15.98:0/2441537708 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f21cc700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9ec103310 0x7fa9ec195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f19cb700 1 -- 172.21.15.98:0/2441537708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9ec103310 msgr2=0x7fa9ec195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f19cb700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9ec103310 0x7fa9ec195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.254+0000 7fa9f19cb700 1 -- 172.21.15.98:0/2441537708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e4009d00 con 0x7fa9ec196000 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.255+0000 7fa9f19cb700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec196000 0x7fa9ec19b070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000c8a0 tx=0x7fa9e000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.255+0000 7fa9eb7fe700 1 -- 172.21.15.98:0/2441537708 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e00078e0 con 0x7fa9ec196000 2024-09-13T02:49:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.255+0000 7fa9eb7fe700 1 -- 172.21.15.98:0/2441537708 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9e000f450 con 0x7fa9ec196000 2024-09-13T02:49:40.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.255+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ec19b610 con 0x7fa9ec196000 2024-09-13T02:49:40.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.255+0000 7fa9eb7fe700 1 -- 172.21.15.98:0/2441537708 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e000e5e0 con 0x7fa9ec196000 2024-09-13T02:49:40.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.255+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec19bb30 con 0x7fa9ec196000 2024-09-13T02:49:40.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.256+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec18fbd0 con 0x7fa9ec196000 2024-09-13T02:49:40.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.256+0000 7fa9eb7fe700 1 -- 172.21.15.98:0/2441537708 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa9e000f5c0 con 0x7fa9ec196000 2024-09-13T02:49:40.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.257+0000 7fa9eb7fe700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9d406c680 0x7fa9d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.257+0000 7fa9eb7fe700 1 -- 172.21.15.98:0/2441537708 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa9e008b350 con 0x7fa9ec196000 2024-09-13T02:49:40.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.257+0000 7fa9f21cc700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9d406c680 0x7fa9d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.257+0000 7fa9f21cc700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9d406c680 0x7fa9d406eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4009fd0 tx=0x7fa9e40060c0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:40.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.261+0000 7fa9eb7fe700 1 -- 172.21.15.98:0/2441537708 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa9e0059920 con 0x7fa9ec196000 2024-09-13T02:49:40.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.460+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9ec02ce20 con 0x7fa9d406c680 2024-09-13T02:49:40.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.464+0000 7fa9eb7fe700 1 -- 172.21.15.98:0/2441537708 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7fa9ec02ce20 con 0x7fa9d406c680 2024-09-13T02:49:40.466 INFO:teuthology.orchestra.run.smithi098.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T02:49:40.466 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T02:49:40.466 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-13T02:49:40.466 INFO:teuthology.orchestra.run.smithi098.stdout:crash 2/2 2m ago 5m * 2024-09-13T02:49:40.466 INFO:teuthology.orchestra.run.smithi098.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-13T02:49:40.466 INFO:teuthology.orchestra.run.smithi098.stdout:mgr 2/2 2m ago 5m count:2 2024-09-13T02:49:40.466 INFO:teuthology.orchestra.run.smithi098.stdout:mon 2/2 2m ago 5m smithi098:172.21.15.98=smithi098;smithi142:172.21.15.142=smithi142;count:2 2024-09-13T02:49:40.467 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-13T02:49:40.467 INFO:teuthology.orchestra.run.smithi098.stdout:osd 6 2m ago - 2024-09-13T02:49:40.467 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-13T02:49:40.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.466+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9d406c680 msgr2=0x7fa9d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.466+0000 7fa9f4430700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9d406c680 0x7fa9d406eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4009fd0 tx=0x7fa9e40060c0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.466+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec196000 msgr2=0x7fa9ec19b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.466+0000 7fa9f4430700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec196000 0x7fa9ec19b070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000c8a0 tx=0x7fa9e000cbb0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.466+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 shutdown_connections 2024-09-13T02:49:40.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.466+0000 7fa9f4430700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fa9d406c680 0x7fa9d406eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.467+0000 7fa9f4430700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9ec103310 0x7fa9ec195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.467+0000 7fa9f4430700 1 --2- 172.21.15.98:0/2441537708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9ec196000 0x7fa9ec19b070 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.467+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 >> 172.21.15.98:0/2441537708 conn(0x7fa9ec0fa780 msgr2=0x7fa9ec0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:40.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.467+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 shutdown_connections 2024-09-13T02:49:40.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:40.467+0000 7fa9f4430700 1 -- 172.21.15.98:0/2441537708 wait complete. 2024-09-13T02:49:40.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:40 smithi142 ceph-mon[33443]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:40.698 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:40 smithi098 ceph-mon[27886]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:41.119 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T02:49:41.322 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:42.439 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:42 smithi098 ceph-mon[27886]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:42.439 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:42 smithi098 ceph-mon[27886]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:42.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:42 smithi142 ceph-mon[33443]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:42.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:42 smithi142 ceph-mon[33443]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:42.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.971+0000 7f40af245700 1 -- 172.21.15.98:0/1744554267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a80ff430 msgr2=0x7f40a80ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:42.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.971+0000 7f40af245700 1 --2- 172.21.15.98:0/1744554267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a80ff430 0x7f40a80ff8a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4094009910 tx=0x7f4094009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:42.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.971+0000 7f40af245700 1 -- 172.21.15.98:0/1744554267 shutdown_connections 2024-09-13T02:49:42.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.971+0000 7f40af245700 1 --2- 172.21.15.98:0/1744554267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a80ff430 0x7f40a80ff8a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.971+0000 7f40af245700 1 --2- 172.21.15.98:0/1744554267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a8100730 0x7f40a8100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.971+0000 7f40af245700 1 -- 172.21.15.98:0/1744554267 >> 172.21.15.98:0/1744554267 conn(0x7f40a80f9f10 msgr2=0x7f40a80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.971+0000 7f40af245700 1 -- 172.21.15.98:0/1744554267 shutdown_connections 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.971+0000 7f40af245700 1 -- 172.21.15.98:0/1744554267 wait complete. 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.971+0000 7f40af245700 1 Processor -- start 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40af245700 1 -- start start 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40af245700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a80ff430 0x7f40a80feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40af245700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a8100730 0x7f40a819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40af245700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a819add0 con 0x7f40a8100730 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40af245700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a819af40 con 0x7f40a80ff430 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a8100730 0x7f40a819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a8100730 0x7f40a819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48524/0 (socket says 172.21.15.98:48524) 2024-09-13T02:49:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a7fff700 1 -- 172.21.15.98:0/960358568 learned_addr learned my addr 172.21.15.98:0/960358568 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40acfe1700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a80ff430 0x7f40a80feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a7fff700 1 -- 172.21.15.98:0/960358568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a80ff430 msgr2=0x7f40a80feea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a7fff700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a80ff430 0x7f40a80feea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a7fff700 1 -- 172.21.15.98:0/960358568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940095f0 con 0x7f40a8100730 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a7fff700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a8100730 0x7f40a819a800 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4094006010 tx=0x7f409400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a5ffb700 1 -- 172.21.15.98:0/960358568 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409401d070 con 0x7f40a8100730 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a5ffb700 1 -- 172.21.15.98:0/960358568 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f409400f460 con 0x7f40a8100730 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a819b1c0 con 0x7f40a8100730 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.972+0000 7f40a5ffb700 1 -- 172.21.15.98:0/960358568 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4094021640 con 0x7f40a8100730 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.973+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a819b6b0 con 0x7f40a8100730 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.974+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a8107bf0 con 0x7f40a8100730 2024-09-13T02:49:42.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.974+0000 7f40a5ffb700 1 -- 172.21.15.98:0/960358568 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f409400fab0 con 0x7f40a8100730 2024-09-13T02:49:42.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.974+0000 7f40a5ffb700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f409806c680 0x7f409806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:42.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.974+0000 7f40a5ffb700 1 -- 172.21.15.98:0/960358568 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f409408c720 con 0x7f40a8100730 2024-09-13T02:49:42.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.974+0000 7f40acfe1700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f409806c680 0x7f409806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:42.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.975+0000 7f40acfe1700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f409806c680 0x7f409806eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f409c005950 tx=0x7f409c00b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:42.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:42.979+0000 7f40a5ffb700 1 -- 172.21.15.98:0/960358568 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f409405ac70 con 0x7f40a8100730 2024-09-13T02:49:43.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.177+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a819bdb0 con 0x7f409806c680 2024-09-13T02:49:43.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.178+0000 7f40a5ffb700 1 -- 172.21.15.98:0/960358568 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f40a819bdb0 con 0x7f409806c680 2024-09-13T02:49:43.180 INFO:teuthology.orchestra.run.smithi098.stdout:HOST ADDR LABELS STATUS 2024-09-13T02:49:43.180 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098 172.21.15.98 2024-09-13T02:49:43.180 INFO:teuthology.orchestra.run.smithi098.stdout:smithi142 172.21.15.142 2024-09-13T02:49:43.180 INFO:teuthology.orchestra.run.smithi098.stdout:2 hosts in cluster 2024-09-13T02:49:43.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f409806c680 msgr2=0x7f409806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:43.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f409806c680 0x7f409806eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f409c005950 tx=0x7f409c00b410 comp rx=0 tx=0).stop 2024-09-13T02:49:43.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a8100730 msgr2=0x7f40a819a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a8100730 0x7f40a819a800 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4094006010 tx=0x7f409400bd70 comp rx=0 tx=0).stop 2024-09-13T02:49:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 shutdown_connections 2024-09-13T02:49:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f409806c680 0x7f409806eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a80ff430 0x7f40a80feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 --2- 172.21.15.98:0/960358568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40a8100730 0x7f40a819a800 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 >> 172.21.15.98:0/960358568 conn(0x7f40a80f9f10 msgr2=0x7f40a8103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 shutdown_connections 2024-09-13T02:49:43.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:43.180+0000 7f40af245700 1 -- 172.21.15.98:0/960358568 wait complete. 2024-09-13T02:49:43.927 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T02:49:44.134 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:44.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:44 smithi098 ceph-mon[27886]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:44.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:44 smithi098 ceph-mon[27886]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:44 smithi142 ceph-mon[33443]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:44 smithi142 ceph-mon[33443]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:45.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.577+0000 7f71a5f9b700 1 -- 172.21.15.98:0/2833631925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a0100750 msgr2=0x7f71a0100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:45.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.577+0000 7f71a5f9b700 1 --2- 172.21.15.98:0/2833631925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a0100750 0x7f71a0100b60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f719800b0a0 tx=0x7f719800b3b0 comp rx=0 tx=0).stop 2024-09-13T02:49:45.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.577+0000 7f71a5f9b700 1 -- 172.21.15.98:0/2833631925 shutdown_connections 2024-09-13T02:49:45.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.577+0000 7f71a5f9b700 1 --2- 172.21.15.98:0/2833631925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a01010a0 0x7f71a00ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:45.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.577+0000 7f71a5f9b700 1 --2- 172.21.15.98:0/2833631925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a0100750 0x7f71a0100b60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.577+0000 7f71a5f9b700 1 -- 172.21.15.98:0/2833631925 >> 172.21.15.98:0/2833631925 conn(0x7f71a00f9f10 msgr2=0x7f71a00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.577+0000 7f71a5f9b700 1 -- 172.21.15.98:0/2833631925 shutdown_connections 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.577+0000 7f71a5f9b700 1 -- 172.21.15.98:0/2833631925 wait complete. 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f71a5f9b700 1 Processor -- start 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f71a5f9b700 1 -- start start 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f71a5f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a0100750 0x7f71a00feec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f71a5f9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a01010a0 0x7f71a019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f71a5f9b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0196790 con 0x7f71a01010a0 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f71a5f9b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a019d260 con 0x7f71a0100750 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f719effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a01010a0 0x7f71a019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f719effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a01010a0 0x7f71a019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56458/0 (socket says 172.21.15.98:56458) 2024-09-13T02:49:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f719effd700 1 -- 172.21.15.98:0/725156692 learned_addr learned my addr 172.21.15.98:0/725156692 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f719f7fe700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a0100750 0x7f71a00feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f719effd700 1 -- 172.21.15.98:0/725156692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a0100750 msgr2=0x7f71a00feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f719effd700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a0100750 0x7f71a00feec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f719effd700 1 -- 172.21.15.98:0/725156692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198009d00 con 0x7f71a01010a0 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.578+0000 7f719effd700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a01010a0 0x7f71a019cd20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f718800b4b0 tx=0x7f718800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.579+0000 7f719cff9700 1 -- 172.21.15.98:0/725156692 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7188011800 con 0x7f71a01010a0 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.579+0000 7f719cff9700 1 -- 172.21.15.98:0/725156692 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7188011e10 con 0x7f71a01010a0 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.579+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a019d540 con 0x7f71a01010a0 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.579+0000 7f719cff9700 1 -- 172.21.15.98:0/725156692 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f718800f2e0 con 0x7f71a01010a0 2024-09-13T02:49:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.579+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a019da90 con 0x7f71a01010a0 2024-09-13T02:49:45.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.580+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a0107c80 con 0x7f71a01010a0 2024-09-13T02:49:45.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.580+0000 7f719cff9700 1 -- 172.21.15.98:0/725156692 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7188010380 con 0x7f71a01010a0 2024-09-13T02:49:45.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.581+0000 7f719cff9700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f718c06c680 0x7f718c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:45.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.581+0000 7f719cff9700 1 -- 172.21.15.98:0/725156692 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f718808afc0 con 0x7f71a01010a0 2024-09-13T02:49:45.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.581+0000 7f719f7fe700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f718c06c680 0x7f718c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:45.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.581+0000 7f719f7fe700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f718c06c680 0x7f718c06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7198009480 tx=0x7f7198000f40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:45.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.585+0000 7f719cff9700 1 -- 172.21.15.98:0/725156692 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7188059590 con 0x7f71a01010a0 2024-09-13T02:49:45.723 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:45 smithi142 ceph-mon[33443]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:45.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:45 smithi098 ceph-mon[27886]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:45.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.784+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f71a0104db0 con 0x7f718c06c680 2024-09-13T02:49:45.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.785+0000 7f719cff9700 1 -- 172.21.15.98:0/725156692 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f71a0104db0 con 0x7f718c06c680 2024-09-13T02:49:45.787 INFO:teuthology.orchestra.run.smithi098.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T02:49:45.787 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010H400BGN 372G No 2m ago LVM detected, locked 2024-09-13T02:49:45.787 INFO:teuthology.orchestra.run.smithi098.stdout:smithi142 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN 372G No 68s ago LVM detected, locked 2024-09-13T02:49:45.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.787+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f718c06c680 msgr2=0x7f718c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:45.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.787+0000 7f71a5f9b700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f718c06c680 0x7f718c06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7198009480 tx=0x7f7198000f40 comp rx=0 tx=0).stop 2024-09-13T02:49:45.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.787+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a01010a0 msgr2=0x7f71a019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:45.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.787+0000 7f71a5f9b700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a01010a0 0x7f71a019cd20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f718800b4b0 tx=0x7f718800b870 comp rx=0 tx=0).stop 2024-09-13T02:49:45.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.787+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 shutdown_connections 2024-09-13T02:49:45.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.787+0000 7f71a5f9b700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f718c06c680 0x7f718c06eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:45.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.787+0000 7f71a5f9b700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a0100750 0x7f71a00feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:45.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.787+0000 7f71a5f9b700 1 --2- 172.21.15.98:0/725156692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a01010a0 0x7f71a019cd20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:45.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.787+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 >> 172.21.15.98:0/725156692 conn(0x7f71a00f9f10 msgr2=0x7f71a0103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:45.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.788+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 shutdown_connections 2024-09-13T02:49:45.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:45.788+0000 7f71a5f9b700 1 -- 172.21.15.98:0/725156692 wait complete. 2024-09-13T02:49:46.445 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:49:46.457 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:49:46.458 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T02:49:46.660 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:46.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:46 smithi098 ceph-mon[27886]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:46.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:46 smithi142 ceph-mon[33443]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:48.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.254+0000 7f9bedb2a700 1 -- 172.21.15.98:0/3531687159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be80ff140 msgr2=0x7f9be80ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.254+0000 7f9bedb2a700 1 --2- 172.21.15.98:0/3531687159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be80ff140 0x7f9be80ff550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009910 tx=0x7f9bd8009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.254+0000 7f9bedb2a700 1 -- 172.21.15.98:0/3531687159 shutdown_connections 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.254+0000 7f9bedb2a700 1 --2- 172.21.15.98:0/3531687159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8100340 0x7f9be8100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.254+0000 7f9bedb2a700 1 --2- 172.21.15.98:0/3531687159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be80ff140 0x7f9be80ff550 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.254+0000 7f9bedb2a700 1 -- 172.21.15.98:0/3531687159 >> 172.21.15.98:0/3531687159 conn(0x7f9be80fa6d0 msgr2=0x7f9be80fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.254+0000 7f9bedb2a700 1 -- 172.21.15.98:0/3531687159 shutdown_connections 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.254+0000 7f9bedb2a700 1 -- 172.21.15.98:0/3531687159 wait complete. 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.255+0000 7f9bedb2a700 1 Processor -- start 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.255+0000 7f9bedb2a700 1 -- start start 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.255+0000 7f9bedb2a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be80ff140 0x7f9be8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.255+0000 7f9bedb2a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100340 0x7f9be819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.255+0000 7f9bedb2a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be819ad70 con 0x7f9be8100340 2024-09-13T02:49:48.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.255+0000 7f9bedb2a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be819aeb0 con 0x7f9be80ff140 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.255+0000 7f9bdffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100340 0x7f9be819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.255+0000 7f9bdffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100340 0x7f9be819a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56482/0 (socket says 172.21.15.98:56482) 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.255+0000 7f9bdffff700 1 -- 172.21.15.98:0/2484737146 learned_addr learned my addr 172.21.15.98:0/2484737146 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9be77fe700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be80ff140 0x7f9be8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9bdffff700 1 -- 172.21.15.98:0/2484737146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be80ff140 msgr2=0x7f9be8069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9bdffff700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be80ff140 0x7f9be8069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9bdffff700 1 -- 172.21.15.98:0/2484737146 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80095f0 con 0x7f9be8100340 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9bdffff700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100340 0x7f9be819a830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000c930 tx=0x7f9bd000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9be57fa700 1 -- 172.21.15.98:0/2484737146 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bd0007ad0 con 0x7f9be8100340 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9be57fa700 1 -- 172.21.15.98:0/2484737146 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9bd0007c30 con 0x7f9be8100340 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be819b190 con 0x7f9be8100340 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9be57fa700 1 -- 172.21.15.98:0/2484737146 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bd0018630 con 0x7f9be8100340 2024-09-13T02:49:48.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.256+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be819b6e0 con 0x7f9be8100340 2024-09-13T02:49:48.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.257+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be8107c90 con 0x7f9be8100340 2024-09-13T02:49:48.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.258+0000 7f9be57fa700 1 -- 172.21.15.98:0/2484737146 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9bd000f450 con 0x7f9be8100340 2024-09-13T02:49:48.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.258+0000 7f9be57fa700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bd406c680 0x7f9bd406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:48.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.258+0000 7f9be77fe700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bd406c680 0x7f9bd406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:48.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.258+0000 7f9be57fa700 1 -- 172.21.15.98:0/2484737146 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f9bd008b5e0 con 0x7f9be8100340 2024-09-13T02:49:48.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.259+0000 7f9be77fe700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bd406c680 0x7f9bd406eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8006010 tx=0x7f9bd8005960 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:48.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.263+0000 7f9be57fa700 1 -- 172.21.15.98:0/2484737146 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9bd0059b30 con 0x7f9be8100340 2024-09-13T02:49:48.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:48 smithi098 ceph-mon[27886]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:48.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:48.482+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9be8104c90 con 0x7f9bd406c680 2024-09-13T02:49:48.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:48 smithi142 ceph-mon[33443]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:49.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:49 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T02:49:49.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:49 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T02:49:50.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.269+0000 7f9be57fa700 1 -- 172.21.15.98:0/2484737146 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9be8104c90 con 0x7f9bd406c680 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bd406c680 msgr2=0x7f9bd406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bd406c680 0x7f9bd406eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8006010 tx=0x7f9bd8005960 comp rx=0 tx=0).stop 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100340 msgr2=0x7f9be819a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100340 0x7f9be819a830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000c930 tx=0x7f9bd000ccf0 comp rx=0 tx=0).stop 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 shutdown_connections 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9bd406c680 0x7f9bd406eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be80ff140 0x7f9be8069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 --2- 172.21.15.98:0/2484737146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9be8100340 0x7f9be819a830 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 >> 172.21.15.98:0/2484737146 conn(0x7f9be80fa6d0 msgr2=0x7f9be8103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 shutdown_connections 2024-09-13T02:49:50.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:50.272+0000 7f9bedb2a700 1 -- 172.21.15.98:0/2484737146 wait complete. 2024-09-13T02:49:50.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:50 smithi142 ceph-mon[33443]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:50.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:50 smithi142 ceph-mon[33443]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T02:49:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:50 smithi142 ceph-mon[33443]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T02:49:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:49:50.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:50.568 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:50 smithi098 ceph-mon[27886]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:50.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:50 smithi098 ceph-mon[27886]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:50.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T02:49:50.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:50 smithi098 ceph-mon[27886]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T02:49:50.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:49:50.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:50.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:50 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[27882]: 2024-09-13T02:49:50.245+0000 7f5c4c418700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:49:50.924 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T02:49:51.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T02:49:51.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T02:49:51.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:49:51.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:49:51.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:49:51.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T02:49:51.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: fsmap cephfs:0 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: Saving service mds.cephfs spec with placement count:4 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.nwzstq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.nwzstq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:49:51.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:51 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:51.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T02:49:51.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: fsmap cephfs:0 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: Saving service mds.cephfs spec with placement count:4 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.nwzstq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:49:51.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.nwzstq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:49:51.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:51 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:51.772 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:52.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:52 smithi098 ceph-mon[27886]: Deploying daemon mds.cephfs.smithi098.nwzstq on smithi098 2024-09-13T02:49:52.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:52 smithi098 ceph-mon[27886]: pgmap v175: 65 pgs: 14 creating+peering, 44 unknown, 7 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:52.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:52 smithi098 ceph-mon[27886]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T02:49:52.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:52 smithi142 ceph-mon[33443]: Deploying daemon mds.cephfs.smithi098.nwzstq on smithi098 2024-09-13T02:49:52.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:52 smithi142 ceph-mon[33443]: pgmap v175: 65 pgs: 14 creating+peering, 44 unknown, 7 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:52.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:52 smithi142 ceph-mon[33443]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T02:49:53.467 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:53 smithi098 ceph-mon[27886]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:49:53.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:53 smithi142 ceph-mon[33443]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:49:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.388+0000 7fb097181700 1 -- 172.21.15.98:0/773452163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 msgr2=0x7fb090100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.388+0000 7fb097181700 1 --2- 172.21.15.98:0/773452163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 0x7fb090100650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb084009910 tx=0x7fb084009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.388+0000 7fb097181700 1 -- 172.21.15.98:0/773452163 shutdown_connections 2024-09-13T02:49:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.388+0000 7fb097181700 1 --2- 172.21.15.98:0/773452163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb090101440 0x7fb090101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.388+0000 7fb097181700 1 --2- 172.21.15.98:0/773452163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 0x7fb090100650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.388+0000 7fb097181700 1 -- 172.21.15.98:0/773452163 >> 172.21.15.98:0/773452163 conn(0x7fb0900fb7f0 msgr2=0x7fb0900fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.388+0000 7fb097181700 1 -- 172.21.15.98:0/773452163 shutdown_connections 2024-09-13T02:49:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.388+0000 7fb097181700 1 -- 172.21.15.98:0/773452163 wait complete. 2024-09-13T02:49:54.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb097181700 1 Processor -- start 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb097181700 1 -- start start 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb097181700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 0x7fb090195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb097181700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb090101440 0x7fb090196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb097181700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb090196630 con 0x7fb090100240 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb097181700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb090196770 con 0x7fb090101440 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb094f1d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 0x7fb090195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb094f1d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 0x7fb090195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55178/0 (socket says 172.21.15.98:55178) 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb094f1d700 1 -- 172.21.15.98:0/2727319566 learned_addr learned my addr 172.21.15.98:0/2727319566 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.389+0000 7fb08ffff700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb090101440 0x7fb090196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:54.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.390+0000 7fb094f1d700 1 -- 172.21.15.98:0/2727319566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb090101440 msgr2=0x7fb090196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:54.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.390+0000 7fb094f1d700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb090101440 0x7fb090196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.390+0000 7fb094f1d700 1 -- 172.21.15.98:0/2727319566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840095f0 con 0x7fb090100240 2024-09-13T02:49:54.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.390+0000 7fb094f1d700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 0x7fb090195ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb08400bda0 tx=0x7fb08400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:54.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.390+0000 7fb08dffb700 1 -- 172.21.15.98:0/2727319566 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08401d070 con 0x7fb090100240 2024-09-13T02:49:54.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.390+0000 7fb08dffb700 1 -- 172.21.15.98:0/2727319566 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb08400f460 con 0x7fb090100240 2024-09-13T02:49:54.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.390+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09019b1c0 con 0x7fb090100240 2024-09-13T02:49:54.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.390+0000 7fb08dffb700 1 -- 172.21.15.98:0/2727319566 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb084021620 con 0x7fb090100240 2024-09-13T02:49:54.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.390+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09019b6b0 con 0x7fb090100240 2024-09-13T02:49:54.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.391+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb090108d90 con 0x7fb090100240 2024-09-13T02:49:54.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.392+0000 7fb08dffb700 1 -- 172.21.15.98:0/2727319566 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb08400f5d0 con 0x7fb090100240 2024-09-13T02:49:54.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.392+0000 7fb08dffb700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb08006c680 0x7fb08006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:54.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.392+0000 7fb08dffb700 1 -- 172.21.15.98:0/2727319566 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb08408ca20 con 0x7fb090100240 2024-09-13T02:49:54.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.392+0000 7fb08ffff700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb08006c680 0x7fb08006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:54.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.393+0000 7fb08ffff700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb08006c680 0x7fb08006eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb07c005950 tx=0x7fb07c00b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:54.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.397+0000 7fb08dffb700 1 -- 172.21.15.98:0/2727319566 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb08405acc0 con 0x7fb090100240 2024-09-13T02:49:54.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:54 smithi142 ceph-mon[33443]: pgmap v178: 65 pgs: 19 creating+peering, 19 unknown, 27 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:54.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:54 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:54.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:54 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:54.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:54 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:54.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:54 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.wxfmvt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:49:54.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:54 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.wxfmvt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:49:54.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:54 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:54.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.630+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb09019be00 con 0x7fb090100240 2024-09-13T02:49:54.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:54 smithi098 ceph-mon[27886]: pgmap v178: 65 pgs: 19 creating+peering, 19 unknown, 27 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:49:54.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:54 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:54.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:54 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:54.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:54 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:54.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:54 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.wxfmvt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:49:54.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:54 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.wxfmvt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:49:54.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:54 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:54.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.631+0000 7fb08dffb700 1 -- 172.21.15.98:0/2727319566 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1262 (secure 0 0 0) 0x7fb09019be00 con 0x7fb090100240 2024-09-13T02:49:54.634 INFO:teuthology.orchestra.run.smithi098.stdout:e4 2024-09-13T02:49:54.634 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:49:54.634 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:49:54.634 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T02:49:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:49:54.634 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:49:54.634 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 4 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:49:54.275071+0000 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T02:49:54.635 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data disabled 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T02:49:54.636 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T02:49:54.637 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 0 2024-09-13T02:49:54.637 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:creating seq 1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:49:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:49:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb08006c680 msgr2=0x7fb08006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb08006c680 0x7fb08006eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb07c005950 tx=0x7fb07c00b410 comp rx=0 tx=0).stop 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 msgr2=0x7fb090195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 0x7fb090195ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb08400bda0 tx=0x7fb08400bdd0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 shutdown_connections 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb08006c680 0x7fb08006eb30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb090100240 0x7fb090195ad0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 --2- 172.21.15.98:0/2727319566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb090101440 0x7fb090196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 >> 172.21.15.98:0/2727319566 conn(0x7fb0900fb7f0 msgr2=0x7fb090104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 shutdown_connections 2024-09-13T02:49:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:54.633+0000 7fb097181700 1 -- 172.21.15.98:0/2727319566 wait complete. 2024-09-13T02:49:54.639 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 4 2024-09-13T02:49:55.334 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:49:55.345 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:49:55.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-13T02:49:55.546 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: Deploying daemon mds.cephfs.smithi142.wxfmvt on smithi142 2024-09-13T02:49:55.546 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: mds.? [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] up:boot 2024-09-13T02:49:55.546 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: daemon mds.cephfs.smithi098.nwzstq assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T02:49:55.546 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:49:55.546 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:49:55.546 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: Cluster is now healthy 2024-09-13T02:49:55.546 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: fsmap cephfs:0 1 up:standby 2024-09-13T02:49:55.547 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T02:49:55.547 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:creating} 2024-09-13T02:49:55.547 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: daemon mds.cephfs.smithi098.nwzstq is now active in filesystem cephfs as rank 0 2024-09-13T02:49:55.547 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:55 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2727319566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:49:55.547 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:49:55.665 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: Deploying daemon mds.cephfs.smithi142.wxfmvt on smithi142 2024-09-13T02:49:55.665 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: mds.? [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] up:boot 2024-09-13T02:49:55.665 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: daemon mds.cephfs.smithi098.nwzstq assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T02:49:55.665 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:49:55.665 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:49:55.665 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: Cluster is now healthy 2024-09-13T02:49:55.665 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: fsmap cephfs:0 1 up:standby 2024-09-13T02:49:55.666 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T02:49:55.666 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:creating} 2024-09-13T02:49:55.666 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: daemon mds.cephfs.smithi098.nwzstq is now active in filesystem cephfs as rank 0 2024-09-13T02:49:55.666 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:55 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2727319566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:49:56.415 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:56 smithi142 ceph-mon[33443]: pgmap v179: 65 pgs: 10 creating+peering, 4 unknown, 51 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 665 B/s wr, 2 op/s 2024-09-13T02:49:56.415 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:56 smithi142 ceph-mon[33443]: mds.? [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] up:active 2024-09-13T02:49:56.415 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:56 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 2024-09-13T02:49:56.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:56 smithi098 ceph-mon[27886]: pgmap v179: 65 pgs: 10 creating+peering, 4 unknown, 51 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 665 B/s wr, 2 op/s 2024-09-13T02:49:56.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:56 smithi098 ceph-mon[27886]: mds.? [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] up:active 2024-09-13T02:49:56.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:56 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 2024-09-13T02:49:57.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.121+0000 7f0ab9265700 1 -- 172.21.15.98:0/3894160435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 msgr2=0x7f0ab4100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:57.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.121+0000 7f0ab9265700 1 --2- 172.21.15.98:0/3894160435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 0x7f0ab4100860 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009910 tx=0x7f0a9c009c20 comp rx=0 tx=0).stop 2024-09-13T02:49:57.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.121+0000 7f0ab9265700 1 -- 172.21.15.98:0/3894160435 shutdown_connections 2024-09-13T02:49:57.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.121+0000 7f0ab9265700 1 --2- 172.21.15.98:0/3894160435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 0x7f0ab4100860 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:57.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.121+0000 7f0ab9265700 1 --2- 172.21.15.98:0/3894160435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab40ff150 0x7f0ab40ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:57.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.121+0000 7f0ab9265700 1 -- 172.21.15.98:0/3894160435 >> 172.21.15.98:0/3894160435 conn(0x7f0ab40fa7a0 msgr2=0x7f0ab40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:57.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.122+0000 7f0ab9265700 1 -- 172.21.15.98:0/3894160435 shutdown_connections 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.122+0000 7f0ab9265700 1 -- 172.21.15.98:0/3894160435 wait complete. 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.122+0000 7f0ab9265700 1 Processor -- start 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.122+0000 7f0ab9265700 1 -- start start 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.122+0000 7f0ab9265700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab40ff150 0x7f0ab4194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.122+0000 7f0ab9265700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 0x7f0ab41951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.122+0000 7f0ab9265700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab41957f0 con 0x7f0ab41003f0 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.122+0000 7f0ab9265700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab4195960 con 0x7f0ab40ff150 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 0x7f0ab41951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab27fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 0x7f0ab41951f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55202/0 (socket says 172.21.15.98:55202) 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab27fc700 1 -- 172.21.15.98:0/3936865636 learned_addr learned my addr 172.21.15.98:0/3936865636 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:49:57.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab2ffd700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab40ff150 0x7f0ab4194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:57.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab27fc700 1 -- 172.21.15.98:0/3936865636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab40ff150 msgr2=0x7f0ab4194cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:57.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab27fc700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab40ff150 0x7f0ab4194cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:57.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab27fc700 1 -- 172.21.15.98:0/3936865636 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0095f0 con 0x7f0ab41003f0 2024-09-13T02:49:57.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab27fc700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 0x7f0ab41951f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00bd70 tx=0x7f0a9c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:57.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0aabfff700 1 -- 172.21.15.98:0/3936865636 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a9c01d070 con 0x7f0ab41003f0 2024-09-13T02:49:57.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0aabfff700 1 -- 172.21.15.98:0/3936865636 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a9c005dc0 con 0x7f0ab41003f0 2024-09-13T02:49:57.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab419a390 con 0x7f0ab41003f0 2024-09-13T02:49:57.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0aabfff700 1 -- 172.21.15.98:0/3936865636 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a9c021410 con 0x7f0ab41003f0 2024-09-13T02:49:57.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.123+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab419a880 con 0x7f0ab41003f0 2024-09-13T02:49:57.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.124+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab4068ab0 con 0x7f0ab41003f0 2024-09-13T02:49:57.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.125+0000 7f0aabfff700 1 -- 172.21.15.98:0/3936865636 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0a9c00f7d0 con 0x7f0ab41003f0 2024-09-13T02:49:57.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.125+0000 7f0aabfff700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0aa006c680 0x7f0aa006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:57.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.125+0000 7f0ab2ffd700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0aa006c680 0x7f0aa006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:57.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.125+0000 7f0aabfff700 1 -- 172.21.15.98:0/3936865636 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0a9c08c9f0 con 0x7f0ab41003f0 2024-09-13T02:49:57.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.126+0000 7f0ab2ffd700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0aa006c680 0x7f0aa006eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4195b90 tx=0x7f0aa40073d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:57.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.130+0000 7f0aabfff700 1 -- 172.21.15.98:0/3936865636 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0a9c057180 con 0x7f0ab41003f0 2024-09-13T02:49:57.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:57.375+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f0ab419aaf0 con 0x7f0ab41003f0 2024-09-13T02:49:57.807 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:57.807 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:57.807 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:57.807 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.dioppa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:49:57.807 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.dioppa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:49:57.807 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:57.808 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: Deploying daemon mds.cephfs.smithi098.dioppa on smithi098 2024-09-13T02:49:57.808 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: pgmap v180: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 931 B/s wr, 5 op/s 2024-09-13T02:49:57.808 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:boot 2024-09-13T02:49:57.808 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby 2024-09-13T02:49:57.808 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T02:49:57.808 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:57 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3936865636' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T02:49:57.857 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:57.857 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:57.857 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:49:57.857 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.dioppa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:49:57.858 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.dioppa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:49:57.858 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:57.858 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: Deploying daemon mds.cephfs.smithi098.dioppa on smithi098 2024-09-13T02:49:57.858 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: pgmap v180: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 931 B/s wr, 5 op/s 2024-09-13T02:49:57.858 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:boot 2024-09-13T02:49:57.858 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby 2024-09-13T02:49:57.858 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T02:49:57.858 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:57 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3936865636' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T02:49:58.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.240+0000 7f0aabfff700 1 -- 172.21.15.98:0/3936865636 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0a9c00f460 con 0x7f0ab41003f0 2024-09-13T02:49:58.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0aa006c680 msgr2=0x7f0aa006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0aa006c680 0x7f0aa006eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4195b90 tx=0x7f0aa40073d0 comp rx=0 tx=0).stop 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 msgr2=0x7f0ab41951f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 0x7f0ab41951f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00bd70 tx=0x7f0a9c00bda0 comp rx=0 tx=0).stop 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 shutdown_connections 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f0aa006c680 0x7f0aa006eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab40ff150 0x7f0ab4194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 --2- 172.21.15.98:0/3936865636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ab41003f0 0x7f0ab41951f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 >> 172.21.15.98:0/3936865636 conn(0x7f0ab40fa7a0 msgr2=0x7f0ab4103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 shutdown_connections 2024-09-13T02:49:58.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:49:58.243+0000 7f0ab9265700 1 -- 172.21.15.98:0/3936865636 wait complete. 2024-09-13T02:49:58.950 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:49:58.961 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:49:58.961 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-13T02:49:59.466 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:59 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3936865636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T02:49:59.466 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:49:59 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby 2024-09-13T02:49:59.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:59 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3936865636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T02:49:59.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:49:59 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby 2024-09-13T02:49:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:00.433 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:00 smithi098 ceph-mon[27886]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-13T02:50:00.433 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:00 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:00.433 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:00 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:00.433 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:00 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:00.433 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:00 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.hplrrs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:50:00.433 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:00 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.hplrrs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:50:00.433 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:00 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:00.433 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:00 smithi098 ceph-mon[27886]: overall HEALTH_OK 2024-09-13T02:50:00.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:00 smithi142 ceph-mon[33443]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-13T02:50:00.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:00 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:00.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:00 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:00.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:00 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:00.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:00 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.hplrrs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:50:00.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:00 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.hplrrs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:50:00.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:00 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:00.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:00 smithi142 ceph-mon[33443]: overall HEALTH_OK 2024-09-13T02:50:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.207+0000 7f5b4123d700 1 -- 172.21.15.98:0/3353837048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c102210 msgr2=0x7f5b3c0fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.207+0000 7f5b4123d700 1 --2- 172.21.15.98:0/3353837048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c102210 0x7f5b3c0fe340 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009910 tx=0x7f5b24009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.207+0000 7f5b4123d700 1 -- 172.21.15.98:0/3353837048 shutdown_connections 2024-09-13T02:50:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.207+0000 7f5b4123d700 1 --2- 172.21.15.98:0/3353837048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c102210 0x7f5b3c0fe340 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.207+0000 7f5b4123d700 1 --2- 172.21.15.98:0/3353837048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b3c1018c0 0x7f5b3c101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.207+0000 7f5b4123d700 1 -- 172.21.15.98:0/3353837048 >> 172.21.15.98:0/3353837048 conn(0x7f5b3c0f9f10 msgr2=0x7f5b3c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.207+0000 7f5b4123d700 1 -- 172.21.15.98:0/3353837048 shutdown_connections 2024-09-13T02:50:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.207+0000 7f5b4123d700 1 -- 172.21.15.98:0/3353837048 wait complete. 2024-09-13T02:50:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.208+0000 7f5b4123d700 1 Processor -- start 2024-09-13T02:50:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.208+0000 7f5b4123d700 1 -- start start 2024-09-13T02:50:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.208+0000 7f5b4123d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c1018c0 0x7f5b3c195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.208+0000 7f5b4123d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b3c102210 0x7f5b3c196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.208+0000 7f5b4123d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c196640 con 0x7f5b3c1018c0 2024-09-13T02:50:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.208+0000 7f5b4123d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c196780 con 0x7f5b3c102210 2024-09-13T02:50:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b3ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c1018c0 0x7f5b3c195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b3ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c1018c0 0x7f5b3c195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55240/0 (socket says 172.21.15.98:55240) 2024-09-13T02:50:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b3ad9d700 1 -- 172.21.15.98:0/2725734384 learned_addr learned my addr 172.21.15.98:0/2725734384 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b3a59c700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b3c102210 0x7f5b3c196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b3ad9d700 1 -- 172.21.15.98:0/2725734384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b3c102210 msgr2=0x7f5b3c196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b3ad9d700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b3c102210 0x7f5b3c196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b3ad9d700 1 -- 172.21.15.98:0/2725734384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b240095f0 con 0x7f5b3c1018c0 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b3ad9d700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c1018c0 0x7f5b3c195ae0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00d8d0 tx=0x7f5b2c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b33fff700 1 -- 172.21.15.98:0/2725734384 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c0098a0 con 0x7f5b3c1018c0 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b33fff700 1 -- 172.21.15.98:0/2725734384 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b2c010460 con 0x7f5b3c1018c0 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c19b230 con 0x7f5b3c1018c0 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b33fff700 1 -- 172.21.15.98:0/2725734384 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2c00f5f0 con 0x7f5b3c1018c0 2024-09-13T02:50:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.209+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c19b780 con 0x7f5b3c1018c0 2024-09-13T02:50:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.210+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c108d30 con 0x7f5b3c1018c0 2024-09-13T02:50:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.211+0000 7f5b33fff700 1 -- 172.21.15.98:0/2725734384 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5b2c009a00 con 0x7f5b3c1018c0 2024-09-13T02:50:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.211+0000 7f5b33fff700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5b2806c680 0x7f5b2806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.211+0000 7f5b3a59c700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5b2806c680 0x7f5b2806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.211+0000 7f5b33fff700 1 -- 172.21.15.98:0/2725734384 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5b2c08b6b0 con 0x7f5b3c1018c0 2024-09-13T02:50:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.212+0000 7f5b3a59c700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5b2806c680 0x7f5b2806eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5b24006010 tx=0x7f5b2400b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.215+0000 7f5b33fff700 1 -- 172.21.15.98:0/2725734384 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5b2c0598d0 con 0x7f5b3c1018c0 2024-09-13T02:50:01.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:01.451+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f5b3c108ef0 con 0x7f5b3c1018c0 2024-09-13T02:50:01.543 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:01 smithi142 ceph-mon[33443]: Deploying daemon mds.cephfs.smithi142.hplrrs on smithi142 2024-09-13T02:50:01.543 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:01 smithi142 ceph-mon[33443]: mds.? [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] up:boot 2024-09-13T02:50:01.543 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:01 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 2 up:standby 2024-09-13T02:50:01.543 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:01 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T02:50:01.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:01 smithi098 ceph-mon[27886]: Deploying daemon mds.cephfs.smithi142.hplrrs on smithi142 2024-09-13T02:50:01.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:01 smithi098 ceph-mon[27886]: mds.? [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] up:boot 2024-09-13T02:50:01.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:01 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 2 up:standby 2024-09-13T02:50:01.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:01 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T02:50:02.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.235+0000 7f5b33fff700 1 -- 172.21.15.98:0/2725734384 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f5b2c059460 con 0x7f5b3c1018c0 2024-09-13T02:50:02.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5b2806c680 msgr2=0x7f5b2806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:02.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5b2806c680 0x7f5b2806eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5b24006010 tx=0x7f5b2400b540 comp rx=0 tx=0).stop 2024-09-13T02:50:02.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c1018c0 msgr2=0x7f5b3c195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c1018c0 0x7f5b3c195ae0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00d8d0 tx=0x7f5b2c00dbe0 comp rx=0 tx=0).stop 2024-09-13T02:50:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 shutdown_connections 2024-09-13T02:50:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f5b2806c680 0x7f5b2806eb30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b3c1018c0 0x7f5b3c195ae0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 --2- 172.21.15.98:0/2725734384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b3c102210 0x7f5b3c196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 >> 172.21.15.98:0/2725734384 conn(0x7f5b3c0f9f10 msgr2=0x7f5b3c104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 shutdown_connections 2024-09-13T02:50:02.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:02.238+0000 7f5b4123d700 1 -- 172.21.15.98:0/2725734384 wait complete. 2024-09-13T02:50:02.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-13T02:50:02.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2725734384' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T02:50:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2725734384' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T02:50:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: mds.? [v2:172.21.15.142:6826/3359717454,v1:172.21.15.142:6827/3359717454] up:boot 2024-09-13T02:50:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:02 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2725734384' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2725734384' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: mds.? [v2:172.21.15.142:6826/3359717454,v1:172.21.15.142:6827/3359717454] up:boot 2024-09-13T02:50:02.566 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:02.567 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:02 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:50:02.870 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:50:02.880 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:50:02.880 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-13T02:50:03.582 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:03 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:03.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:03 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:03.734 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:04.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:04 smithi098 ceph-mon[27886]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-13T02:50:04.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:04 smithi098 ceph-mon[27886]: mds.? [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] up:active 2024-09-13T02:50:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:04 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:04.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:04 smithi142 ceph-mon[33443]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-13T02:50:04.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:04 smithi142 ceph-mon[33443]: mds.? [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] up:active 2024-09-13T02:50:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:04 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:05.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:05 smithi098 ceph-mon[27886]: mds.? [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] up:standby 2024-09-13T02:50:05.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:05 smithi098 ceph-mon[27886]: Dropping low affinity standby-replay daemon mds.cephfs.smithi142.hplrrs in favor of higher affinity standby. 2024-09-13T02:50:05.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:05 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:05.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:05 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:50:05.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:05.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:05.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:05.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:05.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:05 smithi142 ceph-mon[33443]: mds.? [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] up:standby 2024-09-13T02:50:05.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:05 smithi142 ceph-mon[33443]: Dropping low affinity standby-replay daemon mds.cephfs.smithi142.hplrrs in favor of higher affinity standby. 2024-09-13T02:50:05.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:05 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:05.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:05 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:50:05.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:05 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:05.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:05 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:05.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:05 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:05.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:05 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.890+0000 7f66a91f7700 1 -- 172.21.15.98:0/1872409334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 msgr2=0x7f66a40ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.890+0000 7f66a91f7700 1 --2- 172.21.15.98:0/1872409334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 0x7f66a40ff550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6694009910 tx=0x7f6694009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.890+0000 7f66a91f7700 1 -- 172.21.15.98:0/1872409334 shutdown_connections 2024-09-13T02:50:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.890+0000 7f66a91f7700 1 --2- 172.21.15.98:0/1872409334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a4100340 0x7f66a4100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.890+0000 7f66a91f7700 1 --2- 172.21.15.98:0/1872409334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 0x7f66a40ff550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.890+0000 7f66a91f7700 1 -- 172.21.15.98:0/1872409334 >> 172.21.15.98:0/1872409334 conn(0x7f66a40fa6d0 msgr2=0x7f66a40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.890+0000 7f66a91f7700 1 -- 172.21.15.98:0/1872409334 shutdown_connections 2024-09-13T02:50:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.890+0000 7f66a91f7700 1 -- 172.21.15.98:0/1872409334 wait complete. 2024-09-13T02:50:05.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.891+0000 7f66a91f7700 1 Processor -- start 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.891+0000 7f66a91f7700 1 -- start start 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.891+0000 7f66a91f7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 0x7f66a4195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.891+0000 7f66a91f7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a4100340 0x7f66a4195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.891+0000 7f66a91f7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4196610 con 0x7f66a40ff140 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.891+0000 7f66a91f7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4196750 con 0x7f66a4100340 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 0x7f66a4195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 0x7f66a4195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60486/0 (socket says 172.21.15.98:60486) 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a2d9d700 1 -- 172.21.15.98:0/801693708 learned_addr learned my addr 172.21.15.98:0/801693708 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a259c700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a4100340 0x7f66a4195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a2d9d700 1 -- 172.21.15.98:0/801693708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a4100340 msgr2=0x7f66a4195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a2d9d700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a4100340 0x7f66a4195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a2d9d700 1 -- 172.21.15.98:0/801693708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940095f0 con 0x7f66a40ff140 2024-09-13T02:50:05.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a2d9d700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 0x7f66a4195ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f669400bda0 tx=0x7f669400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f668bfff700 1 -- 172.21.15.98:0/801693708 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f669401d070 con 0x7f66a40ff140 2024-09-13T02:50:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f668bfff700 1 -- 172.21.15.98:0/801693708 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f669400f460 con 0x7f66a40ff140 2024-09-13T02:50:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a419b1a0 con 0x7f66a40ff140 2024-09-13T02:50:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f668bfff700 1 -- 172.21.15.98:0/801693708 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6694021640 con 0x7f66a40ff140 2024-09-13T02:50:05.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.892+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a419b690 con 0x7f66a40ff140 2024-09-13T02:50:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.893+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a4107c90 con 0x7f66a40ff140 2024-09-13T02:50:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.894+0000 7f668bfff700 1 -- 172.21.15.98:0/801693708 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f669400f5d0 con 0x7f66a40ff140 2024-09-13T02:50:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.894+0000 7f668bfff700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f668c06c680 0x7f668c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.894+0000 7f668bfff700 1 -- 172.21.15.98:0/801693708 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f669408ca50 con 0x7f66a40ff140 2024-09-13T02:50:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.894+0000 7f66a259c700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f668c06c680 0x7f668c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:05.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.894+0000 7f66a259c700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f668c06c680 0x7f668c06eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6698005950 tx=0x7f669800b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:05.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:05.898+0000 7f668bfff700 1 -- 172.21.15.98:0/801693708 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f669405ac70 con 0x7f66a40ff140 2024-09-13T02:50:06.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.152+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f66a419bcd0 con 0x7f66a40ff140 2024-09-13T02:50:06.377 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:06 smithi098 ceph-mon[27886]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-13T02:50:06.377 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:06 smithi098 ceph-mon[27886]: mds.? [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] up:boot 2024-09-13T02:50:06.377 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:06 smithi098 ceph-mon[27886]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:standby 2024-09-13T02:50:06.377 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:06 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:06.377 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:06 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:50:06.378 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:06 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/801693708' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T02:50:06.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.423+0000 7f668bfff700 1 -- 172.21.15.98:0/801693708 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v14) v1 ==== 168+0+0 (secure 0 0 0) 0x7f669405a800 con 0x7f66a40ff140 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f668c06c680 msgr2=0x7f668c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f668c06c680 0x7f668c06eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6698005950 tx=0x7f669800b410 comp rx=0 tx=0).stop 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 msgr2=0x7f66a4195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 0x7f66a4195ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f669400bda0 tx=0x7f669400bdd0 comp rx=0 tx=0).stop 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 shutdown_connections 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f668c06c680 0x7f668c06eb30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a40ff140 0x7f66a4195ab0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 --2- 172.21.15.98:0/801693708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a4100340 0x7f66a4195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 >> 172.21.15.98:0/801693708 conn(0x7f66a40fa6d0 msgr2=0x7f66a4068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 shutdown_connections 2024-09-13T02:50:06.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:06.425+0000 7f66a91f7700 1 -- 172.21.15.98:0/801693708 wait complete. 2024-09-13T02:50:06.428 INFO:teuthology.orchestra.run.smithi098.stderr:inline data enabled 2024-09-13T02:50:06.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:06 smithi142 ceph-mon[33443]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-13T02:50:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:06 smithi142 ceph-mon[33443]: mds.? [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] up:boot 2024-09-13T02:50:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:06 smithi142 ceph-mon[33443]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:standby 2024-09-13T02:50:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:06 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:06 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:50:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:06 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/801693708' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T02:50:07.096 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:50:07.106 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:50:07.107 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T02:50:07.427 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:07 smithi098 ceph-mon[27886]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T02:50:07.427 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:07 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/801693708' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T02:50:07.427 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:07 smithi098 ceph-mon[27886]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:07.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:07 smithi142 ceph-mon[33443]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T02:50:07.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:07 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/801693708' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T02:50:07.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:07 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:50:08.384 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:08 smithi098 ceph-mon[27886]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-13T02:50:08.579 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:08.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:08 smithi142 ceph-mon[33443]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-13T02:50:10.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.111+0000 7fcd61d94700 1 -- 172.21.15.98:0/3895596891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 msgr2=0x7fcd5c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:10.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.111+0000 7fcd61d94700 1 --2- 172.21.15.98:0/3895596891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 0x7fcd5c100840 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009910 tx=0x7fcd44009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:10.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.111+0000 7fcd61d94700 1 -- 172.21.15.98:0/3895596891 shutdown_connections 2024-09-13T02:50:10.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.111+0000 7fcd61d94700 1 --2- 172.21.15.98:0/3895596891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 0x7fcd5c100840 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:10.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.111+0000 7fcd61d94700 1 --2- 172.21.15.98:0/3895596891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd5c0ff130 0x7fcd5c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:10.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.111+0000 7fcd61d94700 1 -- 172.21.15.98:0/3895596891 >> 172.21.15.98:0/3895596891 conn(0x7fcd5c0fa780 msgr2=0x7fcd5c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:10.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.111+0000 7fcd61d94700 1 -- 172.21.15.98:0/3895596891 shutdown_connections 2024-09-13T02:50:10.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.111+0000 7fcd61d94700 1 -- 172.21.15.98:0/3895596891 wait complete. 2024-09-13T02:50:10.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd61d94700 1 Processor -- start 2024-09-13T02:50:10.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd61d94700 1 -- start start 2024-09-13T02:50:10.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd61d94700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd5c0ff130 0x7fcd5c194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:10.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd61d94700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 0x7fcd5c194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:10.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd61d94700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c1954c0 con 0x7fcd5c1003d0 2024-09-13T02:50:10.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd61d94700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c195600 con 0x7fcd5c0ff130 2024-09-13T02:50:10.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd52ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 0x7fcd5c194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:10.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd5b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd5c0ff130 0x7fcd5c194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd52ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 0x7fcd5c194ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60516/0 (socket says 172.21.15.98:60516) 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.112+0000 7fcd52ffd700 1 -- 172.21.15.98:0/1357091349 learned_addr learned my addr 172.21.15.98:0/1357091349 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd5b7fe700 1 -- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 msgr2=0x7fcd5c194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd5b7fe700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 0x7fcd5c194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd5b7fe700 1 -- 172.21.15.98:0/1357091349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440095f0 con 0x7fcd5c0ff130 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd52ffd700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 0x7fcd5c194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd5b7fe700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd5c0ff130 0x7fcd5c194960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007e40 tx=0x7fcd4c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd597fa700 1 -- 172.21.15.98:0/1357091349 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4c00dbd0 con 0x7fcd5c0ff130 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c19a0b0 con 0x7fcd5c0ff130 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd597fa700 1 -- 172.21.15.98:0/1357091349 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcd4c00f040 con 0x7fcd5c0ff130 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd597fa700 1 -- 172.21.15.98:0/1357091349 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4c005a60 con 0x7fcd5c0ff130 2024-09-13T02:50:10.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.113+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c19a600 con 0x7fcd5c0ff130 2024-09-13T02:50:10.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.114+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c107c10 con 0x7fcd5c0ff130 2024-09-13T02:50:10.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.115+0000 7fcd597fa700 1 -- 172.21.15.98:0/1357091349 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcd4c005020 con 0x7fcd5c0ff130 2024-09-13T02:50:10.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.115+0000 7fcd597fa700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcd4806c630 0x7fcd4806eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:10.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.115+0000 7fcd597fa700 1 -- 172.21.15.98:0/1357091349 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcd4c08b160 con 0x7fcd5c0ff130 2024-09-13T02:50:10.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.115+0000 7fcd52ffd700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcd4806c630 0x7fcd4806eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:10.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.116+0000 7fcd52ffd700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcd4806c630 0x7fcd4806eae0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd44005090 tx=0x7fcd4400b560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:10.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.120+0000 7fcd597fa700 1 -- 172.21.15.98:0/1357091349 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcd4c04e720 con 0x7fcd5c0ff130 2024-09-13T02:50:10.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.374+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcd5c19ac90 con 0x7fcd5c0ff130 2024-09-13T02:50:10.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.375+0000 7fcd597fa700 1 -- 172.21.15.98:0/1357091349 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1850 (secure 0 0 0) 0x7fcd4c0590b0 con 0x7fcd5c0ff130 2024-09-13T02:50:10.376 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T02:50:10.377 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T02:50:10.378 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:10.379 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:10.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcd4806c630 msgr2=0x7fcd4806eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:10.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcd4806c630 0x7fcd4806eae0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd44005090 tx=0x7fcd4400b560 comp rx=0 tx=0).stop 2024-09-13T02:50:10.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd5c0ff130 msgr2=0x7fcd5c194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:10.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd5c0ff130 0x7fcd5c194960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007e40 tx=0x7fcd4c00d3b0 comp rx=0 tx=0).stop 2024-09-13T02:50:10.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 shutdown_connections 2024-09-13T02:50:10.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcd4806c630 0x7fcd4806eae0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:10.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd5c0ff130 0x7fcd5c194960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:10.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 --2- 172.21.15.98:0/1357091349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd5c1003d0 0x7fcd5c194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:10.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 >> 172.21.15.98:0/1357091349 conn(0x7fcd5c0fa780 msgr2=0x7fcd5c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:10.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 shutdown_connections 2024-09-13T02:50:10.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:10.377+0000 7fcd61d94700 1 -- 172.21.15.98:0/1357091349 wait complete. 2024-09-13T02:50:10.381 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:50:10.494 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:10 smithi098 ceph-mon[27886]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-13T02:50:10.494 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:10.494 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:10.494 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:10.494 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:10.494 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:10.494 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:10.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:10 smithi142 ceph-mon[33443]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-13T02:50:10.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:10.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:10.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:10.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:10.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:10.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:11.238 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T02:50:11.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:11 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1357091349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:50:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:11 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1357091349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:50:11.775 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:12.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:12 smithi098 ceph-mon[27886]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T02:50:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:12 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:12 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:12.653 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:12 smithi142 ceph-mon[33443]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T02:50:12.653 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:12 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:12.653 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:12 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.826+0000 7fcc00a47700 1 -- 172.21.15.98:0/3566821265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 msgr2=0x7fcbfc0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.826+0000 7fcc00a47700 1 --2- 172.21.15.98:0/3566821265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 0x7fcbfc0ff560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009910 tx=0x7fcbec009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.826+0000 7fcc00a47700 1 -- 172.21.15.98:0/3566821265 shutdown_connections 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.826+0000 7fcc00a47700 1 --2- 172.21.15.98:0/3566821265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc1003f0 0x7fcbfc100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.826+0000 7fcc00a47700 1 --2- 172.21.15.98:0/3566821265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 0x7fcbfc0ff560 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.826+0000 7fcc00a47700 1 -- 172.21.15.98:0/3566821265 >> 172.21.15.98:0/3566821265 conn(0x7fcbfc0fa7a0 msgr2=0x7fcbfc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.826+0000 7fcc00a47700 1 -- 172.21.15.98:0/3566821265 shutdown_connections 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.826+0000 7fcc00a47700 1 -- 172.21.15.98:0/3566821265 wait complete. 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcc00a47700 1 Processor -- start 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcc00a47700 1 -- start start 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcc00a47700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 0x7fcbfc194d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcc00a47700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc1003f0 0x7fcbfc195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcc00a47700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc195870 con 0x7fcbfc0ff150 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcc00a47700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc19a280 con 0x7fcbfc1003f0 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcbfa59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 0x7fcbfc194d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcbfa59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 0x7fcbfc194d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60526/0 (socket says 172.21.15.98:60526) 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcbfa59c700 1 -- 172.21.15.98:0/1232540693 learned_addr learned my addr 172.21.15.98:0/1232540693 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcbf9d9b700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc1003f0 0x7fcbfc195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcbfa59c700 1 -- 172.21.15.98:0/1232540693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc1003f0 msgr2=0x7fcbfc195250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcbfa59c700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc1003f0 0x7fcbfc195250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.827+0000 7fcbfa59c700 1 -- 172.21.15.98:0/1232540693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0095f0 con 0x7fcbfc0ff150 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.828+0000 7fcbfa59c700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 0x7fcbfc194d10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000c00 tx=0x7fcbec005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.828+0000 7fcbeb7fe700 1 -- 172.21.15.98:0/1232540693 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbec0052a0 con 0x7fcbfc0ff150 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.828+0000 7fcbeb7fe700 1 -- 172.21.15.98:0/1232540693 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcbec00fe50 con 0x7fcbfc0ff150 2024-09-13T02:50:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.828+0000 7fcbeb7fe700 1 -- 172.21.15.98:0/1232540693 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbec020670 con 0x7fcbfc0ff150 2024-09-13T02:50:13.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.828+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc068dd0 con 0x7fcbfc0ff150 2024-09-13T02:50:13.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.828+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc069290 con 0x7fcbfc0ff150 2024-09-13T02:50:13.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.829+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc068ab0 con 0x7fcbfc0ff150 2024-09-13T02:50:13.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.830+0000 7fcbeb7fe700 1 -- 172.21.15.98:0/1232540693 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcbec003a40 con 0x7fcbfc0ff150 2024-09-13T02:50:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.830+0000 7fcbeb7fe700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcbe406c680 0x7fcbe406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.830+0000 7fcbf9d9b700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcbe406c680 0x7fcbe406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.830+0000 7fcbeb7fe700 1 -- 172.21.15.98:0/1232540693 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcbec08f480 con 0x7fcbfc0ff150 2024-09-13T02:50:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.830+0000 7fcbf9d9b700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcbe406c680 0x7fcbe406eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009c60 tx=0x7fcbf0009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:13.834+0000 7fcbeb7fe700 1 -- 172.21.15.98:0/1232540693 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcbec059d50 con 0x7fcbfc0ff150 2024-09-13T02:50:14.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.071+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbfc069ce0 con 0x7fcbfc0ff150 2024-09-13T02:50:14.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.072+0000 7fcbeb7fe700 1 -- 172.21.15.98:0/1232540693 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4745 (secure 0 0 0) 0x7fcbec05d370 con 0x7fcbfc0ff150 2024-09-13T02:50:14.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcbe406c680 msgr2=0x7fcbe406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:14.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcbe406c680 0x7fcbe406eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009c60 tx=0x7fcbf0009260 comp rx=0 tx=0).stop 2024-09-13T02:50:14.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 msgr2=0x7fcbfc194d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:14.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 0x7fcbfc194d10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000c00 tx=0x7fcbec005dc0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 shutdown_connections 2024-09-13T02:50:14.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fcbe406c680 0x7fcbe406eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbfc0ff150 0x7fcbfc194d10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 --2- 172.21.15.98:0/1232540693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc1003f0 0x7fcbfc195250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 >> 172.21.15.98:0/1232540693 conn(0x7fcbfc0fa7a0 msgr2=0x7fcbfc1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:14.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.075+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 shutdown_connections 2024-09-13T02:50:14.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:14.076+0000 7fcc00a47700 1 -- 172.21.15.98:0/1232540693 wait complete. 2024-09-13T02:50:14.078 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:50:14.092 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:50:14.398 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:14 smithi098 ceph-mon[27886]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T02:50:14.399 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:14 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1232540693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:50:14.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:14 smithi142 ceph-mon[33443]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T02:50:14.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:14 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1232540693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:50:15.016 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T02:50:15.341 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:16.595 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:16 smithi098 ceph-mon[27886]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-13T02:50:16.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:16 smithi142 ceph-mon[33443]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s 2024-09-13T02:50:17.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 -- 172.21.15.98:0/2937338504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc101440 msgr2=0x7f71dc101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:17.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 --2- 172.21.15.98:0/2937338504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc101440 0x7f71dc101890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009910 tx=0x7f71cc009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:17.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 -- 172.21.15.98:0/2937338504 shutdown_connections 2024-09-13T02:50:17.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 --2- 172.21.15.98:0/2937338504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc101440 0x7f71dc101890 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:17.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 --2- 172.21.15.98:0/2937338504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71dc100240 0x7f71dc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:17.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 -- 172.21.15.98:0/2937338504 >> 172.21.15.98:0/2937338504 conn(0x7f71dc0fb7f0 msgr2=0x7f71dc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:17.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 -- 172.21.15.98:0/2937338504 shutdown_connections 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 -- 172.21.15.98:0/2937338504 wait complete. 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 Processor -- start 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.718+0000 7f71e2c60700 1 -- start start 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e2c60700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc100240 0x7f71dc195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e2c60700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71dc101440 0x7f71dc195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e2c60700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1965f0 con 0x7f71dc100240 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e2c60700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc196730 con 0x7f71dc101440 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e09fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc100240 0x7f71dc195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e09fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc100240 0x7f71dc195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53150/0 (socket says 172.21.15.98:53150) 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e09fc700 1 -- 172.21.15.98:0/3268840034 learned_addr learned my addr 172.21.15.98:0/3268840034 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71d3fff700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71dc101440 0x7f71dc195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e09fc700 1 -- 172.21.15.98:0/3268840034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71dc101440 msgr2=0x7f71dc195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:17.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e09fc700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71dc101440 0x7f71dc195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:17.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e09fc700 1 -- 172.21.15.98:0/3268840034 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0095f0 con 0x7f71dc100240 2024-09-13T02:50:17.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e09fc700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc100240 0x7f71dc195a90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f71d800ada0 tx=0x7f71d800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:17.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71d1ffb700 1 -- 172.21.15.98:0/3268840034 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d800f070 con 0x7f71dc100240 2024-09-13T02:50:17.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71d1ffb700 1 -- 172.21.15.98:0/3268840034 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f71d8007be0 con 0x7f71dc100240 2024-09-13T02:50:17.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc19b1e0 con 0x7f71dc100240 2024-09-13T02:50:17.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.719+0000 7f71d1ffb700 1 -- 172.21.15.98:0/3268840034 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d80083f0 con 0x7f71dc100240 2024-09-13T02:50:17.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.720+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc19b730 con 0x7f71dc100240 2024-09-13T02:50:17.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.721+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc108d90 con 0x7f71dc100240 2024-09-13T02:50:17.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.721+0000 7f71d1ffb700 1 -- 172.21.15.98:0/3268840034 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f71d800cad0 con 0x7f71dc100240 2024-09-13T02:50:17.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.721+0000 7f71d1ffb700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f71c406c680 0x7f71c406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:17.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.722+0000 7f71d3fff700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f71c406c680 0x7f71c406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:17.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.722+0000 7f71d1ffb700 1 -- 172.21.15.98:0/3268840034 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f71d808b1d0 con 0x7f71dc100240 2024-09-13T02:50:17.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.722+0000 7f71d3fff700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f71c406c680 0x7f71c406eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0059d0 tx=0x7f71cc005920 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:17.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:17.726+0000 7f71d1ffb700 1 -- 172.21.15.98:0/3268840034 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f71d80593f0 con 0x7f71dc100240 2024-09-13T02:50:18.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.023+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f71dc19bd70 con 0x7f71dc100240 2024-09-13T02:50:18.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.023+0000 7f71d1ffb700 1 -- 172.21.15.98:0/3268840034 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+83 (secure 0 0 0) 0x7f71d8058f80 con 0x7f71dc100240 2024-09-13T02:50:18.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.025+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f71c406c680 msgr2=0x7f71c406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:18.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.025+0000 7f71e2c60700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f71c406c680 0x7f71c406eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0059d0 tx=0x7f71cc005920 comp rx=0 tx=0).stop 2024-09-13T02:50:18.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.025+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc100240 msgr2=0x7f71dc195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:18.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.025+0000 7f71e2c60700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc100240 0x7f71dc195a90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f71d800ada0 tx=0x7f71d800c330 comp rx=0 tx=0).stop 2024-09-13T02:50:18.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.025+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 shutdown_connections 2024-09-13T02:50:18.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.025+0000 7f71e2c60700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f71c406c680 0x7f71c406eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:18.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.025+0000 7f71e2c60700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71dc100240 0x7f71dc195a90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:18.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.025+0000 7f71e2c60700 1 --2- 172.21.15.98:0/3268840034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71dc101440 0x7f71dc195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:18.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.025+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 >> 172.21.15.98:0/3268840034 conn(0x7f71dc0fb7f0 msgr2=0x7f71dc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:18.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.026+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 shutdown_connections 2024-09-13T02:50:18.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:18.026+0000 7f71e2c60700 1 -- 172.21.15.98:0/3268840034 wait complete. 2024-09-13T02:50:18.037 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:50:18.651 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:18 smithi098 ceph-mon[27886]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T02:50:18.651 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:18.651 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:18.652 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:18.652 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:18.652 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:18 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:18.652 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:18 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3268840034' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T02:50:18.672 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T02:50:18.686 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T02:50:18.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:18 smithi142 ceph-mon[33443]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T02:50:18.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:18 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:18.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:18 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:18.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:18 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:18.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:18 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:18.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:18 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:18.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:18 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3268840034' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T02:50:18.888 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:20.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.267+0000 7f80798c3700 1 -- 172.21.15.98:0/1451679201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 msgr2=0x7f80740ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:20.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.267+0000 7f80798c3700 1 --2- 172.21.15.98:0/1451679201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 0x7f80740ff720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8064009910 tx=0x7f8064009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:20.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.267+0000 7f80798c3700 1 -- 172.21.15.98:0/1451679201 shutdown_connections 2024-09-13T02:50:20.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.267+0000 7f80798c3700 1 --2- 172.21.15.98:0/1451679201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80740ffc60 0x7f807410a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:20.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.267+0000 7f80798c3700 1 --2- 172.21.15.98:0/1451679201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 0x7f80740ff720 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:20.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.267+0000 7f80798c3700 1 -- 172.21.15.98:0/1451679201 >> 172.21.15.98:0/1451679201 conn(0x7f80740748b0 msgr2=0x7f8074074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:20.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.268+0000 7f80798c3700 1 -- 172.21.15.98:0/1451679201 shutdown_connections 2024-09-13T02:50:20.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.268+0000 7f80798c3700 1 -- 172.21.15.98:0/1451679201 wait complete. 2024-09-13T02:50:20.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.268+0000 7f80798c3700 1 Processor -- start 2024-09-13T02:50:20.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.268+0000 7f80798c3700 1 -- start start 2024-09-13T02:50:20.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.268+0000 7f80798c3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 0x7f8074195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:20.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f80798c3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80740ffc60 0x7f8074196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:20.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f80798c3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8074196be0 con 0x7f80740ff350 2024-09-13T02:50:20.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f80798c3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807419a970 con 0x7f80740ffc60 2024-09-13T02:50:20.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f8072ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 0x7f8074195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f8072ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 0x7f8074195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53170/0 (socket says 172.21.15.98:53170) 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f8072ffd700 1 -- 172.21.15.98:0/3998188219 learned_addr learned my addr 172.21.15.98:0/3998188219 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f806a7fc700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80740ffc60 0x7f8074196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f8072ffd700 1 -- 172.21.15.98:0/3998188219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80740ffc60 msgr2=0x7f8074196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f8072ffd700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80740ffc60 0x7f8074196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f8072ffd700 1 -- 172.21.15.98:0/3998188219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80640095f0 con 0x7f80740ff350 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f8072ffd700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 0x7f8074195fc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f80640092e0 tx=0x7f806400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f80788c1700 1 -- 172.21.15.98:0/3998188219 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f806401d070 con 0x7f80740ff350 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807419abf0 con 0x7f80740ff350 2024-09-13T02:50:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f80788c1700 1 -- 172.21.15.98:0/3998188219 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8064022470 con 0x7f80740ff350 2024-09-13T02:50:20.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f80788c1700 1 -- 172.21.15.98:0/3998188219 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f806400f690 con 0x7f80740ff350 2024-09-13T02:50:20.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.269+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807419b0e0 con 0x7f80740ff350 2024-09-13T02:50:20.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.270+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8074107dd0 con 0x7f80740ff350 2024-09-13T02:50:20.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.271+0000 7f80788c1700 1 -- 172.21.15.98:0/3998188219 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f80640225e0 con 0x7f80740ff350 2024-09-13T02:50:20.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.271+0000 7f80788c1700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f806006c680 0x7f806006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:20.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.271+0000 7f806a7fc700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f806006c680 0x7f806006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:20.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.271+0000 7f80788c1700 1 -- 172.21.15.98:0/3998188219 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f806408cdf0 con 0x7f80740ff350 2024-09-13T02:50:20.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.272+0000 7f806a7fc700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f806006c680 0x7f806006eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:20.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.276+0000 7f80788c1700 1 -- 172.21.15.98:0/3998188219 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8064057630 con 0x7f80740ff350 2024-09-13T02:50:20.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.512+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8074197320 con 0x7f80740ff350 2024-09-13T02:50:20.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.513+0000 7f80788c1700 1 -- 172.21.15.98:0/3998188219 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f806405ac50 con 0x7f80740ff350 2024-09-13T02:50:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:50:20.515 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T02:50:06.420732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14454":{"gid":14454,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6827/831008890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":831008890},{"type":"v1","addr":"172.21.15.98:6827","nonce":831008890}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14470":{"gid":14470,"name":"cephfs.smithi098.dioppa","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.98:6829/3075365470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3075365470},{"type":"v1","addr":"172.21.15.98:6829","nonce":3075365470}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T02:50:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f806006c680 msgr2=0x7f806006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f806006c680 0x7f806006eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c008040 comp rx=0 tx=0).stop 2024-09-13T02:50:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 msgr2=0x7f8074195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 0x7f8074195fc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f80640092e0 tx=0x7f806400be20 comp rx=0 tx=0).stop 2024-09-13T02:50:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 shutdown_connections 2024-09-13T02:50:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f806006c680 0x7f806006eb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80740ff350 0x7f8074195fc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 --2- 172.21.15.98:0/3998188219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80740ffc60 0x7f8074196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 >> 172.21.15.98:0/3998188219 conn(0x7f80740748b0 msgr2=0x7f8074104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:20.518 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:20 smithi098 ceph-mon[27886]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T02:50:20.518 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:20 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:20.518 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:20 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:20.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.515+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 shutdown_connections 2024-09-13T02:50:20.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:20.516+0000 7f80798c3700 1 -- 172.21.15.98:0/3998188219 wait complete. 2024-09-13T02:50:20.519 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:50:20.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:20 smithi142 ceph-mon[33443]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T02:50:20.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:20 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:50:20.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:20 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:21.073 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 50} 2024-09-13T02:50:21.073 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T02:50:21.104 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T02:50:21.104 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-13T02:50:21.105 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T02:50:21.105 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T02:50:21.105 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:21.105 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-13T02:50:21.105 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T02:50:21.105 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:21.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:21.106 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-13T02:50:21.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:21.123 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-13T02:50:21.191 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-13T02:50:21.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:50:21.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:21.193 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T02:50:21.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:21.213 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-09-13T02:50:21.287 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-09-13T02:50:21.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:50:21.289 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T02:50:21.289 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T02:50:21.289 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T02:50:21.311 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:21 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3998188219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:50:21.488 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:21.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:21 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3998188219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:50:22.634 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:22 smithi098 ceph-mon[27886]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:50:22.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:22 smithi142 ceph-mon[33443]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:50:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.990+0000 7f840f7b7700 1 -- 172.21.15.98:0/1371799142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ffc60 msgr2=0x7f840810a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.990+0000 7f840f7b7700 1 --2- 172.21.15.98:0/1371799142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ffc60 0x7f840810a6d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009910 tx=0x7f83f8009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.990+0000 7f840f7b7700 1 -- 172.21.15.98:0/1371799142 shutdown_connections 2024-09-13T02:50:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.990+0000 7f840f7b7700 1 --2- 172.21.15.98:0/1371799142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ffc60 0x7f840810a6d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.990+0000 7f840f7b7700 1 --2- 172.21.15.98:0/1371799142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080ff350 0x7f84080ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.990+0000 7f840f7b7700 1 -- 172.21.15.98:0/1371799142 >> 172.21.15.98:0/1371799142 conn(0x7f84080748b0 msgr2=0x7f8408074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.990+0000 7f840f7b7700 1 -- 172.21.15.98:0/1371799142 shutdown_connections 2024-09-13T02:50:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.990+0000 7f840f7b7700 1 -- 172.21.15.98:0/1371799142 wait complete. 2024-09-13T02:50:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.990+0000 7f840f7b7700 1 Processor -- start 2024-09-13T02:50:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840f7b7700 1 -- start start 2024-09-13T02:50:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840f7b7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ff350 0x7f8408195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840f7b7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080ffc60 0x7f8408196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:23.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840f7b7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408196b60 con 0x7f84080ff350 2024-09-13T02:50:23.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840f7b7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840819a8a0 con 0x7f84080ffc60 2024-09-13T02:50:23.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840d553700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ff350 0x7f8408195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:23.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840d553700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ff350 0x7f8408195f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53200/0 (socket says 172.21.15.98:53200) 2024-09-13T02:50:23.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840d553700 1 -- 172.21.15.98:0/2408890211 learned_addr learned my addr 172.21.15.98:0/2408890211 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:23.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840d553700 1 -- 172.21.15.98:0/2408890211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080ffc60 msgr2=0x7f8408196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:23.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840d553700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080ffc60 0x7f8408196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:23.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840d553700 1 -- 172.21.15.98:0/2408890211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80095f0 con 0x7f84080ff350 2024-09-13T02:50:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840d553700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ff350 0x7f8408195f40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f840400b4b0 tx=0x7f840400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f83fe7fc700 1 -- 172.21.15.98:0/2408890211 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8404011800 con 0x7f84080ff350 2024-09-13T02:50:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f83fe7fc700 1 -- 172.21.15.98:0/2408890211 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8404011e10 con 0x7f84080ff350 2024-09-13T02:50:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840819ab80 con 0x7f84080ff350 2024-09-13T02:50:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.991+0000 7f83fe7fc700 1 -- 172.21.15.98:0/2408890211 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f840400f2e0 con 0x7f84080ff350 2024-09-13T02:50:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.992+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840819b0d0 con 0x7f84080ff350 2024-09-13T02:50:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.992+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8408107dd0 con 0x7f84080ff350 2024-09-13T02:50:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.993+0000 7f83fe7fc700 1 -- 172.21.15.98:0/2408890211 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8404010380 con 0x7f84080ff350 2024-09-13T02:50:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.993+0000 7f83fe7fc700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f83f406c680 0x7f83f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.993+0000 7f83fe7fc700 1 -- 172.21.15.98:0/2408890211 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f840408b320 con 0x7f84080ff350 2024-09-13T02:50:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.993+0000 7f840cd52700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f83f406c680 0x7f83f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.994+0000 7f840cd52700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f83f406c680 0x7f83f406eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83f8006010 tx=0x7f83f800b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:22.998+0000 7f83fe7fc700 1 -- 172.21.15.98:0/2408890211 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8404055be0 con 0x7f84080ff350 2024-09-13T02:50:23.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.230+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f840819b3f0 con 0x7f84080ff350 2024-09-13T02:50:23.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.231+0000 7f83fe7fc700 1 -- 172.21.15.98:0/2408890211 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f8404059200 con 0x7f84080ff350 2024-09-13T02:50:23.232 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T02:50:23.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f83f406c680 msgr2=0x7f83f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:23.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f83f406c680 0x7f83f406eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83f8006010 tx=0x7f83f800b540 comp rx=0 tx=0).stop 2024-09-13T02:50:23.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ff350 msgr2=0x7f8408195f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:23.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ff350 0x7f8408195f40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f840400b4b0 tx=0x7f840400b870 comp rx=0 tx=0).stop 2024-09-13T02:50:23.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 shutdown_connections 2024-09-13T02:50:23.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f83f406c680 0x7f83f406eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:23.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84080ff350 0x7f8408195f40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:23.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 --2- 172.21.15.98:0/2408890211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080ffc60 0x7f8408196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:23.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 >> 172.21.15.98:0/2408890211 conn(0x7f84080748b0 msgr2=0x7f8408104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:23.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 shutdown_connections 2024-09-13T02:50:23.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23.233+0000 7f840f7b7700 1 -- 172.21.15.98:0/2408890211 wait complete. 2024-09-13T02:50:23.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:23 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2408890211' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:50:23.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:23 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2408890211' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:50:23.839 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T02:50:23.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T02:50:23.839 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2024-09-13T02:50:23.839 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T02:50:23.839 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:23.839 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T02:50:23.839 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T02:50:23.839 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T02:50:23.839 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T02:50:23.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:23.840 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2024-09-13T02:50:23.896 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T02:50:23.896 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T02:50:23.896 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T02:50:23.896 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:50:23.896 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-13T02:50:23.896 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42356sec preferred_lft 42356sec 2024-09-13T02:50:23.897 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-13T02:50:23.898 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:50:23.900 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T02:50:23.901 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:23.901 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-13T02:50:23.901 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2024-09-13T02:50:23.901 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2024-09-13T02:50:23.901 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2024-09-13T02:50:23.901 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T02:50:23.901 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-13T02:50:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:24.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:24.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:24.110 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T02:50:24.136 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-13T02:50:24.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:24.138 DEBUG:teuthology.orchestra.run.smithi098:> route 2024-09-13T02:50:24.207 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2024-09-13T02:50:24.207 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T02:50:24.207 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T02:50:24.208 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T02:50:24.208 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T02:50:24.208 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:24.208 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-13T02:50:24.208 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T02:50:24.208 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T02:50:24.209 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T02:50:24.209 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-13T02:50:24.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:24.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:24.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:24.528 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-13T02:50:24.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:24.543 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2024-09-13T02:50:24.599 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:24.599 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-13T02:50:24.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T02:50:24.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T02:50:24.599 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-13T02:50:24.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:24.695 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:24 smithi098 ceph-mon[27886]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:50:24.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:24.717 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T02:50:24.717 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:24.717 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-13T02:50:24.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T02:50:24.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T02:50:24.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T02:50:24.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T02:50:24.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T02:50:24.717 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-13T02:50:24.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:24 smithi142 ceph-mon[33443]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:50:24.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:24.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:24.844 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:24.844 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-13T02:50:24.844 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2024-09-13T02:50:24.844 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T02:50:24.844 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-13T02:50:24.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:24.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:24.921 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T02:50:24.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:50:24.925 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:24.951 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T02:50:24.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:50:24.951 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:25.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2024-09-13T02:50:25.073 DEBUG:teuthology.orchestra.run.smithi098:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T02:50:25.130 INFO:teuthology.orchestra.run.smithi098.stdout:/proc 2024-09-13T02:50:25.130 INFO:teuthology.orchestra.run.smithi098.stdout:/sys 2024-09-13T02:50:25.130 INFO:teuthology.orchestra.run.smithi098.stdout:/dev 2024-09-13T02:50:25.130 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/security 2024-09-13T02:50:25.130 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/shm 2024-09-13T02:50:25.130 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/pts 2024-09-13T02:50:25.130 INFO:teuthology.orchestra.run.smithi098.stdout:/run 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/cgroup 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/pstore 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/bpf 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/ 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/selinux 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/mqueue 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/hugepages 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/debug 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/tracing 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/fuse/connections 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/config 2024-09-13T02:50:25.131 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/run/user/1000 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/ceph 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/6949c823d1477d2fa68937da1dacd24fe438305b167cf112346d72baf41fc717/merged 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/d197534082fd5add3f5aa7d3710c066c388935b67143a19baf74c3d536f1b71e/merged 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/run/user/0 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/f75163fbf5b01b8bcdb4558c78842fb84758d3d143f4eb8cf67413ea56818887/merged 2024-09-13T02:50:25.132 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/4a904001ba3b13385ece4ffaa5da244d644b41f9486c5dc1496ad9fa7fe99054/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/b04b82465df0a7bb7a60f4f7562c11ab2829f0543ef42b23f7950c2852b93e4e/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/41c494d7557aad8b941414261ed3f3471ea9d979bb56c627a9a93cf0c4445113/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/25172a4a983ad919983064d37d43ea292467fdb75740d9c51dd063750ab3df73/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/06f631ee66c06586b846cf072329298b8c97e72818a081aea86814daec78a7e8/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/0aed213ea2f4be6eef837a0db424eb169f640a462e28d5c33afe202e2c4b568a/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/10fe42928bf7d6edb6699a428a1b8f46e7cfecb9af89142239b85b1280ff9c8a/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/c0aee8634c704469b8448307d47cdfb474b43babe62ef23708f86934d9a29e32/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/fae5090da5a4b0a25d6f6edd15c3bcb5c0e27058b276cb8be3d19b5f434ae343/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/d80415c5f7956aba6c6337837c2dcd1fed0f1e9efc4762adc0091d9c6b788e49/merged 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T02:50:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T02:50:25.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:25.134 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2024-09-13T02:50:25.185 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T02:50:25.186 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T02:50:25.229 DEBUG:teuthology.orchestra.run.smithi098:> sudo modprobe fuse 2024-09-13T02:50:25.253 DEBUG:teuthology.orchestra.run.smithi098:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/proc 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/sys 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/dev 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/security 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/shm 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/pts 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/run 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/cgroup 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/pstore 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/bpf 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/ 2024-09-13T02:50:25.311 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/selinux 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/mqueue 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/dev/hugepages 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/debug 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/tracing 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/fs/fuse/connections 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/sys/kernel/config 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/run/user/1000 2024-09-13T02:50:25.312 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/ceph 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/6949c823d1477d2fa68937da1dacd24fe438305b167cf112346d72baf41fc717/merged 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/d197534082fd5add3f5aa7d3710c066c388935b67143a19baf74c3d536f1b71e/merged 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/run/user/0 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/f75163fbf5b01b8bcdb4558c78842fb84758d3d143f4eb8cf67413ea56818887/merged 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/4a904001ba3b13385ece4ffaa5da244d644b41f9486c5dc1496ad9fa7fe99054/merged 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/b04b82465df0a7bb7a60f4f7562c11ab2829f0543ef42b23f7950c2852b93e4e/merged 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/41c494d7557aad8b941414261ed3f3471ea9d979bb56c627a9a93cf0c4445113/merged 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/25172a4a983ad919983064d37d43ea292467fdb75740d9c51dd063750ab3df73/merged 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/06f631ee66c06586b846cf072329298b8c97e72818a081aea86814daec78a7e8/merged 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/0aed213ea2f4be6eef837a0db424eb169f640a462e28d5c33afe202e2c4b568a/merged 2024-09-13T02:50:25.313 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/10fe42928bf7d6edb6699a428a1b8f46e7cfecb9af89142239b85b1280ff9c8a/merged 2024-09-13T02:50:25.314 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/c0aee8634c704469b8448307d47cdfb474b43babe62ef23708f86934d9a29e32/merged 2024-09-13T02:50:25.314 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/fae5090da5a4b0a25d6f6edd15c3bcb5c0e27058b276cb8be3d19b5f434ae343/merged 2024-09-13T02:50:25.314 INFO:teuthology.orchestra.run.smithi098.stdout:/var/lib/containers/storage/overlay/d80415c5f7956aba6c6337837c2dcd1fed0f1e9efc4762adc0091d9c6b788e49/merged 2024-09-13T02:50:25.314 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns 2024-09-13T02:50:25.314 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T02:50:25.314 INFO:teuthology.orchestra.run.smithi098.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T02:50:25.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:25.314 DEBUG:teuthology.orchestra.run.smithi098:> ls /sys/fs/fuse/connections 2024-09-13T02:50:25.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:2024-09-13T02:50:25.341+0000 7f554ab59480 -1 init, newargv = 0x55f9ce5912b0 newargc=15 2024-09-13T02:50:25.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[65537]: starting ceph client 2024-09-13T02:50:25.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[65537]: starting fuse 2024-09-13T02:50:25.358 INFO:teuthology.orchestra.run.smithi098.stdout:165 2024-09-13T02:50:25.358 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [165] 2024-09-13T02:50:25.359 DEBUG:teuthology.orchestra.run.smithi098:> sudo stdin-killer -- python3 -c ' 2024-09-13T02:50:25.359 DEBUG:teuthology.orchestra.run.smithi098:> import glob 2024-09-13T02:50:25.359 DEBUG:teuthology.orchestra.run.smithi098:> import re 2024-09-13T02:50:25.359 DEBUG:teuthology.orchestra.run.smithi098:> import os 2024-09-13T02:50:25.359 DEBUG:teuthology.orchestra.run.smithi098:> import subprocess 2024-09-13T02:50:25.359 DEBUG:teuthology.orchestra.run.smithi098:> 2024-09-13T02:50:25.359 DEBUG:teuthology.orchestra.run.smithi098:> def _find_admin_socket(client_name): 2024-09-13T02:50:25.359 DEBUG:teuthology.orchestra.run.smithi098:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T02:50:25.359 DEBUG:teuthology.orchestra.run.smithi098:> files = glob.glob(asok_path) 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> # Given a non-glob path, it better be there 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> if "*" not in asok_path: 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> assert(len(files) == 1) 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> return files[0] 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> for f in files: 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T02:50:25.360 DEBUG:teuthology.orchestra.run.smithi098:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T02:50:25.361 DEBUG:teuthology.orchestra.run.smithi098:> contents = proc_f.read() 2024-09-13T02:50:25.361 DEBUG:teuthology.orchestra.run.smithi098:> if mountpoint in contents: 2024-09-13T02:50:25.361 DEBUG:teuthology.orchestra.run.smithi098:> return f 2024-09-13T02:50:25.361 DEBUG:teuthology.orchestra.run.smithi098:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T02:50:25.361 DEBUG:teuthology.orchestra.run.smithi098:> 2024-09-13T02:50:25.361 DEBUG:teuthology.orchestra.run.smithi098:> print(_find_admin_socket("client.0")) 2024-09-13T02:50:25.361 DEBUG:teuthology.orchestra.run.smithi098:> ' 2024-09-13T02:50:25.475 INFO:teuthology.orchestra.run.smithi098.stdout:/var/run/ceph/ceph-client.0.65537.asok 2024-09-13T02:50:25.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:25.485 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.65537.asok 2024-09-13T02:50:25.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:25.486 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.65537.asok status 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "metadata": { 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "entity_id": "0", 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": "smithi098", 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "pid": "65537", 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "root": "/" 2024-09-13T02:50:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_count": 0, 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "dentry_pinned_count": 0, 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 14508, 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "inst": { 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "name": { 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "client", 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "num": 14508 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3551376023 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:50:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": { 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "192.168.0.1:0", 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3551376023 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "inst_str": "client.14508 192.168.0.1:0/3551376023", 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "addr_str": "192.168.0.1:0/3551376023", 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "inode_count": 1, 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_epoch": 14, 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch": 46, 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_epoch_barrier": 0, 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "blocklisted": false, 2024-09-13T02:50:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs" 2024-09-13T02:50:25.621 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:50:25.626 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T02:50:25.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T02:50:25.828 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:26.719 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:26 smithi098 ceph-mon[27886]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:50:26.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:26 smithi142 ceph-mon[33443]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:50:27.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.242+0000 7f59794c6700 1 -- 172.21.15.98:0/1864620103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 msgr2=0x7f5974104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:27.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.242+0000 7f59794c6700 1 --2- 172.21.15.98:0/1864620103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 0x7f5974104500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5964009910 tx=0x7f5964009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:27.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.242+0000 7f59794c6700 1 -- 172.21.15.98:0/1864620103 shutdown_connections 2024-09-13T02:50:27.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.242+0000 7f59794c6700 1 --2- 172.21.15.98:0/1864620103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59740ffbd0 0x7f5974100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:27.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.242+0000 7f59794c6700 1 --2- 172.21.15.98:0/1864620103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 0x7f5974104500 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:27.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.242+0000 7f59794c6700 1 -- 172.21.15.98:0/1864620103 >> 172.21.15.98:0/1864620103 conn(0x7f5974075130 msgr2=0x7f5974075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:27.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.242+0000 7f59794c6700 1 -- 172.21.15.98:0/1864620103 shutdown_connections 2024-09-13T02:50:27.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.242+0000 7f59794c6700 1 -- 172.21.15.98:0/1864620103 wait complete. 2024-09-13T02:50:27.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f59794c6700 1 Processor -- start 2024-09-13T02:50:27.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f59794c6700 1 -- start start 2024-09-13T02:50:27.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f59794c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59740ffbd0 0x7f5974195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:27.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f59794c6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 0x7f5974196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:27.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f59794c6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974196a50 con 0x7f5974104130 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f59794c6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597419a770 con 0x7f59740ffbd0 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f59727fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 0x7f5974196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f59727fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 0x7f5974196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43330/0 (socket says 172.21.15.98:43330) 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f59727fc700 1 -- 172.21.15.98:0/2550008847 learned_addr learned my addr 172.21.15.98:0/2550008847 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.243+0000 7f5972ffd700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59740ffbd0 0x7f5974195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.244+0000 7f59727fc700 1 -- 172.21.15.98:0/2550008847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59740ffbd0 msgr2=0x7f5974195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.244+0000 7f59727fc700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59740ffbd0 0x7f5974195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.244+0000 7f59727fc700 1 -- 172.21.15.98:0/2550008847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640095f0 con 0x7f5974104130 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.244+0000 7f59727fc700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 0x7f5974196370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f596800e920 tx=0x7f596800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:27.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.244+0000 7f595bfff700 1 -- 172.21.15.98:0/2550008847 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f596800c9d0 con 0x7f5974104130 2024-09-13T02:50:27.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.244+0000 7f595bfff700 1 -- 172.21.15.98:0/2550008847 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5968010430 con 0x7f5974104130 2024-09-13T02:50:27.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.244+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597419aa50 con 0x7f5974104130 2024-09-13T02:50:27.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.244+0000 7f595bfff700 1 -- 172.21.15.98:0/2550008847 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5968018650 con 0x7f5974104130 2024-09-13T02:50:27.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.244+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597419afa0 con 0x7f5974104130 2024-09-13T02:50:27.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.245+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597404f2a0 con 0x7f5974104130 2024-09-13T02:50:27.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.245+0000 7f595bfff700 1 -- 172.21.15.98:0/2550008847 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f59680105a0 con 0x7f5974104130 2024-09-13T02:50:27.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.246+0000 7f595bfff700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:27.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.246+0000 7f595bfff700 1 -- 172.21.15.98:0/2550008847 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5968014070 con 0x7f5974104130 2024-09-13T02:50:27.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.246+0000 7f5972ffd700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:27.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.246+0000 7f5972ffd700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5964009fd0 tx=0x7f5964005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:27.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.250+0000 7f595bfff700 1 -- 172.21.15.98:0/2550008847 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5968051720 con 0x7f5974104130 2024-09-13T02:50:27.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.487+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f597419b2b0 con 0x7f5974104130 2024-09-13T02:50:27.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.487+0000 7f595bfff700 1 -- 172.21.15.98:0/2550008847 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f5968056350 con 0x7f5974104130 2024-09-13T02:50:27.489 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T02:50:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.489+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f595c06c680 msgr2=0x7f595c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.489+0000 7f59794c6700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5964009fd0 tx=0x7f5964005a90 comp rx=0 tx=0).stop 2024-09-13T02:50:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.489+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 msgr2=0x7f5974196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.489+0000 7f59794c6700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 0x7f5974196370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f596800e920 tx=0x7f596800ec30 comp rx=0 tx=0).stop 2024-09-13T02:50:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.489+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 shutdown_connections 2024-09-13T02:50:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.489+0000 7f59794c6700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.489+0000 7f59794c6700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59740ffbd0 0x7f5974195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.489+0000 7f59794c6700 1 --2- 172.21.15.98:0/2550008847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5974104130 0x7f5974196370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:27.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.489+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 >> 172.21.15.98:0/2550008847 conn(0x7f5974075130 msgr2=0x7f59740685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:27.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.490+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 shutdown_connections 2024-09-13T02:50:27.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:27.490+0000 7f59794c6700 1 -- 172.21.15.98:0/2550008847 wait complete. 2024-09-13T02:50:28.057 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T02:50:28.057 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T02:50:28.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-09-13T02:50:28.057 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T02:50:28.057 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:28.057 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T02:50:28.057 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T02:50:28.057 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T02:50:28.058 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T02:50:28.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:28.058 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-09-13T02:50:28.077 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:50:28.078 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-09-13T02:50:28.079 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T02:50:28.079 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-09-13T02:50:28.079 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T02:50:28.079 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42359sec preferred_lft 42359sec 2024-09-13T02:50:28.079 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link noprefixroute 2024-09-13T02:50:28.079 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:50:28.079 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T02:50:28.079 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:28.079 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T02:50:28.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-09-13T02:50:28.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-09-13T02:50:28.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-09-13T02:50:28.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T02:50:28.080 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T02:50:28.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:28.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:28.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:28.304 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T02:50:28.328 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-09-13T02:50:28.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:28.330 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-09-13T02:50:28.394 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-09-13T02:50:28.394 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T02:50:28.394 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T02:50:28.395 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T02:50:28.395 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T02:50:28.395 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:28.395 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T02:50:28.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T02:50:28.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T02:50:28.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T02:50:28.395 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T02:50:28.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:28.491 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:28 smithi142 ceph-mon[33443]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:50:28.491 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:28 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2550008847' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:50:28.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:28.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:28.691 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-09-13T02:50:28.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:28.707 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-09-13T02:50:28.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:28 smithi098 ceph-mon[27886]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:50:28.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:28 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2550008847' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:50:28.763 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:28.763 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T02:50:28.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T02:50:28.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T02:50:28.763 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T02:50:28.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:28.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:28.883 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T02:50:28.883 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:28.883 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T02:50:28.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T02:50:28.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T02:50:28.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T02:50:28.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T02:50:28.883 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T02:50:28.883 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T02:50:28.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:29.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:29.024 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:50:29.024 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-09-13T02:50:29.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-09-13T02:50:29.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T02:50:29.024 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-09-13T02:50:29.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:50:29.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:29.101 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T02:50:29.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:50:29.101 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:29.116 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T02:50:29.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:50:29.117 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:29.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-09-13T02:50:29.238 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T02:50:29.294 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-09-13T02:50:29.294 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-09-13T02:50:29.294 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-09-13T02:50:29.294 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/bpf 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-09-13T02:50:29.295 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/0 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/c712d170ad5c5ecba7825a2540d8b832ae9faa48011440701be74d248082acf8/merged 2024-09-13T02:50:29.296 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/046ee2b0d72ee70d6331f9b99959231c7a0111258b5a1bbfdb8b24cf30f16a27/merged 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/8f6402e9b04e5603f4fbe4cedfa30f99648eefd26d5bdff3b175a6a855cca9e8/merged 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/16890d920521748c0aa20b4d8afac7b415af67d9f8548c11cd06d0700f2cb195/merged 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/9c9caed9dc0ff3ae52343e07d6e50d189c9261c8f8f27f1d83504b6d25ec25a9/merged 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/e0daa8d9ab13b96f294bc1374daf8c9bad7f2857ab2472b0684f4a5a2ef32aeb/merged 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/e1e002321ad20b2043d2c5492cd91ff9d880ef55e444e9955a758bcc5e092570/merged 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/0ce9460398d3788ceb8466cbbcdd099946e474ed82e9333f4564cba3af9f569f/merged 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/8dbcf24f9823a9b1e62061a760fc2dbc2a4fff7b9156bc3bb5ffa5e5484babbe/merged 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/03dc0f9616d409b5c64117b2c18d036bc544182c2229d6ae08346998d9ec4e11/merged 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T02:50:29.297 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T02:50:29.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:29.298 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-09-13T02:50:29.350 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T02:50:29.351 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T02:50:29.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-09-13T02:50:29.420 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T02:50:29.476 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-09-13T02:50:29.476 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-09-13T02:50:29.476 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-09-13T02:50:29.476 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-09-13T02:50:29.476 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-09-13T02:50:29.476 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-09-13T02:50:29.476 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/bpf 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T02:50:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/0 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/c712d170ad5c5ecba7825a2540d8b832ae9faa48011440701be74d248082acf8/merged 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/046ee2b0d72ee70d6331f9b99959231c7a0111258b5a1bbfdb8b24cf30f16a27/merged 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/8f6402e9b04e5603f4fbe4cedfa30f99648eefd26d5bdff3b175a6a855cca9e8/merged 2024-09-13T02:50:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/16890d920521748c0aa20b4d8afac7b415af67d9f8548c11cd06d0700f2cb195/merged 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/9c9caed9dc0ff3ae52343e07d6e50d189c9261c8f8f27f1d83504b6d25ec25a9/merged 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/e0daa8d9ab13b96f294bc1374daf8c9bad7f2857ab2472b0684f4a5a2ef32aeb/merged 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/e1e002321ad20b2043d2c5492cd91ff9d880ef55e444e9955a758bcc5e092570/merged 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/0ce9460398d3788ceb8466cbbcdd099946e474ed82e9333f4564cba3af9f569f/merged 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/8dbcf24f9823a9b1e62061a760fc2dbc2a4fff7b9156bc3bb5ffa5e5484babbe/merged 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/03dc0f9616d409b5c64117b2c18d036bc544182c2229d6ae08346998d9ec4e11/merged 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T02:50:29.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:29.480 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-09-13T02:50:29.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:2024-09-13T02:50:29.537+0000 7f01105b9480 -1 init, newargv = 0x556a17265490 newargc=15 2024-09-13T02:50:29.539 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:ceph-fuse[52994]: starting ceph client 2024-09-13T02:50:29.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:ceph-fuse[52994]: starting fuse 2024-09-13T02:50:30.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:30 smithi098 ceph-mon[27886]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:50:30.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-09-13T02:50:30.658 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:30 smithi142 ceph-mon[33443]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:50:30.663 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T02:50:30.720 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-09-13T02:50:30.720 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-09-13T02:50:30.720 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-09-13T02:50:30.720 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-09-13T02:50:30.720 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-09-13T02:50:30.720 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-09-13T02:50:30.720 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/bpf 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T02:50:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/0 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/c712d170ad5c5ecba7825a2540d8b832ae9faa48011440701be74d248082acf8/merged 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/046ee2b0d72ee70d6331f9b99959231c7a0111258b5a1bbfdb8b24cf30f16a27/merged 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/8f6402e9b04e5603f4fbe4cedfa30f99648eefd26d5bdff3b175a6a855cca9e8/merged 2024-09-13T02:50:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/16890d920521748c0aa20b4d8afac7b415af67d9f8548c11cd06d0700f2cb195/merged 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/9c9caed9dc0ff3ae52343e07d6e50d189c9261c8f8f27f1d83504b6d25ec25a9/merged 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/e0daa8d9ab13b96f294bc1374daf8c9bad7f2857ab2472b0684f4a5a2ef32aeb/merged 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/e1e002321ad20b2043d2c5492cd91ff9d880ef55e444e9955a758bcc5e092570/merged 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/0ce9460398d3788ceb8466cbbcdd099946e474ed82e9333f4564cba3af9f569f/merged 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/8dbcf24f9823a9b1e62061a760fc2dbc2a4fff7b9156bc3bb5ffa5e5484babbe/merged 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/03dc0f9616d409b5c64117b2c18d036bc544182c2229d6ae08346998d9ec4e11/merged 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T02:50:30.723 INFO:teuthology.orchestra.run.smithi142.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:30.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:30.724 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-09-13T02:50:30.781 INFO:teuthology.orchestra.run.smithi142.stdout:129 2024-09-13T02:50:30.781 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-13T02:50:30.781 DEBUG:teuthology.orchestra.run.smithi142:> sudo stdin-killer -- python3 -c ' 2024-09-13T02:50:30.781 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2024-09-13T02:50:30.781 DEBUG:teuthology.orchestra.run.smithi142:> import re 2024-09-13T02:50:30.781 DEBUG:teuthology.orchestra.run.smithi142:> import os 2024-09-13T02:50:30.781 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2024-09-13T02:50:30.781 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T02:50:30.782 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2024-09-13T02:50:30.783 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2024-09-13T02:50:30.783 DEBUG:teuthology.orchestra.run.smithi142:> return f 2024-09-13T02:50:30.783 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T02:50:30.783 DEBUG:teuthology.orchestra.run.smithi142:> 2024-09-13T02:50:30.783 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.1")) 2024-09-13T02:50:30.783 DEBUG:teuthology.orchestra.run.smithi142:> ' 2024-09-13T02:50:30.902 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.1.52994.asok 2024-09-13T02:50:30.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-13T02:50:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:50:30.912 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.52994.asok 2024-09-13T02:50:30.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:30.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.52994.asok status 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "1", 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "52994", 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2024-09-13T02:50:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 24313, 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 24313 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3572139203 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T02:50:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3572139203 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.24313 192.168.0.1:0/3572139203", 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "192.168.0.1:0/3572139203", 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 14, 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 46, 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2024-09-13T02:50:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2024-09-13T02:50:31.049 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-09-13T02:50:31.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:31.054 DEBUG:teuthology.orchestra.run.smithi098:> stat --file-system '--printf=%T 2024-09-13T02:50:31.054 DEBUG:teuthology.orchestra.run.smithi098:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:31.075 INFO:teuthology.orchestra.run.smithi098.stdout:fuseblk 2024-09-13T02:50:31.075 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:31.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:31.075 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:31.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:31.150 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2024-09-13T02:50:31.150 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:31.166 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2024-09-13T02:50:31.166 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:31.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:50:31.166 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:31.234 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:50:31.245 INFO:teuthology.task.print:**** done client 2024-09-13T02:50:31.245 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T02:50:31.292 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T02:50:31.292 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T02:50:31.293 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:50:31.293 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:50:31.294 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T02:50:31.294 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T02:50:31.294 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T02:50:31.299 INFO:tasks.workunit:Pulling workunits from ref ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T02:50:31.300 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T02:50:31.300 INFO:tasks.workunit:timeout=3h 2024-09-13T02:50:31.300 INFO:tasks.workunit:cleanup=True 2024-09-13T02:50:31.300 DEBUG:teuthology.orchestra.run.smithi098:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T02:50:31.319 INFO:teuthology.orchestra.run.smithi098.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-13T02:50:31.319 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:50:31.319 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-13T02:50:31.319 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T02:50:31.319 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-13 02:49:54.279573710 +0000 2024-09-13T02:50:31.319 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-13 02:50:31.146433661 +0000 2024-09-13T02:50:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-13T02:50:31.320 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T02:50:31.320 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T02:50:31.389 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:31.405 INFO:teuthology.orchestra.run.smithi142.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:31.406 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T02:50:31.406 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-13T02:50:31.406 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:50:31.406 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-13T02:50:31.406 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T02:50:31.406 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-13 02:50:31.382937436 +0000 2024-09-13T02:50:31.406 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-13 02:50:31.382937436 +0000 2024-09-13T02:50:31.406 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-09-13T02:50:31.406 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T02:50:31.407 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T02:50:31.477 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T02:50:31.478 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T02:50:31.495 INFO:tasks.workunit.client.0.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T02:50:31.508 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:31.533 INFO:tasks.workunit.client.1.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T02:50:32.568 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:32 smithi098 ceph-mon[27886]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:50:32.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:32 smithi142 ceph-mon[33443]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:50:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.876+0000 7f2bdaf81700 1 -- 172.21.15.98:0/3082681255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40fe8c0 msgr2=0x7f2bd40fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.876+0000 7f2bdaf81700 1 --2- 172.21.15.98:0/3082681255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40fe8c0 0x7f2bd40fecd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009910 tx=0x7f2bc8009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.876+0000 7f2bdaf81700 1 -- 172.21.15.98:0/3082681255 shutdown_connections 2024-09-13T02:50:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.876+0000 7f2bdaf81700 1 --2- 172.21.15.98:0/3082681255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bd40ffb60 0x7f2bd40fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.876+0000 7f2bdaf81700 1 --2- 172.21.15.98:0/3082681255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40fe8c0 0x7f2bd40fecd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.876+0000 7f2bdaf81700 1 -- 172.21.15.98:0/3082681255 >> 172.21.15.98:0/3082681255 conn(0x7f2bd40f9f10 msgr2=0x7f2bd40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.876+0000 7f2bdaf81700 1 -- 172.21.15.98:0/3082681255 shutdown_connections 2024-09-13T02:50:32.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.876+0000 7f2bdaf81700 1 -- 172.21.15.98:0/3082681255 wait complete. 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bdaf81700 1 Processor -- start 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bdaf81700 1 -- start start 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bdaf81700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bd40fe8c0 0x7f2bd41018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bdaf81700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40ffb60 0x7f2bd419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bdaf81700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd419ae40 con 0x7f2bd40ffb60 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bdaf81700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd419af80 con 0x7f2bd40fe8c0 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bd3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40ffb60 0x7f2bd419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bd3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40ffb60 0x7f2bd419a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43350/0 (socket says 172.21.15.98:43350) 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bd3fff700 1 -- 172.21.15.98:0/404133144 learned_addr learned my addr 172.21.15.98:0/404133144 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bd8d1d700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bd40fe8c0 0x7f2bd41018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:32.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bd3fff700 1 -- 172.21.15.98:0/404133144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bd40fe8c0 msgr2=0x7f2bd41018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bd3fff700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bd40fe8c0 0x7f2bd41018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bd3fff700 1 -- 172.21.15.98:0/404133144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc80095f0 con 0x7f2bd40ffb60 2024-09-13T02:50:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.877+0000 7f2bd8d1d700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bd40fe8c0 0x7f2bd41018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:50:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.878+0000 7f2bd3fff700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40ffb60 0x7f2bd419a870 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000b4b0 tx=0x7f2bc000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.878+0000 7f2bd1ffb700 1 -- 172.21.15.98:0/404133144 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bc0011800 con 0x7f2bd40ffb60 2024-09-13T02:50:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.878+0000 7f2bd1ffb700 1 -- 172.21.15.98:0/404133144 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2bc0011e10 con 0x7f2bd40ffb60 2024-09-13T02:50:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.878+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd419b260 con 0x7f2bd40ffb60 2024-09-13T02:50:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.878+0000 7f2bd1ffb700 1 -- 172.21.15.98:0/404133144 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bc000f2e0 con 0x7f2bd40ffb60 2024-09-13T02:50:32.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.878+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd419b7b0 con 0x7f2bd40ffb60 2024-09-13T02:50:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.879+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd4107420 con 0x7f2bd40ffb60 2024-09-13T02:50:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.879+0000 7f2bd1ffb700 1 -- 172.21.15.98:0/404133144 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2bc0010380 con 0x7f2bd40ffb60 2024-09-13T02:50:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.880+0000 7f2bd1ffb700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2bc406c680 0x7f2bc406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.880+0000 7f2bd8d1d700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2bc406c680 0x7f2bc406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.880+0000 7f2bd1ffb700 1 -- 172.21.15.98:0/404133144 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2bc008b2e0 con 0x7f2bd40ffb60 2024-09-13T02:50:32.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.880+0000 7f2bd8d1d700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2bc406c680 0x7f2bc406eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8005b40 tx=0x7f2bc8005ab0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:32.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:32.885+0000 7f2bd1ffb700 1 -- 172.21.15.98:0/404133144 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2bc0059630 con 0x7f2bd40ffb60 2024-09-13T02:50:33.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.075+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f2bd4107640 con 0x7f2bd40ffb60 2024-09-13T02:50:33.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.075+0000 7f2bd1ffb700 1 -- 172.21.15.98:0/404133144 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f2bc00591c0 con 0x7f2bd40ffb60 2024-09-13T02:50:33.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2bc406c680 msgr2=0x7f2bc406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:33.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2bc406c680 0x7f2bc406eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8005b40 tx=0x7f2bc8005ab0 comp rx=0 tx=0).stop 2024-09-13T02:50:33.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40ffb60 msgr2=0x7f2bd419a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:33.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40ffb60 0x7f2bd419a870 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000b4b0 tx=0x7f2bc000b870 comp rx=0 tx=0).stop 2024-09-13T02:50:33.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 shutdown_connections 2024-09-13T02:50:33.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2bc406c680 0x7f2bc406eb30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:33.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bd40fe8c0 0x7f2bd41018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:33.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 --2- 172.21.15.98:0/404133144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bd40ffb60 0x7f2bd419a870 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:33.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 >> 172.21.15.98:0/404133144 conn(0x7f2bd40f9f10 msgr2=0x7f2bd40fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:33.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 shutdown_connections 2024-09-13T02:50:33.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:33.077+0000 7f2bdaf81700 1 -- 172.21.15.98:0/404133144 wait complete. 2024-09-13T02:50:33.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T02:50:34.164 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:34.587 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:34 smithi098 ceph-mon[27886]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T02:50:34.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:34 smithi142 ceph-mon[33443]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T02:50:35.455 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:35.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.676+0000 7f79290dd700 1 -- 172.21.15.98:0/664784847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 msgr2=0x7f7924101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:35.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.676+0000 7f79290dd700 1 --2- 172.21.15.98:0/664784847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 0x7f7924101580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f790c009910 tx=0x7f790c009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:35.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.676+0000 7f79290dd700 1 -- 172.21.15.98:0/664784847 shutdown_connections 2024-09-13T02:50:35.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.676+0000 7f79290dd700 1 --2- 172.21.15.98:0/664784847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 0x7f7924101580 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:35.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.676+0000 7f79290dd700 1 --2- 172.21.15.98:0/664784847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79240fe500 0x7f79240fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:35.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.676+0000 7f79290dd700 1 -- 172.21.15.98:0/664784847 >> 172.21.15.98:0/664784847 conn(0x7f79240f9f10 msgr2=0x7f79240fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.676+0000 7f79290dd700 1 -- 172.21.15.98:0/664784847 shutdown_connections 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.676+0000 7f79290dd700 1 -- 172.21.15.98:0/664784847 wait complete. 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.676+0000 7f79290dd700 1 Processor -- start 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f79290dd700 1 -- start start 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f79290dd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79240fe500 0x7f7924100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f79290dd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 0x7f79240ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f79290dd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240ffa70 con 0x7f79240fee50 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f79290dd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240ffbb0 con 0x7f79240fe500 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f792259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 0x7f79240ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f792259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 0x7f79240ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37282/0 (socket says 172.21.15.98:37282) 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f792259c700 1 -- 172.21.15.98:0/3714683420 learned_addr learned my addr 172.21.15.98:0/3714683420 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f7922d9d700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79240fe500 0x7f7924100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:35.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f792259c700 1 -- 172.21.15.98:0/3714683420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79240fe500 msgr2=0x7f7924100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f792259c700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79240fe500 0x7f7924100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f792259c700 1 -- 172.21.15.98:0/3714683420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0095f0 con 0x7f79240fee50 2024-09-13T02:50:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.677+0000 7f792259c700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 0x7f79240ff530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f790c00bd70 tx=0x7f790c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.678+0000 7f791bfff700 1 -- 172.21.15.98:0/3714683420 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790c01d070 con 0x7f79240fee50 2024-09-13T02:50:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.678+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79240ffe30 con 0x7f79240fee50 2024-09-13T02:50:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.678+0000 7f791bfff700 1 -- 172.21.15.98:0/3714683420 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f790c022470 con 0x7f79240fee50 2024-09-13T02:50:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.678+0000 7f791bfff700 1 -- 172.21.15.98:0/3714683420 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790c00f670 con 0x7f79240fee50 2024-09-13T02:50:35.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.678+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7924100320 con 0x7f79240fee50 2024-09-13T02:50:35.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.679+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7924108d90 con 0x7f79240fee50 2024-09-13T02:50:35.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.679+0000 7f791bfff700 1 -- 172.21.15.98:0/3714683420 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f790c004af0 con 0x7f79240fee50 2024-09-13T02:50:35.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.680+0000 7f791bfff700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f791006c680 0x7f791006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:35.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.680+0000 7f791bfff700 1 -- 172.21.15.98:0/3714683420 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f790c08ce00 con 0x7f79240fee50 2024-09-13T02:50:35.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.680+0000 7f7922d9d700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f791006c680 0x7f791006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:35.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.680+0000 7f7922d9d700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f791006c680 0x7f791006eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7914009f20 tx=0x7f79140094f0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:35.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.684+0000 7f791bfff700 1 -- 172.21.15.98:0/3714683420 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f790c05b0d0 con 0x7f79240fee50 2024-09-13T02:50:35.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:35.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.877+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f792419e010 con 0x7f79240fee50 2024-09-13T02:50:35.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.877+0000 7f791bfff700 1 -- 172.21.15.98:0/3714683420 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f790c05ac60 con 0x7f79240fee50 2024-09-13T02:50:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f791006c680 msgr2=0x7f791006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f791006c680 0x7f791006eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7914009f20 tx=0x7f79140094f0 comp rx=0 tx=0).stop 2024-09-13T02:50:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 msgr2=0x7f79240ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 0x7f79240ff530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f790c00bd70 tx=0x7f790c00be50 comp rx=0 tx=0).stop 2024-09-13T02:50:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 shutdown_connections 2024-09-13T02:50:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f791006c680 0x7f791006eb30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79240fe500 0x7f7924100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 --2- 172.21.15.98:0/3714683420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79240fee50 0x7f79240ff530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 >> 172.21.15.98:0/3714683420 conn(0x7f79240f9f10 msgr2=0x7f79241047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 shutdown_connections 2024-09-13T02:50:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:35.880+0000 7f79290dd700 1 -- 172.21.15.98:0/3714683420 wait complete. 2024-09-13T02:50:36.443 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:36 smithi098 ceph-mon[27886]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-13T02:50:36.463 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T02:50:36.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:36 smithi142 ceph-mon[33443]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-13T02:50:36.662 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:38.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.176+0000 7f2e6effb700 1 -- 172.21.15.98:0/1343336602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 msgr2=0x7f2e68101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.176+0000 7f2e6effb700 1 --2- 172.21.15.98:0/1343336602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 0x7f2e68101890 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009910 tx=0x7f2e54009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.176+0000 7f2e6effb700 1 -- 172.21.15.98:0/1343336602 shutdown_connections 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.176+0000 7f2e6effb700 1 --2- 172.21.15.98:0/1343336602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 0x7f2e68101890 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.176+0000 7f2e6effb700 1 --2- 172.21.15.98:0/1343336602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e68100240 0x7f2e68100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.176+0000 7f2e6effb700 1 -- 172.21.15.98:0/1343336602 >> 172.21.15.98:0/1343336602 conn(0x7f2e680fb7f0 msgr2=0x7f2e680fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.176+0000 7f2e6effb700 1 -- 172.21.15.98:0/1343336602 shutdown_connections 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.176+0000 7f2e6effb700 1 -- 172.21.15.98:0/1343336602 wait complete. 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e6effb700 1 Processor -- start 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e6effb700 1 -- start start 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e6effb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e68100240 0x7f2e68195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e6effb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 0x7f2e68196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:38.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e6effb700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68196640 con 0x7f2e68101440 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e6effb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68196780 con 0x7f2e68100240 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 0x7f2e68196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 0x7f2e68196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37306/0 (socket says 172.21.15.98:37306) 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e67fff700 1 -- 172.21.15.98:0/938362706 learned_addr learned my addr 172.21.15.98:0/938362706 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.177+0000 7f2e6cd97700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e68100240 0x7f2e68195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e67fff700 1 -- 172.21.15.98:0/938362706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e68100240 msgr2=0x7f2e68195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e67fff700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e68100240 0x7f2e68195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e67fff700 1 -- 172.21.15.98:0/938362706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540095f0 con 0x7f2e68101440 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e6cd97700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e68100240 0x7f2e68195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e67fff700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 0x7f2e68196020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2e54006010 tx=0x7f2e5400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:38.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e65ffb700 1 -- 172.21.15.98:0/938362706 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5401d070 con 0x7f2e68101440 2024-09-13T02:50:38.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e65ffb700 1 -- 172.21.15.98:0/938362706 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2e5400f460 con 0x7f2e68101440 2024-09-13T02:50:38.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e65ffb700 1 -- 172.21.15.98:0/938362706 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e54021640 con 0x7f2e68101440 2024-09-13T02:50:38.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6819b1d0 con 0x7f2e68101440 2024-09-13T02:50:38.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.178+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6819b670 con 0x7f2e68101440 2024-09-13T02:50:38.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.179+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e68108d90 con 0x7f2e68101440 2024-09-13T02:50:38.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.180+0000 7f2e65ffb700 1 -- 172.21.15.98:0/938362706 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2e5400fab0 con 0x7f2e68101440 2024-09-13T02:50:38.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.180+0000 7f2e65ffb700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2e5806c680 0x7f2e5806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:38.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.180+0000 7f2e65ffb700 1 -- 172.21.15.98:0/938362706 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2e5408cc50 con 0x7f2e68101440 2024-09-13T02:50:38.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.180+0000 7f2e6cd97700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2e5806c680 0x7f2e5806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:38.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.180+0000 7f2e6cd97700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2e5806c680 0x7f2e5806eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e681012a0 tx=0x7f2e5c005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:38.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.185+0000 7f2e65ffb700 1 -- 172.21.15.98:0/938362706 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2e5405ae30 con 0x7f2e68101440 2024-09-13T02:50:38.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.378+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f2e68108f50 con 0x7f2e68101440 2024-09-13T02:50:38.380 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:38 smithi098 ceph-mon[27886]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-13T02:50:38.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.378+0000 7f2e65ffb700 1 -- 172.21.15.98:0/938362706 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f2e540260c0 con 0x7f2e68101440 2024-09-13T02:50:38.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.380+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2e5806c680 msgr2=0x7f2e5806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:38.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.380+0000 7f2e6effb700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2e5806c680 0x7f2e5806eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e681012a0 tx=0x7f2e5c005f90 comp rx=0 tx=0).stop 2024-09-13T02:50:38.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.380+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 msgr2=0x7f2e68196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:38.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.380+0000 7f2e6effb700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 0x7f2e68196020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2e54006010 tx=0x7f2e5400be20 comp rx=0 tx=0).stop 2024-09-13T02:50:38.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.381+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 shutdown_connections 2024-09-13T02:50:38.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.381+0000 7f2e6effb700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f2e5806c680 0x7f2e5806eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:38.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.381+0000 7f2e6effb700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e68100240 0x7f2e68195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:38.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.381+0000 7f2e6effb700 1 --2- 172.21.15.98:0/938362706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e68101440 0x7f2e68196020 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:38.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.381+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 >> 172.21.15.98:0/938362706 conn(0x7f2e680fb7f0 msgr2=0x7f2e68104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:38.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.381+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 shutdown_connections 2024-09-13T02:50:38.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:38.381+0000 7f2e6effb700 1 -- 172.21.15.98:0/938362706 wait complete. 2024-09-13T02:50:38.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:38 smithi142 ceph-mon[33443]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-13T02:50:39.024 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-13T02:50:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:50:40.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:40 smithi142 ceph-mon[33443]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-13T02:50:40.591 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:40 smithi098 ceph-mon[27886]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-13T02:50:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.806+0000 7fd8d5a14700 1 -- 172.21.15.98:0/2778146927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0103680 msgr2=0x7fd8d0105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.806+0000 7fd8d5a14700 1 --2- 172.21.15.98:0/2778146927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0103680 0x7fd8d0105a60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009910 tx=0x7fd8c4009c20 comp rx=0 tx=0).stop 2024-09-13T02:50:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.806+0000 7fd8d5a14700 1 -- 172.21.15.98:0/2778146927 shutdown_connections 2024-09-13T02:50:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.806+0000 7fd8d5a14700 1 --2- 172.21.15.98:0/2778146927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0103680 0x7fd8d0105a60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.806+0000 7fd8d5a14700 1 --2- 172.21.15.98:0/2778146927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8d0100d60 0x7fd8d0103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.806+0000 7fd8d5a14700 1 -- 172.21.15.98:0/2778146927 >> 172.21.15.98:0/2778146927 conn(0x7fd8d00fa780 msgr2=0x7fd8d00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.806+0000 7fd8d5a14700 1 -- 172.21.15.98:0/2778146927 shutdown_connections 2024-09-13T02:50:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.806+0000 7fd8d5a14700 1 -- 172.21.15.98:0/2778146927 wait complete. 2024-09-13T02:50:40.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8d5a14700 1 Processor -- start 2024-09-13T02:50:40.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8d5a14700 1 -- start start 2024-09-13T02:50:40.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8d5a14700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0100d60 0x7fd8d01006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:40.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8d5a14700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8d0103680 0x7fd8d00fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:40.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8d5a14700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00ff250 con 0x7fd8d0100d60 2024-09-13T02:50:40.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8d5a14700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00ff390 con 0x7fd8d0103680 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8ceffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0100d60 0x7fd8d01006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8ceffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0100d60 0x7fd8d01006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37320/0 (socket says 172.21.15.98:37320) 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8ceffd700 1 -- 172.21.15.98:0/1795583834 learned_addr learned my addr 172.21.15.98:0/1795583834 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.807+0000 7fd8ce7fc700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8d0103680 0x7fd8d00fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.808+0000 7fd8ceffd700 1 -- 172.21.15.98:0/1795583834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8d0103680 msgr2=0x7fd8d00fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.808+0000 7fd8ceffd700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8d0103680 0x7fd8d00fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.808+0000 7fd8ceffd700 1 -- 172.21.15.98:0/1795583834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c40095f0 con 0x7fd8d0100d60 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.808+0000 7fd8ceffd700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0100d60 0x7fd8d01006c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000c8f0 tx=0x7fd8c000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.808+0000 7fd8d4a12700 1 -- 172.21.15.98:0/1795583834 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c00078a0 con 0x7fd8d0100d60 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.808+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d00ff670 con 0x7fd8d0100d60 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.808+0000 7fd8d4a12700 1 -- 172.21.15.98:0/1795583834 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd8c000f450 con 0x7fd8d0100d60 2024-09-13T02:50:40.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.808+0000 7fd8d4a12700 1 -- 172.21.15.98:0/1795583834 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c0018610 con 0x7fd8d0100d60 2024-09-13T02:50:40.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.808+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d019db40 con 0x7fd8d0100d60 2024-09-13T02:50:40.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.809+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d018fbe0 con 0x7fd8d0100d60 2024-09-13T02:50:40.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.810+0000 7fd8d4a12700 1 -- 172.21.15.98:0/1795583834 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd8c0007a00 con 0x7fd8d0100d60 2024-09-13T02:50:40.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.810+0000 7fd8d4a12700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd8b806c680 0x7fd8b806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:40.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.810+0000 7fd8d4a12700 1 -- 172.21.15.98:0/1795583834 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd8c008b730 con 0x7fd8d0100d60 2024-09-13T02:50:40.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.810+0000 7fd8ce7fc700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd8b806c680 0x7fd8b806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:40.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.810+0000 7fd8ce7fc700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd8b806c680 0x7fd8b806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4006010 tx=0x7fd8c400b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:40.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:40.814+0000 7fd8d4a12700 1 -- 172.21.15.98:0/1795583834 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd8c0059950 con 0x7fd8d0100d60 2024-09-13T02:50:41.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:50:41.025+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8d0061240 con 0x7fd8b806c680 2024-09-13T02:50:42.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:42 smithi142 ceph-mon[33443]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-13T02:50:42.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:42 smithi142 ceph-mon[33443]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:42.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:42 smithi098 ceph-mon[27886]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-13T02:50:42.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:42 smithi098 ceph-mon[27886]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:44.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:44 smithi098 ceph-mon[27886]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-13T02:50:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:44 smithi142 ceph-mon[33443]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-13T02:50:46.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:46 smithi142 ceph-mon[33443]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-13T02:50:46.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:46 smithi098 ceph-mon[27886]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-13T02:50:48.535 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:48 smithi098 ceph-mon[27886]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-13T02:50:48.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:48 smithi142 ceph-mon[33443]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-13T02:50:50.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:50 smithi098 ceph-mon[27886]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-13T02:50:50.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:50.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:50 smithi142 ceph-mon[33443]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-13T02:50:50.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:52.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:52 smithi098 ceph-mon[27886]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-13T02:50:52.817 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:52 smithi142 ceph-mon[33443]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-13T02:50:54.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:54 smithi098 ceph-mon[27886]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T02:50:54.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:54 smithi142 ceph-mon[33443]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-13T02:50:56.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:56 smithi098 ceph-mon[27886]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:50:56.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:56 smithi142 ceph-mon[33443]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:50:58.585 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:50:58 smithi098 ceph-mon[27886]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:50:58.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:50:58 smithi142 ceph-mon[33443]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:00.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:00 smithi098 ceph-mon[27886]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:00.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:00 smithi142 ceph-mon[33443]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:02.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:02 smithi098 ceph-mon[27886]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:02.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:02 smithi142 ceph-mon[33443]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:04.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:04 smithi098 ceph-mon[27886]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:04.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:04 smithi142 ceph-mon[33443]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:05.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:05.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:05 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:06.592 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:06 smithi098 ceph-mon[27886]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:06 smithi142 ceph-mon[33443]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:08.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:08 smithi098 ceph-mon[27886]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:08.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:08 smithi142 ceph-mon[33443]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:09.334 INFO:teuthology.orchestra.run.smithi098.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:51:09.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.332+0000 7fd8d4a12700 1 -- 172.21.15.98:0/1795583834 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fd8d0061240 con 0x7fd8b806c680 2024-09-13T02:51:09.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd8b806c680 msgr2=0x7fd8b806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:09.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd8b806c680 0x7fd8b806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4006010 tx=0x7fd8c400b540 comp rx=0 tx=0).stop 2024-09-13T02:51:09.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0100d60 msgr2=0x7fd8d01006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:09.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0100d60 0x7fd8d01006c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000c8f0 tx=0x7fd8c000cc00 comp rx=0 tx=0).stop 2024-09-13T02:51:09.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 shutdown_connections 2024-09-13T02:51:09.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fd8b806c680 0x7fd8b806eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8d0100d60 0x7fd8d01006c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 --2- 172.21.15.98:0/1795583834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8d0103680 0x7fd8d00fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 >> 172.21.15.98:0/1795583834 conn(0x7fd8d00fa780 msgr2=0x7fd8d00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:09.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 shutdown_connections 2024-09-13T02:51:09.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:09.335+0000 7fd8d5a14700 1 -- 172.21.15.98:0/1795583834 wait complete. 2024-09-13T02:51:09.927 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-13T02:51:10.215 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:51:10.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:10 smithi098 ceph-mon[27886]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:10.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:10.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:10.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:10.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:51:10.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:10 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:10.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:10 smithi142 ceph-mon[33443]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:51:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:10 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:11.592 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:11 smithi098 ceph-mon[27886]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:51:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:11 smithi142 ceph-mon[33443]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:51:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.204+0000 7ffad793c700 1 -- 172.21.15.98:0/192858313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 msgr2=0x7ffad00ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.204+0000 7ffad793c700 1 --2- 172.21.15.98:0/192858313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 0x7ffad00ff560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009910 tx=0x7ffacc009c20 comp rx=0 tx=0).stop 2024-09-13T02:51:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.205+0000 7ffad793c700 1 -- 172.21.15.98:0/192858313 shutdown_connections 2024-09-13T02:51:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.205+0000 7ffad793c700 1 --2- 172.21.15.98:0/192858313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffad0100350 0x7ffad01007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.205+0000 7ffad793c700 1 --2- 172.21.15.98:0/192858313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 0x7ffad00ff560 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.205+0000 7ffad793c700 1 -- 172.21.15.98:0/192858313 >> 172.21.15.98:0/192858313 conn(0x7ffad00fa700 msgr2=0x7ffad00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.205+0000 7ffad793c700 1 -- 172.21.15.98:0/192858313 shutdown_connections 2024-09-13T02:51:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.205+0000 7ffad793c700 1 -- 172.21.15.98:0/192858313 wait complete. 2024-09-13T02:51:12.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.206+0000 7ffad793c700 1 Processor -- start 2024-09-13T02:51:12.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.206+0000 7ffad793c700 1 -- start start 2024-09-13T02:51:12.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad793c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 0x7ffad0069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:12.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad56d8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 0x7ffad0069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:12.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad56d8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 0x7ffad0069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35038/0 (socket says 172.21.15.98:35038) 2024-09-13T02:51:12.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad56d8700 1 -- 172.21.15.98:0/4100590776 learned_addr learned my addr 172.21.15.98:0/4100590776 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:12.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad793c700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffad0100350 0x7ffad019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:12.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad01966b0 con 0x7ffad00ff150 2024-09-13T02:51:12.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad019d180 con 0x7ffad0100350 2024-09-13T02:51:12.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad4ed7700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffad0100350 0x7ffad019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:12.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad56d8700 1 -- 172.21.15.98:0/4100590776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffad0100350 msgr2=0x7ffad019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad56d8700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffad0100350 0x7ffad019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.207+0000 7ffad56d8700 1 -- 172.21.15.98:0/4100590776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0095f0 con 0x7ffad00ff150 2024-09-13T02:51:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.208+0000 7ffad56d8700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 0x7ffad0069930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00bdd0 tx=0x7ffacc00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.208+0000 7ffac67fc700 1 -- 172.21.15.98:0/4100590776 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffacc01d070 con 0x7ffad00ff150 2024-09-13T02:51:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.208+0000 7ffac67fc700 1 -- 172.21.15.98:0/4100590776 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffacc00f460 con 0x7ffad00ff150 2024-09-13T02:51:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.209+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad019d3d0 con 0x7ffad00ff150 2024-09-13T02:51:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.209+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad019d800 con 0x7ffad00ff150 2024-09-13T02:51:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.209+0000 7ffac67fc700 1 -- 172.21.15.98:0/4100590776 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffacc021620 con 0x7ffad00ff150 2024-09-13T02:51:12.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.210+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab4005320 con 0x7ffad00ff150 2024-09-13T02:51:12.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.211+0000 7ffac67fc700 1 -- 172.21.15.98:0/4100590776 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ffacc004af0 con 0x7ffad00ff150 2024-09-13T02:51:12.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.212+0000 7ffac67fc700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffabc06c6d0 0x7ffabc06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:12.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.212+0000 7ffad4ed7700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffabc06c6d0 0x7ffabc06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:12.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.213+0000 7ffac67fc700 1 -- 172.21.15.98:0/4100590776 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffacc08ca40 con 0x7ffad00ff150 2024-09-13T02:51:12.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.213+0000 7ffad4ed7700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffabc06c6d0 0x7ffabc06eb80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005950 tx=0x7ffac00058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:12.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.220+0000 7ffac67fc700 1 -- 172.21.15.98:0/4100590776 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffacc05ace0 con 0x7ffad00ff150 2024-09-13T02:51:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:12 smithi098 ceph-mon[27886]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:51:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:12 smithi098 ceph-mon[27886]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:12.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.637+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffab4000bf0 con 0x7ffabc06c6d0 2024-09-13T02:51:12.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.640+0000 7ffac67fc700 1 -- 172.21.15.98:0/4100590776 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7ffab4000bf0 con 0x7ffabc06c6d0 2024-09-13T02:51:12.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffabc06c6d0 msgr2=0x7ffabc06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:12.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffabc06c6d0 0x7ffabc06eb80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005950 tx=0x7ffac00058e0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 msgr2=0x7ffad0069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:12.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 0x7ffad0069930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00bdd0 tx=0x7ffacc00beb0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 shutdown_connections 2024-09-13T02:51:12.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7ffabc06c6d0 0x7ffabc06eb80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad00ff150 0x7ffad0069930 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 --2- 172.21.15.98:0/4100590776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffad0100350 0x7ffad019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 >> 172.21.15.98:0/4100590776 conn(0x7ffad00fa700 msgr2=0x7ffad0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:12.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 shutdown_connections 2024-09-13T02:51:12.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.643+0000 7ffad793c700 1 -- 172.21.15.98:0/4100590776 wait complete. 2024-09-13T02:51:12.653 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:12 smithi142 ceph-mon[33443]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:51:12.653 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:12 smithi142 ceph-mon[33443]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:12.660 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:51:12.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.818+0000 7f9b6c234700 1 -- 172.21.15.98:0/3869649018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b640ff150 msgr2=0x7f9b640ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:12.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.818+0000 7f9b6c234700 1 --2- 172.21.15.98:0/3869649018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b640ff150 0x7f9b640ff560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009910 tx=0x7f9b60009c20 comp rx=0 tx=0).stop 2024-09-13T02:51:12.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.818+0000 7f9b6c234700 1 -- 172.21.15.98:0/3869649018 shutdown_connections 2024-09-13T02:51:12.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.818+0000 7f9b6c234700 1 --2- 172.21.15.98:0/3869649018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b641003f0 0x7f9b64100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.818+0000 7f9b6c234700 1 --2- 172.21.15.98:0/3869649018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b640ff150 0x7f9b640ff560 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.818+0000 7f9b6c234700 1 -- 172.21.15.98:0/3869649018 >> 172.21.15.98:0/3869649018 conn(0x7f9b640fa7a0 msgr2=0x7f9b640fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:12.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.818+0000 7f9b6c234700 1 -- 172.21.15.98:0/3869649018 shutdown_connections 2024-09-13T02:51:12.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.818+0000 7f9b6c234700 1 -- 172.21.15.98:0/3869649018 wait complete. 2024-09-13T02:51:12.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.819+0000 7f9b6c234700 1 Processor -- start 2024-09-13T02:51:12.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.819+0000 7f9b6c234700 1 -- start start 2024-09-13T02:51:12.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b6c234700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b641003f0 0x7f9b64193dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:12.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b6c234700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64194310 0x7f9b64199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:12.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b6c234700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64194810 con 0x7f9b641003f0 2024-09-13T02:51:12.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b6c234700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64194980 con 0x7f9b64194310 2024-09-13T02:51:12.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b69fd0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b641003f0 0x7f9b64193dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:12.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b69fd0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b641003f0 0x7f9b64193dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35062/0 (socket says 172.21.15.98:35062) 2024-09-13T02:51:12.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b69fd0700 1 -- 172.21.15.98:0/3781220428 learned_addr learned my addr 172.21.15.98:0/3781220428 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:12.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b69fd0700 1 -- 172.21.15.98:0/3781220428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64194310 msgr2=0x7f9b64199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:12.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b69fd0700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64194310 0x7f9b64199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:12.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.820+0000 7f9b69fd0700 1 -- 172.21.15.98:0/3781220428 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600095f0 con 0x7f9b641003f0 2024-09-13T02:51:12.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.821+0000 7f9b69fd0700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b641003f0 0x7f9b64193dd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9b60005b40 tx=0x7f9b6000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:12.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.821+0000 7f9b5affd700 1 -- 172.21.15.98:0/3781220428 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b6001d070 con 0x7f9b641003f0 2024-09-13T02:51:12.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.821+0000 7f9b5affd700 1 -- 172.21.15.98:0/3781220428 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b60005dc0 con 0x7f9b641003f0 2024-09-13T02:51:12.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.821+0000 7f9b5affd700 1 -- 172.21.15.98:0/3781220428 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b60022470 con 0x7f9b641003f0 2024-09-13T02:51:12.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.821+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b641998c0 con 0x7f9b641003f0 2024-09-13T02:51:12.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.821+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b64199d80 con 0x7f9b641003f0 2024-09-13T02:51:12.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.822+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6418d9e0 con 0x7f9b641003f0 2024-09-13T02:51:12.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.824+0000 7f9b5affd700 1 -- 172.21.15.98:0/3781220428 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9b600051d0 con 0x7f9b641003f0 2024-09-13T02:51:12.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.824+0000 7f9b5affd700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9b5006e9b0 0x7f9b50070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:12.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.825+0000 7f9b697cf700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9b5006e9b0 0x7f9b50070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:12.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.825+0000 7f9b5affd700 1 -- 172.21.15.98:0/3781220428 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9b6008cc20 con 0x7f9b641003f0 2024-09-13T02:51:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.825+0000 7f9b697cf700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9b5006e9b0 0x7f9b50070e60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9b54005950 tx=0x7f9b540058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:12.829+0000 7f9b5affd700 1 -- 172.21.15.98:0/3781220428 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9b6005aec0 con 0x7f9b641003f0 2024-09-13T02:51:13.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.170+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b64061190 con 0x7f9b5006e9b0 2024-09-13T02:51:13.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.172+0000 7f9b5affd700 1 -- 172.21.15.98:0/3781220428 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f9b64061190 con 0x7f9b5006e9b0 2024-09-13T02:51:13.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9b5006e9b0 msgr2=0x7f9b50070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:13.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9b5006e9b0 0x7f9b50070e60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9b54005950 tx=0x7f9b540058e0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b641003f0 msgr2=0x7f9b64193dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:13.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b641003f0 0x7f9b64193dd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9b60005b40 tx=0x7f9b6000fab0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 shutdown_connections 2024-09-13T02:51:13.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9b5006e9b0 0x7f9b50070e60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b641003f0 0x7f9b64193dd0 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9b60005b40 tx=0x7f9b6000fab0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 --2- 172.21.15.98:0/3781220428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b64194310 0x7f9b64199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 >> 172.21.15.98:0/3781220428 conn(0x7f9b640fa7a0 msgr2=0x7f9b64103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:13.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 shutdown_connections 2024-09-13T02:51:13.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.176+0000 7f9b6c234700 1 -- 172.21.15.98:0/3781220428 wait complete. 2024-09-13T02:51:13.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.330+0000 7f626a464700 1 -- 172.21.15.98:0/1903881515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264100350 msgr2=0x7f62641007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:13.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.330+0000 7f626a464700 1 --2- 172.21.15.98:0/1903881515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264100350 0x7f62641007a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6258009910 tx=0x7f6258009c20 comp rx=0 tx=0).stop 2024-09-13T02:51:13.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.330+0000 7f626a464700 1 -- 172.21.15.98:0/1903881515 shutdown_connections 2024-09-13T02:51:13.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.330+0000 7f626a464700 1 --2- 172.21.15.98:0/1903881515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264100350 0x7f62641007a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.330+0000 7f626a464700 1 --2- 172.21.15.98:0/1903881515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62640ff150 0x7f62640ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.330+0000 7f626a464700 1 -- 172.21.15.98:0/1903881515 >> 172.21.15.98:0/1903881515 conn(0x7f62640fa700 msgr2=0x7f62640fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:13.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.330+0000 7f626a464700 1 -- 172.21.15.98:0/1903881515 shutdown_connections 2024-09-13T02:51:13.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.331+0000 7f626a464700 1 -- 172.21.15.98:0/1903881515 wait complete. 2024-09-13T02:51:13.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.332+0000 7f626a464700 1 Processor -- start 2024-09-13T02:51:13.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.332+0000 7f626a464700 1 -- start start 2024-09-13T02:51:13.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.332+0000 7f626a464700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62640ff150 0x7f6264197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:13.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.332+0000 7f626a464700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264198440 0x7f626419d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:13.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.333+0000 7f626a464700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264198940 con 0x7f6264198440 2024-09-13T02:51:13.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.333+0000 7f626a464700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264198ab0 con 0x7f62640ff150 2024-09-13T02:51:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.333+0000 7f6263fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62640ff150 0x7f6264197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.333+0000 7f6263fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62640ff150 0x7f6264197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.98:35638/0 (socket says 172.21.15.98:35638) 2024-09-13T02:51:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.333+0000 7f6263fff700 1 -- 172.21.15.98:0/2113700466 learned_addr learned my addr 172.21.15.98:0/2113700466 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.333+0000 7f62637fe700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264198440 0x7f626419d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:13.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.333+0000 7f62637fe700 1 -- 172.21.15.98:0/2113700466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62640ff150 msgr2=0x7f6264197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:13.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.333+0000 7f62637fe700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62640ff150 0x7f6264197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.333+0000 7f62637fe700 1 -- 172.21.15.98:0/2113700466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62580095f0 con 0x7f6264198440 2024-09-13T02:51:13.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.334+0000 7f62637fe700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264198440 0x7f626419d4b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6258008000 tx=0x7f625800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:13.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.334+0000 7f62617fa700 1 -- 172.21.15.98:0/2113700466 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625801d070 con 0x7f6264198440 2024-09-13T02:51:13.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.334+0000 7f62617fa700 1 -- 172.21.15.98:0/2113700466 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6258005dc0 con 0x7f6264198440 2024-09-13T02:51:13.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.334+0000 7f62617fa700 1 -- 172.21.15.98:0/2113700466 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6258021410 con 0x7f6264198440 2024-09-13T02:51:13.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.334+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626419d9f0 con 0x7f6264198440 2024-09-13T02:51:13.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.334+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626419ddf0 con 0x7f6264198440 2024-09-13T02:51:13.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.335+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626410afa0 con 0x7f6264198440 2024-09-13T02:51:13.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.336+0000 7f62617fa700 1 -- 172.21.15.98:0/2113700466 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f625800f6f0 con 0x7f6264198440 2024-09-13T02:51:13.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.337+0000 7f62617fa700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f624c06c6d0 0x7f624c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:13.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.337+0000 7f62617fa700 1 -- 172.21.15.98:0/2113700466 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f625808c860 con 0x7f6264198440 2024-09-13T02:51:13.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.337+0000 7f6263fff700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f624c06c6d0 0x7f624c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:13.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.338+0000 7f6263fff700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f624c06c6d0 0x7f624c06eb80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f625400bd70 tx=0x7f625400b4a0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:13.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.341+0000 7f62617fa700 1 -- 172.21.15.98:0/2113700466 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f625805aa80 con 0x7f6264198440 2024-09-13T02:51:13.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.574+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6264104ca0 con 0x7f624c06c6d0 2024-09-13T02:51:13.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.592+0000 7f62617fa700 1 -- 172.21.15.98:0/2113700466 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f6264104ca0 con 0x7f624c06c6d0 2024-09-13T02:51:13.595 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:51:13.595 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (5m) 55s ago 6m 24.6M - 0.25.0 c8568f914cd2 babcc5d689b7 2024-09-13T02:51:13.595 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (6m) 55s ago 6m 7448k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:51:13.595 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (5m) 61s ago 5m 7142k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:51:13.595 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (6m) 55s ago 6m 6660k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:51:13.595 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (5m) 61s ago 5m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:51:13.595 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (5m) 55s ago 6m 84.7M - 9.4.7 954c08fa6188 6b3b619a7e20 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (74s) 55s ago 74s 18.7M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (80s) 55s ago 79s 18.5M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (71s) 61s ago 71s 11.3M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (77s) 61s ago 77s 14.6M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:9283,8765,8443 running (8m) 55s ago 8m 487M - 18.2.0 dc2bc1663786 230c0046ad07 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (5m) 61s ago 5m 439M - 18.2.0 dc2bc1663786 980f7ae983de 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (8m) 55s ago 8m 47.6M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (5m) 61s ago 5m 35.3M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (6m) 55s ago 6m 15.8M - 1.5.0 0da6a335fe13 5c48ece10527 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (5m) 61s ago 5m 15.3M - 1.5.0 0da6a335fe13 b2fc832c8f17 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (4m) 55s ago 4m 48.2M 3946M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:51:13.596 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (4m) 55s ago 4m 47.1M 3946M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:51:13.597 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (4m) 55s ago 4m 44.8M 3946M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:51:13.597 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (3m) 61s ago 3m 45.4M 4970M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:51:13.597 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (3m) 61s ago 3m 42.7M 4970M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:51:13.597 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (2m) 61s ago 2m 43.3M 4970M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:51:13.597 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (5m) 55s ago 6m 60.9M - 2.43.0 a07b618ecd1d fc785e775830 2024-09-13T02:51:13.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.595+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f624c06c6d0 msgr2=0x7f624c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.595+0000 7f626a464700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f624c06c6d0 0x7f624c06eb80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f625400bd70 tx=0x7f625400b4a0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.595+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264198440 msgr2=0x7f626419d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.595+0000 7f626a464700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264198440 0x7f626419d4b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6258008000 tx=0x7f625800bd70 comp rx=0 tx=0).stop 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.596+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 shutdown_connections 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.596+0000 7f626a464700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f624c06c6d0 0x7f624c06eb80 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f625400bd70 tx=0x7f625400b4a0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.596+0000 7f626a464700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62640ff150 0x7f6264197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.596+0000 7f626a464700 1 --2- 172.21.15.98:0/2113700466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6264198440 0x7f626419d4b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.596+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 >> 172.21.15.98:0/2113700466 conn(0x7f62640fa700 msgr2=0x7f6264103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.596+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 shutdown_connections 2024-09-13T02:51:13.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.596+0000 7f626a464700 1 -- 172.21.15.98:0/2113700466 wait complete. 2024-09-13T02:51:13.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.706+0000 7f028a120700 1 -- 172.21.15.98:0/1418664356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02841003d0 msgr2=0x7f0284100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:13.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.706+0000 7f028a120700 1 --2- 172.21.15.98:0/1418664356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02841003d0 0x7f0284100840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0278009870 tx=0x7f0278009b80 comp rx=0 tx=0).stop 2024-09-13T02:51:13.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.707+0000 7f028a120700 1 -- 172.21.15.98:0/1418664356 shutdown_connections 2024-09-13T02:51:13.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.707+0000 7f028a120700 1 --2- 172.21.15.98:0/1418664356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02841003d0 0x7f0284100840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.707+0000 7f028a120700 1 --2- 172.21.15.98:0/1418664356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02840ff130 0x7f02840ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.707+0000 7f028a120700 1 -- 172.21.15.98:0/1418664356 >> 172.21.15.98:0/1418664356 conn(0x7f02840fa780 msgr2=0x7f02840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:13.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.707+0000 7f028a120700 1 -- 172.21.15.98:0/1418664356 shutdown_connections 2024-09-13T02:51:13.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.707+0000 7f028a120700 1 -- 172.21.15.98:0/1418664356 wait complete. 2024-09-13T02:51:13.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f028a120700 1 Processor -- start 2024-09-13T02:51:13.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f028a120700 1 -- start start 2024-09-13T02:51:13.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f028a120700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02840ff130 0x7f0284071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:13.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f028a120700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02841003d0 0x7f02840722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:13.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f028a120700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02840728e0 con 0x7f02840ff130 2024-09-13T02:51:13.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f028a120700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02841a15b0 con 0x7f02841003d0 2024-09-13T02:51:13.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f02837fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02840ff130 0x7f0284071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:13.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f02837fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02840ff130 0x7f0284071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35110/0 (socket says 172.21.15.98:35110) 2024-09-13T02:51:13.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f02837fe700 1 -- 172.21.15.98:0/1052977323 learned_addr learned my addr 172.21.15.98:0/1052977323 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:13.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.708+0000 7f0282ffd700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02841003d0 0x7f02840722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:13.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.709+0000 7f0282ffd700 1 -- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02840ff130 msgr2=0x7f0284071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:13.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.709+0000 7f0282ffd700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02840ff130 0x7f0284071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.709+0000 7f0282ffd700 1 -- 172.21.15.98:0/1052977323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740095f0 con 0x7f02841003d0 2024-09-13T02:51:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.709+0000 7f02837fe700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02840ff130 0x7f0284071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:51:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.709+0000 7f0282ffd700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02841003d0 0x7f02840722c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0278000c00 tx=0x7f027800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.709+0000 7f0280ff9700 1 -- 172.21.15.98:0/1052977323 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027801c070 con 0x7f02841003d0 2024-09-13T02:51:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.709+0000 7f0280ff9700 1 -- 172.21.15.98:0/1052977323 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f027800fd60 con 0x7f02841003d0 2024-09-13T02:51:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.709+0000 7f0280ff9700 1 -- 172.21.15.98:0/1052977323 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0278022da0 con 0x7f02841003d0 2024-09-13T02:51:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.710+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0278009520 con 0x7f02841003d0 2024-09-13T02:51:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.710+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02841a1a60 con 0x7f02841003d0 2024-09-13T02:51:13.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.711+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0284106ae0 con 0x7f02841003d0 2024-09-13T02:51:13.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.712+0000 7f0280ff9700 1 -- 172.21.15.98:0/1052977323 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0278020070 con 0x7f02841003d0 2024-09-13T02:51:13.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.713+0000 7f0280ff9700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f026c06c680 0x7f026c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:13.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.713+0000 7f0280ff9700 1 -- 172.21.15.98:0/1052977323 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f027808c670 con 0x7f02841003d0 2024-09-13T02:51:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.713+0000 7f02837fe700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f026c06c680 0x7f026c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.714+0000 7f02837fe700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f026c06c680 0x7f026c06eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0274005d10 tx=0x7f0274014040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:13.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:13.721+0000 7f0280ff9700 1 -- 172.21.15.98:0/1052977323 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f027805a940 con 0x7f02841003d0 2024-09-13T02:51:14.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.139+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0284106cd0 con 0x7f02841003d0 2024-09-13T02:51:14.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.140+0000 7f0280ff9700 1 -- 172.21.15.98:0/1052977323 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f027805a4d0 con 0x7f02841003d0 2024-09-13T02:51:14.142 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:51:14.142 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:51:14.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:51:14.144 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:51:14.144 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-13T02:51:14.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:51:14.144 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:51:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f026c06c680 msgr2=0x7f026c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f026c06c680 0x7f026c06eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0274005d10 tx=0x7f0274014040 comp rx=0 tx=0).stop 2024-09-13T02:51:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02841003d0 msgr2=0x7f02840722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02841003d0 0x7f02840722c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0278000c00 tx=0x7f027800f690 comp rx=0 tx=0).stop 2024-09-13T02:51:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 shutdown_connections 2024-09-13T02:51:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f026c06c680 0x7f026c06eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02840ff130 0x7f0284071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 --2- 172.21.15.98:0/1052977323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02841003d0 0x7f02840722c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 >> 172.21.15.98:0/1052977323 conn(0x7f02840fa780 msgr2=0x7f0284103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 shutdown_connections 2024-09-13T02:51:14.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.143+0000 7f028a120700 1 -- 172.21.15.98:0/1052977323 wait complete. 2024-09-13T02:51:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:14 smithi098 ceph-mon[27886]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:14 smithi098 ceph-mon[27886]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:14 smithi098 ceph-mon[27886]: Upgrade: Target is version 19.1.1-322-g7741f7f9 (unknown) 2024-09-13T02:51:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:14 smithi098 ceph-mon[27886]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d'] 2024-09-13T02:51:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:14 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:14 smithi098 ceph-mon[27886]: Upgrade: Need to upgrade myself (mgr.smithi098.ukgenf) 2024-09-13T02:51:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:14 smithi098 ceph-mon[27886]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:14.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.266+0000 7fdb09691700 1 -- 172.21.15.98:0/2118265785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb040ff130 msgr2=0x7fdb040ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.266+0000 7fdb09691700 1 --2- 172.21.15.98:0/2118265785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb040ff130 0x7fdb040ff540 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009910 tx=0x7fdaf4009c20 comp rx=0 tx=0).stop 2024-09-13T02:51:14.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.266+0000 7fdb09691700 1 -- 172.21.15.98:0/2118265785 shutdown_connections 2024-09-13T02:51:14.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.266+0000 7fdb09691700 1 --2- 172.21.15.98:0/2118265785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb041003d0 0x7fdb04100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.266+0000 7fdb09691700 1 --2- 172.21.15.98:0/2118265785 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb040ff130 0x7fdb040ff540 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.266+0000 7fdb09691700 1 -- 172.21.15.98:0/2118265785 >> 172.21.15.98:0/2118265785 conn(0x7fdb040fa780 msgr2=0x7fdb040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.266+0000 7fdb09691700 1 -- 172.21.15.98:0/2118265785 shutdown_connections 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.266+0000 7fdb09691700 1 -- 172.21.15.98:0/2118265785 wait complete. 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb09691700 1 Processor -- start 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb09691700 1 -- start start 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb09691700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb040ff130 0x7fdb04195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb09691700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb041003d0 0x7fdb04195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb09691700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04196600 con 0x7fdb041003d0 2024-09-13T02:51:14.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb09691700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04196740 con 0x7fdb040ff130 2024-09-13T02:51:14.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb027fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb041003d0 0x7fdb04195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:14.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb027fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb041003d0 0x7fdb04195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35126/0 (socket says 172.21.15.98:35126) 2024-09-13T02:51:14.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb027fc700 1 -- 172.21.15.98:0/3656786742 learned_addr learned my addr 172.21.15.98:0/3656786742 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:14.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.267+0000 7fdb02ffd700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb040ff130 0x7fdb04195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:14.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.268+0000 7fdb027fc700 1 -- 172.21.15.98:0/3656786742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb040ff130 msgr2=0x7fdb04195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.268+0000 7fdb027fc700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb040ff130 0x7fdb04195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.268+0000 7fdb027fc700 1 -- 172.21.15.98:0/3656786742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40095f0 con 0x7fdb041003d0 2024-09-13T02:51:14.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.268+0000 7fdb027fc700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb041003d0 0x7fdb04195fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800e920 tx=0x7fdaf800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:14.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.268+0000 7fdaebfff700 1 -- 172.21.15.98:0/3656786742 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaf8009790 con 0x7fdb041003d0 2024-09-13T02:51:14.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.268+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0419b1f0 con 0x7fdb041003d0 2024-09-13T02:51:14.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.268+0000 7fdaebfff700 1 -- 172.21.15.98:0/3656786742 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdaf800cba0 con 0x7fdb041003d0 2024-09-13T02:51:14.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.268+0000 7fdaebfff700 1 -- 172.21.15.98:0/3656786742 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaf8018630 con 0x7fdb041003d0 2024-09-13T02:51:14.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.268+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0419b740 con 0x7fdb041003d0 2024-09-13T02:51:14.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.270+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb04107c10 con 0x7fdb041003d0 2024-09-13T02:51:14.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.270+0000 7fdaebfff700 1 -- 172.21.15.98:0/3656786742 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdaf800cd10 con 0x7fdb041003d0 2024-09-13T02:51:14.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.271+0000 7fdaebfff700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdaec06c680 0x7fdaec06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:14.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.271+0000 7fdaebfff700 1 -- 172.21.15.98:0/3656786742 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdaf8014070 con 0x7fdb041003d0 2024-09-13T02:51:14.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.271+0000 7fdb02ffd700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdaec06c680 0x7fdaec06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:14.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.272+0000 7fdb02ffd700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdaec06c680 0x7fdaec06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400b6f0 tx=0x7fdaf4009f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:14.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.275+0000 7fdaebfff700 1 -- 172.21.15.98:0/3656786742 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdaf8051720 con 0x7fdb041003d0 2024-09-13T02:51:14.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.492+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb04068c50 con 0x7fdaec06c680 2024-09-13T02:51:14.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.494+0000 7fdaebfff700 1 -- 172.21.15.98:0/3656786742 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fdb04068c50 con 0x7fdaec06c680 2024-09-13T02:51:14.495 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:51:14.495 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:51:14.495 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:51:14.495 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T02:51:14.495 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [], 2024-09-13T02:51:14.495 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "0/2 daemons upgraded", 2024-09-13T02:51:14.496 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d image on host smithi142", 2024-09-13T02:51:14.496 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:51:14.496 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:51:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.496+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdaec06c680 msgr2=0x7fdaec06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.496+0000 7fdb09691700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdaec06c680 0x7fdaec06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400b6f0 tx=0x7fdaf4009f90 comp rx=0 tx=0).stop 2024-09-13T02:51:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.496+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb041003d0 msgr2=0x7fdb04195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.496+0000 7fdb09691700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb041003d0 0x7fdb04195fe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800e920 tx=0x7fdaf800ece0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.497+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 shutdown_connections 2024-09-13T02:51:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.497+0000 7fdb09691700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fdaec06c680 0x7fdaec06eb30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.497+0000 7fdb09691700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb040ff130 0x7fdb04195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.497+0000 7fdb09691700 1 --2- 172.21.15.98:0/3656786742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb041003d0 0x7fdb04195fe0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.497+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 >> 172.21.15.98:0/3656786742 conn(0x7fdb040fa780 msgr2=0x7fdb04068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:14.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.497+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 shutdown_connections 2024-09-13T02:51:14.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:14.497+0000 7fdb09691700 1 -- 172.21.15.98:0/3656786742 wait complete. 2024-09-13T02:51:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:14 smithi142 ceph-mon[33443]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:14 smithi142 ceph-mon[33443]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:14 smithi142 ceph-mon[33443]: Upgrade: Target is version 19.1.1-322-g7741f7f9 (unknown) 2024-09-13T02:51:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:14 smithi142 ceph-mon[33443]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d'] 2024-09-13T02:51:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:14 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:14 smithi142 ceph-mon[33443]: Upgrade: Need to upgrade myself (mgr.smithi098.ukgenf) 2024-09-13T02:51:14.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:14 smithi142 ceph-mon[33443]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:15.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:15 smithi098 ceph-mon[27886]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d on smithi142 2024-09-13T02:51:15.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:15 smithi098 ceph-mon[27886]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:15.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:15 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1052977323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:51:15.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:15 smithi142 ceph-mon[33443]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d on smithi142 2024-09-13T02:51:15.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:15 smithi142 ceph-mon[33443]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:15.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:15 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1052977323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:51:16.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:16 smithi098 ceph-mon[27886]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:16.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:16 smithi098 ceph-mon[27886]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:16.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:16 smithi142 ceph-mon[33443]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:16.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:16 smithi142 ceph-mon[33443]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:18.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:18 smithi098 ceph-mon[27886]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:18.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:18 smithi142 ceph-mon[33443]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:20.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:20 smithi098 ceph-mon[27886]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:20.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:20 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:20.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:20 smithi142 ceph-mon[33443]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:20.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:20 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:22.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:22 smithi098 ceph-mon[27886]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:22.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:22 smithi142 ceph-mon[33443]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:24.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:24 smithi098 ceph-mon[27886]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:24.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:24 smithi142 ceph-mon[33443]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:26.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:26 smithi142 ceph-mon[33443]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:26.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:26 smithi098 ceph-mon[27886]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:28.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:28 smithi098 ceph-mon[27886]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:28.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:28 smithi142 ceph-mon[33443]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:30.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:30 smithi098 ceph-mon[27886]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:30.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:30 smithi142 ceph-mon[33443]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:31.992 INFO:tasks.workunit.client.0.smithi098.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr: git switch -c 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-13T02:51:31.993 INFO:tasks.workunit.client.0.smithi098.stderr:Or undo this operation with: 2024-09-13T02:51:31.994 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-13T02:51:31.994 INFO:tasks.workunit.client.0.smithi098.stderr: git switch - 2024-09-13T02:51:31.994 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-13T02:51:31.994 INFO:tasks.workunit.client.0.smithi098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T02:51:31.994 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-13T02:51:31.994 INFO:tasks.workunit.client.0.smithi098.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T02:51:31.999 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T02:51:32.134 INFO:tasks.workunit.client.0.smithi098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T02:51:32.136 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T02:51:32.136 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T02:51:32.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:32 smithi098 ceph-mon[27886]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:32.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:32 smithi142 ceph-mon[33443]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:33.449 INFO:tasks.workunit.client.1.smithi142.stderr:Updating files: 90% (11657/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-13T02:51:34.209 INFO:tasks.workunit.client.1.smithi142.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T02:51:34.209 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-09-13T02:51:34.209 INFO:tasks.workunit.client.1.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T02:51:34.209 INFO:tasks.workunit.client.1.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T02:51:34.209 INFO:tasks.workunit.client.1.smithi142.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T02:51:34.209 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-09-13T02:51:34.209 INFO:tasks.workunit.client.1.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr: git switch -c 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr:Or undo this operation with: 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr: git switch - 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-09-13T02:51:34.210 INFO:tasks.workunit.client.1.smithi142.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T02:51:34.214 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T02:51:34.277 INFO:tasks.workunit.client.1.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T02:51:34.279 INFO:tasks.workunit.client.1.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T02:51:34.279 INFO:tasks.workunit.client.1.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T02:51:34.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:34 smithi098 ceph-mon[27886]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:34.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:34 smithi142 ceph-mon[33443]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:51:35.063 INFO:tasks.workunit.client.1.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T02:51:35.134 INFO:tasks.workunit.client.1.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T02:51:35.173 INFO:tasks.workunit.client.1.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T02:51:35.175 INFO:tasks.workunit.client.1.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T02:51:35.175 INFO:tasks.workunit.client.1.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T02:51:35.214 INFO:tasks.workunit.client.1.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T02:51:35.217 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-13T02:51:35.217 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T02:51:35.273 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T02:51:35.275 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T02:51:35.275 DEBUG:teuthology.orchestra.run.smithi142:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T02:51:35.339 INFO:tasks.workunit.client.1.smithi142.stderr:+ mkdir -p fsstress 2024-09-13T02:51:35.341 INFO:tasks.workunit.client.1.smithi142.stderr:+ pushd fsstress 2024-09-13T02:51:35.342 INFO:tasks.workunit.client.1.smithi142.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:51:35.343 INFO:tasks.workunit.client.1.smithi142.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T02:51:35.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:35 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:35.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:35 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:35.905 INFO:tasks.workunit.client.1.smithi142.stderr:+ tar xzf ltp-full.tgz 2024-09-13T02:51:36.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:36 smithi098 ceph-mon[27886]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:36.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:36 smithi142 ceph-mon[33443]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:51:38.012 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T02:51:38.487 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T02:51:38.558 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T02:51:38.560 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T02:51:38.560 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T02:51:38.665 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T02:51:38.669 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T02:51:38.669 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T02:51:38.685 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T02:51:38.687 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T02:51:38.687 DEBUG:teuthology.orchestra.run.smithi098:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T02:51:38.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:38 smithi098 ceph-mon[27886]: pgmap v230: 65 pgs: 65 active+clean; 6.9 MiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 537 KiB/s wr, 2 op/s 2024-09-13T02:51:38.750 INFO:tasks.workunit.client.0.smithi098.stderr:+ mkdir -p fsstress 2024-09-13T02:51:38.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:38 smithi142 ceph-mon[33443]: pgmap v230: 65 pgs: 65 active+clean; 6.9 MiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 537 KiB/s wr, 2 op/s 2024-09-13T02:51:38.752 INFO:tasks.workunit.client.0.smithi098.stderr:+ pushd fsstress 2024-09-13T02:51:38.754 INFO:tasks.workunit.client.0.smithi098.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:51:38.754 INFO:tasks.workunit.client.0.smithi098.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T02:51:39.340 INFO:tasks.workunit.client.0.smithi098.stderr:+ tar xzf ltp-full.tgz 2024-09-13T02:51:40.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:40 smithi098 ceph-mon[27886]: pgmap v231: 65 pgs: 65 active+clean; 12 MiB data, 175 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 951 KiB/s wr, 15 op/s 2024-09-13T02:51:40.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:40 smithi142 ceph-mon[33443]: pgmap v231: 65 pgs: 65 active+clean; 12 MiB data, 175 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 951 KiB/s wr, 15 op/s 2024-09-13T02:51:42.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:42 smithi098 ceph-mon[27886]: pgmap v232: 65 pgs: 65 active+clean; 18 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 237 KiB/s rd, 1.5 MiB/s wr, 38 op/s 2024-09-13T02:51:42.644 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:42 smithi142 ceph-mon[33443]: pgmap v232: 65 pgs: 65 active+clean; 18 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 237 KiB/s rd, 1.5 MiB/s wr, 38 op/s 2024-09-13T02:51:44.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.653+0000 7fe4aa273700 1 -- 172.21.15.98:0/197440686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4a41021f0 msgr2=0x7fe4a40fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:44.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.653+0000 7fe4aa273700 1 --2- 172.21.15.98:0/197440686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4a41021f0 0x7fe4a40fe320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe498009910 tx=0x7fe498009c20 comp rx=0 tx=0).stop 2024-09-13T02:51:44.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.653+0000 7fe4aa273700 1 -- 172.21.15.98:0/197440686 shutdown_connections 2024-09-13T02:51:44.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.653+0000 7fe4aa273700 1 --2- 172.21.15.98:0/197440686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4a41021f0 0x7fe4a40fe320 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:44.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.653+0000 7fe4aa273700 1 --2- 172.21.15.98:0/197440686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a41018a0 0x7fe4a4101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:44.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.653+0000 7fe4aa273700 1 -- 172.21.15.98:0/197440686 >> 172.21.15.98:0/197440686 conn(0x7fe4a40f9f10 msgr2=0x7fe4a40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:44.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.653+0000 7fe4aa273700 1 -- 172.21.15.98:0/197440686 shutdown_connections 2024-09-13T02:51:44.656 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:44 smithi098 ceph-mon[27886]: pgmap v233: 65 pgs: 65 active+clean; 24 MiB data, 241 MiB used, 536 GiB / 536 GiB avail; 236 KiB/s rd, 2.0 MiB/s wr, 66 op/s 2024-09-13T02:51:44.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.653+0000 7fe4aa273700 1 -- 172.21.15.98:0/197440686 wait complete. 2024-09-13T02:51:44.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.654+0000 7fe4aa273700 1 Processor -- start 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.654+0000 7fe4aa273700 1 -- start start 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4aa273700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a41018a0 0x7fe4a41938d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4aa273700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4a41021f0 0x7fe4a4193e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4aa273700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4194430 con 0x7fe4a41021f0 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4aa273700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4194570 con 0x7fe4a41018a0 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4a3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a41018a0 0x7fe4a41938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4a3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a41018a0 0x7fe4a41938d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.98:47862/0 (socket says 172.21.15.98:47862) 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4a3fff700 1 -- 172.21.15.98:0/803679075 learned_addr learned my addr 172.21.15.98:0/803679075 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4a37fe700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4a41021f0 0x7fe4a4193e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4a3fff700 1 -- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4a41021f0 msgr2=0x7fe4a4193e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:44.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4a3fff700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4a41021f0 0x7fe4a4193e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:44.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4a3fff700 1 -- 172.21.15.98:0/803679075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4980095f0 con 0x7fe4a41018a0 2024-09-13T02:51:44.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4a3fff700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a41018a0 0x7fe4a41938d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe49400e920 tx=0x7fe49400ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:44.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.655+0000 7fe4a17fa700 1 -- 172.21.15.98:0/803679075 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe49400c9d0 con 0x7fe4a41018a0 2024-09-13T02:51:44.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.656+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a4199020 con 0x7fe4a41018a0 2024-09-13T02:51:44.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.656+0000 7fe4a17fa700 1 -- 172.21.15.98:0/803679075 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe494010430 con 0x7fe4a41018a0 2024-09-13T02:51:44.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.656+0000 7fe4a17fa700 1 -- 172.21.15.98:0/803679075 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe494018650 con 0x7fe4a41018a0 2024-09-13T02:51:44.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.656+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a4199570 con 0x7fe4a41018a0 2024-09-13T02:51:44.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.657+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a4108d10 con 0x7fe4a41018a0 2024-09-13T02:51:44.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.657+0000 7fe4a17fa700 1 -- 172.21.15.98:0/803679075 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe49400cb30 con 0x7fe4a41018a0 2024-09-13T02:51:44.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.658+0000 7fe4a17fa700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe48c06c680 0x7fe48c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:44.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.658+0000 7fe4a37fe700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe48c06c680 0x7fe48c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:44.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.658+0000 7fe4a17fa700 1 -- 172.21.15.98:0/803679075 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe494014070 con 0x7fe4a41018a0 2024-09-13T02:51:44.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.658+0000 7fe4a37fe700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe48c06c680 0x7fe48c06eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe49800b6f0 tx=0x7fe498005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:44.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:44.662+0000 7fe4a17fa700 1 -- 172.21.15.98:0/803679075 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe494051720 con 0x7fe4a41018a0 2024-09-13T02:51:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:44 smithi142 ceph-mon[33443]: pgmap v233: 65 pgs: 65 active+clean; 24 MiB data, 241 MiB used, 536 GiB / 536 GiB avail; 236 KiB/s rd, 2.0 MiB/s wr, 66 op/s 2024-09-13T02:51:45.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.002+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4a41051e0 con 0x7fe48c06c680 2024-09-13T02:51:45.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.004+0000 7fe4a17fa700 1 -- 172.21.15.98:0/803679075 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fe4a41051e0 con 0x7fe48c06c680 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe48c06c680 msgr2=0x7fe48c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe48c06c680 0x7fe48c06eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe49800b6f0 tx=0x7fe498005940 comp rx=0 tx=0).stop 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a41018a0 msgr2=0x7fe4a41938d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a41018a0 0x7fe4a41938d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe49400e920 tx=0x7fe49400ec30 comp rx=0 tx=0).stop 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 shutdown_connections 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fe48c06c680 0x7fe48c06eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4a41018a0 0x7fe4a41938d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 --2- 172.21.15.98:0/803679075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4a41021f0 0x7fe4a4193e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 >> 172.21.15.98:0/803679075 conn(0x7fe4a40f9f10 msgr2=0x7fe4a4102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 shutdown_connections 2024-09-13T02:51:45.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.007+0000 7fe4aa273700 1 -- 172.21.15.98:0/803679075 wait complete. 2024-09-13T02:51:45.024 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:51:45.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.164+0000 7f12f632d700 1 -- 172.21.15.98:0/841601837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 msgr2=0x7f12f00fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.164+0000 7f12f632d700 1 --2- 172.21.15.98:0/841601837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 0x7f12f00fe320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009910 tx=0x7f12e4009c20 comp rx=0 tx=0).stop 2024-09-13T02:51:45.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.164+0000 7f12f632d700 1 -- 172.21.15.98:0/841601837 shutdown_connections 2024-09-13T02:51:45.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.164+0000 7f12f632d700 1 --2- 172.21.15.98:0/841601837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 0x7f12f00fe320 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.164+0000 7f12f632d700 1 --2- 172.21.15.98:0/841601837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f01018a0 0x7f12f0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.164+0000 7f12f632d700 1 -- 172.21.15.98:0/841601837 >> 172.21.15.98:0/841601837 conn(0x7f12f00f9f10 msgr2=0x7f12f00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:45.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.164+0000 7f12f632d700 1 -- 172.21.15.98:0/841601837 shutdown_connections 2024-09-13T02:51:45.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.164+0000 7f12f632d700 1 -- 172.21.15.98:0/841601837 wait complete. 2024-09-13T02:51:45.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.165+0000 7f12f632d700 1 Processor -- start 2024-09-13T02:51:45.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.165+0000 7f12f632d700 1 -- start start 2024-09-13T02:51:45.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.165+0000 7f12f632d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f01018a0 0x7f12f01938d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:45.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.165+0000 7f12f632d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 0x7f12f0193e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:45.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.165+0000 7f12f632d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0194430 con 0x7f12f01021f0 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.165+0000 7f12f632d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0194570 con 0x7f12f01018a0 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.165+0000 7f12ef7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 0x7f12f0193e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.165+0000 7f12ef7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 0x7f12f0193e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37512/0 (socket says 172.21.15.98:37512) 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.165+0000 7f12ef7fe700 1 -- 172.21.15.98:0/3592063487 learned_addr learned my addr 172.21.15.98:0/3592063487 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.166+0000 7f12effff700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f01018a0 0x7f12f01938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.166+0000 7f12ef7fe700 1 -- 172.21.15.98:0/3592063487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f01018a0 msgr2=0x7f12f01938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.166+0000 7f12ef7fe700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f01018a0 0x7f12f01938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.166+0000 7f12ef7fe700 1 -- 172.21.15.98:0/3592063487 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e40095f0 con 0x7f12f01021f0 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.166+0000 7f12ef7fe700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 0x7f12f0193e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f12e4000c00 tx=0x7f12e400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.166+0000 7f12ed7fa700 1 -- 172.21.15.98:0/3592063487 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12e401d070 con 0x7f12f01021f0 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.167+0000 7f12ed7fa700 1 -- 172.21.15.98:0/3592063487 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f12e4005dc0 con 0x7f12f01021f0 2024-09-13T02:51:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.167+0000 7f12ed7fa700 1 -- 172.21.15.98:0/3592063487 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12e4022470 con 0x7f12f01021f0 2024-09-13T02:51:45.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.167+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f0198fc0 con 0x7f12f01021f0 2024-09-13T02:51:45.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.167+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f0199480 con 0x7f12f01021f0 2024-09-13T02:51:45.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.168+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f0106b30 con 0x7f12f01021f0 2024-09-13T02:51:45.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.169+0000 7f12ed7fa700 1 -- 172.21.15.98:0/3592063487 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f12e4003810 con 0x7f12f01021f0 2024-09-13T02:51:45.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.169+0000 7f12ed7fa700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f12d8070ae0 0x7f12d8072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:45.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.169+0000 7f12ed7fa700 1 -- 172.21.15.98:0/3592063487 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f12e408cb20 con 0x7f12f01021f0 2024-09-13T02:51:45.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.169+0000 7f12effff700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f12d8070ae0 0x7f12d8072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:45.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.170+0000 7f12effff700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f12d8070ae0 0x7f12d8072f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009c60 tx=0x7f12e0009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:45.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.176+0000 7f12ed7fa700 1 -- 172.21.15.98:0/3592063487 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f12e405ae80 con 0x7f12f01021f0 2024-09-13T02:51:45.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.511+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12f0199ae0 con 0x7f12d8070ae0 2024-09-13T02:51:45.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.513+0000 7f12ed7fa700 1 -- 172.21.15.98:0/3592063487 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f12f0199ae0 con 0x7f12d8070ae0 2024-09-13T02:51:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f12d8070ae0 msgr2=0x7f12d8072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f12d8070ae0 0x7f12d8072f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009c60 tx=0x7f12e0009260 comp rx=0 tx=0).stop 2024-09-13T02:51:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 msgr2=0x7f12f0193e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 0x7f12f0193e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f12e4000c00 tx=0x7f12e400f690 comp rx=0 tx=0).stop 2024-09-13T02:51:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 shutdown_connections 2024-09-13T02:51:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f12d8070ae0 0x7f12d8072f90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f01018a0 0x7f12f01938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 --2- 172.21.15.98:0/3592063487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12f01021f0 0x7f12f0193e10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 >> 172.21.15.98:0/3592063487 conn(0x7f12f00f9f10 msgr2=0x7f12f0104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:45.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.516+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 shutdown_connections 2024-09-13T02:51:45.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.517+0000 7f12f632d700 1 -- 172.21.15.98:0/3592063487 wait complete. 2024-09-13T02:51:45.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.631+0000 7fb081a7c700 1 -- 172.21.15.98:0/1263109672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c1003d0 msgr2=0x7fb07c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.631+0000 7fb081a7c700 1 --2- 172.21.15.98:0/1263109672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c1003d0 0x7fb07c100840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb070009910 tx=0x7fb070009c20 comp rx=0 tx=0).stop 2024-09-13T02:51:45.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.631+0000 7fb081a7c700 1 -- 172.21.15.98:0/1263109672 shutdown_connections 2024-09-13T02:51:45.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.631+0000 7fb081a7c700 1 --2- 172.21.15.98:0/1263109672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c1003d0 0x7fb07c100840 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.631+0000 7fb081a7c700 1 --2- 172.21.15.98:0/1263109672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb07c0ff130 0x7fb07c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.631+0000 7fb081a7c700 1 -- 172.21.15.98:0/1263109672 >> 172.21.15.98:0/1263109672 conn(0x7fb07c0fa780 msgr2=0x7fb07c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:45.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.631+0000 7fb081a7c700 1 -- 172.21.15.98:0/1263109672 shutdown_connections 2024-09-13T02:51:45.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.631+0000 7fb081a7c700 1 -- 172.21.15.98:0/1263109672 wait complete. 2024-09-13T02:51:45.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb081a7c700 1 Processor -- start 2024-09-13T02:51:45.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb081a7c700 1 -- start start 2024-09-13T02:51:45.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb081a7c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c0ff130 0x7fb07c195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:45.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb081a7c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb07c1003d0 0x7fb07c195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:45.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb081a7c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1965d0 con 0x7fb07c0ff130 2024-09-13T02:51:45.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb081a7c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c196710 con 0x7fb07c1003d0 2024-09-13T02:51:45.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb07b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c0ff130 0x7fb07c195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:45.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb07b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c0ff130 0x7fb07c195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37526/0 (socket says 172.21.15.98:37526) 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb07b7fe700 1 -- 172.21.15.98:0/2363838832 learned_addr learned my addr 172.21.15.98:0/2363838832 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.632+0000 7fb07affd700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb07c1003d0 0x7fb07c195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.633+0000 7fb07b7fe700 1 -- 172.21.15.98:0/2363838832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb07c1003d0 msgr2=0x7fb07c195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.633+0000 7fb07b7fe700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb07c1003d0 0x7fb07c195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.633+0000 7fb07b7fe700 1 -- 172.21.15.98:0/2363838832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0700095f0 con 0x7fb07c0ff130 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.633+0000 7fb07b7fe700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c0ff130 0x7fb07c195a70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00d900 tx=0x7fb06c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.633+0000 7fb078ff9700 1 -- 172.21.15.98:0/2363838832 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06c0041f0 con 0x7fb07c0ff130 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.633+0000 7fb078ff9700 1 -- 172.21.15.98:0/2363838832 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb06c004ce0 con 0x7fb07c0ff130 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.633+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c19b1c0 con 0x7fb07c0ff130 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.633+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c19b710 con 0x7fb07c0ff130 2024-09-13T02:51:45.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.633+0000 7fb078ff9700 1 -- 172.21.15.98:0/2363838832 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06c00b750 con 0x7fb07c0ff130 2024-09-13T02:51:45.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.634+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c107c10 con 0x7fb07c0ff130 2024-09-13T02:51:45.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.635+0000 7fb078ff9700 1 -- 172.21.15.98:0/2363838832 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb06c004e50 con 0x7fb07c0ff130 2024-09-13T02:51:45.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.635+0000 7fb078ff9700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb06406c680 0x7fb06406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:45.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.636+0000 7fb078ff9700 1 -- 172.21.15.98:0/2363838832 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb06c08bbd0 con 0x7fb07c0ff130 2024-09-13T02:51:45.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.636+0000 7fb07affd700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb06406c680 0x7fb06406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:45.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.637+0000 7fb07affd700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb06406c680 0x7fb06406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b5c0 tx=0x7fb070005ee0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:45.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.642+0000 7fb078ff9700 1 -- 172.21.15.98:0/2363838832 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb06c059e70 con 0x7fb07c0ff130 2024-09-13T02:51:45.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.893+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb07c068c50 con 0x7fb06406c680 2024-09-13T02:51:45.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.907+0000 7fb078ff9700 1 -- 172.21.15.98:0/2363838832 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7fb07c068c50 con 0x7fb06406c680 2024-09-13T02:51:45.908 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (5m) 88s ago 7m 24.6M - 0.25.0 c8568f914cd2 babcc5d689b7 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (7m) 88s ago 7m 7448k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (6m) 94s ago 6m 7142k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (7m) 88s ago 7m 6660k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (6m) 94s ago 6m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (5m) 88s ago 6m 84.7M - 9.4.7 954c08fa6188 6b3b619a7e20 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (106s) 88s ago 106s 18.7M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (112s) 88s ago 111s 18.5M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (104s) 94s ago 103s 11.3M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (109s) 94s ago 109s 14.6M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:9283,8765,8443 running (8m) 88s ago 8m 487M - 18.2.0 dc2bc1663786 230c0046ad07 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (6m) 94s ago 6m 439M - 18.2.0 dc2bc1663786 980f7ae983de 2024-09-13T02:51:45.909 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (8m) 88s ago 8m 47.6M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (6m) 94s ago 6m 35.3M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 88s ago 7m 15.8M - 1.5.0 0da6a335fe13 5c48ece10527 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (6m) 94s ago 6m 15.3M - 1.5.0 0da6a335fe13 b2fc832c8f17 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (5m) 88s ago 5m 48.2M 3946M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (5m) 88s ago 5m 47.1M 3946M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (4m) 88s ago 4m 44.8M 3946M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (4m) 94s ago 4m 45.4M 4970M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (3m) 94s ago 3m 42.7M 4970M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (3m) 94s ago 3m 43.3M 4970M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:51:45.910 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (5m) 88s ago 6m 60.9M - 2.43.0 a07b618ecd1d fc785e775830 2024-09-13T02:51:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb06406c680 msgr2=0x7fb06406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb06406c680 0x7fb06406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b5c0 tx=0x7fb070005ee0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c0ff130 msgr2=0x7fb07c195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c0ff130 0x7fb07c195a70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00d900 tx=0x7fb06c00dc10 comp rx=0 tx=0).stop 2024-09-13T02:51:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 shutdown_connections 2024-09-13T02:51:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7fb06406c680 0x7fb06406eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb07c0ff130 0x7fb07c195a70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 --2- 172.21.15.98:0/2363838832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb07c1003d0 0x7fb07c195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 >> 172.21.15.98:0/2363838832 conn(0x7fb07c0fa780 msgr2=0x7fb07c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 shutdown_connections 2024-09-13T02:51:45.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:45.909+0000 7fb081a7c700 1 -- 172.21.15.98:0/2363838832 wait complete. 2024-09-13T02:51:46.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.047+0000 7f32869c1700 1 -- 172.21.15.98:0/35899776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32800ff150 msgr2=0x7f32800ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.047+0000 7f32869c1700 1 --2- 172.21.15.98:0/35899776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32800ff150 0x7f32800ff560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3270009910 tx=0x7f3270009c20 comp rx=0 tx=0).stop 2024-09-13T02:51:46.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.047+0000 7f32869c1700 1 -- 172.21.15.98:0/35899776 shutdown_connections 2024-09-13T02:51:46.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.047+0000 7f32869c1700 1 --2- 172.21.15.98:0/35899776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32801003f0 0x7f3280100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.047+0000 7f32869c1700 1 --2- 172.21.15.98:0/35899776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32800ff150 0x7f32800ff560 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.047+0000 7f32869c1700 1 -- 172.21.15.98:0/35899776 >> 172.21.15.98:0/35899776 conn(0x7f32800fa7a0 msgr2=0x7f32800fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:46.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.047+0000 7f32869c1700 1 -- 172.21.15.98:0/35899776 shutdown_connections 2024-09-13T02:51:46.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.048+0000 7f32869c1700 1 -- 172.21.15.98:0/35899776 wait complete. 2024-09-13T02:51:46.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.048+0000 7f32869c1700 1 Processor -- start 2024-09-13T02:51:46.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.048+0000 7f32869c1700 1 -- start start 2024-09-13T02:51:46.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f32869c1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32800ff150 0x7f3280103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:46.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f32869c1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32801003f0 0x7f32801017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f32869c1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3280101d10 con 0x7f32801003f0 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f32869c1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3280101e50 con 0x7f32800ff150 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f327f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32801003f0 0x7f32801017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f327f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32801003f0 0x7f32801017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37542/0 (socket says 172.21.15.98:37542) 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f327f7fe700 1 -- 172.21.15.98:0/644242683 learned_addr learned my addr 172.21.15.98:0/644242683 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f327ffff700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32800ff150 0x7f3280103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f327f7fe700 1 -- 172.21.15.98:0/644242683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32800ff150 msgr2=0x7f3280103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f327f7fe700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32800ff150 0x7f3280103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.049+0000 7f327f7fe700 1 -- 172.21.15.98:0/644242683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32700095f0 con 0x7f32801003f0 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.050+0000 7f327f7fe700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32801003f0 0x7f32801017d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f327400d8d0 tx=0x7f327400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.050+0000 7f327d7fa700 1 -- 172.21.15.98:0/644242683 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32740098a0 con 0x7f32801003f0 2024-09-13T02:51:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.050+0000 7f327d7fa700 1 -- 172.21.15.98:0/644242683 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3274010460 con 0x7f32801003f0 2024-09-13T02:51:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.050+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3280102130 con 0x7f32801003f0 2024-09-13T02:51:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.050+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328019de70 con 0x7f32801003f0 2024-09-13T02:51:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.050+0000 7f327d7fa700 1 -- 172.21.15.98:0/644242683 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327400f5f0 con 0x7f32801003f0 2024-09-13T02:51:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.051+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3280068ab0 con 0x7f32801003f0 2024-09-13T02:51:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.052+0000 7f327d7fa700 1 -- 172.21.15.98:0/644242683 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3274009a00 con 0x7f32801003f0 2024-09-13T02:51:46.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.052+0000 7f327d7fa700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f326806c680 0x7f326806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:46.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.053+0000 7f327d7fa700 1 -- 172.21.15.98:0/644242683 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f327408b680 con 0x7f32801003f0 2024-09-13T02:51:46.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.053+0000 7f327ffff700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f326806c680 0x7f326806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:46.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.053+0000 7f327ffff700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f326806c680 0x7f326806eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3270006010 tx=0x7f327000b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:46.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.058+0000 7f327d7fa700 1 -- 172.21.15.98:0/644242683 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f32740598a0 con 0x7f32801003f0 2024-09-13T02:51:46.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.496+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f328019e000 con 0x7f32801003f0 2024-09-13T02:51:46.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.496+0000 7f327d7fa700 1 -- 172.21.15.98:0/644242683 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f327408b070 con 0x7f32801003f0 2024-09-13T02:51:46.498 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:51:46.498 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:51:46.498 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:51:46.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:51:46.498 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:51:46.498 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:51:46.499 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:51:46.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f326806c680 msgr2=0x7f326806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f326806c680 0x7f326806eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3270006010 tx=0x7f327000b540 comp rx=0 tx=0).stop 2024-09-13T02:51:46.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32801003f0 msgr2=0x7f32801017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32801003f0 0x7f32801017d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f327400d8d0 tx=0x7f327400dbe0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 shutdown_connections 2024-09-13T02:51:46.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f326806c680 0x7f326806eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32800ff150 0x7f3280103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 --2- 172.21.15.98:0/644242683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32801003f0 0x7f32801017d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 >> 172.21.15.98:0/644242683 conn(0x7f32800fa7a0 msgr2=0x7f3280068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:46.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 shutdown_connections 2024-09-13T02:51:46.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.499+0000 7f32869c1700 1 -- 172.21.15.98:0/644242683 wait complete. 2024-09-13T02:51:46.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:46 smithi142 ceph-mon[33443]: pgmap v234: 65 pgs: 65 active+clean; 36 MiB data, 270 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 2.9 MiB/s wr, 106 op/s 2024-09-13T02:51:46.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:46 smithi142 ceph-mon[33443]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.609+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/355652411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 msgr2=0x7f9ff80ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.609+0000 7f9ffd0c8700 1 --2- 172.21.15.98:0/355652411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 0x7f9ff80ff540 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009910 tx=0x7f9fe8009c20 comp rx=0 tx=0).stop 2024-09-13T02:51:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.609+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/355652411 shutdown_connections 2024-09-13T02:51:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.609+0000 7f9ffd0c8700 1 --2- 172.21.15.98:0/355652411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff81003d0 0x7f9ff8100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.609+0000 7f9ffd0c8700 1 --2- 172.21.15.98:0/355652411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 0x7f9ff80ff540 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.609+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/355652411 >> 172.21.15.98:0/355652411 conn(0x7f9ff80fa780 msgr2=0x7f9ff80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:46.611 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:46 smithi098 ceph-mon[27886]: pgmap v234: 65 pgs: 65 active+clean; 36 MiB data, 270 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 2.9 MiB/s wr, 106 op/s 2024-09-13T02:51:46.611 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:46 smithi098 ceph-mon[27886]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.609+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/355652411 shutdown_connections 2024-09-13T02:51:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.609+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/355652411 wait complete. 2024-09-13T02:51:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ffd0c8700 1 Processor -- start 2024-09-13T02:51:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ffd0c8700 1 -- start start 2024-09-13T02:51:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ffd0c8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 0x7f9ff80690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ffd0c8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff81003d0 0x7f9ff819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ffd0c8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff819ade0 con 0x7f9ff80ff130 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ffd0c8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff819af20 con 0x7f9ff81003d0 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ff6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 0x7f9ff80690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ff6d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 0x7f9ff80690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37566/0 (socket says 172.21.15.98:37566) 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ff6d9d700 1 -- 172.21.15.98:0/52872915 learned_addr learned my addr 172.21.15.98:0/52872915 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.610+0000 7f9ff659c700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff81003d0 0x7f9ff819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9ff6d9d700 1 -- 172.21.15.98:0/52872915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff81003d0 msgr2=0x7f9ff819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9ff6d9d700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff81003d0 0x7f9ff819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9ff6d9d700 1 -- 172.21.15.98:0/52872915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80095f0 con 0x7f9ff80ff130 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9ff659c700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff81003d0 0x7f9ff819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:51:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9ff6d9d700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 0x7f9ff80690a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800bd70 tx=0x7f9fe800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9fdffff700 1 -- 172.21.15.98:0/52872915 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fe801d070 con 0x7f9ff80ff130 2024-09-13T02:51:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff819b1a0 con 0x7f9ff80ff130 2024-09-13T02:51:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff819b690 con 0x7f9ff80ff130 2024-09-13T02:51:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9fdffff700 1 -- 172.21.15.98:0/52872915 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9fe8005dc0 con 0x7f9ff80ff130 2024-09-13T02:51:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.611+0000 7f9fdffff700 1 -- 172.21.15.98:0/52872915 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fe8021410 con 0x7f9ff80ff130 2024-09-13T02:51:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.612+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff8107c10 con 0x7f9ff80ff130 2024-09-13T02:51:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.613+0000 7f9fdffff700 1 -- 172.21.15.98:0/52872915 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9fe800f7d0 con 0x7f9ff80ff130 2024-09-13T02:51:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.614+0000 7f9fdffff700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9fe006c680 0x7f9fe006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.614+0000 7f9fdffff700 1 -- 172.21.15.98:0/52872915 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9fe808c9b0 con 0x7f9ff80ff130 2024-09-13T02:51:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.614+0000 7f9ff659c700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9fe006c680 0x7f9fe006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.614+0000 7f9ff659c700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9fe006c680 0x7f9fe006eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8069620 tx=0x7f9fec0073d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:46.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.622+0000 7f9fdffff700 1 -- 172.21.15.98:0/52872915 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9fe805abd0 con 0x7f9ff80ff130 2024-09-13T02:51:46.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.876+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 --> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ff8104d20 con 0x7f9fe006c680 2024-09-13T02:51:46.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.877+0000 7f9fdffff700 1 -- 172.21.15.98:0/52872915 <== mgr.14211 v2:172.21.15.98:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f9ff8104d20 con 0x7f9fe006c680 2024-09-13T02:51:46.879 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:51:46.879 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:51:46.879 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:51:46.879 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T02:51:46.879 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [], 2024-09-13T02:51:46.879 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "0/2 daemons upgraded", 2024-09-13T02:51:46.879 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d image on host smithi142", 2024-09-13T02:51:46.879 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:51:46.880 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:51:46.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9fe006c680 msgr2=0x7f9fe006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9fe006c680 0x7f9fe006eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8069620 tx=0x7f9fec0073d0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 msgr2=0x7f9ff80690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 0x7f9ff80690a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800bd70 tx=0x7f9fe800bda0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 shutdown_connections 2024-09-13T02:51:46.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:6800/2,v1:172.21.15.98:6801/2] conn(0x7f9fe006c680 0x7f9fe006eb30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff80ff130 0x7f9ff80690a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 --2- 172.21.15.98:0/52872915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ff81003d0 0x7f9ff819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 >> 172.21.15.98:0/52872915 conn(0x7f9ff80fa780 msgr2=0x7f9ff8103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:46.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 shutdown_connections 2024-09-13T02:51:46.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:51:46.881+0000 7f9ffd0c8700 1 -- 172.21.15.98:0/52872915 wait complete. 2024-09-13T02:51:47.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:47 smithi098 ceph-mon[27886]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:47.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:47 smithi098 ceph-mon[27886]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:47.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:47 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/644242683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:51:47.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:47 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:47.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:47 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:51:47.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:47 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:51:47.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:47 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:47.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:47 smithi142 ceph-mon[33443]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:47.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:47 smithi142 ceph-mon[33443]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:47.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:47 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/644242683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:51:47.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:47 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:47.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:47 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:51:47.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:47 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:51:47.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:47 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:48.582 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:48 smithi142 ceph-mon[33443]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:48.582 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:48 smithi142 ceph-mon[33443]: pgmap v235: 65 pgs: 65 active+clean; 41 MiB data, 300 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 127 op/s 2024-09-13T02:51:48.582 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:48 smithi142 ceph-mon[33443]: Upgrade: Updating mgr.smithi142.jutrvi 2024-09-13T02:51:48.582 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:48 smithi142 ceph-mon[33443]: Deploying daemon mgr.smithi142.jutrvi on smithi142 2024-09-13T02:51:48.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:48 smithi098 ceph-mon[27886]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:48.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:48 smithi098 ceph-mon[27886]: pgmap v235: 65 pgs: 65 active+clean; 41 MiB data, 300 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 127 op/s 2024-09-13T02:51:48.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:48 smithi098 ceph-mon[27886]: Upgrade: Updating mgr.smithi142.jutrvi 2024-09-13T02:51:48.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:48 smithi098 ceph-mon[27886]: Deploying daemon mgr.smithi142.jutrvi on smithi142 2024-09-13T02:51:50.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:50 smithi098 ceph-mon[27886]: pgmap v236: 65 pgs: 65 active+clean; 49 MiB data, 324 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 155 op/s 2024-09-13T02:51:50.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:50 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:50.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:50 smithi142 ceph-mon[33443]: pgmap v236: 65 pgs: 65 active+clean; 49 MiB data, 324 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 155 op/s 2024-09-13T02:51:50.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:50 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:52.399 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:52 smithi142 ceph-mon[33443]: pgmap v237: 65 pgs: 65 active+clean; 64 MiB data, 361 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 172 op/s 2024-09-13T02:51:52.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:52 smithi098 ceph-mon[27886]: pgmap v237: 65 pgs: 65 active+clean; 64 MiB data, 361 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 172 op/s 2024-09-13T02:51:53.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:53 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:53 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:53 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:53 smithi098 ceph-mon[27886]: pgmap v238: 65 pgs: 65 active+clean; 70 MiB data, 391 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 183 op/s 2024-09-13T02:51:54.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:53 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:54.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:53 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:54.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:53 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:54.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:53 smithi142 ceph-mon[33443]: pgmap v238: 65 pgs: 65 active+clean; 70 MiB data, 391 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 183 op/s 2024-09-13T02:51:56.140 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:55 smithi142 ceph-mon[33443]: pgmap v239: 65 pgs: 65 active+clean; 84 MiB data, 436 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 5.1 MiB/s wr, 189 op/s 2024-09-13T02:51:56.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:55 smithi098 ceph-mon[27886]: pgmap v239: 65 pgs: 65 active+clean; 84 MiB data, 436 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 5.1 MiB/s wr, 189 op/s 2024-09-13T02:51:58.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:58 smithi098 ceph-mon[27886]: pgmap v240: 65 pgs: 65 active+clean; 87 MiB data, 478 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 184 op/s 2024-09-13T02:51:58.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:58 smithi098 ceph-mon[27886]: Standby manager daemon smithi142.jutrvi restarted 2024-09-13T02:51:58.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:58 smithi098 ceph-mon[27886]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:51:58.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:58 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:51:58.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:58 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:51:58.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:58 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:51:58.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:58 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:51:58.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:58 smithi142 ceph-mon[33443]: pgmap v240: 65 pgs: 65 active+clean; 87 MiB data, 478 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 184 op/s 2024-09-13T02:51:58.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:58 smithi142 ceph-mon[33443]: Standby manager daemon smithi142.jutrvi restarted 2024-09-13T02:51:58.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:58 smithi142 ceph-mon[33443]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:51:58.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:58 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:51:58.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:58 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:51:58.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:58 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:51:58.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:58 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:51:59.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:59 smithi098 ceph-mon[27886]: mgrmap e20: smithi098.ukgenf(active, since 6m), standbys: smithi142.jutrvi 2024-09-13T02:51:59.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:59 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:59.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:59 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:59.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:59 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:59.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:51:59 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:59.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:59 smithi142 ceph-mon[33443]: mgrmap e20: smithi098.ukgenf(active, since 6m), standbys: smithi142.jutrvi 2024-09-13T02:51:59.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:59 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:59.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:59 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:59.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:59 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:51:59.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:51:59 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:52:00.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:00 smithi142 ceph-mon[33443]: pgmap v241: 65 pgs: 65 active+clean; 98 MiB data, 505 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 197 op/s 2024-09-13T02:52:00.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:00 smithi098 ceph-mon[27886]: pgmap v241: 65 pgs: 65 active+clean; 98 MiB data, 505 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 197 op/s 2024-09-13T02:52:02.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:02 smithi142 ceph-mon[33443]: pgmap v242: 65 pgs: 65 active+clean; 103 MiB data, 523 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2024-09-13T02:52:02.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:02 smithi098 ceph-mon[27886]: pgmap v242: 65 pgs: 65 active+clean; 103 MiB data, 523 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2024-09-13T02:52:04.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:04 smithi098 ceph-mon[27886]: pgmap v243: 65 pgs: 65 active+clean; 108 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 192 op/s 2024-09-13T02:52:04.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:04 smithi142 ceph-mon[33443]: pgmap v243: 65 pgs: 65 active+clean; 108 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 192 op/s 2024-09-13T02:52:05.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:05 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:05.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:05 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:06.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:06 smithi098 ceph-mon[27886]: pgmap v244: 65 pgs: 65 active+clean; 117 MiB data, 560 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 186 op/s 2024-09-13T02:52:06.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:06 smithi142 ceph-mon[33443]: pgmap v244: 65 pgs: 65 active+clean; 117 MiB data, 560 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 186 op/s 2024-09-13T02:52:08.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: pgmap v245: 65 pgs: 65 active+clean; 122 MiB data, 583 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 177 op/s 2024-09-13T02:52:08.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:52:08.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:52:08.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:08.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:08.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:52:08.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr fail", "who": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "mgr fail", "who": "smithi098.ukgenf"}]': finished 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: mgrmap e21: smithi142.jutrvi(active, starting, since 0.00674584s) 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:52:08.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr metadata", "who": "smithi142.jutrvi", "id": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: Manager daemon smithi142.jutrvi is now available 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: Migrating agent root cert to cert store 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: Migrating agent root key to cert store 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: Checking for cert/key for grafana.smithi098 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: Migrating grafana.smithi098 cert to cert store 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: Migrating grafana.smithi098 key to cert store 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.jutrvi/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.jutrvi/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.jutrvi/trash_purge_schedule"}]: dispatch 2024-09-13T02:52:08.487 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:08 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.jutrvi/trash_purge_schedule"}]: dispatch 2024-09-13T02:52:08.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: pgmap v245: 65 pgs: 65 active+clean; 122 MiB data, 583 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 177 op/s 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr fail", "who": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.14211 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "mgr fail", "who": "smithi098.ukgenf"}]': finished 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: mgrmap e21: smithi142.jutrvi(active, starting, since 0.00674584s) 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:52:08.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr metadata", "who": "smithi142.jutrvi", "id": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:52:08.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: Manager daemon smithi142.jutrvi is now available 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: Migrating agent root cert to cert store 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: Migrating agent root key to cert store 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: Checking for cert/key for grafana.smithi098 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: Migrating grafana.smithi098 cert to cert store 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: Migrating grafana.smithi098 key to cert store 2024-09-13T02:52:08.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:08.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:08.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:08.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.jutrvi/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:52:08.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.jutrvi/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:52:08.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.jutrvi/trash_purge_schedule"}]: dispatch 2024-09-13T02:52:08.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:08 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.jutrvi/trash_purge_schedule"}]: dispatch 2024-09-13T02:52:09.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:09 smithi098 ceph-mon[27886]: Deploying cephadm binary to smithi098 2024-09-13T02:52:09.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:09 smithi098 ceph-mon[27886]: Deploying cephadm binary to smithi142 2024-09-13T02:52:09.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:09 smithi098 ceph-mon[27886]: mgrmap e22: smithi142.jutrvi(active, since 1.01182s) 2024-09-13T02:52:09.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:09 smithi098 ceph-mon[27886]: pgmap v3: 65 pgs: 65 active+clean; 140 MiB data, 653 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:52:09.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:09 smithi142 ceph-mon[33443]: Deploying cephadm binary to smithi098 2024-09-13T02:52:09.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:09 smithi142 ceph-mon[33443]: Deploying cephadm binary to smithi142 2024-09-13T02:52:09.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:09 smithi142 ceph-mon[33443]: mgrmap e22: smithi142.jutrvi(active, since 1.01182s) 2024-09-13T02:52:09.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:09 smithi142 ceph-mon[33443]: pgmap v3: 65 pgs: 65 active+clean; 140 MiB data, 653 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:52:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:10 smithi098 ceph-mon[27886]: [13/Sep/2024:02:52:09] ENGINE Bus STARTING 2024-09-13T02:52:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:10 smithi098 ceph-mon[27886]: [13/Sep/2024:02:52:09] ENGINE Serving on https://172.21.15.142:7150 2024-09-13T02:52:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:10 smithi098 ceph-mon[27886]: [13/Sep/2024:02:52:09] ENGINE Error in HTTPServer.serve 2024-09-13T02:52:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Traceback (most recent call last): 2024-09-13T02:52:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:52:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:52:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:52:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._run(expiration_interval) 2024-09-13T02:52:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s = self.context.wrap_socket( 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: return self.sslsocket_class._create( 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self.do_handshake() 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._sslobj.do_handshake() 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:52:10.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:10 smithi098 ceph-mon[27886]: pgmap v4: 65 pgs: 65 active+clean; 140 MiB data, 653 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:52:10.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:10 smithi098 ceph-mon[27886]: [13/Sep/2024:02:52:09] ENGINE Serving on http://172.21.15.142:8765 2024-09-13T02:52:10.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:10 smithi098 ceph-mon[27886]: [13/Sep/2024:02:52:09] ENGINE Bus STARTED 2024-09-13T02:52:10.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:10 smithi142 ceph-mon[33443]: [13/Sep/2024:02:52:09] ENGINE Bus STARTING 2024-09-13T02:52:10.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:10 smithi142 ceph-mon[33443]: [13/Sep/2024:02:52:09] ENGINE Serving on https://172.21.15.142:7150 2024-09-13T02:52:10.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:10 smithi142 ceph-mon[33443]: [13/Sep/2024:02:52:09] ENGINE Error in HTTPServer.serve 2024-09-13T02:52:10.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Traceback (most recent call last): 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self._run(expiration_interval) 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: s = self.context.wrap_socket( 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: return self.sslsocket_class._create( 2024-09-13T02:52:10.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:52:10.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self.do_handshake() 2024-09-13T02:52:10.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:52:10.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self._sslobj.do_handshake() 2024-09-13T02:52:10.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:52:10.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:10 smithi142 ceph-mon[33443]: pgmap v4: 65 pgs: 65 active+clean; 140 MiB data, 653 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:52:10.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:10 smithi142 ceph-mon[33443]: [13/Sep/2024:02:52:09] ENGINE Serving on http://172.21.15.142:8765 2024-09-13T02:52:10.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:10 smithi142 ceph-mon[33443]: [13/Sep/2024:02:52:09] ENGINE Bus STARTED 2024-09-13T02:52:11.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:11 smithi098 ceph-mon[27886]: mgrmap e23: smithi142.jutrvi(active, since 3s) 2024-09-13T02:52:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:11 smithi142 ceph-mon[33443]: mgrmap e23: smithi142.jutrvi(active, since 3s) 2024-09-13T02:52:12.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:12 smithi142 ceph-mon[33443]: pgmap v5: 65 pgs: 65 active+clean; 140 MiB data, 653 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:52:12.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:12 smithi098 ceph-mon[27886]: pgmap v5: 65 pgs: 65 active+clean; 140 MiB data, 653 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:52:13.492 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:13 smithi098 ceph-mon[27886]: mgrmap e24: smithi142.jutrvi(active, since 5s) 2024-09-13T02:52:13.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:13 smithi142 ceph-mon[33443]: mgrmap e24: smithi142.jutrvi(active, since 5s) 2024-09-13T02:52:14.696 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:14 smithi098 ceph-mon[27886]: pgmap v6: 65 pgs: 65 active+clean; 141 MiB data, 670 MiB used, 536 GiB / 536 GiB avail; 410 B/s rd, 327 KiB/s wr, 64 op/s 2024-09-13T02:52:14.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:14 smithi142 ceph-mon[33443]: pgmap v6: 65 pgs: 65 active+clean; 141 MiB data, 670 MiB used, 536 GiB / 536 GiB avail; 410 B/s rd, 327 KiB/s wr, 64 op/s 2024-09-13T02:52:16.160 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:15 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:16.161 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:15 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:16.161 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:15 smithi098 ceph-mon[27886]: pgmap v7: 65 pgs: 65 active+clean; 160 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 227 op/s 2024-09-13T02:52:16.161 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:15 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:16.161 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:15 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:15 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:15 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:16.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:15 smithi142 ceph-mon[33443]: pgmap v7: 65 pgs: 65 active+clean; 160 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 227 op/s 2024-09-13T02:52:16.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:15 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:16.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:15 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:17.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.023+0000 7f7f906a2700 1 -- 172.21.15.98:0/62040168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 msgr2=0x7f7f88102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.023+0000 7f7f906a2700 1 --2- 172.21.15.98:0/62040168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 0x7f7f88102df0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009910 tx=0x7f7f84009c20 comp rx=0 tx=0).stop 2024-09-13T02:52:17.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.024+0000 7f7f906a2700 1 -- 172.21.15.98:0/62040168 shutdown_connections 2024-09-13T02:52:17.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.024+0000 7f7f906a2700 1 --2- 172.21.15.98:0/62040168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f88103330 0x7f7f88105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.024+0000 7f7f906a2700 1 --2- 172.21.15.98:0/62040168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 0x7f7f88102df0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.024+0000 7f7f906a2700 1 -- 172.21.15.98:0/62040168 >> 172.21.15.98:0/62040168 conn(0x7f7f880fa780 msgr2=0x7f7f880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:17.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.024+0000 7f7f906a2700 1 -- 172.21.15.98:0/62040168 shutdown_connections 2024-09-13T02:52:17.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.024+0000 7f7f906a2700 1 -- 172.21.15.98:0/62040168 wait complete. 2024-09-13T02:52:17.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.025+0000 7f7f906a2700 1 Processor -- start 2024-09-13T02:52:17.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.025+0000 7f7f906a2700 1 -- start start 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.025+0000 7f7f906a2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 0x7f7f881938f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.025+0000 7f7f906a2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f88103330 0x7f7f88193e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.025+0000 7f7f906a2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88194450 con 0x7f7f88069250 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.025+0000 7f7f906a2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88194590 con 0x7f7f88103330 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.025+0000 7f7f8e43e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 0x7f7f881938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.025+0000 7f7f8e43e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 0x7f7f881938f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37164/0 (socket says 172.21.15.98:37164) 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.025+0000 7f7f8e43e700 1 -- 172.21.15.98:0/3333323003 learned_addr learned my addr 172.21.15.98:0/3333323003 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f8dc3d700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f88103330 0x7f7f88193e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f8e43e700 1 -- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f88103330 msgr2=0x7f7f88193e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f8e43e700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f88103330 0x7f7f88193e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f8e43e700 1 -- 172.21.15.98:0/3333323003 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840095f0 con 0x7f7f88069250 2024-09-13T02:52:17.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f8e43e700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 0x7f7f881938f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400f690 tx=0x7f7f8400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:17.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f7f7fe700 1 -- 172.21.15.98:0/3333323003 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f8401d070 con 0x7f7f88069250 2024-09-13T02:52:17.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f88198fe0 con 0x7f7f88069250 2024-09-13T02:52:17.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f7f7fe700 1 -- 172.21.15.98:0/3333323003 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f84005dc0 con 0x7f7f88069250 2024-09-13T02:52:17.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f881994d0 con 0x7f7f88069250 2024-09-13T02:52:17.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.026+0000 7f7f7f7fe700 1 -- 172.21.15.98:0/3333323003 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f84017400 con 0x7f7f88069250 2024-09-13T02:52:17.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.028+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f88108cf0 con 0x7f7f88069250 2024-09-13T02:52:17.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.029+0000 7f7f7f7fe700 1 -- 172.21.15.98:0/3333323003 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f7f840038a0 con 0x7f7f88069250 2024-09-13T02:52:17.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.029+0000 7f7f7f7fe700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f7f7406d5f0 0x7f7f7406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:17.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.030+0000 7f7f7f7fe700 1 -- 172.21.15.98:0/3333323003 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7f8408e140 con 0x7f7f88069250 2024-09-13T02:52:17.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.030+0000 7f7f8dc3d700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f7f7406d5f0 0x7f7f7406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:17.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.030+0000 7f7f8dc3d700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f7f7406d5f0 0x7f7f7406faa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009c60 tx=0x7f7f78009260 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:17.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.035+0000 7f7f7f7fe700 1 -- 172.21.15.98:0/3333323003 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f7f8405b350 con 0x7f7f88069250 2024-09-13T02:52:17.220 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:16 smithi142 ceph-mon[33443]: Standby manager daemon smithi098.ukgenf started 2024-09-13T02:52:17.220 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:16 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.ukgenf/crt"}]: dispatch 2024-09-13T02:52:17.220 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:16 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:52:17.220 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:16 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.ukgenf/key"}]: dispatch 2024-09-13T02:52:17.220 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:16 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:52:17.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:16 smithi098 ceph-mon[27886]: Standby manager daemon smithi098.ukgenf started 2024-09-13T02:52:17.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:16 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.ukgenf/crt"}]: dispatch 2024-09-13T02:52:17.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:16 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:52:17.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:16 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.ukgenf/key"}]: dispatch 2024-09-13T02:52:17.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:16 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.98:0/2' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:52:17.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.340+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f880fbe30 con 0x7f7f7406d5f0 2024-09-13T02:52:17.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.342+0000 7f7f7f7fe700 1 -- 172.21.15.98:0/3333323003 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f7f880fbe30 con 0x7f7f7406d5f0 2024-09-13T02:52:17.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.345+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f7f7406d5f0 msgr2=0x7f7f7406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.345+0000 7f7f906a2700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f7f7406d5f0 0x7f7f7406faa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009c60 tx=0x7f7f78009260 comp rx=0 tx=0).stop 2024-09-13T02:52:17.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.346+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 msgr2=0x7f7f881938f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.346+0000 7f7f906a2700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 0x7f7f881938f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400f690 tx=0x7f7f8400f6c0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.346+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 shutdown_connections 2024-09-13T02:52:17.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.346+0000 7f7f906a2700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f7f7406d5f0 0x7f7f7406faa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.346+0000 7f7f906a2700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f88069250 0x7f7f881938f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.346+0000 7f7f906a2700 1 --2- 172.21.15.98:0/3333323003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f88103330 0x7f7f88193e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.346+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 >> 172.21.15.98:0/3333323003 conn(0x7f7f880fa780 msgr2=0x7f7f88100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:17.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.347+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 shutdown_connections 2024-09-13T02:52:17.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.347+0000 7f7f906a2700 1 -- 172.21.15.98:0/3333323003 wait complete. 2024-09-13T02:52:17.362 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:52:17.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.498+0000 7f58187e3700 1 -- 172.21.15.98:0/3023154457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58100ff130 msgr2=0x7f58100ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.498+0000 7f58187e3700 1 --2- 172.21.15.98:0/3023154457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58100ff130 0x7f58100ff540 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f580c009910 tx=0x7f580c009c20 comp rx=0 tx=0).stop 2024-09-13T02:52:17.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.498+0000 7f58187e3700 1 -- 172.21.15.98:0/3023154457 shutdown_connections 2024-09-13T02:52:17.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.498+0000 7f58187e3700 1 --2- 172.21.15.98:0/3023154457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58101003d0 0x7f5810100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.498+0000 7f58187e3700 1 --2- 172.21.15.98:0/3023154457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58100ff130 0x7f58100ff540 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.498+0000 7f58187e3700 1 -- 172.21.15.98:0/3023154457 >> 172.21.15.98:0/3023154457 conn(0x7f58100fa780 msgr2=0x7f58100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:17.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.499+0000 7f58187e3700 1 -- 172.21.15.98:0/3023154457 shutdown_connections 2024-09-13T02:52:17.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.499+0000 7f58187e3700 1 -- 172.21.15.98:0/3023154457 wait complete. 2024-09-13T02:52:17.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.499+0000 7f58187e3700 1 Processor -- start 2024-09-13T02:52:17.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.499+0000 7f58187e3700 1 -- start start 2024-09-13T02:52:17.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f58187e3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58100ff130 0x7f5810195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f58187e3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58101003d0 0x7f5810195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f58187e3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810196600 con 0x7f58101003d0 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f58187e3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810196740 con 0x7f58100ff130 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f5815d7e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58101003d0 0x7f5810195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f5815d7e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58101003d0 0x7f5810195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37174/0 (socket says 172.21.15.98:37174) 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f5815d7e700 1 -- 172.21.15.98:0/558388183 learned_addr learned my addr 172.21.15.98:0/558388183 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f581657f700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58100ff130 0x7f5810195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f5815d7e700 1 -- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58100ff130 msgr2=0x7f5810195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f5815d7e700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58100ff130 0x7f5810195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f5815d7e700 1 -- 172.21.15.98:0/558388183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c0095f0 con 0x7f58101003d0 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f5815d7e700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58101003d0 0x7f5810195fe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f580000d8d0 tx=0x7f580000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.500+0000 7f58077fe700 1 -- 172.21.15.98:0/558388183 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58000098a0 con 0x7f58101003d0 2024-09-13T02:52:17.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.501+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5810101650 con 0x7f58101003d0 2024-09-13T02:52:17.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.501+0000 7f58077fe700 1 -- 172.21.15.98:0/558388183 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5800010460 con 0x7f58101003d0 2024-09-13T02:52:17.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.501+0000 7f58077fe700 1 -- 172.21.15.98:0/558388183 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f580000f5f0 con 0x7f58101003d0 2024-09-13T02:52:17.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.501+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5810101ba0 con 0x7f58101003d0 2024-09-13T02:52:17.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.502+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5810107c10 con 0x7f58101003d0 2024-09-13T02:52:17.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.503+0000 7f58077fe700 1 -- 172.21.15.98:0/558388183 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f5800009a00 con 0x7f58101003d0 2024-09-13T02:52:17.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.503+0000 7f58077fe700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f57fc06d5f0 0x7f57fc06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:17.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.503+0000 7f58077fe700 1 -- 172.21.15.98:0/558388183 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f580008cd80 con 0x7f58101003d0 2024-09-13T02:52:17.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.504+0000 7f581657f700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f57fc06d5f0 0x7f57fc06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:17.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.505+0000 7f581657f700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f57fc06d5f0 0x7f57fc06faa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f580c006010 tx=0x7f580c00b560 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:17.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.510+0000 7f58077fe700 1 -- 172.21.15.98:0/558388183 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5800090030 con 0x7f58101003d0 2024-09-13T02:52:17.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.876+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5810068c50 con 0x7f57fc06d5f0 2024-09-13T02:52:17.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.878+0000 7f58077fe700 1 -- 172.21.15.98:0/558388183 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f5810068c50 con 0x7f57fc06d5f0 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f57fc06d5f0 msgr2=0x7f57fc06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f57fc06d5f0 0x7f57fc06faa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f580c006010 tx=0x7f580c00b560 comp rx=0 tx=0).stop 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58101003d0 msgr2=0x7f5810195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58101003d0 0x7f5810195fe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f580000d8d0 tx=0x7f580000dbe0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 shutdown_connections 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f57fc06d5f0 0x7f57fc06faa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58100ff130 0x7f5810195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 --2- 172.21.15.98:0/558388183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58101003d0 0x7f5810195fe0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 >> 172.21.15.98:0/558388183 conn(0x7f58100fa780 msgr2=0x7f5810068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 shutdown_connections 2024-09-13T02:52:17.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:17.881+0000 7f58187e3700 1 -- 172.21.15.98:0/558388183 wait complete. 2024-09-13T02:52:18.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.030+0000 7fda74c3b700 1 -- 172.21.15.98:0/4048596502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70100240 msgr2=0x7fda70100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:18.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.030+0000 7fda74c3b700 1 --2- 172.21.15.98:0/4048596502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70100240 0x7fda70100650 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fda60009910 tx=0x7fda60009c20 comp rx=0 tx=0).stop 2024-09-13T02:52:18.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.030+0000 7fda74c3b700 1 -- 172.21.15.98:0/4048596502 shutdown_connections 2024-09-13T02:52:18.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.030+0000 7fda74c3b700 1 --2- 172.21.15.98:0/4048596502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda70101440 0x7fda70101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:18.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.030+0000 7fda74c3b700 1 --2- 172.21.15.98:0/4048596502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70100240 0x7fda70100650 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:18.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.030+0000 7fda74c3b700 1 -- 172.21.15.98:0/4048596502 >> 172.21.15.98:0/4048596502 conn(0x7fda700fb7f0 msgr2=0x7fda700fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:18.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.030+0000 7fda74c3b700 1 -- 172.21.15.98:0/4048596502 shutdown_connections 2024-09-13T02:52:18.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.030+0000 7fda74c3b700 1 -- 172.21.15.98:0/4048596502 wait complete. 2024-09-13T02:52:18.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.031+0000 7fda74c3b700 1 Processor -- start 2024-09-13T02:52:18.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.031+0000 7fda74c3b700 1 -- start start 2024-09-13T02:52:18.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.031+0000 7fda74c3b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda70100240 0x7fda70195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:18.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.031+0000 7fda74c3b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70101440 0x7fda70195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:18.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.031+0000 7fda74c3b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70196610 con 0x7fda70101440 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.031+0000 7fda74c3b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70196750 con 0x7fda70100240 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda6dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70101440 0x7fda70195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda6dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70101440 0x7fda70195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37188/0 (socket says 172.21.15.98:37188) 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda6dd9b700 1 -- 172.21.15.98:0/90531963 learned_addr learned my addr 172.21.15.98:0/90531963 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda6e59c700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda70100240 0x7fda70195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda6e59c700 1 -- 172.21.15.98:0/90531963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70101440 msgr2=0x7fda70195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda6e59c700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70101440 0x7fda70195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda6e59c700 1 -- 172.21.15.98:0/90531963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600095f0 con 0x7fda70100240 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda6dd9b700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70101440 0x7fda70195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda6e59c700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda70100240 0x7fda70195ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda60000c00 tx=0x7fda6000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda5f7fe700 1 -- 172.21.15.98:0/90531963 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda6001d070 con 0x7fda70100240 2024-09-13T02:52:18.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda5f7fe700 1 -- 172.21.15.98:0/90531963 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda60005dc0 con 0x7fda70100240 2024-09-13T02:52:18.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7019b1a0 con 0x7fda70100240 2024-09-13T02:52:18.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda5f7fe700 1 -- 172.21.15.98:0/90531963 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda60017400 con 0x7fda70100240 2024-09-13T02:52:18.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.032+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7019b690 con 0x7fda70100240 2024-09-13T02:52:18.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.033+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda70108d90 con 0x7fda70100240 2024-09-13T02:52:18.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.034+0000 7fda5f7fe700 1 -- 172.21.15.98:0/90531963 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7fda6000fa40 con 0x7fda70100240 2024-09-13T02:52:18.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.034+0000 7fda5f7fe700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fda5806d600 0x7fda5806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:18.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.034+0000 7fda5f7fe700 1 -- 172.21.15.98:0/90531963 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fda6008dce0 con 0x7fda70100240 2024-09-13T02:52:18.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.035+0000 7fda6dd9b700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fda5806d600 0x7fda5806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:18.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.035+0000 7fda6dd9b700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fda5806d600 0x7fda5806fab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda64011550 tx=0x7fda64009260 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:18.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.039+0000 7fda5f7fe700 1 -- 172.21.15.98:0/90531963 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fda6005ae70 con 0x7fda70100240 2024-09-13T02:52:18.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:17 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:52:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:17 smithi098 ceph-mon[27886]: mgrmap e25: smithi142.jutrvi(active, since 9s), standbys: smithi098.ukgenf 2024-09-13T02:52:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:17 smithi098 ceph-mon[27886]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:17 smithi098 ceph-mon[27886]: pgmap v8: 65 pgs: 65 active+clean; 160 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 176 op/s 2024-09-13T02:52:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:17 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:52:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:17 smithi142 ceph-mon[33443]: mgrmap e25: smithi142.jutrvi(active, since 9s), standbys: smithi098.ukgenf 2024-09-13T02:52:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:17 smithi142 ceph-mon[33443]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:17 smithi142 ceph-mon[33443]: pgmap v8: 65 pgs: 65 active+clean; 160 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 176 op/s 2024-09-13T02:52:18.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.338+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda70105d90 con 0x7fda5806d600 2024-09-13T02:52:18.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.351+0000 7fda5f7fe700 1 -- 172.21.15.98:0/90531963 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fda70105d90 con 0x7fda5806d600 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (6m) 2m ago 7m 24.6M - 0.25.0 c8568f914cd2 babcc5d689b7 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (8m) 2m ago 8m 7448k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (7m) 3s ago 7m 7306k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (7m) 2m ago 7m 6660k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (7m) 3s ago 7m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (6m) 2m ago 7m 84.7M - 9.4.7 954c08fa6188 6b3b619a7e20 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (2m) 2m ago 2m 18.7M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (2m) 2m ago 2m 18.5M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (2m) 3s ago 2m 12.9M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (2m) 3s ago 2m 16.0M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:52:18.353 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:9283,8765,8443 running (9m) 2m ago 9m 487M - 18.2.0 dc2bc1663786 230c0046ad07 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (27s) 3s ago 6m 479M - 19.1.1-322-g7741f7f9 19dc8d659727 0ffcd7ff6f2c 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (9m) 2m ago 9m 47.6M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (6m) 3s ago 6m 38.4M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 2m ago 7m 15.8M - 1.5.0 0da6a335fe13 5c48ece10527 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (6m) 3s ago 6m 15.0M - 1.5.0 0da6a335fe13 b2fc832c8f17 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (6m) 2m ago 6m 48.2M 3946M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (5m) 2m ago 5m 47.1M 3946M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (5m) 2m ago 5m 44.8M 3946M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (4m) 3s ago 4m 83.8M 4970M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (4m) 3s ago 4m 79.2M 4970M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (3m) 3s ago 3m 73.8M 4970M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:52:18.354 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (6m) 2m ago 7m 60.9M - 2.43.0 a07b618ecd1d fc785e775830 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.354+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fda5806d600 msgr2=0x7fda5806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.354+0000 7fda74c3b700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fda5806d600 0x7fda5806fab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda64011550 tx=0x7fda64009260 comp rx=0 tx=0).stop 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.354+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda70100240 msgr2=0x7fda70195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.354+0000 7fda74c3b700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda70100240 0x7fda70195ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda60000c00 tx=0x7fda6000f690 comp rx=0 tx=0).stop 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.354+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 shutdown_connections 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.354+0000 7fda74c3b700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fda5806d600 0x7fda5806fab0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.354+0000 7fda74c3b700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda70100240 0x7fda70195ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.354+0000 7fda74c3b700 1 --2- 172.21.15.98:0/90531963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda70101440 0x7fda70195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.354+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 >> 172.21.15.98:0/90531963 conn(0x7fda700fb7f0 msgr2=0x7fda70104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.355+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 shutdown_connections 2024-09-13T02:52:18.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.355+0000 7fda74c3b700 1 -- 172.21.15.98:0/90531963 wait complete. 2024-09-13T02:52:18.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.519+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/4236811183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 msgr2=0x7f3ae4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:18.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.519+0000 7f3ae9a3c700 1 --2- 172.21.15.98:0/4236811183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 0x7f3ae4103120 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009910 tx=0x7f3ad4009c20 comp rx=0 tx=0).stop 2024-09-13T02:52:18.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.520+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/4236811183 shutdown_connections 2024-09-13T02:52:18.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.520+0000 7f3ae9a3c700 1 --2- 172.21.15.98:0/4236811183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae4103660 0x7f3ae4105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:18.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.520+0000 7f3ae9a3c700 1 --2- 172.21.15.98:0/4236811183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 0x7f3ae4103120 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:18.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.520+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/4236811183 >> 172.21.15.98:0/4236811183 conn(0x7f3ae40fa700 msgr2=0x7f3ae40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:18.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.520+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/4236811183 shutdown_connections 2024-09-13T02:52:18.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.520+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/4236811183 wait complete. 2024-09-13T02:52:18.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.522+0000 7f3ae9a3c700 1 Processor -- start 2024-09-13T02:52:18.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.522+0000 7f3ae9a3c700 1 -- start start 2024-09-13T02:52:18.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.522+0000 7f3ae9a3c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 0x7f3ae419c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:18.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.522+0000 7f3ae9a3c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae4103660 0x7f3ae419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:18.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.522+0000 7f3ae9a3c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae419cbe0 con 0x7f3ae4100d40 2024-09-13T02:52:18.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.522+0000 7f3ae9a3c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae419cd20 con 0x7f3ae4103660 2024-09-13T02:52:18.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.523+0000 7f3ae2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 0x7f3ae419c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:18.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.523+0000 7f3ae2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 0x7f3ae419c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37218/0 (socket says 172.21.15.98:37218) 2024-09-13T02:52:18.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.523+0000 7f3ae2ffd700 1 -- 172.21.15.98:0/2025014850 learned_addr learned my addr 172.21.15.98:0/2025014850 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:18.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.523+0000 7f3ae2ffd700 1 -- 172.21.15.98:0/2025014850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae4103660 msgr2=0x7f3ae419c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:18.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.523+0000 7f3ae2ffd700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae4103660 0x7f3ae419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:18.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.523+0000 7f3ae2ffd700 1 -- 172.21.15.98:0/2025014850 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad40095f0 con 0x7f3ae4100d40 2024-09-13T02:52:18.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.523+0000 7f3ae2ffd700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 0x7f3ae419c080 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4006010 tx=0x7f3ad400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:18.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.524+0000 7f3ae8a3a700 1 -- 172.21.15.98:0/2025014850 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad401d070 con 0x7f3ae4100d40 2024-09-13T02:52:18.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.524+0000 7f3ae8a3a700 1 -- 172.21.15.98:0/2025014850 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ad400f460 con 0x7f3ae4100d40 2024-09-13T02:52:18.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.524+0000 7f3ae8a3a700 1 -- 172.21.15.98:0/2025014850 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad4022650 con 0x7f3ae4100d40 2024-09-13T02:52:18.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.524+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae41a1770 con 0x7f3ae4100d40 2024-09-13T02:52:18.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.524+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae41a1c10 con 0x7f3ae4100d40 2024-09-13T02:52:18.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.525+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae40fc2c0 con 0x7f3ae4100d40 2024-09-13T02:52:18.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.526+0000 7f3ae8a3a700 1 -- 172.21.15.98:0/2025014850 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f3ad400f5d0 con 0x7f3ae4100d40 2024-09-13T02:52:18.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.527+0000 7f3ae8a3a700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f3acc06d630 0x7f3acc06fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:18.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.527+0000 7f3ae8a3a700 1 -- 172.21.15.98:0/2025014850 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f3ad408e1c0 con 0x7f3ae4100d40 2024-09-13T02:52:18.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.527+0000 7f3ae27fc700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f3acc06d630 0x7f3acc06fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:18.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.528+0000 7f3ae27fc700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f3acc06d630 0x7f3acc06fae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8005950 tx=0x7f3ad80058e0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:18.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.534+0000 7f3ae8a3a700 1 -- 172.21.15.98:0/2025014850 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f3ad405b3d0 con 0x7f3ae4100d40 2024-09-13T02:52:19.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.998+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ae402ce80 con 0x7f3ae4100d40 2024-09-13T02:52:19.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:18.999+0000 7f3ae8a3a700 1 -- 172.21.15.98:0/2025014850 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7f3ad4057070 con 0x7f3ae4100d40 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:52:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:52:19.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.002+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f3acc06d630 msgr2=0x7f3acc06fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:19.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.002+0000 7f3ae9a3c700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f3acc06d630 0x7f3acc06fae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8005950 tx=0x7f3ad80058e0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.002+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 msgr2=0x7f3ae419c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:19.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.002+0000 7f3ae9a3c700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 0x7f3ae419c080 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4006010 tx=0x7f3ad400be20 comp rx=0 tx=0).stop 2024-09-13T02:52:19.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.002+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 shutdown_connections 2024-09-13T02:52:19.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.002+0000 7f3ae9a3c700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f3acc06d630 0x7f3acc06fae0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.002+0000 7f3ae9a3c700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ae4100d40 0x7f3ae419c080 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.002+0000 7f3ae9a3c700 1 --2- 172.21.15.98:0/2025014850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ae4103660 0x7f3ae419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.002+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 >> 172.21.15.98:0/2025014850 conn(0x7f3ae40fa700 msgr2=0x7f3ae41042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:19.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.003+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 shutdown_connections 2024-09-13T02:52:19.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.003+0000 7f3ae9a3c700 1 -- 172.21.15.98:0/2025014850 wait complete. 2024-09-13T02:52:19.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 -- 172.21.15.98:0/3129409782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1190100340 msgr2=0x7f1190100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 --2- 172.21.15.98:0/3129409782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1190100340 0x7f1190100790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1180009910 tx=0x7f1180009c20 comp rx=0 tx=0).stop 2024-09-13T02:52:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 -- 172.21.15.98:0/3129409782 shutdown_connections 2024-09-13T02:52:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 --2- 172.21.15.98:0/3129409782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1190100340 0x7f1190100790 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 --2- 172.21.15.98:0/3129409782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11900ff140 0x7f11900ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 -- 172.21.15.98:0/3129409782 >> 172.21.15.98:0/3129409782 conn(0x7f11900fa6d0 msgr2=0x7f11900fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 -- 172.21.15.98:0/3129409782 shutdown_connections 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 -- 172.21.15.98:0/3129409782 wait complete. 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 Processor -- start 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.165+0000 7f11968af700 1 -- start start 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.166+0000 7f11968af700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11900ff140 0x7f1190071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.166+0000 7f11968af700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1190100340 0x7f1190072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.166+0000 7f11968af700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900728a0 con 0x7f11900ff140 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.166+0000 7f11968af700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900729e0 con 0x7f1190100340 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.166+0000 7f118ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11900ff140 0x7f1190071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.166+0000 7f118ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11900ff140 0x7f1190071d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37234/0 (socket says 172.21.15.98:37234) 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.166+0000 7f118ffff700 1 -- 172.21.15.98:0/208709750 learned_addr learned my addr 172.21.15.98:0/208709750 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:19.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.166+0000 7f118f7fe700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1190100340 0x7f1190072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f118f7fe700 1 -- 172.21.15.98:0/208709750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11900ff140 msgr2=0x7f1190071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f118f7fe700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11900ff140 0x7f1190071d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f118f7fe700 1 -- 172.21.15.98:0/208709750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800095f0 con 0x7f1190100340 2024-09-13T02:52:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f118ffff700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11900ff140 0x7f1190071d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:52:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f118f7fe700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1190100340 0x7f1190072280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1180000c00 tx=0x7f118000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f118d7fa700 1 -- 172.21.15.98:0/208709750 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118001d070 con 0x7f1190100340 2024-09-13T02:52:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1190068f10 con 0x7f1190100340 2024-09-13T02:52:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f118d7fa700 1 -- 172.21.15.98:0/208709750 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1180005dc0 con 0x7f1190100340 2024-09-13T02:52:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f118d7fa700 1 -- 172.21.15.98:0/208709750 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1180021410 con 0x7f1190100340 2024-09-13T02:52:19.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.167+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1190069400 con 0x7f1190100340 2024-09-13T02:52:19.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.169+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1190107c90 con 0x7f1190100340 2024-09-13T02:52:19.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.169+0000 7f118d7fa700 1 -- 172.21.15.98:0/208709750 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f1180003a60 con 0x7f1190100340 2024-09-13T02:52:19.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.170+0000 7f118d7fa700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f117c06d5f0 0x7f117c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:19.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.170+0000 7f118d7fa700 1 -- 172.21.15.98:0/208709750 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f118008dfe0 con 0x7f1190100340 2024-09-13T02:52:19.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.170+0000 7f118ffff700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f117c06d5f0 0x7f117c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:19.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.171+0000 7f118ffff700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f117c06d5f0 0x7f117c06faa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f11780105c0 tx=0x7f117800b4a0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:19.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.176+0000 7f118d7fa700 1 -- 172.21.15.98:0/208709750 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f118005b1b0 con 0x7f1190100340 2024-09-13T02:52:19.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.581+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1190104c90 con 0x7f117c06d5f0 2024-09-13T02:52:19.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.582+0000 7f118d7fa700 1 -- 172.21.15.98:0/208709750 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f1190104c90 con 0x7f117c06d5f0 2024-09-13T02:52:19.584 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:52:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:52:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:52:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T02:52:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [], 2024-09-13T02:52:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "1/2 daemons upgraded", 2024-09-13T02:52:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "", 2024-09-13T02:52:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:52:19.585 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:52:19.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.585+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f117c06d5f0 msgr2=0x7f117c06faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.585+0000 7f11968af700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f117c06d5f0 0x7f117c06faa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f11780105c0 tx=0x7f117800b4a0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.585+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1190100340 msgr2=0x7f1190072280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.585+0000 7f11968af700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1190100340 0x7f1190072280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1180000c00 tx=0x7f118000bd70 comp rx=0 tx=0).stop 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.586+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 shutdown_connections 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.586+0000 7f11968af700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f117c06d5f0 0x7f117c06faa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.586+0000 7f11968af700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11900ff140 0x7f1190071d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.586+0000 7f11968af700 1 --2- 172.21.15.98:0/208709750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1190100340 0x7f1190072280 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.586+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 >> 172.21.15.98:0/208709750 conn(0x7f11900fa6d0 msgr2=0x7f1190103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.586+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 shutdown_connections 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:19.586+0000 7f11968af700 1 -- 172.21.15.98:0/208709750 wait complete. 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2025014850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:19 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:19.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2025014850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:19 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:20.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:20 smithi142 ceph-mon[33443]: pgmap v9: 65 pgs: 65 active+clean; 173 MiB data, 741 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 319 op/s 2024-09-13T02:52:20.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:20 smithi142 ceph-mon[33443]: Adjusting osd_memory_target on smithi098 to 1216M 2024-09-13T02:52:20.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:20 smithi142 ceph-mon[33443]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:20.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:20 smithi098 ceph-mon[27886]: pgmap v9: 65 pgs: 65 active+clean; 173 MiB data, 741 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 319 op/s 2024-09-13T02:52:20.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:20 smithi098 ceph-mon[27886]: Adjusting osd_memory_target on smithi098 to 1216M 2024-09-13T02:52:20.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:20 smithi098 ceph-mon[27886]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:21.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:21.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:21.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:21.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:21.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:21.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:21.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:21.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:21.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: Adjusting osd_memory_target on smithi142 to 2240M 2024-09-13T02:52:21.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:21.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:21.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:21.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-13T02:52:21.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:21 smithi098 ceph-mon[27886]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-13T02:52:22.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:22.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: Adjusting osd_memory_target on smithi142 to 2240M 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-13T02:52:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:21 smithi142 ceph-mon[33443]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-13T02:52:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: pgmap v10: 65 pgs: 65 active+clean; 173 MiB data, 741 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 292 op/s 2024-09-13T02:52:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:22.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:23.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: pgmap v10: 65 pgs: 65 active+clean; 173 MiB data, 741 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 292 op/s 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:23.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:23.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:24.195 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:23 smithi098 ceph-mon[27886]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:24.196 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:23 smithi098 ceph-mon[27886]: Reconfiguring prometheus.smithi098 (dependencies changed)... 2024-09-13T02:52:24.196 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:23 smithi098 ceph-mon[27886]: Reconfiguring daemon prometheus.smithi098 on smithi098 2024-09-13T02:52:24.196 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:23 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:23 smithi142 ceph-mon[33443]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:23 smithi142 ceph-mon[33443]: Reconfiguring prometheus.smithi098 (dependencies changed)... 2024-09-13T02:52:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:23 smithi142 ceph-mon[33443]: Reconfiguring daemon prometheus.smithi098 on smithi098 2024-09-13T02:52:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:23 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:25.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:24 smithi142 ceph-mon[33443]: pgmap v11: 65 pgs: 65 active+clean; 177 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 355 op/s 2024-09-13T02:52:25.013 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:24 smithi098 ceph-mon[27886]: pgmap v11: 65 pgs: 65 active+clean; 177 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 355 op/s 2024-09-13T02:52:26.061 INFO:tasks.workunit.client.1.smithi142.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T02:52:26.066 INFO:tasks.workunit.client.1.smithi142.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:52:26.066 INFO:tasks.workunit.client.1.smithi142.stderr:+ make 2024-09-13T02:52:26.497 INFO:tasks.workunit.client.1.smithi142.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T02:52:26.881 INFO:tasks.workunit.client.1.smithi142.stderr:++ readlink -f fsstress 2024-09-13T02:52:26.883 INFO:tasks.workunit.client.1.smithi142.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T02:52:26.883 INFO:tasks.workunit.client.1.smithi142.stderr:+ popd 2024-09-13T02:52:26.884 INFO:tasks.workunit.client.1.smithi142.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:52:26.884 INFO:tasks.workunit.client.1.smithi142.stderr:+ popd 2024-09-13T02:52:26.885 INFO:tasks.workunit.client.1.smithi142.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:52:26.885 INFO:tasks.workunit.client.1.smithi142.stderr:++ mktemp -d -p . 2024-09-13T02:52:26.887 INFO:tasks.workunit.client.1.smithi142.stderr:+ T=./tmp.zW5d2o33f4 2024-09-13T02:52:26.888 INFO:tasks.workunit.client.1.smithi142.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.zW5d2o33f4 -l 1 -n 1000 -p 10 -v 2024-09-13T02:52:26.890 INFO:tasks.workunit.client.1.smithi142.stdout:seed = 1726889902 2024-09-13T02:52:26.895 INFO:tasks.workunit.client.1.smithi142.stdout:1/0: link - no file 2024-09-13T02:52:26.896 INFO:tasks.workunit.client.1.smithi142.stdout:1/1: write - no filename 2024-09-13T02:52:26.896 INFO:tasks.workunit.client.1.smithi142.stdout:1/2: fsync - no filename 2024-09-13T02:52:26.897 INFO:tasks.workunit.client.1.smithi142.stdout:1/3: getdents . 0 2024-09-13T02:52:26.898 INFO:tasks.workunit.client.1.smithi142.stdout:1/4: chown . 0 1 2024-09-13T02:52:26.898 INFO:tasks.workunit.client.1.smithi142.stdout:1/5: chown . 249745 1 2024-09-13T02:52:26.900 INFO:tasks.workunit.client.1.smithi142.stdout:1/6: mknod c0 0 2024-09-13T02:52:26.900 INFO:tasks.workunit.client.1.smithi142.stdout:1/7: rmdir - no directory 2024-09-13T02:52:26.901 INFO:tasks.workunit.client.1.smithi142.stdout:4/0: write - no filename 2024-09-13T02:52:26.901 INFO:tasks.workunit.client.1.smithi142.stdout:4/1: rename - no filename 2024-09-13T02:52:26.901 INFO:tasks.workunit.client.1.smithi142.stdout:4/2: fdatasync - no filename 2024-09-13T02:52:26.901 INFO:tasks.workunit.client.1.smithi142.stdout:4/3: stat - no entries 2024-09-13T02:52:26.902 INFO:tasks.workunit.client.1.smithi142.stdout:3/0: mknod c0 0 2024-09-13T02:52:26.902 INFO:tasks.workunit.client.1.smithi142.stdout:3/1: dwrite - no filename 2024-09-13T02:52:26.902 INFO:tasks.workunit.client.1.smithi142.stdout:3/2: chown c0 385456 1 2024-09-13T02:52:26.902 INFO:tasks.workunit.client.1.smithi142.stdout:3/3: chown c0 96546932 1 2024-09-13T02:52:26.903 INFO:tasks.workunit.client.1.smithi142.stdout:3/4: chown c0 1419756275 1 2024-09-13T02:52:26.903 INFO:tasks.workunit.client.1.smithi142.stdout:3/5: write - no filename 2024-09-13T02:52:26.903 INFO:tasks.workunit.client.1.smithi142.stdout:3/6: rmdir - no directory 2024-09-13T02:52:26.904 INFO:tasks.workunit.client.1.smithi142.stdout:3/7: rename c0 to c1 0 2024-09-13T02:52:26.905 INFO:tasks.workunit.client.1.smithi142.stdout:4/4: mkdir d0 0 2024-09-13T02:52:26.905 INFO:tasks.workunit.client.1.smithi142.stdout:4/5: rename d0 to d0/d1 22 2024-09-13T02:52:26.907 INFO:tasks.workunit.client.1.smithi142.stdout:3/8: symlink l2 0 2024-09-13T02:52:26.908 INFO:tasks.workunit.client.1.smithi142.stdout:5/0: getdents . 0 2024-09-13T02:52:26.909 INFO:tasks.workunit.client.1.smithi142.stdout:7/0: readlink - no filename 2024-09-13T02:52:26.909 INFO:tasks.workunit.client.1.smithi142.stdout:7/1: dread - no filename 2024-09-13T02:52:26.910 INFO:tasks.workunit.client.1.smithi142.stdout:4/6: creat d0/f2 x:0 0 0 2024-09-13T02:52:26.911 INFO:tasks.workunit.client.1.smithi142.stdout:3/9: mknod c3 0 2024-09-13T02:52:26.911 INFO:tasks.workunit.client.1.smithi142.stdout:3/10: dwrite - no filename 2024-09-13T02:52:26.911 INFO:tasks.workunit.client.1.smithi142.stdout:3/11: truncate - no filename 2024-09-13T02:52:26.911 INFO:tasks.workunit.client.1.smithi142.stdout:3/12: dwrite - no filename 2024-09-13T02:52:26.911 INFO:tasks.workunit.client.1.smithi142.stdout:4/7: dread - d0/f2 zero size 2024-09-13T02:52:26.912 INFO:tasks.workunit.client.1.smithi142.stdout:6/0: mknod c0 0 2024-09-13T02:52:26.913 INFO:tasks.workunit.client.1.smithi142.stdout:8/0: dwrite - no filename 2024-09-13T02:52:26.914 INFO:tasks.workunit.client.1.smithi142.stdout:8/1: stat - no entries 2024-09-13T02:52:26.914 INFO:tasks.workunit.client.1.smithi142.stdout:8/2: dread - no filename 2024-09-13T02:52:26.914 INFO:tasks.workunit.client.1.smithi142.stdout:8/3: chown . 79912497 1 2024-09-13T02:52:26.914 INFO:tasks.workunit.client.1.smithi142.stdout:8/4: chown . 51 1 2024-09-13T02:52:26.914 INFO:tasks.workunit.client.1.smithi142.stdout:8/5: chown . 421540618 1 2024-09-13T02:52:26.915 INFO:tasks.workunit.client.1.smithi142.stdout:5/1: creat f0 x:0 0 0 2024-09-13T02:52:26.915 INFO:tasks.workunit.client.1.smithi142.stdout:5/2: readlink - no filename 2024-09-13T02:52:26.916 INFO:tasks.workunit.client.1.smithi142.stdout:3/13: unlink l2 0 2024-09-13T02:52:26.916 INFO:tasks.workunit.client.1.smithi142.stdout:3/14: write - no filename 2024-09-13T02:52:26.916 INFO:tasks.workunit.client.1.smithi142.stdout:3/15: fdatasync - no filename 2024-09-13T02:52:26.916 INFO:tasks.workunit.client.1.smithi142.stdout:3/16: truncate - no filename 2024-09-13T02:52:26.916 INFO:tasks.workunit.client.1.smithi142.stdout:3/17: dwrite - no filename 2024-09-13T02:52:26.917 INFO:tasks.workunit.client.1.smithi142.stdout:6/1: mkdir d1 0 2024-09-13T02:52:26.917 INFO:tasks.workunit.client.1.smithi142.stdout:6/2: write - no filename 2024-09-13T02:52:26.917 INFO:tasks.workunit.client.1.smithi142.stdout:6/3: rename d1 to d1/d2 22 2024-09-13T02:52:26.918 INFO:tasks.workunit.client.1.smithi142.stdout:6/4: write - no filename 2024-09-13T02:52:26.918 INFO:tasks.workunit.client.1.smithi142.stdout:7/2: symlink l0 0 2024-09-13T02:52:26.919 INFO:tasks.workunit.client.1.smithi142.stdout:4/8: dwrite d0/f2 [0,4194304] 0 2024-09-13T02:52:26.921 INFO:tasks.workunit.client.1.smithi142.stdout:5/3: mknod c1 0 2024-09-13T02:52:26.921 INFO:tasks.workunit.client.1.smithi142.stdout:5/4: chown c1 323 1 2024-09-13T02:52:26.921 INFO:tasks.workunit.client.1.smithi142.stdout:3/18: symlink l4 0 2024-09-13T02:52:26.923 INFO:tasks.workunit.client.1.smithi142.stdout:8/6: mkdir d0 0 2024-09-13T02:52:26.923 INFO:tasks.workunit.client.1.smithi142.stdout:8/7: chown d0 93 1 2024-09-13T02:52:26.925 INFO:tasks.workunit.client.1.smithi142.stdout:4/9: mkdir d0/d3 0 2024-09-13T02:52:26.926 INFO:tasks.workunit.client.1.smithi142.stdout:5/5: mknod c2 0 2024-09-13T02:52:26.926 INFO:tasks.workunit.client.1.smithi142.stdout:5/6: dread - f0 zero size 2024-09-13T02:52:26.927 INFO:tasks.workunit.client.1.smithi142.stdout:6/5: symlink d1/l3 0 2024-09-13T02:52:26.928 INFO:tasks.workunit.client.1.smithi142.stdout:9/0: mknod c0 0 2024-09-13T02:52:26.932 INFO:tasks.workunit.client.1.smithi142.stdout:5/7: creat f3 x:0 0 0 2024-09-13T02:52:26.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/6: mkdir d1/d4 0 2024-09-13T02:52:26.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/7: dread - no filename 2024-09-13T02:52:26.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/8: read - no filename 2024-09-13T02:52:26.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/9: dread - no filename 2024-09-13T02:52:26.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/10: dwrite - no filename 2024-09-13T02:52:26.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/11: write - no filename 2024-09-13T02:52:26.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/12: dread - no filename 2024-09-13T02:52:26.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/13: rename d1 to d1/d4/d5 22 2024-09-13T02:52:26.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/14: dread - no filename 2024-09-13T02:52:26.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/15: stat c0 0 2024-09-13T02:52:26.936 INFO:tasks.workunit.client.1.smithi142.stdout:9/1: symlink l1 0 2024-09-13T02:52:26.936 INFO:tasks.workunit.client.1.smithi142.stdout:9/2: readlink l1 0 2024-09-13T02:52:26.937 INFO:tasks.workunit.client.1.smithi142.stdout:8/8: mkdir d0/d1 0 2024-09-13T02:52:26.937 INFO:tasks.workunit.client.1.smithi142.stdout:8/9: chown d0 2306 1 2024-09-13T02:52:26.939 INFO:tasks.workunit.client.1.smithi142.stdout:4/10: creat d0/d3/f4 x:0 0 0 2024-09-13T02:52:26.940 INFO:tasks.workunit.client.1.smithi142.stdout:5/8: creat f4 x:0 0 0 2024-09-13T02:52:26.941 INFO:tasks.workunit.client.1.smithi142.stdout:5/9: truncate f4 958801 0 2024-09-13T02:52:26.942 INFO:tasks.workunit.client.1.smithi142.stdout:6/16: unlink d1/l3 0 2024-09-13T02:52:26.942 INFO:tasks.workunit.client.1.smithi142.stdout:4/11: dread d0/f2 [0,4194304] 0 2024-09-13T02:52:26.947 INFO:tasks.workunit.client.1.smithi142.stdout:5/10: creat f5 x:0 0 0 2024-09-13T02:52:26.947 INFO:tasks.workunit.client.1.smithi142.stdout:6/17: mknod d1/c6 0 2024-09-13T02:52:26.947 INFO:tasks.workunit.client.1.smithi142.stdout:6/18: truncate - no filename 2024-09-13T02:52:26.947 INFO:tasks.workunit.client.1.smithi142.stdout:6/19: dread - no filename 2024-09-13T02:52:26.948 INFO:tasks.workunit.client.1.smithi142.stdout:4/12: creat d0/d3/f5 x:0 0 0 2024-09-13T02:52:26.951 INFO:tasks.workunit.client.1.smithi142.stdout:5/11: symlink l6 0 2024-09-13T02:52:26.951 INFO:tasks.workunit.client.1.smithi142.stdout:5/12: dread - f5 zero size 2024-09-13T02:52:26.951 INFO:tasks.workunit.client.1.smithi142.stdout:6/20: mkdir d1/d7 0 2024-09-13T02:52:26.952 INFO:tasks.workunit.client.1.smithi142.stdout:6/21: truncate - no filename 2024-09-13T02:52:26.953 INFO:tasks.workunit.client.1.smithi142.stdout:4/13: unlink d0/f2 0 2024-09-13T02:52:26.954 INFO:tasks.workunit.client.1.smithi142.stdout:4/14: readlink - no filename 2024-09-13T02:52:26.955 INFO:tasks.workunit.client.1.smithi142.stdout:5/13: mknod c7 0 2024-09-13T02:52:26.958 INFO:tasks.workunit.client.1.smithi142.stdout:6/22: mknod d1/d4/c8 0 2024-09-13T02:52:26.958 INFO:tasks.workunit.client.1.smithi142.stdout:6/23: truncate - no filename 2024-09-13T02:52:26.959 INFO:tasks.workunit.client.1.smithi142.stdout:6/24: rmdir d1/d4 39 2024-09-13T02:52:26.959 INFO:tasks.workunit.client.1.smithi142.stdout:6/25: dwrite - no filename 2024-09-13T02:52:26.959 INFO:tasks.workunit.client.1.smithi142.stdout:6/26: dread - no filename 2024-09-13T02:52:26.960 INFO:tasks.workunit.client.1.smithi142.stdout:6/27: dwrite - no filename 2024-09-13T02:52:26.960 INFO:tasks.workunit.client.1.smithi142.stdout:6/28: write - no filename 2024-09-13T02:52:26.960 INFO:tasks.workunit.client.1.smithi142.stdout:6/29: dwrite - no filename 2024-09-13T02:52:26.962 INFO:tasks.workunit.client.1.smithi142.stdout:5/14: dwrite f0 [0,4194304] 0 2024-09-13T02:52:26.962 INFO:tasks.workunit.client.1.smithi142.stdout:6/30: creat d1/d7/f9 x:0 0 0 2024-09-13T02:52:26.963 INFO:tasks.workunit.client.1.smithi142.stdout:6/31: truncate d1/d7/f9 1012067 0 2024-09-13T02:52:26.964 INFO:tasks.workunit.client.1.smithi142.stdout:5/15: mkdir d8 0 2024-09-13T02:52:26.964 INFO:tasks.workunit.client.1.smithi142.stdout:5/16: dread - f3 zero size 2024-09-13T02:52:26.965 INFO:tasks.workunit.client.1.smithi142.stdout:5/17: fdatasync f4 0 2024-09-13T02:52:26.970 INFO:tasks.workunit.client.1.smithi142.stdout:5/18: symlink d8/l9 0 2024-09-13T02:52:26.970 INFO:tasks.workunit.client.1.smithi142.stdout:5/19: read f4 [563377,68128] 0 2024-09-13T02:52:26.978 INFO:tasks.workunit.client.1.smithi142.stdout:5/20: dwrite f3 [0,4194304] 0 2024-09-13T02:52:26.979 INFO:tasks.workunit.client.1.smithi142.stdout:5/21: read f3 [1077980,77029] 0 2024-09-13T02:52:26.979 INFO:tasks.workunit.client.1.smithi142.stdout:5/22: chown f5 43754 1 2024-09-13T02:52:26.981 INFO:tasks.workunit.client.1.smithi142.stdout:5/23: rmdir d8 39 2024-09-13T02:52:26.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:26 smithi098 ceph-mon[27886]: pgmap v12: 65 pgs: 65 active+clean; 196 MiB data, 788 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 430 op/s 2024-09-13T02:52:27.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:26 smithi142 ceph-mon[33443]: pgmap v12: 65 pgs: 65 active+clean; 196 MiB data, 788 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 430 op/s 2024-09-13T02:52:27.310 INFO:tasks.workunit.client.1.smithi142.stdout:3/19: getdents . 0 2024-09-13T02:52:27.319 INFO:tasks.workunit.client.1.smithi142.stdout:6/32: chown d1/d4/c8 1045 1 2024-09-13T02:52:27.321 INFO:tasks.workunit.client.1.smithi142.stdout:9/3: getdents . 0 2024-09-13T02:52:27.321 INFO:tasks.workunit.client.1.smithi142.stdout:9/4: write - no filename 2024-09-13T02:52:27.333 INFO:tasks.workunit.client.1.smithi142.stdout:3/20: mknod c5 0 2024-09-13T02:52:27.335 INFO:tasks.workunit.client.1.smithi142.stdout:6/33: symlink d1/d7/la 0 2024-09-13T02:52:27.339 INFO:tasks.workunit.client.1.smithi142.stdout:3/21: rename l4 to l6 0 2024-09-13T02:52:27.339 INFO:tasks.workunit.client.1.smithi142.stdout:3/22: fsync - no filename 2024-09-13T02:52:27.339 INFO:tasks.workunit.client.1.smithi142.stdout:3/23: dread - no filename 2024-09-13T02:52:27.339 INFO:tasks.workunit.client.1.smithi142.stdout:3/24: write - no filename 2024-09-13T02:52:27.340 INFO:tasks.workunit.client.1.smithi142.stdout:3/25: chown c5 477518 1 2024-09-13T02:52:27.342 INFO:tasks.workunit.client.1.smithi142.stdout:6/34: dwrite d1/d7/f9 [0,4194304] 0 2024-09-13T02:52:27.343 INFO:tasks.workunit.client.1.smithi142.stdout:9/5: link l1 l2 0 2024-09-13T02:52:27.343 INFO:tasks.workunit.client.1.smithi142.stdout:9/6: dwrite - no filename 2024-09-13T02:52:27.344 INFO:tasks.workunit.client.1.smithi142.stdout:9/7: dread - no filename 2024-09-13T02:52:27.345 INFO:tasks.workunit.client.1.smithi142.stdout:6/35: mknod d1/d7/cb 0 2024-09-13T02:52:27.347 INFO:tasks.workunit.client.1.smithi142.stdout:9/8: creat f3 x:0 0 0 2024-09-13T02:52:27.347 INFO:tasks.workunit.client.1.smithi142.stdout:9/9: fdatasync f3 0 2024-09-13T02:52:27.348 INFO:tasks.workunit.client.1.smithi142.stdout:9/10: write f3 [393955,93099] 0 2024-09-13T02:52:27.348 INFO:tasks.workunit.client.1.smithi142.stdout:5/24: chown d8 30236708 1 2024-09-13T02:52:27.349 INFO:tasks.workunit.client.1.smithi142.stdout:5/25: fsync f5 0 2024-09-13T02:52:27.349 INFO:tasks.workunit.client.1.smithi142.stdout:9/11: stat f3 0 2024-09-13T02:52:27.349 INFO:tasks.workunit.client.1.smithi142.stdout:6/36: symlink d1/lc 0 2024-09-13T02:52:27.350 INFO:tasks.workunit.client.1.smithi142.stdout:6/37: stat d1 0 2024-09-13T02:52:27.350 INFO:tasks.workunit.client.1.smithi142.stdout:6/38: write d1/d7/f9 [2641023,40543] 0 2024-09-13T02:52:27.352 INFO:tasks.workunit.client.1.smithi142.stdout:9/12: creat f4 x:0 0 0 2024-09-13T02:52:27.357 INFO:tasks.workunit.client.1.smithi142.stdout:9/13: unlink c0 0 2024-09-13T02:52:27.360 INFO:tasks.workunit.client.1.smithi142.stdout:6/39: mkdir d1/dd 0 2024-09-13T02:52:27.361 INFO:tasks.workunit.client.1.smithi142.stdout:5/26: link l6 d8/la 0 2024-09-13T02:52:27.361 INFO:tasks.workunit.client.1.smithi142.stdout:5/27: read f3 [1284184,82546] 0 2024-09-13T02:52:27.362 INFO:tasks.workunit.client.1.smithi142.stdout:5/28: stat d8 0 2024-09-13T02:52:27.364 INFO:tasks.workunit.client.1.smithi142.stdout:6/40: symlink d1/dd/le 0 2024-09-13T02:52:27.365 INFO:tasks.workunit.client.1.smithi142.stdout:6/41: fdatasync d1/d7/f9 0 2024-09-13T02:52:27.369 INFO:tasks.workunit.client.1.smithi142.stdout:6/42: mknod d1/cf 0 2024-09-13T02:52:27.374 INFO:tasks.workunit.client.1.smithi142.stdout:6/43: dwrite d1/d7/f9 [0,4194304] 0 2024-09-13T02:52:27.375 INFO:tasks.workunit.client.1.smithi142.stdout:6/44: readlink d1/lc 0 2024-09-13T02:52:27.379 INFO:tasks.workunit.client.1.smithi142.stdout:6/45: creat d1/f10 x:0 0 0 2024-09-13T02:52:27.385 INFO:tasks.workunit.client.1.smithi142.stdout:6/46: dwrite d1/f10 [0,4194304] 0 2024-09-13T02:52:27.387 INFO:tasks.workunit.client.1.smithi142.stdout:6/47: read d1/f10 [236909,103330] 0 2024-09-13T02:52:27.390 INFO:tasks.workunit.client.1.smithi142.stdout:6/48: rename d1/cf to d1/dd/c11 0 2024-09-13T02:52:27.527 INFO:tasks.workunit.client.1.smithi142.stdout:3/26: readlink l6 0 2024-09-13T02:52:27.531 INFO:tasks.workunit.client.1.smithi142.stdout:3/27: link l6 l7 0 2024-09-13T02:52:27.532 INFO:tasks.workunit.client.1.smithi142.stdout:3/28: mknod c8 0 2024-09-13T02:52:27.534 INFO:tasks.workunit.client.1.smithi142.stdout:3/29: rename c1 to c9 0 2024-09-13T02:52:27.535 INFO:tasks.workunit.client.1.smithi142.stdout:3/30: dread - no filename 2024-09-13T02:52:27.535 INFO:tasks.workunit.client.1.smithi142.stdout:3/31: dread - no filename 2024-09-13T02:52:27.536 INFO:tasks.workunit.client.1.smithi142.stdout:9/14: getdents . 0 2024-09-13T02:52:27.537 INFO:tasks.workunit.client.1.smithi142.stdout:3/32: symlink la 0 2024-09-13T02:52:27.540 INFO:tasks.workunit.client.1.smithi142.stdout:3/33: mknod cb 0 2024-09-13T02:52:27.543 INFO:tasks.workunit.client.1.smithi142.stdout:9/15: dwrite f3 [0,4194304] 0 2024-09-13T02:52:27.543 INFO:tasks.workunit.client.1.smithi142.stdout:3/34: creat fc x:0 0 0 2024-09-13T02:52:27.544 INFO:tasks.workunit.client.1.smithi142.stdout:6/49: truncate d1/f10 2927263 0 2024-09-13T02:52:27.547 INFO:tasks.workunit.client.1.smithi142.stdout:3/35: symlink ld 0 2024-09-13T02:52:27.554 INFO:tasks.workunit.client.1.smithi142.stdout:6/50: creat d1/f12 x:0 0 0 2024-09-13T02:52:27.554 INFO:tasks.workunit.client.1.smithi142.stdout:6/51: stat d1/d7/la 0 2024-09-13T02:52:27.558 INFO:tasks.workunit.client.1.smithi142.stdout:6/52: creat d1/d4/f13 x:0 0 0 2024-09-13T02:52:27.558 INFO:tasks.workunit.client.1.smithi142.stdout:6/53: write d1/f12 [890476,85050] 0 2024-09-13T02:52:27.566 INFO:tasks.workunit.client.1.smithi142.stdout:9/16: fdatasync f3 0 2024-09-13T02:52:27.572 INFO:tasks.workunit.client.1.smithi142.stdout:9/17: dwrite f4 [0,4194304] 0 2024-09-13T02:52:27.595 INFO:tasks.workunit.client.1.smithi142.stdout:3/36: getdents . 0 2024-09-13T02:52:27.597 INFO:tasks.workunit.client.1.smithi142.stdout:6/54: fsync d1/f12 0 2024-09-13T02:52:27.597 INFO:tasks.workunit.client.1.smithi142.stdout:3/37: getdents . 0 2024-09-13T02:52:27.598 INFO:tasks.workunit.client.1.smithi142.stdout:6/55: write d1/f12 [640678,73036] 0 2024-09-13T02:52:27.600 INFO:tasks.workunit.client.1.smithi142.stdout:3/38: creat fe x:0 0 0 2024-09-13T02:52:27.602 INFO:tasks.workunit.client.1.smithi142.stdout:6/56: dread d1/d7/f9 [0,4194304] 0 2024-09-13T02:52:27.603 INFO:tasks.workunit.client.0.smithi098.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T02:52:27.604 INFO:tasks.workunit.client.1.smithi142.stdout:3/39: unlink la 0 2024-09-13T02:52:27.604 INFO:tasks.workunit.client.1.smithi142.stdout:3/40: dread - fe zero size 2024-09-13T02:52:27.605 INFO:tasks.workunit.client.1.smithi142.stdout:6/57: symlink d1/dd/l14 0 2024-09-13T02:52:27.606 INFO:tasks.workunit.client.1.smithi142.stdout:6/58: truncate d1/d4/f13 836654 0 2024-09-13T02:52:27.607 INFO:tasks.workunit.client.1.smithi142.stdout:3/41: symlink lf 0 2024-09-13T02:52:27.609 INFO:tasks.workunit.client.1.smithi142.stdout:6/59: unlink d1/f12 0 2024-09-13T02:52:27.610 INFO:tasks.workunit.client.1.smithi142.stdout:3/42: readlink l6 0 2024-09-13T02:52:27.611 INFO:tasks.workunit.client.0.smithi098.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:52:27.611 INFO:tasks.workunit.client.0.smithi098.stderr:+ make 2024-09-13T02:52:27.616 INFO:tasks.workunit.client.1.smithi142.stdout:3/43: unlink c9 0 2024-09-13T02:52:27.616 INFO:tasks.workunit.client.1.smithi142.stdout:3/44: mknod c10 0 2024-09-13T02:52:27.618 INFO:tasks.workunit.client.1.smithi142.stdout:6/60: dwrite d1/d7/f9 [4194304,4194304] 0 2024-09-13T02:52:27.618 INFO:tasks.workunit.client.1.smithi142.stdout:3/45: symlink l11 0 2024-09-13T02:52:27.618 INFO:tasks.workunit.client.1.smithi142.stdout:3/46: rmdir - no directory 2024-09-13T02:52:27.622 INFO:tasks.workunit.client.1.smithi142.stdout:6/61: creat d1/d4/f15 x:0 0 0 2024-09-13T02:52:27.623 INFO:tasks.workunit.client.1.smithi142.stdout:6/62: chown d1/d7/f9 69899 1 2024-09-13T02:52:27.625 INFO:tasks.workunit.client.1.smithi142.stdout:3/47: mkdir d12 0 2024-09-13T02:52:27.628 INFO:tasks.workunit.client.1.smithi142.stdout:6/63: write d1/f10 [1159762,120308] 0 2024-09-13T02:52:27.633 INFO:tasks.workunit.client.1.smithi142.stdout:3/48: dwrite fc [0,4194304] 0 2024-09-13T02:52:27.634 INFO:tasks.workunit.client.1.smithi142.stdout:3/49: write fc [1289435,46462] 0 2024-09-13T02:52:27.649 INFO:tasks.workunit.client.1.smithi142.stdout:6/64: rename d1/d4 to d1/dd/d16 0 2024-09-13T02:52:27.653 INFO:tasks.workunit.client.1.smithi142.stdout:6/65: dread d1/d7/f9 [0,4194304] 0 2024-09-13T02:52:27.657 INFO:tasks.workunit.client.1.smithi142.stdout:6/66: unlink d1/c6 0 2024-09-13T02:52:27.657 INFO:tasks.workunit.client.1.smithi142.stdout:6/67: readlink d1/lc 0 2024-09-13T02:52:27.663 INFO:tasks.workunit.client.1.smithi142.stdout:6/68: dwrite d1/f10 [0,4194304] 0 2024-09-13T02:52:27.664 INFO:tasks.workunit.client.1.smithi142.stdout:6/69: chown d1/f10 113 1 2024-09-13T02:52:27.666 INFO:tasks.workunit.client.1.smithi142.stdout:6/70: rename d1/dd/d16/c8 to d1/dd/d16/c17 0 2024-09-13T02:52:27.667 INFO:tasks.workunit.client.1.smithi142.stdout:6/71: dread - d1/dd/d16/f15 zero size 2024-09-13T02:52:27.667 INFO:tasks.workunit.client.1.smithi142.stdout:6/72: write d1/dd/d16/f13 [1424210,111350] 0 2024-09-13T02:52:27.668 INFO:tasks.workunit.client.0.smithi098.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T02:52:27.670 INFO:tasks.workunit.client.1.smithi142.stdout:6/73: mkdir d1/dd/d18 0 2024-09-13T02:52:28.516 INFO:tasks.workunit.client.1.smithi142.stdout:8/10: sync 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:8/11: write - no filename 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/0: sync 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:8/12: dread - no filename 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/1: fdatasync - no filename 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/2: dwrite - no filename 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/3: dread - no filename 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/4: rmdir - no directory 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:9/18: sync 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:7/3: sync 2024-09-13T02:52:28.517 INFO:tasks.workunit.client.1.smithi142.stdout:1/8: sync 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:5/29: sync 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:3/50: sync 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/0: sync 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/1: dwrite - no filename 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/2: truncate - no filename 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/3: dread - no filename 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/4: dwrite - no filename 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/5: unlink - no file 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/6: dwrite - no filename 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/7: read - no filename 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/8: dwrite - no filename 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/9: unlink - no file 2024-09-13T02:52:28.518 INFO:tasks.workunit.client.1.smithi142.stdout:4/15: sync 2024-09-13T02:52:28.519 INFO:tasks.workunit.client.1.smithi142.stdout:0/10: link - no file 2024-09-13T02:52:28.519 INFO:tasks.workunit.client.1.smithi142.stdout:0/11: rename - no filename 2024-09-13T02:52:28.519 INFO:tasks.workunit.client.1.smithi142.stdout:4/16: readlink - no filename 2024-09-13T02:52:28.519 INFO:tasks.workunit.client.1.smithi142.stdout:6/74: sync 2024-09-13T02:52:28.520 INFO:tasks.workunit.client.1.smithi142.stdout:0/12: chown . 273 1 2024-09-13T02:52:28.520 INFO:tasks.workunit.client.1.smithi142.stdout:9/19: chown f3 8 1 2024-09-13T02:52:28.520 INFO:tasks.workunit.client.1.smithi142.stdout:5/30: write f4 [528804,52093] 0 2024-09-13T02:52:28.520 INFO:tasks.workunit.client.1.smithi142.stdout:3/51: write fe [641463,25787] 0 2024-09-13T02:52:28.520 INFO:tasks.workunit.client.1.smithi142.stdout:1/9: creat f1 x:0 0 0 2024-09-13T02:52:28.520 INFO:tasks.workunit.client.1.smithi142.stdout:7/4: rename l0 to l1 0 2024-09-13T02:52:28.521 INFO:tasks.workunit.client.1.smithi142.stdout:6/75: mkdir d1/d7/d19 0 2024-09-13T02:52:28.522 INFO:tasks.workunit.client.1.smithi142.stdout:9/20: creat f5 x:0 0 0 2024-09-13T02:52:28.523 INFO:tasks.workunit.client.1.smithi142.stdout:2/5: creat f0 x:0 0 0 2024-09-13T02:52:28.525 INFO:tasks.workunit.client.1.smithi142.stdout:0/13: mknod c0 0 2024-09-13T02:52:28.525 INFO:tasks.workunit.client.1.smithi142.stdout:7/5: creat f2 x:0 0 0 2024-09-13T02:52:28.526 INFO:tasks.workunit.client.1.smithi142.stdout:9/21: truncate f4 4782603 0 2024-09-13T02:52:28.526 INFO:tasks.workunit.client.1.smithi142.stdout:2/6: truncate f0 245977 0 2024-09-13T02:52:28.528 INFO:tasks.workunit.client.1.smithi142.stdout:3/52: creat d12/f13 x:0 0 0 2024-09-13T02:52:28.528 INFO:tasks.workunit.client.1.smithi142.stdout:4/17: mknod d0/d3/c6 0 2024-09-13T02:52:28.528 INFO:tasks.workunit.client.1.smithi142.stdout:2/7: chown f0 103850 1 2024-09-13T02:52:28.529 INFO:tasks.workunit.client.1.smithi142.stdout:7/6: write f2 [837390,35052] 0 2024-09-13T02:52:28.530 INFO:tasks.workunit.client.1.smithi142.stdout:0/14: symlink l1 0 2024-09-13T02:52:28.531 INFO:tasks.workunit.client.1.smithi142.stdout:3/53: chown c5 4 1 2024-09-13T02:52:28.533 INFO:tasks.workunit.client.1.smithi142.stdout:8/13: getdents d0 0 2024-09-13T02:52:28.534 INFO:tasks.workunit.client.1.smithi142.stdout:5/31: getdents d8 0 2024-09-13T02:52:28.534 INFO:tasks.workunit.client.1.smithi142.stdout:4/18: write d0/d3/f5 [653316,64882] 0 2024-09-13T02:52:28.535 INFO:tasks.workunit.client.1.smithi142.stdout:2/8: mkdir d1 0 2024-09-13T02:52:28.535 INFO:tasks.workunit.client.1.smithi142.stdout:6/76: dread d1/f10 [0,4194304] 0 2024-09-13T02:52:28.535 INFO:tasks.workunit.client.1.smithi142.stdout:1/10: dwrite f1 [0,4194304] 0 2024-09-13T02:52:28.536 INFO:tasks.workunit.client.1.smithi142.stdout:0/15: creat f2 x:0 0 0 2024-09-13T02:52:28.539 INFO:tasks.workunit.client.1.smithi142.stdout:9/22: link l1 l6 0 2024-09-13T02:52:28.539 INFO:tasks.workunit.client.1.smithi142.stdout:8/14: creat d0/f2 x:0 0 0 2024-09-13T02:52:28.540 INFO:tasks.workunit.client.1.smithi142.stdout:4/19: truncate d0/d3/f5 922403 0 2024-09-13T02:52:28.541 INFO:tasks.workunit.client.1.smithi142.stdout:1/11: rename c0 to c2 0 2024-09-13T02:52:28.543 INFO:tasks.workunit.client.1.smithi142.stdout:3/54: dread fc [0,4194304] 0 2024-09-13T02:52:28.543 INFO:tasks.workunit.client.1.smithi142.stdout:1/12: chown f1 238 1 2024-09-13T02:52:28.544 INFO:tasks.workunit.client.1.smithi142.stdout:0/16: rename c0 to c3 0 2024-09-13T02:52:28.545 INFO:tasks.workunit.client.1.smithi142.stdout:0/17: readlink l1 0 2024-09-13T02:52:28.547 INFO:tasks.workunit.client.1.smithi142.stdout:9/23: dwrite f4 [0,4194304] 0 2024-09-13T02:52:28.548 INFO:tasks.workunit.client.1.smithi142.stdout:5/32: link f4 d8/fb 0 2024-09-13T02:52:28.549 INFO:tasks.workunit.client.1.smithi142.stdout:6/77: symlink d1/l1a 0 2024-09-13T02:52:28.549 INFO:tasks.workunit.client.1.smithi142.stdout:9/24: write f4 [3413873,31684] 0 2024-09-13T02:52:28.550 INFO:tasks.workunit.client.1.smithi142.stdout:8/15: rename d0/f2 to d0/d1/f3 0 2024-09-13T02:52:28.551 INFO:tasks.workunit.client.1.smithi142.stdout:2/9: link f0 d1/f2 0 2024-09-13T02:52:28.552 INFO:tasks.workunit.client.1.smithi142.stdout:4/20: rename d0/d3/f4 to d0/d3/f7 0 2024-09-13T02:52:28.553 INFO:tasks.workunit.client.1.smithi142.stdout:1/13: symlink l3 0 2024-09-13T02:52:28.555 INFO:tasks.workunit.client.1.smithi142.stdout:3/55: mknod d12/c14 0 2024-09-13T02:52:28.556 INFO:tasks.workunit.client.1.smithi142.stdout:3/56: fdatasync fe 0 2024-09-13T02:52:28.557 INFO:tasks.workunit.client.1.smithi142.stdout:0/18: rename l1 to l4 0 2024-09-13T02:52:28.561 INFO:tasks.workunit.client.1.smithi142.stdout:5/33: write f4 [1100953,84151] 0 2024-09-13T02:52:28.562 INFO:tasks.workunit.client.1.smithi142.stdout:9/25: creat f7 x:0 0 0 2024-09-13T02:52:28.564 INFO:tasks.workunit.client.1.smithi142.stdout:6/78: rename d1/lc to d1/dd/d18/l1b 0 2024-09-13T02:52:28.568 INFO:tasks.workunit.client.1.smithi142.stdout:1/14: symlink l4 0 2024-09-13T02:52:28.569 INFO:tasks.workunit.client.1.smithi142.stdout:1/15: chown f1 127 1 2024-09-13T02:52:28.570 INFO:tasks.workunit.client.1.smithi142.stdout:3/57: mkdir d12/d15 0 2024-09-13T02:52:28.572 INFO:tasks.workunit.client.1.smithi142.stdout:5/34: creat d8/fc x:0 0 0 2024-09-13T02:52:28.573 INFO:tasks.workunit.client.1.smithi142.stdout:8/16: dwrite d0/d1/f3 [0,4194304] 0 2024-09-13T02:52:28.574 INFO:tasks.workunit.client.1.smithi142.stdout:9/26: creat f8 x:0 0 0 2024-09-13T02:52:28.574 INFO:tasks.workunit.client.1.smithi142.stdout:9/27: dread - f7 zero size 2024-09-13T02:52:28.574 INFO:tasks.workunit.client.1.smithi142.stdout:2/10: creat d1/f3 x:0 0 0 2024-09-13T02:52:28.575 INFO:tasks.workunit.client.1.smithi142.stdout:2/11: stat d1/f3 0 2024-09-13T02:52:28.575 INFO:tasks.workunit.client.1.smithi142.stdout:9/28: write f8 [829317,118023] 0 2024-09-13T02:52:28.576 INFO:tasks.workunit.client.1.smithi142.stdout:4/21: link d0/d3/f7 d0/f8 0 2024-09-13T02:52:28.579 INFO:tasks.workunit.client.1.smithi142.stdout:8/17: dread d0/d1/f3 [0,4194304] 0 2024-09-13T02:52:28.579 INFO:tasks.workunit.client.1.smithi142.stdout:3/58: rename d12/d15 to d12/d16 0 2024-09-13T02:52:28.581 INFO:tasks.workunit.client.1.smithi142.stdout:5/35: creat d8/fd x:0 0 0 2024-09-13T02:52:28.584 INFO:tasks.workunit.client.1.smithi142.stdout:2/12: creat d1/f4 x:0 0 0 2024-09-13T02:52:28.586 INFO:tasks.workunit.client.1.smithi142.stdout:4/22: mkdir d0/d3/d9 0 2024-09-13T02:52:28.587 INFO:tasks.workunit.client.1.smithi142.stdout:4/23: stat d0/d3/f7 0 2024-09-13T02:52:28.588 INFO:tasks.workunit.client.1.smithi142.stdout:8/18: mknod d0/c4 0 2024-09-13T02:52:28.590 INFO:tasks.workunit.client.1.smithi142.stdout:3/59: write fc [4813380,24602] 0 2024-09-13T02:52:28.594 INFO:tasks.workunit.client.1.smithi142.stdout:4/24: write d0/d3/f7 [495830,62126] 0 2024-09-13T02:52:28.594 INFO:tasks.workunit.client.1.smithi142.stdout:3/60: write d12/f13 [506144,127874] 0 2024-09-13T02:52:28.595 INFO:tasks.workunit.client.1.smithi142.stdout:5/36: link f0 d8/fe 0 2024-09-13T02:52:28.595 INFO:tasks.workunit.client.1.smithi142.stdout:2/13: dwrite d1/f3 [0,4194304] 0 2024-09-13T02:52:28.598 INFO:tasks.workunit.client.1.smithi142.stdout:5/37: symlink d8/lf 0 2024-09-13T02:52:28.599 INFO:tasks.workunit.client.1.smithi142.stdout:8/19: link d0/d1/f3 d0/f5 0 2024-09-13T02:52:28.600 INFO:tasks.workunit.client.1.smithi142.stdout:3/61: dread fe [0,4194304] 0 2024-09-13T02:52:28.601 INFO:tasks.workunit.client.1.smithi142.stdout:4/25: getdents d0/d3/d9 0 2024-09-13T02:52:28.603 INFO:tasks.workunit.client.1.smithi142.stdout:8/20: mkdir d0/d6 0 2024-09-13T02:52:28.604 INFO:tasks.workunit.client.1.smithi142.stdout:3/62: creat d12/d16/f17 x:0 0 0 2024-09-13T02:52:28.610 INFO:tasks.workunit.client.1.smithi142.stdout:4/26: dread d0/f8 [0,4194304] 0 2024-09-13T02:52:28.610 INFO:tasks.workunit.client.1.smithi142.stdout:3/63: dread - d12/d16/f17 zero size 2024-09-13T02:52:28.611 INFO:tasks.workunit.client.1.smithi142.stdout:2/14: dwrite d1/f4 [0,4194304] 0 2024-09-13T02:52:28.614 INFO:tasks.workunit.client.1.smithi142.stdout:5/38: dwrite d8/fc [0,4194304] 0 2024-09-13T02:52:28.616 INFO:tasks.workunit.client.1.smithi142.stdout:5/39: chown d8/fd 29194 1 2024-09-13T02:52:28.616 INFO:tasks.workunit.client.1.smithi142.stdout:8/21: dread d0/f5 [0,4194304] 0 2024-09-13T02:52:28.622 INFO:tasks.workunit.client.1.smithi142.stdout:5/40: unlink d8/fb 0 2024-09-13T02:52:28.622 INFO:tasks.workunit.client.1.smithi142.stdout:5/41: chown d8/l9 9428859 1 2024-09-13T02:52:28.622 INFO:tasks.workunit.client.1.smithi142.stdout:5/42: read d8/fc [3327096,114936] 0 2024-09-13T02:52:28.623 INFO:tasks.workunit.client.1.smithi142.stdout:8/22: creat d0/f7 x:0 0 0 2024-09-13T02:52:28.628 INFO:tasks.workunit.client.1.smithi142.stdout:5/43: creat d8/f10 x:0 0 0 2024-09-13T02:52:28.630 INFO:tasks.workunit.client.1.smithi142.stdout:5/44: mkdir d8/d11 0 2024-09-13T02:52:28.633 INFO:tasks.workunit.client.1.smithi142.stdout:5/45: dread f0 [0,4194304] 0 2024-09-13T02:52:28.636 INFO:tasks.workunit.client.1.smithi142.stdout:5/46: dread f0 [0,4194304] 0 2024-09-13T02:52:28.643 INFO:tasks.workunit.client.1.smithi142.stdout:5/47: dwrite d8/f10 [0,4194304] 0 2024-09-13T02:52:28.644 INFO:tasks.workunit.client.1.smithi142.stdout:5/48: dread - f5 zero size 2024-09-13T02:52:28.644 INFO:tasks.workunit.client.1.smithi142.stdout:5/49: truncate f5 552268 0 2024-09-13T02:52:28.645 INFO:tasks.workunit.client.1.smithi142.stdout:5/50: truncate f5 846656 0 2024-09-13T02:52:28.652 INFO:tasks.workunit.client.1.smithi142.stdout:7/7: truncate f2 321779 0 2024-09-13T02:52:28.655 INFO:tasks.workunit.client.1.smithi142.stdout:1/16: dwrite f1 [4194304,4194304] 0 2024-09-13T02:52:28.657 INFO:tasks.workunit.client.1.smithi142.stdout:0/19: rename c3 to c5 0 2024-09-13T02:52:28.659 INFO:tasks.workunit.client.1.smithi142.stdout:0/20: write f2 [121333,89989] 0 2024-09-13T02:52:28.659 INFO:tasks.workunit.client.1.smithi142.stdout:1/17: creat f5 x:0 0 0 2024-09-13T02:52:28.662 INFO:tasks.workunit.client.1.smithi142.stdout:0/21: write f2 [1145684,62848] 0 2024-09-13T02:52:28.665 INFO:tasks.workunit.client.1.smithi142.stdout:6/79: getdents d1/dd/d18 0 2024-09-13T02:52:28.667 INFO:tasks.workunit.client.1.smithi142.stdout:6/80: link d1/d7/f9 d1/dd/d16/f1c 0 2024-09-13T02:52:28.669 INFO:tasks.workunit.client.1.smithi142.stdout:6/81: mknod d1/d7/d19/c1d 0 2024-09-13T02:52:28.670 INFO:tasks.workunit.client.1.smithi142.stdout:1/18: fdatasync f1 0 2024-09-13T02:52:28.671 INFO:tasks.workunit.client.1.smithi142.stdout:1/19: write f5 [936393,91486] 0 2024-09-13T02:52:28.673 INFO:tasks.workunit.client.1.smithi142.stdout:1/20: symlink l6 0 2024-09-13T02:52:28.673 INFO:tasks.workunit.client.1.smithi142.stdout:2/15: getdents d1 0 2024-09-13T02:52:28.675 INFO:tasks.workunit.client.1.smithi142.stdout:1/21: symlink l7 0 2024-09-13T02:52:28.675 INFO:tasks.workunit.client.1.smithi142.stdout:1/22: readlink l6 0 2024-09-13T02:52:28.676 INFO:tasks.workunit.client.1.smithi142.stdout:1/23: readlink l4 0 2024-09-13T02:52:28.676 INFO:tasks.workunit.client.1.smithi142.stdout:1/24: rmdir - no directory 2024-09-13T02:52:28.676 INFO:tasks.workunit.client.1.smithi142.stdout:9/29: truncate f4 3584539 0 2024-09-13T02:52:28.676 INFO:tasks.workunit.client.1.smithi142.stdout:9/30: write f8 [253345,50419] 0 2024-09-13T02:52:28.677 INFO:tasks.workunit.client.1.smithi142.stdout:6/82: rename d1/dd/c11 to d1/c1e 0 2024-09-13T02:52:28.679 INFO:tasks.workunit.client.1.smithi142.stdout:1/25: dread f5 [0,4194304] 0 2024-09-13T02:52:28.681 INFO:tasks.workunit.client.1.smithi142.stdout:6/83: dread d1/dd/d16/f1c [0,4194304] 0 2024-09-13T02:52:28.682 INFO:tasks.workunit.client.1.smithi142.stdout:9/31: rename l6 to l9 0 2024-09-13T02:52:28.683 INFO:tasks.workunit.client.1.smithi142.stdout:3/64: fsync d12/d16/f17 0 2024-09-13T02:52:28.686 INFO:tasks.workunit.client.1.smithi142.stdout:3/65: symlink d12/l18 0 2024-09-13T02:52:28.687 INFO:tasks.workunit.client.1.smithi142.stdout:4/27: truncate d0/d3/f7 458648 0 2024-09-13T02:52:28.688 INFO:tasks.workunit.client.1.smithi142.stdout:3/66: creat d12/f19 x:0 0 0 2024-09-13T02:52:28.690 INFO:tasks.workunit.client.1.smithi142.stdout:6/84: link d1/d7/d19/c1d d1/d7/d19/c1f 0 2024-09-13T02:52:28.690 INFO:tasks.workunit.client.1.smithi142.stdout:8/23: rmdir d0 39 2024-09-13T02:52:28.692 INFO:tasks.workunit.client.1.smithi142.stdout:3/67: rename c3 to d12/d16/c1a 0 2024-09-13T02:52:28.694 INFO:tasks.workunit.client.1.smithi142.stdout:5/51: unlink f4 0 2024-09-13T02:52:28.694 INFO:tasks.workunit.client.1.smithi142.stdout:6/85: rmdir d1/dd/d18 39 2024-09-13T02:52:28.694 INFO:tasks.workunit.client.1.smithi142.stdout:4/28: dwrite d0/d3/f5 [0,4194304] 0 2024-09-13T02:52:28.695 INFO:tasks.workunit.client.1.smithi142.stdout:4/29: chown d0 645317 1 2024-09-13T02:52:28.697 INFO:tasks.workunit.client.1.smithi142.stdout:6/86: chown d1/d7/f9 159 1 2024-09-13T02:52:28.698 INFO:tasks.workunit.client.1.smithi142.stdout:5/52: fdatasync f3 0 2024-09-13T02:52:28.699 INFO:tasks.workunit.client.1.smithi142.stdout:1/26: truncate f1 60447 0 2024-09-13T02:52:28.699 INFO:tasks.workunit.client.1.smithi142.stdout:1/27: rmdir - no directory 2024-09-13T02:52:28.700 INFO:tasks.workunit.client.1.smithi142.stdout:5/53: dread - d8/fd zero size 2024-09-13T02:52:28.701 INFO:tasks.workunit.client.1.smithi142.stdout:0/22: rename c5 to c6 0 2024-09-13T02:52:28.702 INFO:tasks.workunit.client.1.smithi142.stdout:4/30: symlink d0/d3/la 0 2024-09-13T02:52:28.703 INFO:tasks.workunit.client.1.smithi142.stdout:8/24: dread d0/f5 [0,4194304] 0 2024-09-13T02:52:28.704 INFO:tasks.workunit.client.1.smithi142.stdout:0/23: write f2 [491663,10399] 0 2024-09-13T02:52:28.707 INFO:tasks.workunit.client.1.smithi142.stdout:7/8: dwrite f2 [0,4194304] 0 2024-09-13T02:52:28.708 INFO:tasks.workunit.client.1.smithi142.stdout:0/24: truncate f2 1792999 0 2024-09-13T02:52:28.709 INFO:tasks.workunit.client.1.smithi142.stdout:6/87: dread d1/dd/d16/f13 [0,4194304] 0 2024-09-13T02:52:28.712 INFO:tasks.workunit.client.1.smithi142.stdout:0/25: fsync f2 0 2024-09-13T02:52:28.714 INFO:tasks.workunit.client.1.smithi142.stdout:7/9: symlink l3 0 2024-09-13T02:52:28.716 INFO:tasks.workunit.client.1.smithi142.stdout:8/25: truncate d0/d1/f3 2757303 0 2024-09-13T02:52:28.716 INFO:tasks.workunit.client.1.smithi142.stdout:0/26: read f2 [1499915,103402] 0 2024-09-13T02:52:28.717 INFO:tasks.workunit.client.1.smithi142.stdout:3/68: truncate fc 4302662 0 2024-09-13T02:52:28.718 INFO:tasks.workunit.client.1.smithi142.stdout:3/69: stat d12/d16 0 2024-09-13T02:52:28.718 INFO:tasks.workunit.client.1.smithi142.stdout:5/54: rmdir d8/d11 0 2024-09-13T02:52:28.718 INFO:tasks.workunit.client.1.smithi142.stdout:1/28: dwrite f5 [0,4194304] 0 2024-09-13T02:52:28.720 INFO:tasks.workunit.client.1.smithi142.stdout:3/70: chown d12/f19 27267397 1 2024-09-13T02:52:28.721 INFO:tasks.workunit.client.1.smithi142.stdout:7/10: creat f4 x:0 0 0 2024-09-13T02:52:28.723 INFO:tasks.workunit.client.1.smithi142.stdout:0/27: chown l4 2177 1 2024-09-13T02:52:28.724 INFO:tasks.workunit.client.1.smithi142.stdout:1/29: dread f5 [0,4194304] 0 2024-09-13T02:52:28.727 INFO:tasks.workunit.client.1.smithi142.stdout:3/71: creat d12/f1b x:0 0 0 2024-09-13T02:52:28.729 INFO:tasks.workunit.client.1.smithi142.stdout:7/11: symlink l5 0 2024-09-13T02:52:28.732 INFO:tasks.workunit.client.1.smithi142.stdout:1/30: creat f8 x:0 0 0 2024-09-13T02:52:28.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:28 smithi098 ceph-mon[27886]: pgmap v13: 65 pgs: 65 active+clean; 196 MiB data, 788 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 325 op/s 2024-09-13T02:52:28.736 INFO:tasks.workunit.client.1.smithi142.stdout:4/31: dwrite d0/f8 [0,4194304] 0 2024-09-13T02:52:28.736 INFO:tasks.workunit.client.1.smithi142.stdout:3/72: symlink d12/l1c 0 2024-09-13T02:52:28.737 INFO:tasks.workunit.client.1.smithi142.stdout:4/32: chown d0/d3/f5 6665517 1 2024-09-13T02:52:28.737 INFO:tasks.workunit.client.1.smithi142.stdout:7/12: rename l3 to l6 0 2024-09-13T02:52:28.739 INFO:tasks.workunit.client.1.smithi142.stdout:0/28: unlink c6 0 2024-09-13T02:52:28.740 INFO:tasks.workunit.client.1.smithi142.stdout:1/31: rename l6 to l9 0 2024-09-13T02:52:28.742 INFO:tasks.workunit.client.1.smithi142.stdout:6/88: link d1/dd/l14 d1/l20 0 2024-09-13T02:52:28.744 INFO:tasks.workunit.client.1.smithi142.stdout:4/33: symlink d0/lb 0 2024-09-13T02:52:28.745 INFO:tasks.workunit.client.1.smithi142.stdout:9/32: truncate f4 2045923 0 2024-09-13T02:52:28.746 INFO:tasks.workunit.client.1.smithi142.stdout:1/32: mknod ca 0 2024-09-13T02:52:28.748 INFO:tasks.workunit.client.1.smithi142.stdout:7/13: rename l1 to l7 0 2024-09-13T02:52:28.749 INFO:tasks.workunit.client.1.smithi142.stdout:9/33: read f8 [281999,40657] 0 2024-09-13T02:52:28.750 INFO:tasks.workunit.client.1.smithi142.stdout:0/29: dwrite f2 [0,4194304] 0 2024-09-13T02:52:28.750 INFO:tasks.workunit.client.1.smithi142.stdout:4/34: rmdir d0/d3 39 2024-09-13T02:52:28.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:28 smithi142 ceph-mon[33443]: pgmap v13: 65 pgs: 65 active+clean; 196 MiB data, 788 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 325 op/s 2024-09-13T02:52:28.751 INFO:tasks.workunit.client.1.smithi142.stdout:5/55: dwrite f0 [0,4194304] 0 2024-09-13T02:52:28.753 INFO:tasks.workunit.client.1.smithi142.stdout:3/73: link c5 d12/d16/c1d 0 2024-09-13T02:52:28.753 INFO:tasks.workunit.client.1.smithi142.stdout:1/33: unlink l7 0 2024-09-13T02:52:28.754 INFO:tasks.workunit.client.1.smithi142.stdout:6/89: dread d1/d7/f9 [0,4194304] 0 2024-09-13T02:52:28.755 INFO:tasks.workunit.client.1.smithi142.stdout:7/14: creat f8 x:0 0 0 2024-09-13T02:52:28.756 INFO:tasks.workunit.client.1.smithi142.stdout:7/15: chown f8 756161 1 2024-09-13T02:52:28.757 INFO:tasks.workunit.client.1.smithi142.stdout:9/34: creat fa x:0 0 0 2024-09-13T02:52:28.759 INFO:tasks.workunit.client.1.smithi142.stdout:0/30: dread f2 [0,4194304] 0 2024-09-13T02:52:28.761 INFO:tasks.workunit.client.1.smithi142.stdout:5/56: write d8/fc [344713,114082] 0 2024-09-13T02:52:28.762 INFO:tasks.workunit.client.1.smithi142.stdout:1/34: mknod cb 0 2024-09-13T02:52:28.762 INFO:tasks.workunit.client.1.smithi142.stdout:1/35: rmdir - no directory 2024-09-13T02:52:28.762 INFO:tasks.workunit.client.1.smithi142.stdout:6/90: dread d1/f10 [0,4194304] 0 2024-09-13T02:52:28.765 INFO:tasks.workunit.client.1.smithi142.stdout:7/16: symlink l9 0 2024-09-13T02:52:28.766 INFO:tasks.workunit.client.1.smithi142.stdout:9/35: readlink l1 0 2024-09-13T02:52:28.768 INFO:tasks.workunit.client.1.smithi142.stdout:0/31: mknod c7 0 2024-09-13T02:52:28.769 INFO:tasks.workunit.client.1.smithi142.stdout:5/57: dwrite d8/f10 [0,4194304] 0 2024-09-13T02:52:28.770 INFO:tasks.workunit.client.1.smithi142.stdout:1/36: unlink f8 0 2024-09-13T02:52:28.772 INFO:tasks.workunit.client.1.smithi142.stdout:6/91: mknod d1/dd/d16/c21 0 2024-09-13T02:52:28.773 INFO:tasks.workunit.client.1.smithi142.stdout:7/17: readlink l7 0 2024-09-13T02:52:28.774 INFO:tasks.workunit.client.1.smithi142.stdout:6/92: fdatasync d1/dd/d16/f15 0 2024-09-13T02:52:28.774 INFO:tasks.workunit.client.1.smithi142.stdout:0/32: symlink l8 0 2024-09-13T02:52:28.774 INFO:tasks.workunit.client.1.smithi142.stdout:7/18: dread - f8 zero size 2024-09-13T02:52:28.775 INFO:tasks.workunit.client.1.smithi142.stdout:9/36: dwrite f5 [0,4194304] 0 2024-09-13T02:52:28.776 INFO:tasks.workunit.client.1.smithi142.stdout:1/37: write f5 [2114063,12386] 0 2024-09-13T02:52:28.777 INFO:tasks.workunit.client.1.smithi142.stdout:3/74: link l6 d12/l1e 0 2024-09-13T02:52:28.779 INFO:tasks.workunit.client.1.smithi142.stdout:4/35: link d0/lb d0/lc 0 2024-09-13T02:52:28.780 INFO:tasks.workunit.client.1.smithi142.stdout:7/19: rename f4 to fa 0 2024-09-13T02:52:28.781 INFO:tasks.workunit.client.1.smithi142.stdout:9/37: fsync f8 0 2024-09-13T02:52:28.781 INFO:tasks.workunit.client.1.smithi142.stdout:1/38: unlink l3 0 2024-09-13T02:52:28.782 INFO:tasks.workunit.client.1.smithi142.stdout:0/33: dread f2 [0,4194304] 0 2024-09-13T02:52:28.783 INFO:tasks.workunit.client.1.smithi142.stdout:3/75: unlink ld 0 2024-09-13T02:52:28.787 INFO:tasks.workunit.client.1.smithi142.stdout:9/38: dwrite f3 [0,4194304] 0 2024-09-13T02:52:28.789 INFO:tasks.workunit.client.1.smithi142.stdout:1/39: dread f1 [0,4194304] 0 2024-09-13T02:52:28.789 INFO:tasks.workunit.client.1.smithi142.stdout:0/34: unlink f2 0 2024-09-13T02:52:28.791 INFO:tasks.workunit.client.1.smithi142.stdout:5/58: truncate f0 264456 0 2024-09-13T02:52:28.791 INFO:tasks.workunit.client.1.smithi142.stdout:4/36: dread d0/d3/f7 [0,4194304] 0 2024-09-13T02:52:28.792 INFO:tasks.workunit.client.1.smithi142.stdout:6/93: creat d1/dd/f22 x:0 0 0 2024-09-13T02:52:28.793 INFO:tasks.workunit.client.1.smithi142.stdout:9/39: creat fb x:0 0 0 2024-09-13T02:52:28.793 INFO:tasks.workunit.client.1.smithi142.stdout:6/94: stat d1/dd/d16/f13 0 2024-09-13T02:52:28.793 INFO:tasks.workunit.client.1.smithi142.stdout:1/40: creat fc x:0 0 0 2024-09-13T02:52:28.794 INFO:tasks.workunit.client.1.smithi142.stdout:0/35: creat f9 x:0 0 0 2024-09-13T02:52:28.795 INFO:tasks.workunit.client.1.smithi142.stdout:1/41: write f5 [4801220,12234] 0 2024-09-13T02:52:28.796 INFO:tasks.workunit.client.1.smithi142.stdout:6/95: truncate d1/dd/d16/f15 239458 0 2024-09-13T02:52:28.796 INFO:tasks.workunit.client.1.smithi142.stdout:0/36: write f9 [711590,66703] 0 2024-09-13T02:52:28.797 INFO:tasks.workunit.client.1.smithi142.stdout:0/37: readlink l4 0 2024-09-13T02:52:28.797 INFO:tasks.workunit.client.1.smithi142.stdout:9/40: mknod cc 0 2024-09-13T02:52:28.798 INFO:tasks.workunit.client.1.smithi142.stdout:0/38: write f9 [1221329,64361] 0 2024-09-13T02:52:28.798 INFO:tasks.workunit.client.1.smithi142.stdout:6/96: write d1/dd/f22 [494700,9984] 0 2024-09-13T02:52:28.800 INFO:tasks.workunit.client.1.smithi142.stdout:0/39: write f9 [735443,20339] 0 2024-09-13T02:52:28.801 INFO:tasks.workunit.client.1.smithi142.stdout:1/42: creat fd x:0 0 0 2024-09-13T02:52:28.802 INFO:tasks.workunit.client.1.smithi142.stdout:7/20: getdents . 0 2024-09-13T02:52:28.803 INFO:tasks.workunit.client.1.smithi142.stdout:7/21: dread - fa zero size 2024-09-13T02:52:28.805 INFO:tasks.workunit.client.1.smithi142.stdout:7/22: dread - f8 zero size 2024-09-13T02:52:28.806 INFO:tasks.workunit.client.1.smithi142.stdout:6/97: mknod d1/d7/c23 0 2024-09-13T02:52:28.807 INFO:tasks.workunit.client.1.smithi142.stdout:9/41: dwrite f5 [4194304,4194304] 0 2024-09-13T02:52:28.808 INFO:tasks.workunit.client.1.smithi142.stdout:1/43: chown c2 3842 1 2024-09-13T02:52:28.808 INFO:tasks.workunit.client.1.smithi142.stdout:5/59: dread d8/fe [0,4194304] 0 2024-09-13T02:52:28.809 INFO:tasks.workunit.client.1.smithi142.stdout:1/44: dread f1 [0,4194304] 0 2024-09-13T02:52:28.810 INFO:tasks.workunit.client.1.smithi142.stdout:5/60: chown d8/lf 12 1 2024-09-13T02:52:28.810 INFO:tasks.workunit.client.1.smithi142.stdout:4/37: getdents d0 0 2024-09-13T02:52:28.810 INFO:tasks.workunit.client.1.smithi142.stdout:1/45: chown f5 110094 1 2024-09-13T02:52:28.810 INFO:tasks.workunit.client.1.smithi142.stdout:5/61: write f3 [3661138,87423] 0 2024-09-13T02:52:28.811 INFO:tasks.workunit.client.1.smithi142.stdout:7/23: symlink lb 0 2024-09-13T02:52:28.811 INFO:tasks.workunit.client.1.smithi142.stdout:5/62: dread d8/fe [0,4194304] 0 2024-09-13T02:52:28.814 INFO:tasks.workunit.client.1.smithi142.stdout:6/98: creat d1/d7/f24 x:0 0 0 2024-09-13T02:52:28.815 INFO:tasks.workunit.client.1.smithi142.stdout:9/42: mkdir dd 0 2024-09-13T02:52:28.816 INFO:tasks.workunit.client.1.smithi142.stdout:9/43: read - fa zero size 2024-09-13T02:52:28.817 INFO:tasks.workunit.client.1.smithi142.stdout:9/44: write fb [705559,115107] 0 2024-09-13T02:52:28.817 INFO:tasks.workunit.client.1.smithi142.stdout:4/38: creat d0/fd x:0 0 0 2024-09-13T02:52:28.819 INFO:tasks.workunit.client.1.smithi142.stdout:1/46: creat fe x:0 0 0 2024-09-13T02:52:28.820 INFO:tasks.workunit.client.1.smithi142.stdout:7/24: creat fc x:0 0 0 2024-09-13T02:52:28.821 INFO:tasks.workunit.client.1.smithi142.stdout:5/63: readlink d8/la 0 2024-09-13T02:52:28.822 INFO:tasks.workunit.client.1.smithi142.stdout:6/99: dwrite d1/dd/d16/f15 [0,4194304] 0 2024-09-13T02:52:28.826 INFO:tasks.workunit.client.1.smithi142.stdout:1/47: creat ff x:0 0 0 2024-09-13T02:52:28.827 INFO:tasks.workunit.client.1.smithi142.stdout:9/45: dread f4 [0,4194304] 0 2024-09-13T02:52:28.829 INFO:tasks.workunit.client.1.smithi142.stdout:5/64: link f5 d8/f12 0 2024-09-13T02:52:28.833 INFO:tasks.workunit.client.1.smithi142.stdout:9/46: rename f4 to dd/fe 0 2024-09-13T02:52:28.835 INFO:tasks.workunit.client.1.smithi142.stdout:6/100: creat d1/f25 x:0 0 0 2024-09-13T02:52:28.840 INFO:tasks.workunit.client.1.smithi142.stdout:7/25: getdents . 0 2024-09-13T02:52:28.840 INFO:tasks.workunit.client.1.smithi142.stdout:7/26: fsync fc 0 2024-09-13T02:52:28.841 INFO:tasks.workunit.client.1.smithi142.stdout:7/27: read - fc zero size 2024-09-13T02:52:28.842 INFO:tasks.workunit.client.1.smithi142.stdout:4/39: symlink d0/d3/le 0 2024-09-13T02:52:28.844 INFO:tasks.workunit.client.1.smithi142.stdout:5/65: getdents d8 0 2024-09-13T02:52:28.844 INFO:tasks.workunit.client.1.smithi142.stdout:1/48: write f1 [893624,95554] 0 2024-09-13T02:52:28.846 INFO:tasks.workunit.client.1.smithi142.stdout:4/40: mkdir d0/df 0 2024-09-13T02:52:28.847 INFO:tasks.workunit.client.1.smithi142.stdout:5/66: creat d8/f13 x:0 0 0 2024-09-13T02:52:28.848 INFO:tasks.workunit.client.1.smithi142.stdout:1/49: creat f10 x:0 0 0 2024-09-13T02:52:28.849 INFO:tasks.workunit.client.1.smithi142.stdout:1/50: fdatasync ff 0 2024-09-13T02:52:28.850 INFO:tasks.workunit.client.1.smithi142.stdout:5/67: mknod d8/c14 0 2024-09-13T02:52:28.851 INFO:tasks.workunit.client.1.smithi142.stdout:4/41: chown d0/lb 724058774 1 2024-09-13T02:52:28.852 INFO:tasks.workunit.client.1.smithi142.stdout:7/28: dwrite fa [0,4194304] 0 2024-09-13T02:52:28.853 INFO:tasks.workunit.client.1.smithi142.stdout:1/51: symlink l11 0 2024-09-13T02:52:28.854 INFO:tasks.workunit.client.1.smithi142.stdout:9/47: write dd/fe [1214516,94816] 0 2024-09-13T02:52:28.856 INFO:tasks.workunit.client.1.smithi142.stdout:1/52: truncate f1 1696278 0 2024-09-13T02:52:28.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/53: dread - f10 zero size 2024-09-13T02:52:28.863 INFO:tasks.workunit.client.1.smithi142.stdout:6/101: dwrite d1/dd/d16/f1c [0,4194304] 0 2024-09-13T02:52:28.863 INFO:tasks.workunit.client.1.smithi142.stdout:2/16: sync 2024-09-13T02:52:28.863 INFO:tasks.workunit.client.1.smithi142.stdout:6/102: chown d1 281083239 1 2024-09-13T02:52:28.863 INFO:tasks.workunit.client.1.smithi142.stdout:6/103: dread - d1/f25 zero size 2024-09-13T02:52:28.863 INFO:tasks.workunit.client.1.smithi142.stdout:5/68: link f3 d8/f15 0 2024-09-13T02:52:28.863 INFO:tasks.workunit.client.1.smithi142.stdout:7/29: link fa fd 0 2024-09-13T02:52:28.865 INFO:tasks.workunit.client.1.smithi142.stdout:9/48: creat dd/ff x:0 0 0 2024-09-13T02:52:28.865 INFO:tasks.workunit.client.1.smithi142.stdout:6/104: chown d1/d7/f9 0 1 2024-09-13T02:52:28.866 INFO:tasks.workunit.client.1.smithi142.stdout:4/42: rename d0/d3/c6 to d0/d3/d9/c10 0 2024-09-13T02:52:28.868 INFO:tasks.workunit.client.1.smithi142.stdout:7/30: unlink lb 0 2024-09-13T02:52:28.870 INFO:tasks.workunit.client.1.smithi142.stdout:9/49: creat dd/f10 x:0 0 0 2024-09-13T02:52:28.871 INFO:tasks.workunit.client.1.smithi142.stdout:9/50: chown l1 3992560 1 2024-09-13T02:52:28.871 INFO:tasks.workunit.client.1.smithi142.stdout:9/51: truncate f7 181133 0 2024-09-13T02:52:28.872 INFO:tasks.workunit.client.1.smithi142.stdout:5/69: mknod d8/c16 0 2024-09-13T02:52:28.874 INFO:tasks.workunit.client.1.smithi142.stdout:4/43: creat d0/d3/d9/f11 x:0 0 0 2024-09-13T02:52:28.876 INFO:tasks.workunit.client.1.smithi142.stdout:7/31: write fa [1181377,65365] 0 2024-09-13T02:52:28.876 INFO:tasks.workunit.client.1.smithi142.stdout:9/52: creat dd/f11 x:0 0 0 2024-09-13T02:52:28.876 INFO:tasks.workunit.client.1.smithi142.stdout:6/105: creat d1/dd/f26 x:0 0 0 2024-09-13T02:52:28.877 INFO:tasks.workunit.client.1.smithi142.stdout:0/40: dread f9 [0,4194304] 0 2024-09-13T02:52:28.878 INFO:tasks.workunit.client.1.smithi142.stdout:6/106: chown d1/d7/f24 2836 1 2024-09-13T02:52:28.878 INFO:tasks.workunit.client.1.smithi142.stdout:4/44: write d0/f8 [4369558,4230] 0 2024-09-13T02:52:28.879 INFO:tasks.workunit.client.1.smithi142.stdout:0/41: mknod ca 0 2024-09-13T02:52:28.879 INFO:tasks.workunit.client.1.smithi142.stdout:0/42: rmdir - no directory 2024-09-13T02:52:28.882 INFO:tasks.workunit.client.1.smithi142.stdout:4/45: mknod d0/d3/c12 0 2024-09-13T02:52:28.884 INFO:tasks.workunit.client.1.smithi142.stdout:4/46: dread - d0/fd zero size 2024-09-13T02:52:28.884 INFO:tasks.workunit.client.1.smithi142.stdout:0/43: link l4 lb 0 2024-09-13T02:52:28.885 INFO:tasks.workunit.client.1.smithi142.stdout:9/53: dwrite f3 [0,4194304] 0 2024-09-13T02:52:28.886 INFO:tasks.workunit.client.1.smithi142.stdout:0/44: mknod cc 0 2024-09-13T02:52:28.887 INFO:tasks.workunit.client.1.smithi142.stdout:1/54: fsync f5 0 2024-09-13T02:52:28.889 INFO:tasks.workunit.client.1.smithi142.stdout:9/54: symlink dd/l12 0 2024-09-13T02:52:28.889 INFO:tasks.workunit.client.1.smithi142.stdout:1/55: chown fc 17596 1 2024-09-13T02:52:28.891 INFO:tasks.workunit.client.1.smithi142.stdout:0/45: creat fd x:0 0 0 2024-09-13T02:52:28.893 INFO:tasks.workunit.client.1.smithi142.stdout:0/46: dread - fd zero size 2024-09-13T02:52:28.895 INFO:tasks.workunit.client.1.smithi142.stdout:9/55: creat dd/f13 x:0 0 0 2024-09-13T02:52:28.895 INFO:tasks.workunit.client.1.smithi142.stdout:0/47: chown c7 5 1 2024-09-13T02:52:28.896 INFO:tasks.workunit.client.1.smithi142.stdout:6/107: dwrite d1/dd/d16/f13 [0,4194304] 0 2024-09-13T02:52:28.898 INFO:tasks.workunit.client.1.smithi142.stdout:7/32: truncate fd 3075316 0 2024-09-13T02:52:28.901 INFO:tasks.workunit.client.1.smithi142.stdout:0/48: symlink le 0 2024-09-13T02:52:28.902 INFO:tasks.workunit.client.1.smithi142.stdout:4/47: dwrite d0/d3/f7 [4194304,4194304] 0 2024-09-13T02:52:28.904 INFO:tasks.workunit.client.1.smithi142.stdout:1/56: dread f5 [0,4194304] 0 2024-09-13T02:52:28.905 INFO:tasks.workunit.client.1.smithi142.stdout:6/108: symlink d1/dd/l27 0 2024-09-13T02:52:28.907 INFO:tasks.workunit.client.1.smithi142.stdout:0/49: chown l4 1747587318 1 2024-09-13T02:52:28.907 INFO:tasks.workunit.client.1.smithi142.stdout:1/57: dread - fe zero size 2024-09-13T02:52:28.911 INFO:tasks.workunit.client.1.smithi142.stdout:0/50: write f9 [466473,50327] 0 2024-09-13T02:52:28.911 INFO:tasks.workunit.client.1.smithi142.stdout:9/56: dwrite f7 [0,4194304] 0 2024-09-13T02:52:28.912 INFO:tasks.workunit.client.1.smithi142.stdout:1/58: mkdir d12 0 2024-09-13T02:52:28.912 INFO:tasks.workunit.client.1.smithi142.stdout:9/57: stat cc 0 2024-09-13T02:52:28.913 INFO:tasks.workunit.client.1.smithi142.stdout:4/48: dread d0/f8 [0,4194304] 0 2024-09-13T02:52:28.913 INFO:tasks.workunit.client.1.smithi142.stdout:6/109: mknod d1/dd/c28 0 2024-09-13T02:52:28.915 INFO:tasks.workunit.client.1.smithi142.stdout:0/51: creat ff x:0 0 0 2024-09-13T02:52:28.917 INFO:tasks.workunit.client.1.smithi142.stdout:7/33: dread fd [0,4194304] 0 2024-09-13T02:52:28.918 INFO:tasks.workunit.client.1.smithi142.stdout:7/34: dread - f8 zero size 2024-09-13T02:52:28.918 INFO:tasks.workunit.client.1.smithi142.stdout:4/49: mkdir d0/d3/d13 0 2024-09-13T02:52:28.919 INFO:tasks.workunit.client.1.smithi142.stdout:4/50: chown d0/d3 76408838 1 2024-09-13T02:52:28.919 INFO:tasks.workunit.client.1.smithi142.stdout:1/59: mkdir d12/d13 0 2024-09-13T02:52:28.919 INFO:tasks.workunit.client.1.smithi142.stdout:1/60: dread - fe zero size 2024-09-13T02:52:28.920 INFO:tasks.workunit.client.1.smithi142.stdout:0/52: mkdir d10 0 2024-09-13T02:52:28.923 INFO:tasks.workunit.client.1.smithi142.stdout:4/51: write d0/d3/f7 [4438067,29774] 0 2024-09-13T02:52:28.924 INFO:tasks.workunit.client.1.smithi142.stdout:1/61: mknod d12/c14 0 2024-09-13T02:52:28.925 INFO:tasks.workunit.client.1.smithi142.stdout:1/62: read f1 [915516,114484] 0 2024-09-13T02:52:28.926 INFO:tasks.workunit.client.1.smithi142.stdout:1/63: write f1 [1362076,62675] 0 2024-09-13T02:52:28.926 INFO:tasks.workunit.client.1.smithi142.stdout:1/64: dread - fe zero size 2024-09-13T02:52:28.927 INFO:tasks.workunit.client.1.smithi142.stdout:1/65: chown f5 207525 1 2024-09-13T02:52:28.928 INFO:tasks.workunit.client.1.smithi142.stdout:7/35: link f2 fe 0 2024-09-13T02:52:28.928 INFO:tasks.workunit.client.1.smithi142.stdout:1/66: read - f10 zero size 2024-09-13T02:52:28.928 INFO:tasks.workunit.client.1.smithi142.stdout:0/53: mknod d10/c11 0 2024-09-13T02:52:28.930 INFO:tasks.workunit.client.1.smithi142.stdout:7/36: creat ff x:0 0 0 2024-09-13T02:52:28.931 INFO:tasks.workunit.client.1.smithi142.stdout:1/67: mknod d12/c15 0 2024-09-13T02:52:28.932 INFO:tasks.workunit.client.1.smithi142.stdout:0/54: symlink d10/l12 0 2024-09-13T02:52:28.932 INFO:tasks.workunit.client.1.smithi142.stdout:0/55: chown l8 234697830 1 2024-09-13T02:52:28.933 INFO:tasks.workunit.client.1.smithi142.stdout:0/56: chown ca 452 1 2024-09-13T02:52:28.933 INFO:tasks.workunit.client.1.smithi142.stdout:0/57: fsync f9 0 2024-09-13T02:52:28.934 INFO:tasks.workunit.client.1.smithi142.stdout:4/52: creat d0/f14 x:0 0 0 2024-09-13T02:52:28.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/58: truncate f5 7692861 0 2024-09-13T02:52:28.936 INFO:tasks.workunit.client.1.smithi142.stdout:7/37: write fe [2272047,90221] 0 2024-09-13T02:52:28.936 INFO:tasks.workunit.client.1.smithi142.stdout:6/110: truncate d1/f10 1101461 0 2024-09-13T02:52:28.937 INFO:tasks.workunit.client.1.smithi142.stdout:0/58: creat d10/f13 x:0 0 0 2024-09-13T02:52:28.940 INFO:tasks.workunit.client.1.smithi142.stdout:7/38: fsync fa 0 2024-09-13T02:52:28.941 INFO:tasks.workunit.client.1.smithi142.stdout:9/59: dread f7 [0,4194304] 0 2024-09-13T02:52:28.942 INFO:tasks.workunit.client.1.smithi142.stdout:1/68: dread f1 [0,4194304] 0 2024-09-13T02:52:28.942 INFO:tasks.workunit.client.1.smithi142.stdout:1/69: stat d12/d13 0 2024-09-13T02:52:28.943 INFO:tasks.workunit.client.1.smithi142.stdout:0/59: rename le to d10/l14 0 2024-09-13T02:52:28.943 INFO:tasks.workunit.client.1.smithi142.stdout:1/70: dread - f10 zero size 2024-09-13T02:52:28.944 INFO:tasks.workunit.client.1.smithi142.stdout:0/60: readlink l8 0 2024-09-13T02:52:28.946 INFO:tasks.workunit.client.1.smithi142.stdout:4/53: creat d0/f15 x:0 0 0 2024-09-13T02:52:28.946 INFO:tasks.workunit.client.1.smithi142.stdout:9/60: mknod dd/c14 0 2024-09-13T02:52:28.950 INFO:tasks.workunit.client.1.smithi142.stdout:6/111: dread d1/f10 [0,4194304] 0 2024-09-13T02:52:28.951 INFO:tasks.workunit.client.1.smithi142.stdout:7/39: dwrite fc [0,4194304] 0 2024-09-13T02:52:28.952 INFO:tasks.workunit.client.1.smithi142.stdout:7/40: fdatasync ff 0 2024-09-13T02:52:28.953 INFO:tasks.workunit.client.1.smithi142.stdout:7/41: fdatasync fa 0 2024-09-13T02:52:28.956 INFO:tasks.workunit.client.1.smithi142.stdout:0/61: dwrite fd [0,4194304] 0 2024-09-13T02:52:28.958 INFO:tasks.workunit.client.1.smithi142.stdout:0/62: write f9 [2114824,108349] 0 2024-09-13T02:52:28.960 INFO:tasks.workunit.client.1.smithi142.stdout:0/63: write ff [763126,32340] 0 2024-09-13T02:52:28.961 INFO:tasks.workunit.client.1.smithi142.stdout:0/64: chown d10/l12 305459 1 2024-09-13T02:52:28.963 INFO:tasks.workunit.client.1.smithi142.stdout:0/65: write d10/f13 [690632,2431] 0 2024-09-13T02:52:28.964 INFO:tasks.workunit.client.1.smithi142.stdout:7/42: dwrite f2 [4194304,4194304] 0 2024-09-13T02:52:28.964 INFO:tasks.workunit.client.1.smithi142.stdout:7/43: rmdir - no directory 2024-09-13T02:52:28.964 INFO:tasks.workunit.client.1.smithi142.stdout:7/44: read - f8 zero size 2024-09-13T02:52:28.965 INFO:tasks.workunit.client.1.smithi142.stdout:7/45: chown l9 242319 1 2024-09-13T02:52:28.966 INFO:tasks.workunit.client.1.smithi142.stdout:8/26: sync 2024-09-13T02:52:28.966 INFO:tasks.workunit.client.1.smithi142.stdout:8/27: readlink - no filename 2024-09-13T02:52:28.966 INFO:tasks.workunit.client.1.smithi142.stdout:8/28: write d0/f7 [293436,82248] 0 2024-09-13T02:52:29.004 INFO:tasks.workunit.client.1.smithi142.stdout:2/17: sync 2024-09-13T02:52:29.017 INFO:tasks.workunit.client.1.smithi142.stdout:1/71: rename fc to d12/d13/f16 0 2024-09-13T02:52:29.017 INFO:tasks.workunit.client.1.smithi142.stdout:1/72: stat c2 0 2024-09-13T02:52:29.031 INFO:tasks.workunit.client.1.smithi142.stdout:9/61: symlink dd/l15 0 2024-09-13T02:52:29.055 INFO:tasks.workunit.client.1.smithi142.stdout:6/112: write d1/f10 [1263245,15435] 0 2024-09-13T02:52:29.060 INFO:tasks.workunit.client.1.smithi142.stdout:5/70: sync 2024-09-13T02:52:29.060 INFO:tasks.workunit.client.1.smithi142.stdout:3/76: sync 2024-09-13T02:52:29.061 INFO:tasks.workunit.client.1.smithi142.stdout:5/71: chown d8/fc 0 1 2024-09-13T02:52:29.061 INFO:tasks.workunit.client.1.smithi142.stdout:0/66: chown d10/l14 11857861 1 2024-09-13T02:52:29.064 INFO:tasks.workunit.client.1.smithi142.stdout:7/46: unlink l9 0 2024-09-13T02:52:29.072 INFO:tasks.workunit.client.1.smithi142.stdout:9/62: creat dd/f16 x:0 0 0 2024-09-13T02:52:29.073 INFO:tasks.workunit.client.1.smithi142.stdout:1/73: write d12/d13/f16 [3183,117753] 0 2024-09-13T02:52:29.074 INFO:tasks.workunit.client.1.smithi142.stdout:4/54: link d0/d3/f5 d0/d3/d13/f16 0 2024-09-13T02:52:29.074 INFO:tasks.workunit.client.1.smithi142.stdout:4/55: truncate d0/f15 330621 0 2024-09-13T02:52:29.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/77: creat d12/d16/f1f x:0 0 0 2024-09-13T02:52:29.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/78: truncate d12/f19 790168 0 2024-09-13T02:52:29.080 INFO:tasks.workunit.client.1.smithi142.stdout:5/72: fdatasync f3 0 2024-09-13T02:52:29.082 INFO:tasks.workunit.client.1.smithi142.stdout:0/67: mkdir d10/d15 0 2024-09-13T02:52:29.083 INFO:tasks.workunit.client.1.smithi142.stdout:0/68: write fd [1842121,108474] 0 2024-09-13T02:52:29.083 INFO:tasks.workunit.client.1.smithi142.stdout:7/47: mkdir d10 0 2024-09-13T02:52:29.085 INFO:tasks.workunit.client.1.smithi142.stdout:8/29: fdatasync d0/f5 0 2024-09-13T02:52:29.086 INFO:tasks.workunit.client.1.smithi142.stdout:2/18: getdents d1 0 2024-09-13T02:52:29.088 INFO:tasks.workunit.client.1.smithi142.stdout:2/19: fsync d1/f4 0 2024-09-13T02:52:29.088 INFO:tasks.workunit.client.1.smithi142.stdout:9/63: mkdir dd/d17 0 2024-09-13T02:52:29.089 INFO:tasks.workunit.client.1.smithi142.stdout:5/73: dwrite d8/fd [0,4194304] 0 2024-09-13T02:52:29.090 INFO:tasks.workunit.client.1.smithi142.stdout:2/20: write d1/f4 [1941405,118042] 0 2024-09-13T02:52:29.091 INFO:tasks.workunit.client.1.smithi142.stdout:8/30: dread d0/f7 [0,4194304] 0 2024-09-13T02:52:29.091 INFO:tasks.workunit.client.1.smithi142.stdout:5/74: read d8/f15 [405126,69766] 0 2024-09-13T02:52:29.091 INFO:tasks.workunit.client.1.smithi142.stdout:9/64: truncate dd/f10 630722 0 2024-09-13T02:52:29.092 INFO:tasks.workunit.client.1.smithi142.stdout:1/74: chown l9 2 1 2024-09-13T02:52:29.095 INFO:tasks.workunit.client.1.smithi142.stdout:4/56: write d0/d3/d13/f16 [573271,93010] 0 2024-09-13T02:52:29.096 INFO:tasks.workunit.client.1.smithi142.stdout:4/57: dread - d0/d3/d9/f11 zero size 2024-09-13T02:52:29.099 INFO:tasks.workunit.client.1.smithi142.stdout:3/79: creat d12/d16/f20 x:0 0 0 2024-09-13T02:52:29.100 INFO:tasks.workunit.client.1.smithi142.stdout:3/80: fdatasync d12/d16/f20 0 2024-09-13T02:52:29.101 INFO:tasks.workunit.client.1.smithi142.stdout:3/81: fsync d12/d16/f17 0 2024-09-13T02:52:29.103 INFO:tasks.workunit.client.1.smithi142.stdout:4/58: dwrite d0/f15 [0,4194304] 0 2024-09-13T02:52:29.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/59: chown d0/d3/c12 3504022 1 2024-09-13T02:52:29.106 INFO:tasks.workunit.client.1.smithi142.stdout:4/60: write d0/d3/d9/f11 [351571,68861] 0 2024-09-13T02:52:29.110 INFO:tasks.workunit.client.1.smithi142.stdout:3/82: dwrite d12/f13 [0,4194304] 0 2024-09-13T02:52:29.111 INFO:tasks.workunit.client.1.smithi142.stdout:3/83: write d12/f1b [152945,87231] 0 2024-09-13T02:52:29.112 INFO:tasks.workunit.client.1.smithi142.stdout:3/84: write d12/f13 [2129833,25515] 0 2024-09-13T02:52:29.120 INFO:tasks.workunit.client.1.smithi142.stdout:2/21: creat d1/f5 x:0 0 0 2024-09-13T02:52:29.120 INFO:tasks.workunit.client.1.smithi142.stdout:9/65: creat dd/f18 x:0 0 0 2024-09-13T02:52:29.121 INFO:tasks.workunit.client.1.smithi142.stdout:9/66: write dd/ff [619702,114035] 0 2024-09-13T02:52:29.122 INFO:tasks.workunit.client.1.smithi142.stdout:9/67: stat dd/c14 0 2024-09-13T02:52:29.126 INFO:tasks.workunit.client.1.smithi142.stdout:2/22: dwrite d1/f4 [0,4194304] 0 2024-09-13T02:52:29.127 INFO:tasks.workunit.client.1.smithi142.stdout:2/23: write d1/f5 [330401,52245] 0 2024-09-13T02:52:29.142 INFO:tasks.workunit.client.1.smithi142.stdout:6/113: creat d1/dd/f29 x:0 0 0 2024-09-13T02:52:29.143 INFO:tasks.workunit.client.1.smithi142.stdout:0/69: mknod d10/d15/c16 0 2024-09-13T02:52:29.143 INFO:tasks.workunit.client.1.smithi142.stdout:7/48: mknod d10/c11 0 2024-09-13T02:52:29.145 INFO:tasks.workunit.client.1.smithi142.stdout:4/61: unlink d0/f15 0 2024-09-13T02:52:29.145 INFO:tasks.workunit.client.1.smithi142.stdout:2/24: dwrite d1/f4 [0,4194304] 0 2024-09-13T02:52:29.151 INFO:tasks.workunit.client.1.smithi142.stdout:3/85: unlink d12/f1b 0 2024-09-13T02:52:29.152 INFO:tasks.workunit.client.1.smithi142.stdout:3/86: write d12/d16/f17 [245282,46636] 0 2024-09-13T02:52:29.153 INFO:tasks.workunit.client.1.smithi142.stdout:3/87: dread fe [0,4194304] 0 2024-09-13T02:52:29.159 INFO:tasks.workunit.client.1.smithi142.stdout:9/68: creat dd/f19 x:0 0 0 2024-09-13T02:52:29.162 INFO:tasks.workunit.client.1.smithi142.stdout:1/75: link ff d12/d13/f17 0 2024-09-13T02:52:29.162 INFO:tasks.workunit.client.1.smithi142.stdout:1/76: write fd [776029,124082] 0 2024-09-13T02:52:29.167 INFO:tasks.workunit.client.1.smithi142.stdout:8/31: truncate d0/f5 3748098 0 2024-09-13T02:52:29.178 INFO:tasks.workunit.client.1.smithi142.stdout:5/75: dwrite f5 [0,4194304] 0 2024-09-13T02:52:29.181 INFO:tasks.workunit.client.1.smithi142.stdout:5/76: dread f5 [0,4194304] 0 2024-09-13T02:52:29.399 INFO:tasks.workunit.client.1.smithi142.stdout:0/70: mknod d10/c17 0 2024-09-13T02:52:29.399 INFO:tasks.workunit.client.1.smithi142.stdout:2/25: truncate f0 399563 0 2024-09-13T02:52:29.401 INFO:tasks.workunit.client.1.smithi142.stdout:3/88: unlink d12/c14 0 2024-09-13T02:52:29.402 INFO:tasks.workunit.client.1.smithi142.stdout:3/89: dread - d12/d16/f20 zero size 2024-09-13T02:52:29.403 INFO:tasks.workunit.client.1.smithi142.stdout:8/32: mkdir d0/d1/d8 0 2024-09-13T02:52:29.405 INFO:tasks.workunit.client.1.smithi142.stdout:5/77: mknod d8/c17 0 2024-09-13T02:52:29.407 INFO:tasks.workunit.client.1.smithi142.stdout:6/114: rmdir d1/dd/d18 39 2024-09-13T02:52:29.409 INFO:tasks.workunit.client.1.smithi142.stdout:0/71: rmdir d10/d15 39 2024-09-13T02:52:29.410 INFO:tasks.workunit.client.1.smithi142.stdout:8/33: rmdir d0 39 2024-09-13T02:52:29.411 INFO:tasks.workunit.client.1.smithi142.stdout:6/115: fdatasync d1/f25 0 2024-09-13T02:52:29.412 INFO:tasks.workunit.client.1.smithi142.stdout:5/78: rename d8/l9 to d8/l18 0 2024-09-13T02:52:29.420 INFO:tasks.workunit.client.1.smithi142.stdout:2/26: dwrite d1/f5 [0,4194304] 0 2024-09-13T02:52:29.422 INFO:tasks.workunit.client.1.smithi142.stdout:6/116: unlink d1/dd/l27 0 2024-09-13T02:52:29.423 INFO:tasks.workunit.client.1.smithi142.stdout:9/69: dwrite f7 [0,4194304] 0 2024-09-13T02:52:29.423 INFO:tasks.workunit.client.1.smithi142.stdout:3/90: dwrite d12/d16/f20 [0,4194304] 0 2024-09-13T02:52:29.425 INFO:tasks.workunit.client.1.smithi142.stdout:5/79: rename d8/f12 to d8/f19 0 2024-09-13T02:52:29.425 INFO:tasks.workunit.client.1.smithi142.stdout:5/80: fdatasync d8/fc 0 2024-09-13T02:52:29.426 INFO:tasks.workunit.client.1.smithi142.stdout:0/72: creat d10/f18 x:0 0 0 2024-09-13T02:52:29.427 INFO:tasks.workunit.client.1.smithi142.stdout:5/81: chown d8/f13 29 1 2024-09-13T02:52:29.429 INFO:tasks.workunit.client.1.smithi142.stdout:9/70: rmdir dd 39 2024-09-13T02:52:29.431 INFO:tasks.workunit.client.1.smithi142.stdout:6/117: creat d1/d7/f2a x:0 0 0 2024-09-13T02:52:29.433 INFO:tasks.workunit.client.1.smithi142.stdout:8/34: dread d0/f5 [0,4194304] 0 2024-09-13T02:52:29.437 INFO:tasks.workunit.client.1.smithi142.stdout:2/27: link d1/f4 d1/f6 0 2024-09-13T02:52:29.441 INFO:tasks.workunit.client.1.smithi142.stdout:9/71: dread dd/f10 [0,4194304] 0 2024-09-13T02:52:29.442 INFO:tasks.workunit.client.1.smithi142.stdout:5/82: dwrite f0 [0,4194304] 0 2024-09-13T02:52:29.443 INFO:tasks.workunit.client.1.smithi142.stdout:9/72: write dd/f13 [730182,26638] 0 2024-09-13T02:52:29.444 INFO:tasks.workunit.client.1.smithi142.stdout:6/118: symlink d1/dd/l2b 0 2024-09-13T02:52:29.446 INFO:tasks.workunit.client.1.smithi142.stdout:0/73: creat d10/f19 x:0 0 0 2024-09-13T02:52:29.447 INFO:tasks.workunit.client.1.smithi142.stdout:8/35: mknod d0/d6/c9 0 2024-09-13T02:52:29.448 INFO:tasks.workunit.client.1.smithi142.stdout:2/28: link d1/f6 d1/f7 0 2024-09-13T02:52:29.449 INFO:tasks.workunit.client.1.smithi142.stdout:2/29: rename d1 to d1/d8 22 2024-09-13T02:52:29.452 INFO:tasks.workunit.client.1.smithi142.stdout:9/73: creat dd/f1a x:0 0 0 2024-09-13T02:52:29.487 INFO:tasks.workunit.client.1.smithi142.stdout:9/74: readlink l1 0 2024-09-13T02:52:29.487 INFO:tasks.workunit.client.1.smithi142.stdout:8/36: creat d0/d1/fa x:0 0 0 2024-09-13T02:52:29.487 INFO:tasks.workunit.client.1.smithi142.stdout:0/74: dwrite d10/f19 [0,4194304] 0 2024-09-13T02:52:29.488 INFO:tasks.workunit.client.1.smithi142.stdout:9/75: write dd/f1a [355561,80367] 0 2024-09-13T02:52:29.492 INFO:tasks.workunit.client.1.smithi142.stdout:9/76: creat dd/f1b x:0 0 0 2024-09-13T02:52:29.492 INFO:tasks.workunit.client.1.smithi142.stdout:9/77: write f3 [2469994,56423] 0 2024-09-13T02:52:29.493 INFO:tasks.workunit.client.1.smithi142.stdout:0/75: mkdir d10/d15/d1a 0 2024-09-13T02:52:29.496 INFO:tasks.workunit.client.1.smithi142.stdout:9/78: creat dd/f1c x:0 0 0 2024-09-13T02:52:29.497 INFO:tasks.workunit.client.1.smithi142.stdout:0/76: symlink d10/d15/l1b 0 2024-09-13T02:52:29.498 INFO:tasks.workunit.client.1.smithi142.stdout:9/79: creat dd/f1d x:0 0 0 2024-09-13T02:52:29.500 INFO:tasks.workunit.client.1.smithi142.stdout:0/77: symlink d10/d15/l1c 0 2024-09-13T02:52:29.502 INFO:tasks.workunit.client.1.smithi142.stdout:9/80: symlink dd/d17/l1e 0 2024-09-13T02:52:29.502 INFO:tasks.workunit.client.1.smithi142.stdout:9/81: readlink l2 0 2024-09-13T02:52:29.506 INFO:tasks.workunit.client.1.smithi142.stdout:0/78: dwrite d10/f13 [0,4194304] 0 2024-09-13T02:52:29.507 INFO:tasks.workunit.client.1.smithi142.stdout:0/79: chown d10/l14 1944074 1 2024-09-13T02:52:29.507 INFO:tasks.workunit.client.1.smithi142.stdout:0/80: write d10/f13 [2325295,898] 0 2024-09-13T02:52:29.510 INFO:tasks.workunit.client.1.smithi142.stdout:0/81: unlink d10/f18 0 2024-09-13T02:52:29.514 INFO:tasks.workunit.client.1.smithi142.stdout:0/82: dread f9 [0,4194304] 0 2024-09-13T02:52:29.515 INFO:tasks.workunit.client.1.smithi142.stdout:0/83: write ff [1839409,128988] 0 2024-09-13T02:52:29.517 INFO:tasks.workunit.client.1.smithi142.stdout:0/84: mknod d10/d15/d1a/c1d 0 2024-09-13T02:52:29.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/85: write f9 [379252,33462] 0 2024-09-13T02:52:29.520 INFO:tasks.workunit.client.1.smithi142.stdout:0/86: mkdir d10/d15/d1a/d1e 0 2024-09-13T02:52:29.522 INFO:tasks.workunit.client.1.smithi142.stdout:0/87: mknod d10/c1f 0 2024-09-13T02:52:29.523 INFO:tasks.workunit.client.1.smithi142.stdout:0/88: write d10/f13 [1908430,12856] 0 2024-09-13T02:52:29.529 INFO:tasks.workunit.client.1.smithi142.stdout:0/89: dwrite d10/f19 [0,4194304] 0 2024-09-13T02:52:29.531 INFO:tasks.workunit.client.1.smithi142.stdout:0/90: mknod d10/d15/d1a/c20 0 2024-09-13T02:52:29.532 INFO:tasks.workunit.client.1.smithi142.stdout:0/91: read ff [516575,67913] 0 2024-09-13T02:52:29.534 INFO:tasks.workunit.client.1.smithi142.stdout:0/92: mkdir d10/d15/d21 0 2024-09-13T02:52:29.538 INFO:tasks.workunit.client.1.smithi142.stdout:0/93: creat d10/d15/d1a/f22 x:0 0 0 2024-09-13T02:52:29.541 INFO:tasks.workunit.client.1.smithi142.stdout:0/94: mkdir d10/d23 0 2024-09-13T02:52:29.541 INFO:tasks.workunit.client.1.smithi142.stdout:0/95: read fd [1362999,33591] 0 2024-09-13T02:52:29.545 INFO:tasks.workunit.client.1.smithi142.stdout:0/96: dread d10/f13 [0,4194304] 0 2024-09-13T02:52:29.545 INFO:tasks.workunit.client.1.smithi142.stdout:0/97: dread - d10/d15/d1a/f22 zero size 2024-09-13T02:52:29.548 INFO:tasks.workunit.client.1.smithi142.stdout:0/98: symlink d10/l24 0 2024-09-13T02:52:29.549 INFO:tasks.workunit.client.1.smithi142.stdout:0/99: creat d10/d23/f25 x:0 0 0 2024-09-13T02:52:29.552 INFO:tasks.workunit.client.1.smithi142.stdout:0/100: getdents d10/d15/d1a/d1e 0 2024-09-13T02:52:29.553 INFO:tasks.workunit.client.1.smithi142.stdout:0/101: mknod d10/d15/c26 0 2024-09-13T02:52:29.554 INFO:tasks.workunit.client.1.smithi142.stdout:0/102: chown d10/l14 162264643 1 2024-09-13T02:52:29.554 INFO:tasks.workunit.client.1.smithi142.stdout:0/103: chown d10/d15 0 1 2024-09-13T02:52:29.555 INFO:tasks.workunit.client.1.smithi142.stdout:0/104: symlink d10/d15/l27 0 2024-09-13T02:52:29.572 INFO:tasks.workunit.client.1.smithi142.stdout:7/49: truncate f2 2167054 0 2024-09-13T02:52:29.573 INFO:tasks.workunit.client.1.smithi142.stdout:4/62: truncate d0/d3/f5 1440709 0 2024-09-13T02:52:29.573 INFO:tasks.workunit.client.1.smithi142.stdout:1/77: dwrite ff [0,4194304] 0 2024-09-13T02:52:29.574 INFO:tasks.workunit.client.1.smithi142.stdout:1/78: chown ca 6352 1 2024-09-13T02:52:29.575 INFO:tasks.workunit.client.1.smithi142.stdout:7/50: rmdir d10 39 2024-09-13T02:52:29.576 INFO:tasks.workunit.client.1.smithi142.stdout:4/63: unlink d0/fd 0 2024-09-13T02:52:29.577 INFO:tasks.workunit.client.1.smithi142.stdout:4/64: readlink d0/d3/la 0 2024-09-13T02:52:29.577 INFO:tasks.workunit.client.1.smithi142.stdout:4/65: stat d0/d3/f7 0 2024-09-13T02:52:29.578 INFO:tasks.workunit.client.1.smithi142.stdout:4/66: stat d0/f8 0 2024-09-13T02:52:29.582 INFO:tasks.workunit.client.1.smithi142.stdout:7/51: symlink d10/l12 0 2024-09-13T02:52:29.584 INFO:tasks.workunit.client.1.smithi142.stdout:1/79: dwrite f1 [0,4194304] 0 2024-09-13T02:52:29.584 INFO:tasks.workunit.client.1.smithi142.stdout:3/91: write fc [3844831,116137] 0 2024-09-13T02:52:29.587 INFO:tasks.workunit.client.1.smithi142.stdout:1/80: write f5 [2417702,113402] 0 2024-09-13T02:52:29.587 INFO:tasks.workunit.client.1.smithi142.stdout:3/92: truncate d12/d16/f1f 178840 0 2024-09-13T02:52:29.587 INFO:tasks.workunit.client.1.smithi142.stdout:7/52: mkdir d10/d13 0 2024-09-13T02:52:29.588 INFO:tasks.workunit.client.1.smithi142.stdout:7/53: truncate ff 661530 0 2024-09-13T02:52:29.589 INFO:tasks.workunit.client.1.smithi142.stdout:1/81: rename cb to d12/d13/c18 0 2024-09-13T02:52:29.591 INFO:tasks.workunit.client.1.smithi142.stdout:3/93: creat d12/d16/f21 x:0 0 0 2024-09-13T02:52:29.592 INFO:tasks.workunit.client.1.smithi142.stdout:3/94: write d12/f13 [3824209,18726] 0 2024-09-13T02:52:29.592 INFO:tasks.workunit.client.1.smithi142.stdout:3/95: truncate fe 1498281 0 2024-09-13T02:52:29.594 INFO:tasks.workunit.client.1.smithi142.stdout:1/82: creat d12/d13/f19 x:0 0 0 2024-09-13T02:52:29.599 INFO:tasks.workunit.client.1.smithi142.stdout:2/30: write d1/f5 [4348420,102867] 0 2024-09-13T02:52:29.599 INFO:tasks.workunit.client.1.smithi142.stdout:2/31: readlink - no filename 2024-09-13T02:52:29.600 INFO:tasks.workunit.client.1.smithi142.stdout:8/37: write d0/f7 [613533,85908] 0 2024-09-13T02:52:29.600 INFO:tasks.workunit.client.1.smithi142.stdout:5/83: dwrite f5 [4194304,4194304] 0 2024-09-13T02:52:29.601 INFO:tasks.workunit.client.1.smithi142.stdout:5/84: fsync d8/fc 0 2024-09-13T02:52:29.648 INFO:tasks.workunit.client.1.smithi142.stdout:8/38: creat d0/fb x:0 0 0 2024-09-13T02:52:29.649 INFO:tasks.workunit.client.1.smithi142.stdout:8/39: chown d0/d6/c9 2 1 2024-09-13T02:52:29.649 INFO:tasks.workunit.client.1.smithi142.stdout:8/40: chown d0/fb 13192 1 2024-09-13T02:52:29.649 INFO:tasks.workunit.client.1.smithi142.stdout:8/41: readlink - no filename 2024-09-13T02:52:29.649 INFO:tasks.workunit.client.1.smithi142.stdout:0/105: truncate d10/f13 1610713 0 2024-09-13T02:52:29.651 INFO:tasks.workunit.client.1.smithi142.stdout:3/96: rmdir d12/d16 39 2024-09-13T02:52:29.651 INFO:tasks.workunit.client.1.smithi142.stdout:5/85: dread f3 [0,4194304] 0 2024-09-13T02:52:29.652 INFO:tasks.workunit.client.1.smithi142.stdout:4/67: dread d0/d3/f5 [0,4194304] 0 2024-09-13T02:52:29.653 INFO:tasks.workunit.client.1.smithi142.stdout:7/54: truncate fe 1846694 0 2024-09-13T02:52:29.653 INFO:tasks.workunit.client.1.smithi142.stdout:4/68: chown d0/d3 64 1 2024-09-13T02:52:29.655 INFO:tasks.workunit.client.1.smithi142.stdout:5/86: mknod d8/c1a 0 2024-09-13T02:52:29.655 INFO:tasks.workunit.client.1.smithi142.stdout:3/97: write fe [1381496,122802] 0 2024-09-13T02:52:29.657 INFO:tasks.workunit.client.1.smithi142.stdout:0/106: getdents d10/d15/d1a/d1e 0 2024-09-13T02:52:29.659 INFO:tasks.workunit.client.1.smithi142.stdout:5/87: creat d8/f1b x:0 0 0 2024-09-13T02:52:29.659 INFO:tasks.workunit.client.1.smithi142.stdout:4/69: truncate d0/d3/f5 2353263 0 2024-09-13T02:52:29.664 INFO:tasks.workunit.client.1.smithi142.stdout:0/107: mkdir d10/d15/d1a/d28 0 2024-09-13T02:52:29.665 INFO:tasks.workunit.client.1.smithi142.stdout:8/42: dwrite d0/f7 [0,4194304] 0 2024-09-13T02:52:29.665 INFO:tasks.workunit.client.1.smithi142.stdout:4/70: fsync d0/f14 0 2024-09-13T02:52:29.665 INFO:tasks.workunit.client.1.smithi142.stdout:5/88: write d8/f10 [4065041,42169] 0 2024-09-13T02:52:29.665 INFO:tasks.workunit.client.1.smithi142.stdout:2/32: dwrite d1/f6 [0,4194304] 0 2024-09-13T02:52:29.665 INFO:tasks.workunit.client.1.smithi142.stdout:7/55: dread fa [0,4194304] 0 2024-09-13T02:52:29.665 INFO:tasks.workunit.client.1.smithi142.stdout:3/98: link d12/d16/f21 d12/f22 0 2024-09-13T02:52:29.666 INFO:tasks.workunit.client.1.smithi142.stdout:5/89: fsync d8/f10 0 2024-09-13T02:52:29.666 INFO:tasks.workunit.client.1.smithi142.stdout:8/43: mkdir d0/d6/dc 0 2024-09-13T02:52:29.666 INFO:tasks.workunit.client.1.smithi142.stdout:8/44: readlink - no filename 2024-09-13T02:52:29.669 INFO:tasks.workunit.client.1.smithi142.stdout:4/71: creat d0/df/f17 x:0 0 0 2024-09-13T02:52:29.669 INFO:tasks.workunit.client.1.smithi142.stdout:8/45: write d0/fb [624831,78661] 0 2024-09-13T02:52:29.670 INFO:tasks.workunit.client.1.smithi142.stdout:2/33: link d1/f4 d1/f9 0 2024-09-13T02:52:29.671 INFO:tasks.workunit.client.1.smithi142.stdout:3/99: chown d12/l1e 1 1 2024-09-13T02:52:29.671 INFO:tasks.workunit.client.1.smithi142.stdout:4/72: readlink d0/d3/la 0 2024-09-13T02:52:29.675 INFO:tasks.workunit.client.1.smithi142.stdout:2/34: creat d1/fa x:0 0 0 2024-09-13T02:52:29.675 INFO:tasks.workunit.client.1.smithi142.stdout:0/108: dwrite f9 [0,4194304] 0 2024-09-13T02:52:29.679 INFO:tasks.workunit.client.1.smithi142.stdout:2/35: dread - d1/fa zero size 2024-09-13T02:52:29.681 INFO:tasks.workunit.client.1.smithi142.stdout:3/100: dread d12/d16/f17 [0,4194304] 0 2024-09-13T02:52:29.681 INFO:tasks.workunit.client.1.smithi142.stdout:3/101: readlink l7 0 2024-09-13T02:52:29.683 INFO:tasks.workunit.client.1.smithi142.stdout:5/90: dwrite d8/fd [0,4194304] 0 2024-09-13T02:52:29.686 INFO:tasks.workunit.client.1.smithi142.stdout:0/109: mknod d10/d23/c29 0 2024-09-13T02:52:29.686 INFO:tasks.workunit.client.1.smithi142.stdout:3/102: dread d12/d16/f17 [0,4194304] 0 2024-09-13T02:52:29.687 INFO:tasks.workunit.client.1.smithi142.stdout:3/103: readlink l7 0 2024-09-13T02:52:29.687 INFO:tasks.workunit.client.1.smithi142.stdout:5/91: creat d8/f1c x:0 0 0 2024-09-13T02:52:29.688 INFO:tasks.workunit.client.1.smithi142.stdout:0/110: creat d10/d23/f2a x:0 0 0 2024-09-13T02:52:29.689 INFO:tasks.workunit.client.1.smithi142.stdout:0/111: fsync d10/d15/d1a/f22 0 2024-09-13T02:52:29.691 INFO:tasks.workunit.client.1.smithi142.stdout:5/92: unlink d8/la 0 2024-09-13T02:52:29.693 INFO:tasks.workunit.client.1.smithi142.stdout:7/56: write f2 [957500,104894] 0 2024-09-13T02:52:29.693 INFO:tasks.workunit.client.1.smithi142.stdout:0/112: symlink d10/d15/d1a/d28/l2b 0 2024-09-13T02:52:29.696 INFO:tasks.workunit.client.1.smithi142.stdout:0/113: chown d10/d23/f25 5864 1 2024-09-13T02:52:29.696 INFO:tasks.workunit.client.1.smithi142.stdout:2/36: dwrite d1/f4 [4194304,4194304] 0 2024-09-13T02:52:29.696 INFO:tasks.workunit.client.1.smithi142.stdout:7/57: mknod d10/c14 0 2024-09-13T02:52:29.701 INFO:tasks.workunit.client.1.smithi142.stdout:2/37: dread f0 [0,4194304] 0 2024-09-13T02:52:29.701 INFO:tasks.workunit.client.1.smithi142.stdout:9/82: sync 2024-09-13T02:52:29.702 INFO:tasks.workunit.client.1.smithi142.stdout:0/114: symlink d10/d15/l2c 0 2024-09-13T02:52:29.702 INFO:tasks.workunit.client.1.smithi142.stdout:6/119: sync 2024-09-13T02:52:29.703 INFO:tasks.workunit.client.1.smithi142.stdout:2/38: write d1/f3 [3890023,60078] 0 2024-09-13T02:52:29.703 INFO:tasks.workunit.client.1.smithi142.stdout:7/58: dread fc [0,4194304] 0 2024-09-13T02:52:29.704 INFO:tasks.workunit.client.1.smithi142.stdout:9/83: creat dd/f1f x:0 0 0 2024-09-13T02:52:29.705 INFO:tasks.workunit.client.1.smithi142.stdout:7/59: read fd [2500374,1509] 0 2024-09-13T02:52:29.705 INFO:tasks.workunit.client.1.smithi142.stdout:8/46: truncate d0/f7 2984898 0 2024-09-13T02:52:29.706 INFO:tasks.workunit.client.1.smithi142.stdout:0/115: creat d10/d15/f2d x:0 0 0 2024-09-13T02:52:29.708 INFO:tasks.workunit.client.1.smithi142.stdout:6/120: creat d1/dd/d16/f2c x:0 0 0 2024-09-13T02:52:29.708 INFO:tasks.workunit.client.1.smithi142.stdout:4/73: truncate d0/f8 5226322 0 2024-09-13T02:52:29.709 INFO:tasks.workunit.client.1.smithi142.stdout:4/74: dread - d0/f14 zero size 2024-09-13T02:52:29.710 INFO:tasks.workunit.client.1.smithi142.stdout:2/39: rename d1/f3 to d1/fb 0 2024-09-13T02:52:29.712 INFO:tasks.workunit.client.1.smithi142.stdout:5/93: getdents d8 0 2024-09-13T02:52:29.713 INFO:tasks.workunit.client.1.smithi142.stdout:5/94: dread - d8/f13 zero size 2024-09-13T02:52:29.715 INFO:tasks.workunit.client.1.smithi142.stdout:6/121: dwrite d1/dd/f26 [0,4194304] 0 2024-09-13T02:52:29.715 INFO:tasks.workunit.client.1.smithi142.stdout:7/60: mknod d10/d13/c15 0 2024-09-13T02:52:29.717 INFO:tasks.workunit.client.1.smithi142.stdout:8/47: symlink d0/d6/dc/ld 0 2024-09-13T02:52:29.718 INFO:tasks.workunit.client.1.smithi142.stdout:0/116: mknod d10/c2e 0 2024-09-13T02:52:29.719 INFO:tasks.workunit.client.1.smithi142.stdout:9/84: fsync dd/f1f 0 2024-09-13T02:52:29.723 INFO:tasks.workunit.client.1.smithi142.stdout:9/85: symlink dd/l20 0 2024-09-13T02:52:29.726 INFO:tasks.workunit.client.1.smithi142.stdout:7/61: dwrite fa [0,4194304] 0 2024-09-13T02:52:29.728 INFO:tasks.workunit.client.1.smithi142.stdout:4/75: dread d0/f8 [0,4194304] 0 2024-09-13T02:52:29.732 INFO:tasks.workunit.client.1.smithi142.stdout:6/122: mkdir d1/dd/d2d 0 2024-09-13T02:52:29.733 INFO:tasks.workunit.client.1.smithi142.stdout:6/123: stat d1/d7/f24 0 2024-09-13T02:52:29.735 INFO:tasks.workunit.client.1.smithi142.stdout:8/48: link d0/fb d0/d6/dc/fe 0 2024-09-13T02:52:29.736 INFO:tasks.workunit.client.1.smithi142.stdout:8/49: write d0/d1/fa [232202,42059] 0 2024-09-13T02:52:29.736 INFO:tasks.workunit.client.1.smithi142.stdout:9/86: symlink dd/d17/l21 0 2024-09-13T02:52:29.738 INFO:tasks.workunit.client.1.smithi142.stdout:7/62: creat d10/f16 x:0 0 0 2024-09-13T02:52:29.738 INFO:tasks.workunit.client.1.smithi142.stdout:4/76: rmdir d0/df 39 2024-09-13T02:52:29.738 INFO:tasks.workunit.client.1.smithi142.stdout:7/63: stat d10/c14 0 2024-09-13T02:52:29.739 INFO:tasks.workunit.client.1.smithi142.stdout:7/64: truncate ff 1395228 0 2024-09-13T02:52:29.741 INFO:tasks.workunit.client.1.smithi142.stdout:5/95: write d8/f15 [3833769,39588] 0 2024-09-13T02:52:29.741 INFO:tasks.workunit.client.1.smithi142.stdout:9/87: mknod dd/c22 0 2024-09-13T02:52:29.742 INFO:tasks.workunit.client.1.smithi142.stdout:5/96: write d8/fe [635452,53827] 0 2024-09-13T02:52:29.742 INFO:tasks.workunit.client.1.smithi142.stdout:7/65: creat d10/f17 x:0 0 0 2024-09-13T02:52:29.744 INFO:tasks.workunit.client.1.smithi142.stdout:6/124: creat d1/f2e x:0 0 0 2024-09-13T02:52:29.744 INFO:tasks.workunit.client.1.smithi142.stdout:6/125: write d1/dd/d16/f2c [878605,40835] 0 2024-09-13T02:52:29.749 INFO:tasks.workunit.client.1.smithi142.stdout:5/97: mknod d8/c1d 0 2024-09-13T02:52:29.751 INFO:tasks.workunit.client.1.smithi142.stdout:7/66: symlink d10/d13/l18 0 2024-09-13T02:52:29.753 INFO:tasks.workunit.client.1.smithi142.stdout:6/126: rename d1/d7/f9 to d1/d7/d19/f2f 0 2024-09-13T02:52:29.754 INFO:tasks.workunit.client.1.smithi142.stdout:8/50: dwrite d0/d1/f3 [0,4194304] 0 2024-09-13T02:52:29.755 INFO:tasks.workunit.client.1.smithi142.stdout:5/98: rmdir d8 39 2024-09-13T02:52:29.758 INFO:tasks.workunit.client.1.smithi142.stdout:8/51: dread d0/d6/dc/fe [0,4194304] 0 2024-09-13T02:52:29.758 INFO:tasks.workunit.client.1.smithi142.stdout:7/67: symlink d10/d13/l19 0 2024-09-13T02:52:29.759 INFO:tasks.workunit.client.1.smithi142.stdout:4/77: truncate d0/d3/d9/f11 192165 0 2024-09-13T02:52:29.759 INFO:tasks.workunit.client.1.smithi142.stdout:4/78: chown d0/d3/f7 165 1 2024-09-13T02:52:29.760 INFO:tasks.workunit.client.1.smithi142.stdout:6/127: mkdir d1/d7/d19/d30 0 2024-09-13T02:52:29.760 INFO:tasks.workunit.client.1.smithi142.stdout:9/88: link dd/d17/l21 dd/l23 0 2024-09-13T02:52:29.763 INFO:tasks.workunit.client.1.smithi142.stdout:4/79: dread d0/d3/f5 [0,4194304] 0 2024-09-13T02:52:29.764 INFO:tasks.workunit.client.1.smithi142.stdout:5/99: fdatasync d8/f15 0 2024-09-13T02:52:29.766 INFO:tasks.workunit.client.1.smithi142.stdout:5/100: chown d8/c14 253 1 2024-09-13T02:52:29.766 INFO:tasks.workunit.client.1.smithi142.stdout:7/68: unlink l6 0 2024-09-13T02:52:29.769 INFO:tasks.workunit.client.1.smithi142.stdout:9/89: dwrite f3 [4194304,4194304] 0 2024-09-13T02:52:29.772 INFO:tasks.workunit.client.1.smithi142.stdout:4/80: dread - d0/df/f17 zero size 2024-09-13T02:52:29.772 INFO:tasks.workunit.client.1.smithi142.stdout:9/90: fdatasync dd/ff 0 2024-09-13T02:52:29.810 INFO:tasks.workunit.client.1.smithi142.stdout:1/83: sync 2024-09-13T02:52:29.822 INFO:tasks.workunit.client.1.smithi142.stdout:8/52: getdents d0/d6/dc 0 2024-09-13T02:52:29.824 INFO:tasks.workunit.client.1.smithi142.stdout:9/91: mknod dd/c24 0 2024-09-13T02:52:29.824 INFO:tasks.workunit.client.1.smithi142.stdout:1/84: truncate fe 796865 0 2024-09-13T02:52:29.825 INFO:tasks.workunit.client.1.smithi142.stdout:4/81: mknod d0/c18 0 2024-09-13T02:52:29.828 INFO:tasks.workunit.client.1.smithi142.stdout:8/53: mkdir d0/d1/d8/df 0 2024-09-13T02:52:29.828 INFO:tasks.workunit.client.1.smithi142.stdout:5/101: dwrite d8/f15 [4194304,4194304] 0 2024-09-13T02:52:29.828 INFO:tasks.workunit.client.1.smithi142.stdout:4/82: chown d0/f8 1275 1 2024-09-13T02:52:29.828 INFO:tasks.workunit.client.1.smithi142.stdout:9/92: mkdir dd/d17/d25 0 2024-09-13T02:52:29.829 INFO:tasks.workunit.client.1.smithi142.stdout:7/69: dwrite fd [4194304,4194304] 0 2024-09-13T02:52:29.831 INFO:tasks.workunit.client.1.smithi142.stdout:5/102: write d8/f1b [803182,29822] 0 2024-09-13T02:52:29.831 INFO:tasks.workunit.client.1.smithi142.stdout:8/54: fsync d0/d1/fa 0 2024-09-13T02:52:29.833 INFO:tasks.workunit.client.1.smithi142.stdout:7/70: write fe [592358,13427] 0 2024-09-13T02:52:29.833 INFO:tasks.workunit.client.1.smithi142.stdout:4/83: write d0/f14 [27331,121151] 0 2024-09-13T02:52:29.833 INFO:tasks.workunit.client.1.smithi142.stdout:9/93: creat dd/d17/f26 x:0 0 0 2024-09-13T02:52:29.833 INFO:tasks.workunit.client.1.smithi142.stdout:1/85: dread fd [0,4194304] 0 2024-09-13T02:52:29.834 INFO:tasks.workunit.client.1.smithi142.stdout:5/103: fsync d8/fe 0 2024-09-13T02:52:29.835 INFO:tasks.workunit.client.1.smithi142.stdout:7/71: chown ff 1973 1 2024-09-13T02:52:29.839 INFO:tasks.workunit.client.1.smithi142.stdout:7/72: mknod d10/d13/c1a 0 2024-09-13T02:52:29.841 INFO:tasks.workunit.client.1.smithi142.stdout:4/84: symlink d0/d3/d13/l19 0 2024-09-13T02:52:29.842 INFO:tasks.workunit.client.1.smithi142.stdout:1/86: link l9 d12/d13/l1a 0 2024-09-13T02:52:29.846 INFO:tasks.workunit.client.1.smithi142.stdout:7/73: write fc [3133516,104739] 0 2024-09-13T02:52:29.848 INFO:tasks.workunit.client.1.smithi142.stdout:4/85: creat d0/d3/d13/f1a x:0 0 0 2024-09-13T02:52:29.849 INFO:tasks.workunit.client.1.smithi142.stdout:7/74: fsync ff 0 2024-09-13T02:52:29.851 INFO:tasks.workunit.client.1.smithi142.stdout:5/104: dwrite d8/f1c [0,4194304] 0 2024-09-13T02:52:29.851 INFO:tasks.workunit.client.1.smithi142.stdout:9/94: dwrite dd/f1a [0,4194304] 0 2024-09-13T02:52:29.852 INFO:tasks.workunit.client.1.smithi142.stdout:8/55: write d0/d6/dc/fe [529101,92487] 0 2024-09-13T02:52:29.856 INFO:tasks.workunit.client.1.smithi142.stdout:7/75: fdatasync fd 0 2024-09-13T02:52:29.858 INFO:tasks.workunit.client.1.smithi142.stdout:4/86: rename d0/d3/f5 to d0/d3/d13/f1b 0 2024-09-13T02:52:29.863 INFO:tasks.workunit.client.1.smithi142.stdout:8/56: dread d0/d1/f3 [0,4194304] 0 2024-09-13T02:52:29.865 INFO:tasks.workunit.client.1.smithi142.stdout:5/105: truncate f0 4082135 0 2024-09-13T02:52:29.866 INFO:tasks.workunit.client.1.smithi142.stdout:7/76: dread fc [0,4194304] 0 2024-09-13T02:52:29.866 INFO:tasks.workunit.client.1.smithi142.stdout:1/87: truncate f5 1736349 0 2024-09-13T02:52:29.867 INFO:tasks.workunit.client.1.smithi142.stdout:8/57: creat d0/d1/f10 x:0 0 0 2024-09-13T02:52:29.868 INFO:tasks.workunit.client.1.smithi142.stdout:7/77: chown fc 0 1 2024-09-13T02:52:29.869 INFO:tasks.workunit.client.1.smithi142.stdout:5/106: creat d8/f1e x:0 0 0 2024-09-13T02:52:29.873 INFO:tasks.workunit.client.1.smithi142.stdout:7/78: dread - f8 zero size 2024-09-13T02:52:29.873 INFO:tasks.workunit.client.1.smithi142.stdout:1/88: mkdir d12/d1b 0 2024-09-13T02:52:29.873 INFO:tasks.workunit.client.1.smithi142.stdout:4/87: dwrite d0/df/f17 [0,4194304] 0 2024-09-13T02:52:29.873 INFO:tasks.workunit.client.1.smithi142.stdout:8/58: read d0/f5 [1842052,52981] 0 2024-09-13T02:52:29.873 INFO:tasks.workunit.client.1.smithi142.stdout:1/89: stat l4 0 2024-09-13T02:52:29.873 INFO:tasks.workunit.client.1.smithi142.stdout:1/90: dread - f10 zero size 2024-09-13T02:52:29.873 INFO:tasks.workunit.client.1.smithi142.stdout:7/79: write f8 [561474,28844] 0 2024-09-13T02:52:29.874 INFO:tasks.workunit.client.1.smithi142.stdout:5/107: creat d8/f1f x:0 0 0 2024-09-13T02:52:29.875 INFO:tasks.workunit.client.1.smithi142.stdout:4/88: unlink d0/d3/d13/f1b 0 2024-09-13T02:52:29.877 INFO:tasks.workunit.client.1.smithi142.stdout:1/91: rmdir d12 39 2024-09-13T02:52:29.882 INFO:tasks.workunit.client.1.smithi142.stdout:7/80: dwrite f2 [0,4194304] 0 2024-09-13T02:52:29.882 INFO:tasks.workunit.client.1.smithi142.stdout:5/108: dwrite d8/f10 [0,4194304] 0 2024-09-13T02:52:29.891 INFO:tasks.workunit.client.1.smithi142.stdout:5/109: chown l6 2 1 2024-09-13T02:52:29.892 INFO:tasks.workunit.client.1.smithi142.stdout:8/59: link d0/d6/dc/ld d0/d6/l11 0 2024-09-13T02:52:29.893 INFO:tasks.workunit.client.1.smithi142.stdout:7/81: mknod d10/d13/c1b 0 2024-09-13T02:52:29.893 INFO:tasks.workunit.client.1.smithi142.stdout:8/60: fdatasync d0/d1/f10 0 2024-09-13T02:52:29.896 INFO:tasks.workunit.client.1.smithi142.stdout:7/82: write f2 [3381320,103461] 0 2024-09-13T02:52:29.896 INFO:tasks.workunit.client.1.smithi142.stdout:1/92: symlink d12/d1b/l1c 0 2024-09-13T02:52:29.901 INFO:tasks.workunit.client.1.smithi142.stdout:5/110: dwrite d8/f1f [0,4194304] 0 2024-09-13T02:52:29.901 INFO:tasks.workunit.client.1.smithi142.stdout:5/111: readlink d8/l18 0 2024-09-13T02:52:29.906 INFO:tasks.workunit.client.1.smithi142.stdout:5/112: dread d8/f1f [0,4194304] 0 2024-09-13T02:52:29.906 INFO:tasks.workunit.client.1.smithi142.stdout:5/113: stat d8/l18 0 2024-09-13T02:52:29.907 INFO:tasks.workunit.client.1.smithi142.stdout:5/114: write d8/f19 [8978317,28834] 0 2024-09-13T02:52:29.945 INFO:tasks.workunit.client.1.smithi142.stdout:3/104: sync 2024-09-13T02:52:29.948 INFO:tasks.workunit.client.1.smithi142.stdout:3/105: dread fc [0,4194304] 0 2024-09-13T02:52:29.993 INFO:tasks.workunit.client.1.smithi142.stdout:3/106: chown c5 0 1 2024-09-13T02:52:29.994 INFO:tasks.workunit.client.1.smithi142.stdout:5/115: link f3 d8/f20 0 2024-09-13T02:52:30.000 INFO:tasks.workunit.client.1.smithi142.stdout:4/89: dwrite d0/d3/d9/f11 [0,4194304] 0 2024-09-13T02:52:30.003 INFO:tasks.workunit.client.1.smithi142.stdout:1/93: truncate d12/d13/f17 1362034 0 2024-09-13T02:52:30.005 INFO:tasks.workunit.client.1.smithi142.stdout:4/90: symlink d0/df/l1c 0 2024-09-13T02:52:30.007 INFO:tasks.workunit.client.1.smithi142.stdout:2/40: sync 2024-09-13T02:52:30.007 INFO:tasks.workunit.client.1.smithi142.stdout:0/117: sync 2024-09-13T02:52:30.007 INFO:tasks.workunit.client.1.smithi142.stdout:7/83: dwrite fe [4194304,4194304] 0 2024-09-13T02:52:30.007 INFO:tasks.workunit.client.1.smithi142.stdout:3/107: dread fc [0,4194304] 0 2024-09-13T02:52:30.008 INFO:tasks.workunit.client.1.smithi142.stdout:1/94: chown d12/d13/l1a 24788595 1 2024-09-13T02:52:30.008 INFO:tasks.workunit.client.1.smithi142.stdout:3/108: readlink l6 0 2024-09-13T02:52:30.009 INFO:tasks.workunit.client.1.smithi142.stdout:4/91: dread d0/f14 [0,4194304] 0 2024-09-13T02:52:30.014 INFO:tasks.workunit.client.1.smithi142.stdout:1/95: write fd [318867,127403] 0 2024-09-13T02:52:30.014 INFO:tasks.workunit.client.1.smithi142.stdout:7/84: creat d10/d13/f1c x:0 0 0 2024-09-13T02:52:30.016 INFO:tasks.workunit.client.1.smithi142.stdout:1/96: readlink d12/d13/l1a 0 2024-09-13T02:52:30.017 INFO:tasks.workunit.client.1.smithi142.stdout:2/41: dread d1/f5 [0,4194304] 0 2024-09-13T02:52:30.017 INFO:tasks.workunit.client.1.smithi142.stdout:3/109: dread d12/d16/f20 [0,4194304] 0 2024-09-13T02:52:30.018 INFO:tasks.workunit.client.1.smithi142.stdout:7/85: dread ff [0,4194304] 0 2024-09-13T02:52:30.019 INFO:tasks.workunit.client.1.smithi142.stdout:0/118: getdents d10/d15/d21 0 2024-09-13T02:52:30.020 INFO:tasks.workunit.client.1.smithi142.stdout:3/110: unlink fc 0 2024-09-13T02:52:30.021 INFO:tasks.workunit.client.1.smithi142.stdout:0/119: write d10/f19 [1962213,56061] 0 2024-09-13T02:52:30.021 INFO:tasks.workunit.client.1.smithi142.stdout:1/97: mkdir d12/d13/d1d 0 2024-09-13T02:52:30.024 INFO:tasks.workunit.client.1.smithi142.stdout:0/120: write d10/d23/f2a [928690,82844] 0 2024-09-13T02:52:30.024 INFO:tasks.workunit.client.1.smithi142.stdout:7/86: mkdir d10/d13/d1d 0 2024-09-13T02:52:30.025 INFO:tasks.workunit.client.1.smithi142.stdout:2/42: dwrite d1/f4 [0,4194304] 0 2024-09-13T02:52:30.025 INFO:tasks.workunit.client.1.smithi142.stdout:0/121: chown d10 160 1 2024-09-13T02:52:30.026 INFO:tasks.workunit.client.1.smithi142.stdout:4/92: mknod d0/d3/d13/c1d 0 2024-09-13T02:52:30.028 INFO:tasks.workunit.client.1.smithi142.stdout:2/43: unlink d1/f2 0 2024-09-13T02:52:30.028 INFO:tasks.workunit.client.1.smithi142.stdout:2/44: readlink - no filename 2024-09-13T02:52:30.032 INFO:tasks.workunit.client.1.smithi142.stdout:0/122: creat d10/d23/f2f x:0 0 0 2024-09-13T02:52:30.032 INFO:tasks.workunit.client.1.smithi142.stdout:1/98: dwrite fd [0,4194304] 0 2024-09-13T02:52:30.033 INFO:tasks.workunit.client.1.smithi142.stdout:1/99: truncate f10 472114 0 2024-09-13T02:52:30.033 INFO:tasks.workunit.client.1.smithi142.stdout:7/87: creat d10/d13/f1e x:0 0 0 2024-09-13T02:52:30.034 INFO:tasks.workunit.client.1.smithi142.stdout:7/88: readlink d10/d13/l19 0 2024-09-13T02:52:30.035 INFO:tasks.workunit.client.1.smithi142.stdout:4/93: write d0/f14 [1162957,111238] 0 2024-09-13T02:52:30.038 INFO:tasks.workunit.client.1.smithi142.stdout:3/111: link l11 d12/d16/l23 0 2024-09-13T02:52:30.039 INFO:tasks.workunit.client.1.smithi142.stdout:3/112: readlink l7 0 2024-09-13T02:52:30.039 INFO:tasks.workunit.client.1.smithi142.stdout:3/113: truncate d12/f19 943260 0 2024-09-13T02:52:30.041 INFO:tasks.workunit.client.1.smithi142.stdout:0/123: mkdir d10/d15/d30 0 2024-09-13T02:52:30.043 INFO:tasks.workunit.client.1.smithi142.stdout:3/114: fdatasync d12/d16/f20 0 2024-09-13T02:52:30.045 INFO:tasks.workunit.client.1.smithi142.stdout:3/115: write fe [1984393,73986] 0 2024-09-13T02:52:30.045 INFO:tasks.workunit.client.1.smithi142.stdout:1/100: creat d12/d13/d1d/f1e x:0 0 0 2024-09-13T02:52:30.046 INFO:tasks.workunit.client.1.smithi142.stdout:3/116: fsync d12/f13 0 2024-09-13T02:52:30.046 INFO:tasks.workunit.client.1.smithi142.stdout:7/89: creat d10/d13/d1d/f1f x:0 0 0 2024-09-13T02:52:30.047 INFO:tasks.workunit.client.1.smithi142.stdout:7/90: fdatasync f2 0 2024-09-13T02:52:30.052 INFO:tasks.workunit.client.1.smithi142.stdout:7/91: dread fe [4194304,4194304] 0 2024-09-13T02:52:30.053 INFO:tasks.workunit.client.1.smithi142.stdout:2/45: rmdir d1 39 2024-09-13T02:52:30.058 INFO:tasks.workunit.client.1.smithi142.stdout:4/94: creat d0/d3/d13/f1e x:0 0 0 2024-09-13T02:52:30.060 INFO:tasks.workunit.client.1.smithi142.stdout:7/92: dwrite d10/d13/f1e [0,4194304] 0 2024-09-13T02:52:30.062 INFO:tasks.workunit.client.1.smithi142.stdout:7/93: dread - d10/d13/f1c zero size 2024-09-13T02:52:30.062 INFO:tasks.workunit.client.1.smithi142.stdout:2/46: dread d1/f5 [0,4194304] 0 2024-09-13T02:52:30.062 INFO:tasks.workunit.client.1.smithi142.stdout:1/101: fsync d12/d13/f17 0 2024-09-13T02:52:30.064 INFO:tasks.workunit.client.1.smithi142.stdout:1/102: chown d12/d13 51162 1 2024-09-13T02:52:30.065 INFO:tasks.workunit.client.1.smithi142.stdout:7/94: write fe [1802493,83053] 0 2024-09-13T02:52:30.066 INFO:tasks.workunit.client.1.smithi142.stdout:1/103: chown d12/d1b 111 1 2024-09-13T02:52:30.072 INFO:tasks.workunit.client.1.smithi142.stdout:2/47: creat d1/fc x:0 0 0 2024-09-13T02:52:30.073 INFO:tasks.workunit.client.1.smithi142.stdout:7/95: creat d10/d13/f20 x:0 0 0 2024-09-13T02:52:30.073 INFO:tasks.workunit.client.1.smithi142.stdout:0/124: dwrite fd [0,4194304] 0 2024-09-13T02:52:30.077 INFO:tasks.workunit.client.1.smithi142.stdout:3/117: dwrite d12/f22 [0,4194304] 0 2024-09-13T02:52:30.078 INFO:tasks.workunit.client.1.smithi142.stdout:4/95: dwrite d0/d3/d13/f1a [0,4194304] 0 2024-09-13T02:52:30.081 INFO:tasks.workunit.client.1.smithi142.stdout:3/118: write d12/f22 [3866219,130592] 0 2024-09-13T02:52:30.083 INFO:tasks.workunit.client.1.smithi142.stdout:2/48: dread d1/fb [0,4194304] 0 2024-09-13T02:52:30.086 INFO:tasks.workunit.client.1.smithi142.stdout:0/125: rename d10/d15/c26 to d10/d15/d30/c31 0 2024-09-13T02:52:30.088 INFO:tasks.workunit.client.1.smithi142.stdout:6/128: sync 2024-09-13T02:52:30.088 INFO:tasks.workunit.client.1.smithi142.stdout:8/61: sync 2024-09-13T02:52:30.088 INFO:tasks.workunit.client.1.smithi142.stdout:9/95: sync 2024-09-13T02:52:30.090 INFO:tasks.workunit.client.1.smithi142.stdout:9/96: chown dd 57242330 1 2024-09-13T02:52:30.091 INFO:tasks.workunit.client.1.smithi142.stdout:4/96: dwrite d0/d3/d13/f1e [0,4194304] 0 2024-09-13T02:52:30.092 INFO:tasks.workunit.client.1.smithi142.stdout:7/96: rmdir d10/d13 39 2024-09-13T02:52:30.096 INFO:tasks.workunit.client.1.smithi142.stdout:2/49: symlink d1/ld 0 2024-09-13T02:52:30.099 INFO:tasks.workunit.client.1.smithi142.stdout:2/50: stat d1/fb 0 2024-09-13T02:52:30.104 INFO:tasks.workunit.client.1.smithi142.stdout:2/51: write d1/fc [476350,130688] 0 2024-09-13T02:52:30.105 INFO:tasks.workunit.client.1.smithi142.stdout:0/126: rename d10/d15/l1c to d10/d15/d30/l32 0 2024-09-13T02:52:30.109 INFO:tasks.workunit.client.1.smithi142.stdout:4/97: dread d0/f14 [0,4194304] 0 2024-09-13T02:52:30.110 INFO:tasks.workunit.client.1.smithi142.stdout:9/97: dwrite f3 [4194304,4194304] 0 2024-09-13T02:52:30.110 INFO:tasks.workunit.client.1.smithi142.stdout:6/129: dwrite d1/d7/f2a [0,4194304] 0 2024-09-13T02:52:30.111 INFO:tasks.workunit.client.1.smithi142.stdout:3/119: link d12/d16/f1f d12/d16/f24 0 2024-09-13T02:52:30.113 INFO:tasks.workunit.client.1.smithi142.stdout:6/130: readlink d1/dd/le 0 2024-09-13T02:52:30.113 INFO:tasks.workunit.client.1.smithi142.stdout:0/127: truncate f9 5184679 0 2024-09-13T02:52:30.113 INFO:tasks.workunit.client.1.smithi142.stdout:5/116: sync 2024-09-13T02:52:30.115 INFO:tasks.workunit.client.1.smithi142.stdout:8/62: write d0/f5 [2631751,72835] 0 2024-09-13T02:52:30.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/52: write d1/fc [554816,22210] 0 2024-09-13T02:52:30.116 INFO:tasks.workunit.client.1.smithi142.stdout:7/97: dread fd [4194304,4194304] 0 2024-09-13T02:52:30.118 INFO:tasks.workunit.client.1.smithi142.stdout:7/98: read fe [2787137,70626] 0 2024-09-13T02:52:30.120 INFO:tasks.workunit.client.1.smithi142.stdout:9/98: symlink dd/d17/l27 0 2024-09-13T02:52:30.120 INFO:tasks.workunit.client.1.smithi142.stdout:4/98: unlink d0/f8 0 2024-09-13T02:52:30.121 INFO:tasks.workunit.client.1.smithi142.stdout:3/120: write d12/f22 [4687787,108853] 0 2024-09-13T02:52:30.121 INFO:tasks.workunit.client.1.smithi142.stdout:1/104: dwrite f5 [0,4194304] 0 2024-09-13T02:52:30.122 INFO:tasks.workunit.client.1.smithi142.stdout:2/53: read d1/f6 [1658661,123231] 0 2024-09-13T02:52:30.123 INFO:tasks.workunit.client.1.smithi142.stdout:0/128: unlink lb 0 2024-09-13T02:52:30.126 INFO:tasks.workunit.client.1.smithi142.stdout:2/54: write d1/fa [910395,35028] 0 2024-09-13T02:52:30.127 INFO:tasks.workunit.client.1.smithi142.stdout:1/105: dread ff [0,4194304] 0 2024-09-13T02:52:30.129 INFO:tasks.workunit.client.1.smithi142.stdout:5/117: mknod d8/c21 0 2024-09-13T02:52:30.131 INFO:tasks.workunit.client.1.smithi142.stdout:6/131: dread d1/d7/f2a [0,4194304] 0 2024-09-13T02:52:30.134 INFO:tasks.workunit.client.1.smithi142.stdout:8/63: rename d0/f7 to d0/d1/d8/f12 0 2024-09-13T02:52:30.134 INFO:tasks.workunit.client.1.smithi142.stdout:7/99: dwrite f8 [0,4194304] 0 2024-09-13T02:52:30.135 INFO:tasks.workunit.client.1.smithi142.stdout:8/64: write d0/f5 [3682360,112684] 0 2024-09-13T02:52:30.136 INFO:tasks.workunit.client.1.smithi142.stdout:8/65: write d0/d6/dc/fe [1688331,11258] 0 2024-09-13T02:52:30.138 INFO:tasks.workunit.client.1.smithi142.stdout:3/121: mkdir d12/d16/d25 0 2024-09-13T02:52:30.141 INFO:tasks.workunit.client.1.smithi142.stdout:2/55: mkdir d1/de 0 2024-09-13T02:52:30.162 INFO:tasks.workunit.client.1.smithi142.stdout:3/122: dread d12/f13 [0,4194304] 0 2024-09-13T02:52:30.162 INFO:tasks.workunit.client.1.smithi142.stdout:1/106: symlink d12/l1f 0 2024-09-13T02:52:30.162 INFO:tasks.workunit.client.1.smithi142.stdout:5/118: mknod d8/c22 0 2024-09-13T02:52:30.162 INFO:tasks.workunit.client.1.smithi142.stdout:6/132: rmdir d1/dd/d16 39 2024-09-13T02:52:30.163 INFO:tasks.workunit.client.1.smithi142.stdout:9/99: getdents dd/d17/d25 0 2024-09-13T02:52:30.163 INFO:tasks.workunit.client.1.smithi142.stdout:0/129: symlink d10/l33 0 2024-09-13T02:52:30.165 INFO:tasks.workunit.client.1.smithi142.stdout:9/100: dread - dd/d17/f26 zero size 2024-09-13T02:52:30.165 INFO:tasks.workunit.client.1.smithi142.stdout:8/66: write d0/d1/d8/f12 [2121368,69497] 0 2024-09-13T02:52:30.167 INFO:tasks.workunit.client.1.smithi142.stdout:8/67: write d0/d1/fa [811229,122900] 0 2024-09-13T02:52:30.170 INFO:tasks.workunit.client.1.smithi142.stdout:1/107: dwrite d12/d13/f16 [0,4194304] 0 2024-09-13T02:52:30.171 INFO:tasks.workunit.client.1.smithi142.stdout:1/108: dread - d12/d13/d1d/f1e zero size 2024-09-13T02:52:30.178 INFO:tasks.workunit.client.1.smithi142.stdout:1/109: dwrite f1 [4194304,4194304] 0 2024-09-13T02:52:30.224 INFO:tasks.workunit.client.1.smithi142.stdout:4/99: truncate d0/d3/d13/f1e 2514555 0 2024-09-13T02:52:30.224 INFO:tasks.workunit.client.1.smithi142.stdout:4/100: readlink d0/df/l1c 0 2024-09-13T02:52:30.225 INFO:tasks.workunit.client.1.smithi142.stdout:4/101: write d0/df/f17 [946901,18992] 0 2024-09-13T02:52:30.572 INFO:tasks.workunit.client.1.smithi142.stdout:3/123: write d12/d16/f17 [861687,53403] 0 2024-09-13T02:52:30.572 INFO:tasks.workunit.client.1.smithi142.stdout:3/124: read d12/d16/f1f [116472,41970] 0 2024-09-13T02:52:30.572 INFO:tasks.workunit.client.1.smithi142.stdout:7/100: mkdir d10/d13/d21 0 2024-09-13T02:52:30.573 INFO:tasks.workunit.client.1.smithi142.stdout:7/101: fdatasync d10/d13/f1e 0 2024-09-13T02:52:30.573 INFO:tasks.workunit.client.1.smithi142.stdout:6/133: rename d1/dd/c28 to d1/d7/d19/d30/c31 0 2024-09-13T02:52:30.574 INFO:tasks.workunit.client.1.smithi142.stdout:7/102: stat d10/d13/f1c 0 2024-09-13T02:52:30.576 INFO:tasks.workunit.client.1.smithi142.stdout:8/68: creat d0/d1/f13 x:0 0 0 2024-09-13T02:52:30.578 INFO:tasks.workunit.client.1.smithi142.stdout:1/110: unlink d12/d13/d1d/f1e 0 2024-09-13T02:52:30.578 INFO:tasks.workunit.client.1.smithi142.stdout:1/111: stat d12/c15 0 2024-09-13T02:52:30.580 INFO:tasks.workunit.client.1.smithi142.stdout:4/102: creat d0/df/f1f x:0 0 0 2024-09-13T02:52:30.581 INFO:tasks.workunit.client.1.smithi142.stdout:1/112: truncate d12/d13/f19 246939 0 2024-09-13T02:52:30.582 INFO:tasks.workunit.client.1.smithi142.stdout:4/103: chown d0/df 2 1 2024-09-13T02:52:30.583 INFO:tasks.workunit.client.1.smithi142.stdout:3/125: chown d12/d16/c1a 38609 1 2024-09-13T02:52:30.583 INFO:tasks.workunit.client.1.smithi142.stdout:0/130: symlink d10/d15/d1a/d1e/l34 0 2024-09-13T02:52:30.586 INFO:tasks.workunit.client.1.smithi142.stdout:8/69: dwrite d0/fb [0,4194304] 0 2024-09-13T02:52:30.586 INFO:tasks.workunit.client.1.smithi142.stdout:6/134: mkdir d1/dd/d18/d32 0 2024-09-13T02:52:30.587 INFO:tasks.workunit.client.1.smithi142.stdout:6/135: chown d1/f2e 1716 1 2024-09-13T02:52:30.588 INFO:tasks.workunit.client.1.smithi142.stdout:4/104: chown d0/d3/f7 2 1 2024-09-13T02:52:30.589 INFO:tasks.workunit.client.1.smithi142.stdout:1/113: mkdir d12/d13/d20 0 2024-09-13T02:52:30.591 INFO:tasks.workunit.client.1.smithi142.stdout:0/131: mkdir d10/d15/d1a/d28/d35 0 2024-09-13T02:52:30.592 INFO:tasks.workunit.client.1.smithi142.stdout:8/70: symlink d0/d6/l14 0 2024-09-13T02:52:30.593 INFO:tasks.workunit.client.1.smithi142.stdout:9/101: getdents dd/d17 0 2024-09-13T02:52:30.594 INFO:tasks.workunit.client.1.smithi142.stdout:3/126: creat d12/d16/d25/f26 x:0 0 0 2024-09-13T02:52:30.595 INFO:tasks.workunit.client.1.smithi142.stdout:4/105: chown d0/d3/d9/c10 32437625 1 2024-09-13T02:52:30.596 INFO:tasks.workunit.client.1.smithi142.stdout:1/114: dread f5 [0,4194304] 0 2024-09-13T02:52:30.600 INFO:tasks.workunit.client.1.smithi142.stdout:3/127: symlink d12/d16/d25/l27 0 2024-09-13T02:52:30.600 INFO:tasks.workunit.client.1.smithi142.stdout:0/132: dwrite d10/d23/f2f [0,4194304] 0 2024-09-13T02:52:30.601 INFO:tasks.workunit.client.1.smithi142.stdout:1/115: unlink ff 0 2024-09-13T02:52:30.602 INFO:tasks.workunit.client.1.smithi142.stdout:9/102: getdents dd/d17/d25 0 2024-09-13T02:52:30.604 INFO:tasks.workunit.client.1.smithi142.stdout:0/133: mkdir d10/d15/d36 0 2024-09-13T02:52:30.605 INFO:tasks.workunit.client.1.smithi142.stdout:0/134: stat ff 0 2024-09-13T02:52:30.606 INFO:tasks.workunit.client.1.smithi142.stdout:9/103: creat dd/d17/f28 x:0 0 0 2024-09-13T02:52:30.609 INFO:tasks.workunit.client.1.smithi142.stdout:8/71: fsync d0/fb 0 2024-09-13T02:52:30.612 INFO:tasks.workunit.client.1.smithi142.stdout:8/72: symlink d0/d1/d8/df/l15 0 2024-09-13T02:52:30.612 INFO:tasks.workunit.client.1.smithi142.stdout:9/104: dread f8 [0,4194304] 0 2024-09-13T02:52:30.613 INFO:tasks.workunit.client.1.smithi142.stdout:9/105: dread - fa zero size 2024-09-13T02:52:30.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/73: chown d0/d1/f3 5326620 1 2024-09-13T02:52:30.614 INFO:tasks.workunit.client.1.smithi142.stdout:9/106: truncate fa 243274 0 2024-09-13T02:52:30.667 INFO:tasks.workunit.client.0.smithi098.stderr:++ readlink -f fsstress 2024-09-13T02:52:30.669 INFO:tasks.workunit.client.0.smithi098.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T02:52:30.669 INFO:tasks.workunit.client.0.smithi098.stderr:+ popd 2024-09-13T02:52:30.670 INFO:tasks.workunit.client.0.smithi098.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:52:30.670 INFO:tasks.workunit.client.0.smithi098.stderr:+ popd 2024-09-13T02:52:30.671 INFO:tasks.workunit.client.0.smithi098.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:52:30.671 INFO:tasks.workunit.client.0.smithi098.stderr:++ mktemp -d -p . 2024-09-13T02:52:30.673 INFO:tasks.workunit.client.0.smithi098.stderr:+ T=./tmp.41XZbfSbFh 2024-09-13T02:52:30.673 INFO:tasks.workunit.client.0.smithi098.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.41XZbfSbFh -l 1 -n 1000 -p 10 -v 2024-09-13T02:52:30.677 INFO:tasks.workunit.client.0.smithi098.stdout:seed = 1726610897 2024-09-13T02:52:30.678 INFO:tasks.workunit.client.1.smithi142.stdout:8/74: symlink d0/d1/d8/df/l16 0 2024-09-13T02:52:30.679 INFO:tasks.workunit.client.1.smithi142.stdout:8/75: read - d0/d1/f10 zero size 2024-09-13T02:52:30.682 INFO:tasks.workunit.client.0.smithi098.stdout:1/0: fdatasync - no filename 2024-09-13T02:52:30.682 INFO:tasks.workunit.client.0.smithi098.stdout:1/1: chown . 192788858 1 2024-09-13T02:52:30.684 INFO:tasks.workunit.client.0.smithi098.stdout:2/0: dwrite - no filename 2024-09-13T02:52:30.684 INFO:tasks.workunit.client.0.smithi098.stdout:0/0: mknod c0 0 2024-09-13T02:52:30.687 INFO:tasks.workunit.client.0.smithi098.stdout:3/0: dread - no filename 2024-09-13T02:52:30.688 INFO:tasks.workunit.client.0.smithi098.stdout:0/1: symlink l1 0 2024-09-13T02:52:30.689 INFO:tasks.workunit.client.0.smithi098.stdout:1/2: symlink l0 0 2024-09-13T02:52:30.690 INFO:tasks.workunit.client.0.smithi098.stdout:4/0: rmdir - no directory 2024-09-13T02:52:30.690 INFO:tasks.workunit.client.0.smithi098.stdout:2/1: getdents . 0 2024-09-13T02:52:30.690 INFO:tasks.workunit.client.0.smithi098.stdout:4/1: chown . 202 1 2024-09-13T02:52:30.690 INFO:tasks.workunit.client.0.smithi098.stdout:4/2: link - no file 2024-09-13T02:52:30.690 INFO:tasks.workunit.client.0.smithi098.stdout:4/3: dread - no filename 2024-09-13T02:52:30.690 INFO:tasks.workunit.client.0.smithi098.stdout:4/4: dwrite - no filename 2024-09-13T02:52:30.691 INFO:tasks.workunit.client.0.smithi098.stdout:1/3: creat f1 x:0 0 0 2024-09-13T02:52:30.693 INFO:tasks.workunit.client.0.smithi098.stdout:3/1: symlink l0 0 2024-09-13T02:52:30.693 INFO:tasks.workunit.client.0.smithi098.stdout:3/2: dread - no filename 2024-09-13T02:52:30.694 INFO:tasks.workunit.client.0.smithi098.stdout:1/4: mknod c2 0 2024-09-13T02:52:30.695 INFO:tasks.workunit.client.0.smithi098.stdout:1/5: write f1 [240265,63134] 0 2024-09-13T02:52:30.697 INFO:tasks.workunit.client.0.smithi098.stdout:6/0: dread - no filename 2024-09-13T02:52:30.697 INFO:tasks.workunit.client.0.smithi098.stdout:6/1: rename - no filename 2024-09-13T02:52:30.697 INFO:tasks.workunit.client.0.smithi098.stdout:1/6: write f1 [93955,27815] 0 2024-09-13T02:52:30.697 INFO:tasks.workunit.client.1.smithi142.stdout:8/76: dread d0/fb [0,4194304] 0 2024-09-13T02:52:30.697 INFO:tasks.workunit.client.0.smithi098.stdout:4/5: creat f0 x:0 0 0 2024-09-13T02:52:30.698 INFO:tasks.workunit.client.1.smithi142.stdout:9/107: creat dd/d17/d25/f29 x:0 0 0 2024-09-13T02:52:30.698 INFO:tasks.workunit.client.0.smithi098.stdout:4/6: truncate f0 682720 0 2024-09-13T02:52:30.699 INFO:tasks.workunit.client.1.smithi142.stdout:9/108: read f8 [648698,106006] 0 2024-09-13T02:52:30.699 INFO:tasks.workunit.client.1.smithi142.stdout:9/109: readlink l1 0 2024-09-13T02:52:30.699 INFO:tasks.workunit.client.0.smithi098.stdout:3/3: creat f1 x:0 0 0 2024-09-13T02:52:30.702 INFO:tasks.workunit.client.1.smithi142.stdout:8/77: creat d0/d1/f17 x:0 0 0 2024-09-13T02:52:30.704 INFO:tasks.workunit.client.1.smithi142.stdout:9/110: symlink dd/l2a 0 2024-09-13T02:52:30.705 INFO:tasks.workunit.client.1.smithi142.stdout:6/136: truncate d1/d7/d19/f2f 8229013 0 2024-09-13T02:52:30.705 INFO:tasks.workunit.client.0.smithi098.stdout:1/7: symlink l3 0 2024-09-13T02:52:30.707 INFO:tasks.workunit.client.1.smithi142.stdout:8/78: write d0/d6/dc/fe [956087,63418] 0 2024-09-13T02:52:30.707 INFO:tasks.workunit.client.1.smithi142.stdout:4/106: write d0/f14 [1322141,50066] 0 2024-09-13T02:52:30.707 INFO:tasks.workunit.client.1.smithi142.stdout:3/128: rmdir d12/d16/d25 39 2024-09-13T02:52:30.708 INFO:tasks.workunit.client.1.smithi142.stdout:2/56: dwrite f0 [0,4194304] 0 2024-09-13T02:52:30.712 INFO:tasks.workunit.client.1.smithi142.stdout:7/103: dwrite f2 [4194304,4194304] 0 2024-09-13T02:52:30.713 INFO:tasks.workunit.client.0.smithi098.stdout:3/4: rename l0 to l2 0 2024-09-13T02:52:30.713 INFO:tasks.workunit.client.1.smithi142.stdout:5/119: dwrite d8/fe [4194304,4194304] 0 2024-09-13T02:52:30.717 INFO:tasks.workunit.client.0.smithi098.stdout:8/0: truncate - no filename 2024-09-13T02:52:30.717 INFO:tasks.workunit.client.0.smithi098.stdout:8/1: dwrite - no filename 2024-09-13T02:52:30.717 INFO:tasks.workunit.client.0.smithi098.stdout:8/2: chown . 48305363 1 2024-09-13T02:52:30.717 INFO:tasks.workunit.client.0.smithi098.stdout:8/3: write - no filename 2024-09-13T02:52:30.717 INFO:tasks.workunit.client.0.smithi098.stdout:8/4: dread - no filename 2024-09-13T02:52:30.720 INFO:tasks.workunit.client.1.smithi142.stdout:9/111: rename dd/f19 to dd/d17/f2b 0 2024-09-13T02:52:30.723 INFO:tasks.workunit.client.0.smithi098.stdout:3/5: dwrite f1 [0,4194304] 0 2024-09-13T02:52:30.724 INFO:tasks.workunit.client.0.smithi098.stdout:1/8: creat f4 x:0 0 0 2024-09-13T02:52:30.724 INFO:tasks.workunit.client.1.smithi142.stdout:0/135: dwrite ff [0,4194304] 0 2024-09-13T02:52:30.726 INFO:tasks.workunit.client.1.smithi142.stdout:4/107: creat d0/d3/d9/f20 x:0 0 0 2024-09-13T02:52:30.729 INFO:tasks.workunit.client.0.smithi098.stdout:9/0: unlink - no file 2024-09-13T02:52:30.729 INFO:tasks.workunit.client.0.smithi098.stdout:9/1: rename - no filename 2024-09-13T02:52:30.729 INFO:tasks.workunit.client.0.smithi098.stdout:9/2: dread - no filename 2024-09-13T02:52:30.729 INFO:tasks.workunit.client.1.smithi142.stdout:9/112: dwrite f7 [0,4194304] 0 2024-09-13T02:52:30.730 INFO:tasks.workunit.client.0.smithi098.stdout:3/6: dread f1 [0,4194304] 0 2024-09-13T02:52:30.731 INFO:tasks.workunit.client.0.smithi098.stdout:3/7: write f1 [1708327,31376] 0 2024-09-13T02:52:30.733 INFO:tasks.workunit.client.0.smithi098.stdout:3/8: write f1 [1589635,112866] 0 2024-09-13T02:52:30.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:30 smithi098 ceph-mon[27886]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 1010 MiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 8.9 MiB/s wr, 440 op/s 2024-09-13T02:52:30.737 INFO:tasks.workunit.client.1.smithi142.stdout:8/79: creat d0/d6/dc/f18 x:0 0 0 2024-09-13T02:52:30.738 INFO:tasks.workunit.client.0.smithi098.stdout:7/0: symlink l0 0 2024-09-13T02:52:30.739 INFO:tasks.workunit.client.1.smithi142.stdout:5/120: symlink d8/l23 0 2024-09-13T02:52:30.740 INFO:tasks.workunit.client.0.smithi098.stdout:1/9: fsync f1 0 2024-09-13T02:52:30.742 INFO:tasks.workunit.client.1.smithi142.stdout:7/104: dwrite fc [0,4194304] 0 2024-09-13T02:52:30.744 INFO:tasks.workunit.client.0.smithi098.stdout:4/7: fsync f0 0 2024-09-13T02:52:30.744 INFO:tasks.workunit.client.0.smithi098.stdout:4/8: fdatasync f0 0 2024-09-13T02:52:30.745 INFO:tasks.workunit.client.0.smithi098.stdout:4/9: chown f0 1988 1 2024-09-13T02:52:30.745 INFO:tasks.workunit.client.0.smithi098.stdout:4/10: chown f0 2084197 1 2024-09-13T02:52:30.746 INFO:tasks.workunit.client.0.smithi098.stdout:4/11: chown f0 16451037 1 2024-09-13T02:52:30.747 INFO:tasks.workunit.client.0.smithi098.stdout:8/5: getdents . 0 2024-09-13T02:52:30.748 INFO:tasks.workunit.client.1.smithi142.stdout:5/121: dwrite d8/f1c [0,4194304] 0 2024-09-13T02:52:30.749 INFO:tasks.workunit.client.1.smithi142.stdout:5/122: write f0 [5471914,22625] 0 2024-09-13T02:52:30.750 INFO:tasks.workunit.client.1.smithi142.stdout:0/136: symlink d10/d15/l37 0 2024-09-13T02:52:30.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:30 smithi142 ceph-mon[33443]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 1010 MiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 8.9 MiB/s wr, 440 op/s 2024-09-13T02:52:30.754 INFO:tasks.workunit.client.1.smithi142.stdout:1/116: sync 2024-09-13T02:52:30.755 INFO:tasks.workunit.client.1.smithi142.stdout:1/117: stat d12/d1b/l1c 0 2024-09-13T02:52:30.756 INFO:tasks.workunit.client.1.smithi142.stdout:1/118: write fe [102722,16176] 0 2024-09-13T02:52:30.757 INFO:tasks.workunit.client.1.smithi142.stdout:5/123: dwrite d8/f1c [0,4194304] 0 2024-09-13T02:52:30.960 INFO:tasks.workunit.client.0.smithi098.stdout:7/1: mknod c1 0 2024-09-13T02:52:30.962 INFO:tasks.workunit.client.0.smithi098.stdout:1/10: mknod c5 0 2024-09-13T02:52:30.963 INFO:tasks.workunit.client.0.smithi098.stdout:1/11: stat c2 0 2024-09-13T02:52:30.965 INFO:tasks.workunit.client.1.smithi142.stdout:9/113: mknod dd/d17/c2c 0 2024-09-13T02:52:30.966 INFO:tasks.workunit.client.1.smithi142.stdout:4/108: dwrite d0/d3/f7 [0,4194304] 0 2024-09-13T02:52:30.966 INFO:tasks.workunit.client.1.smithi142.stdout:9/114: write f3 [8013971,13196] 0 2024-09-13T02:52:30.968 INFO:tasks.workunit.client.1.smithi142.stdout:8/80: mknod d0/d1/d8/c19 0 2024-09-13T02:52:30.968 INFO:tasks.workunit.client.0.smithi098.stdout:9/3: mknod c0 0 2024-09-13T02:52:30.969 INFO:tasks.workunit.client.0.smithi098.stdout:9/4: dwrite - no filename 2024-09-13T02:52:30.969 INFO:tasks.workunit.client.1.smithi142.stdout:2/57: write d1/f4 [7416068,93346] 0 2024-09-13T02:52:30.970 INFO:tasks.workunit.client.0.smithi098.stdout:4/12: symlink l1 0 2024-09-13T02:52:30.971 INFO:tasks.workunit.client.1.smithi142.stdout:2/58: chown d1/fa 45407 1 2024-09-13T02:52:30.971 INFO:tasks.workunit.client.0.smithi098.stdout:4/13: write f0 [878571,5549] 0 2024-09-13T02:52:30.972 INFO:tasks.workunit.client.0.smithi098.stdout:4/14: stat l1 0 2024-09-13T02:52:30.973 INFO:tasks.workunit.client.0.smithi098.stdout:4/15: chown l1 9618685 1 2024-09-13T02:52:30.974 INFO:tasks.workunit.client.0.smithi098.stdout:4/16: write f0 [1536813,103778] 0 2024-09-13T02:52:30.976 INFO:tasks.workunit.client.1.smithi142.stdout:7/105: mkdir d10/d13/d22 0 2024-09-13T02:52:30.977 INFO:tasks.workunit.client.0.smithi098.stdout:7/2: symlink l2 0 2024-09-13T02:52:30.977 INFO:tasks.workunit.client.0.smithi098.stdout:7/3: dwrite - no filename 2024-09-13T02:52:30.977 INFO:tasks.workunit.client.0.smithi098.stdout:7/4: truncate - no filename 2024-09-13T02:52:30.979 INFO:tasks.workunit.client.1.smithi142.stdout:3/129: creat d12/f28 x:0 0 0 2024-09-13T02:52:30.983 INFO:tasks.workunit.client.1.smithi142.stdout:7/106: dwrite d10/f16 [0,4194304] 0 2024-09-13T02:52:30.983 INFO:tasks.workunit.client.0.smithi098.stdout:9/5: creat f1 x:0 0 0 2024-09-13T02:52:30.986 INFO:tasks.workunit.client.0.smithi098.stdout:8/6: symlink l0 0 2024-09-13T02:52:30.986 INFO:tasks.workunit.client.1.smithi142.stdout:3/130: dwrite fe [0,4194304] 0 2024-09-13T02:52:30.988 INFO:tasks.workunit.client.1.smithi142.stdout:0/137: read d10/f13 [583519,107878] 0 2024-09-13T02:52:30.988 INFO:tasks.workunit.client.1.smithi142.stdout:3/131: write d12/f19 [696219,121942] 0 2024-09-13T02:52:30.988 INFO:tasks.workunit.client.1.smithi142.stdout:0/138: chown fd 0 1 2024-09-13T02:52:30.989 INFO:tasks.workunit.client.1.smithi142.stdout:3/132: stat d12/d16/f24 0 2024-09-13T02:52:30.991 INFO:tasks.workunit.client.0.smithi098.stdout:7/5: creat f3 x:0 0 0 2024-09-13T02:52:30.996 INFO:tasks.workunit.client.0.smithi098.stdout:9/6: mkdir d2 0 2024-09-13T02:52:30.999 INFO:tasks.workunit.client.0.smithi098.stdout:8/7: unlink l0 0 2024-09-13T02:52:30.999 INFO:tasks.workunit.client.0.smithi098.stdout:8/8: dwrite - no filename 2024-09-13T02:52:31.001 INFO:tasks.workunit.client.1.smithi142.stdout:5/124: dwrite d8/f1f [0,4194304] 0 2024-09-13T02:52:31.001 INFO:tasks.workunit.client.1.smithi142.stdout:6/137: truncate d1/dd/d16/f2c 360320 0 2024-09-13T02:52:31.001 INFO:tasks.workunit.client.0.smithi098.stdout:7/6: mknod c4 0 2024-09-13T02:52:31.002 INFO:tasks.workunit.client.0.smithi098.stdout:7/7: stat c4 0 2024-09-13T02:52:31.002 INFO:tasks.workunit.client.1.smithi142.stdout:9/115: fsync dd/d17/f2b 0 2024-09-13T02:52:31.003 INFO:tasks.workunit.client.1.smithi142.stdout:4/109: dread d0/d3/d13/f16 [0,4194304] 0 2024-09-13T02:52:31.004 INFO:tasks.workunit.client.0.smithi098.stdout:1/12: link c2 c6 0 2024-09-13T02:52:31.005 INFO:tasks.workunit.client.1.smithi142.stdout:9/116: truncate dd/f1c 380479 0 2024-09-13T02:52:31.005 INFO:tasks.workunit.client.1.smithi142.stdout:8/81: creat d0/d6/dc/f1a x:0 0 0 2024-09-13T02:52:31.006 INFO:tasks.workunit.client.1.smithi142.stdout:9/117: chown dd/f1a 57539 1 2024-09-13T02:52:31.006 INFO:tasks.workunit.client.0.smithi098.stdout:9/7: unlink c0 0 2024-09-13T02:52:31.007 INFO:tasks.workunit.client.0.smithi098.stdout:1/13: dread f1 [0,4194304] 0 2024-09-13T02:52:31.007 INFO:tasks.workunit.client.1.smithi142.stdout:5/125: dread d8/fe [0,4194304] 0 2024-09-13T02:52:31.007 INFO:tasks.workunit.client.1.smithi142.stdout:9/118: chown dd/d17/c2c 77525584 1 2024-09-13T02:52:31.007 INFO:tasks.workunit.client.1.smithi142.stdout:4/110: dread d0/f14 [0,4194304] 0 2024-09-13T02:52:31.008 INFO:tasks.workunit.client.0.smithi098.stdout:9/8: chown d2 63 1 2024-09-13T02:52:31.008 INFO:tasks.workunit.client.1.smithi142.stdout:2/59: creat d1/ff x:0 0 0 2024-09-13T02:52:31.008 INFO:tasks.workunit.client.1.smithi142.stdout:5/126: write f0 [7976452,126202] 0 2024-09-13T02:52:31.009 INFO:tasks.workunit.client.0.smithi098.stdout:8/9: creat f1 x:0 0 0 2024-09-13T02:52:31.012 INFO:tasks.workunit.client.0.smithi098.stdout:7/8: creat f5 x:0 0 0 2024-09-13T02:52:31.012 INFO:tasks.workunit.client.1.smithi142.stdout:8/82: dread d0/f5 [0,4194304] 0 2024-09-13T02:52:31.014 INFO:tasks.workunit.client.1.smithi142.stdout:7/107: rename f2 to d10/d13/d1d/f23 0 2024-09-13T02:52:31.015 INFO:tasks.workunit.client.1.smithi142.stdout:7/108: chown d10/c14 12535014 1 2024-09-13T02:52:31.016 INFO:tasks.workunit.client.1.smithi142.stdout:5/127: dwrite d8/f10 [0,4194304] 0 2024-09-13T02:52:31.018 INFO:tasks.workunit.client.0.smithi098.stdout:1/14: chown c2 55999721 1 2024-09-13T02:52:31.019 INFO:tasks.workunit.client.0.smithi098.stdout:9/9: symlink d2/l3 0 2024-09-13T02:52:31.023 INFO:tasks.workunit.client.1.smithi142.stdout:0/139: readlink l4 0 2024-09-13T02:52:31.023 INFO:tasks.workunit.client.0.smithi098.stdout:8/10: dwrite f1 [0,4194304] 0 2024-09-13T02:52:31.028 INFO:tasks.workunit.client.0.smithi098.stdout:8/11: read f1 [231322,42964] 0 2024-09-13T02:52:31.029 INFO:tasks.workunit.client.0.smithi098.stdout:7/9: dwrite f5 [0,4194304] 0 2024-09-13T02:52:31.029 INFO:tasks.workunit.client.1.smithi142.stdout:9/119: dread dd/fe [0,4194304] 0 2024-09-13T02:52:31.030 INFO:tasks.workunit.client.0.smithi098.stdout:9/10: creat d2/f4 x:0 0 0 2024-09-13T02:52:31.030 INFO:tasks.workunit.client.1.smithi142.stdout:1/119: chown d12/d13/d1d 136812680 1 2024-09-13T02:52:31.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/120: read fd [3545542,52290] 0 2024-09-13T02:52:31.031 INFO:tasks.workunit.client.0.smithi098.stdout:8/12: chown f1 59278 1 2024-09-13T02:52:31.033 INFO:tasks.workunit.client.1.smithi142.stdout:3/133: dwrite d12/d16/d25/f26 [0,4194304] 0 2024-09-13T02:52:31.039 INFO:tasks.workunit.client.0.smithi098.stdout:1/15: dwrite f4 [0,4194304] 0 2024-09-13T02:52:31.051 INFO:tasks.workunit.client.0.smithi098.stdout:8/13: dread f1 [0,4194304] 0 2024-09-13T02:52:31.052 INFO:tasks.workunit.client.0.smithi098.stdout:7/10: dwrite f5 [0,4194304] 0 2024-09-13T02:52:31.052 INFO:tasks.workunit.client.0.smithi098.stdout:8/14: readlink - no filename 2024-09-13T02:52:31.052 INFO:tasks.workunit.client.1.smithi142.stdout:4/111: mkdir d0/d3/d21 0 2024-09-13T02:52:31.054 INFO:tasks.workunit.client.0.smithi098.stdout:9/11: dwrite d2/f4 [0,4194304] 0 2024-09-13T02:52:31.058 INFO:tasks.workunit.client.0.smithi098.stdout:7/11: mkdir d6 0 2024-09-13T02:52:31.060 INFO:tasks.workunit.client.0.smithi098.stdout:1/16: dwrite f4 [0,4194304] 0 2024-09-13T02:52:31.062 INFO:tasks.workunit.client.0.smithi098.stdout:9/12: mknod d2/c5 0 2024-09-13T02:52:31.066 INFO:tasks.workunit.client.1.smithi142.stdout:5/128: mkdir d8/d24 0 2024-09-13T02:52:31.066 INFO:tasks.workunit.client.1.smithi142.stdout:5/129: chown f5 35 1 2024-09-13T02:52:31.069 INFO:tasks.workunit.client.0.smithi098.stdout:8/15: dread f1 [0,4194304] 0 2024-09-13T02:52:31.070 INFO:tasks.workunit.client.0.smithi098.stdout:8/16: readlink - no filename 2024-09-13T02:52:31.071 INFO:tasks.workunit.client.1.smithi142.stdout:9/120: creat dd/d17/d25/f2d x:0 0 0 2024-09-13T02:52:31.075 INFO:tasks.workunit.client.0.smithi098.stdout:8/17: fsync f1 0 2024-09-13T02:52:31.076 INFO:tasks.workunit.client.0.smithi098.stdout:7/12: dwrite f3 [0,4194304] 0 2024-09-13T02:52:31.079 INFO:tasks.workunit.client.1.smithi142.stdout:1/121: dwrite d12/d13/f19 [0,4194304] 0 2024-09-13T02:52:31.088 INFO:tasks.workunit.client.1.smithi142.stdout:8/83: unlink d0/d6/dc/f1a 0 2024-09-13T02:52:31.088 INFO:tasks.workunit.client.1.smithi142.stdout:8/84: fdatasync d0/fb 0 2024-09-13T02:52:31.097 INFO:tasks.workunit.client.1.smithi142.stdout:6/138: rmdir d1/dd/d2d 0 2024-09-13T02:52:31.098 INFO:tasks.workunit.client.0.smithi098.stdout:1/17: dwrite f1 [0,4194304] 0 2024-09-13T02:52:31.098 INFO:tasks.workunit.client.0.smithi098.stdout:8/18: mkdir d2 0 2024-09-13T02:52:31.098 INFO:tasks.workunit.client.0.smithi098.stdout:7/13: chown f5 4815 1 2024-09-13T02:52:31.099 INFO:tasks.workunit.client.0.smithi098.stdout:9/13: getdents d2 0 2024-09-13T02:52:31.100 INFO:tasks.workunit.client.0.smithi098.stdout:1/18: write f1 [2969919,96938] 0 2024-09-13T02:52:31.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/85: rename d0/f5 to d0/d1/f1b 0 2024-09-13T02:52:31.104 INFO:tasks.workunit.client.0.smithi098.stdout:1/19: dread f4 [0,4194304] 0 2024-09-13T02:52:31.106 INFO:tasks.workunit.client.1.smithi142.stdout:7/109: truncate fd 1845784 0 2024-09-13T02:52:31.106 INFO:tasks.workunit.client.1.smithi142.stdout:7/110: fsync f8 0 2024-09-13T02:52:31.109 INFO:tasks.workunit.client.1.smithi142.stdout:3/134: creat d12/d16/f29 x:0 0 0 2024-09-13T02:52:31.114 INFO:tasks.workunit.client.1.smithi142.stdout:2/60: getdents d1 0 2024-09-13T02:52:31.120 INFO:tasks.workunit.client.1.smithi142.stdout:7/111: unlink d10/d13/d1d/f1f 0 2024-09-13T02:52:31.122 INFO:tasks.workunit.client.1.smithi142.stdout:3/135: fdatasync d12/d16/f24 0 2024-09-13T02:52:31.129 INFO:tasks.workunit.client.1.smithi142.stdout:9/121: getdents dd 0 2024-09-13T02:52:31.129 INFO:tasks.workunit.client.1.smithi142.stdout:9/122: readlink dd/l20 0 2024-09-13T02:52:31.135 INFO:tasks.workunit.client.1.smithi142.stdout:3/136: unlink d12/d16/f1f 0 2024-09-13T02:52:31.138 INFO:tasks.workunit.client.1.smithi142.stdout:2/61: creat d1/de/f10 x:0 0 0 2024-09-13T02:52:31.138 INFO:tasks.workunit.client.1.smithi142.stdout:1/122: dwrite d12/d13/f17 [0,4194304] 0 2024-09-13T02:52:31.143 INFO:tasks.workunit.client.1.smithi142.stdout:7/112: symlink d10/d13/d21/l24 0 2024-09-13T02:52:31.143 INFO:tasks.workunit.client.1.smithi142.stdout:2/62: dread d1/f7 [4194304,4194304] 0 2024-09-13T02:52:31.146 INFO:tasks.workunit.client.1.smithi142.stdout:2/63: truncate d1/de/f10 760156 0 2024-09-13T02:52:31.148 INFO:tasks.workunit.client.1.smithi142.stdout:6/139: dwrite d1/dd/d16/f2c [0,4194304] 0 2024-09-13T02:52:31.150 INFO:tasks.workunit.client.1.smithi142.stdout:1/123: creat d12/d13/d1d/f21 x:0 0 0 2024-09-13T02:52:31.150 INFO:tasks.workunit.client.1.smithi142.stdout:0/140: sync 2024-09-13T02:52:31.151 INFO:tasks.workunit.client.1.smithi142.stdout:7/113: dwrite fc [0,4194304] 0 2024-09-13T02:52:31.174 INFO:tasks.workunit.client.1.smithi142.stdout:2/64: mknod d1/de/c11 0 2024-09-13T02:52:31.174 INFO:tasks.workunit.client.1.smithi142.stdout:1/124: creat d12/f22 x:0 0 0 2024-09-13T02:52:31.175 INFO:tasks.workunit.client.1.smithi142.stdout:0/141: mknod d10/d23/c38 0 2024-09-13T02:52:31.175 INFO:tasks.workunit.client.1.smithi142.stdout:6/140: chown d1/dd/d16/f1c 29069 1 2024-09-13T02:52:31.175 INFO:tasks.workunit.client.1.smithi142.stdout:6/141: chown d1/dd/d16/f13 6324 1 2024-09-13T02:52:31.178 INFO:tasks.workunit.client.1.smithi142.stdout:9/123: truncate dd/ff 94872 0 2024-09-13T02:52:31.179 INFO:tasks.workunit.client.1.smithi142.stdout:9/124: write dd/d17/f26 [1016643,80206] 0 2024-09-13T02:52:31.200 INFO:tasks.workunit.client.1.smithi142.stdout:3/137: write d12/d16/f24 [865482,123563] 0 2024-09-13T02:52:31.201 INFO:tasks.workunit.client.1.smithi142.stdout:3/138: truncate d12/f19 1340107 0 2024-09-13T02:52:31.206 INFO:tasks.workunit.client.1.smithi142.stdout:3/139: dwrite d12/f28 [0,4194304] 0 2024-09-13T02:52:31.211 INFO:tasks.workunit.client.1.smithi142.stdout:3/140: dwrite d12/f28 [0,4194304] 0 2024-09-13T02:52:31.221 INFO:tasks.workunit.client.1.smithi142.stdout:4/112: sync 2024-09-13T02:52:31.257 INFO:tasks.workunit.client.1.smithi142.stdout:5/130: sync 2024-09-13T02:52:31.257 INFO:tasks.workunit.client.1.smithi142.stdout:8/86: sync 2024-09-13T02:52:31.257 INFO:tasks.workunit.client.1.smithi142.stdout:8/87: chown d0/d1/d8/c19 341301928 1 2024-09-13T02:52:31.297 INFO:tasks.workunit.client.1.smithi142.stdout:0/142: sync 2024-09-13T02:52:31.298 INFO:tasks.workunit.client.1.smithi142.stdout:1/125: sync 2024-09-13T02:52:31.471 INFO:tasks.workunit.client.0.smithi098.stdout:9/14: mkdir d2/d6 0 2024-09-13T02:52:31.474 INFO:tasks.workunit.client.0.smithi098.stdout:1/20: rename l3 to l7 0 2024-09-13T02:52:31.475 INFO:tasks.workunit.client.0.smithi098.stdout:7/14: creat d6/f7 x:0 0 0 2024-09-13T02:52:31.477 INFO:tasks.workunit.client.0.smithi098.stdout:8/19: creat d2/f3 x:0 0 0 2024-09-13T02:52:31.477 INFO:tasks.workunit.client.0.smithi098.stdout:7/15: truncate f5 5101382 0 2024-09-13T02:52:31.477 INFO:tasks.workunit.client.0.smithi098.stdout:8/20: chown d2 0 1 2024-09-13T02:52:31.479 INFO:tasks.workunit.client.0.smithi098.stdout:9/15: dwrite f1 [0,4194304] 0 2024-09-13T02:52:31.481 INFO:tasks.workunit.client.0.smithi098.stdout:1/21: write f4 [1349351,18851] 0 2024-09-13T02:52:31.485 INFO:tasks.workunit.client.0.smithi098.stdout:7/16: symlink d6/l8 0 2024-09-13T02:52:31.489 INFO:tasks.workunit.client.0.smithi098.stdout:9/16: rename f1 to d2/f7 0 2024-09-13T02:52:31.491 INFO:tasks.workunit.client.0.smithi098.stdout:7/17: dwrite f3 [0,4194304] 0 2024-09-13T02:52:31.497 INFO:tasks.workunit.client.0.smithi098.stdout:9/17: rename d2/l3 to d2/d6/l8 0 2024-09-13T02:52:31.501 INFO:tasks.workunit.client.0.smithi098.stdout:1/22: link f1 f8 0 2024-09-13T02:52:31.503 INFO:tasks.workunit.client.0.smithi098.stdout:7/18: unlink d6/f7 0 2024-09-13T02:52:31.510 INFO:tasks.workunit.client.0.smithi098.stdout:1/23: mkdir d9 0 2024-09-13T02:52:31.512 INFO:tasks.workunit.client.0.smithi098.stdout:7/19: dwrite f5 [4194304,4194304] 0 2024-09-13T02:52:31.523 INFO:tasks.workunit.client.0.smithi098.stdout:1/24: creat d9/fa x:0 0 0 2024-09-13T02:52:31.523 INFO:tasks.workunit.client.0.smithi098.stdout:1/25: write f4 [3096381,14476] 0 2024-09-13T02:52:31.531 INFO:tasks.workunit.client.0.smithi098.stdout:1/26: rename l0 to d9/lb 0 2024-09-13T02:52:31.532 INFO:tasks.workunit.client.0.smithi098.stdout:7/20: link l2 d6/l9 0 2024-09-13T02:52:31.532 INFO:tasks.workunit.client.0.smithi098.stdout:7/21: fsync f3 0 2024-09-13T02:52:31.542 INFO:tasks.workunit.client.1.smithi142.stdout:2/65: fsync d1/f6 0 2024-09-13T02:52:31.542 INFO:tasks.workunit.client.1.smithi142.stdout:2/66: stat d1 0 2024-09-13T02:52:31.542 INFO:tasks.workunit.client.1.smithi142.stdout:2/67: truncate d1/ff 367649 0 2024-09-13T02:52:31.543 INFO:tasks.workunit.client.1.smithi142.stdout:6/142: mknod d1/dd/d16/c33 0 2024-09-13T02:52:31.545 INFO:tasks.workunit.client.1.smithi142.stdout:9/125: mkdir dd/d2e 0 2024-09-13T02:52:31.546 INFO:tasks.workunit.client.1.smithi142.stdout:2/68: dread d1/fc [0,4194304] 0 2024-09-13T02:52:31.551 INFO:tasks.workunit.client.1.smithi142.stdout:8/88: chown d0/d6/l11 20608 1 2024-09-13T02:52:31.551 INFO:tasks.workunit.client.1.smithi142.stdout:1/126: stat d12/d13/d20 0 2024-09-13T02:52:31.552 INFO:tasks.workunit.client.1.smithi142.stdout:8/89: chown d0/d1/d8/c19 0 1 2024-09-13T02:52:31.552 INFO:tasks.workunit.client.1.smithi142.stdout:0/143: mkdir d10/d15/d30/d39 0 2024-09-13T02:52:31.557 INFO:tasks.workunit.client.1.smithi142.stdout:1/127: dwrite f1 [0,4194304] 0 2024-09-13T02:52:31.561 INFO:tasks.workunit.client.1.smithi142.stdout:5/131: mknod d8/d24/c25 0 2024-09-13T02:52:31.565 INFO:tasks.workunit.client.1.smithi142.stdout:0/144: mkdir d10/d15/d1a/d3a 0 2024-09-13T02:52:31.565 INFO:tasks.workunit.client.1.smithi142.stdout:1/128: dwrite d12/f22 [0,4194304] 0 2024-09-13T02:52:31.568 INFO:tasks.workunit.client.1.smithi142.stdout:6/143: rename d1/d7/d19/c1f to d1/d7/c34 0 2024-09-13T02:52:31.570 INFO:tasks.workunit.client.1.smithi142.stdout:9/126: fdatasync f5 0 2024-09-13T02:52:31.572 INFO:tasks.workunit.client.1.smithi142.stdout:5/132: mkdir d8/d24/d26 0 2024-09-13T02:52:31.577 INFO:tasks.workunit.client.1.smithi142.stdout:9/127: rmdir dd 39 2024-09-13T02:52:31.580 INFO:tasks.workunit.client.1.smithi142.stdout:0/145: creat d10/d15/d1a/d3a/f3b x:0 0 0 2024-09-13T02:52:31.585 INFO:tasks.workunit.client.1.smithi142.stdout:9/128: symlink dd/l2f 0 2024-09-13T02:52:31.586 INFO:tasks.workunit.client.1.smithi142.stdout:1/129: getdents d12 0 2024-09-13T02:52:31.586 INFO:tasks.workunit.client.1.smithi142.stdout:0/146: dwrite fd [0,4194304] 0 2024-09-13T02:52:31.587 INFO:tasks.workunit.client.1.smithi142.stdout:9/129: chown dd/d17/f28 122 1 2024-09-13T02:52:31.589 INFO:tasks.workunit.client.1.smithi142.stdout:1/130: symlink d12/d13/d1d/l23 0 2024-09-13T02:52:31.592 INFO:tasks.workunit.client.1.smithi142.stdout:0/147: creat d10/d15/d21/f3c x:0 0 0 2024-09-13T02:52:31.596 INFO:tasks.workunit.client.1.smithi142.stdout:1/131: dwrite d12/d13/f17 [0,4194304] 0 2024-09-13T02:52:31.598 INFO:tasks.workunit.client.1.smithi142.stdout:0/148: rename l8 to d10/d15/d1a/d3a/l3d 0 2024-09-13T02:52:31.599 INFO:tasks.workunit.client.1.smithi142.stdout:0/149: fsync d10/d23/f2f 0 2024-09-13T02:52:31.600 INFO:tasks.workunit.client.1.smithi142.stdout:1/132: symlink d12/l24 0 2024-09-13T02:52:31.600 INFO:tasks.workunit.client.1.smithi142.stdout:1/133: readlink d12/l1f 0 2024-09-13T02:52:31.603 INFO:tasks.workunit.client.1.smithi142.stdout:0/150: creat d10/d15/d1a/d28/f3e x:0 0 0 2024-09-13T02:52:31.604 INFO:tasks.workunit.client.1.smithi142.stdout:1/134: unlink ca 0 2024-09-13T02:52:31.606 INFO:tasks.workunit.client.1.smithi142.stdout:1/135: write d12/f22 [1465106,50352] 0 2024-09-13T02:52:31.607 INFO:tasks.workunit.client.1.smithi142.stdout:6/144: dread d1/d7/d19/f2f [4194304,4194304] 0 2024-09-13T02:52:31.608 INFO:tasks.workunit.client.1.smithi142.stdout:0/151: rename d10/d23/c29 to d10/d15/d1a/d28/c3f 0 2024-09-13T02:52:31.609 INFO:tasks.workunit.client.1.smithi142.stdout:5/133: dread d8/f19 [0,4194304] 0 2024-09-13T02:52:31.610 INFO:tasks.workunit.client.1.smithi142.stdout:0/152: write d10/d15/d1a/f22 [15171,162] 0 2024-09-13T02:52:31.611 INFO:tasks.workunit.client.1.smithi142.stdout:1/136: creat d12/d13/d1d/f25 x:0 0 0 2024-09-13T02:52:31.612 INFO:tasks.workunit.client.1.smithi142.stdout:1/137: dread - d12/d13/d1d/f25 zero size 2024-09-13T02:52:31.615 INFO:tasks.workunit.client.1.smithi142.stdout:6/145: creat d1/dd/f35 x:0 0 0 2024-09-13T02:52:31.616 INFO:tasks.workunit.client.1.smithi142.stdout:1/138: mkdir d12/d13/d1d/d26 0 2024-09-13T02:52:31.619 INFO:tasks.workunit.client.1.smithi142.stdout:5/134: dwrite d8/fd [0,4194304] 0 2024-09-13T02:52:31.621 INFO:tasks.workunit.client.1.smithi142.stdout:1/139: mkdir d12/d13/d20/d27 0 2024-09-13T02:52:31.621 INFO:tasks.workunit.client.1.smithi142.stdout:0/153: dwrite f9 [0,4194304] 0 2024-09-13T02:52:31.622 INFO:tasks.workunit.client.1.smithi142.stdout:1/140: fsync d12/d13/d1d/f21 0 2024-09-13T02:52:31.624 INFO:tasks.workunit.client.1.smithi142.stdout:1/141: write d12/f22 [965697,126274] 0 2024-09-13T02:52:31.624 INFO:tasks.workunit.client.1.smithi142.stdout:5/135: rename d8/f20 to d8/d24/f27 0 2024-09-13T02:52:31.629 INFO:tasks.workunit.client.1.smithi142.stdout:1/142: rmdir d12/d13/d20 39 2024-09-13T02:52:31.633 INFO:tasks.workunit.client.1.smithi142.stdout:0/154: dwrite d10/d15/f2d [0,4194304] 0 2024-09-13T02:52:31.634 INFO:tasks.workunit.client.1.smithi142.stdout:5/136: truncate f3 2680831 0 2024-09-13T02:52:31.635 INFO:tasks.workunit.client.1.smithi142.stdout:0/155: chown d10/d15/d1a/d1e/l34 2746 1 2024-09-13T02:52:31.637 INFO:tasks.workunit.client.1.smithi142.stdout:1/143: creat d12/d13/f28 x:0 0 0 2024-09-13T02:52:31.644 INFO:tasks.workunit.client.1.smithi142.stdout:5/137: dwrite d8/f1e [0,4194304] 0 2024-09-13T02:52:31.646 INFO:tasks.workunit.client.1.smithi142.stdout:6/146: dread d1/dd/d16/f15 [0,4194304] 0 2024-09-13T02:52:31.646 INFO:tasks.workunit.client.1.smithi142.stdout:0/156: dwrite d10/d23/f25 [0,4194304] 0 2024-09-13T02:52:31.647 INFO:tasks.workunit.client.1.smithi142.stdout:1/144: rename d12/d13/l1a to d12/d13/d1d/l29 0 2024-09-13T02:52:31.649 INFO:tasks.workunit.client.1.smithi142.stdout:0/157: dread - d10/d15/d1a/d3a/f3b zero size 2024-09-13T02:52:31.651 INFO:tasks.workunit.client.1.smithi142.stdout:6/147: unlink d1/f2e 0 2024-09-13T02:52:31.653 INFO:tasks.workunit.client.1.smithi142.stdout:1/145: chown d12/d13/f16 538790444 1 2024-09-13T02:52:31.653 INFO:tasks.workunit.client.1.smithi142.stdout:6/148: fsync d1/d7/f2a 0 2024-09-13T02:52:31.654 INFO:tasks.workunit.client.1.smithi142.stdout:1/146: truncate f10 1408030 0 2024-09-13T02:52:31.654 INFO:tasks.workunit.client.1.smithi142.stdout:5/138: link c7 d8/d24/c28 0 2024-09-13T02:52:31.656 INFO:tasks.workunit.client.1.smithi142.stdout:5/139: write d8/fc [197557,118645] 0 2024-09-13T02:52:31.658 INFO:tasks.workunit.client.1.smithi142.stdout:1/147: mknod d12/d1b/c2a 0 2024-09-13T02:52:31.659 INFO:tasks.workunit.client.1.smithi142.stdout:0/158: creat d10/d15/d1a/d28/d35/f40 x:0 0 0 2024-09-13T02:52:31.660 INFO:tasks.workunit.client.1.smithi142.stdout:0/159: readlink d10/l33 0 2024-09-13T02:52:31.661 INFO:tasks.workunit.client.1.smithi142.stdout:5/140: mknod d8/c29 0 2024-09-13T02:52:31.665 INFO:tasks.workunit.client.1.smithi142.stdout:0/160: symlink d10/d15/d1a/d28/l41 0 2024-09-13T02:52:31.667 INFO:tasks.workunit.client.1.smithi142.stdout:0/161: chown d10/d15/l37 97114052 1 2024-09-13T02:52:31.668 INFO:tasks.workunit.client.1.smithi142.stdout:5/141: dwrite d8/f10 [4194304,4194304] 0 2024-09-13T02:52:31.668 INFO:tasks.workunit.client.1.smithi142.stdout:6/149: link d1/dd/d16/c17 d1/dd/d18/c36 0 2024-09-13T02:52:31.670 INFO:tasks.workunit.client.1.smithi142.stdout:1/148: dwrite f5 [0,4194304] 0 2024-09-13T02:52:31.673 INFO:tasks.workunit.client.1.smithi142.stdout:0/162: mkdir d10/d15/d1a/d1e/d42 0 2024-09-13T02:52:31.673 INFO:tasks.workunit.client.1.smithi142.stdout:9/130: sync 2024-09-13T02:52:31.679 INFO:tasks.workunit.client.1.smithi142.stdout:6/150: creat d1/f37 x:0 0 0 2024-09-13T02:52:31.680 INFO:tasks.workunit.client.1.smithi142.stdout:1/149: dread d12/d13/f17 [0,4194304] 0 2024-09-13T02:52:31.683 INFO:tasks.workunit.client.1.smithi142.stdout:6/151: symlink d1/d7/l38 0 2024-09-13T02:52:31.684 INFO:tasks.workunit.client.1.smithi142.stdout:0/163: rmdir d10/d15/d30/d39 0 2024-09-13T02:52:31.685 INFO:tasks.workunit.client.1.smithi142.stdout:0/164: rename d10/d15 to d10/d15/d30/d43 22 2024-09-13T02:52:31.686 INFO:tasks.workunit.client.1.smithi142.stdout:9/131: link dd/d17/c2c dd/d17/d25/c30 0 2024-09-13T02:52:31.686 INFO:tasks.workunit.client.1.smithi142.stdout:9/132: write f8 [1134264,7010] 0 2024-09-13T02:52:31.686 INFO:tasks.workunit.client.1.smithi142.stdout:1/150: creat d12/d13/d1d/d26/f2b x:0 0 0 2024-09-13T02:52:31.687 INFO:tasks.workunit.client.1.smithi142.stdout:9/133: chown dd/l12 35 1 2024-09-13T02:52:31.688 INFO:tasks.workunit.client.1.smithi142.stdout:0/165: unlink ff 0 2024-09-13T02:52:31.690 INFO:tasks.workunit.client.1.smithi142.stdout:9/134: symlink dd/d17/d25/l31 0 2024-09-13T02:52:31.691 INFO:tasks.workunit.client.1.smithi142.stdout:9/135: truncate dd/f1b 884621 0 2024-09-13T02:52:31.693 INFO:tasks.workunit.client.1.smithi142.stdout:1/151: mkdir d12/d13/d20/d2c 0 2024-09-13T02:52:31.694 INFO:tasks.workunit.client.1.smithi142.stdout:1/152: symlink d12/d1b/l2d 0 2024-09-13T02:52:31.695 INFO:tasks.workunit.client.1.smithi142.stdout:9/136: dread f7 [0,4194304] 0 2024-09-13T02:52:31.696 INFO:tasks.workunit.client.1.smithi142.stdout:1/153: symlink d12/d13/d20/l2e 0 2024-09-13T02:52:31.700 INFO:tasks.workunit.client.1.smithi142.stdout:9/137: dwrite dd/f13 [0,4194304] 0 2024-09-13T02:52:31.701 INFO:tasks.workunit.client.1.smithi142.stdout:9/138: write dd/f1c [777884,9098] 0 2024-09-13T02:52:31.702 INFO:tasks.workunit.client.1.smithi142.stdout:1/154: link d12/d13/f28 d12/d1b/f2f 0 2024-09-13T02:52:31.705 INFO:tasks.workunit.client.1.smithi142.stdout:9/139: mknod dd/c32 0 2024-09-13T02:52:31.707 INFO:tasks.workunit.client.1.smithi142.stdout:1/155: creat d12/d13/d20/d27/f30 x:0 0 0 2024-09-13T02:52:31.711 INFO:tasks.workunit.client.1.smithi142.stdout:9/140: dwrite dd/f1d [0,4194304] 0 2024-09-13T02:52:31.715 INFO:tasks.workunit.client.1.smithi142.stdout:9/141: creat dd/d17/d25/f33 x:0 0 0 2024-09-13T02:52:31.716 INFO:tasks.workunit.client.1.smithi142.stdout:1/156: dwrite fd [0,4194304] 0 2024-09-13T02:52:31.717 INFO:tasks.workunit.client.1.smithi142.stdout:1/157: chown d12/d13/f19 108364455 1 2024-09-13T02:52:31.718 INFO:tasks.workunit.client.1.smithi142.stdout:9/142: readlink dd/d17/l21 0 2024-09-13T02:52:31.721 INFO:tasks.workunit.client.1.smithi142.stdout:9/143: mknod dd/c34 0 2024-09-13T02:52:31.724 INFO:tasks.workunit.client.1.smithi142.stdout:1/158: dwrite d12/f22 [0,4194304] 0 2024-09-13T02:52:31.724 INFO:tasks.workunit.client.1.smithi142.stdout:9/144: mkdir dd/d17/d35 0 2024-09-13T02:52:31.729 INFO:tasks.workunit.client.1.smithi142.stdout:9/145: creat dd/f36 x:0 0 0 2024-09-13T02:52:31.730 INFO:tasks.workunit.client.1.smithi142.stdout:1/159: fdatasync d12/d13/f17 0 2024-09-13T02:52:31.730 INFO:tasks.workunit.client.1.smithi142.stdout:9/146: rename dd/d17 to dd/d17/d37 22 2024-09-13T02:52:31.733 INFO:tasks.workunit.client.1.smithi142.stdout:9/147: creat dd/d17/d25/f38 x:0 0 0 2024-09-13T02:52:31.736 INFO:tasks.workunit.client.1.smithi142.stdout:9/148: creat dd/d17/f39 x:0 0 0 2024-09-13T02:52:31.738 INFO:tasks.workunit.client.1.smithi142.stdout:1/160: dwrite d12/d13/d1d/f21 [0,4194304] 0 2024-09-13T02:52:31.743 INFO:tasks.workunit.client.1.smithi142.stdout:9/149: rmdir dd/d2e 0 2024-09-13T02:52:31.744 INFO:tasks.workunit.client.1.smithi142.stdout:9/150: write dd/f36 [1042066,27272] 0 2024-09-13T02:52:31.749 INFO:tasks.workunit.client.1.smithi142.stdout:1/161: dwrite d12/d1b/f2f [0,4194304] 0 2024-09-13T02:52:31.749 INFO:tasks.workunit.client.1.smithi142.stdout:9/151: mknod dd/d17/d35/c3a 0 2024-09-13T02:52:31.753 INFO:tasks.workunit.client.1.smithi142.stdout:1/162: creat d12/d13/d20/d2c/f31 x:0 0 0 2024-09-13T02:52:31.756 INFO:tasks.workunit.client.1.smithi142.stdout:9/152: dwrite dd/f1a [0,4194304] 0 2024-09-13T02:52:31.757 INFO:tasks.workunit.client.1.smithi142.stdout:9/153: write dd/f36 [1811531,20732] 0 2024-09-13T02:52:31.758 INFO:tasks.workunit.client.1.smithi142.stdout:1/163: dread f1 [0,4194304] 0 2024-09-13T02:52:31.761 INFO:tasks.workunit.client.1.smithi142.stdout:1/164: mknod d12/d13/d20/d27/c32 0 2024-09-13T02:52:31.763 INFO:tasks.workunit.client.1.smithi142.stdout:1/165: unlink f10 0 2024-09-13T02:52:31.770 INFO:tasks.workunit.client.1.smithi142.stdout:1/166: dwrite d12/d13/f16 [0,4194304] 0 2024-09-13T02:52:31.773 INFO:tasks.workunit.client.1.smithi142.stdout:1/167: mknod d12/d13/d20/d2c/c33 0 2024-09-13T02:52:31.775 INFO:tasks.workunit.client.1.smithi142.stdout:1/168: mknod d12/c34 0 2024-09-13T02:52:31.778 INFO:tasks.workunit.client.1.smithi142.stdout:1/169: dread d12/d13/f17 [0,4194304] 0 2024-09-13T02:52:31.784 INFO:tasks.workunit.client.1.smithi142.stdout:1/170: dwrite d12/d13/d1d/d26/f2b [0,4194304] 0 2024-09-13T02:52:31.787 INFO:tasks.workunit.client.1.smithi142.stdout:1/171: creat d12/d13/d20/f35 x:0 0 0 2024-09-13T02:52:31.789 INFO:tasks.workunit.client.1.smithi142.stdout:1/172: symlink d12/d13/d20/d27/l36 0 2024-09-13T02:52:31.792 INFO:tasks.workunit.client.1.smithi142.stdout:1/173: unlink d12/d13/f28 0 2024-09-13T02:52:31.794 INFO:tasks.workunit.client.1.smithi142.stdout:1/174: dread f5 [0,4194304] 0 2024-09-13T02:52:31.798 INFO:tasks.workunit.client.1.smithi142.stdout:1/175: rename d12/d13/d20/d2c/f31 to d12/d13/d20/d27/f37 0 2024-09-13T02:52:31.804 INFO:tasks.workunit.client.1.smithi142.stdout:6/152: sync 2024-09-13T02:52:31.804 INFO:tasks.workunit.client.1.smithi142.stdout:1/176: dwrite d12/d13/d20/f35 [0,4194304] 0 2024-09-13T02:52:31.804 INFO:tasks.workunit.client.1.smithi142.stdout:6/153: chown d1/d7 106 1 2024-09-13T02:52:31.806 INFO:tasks.workunit.client.1.smithi142.stdout:1/177: creat d12/d13/d20/f38 x:0 0 0 2024-09-13T02:52:31.810 INFO:tasks.workunit.client.1.smithi142.stdout:6/154: symlink d1/dd/l39 0 2024-09-13T02:52:31.811 INFO:tasks.workunit.client.1.smithi142.stdout:1/178: dread d12/d13/d20/f35 [0,4194304] 0 2024-09-13T02:52:31.813 INFO:tasks.workunit.client.1.smithi142.stdout:1/179: mkdir d12/d39 0 2024-09-13T02:52:31.829 INFO:tasks.workunit.client.1.smithi142.stdout:6/155: dread d1/dd/d16/f13 [0,4194304] 0 2024-09-13T02:52:31.830 INFO:tasks.workunit.client.1.smithi142.stdout:6/156: chown d1/l1a 0 1 2024-09-13T02:52:31.831 INFO:tasks.workunit.client.1.smithi142.stdout:6/157: unlink d1/dd/l2b 0 2024-09-13T02:52:31.834 INFO:tasks.workunit.client.1.smithi142.stdout:6/158: rename d1/f37 to d1/d7/f3a 0 2024-09-13T02:52:31.836 INFO:tasks.workunit.client.1.smithi142.stdout:6/159: creat d1/dd/d18/d32/f3b x:0 0 0 2024-09-13T02:52:31.844 INFO:tasks.workunit.client.0.smithi098.stdout:8/21: fsync d2/f3 0 2024-09-13T02:52:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:6/160: dread d1/dd/f26 [0,4194304] 0 2024-09-13T02:52:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:6/161: read d1/dd/d16/f2c [3290851,90786] 0 2024-09-13T02:52:31.849 INFO:tasks.workunit.client.1.smithi142.stdout:9/154: sync 2024-09-13T02:52:31.850 INFO:tasks.workunit.client.1.smithi142.stdout:6/162: fdatasync d1/dd/d16/f15 0 2024-09-13T02:52:31.851 INFO:tasks.workunit.client.1.smithi142.stdout:9/155: read f3 [4651440,105962] 0 2024-09-13T02:52:31.851 INFO:tasks.workunit.client.0.smithi098.stdout:9/18: getdents d2 0 2024-09-13T02:52:31.852 INFO:tasks.workunit.client.1.smithi142.stdout:9/156: write dd/f11 [345249,102016] 0 2024-09-13T02:52:31.852 INFO:tasks.workunit.client.0.smithi098.stdout:9/19: read d2/f7 [3712358,117072] 0 2024-09-13T02:52:31.855 INFO:tasks.workunit.client.1.smithi142.stdout:6/163: rename d1/dd/d16/f15 to d1/dd/d16/f3c 0 2024-09-13T02:52:31.856 INFO:tasks.workunit.client.0.smithi098.stdout:1/27: fsync f8 0 2024-09-13T02:52:31.856 INFO:tasks.workunit.client.0.smithi098.stdout:1/28: dread - d9/fa zero size 2024-09-13T02:52:31.857 INFO:tasks.workunit.client.1.smithi142.stdout:9/157: symlink dd/d17/d35/l3b 0 2024-09-13T02:52:31.861 INFO:tasks.workunit.client.1.smithi142.stdout:9/158: dread dd/f1c [0,4194304] 0 2024-09-13T02:52:31.861 INFO:tasks.workunit.client.0.smithi098.stdout:1/29: dread f8 [0,4194304] 0 2024-09-13T02:52:31.862 INFO:tasks.workunit.client.0.smithi098.stdout:9/20: dwrite d2/f7 [0,4194304] 0 2024-09-13T02:52:31.862 INFO:tasks.workunit.client.0.smithi098.stdout:1/30: read f8 [3477524,67133] 0 2024-09-13T02:52:31.864 INFO:tasks.workunit.client.1.smithi142.stdout:6/164: write d1/dd/d16/f2c [4018003,66458] 0 2024-09-13T02:52:31.867 INFO:tasks.workunit.client.0.smithi098.stdout:1/31: mknod d9/cc 0 2024-09-13T02:52:31.869 INFO:tasks.workunit.client.1.smithi142.stdout:9/159: mknod dd/d17/d35/c3c 0 2024-09-13T02:52:31.870 INFO:tasks.workunit.client.1.smithi142.stdout:6/165: dwrite d1/dd/f22 [0,4194304] 0 2024-09-13T02:52:31.875 INFO:tasks.workunit.client.0.smithi098.stdout:9/21: rename d2/d6/l8 to d2/d6/l9 0 2024-09-13T02:52:31.877 INFO:tasks.workunit.client.1.smithi142.stdout:9/160: creat dd/d17/d35/f3d x:0 0 0 2024-09-13T02:52:31.880 INFO:tasks.workunit.client.0.smithi098.stdout:9/22: rmdir d2/d6 39 2024-09-13T02:52:31.881 INFO:tasks.workunit.client.0.smithi098.stdout:7/22: getdents d6 0 2024-09-13T02:52:31.881 INFO:tasks.workunit.client.0.smithi098.stdout:9/23: truncate d2/f7 4731873 0 2024-09-13T02:52:31.883 INFO:tasks.workunit.client.1.smithi142.stdout:9/161: dwrite dd/f1a [4194304,4194304] 0 2024-09-13T02:52:31.884 INFO:tasks.workunit.client.1.smithi142.stdout:9/162: readlink dd/l20 0 2024-09-13T02:52:31.884 INFO:tasks.workunit.client.1.smithi142.stdout:9/163: dread - dd/f16 zero size 2024-09-13T02:52:31.886 INFO:tasks.workunit.client.0.smithi098.stdout:7/23: rename d6/l8 to d6/la 0 2024-09-13T02:52:31.889 INFO:tasks.workunit.client.1.smithi142.stdout:9/164: mkdir dd/d17/d25/d3e 0 2024-09-13T02:52:31.890 INFO:tasks.workunit.client.0.smithi098.stdout:1/32: link c2 d9/cd 0 2024-09-13T02:52:31.891 INFO:tasks.workunit.client.0.smithi098.stdout:1/33: write f4 [2862898,95768] 0 2024-09-13T02:52:31.894 INFO:tasks.workunit.client.0.smithi098.stdout:7/24: mknod d6/cb 0 2024-09-13T02:52:31.896 INFO:tasks.workunit.client.1.smithi142.stdout:9/165: dwrite dd/d17/d25/f29 [0,4194304] 0 2024-09-13T02:52:31.897 INFO:tasks.workunit.client.0.smithi098.stdout:7/25: rmdir d6 39 2024-09-13T02:52:31.898 INFO:tasks.workunit.client.1.smithi142.stdout:2/69: write d1/f7 [6681071,3134] 0 2024-09-13T02:52:31.898 INFO:tasks.workunit.client.0.smithi098.stdout:1/34: dwrite f4 [0,4194304] 0 2024-09-13T02:52:31.899 INFO:tasks.workunit.client.1.smithi142.stdout:2/70: chown d1/ff 810355 1 2024-09-13T02:52:31.901 INFO:tasks.workunit.client.1.smithi142.stdout:7/114: write fa [475324,45912] 0 2024-09-13T02:52:31.903 INFO:tasks.workunit.client.1.smithi142.stdout:2/71: mkdir d1/de/d12 0 2024-09-13T02:52:31.907 INFO:tasks.workunit.client.0.smithi098.stdout:7/26: dwrite f5 [4194304,4194304] 0 2024-09-13T02:52:31.908 INFO:tasks.workunit.client.0.smithi098.stdout:7/27: stat l0 0 2024-09-13T02:52:31.909 INFO:tasks.workunit.client.0.smithi098.stdout:1/35: dread f1 [0,4194304] 0 2024-09-13T02:52:31.909 INFO:tasks.workunit.client.0.smithi098.stdout:7/28: write f5 [5098848,107283] 0 2024-09-13T02:52:31.918 INFO:tasks.workunit.client.0.smithi098.stdout:7/29: rmdir d6 39 2024-09-13T02:52:31.918 INFO:tasks.workunit.client.1.smithi142.stdout:4/113: dwrite d0/f14 [0,4194304] 0 2024-09-13T02:52:31.919 INFO:tasks.workunit.client.1.smithi142.stdout:2/72: dwrite d1/ff [0,4194304] 0 2024-09-13T02:52:31.920 INFO:tasks.workunit.client.1.smithi142.stdout:7/115: dwrite d10/d13/f1c [0,4194304] 0 2024-09-13T02:52:31.925 INFO:tasks.workunit.client.1.smithi142.stdout:7/116: stat d10/d13/f20 0 2024-09-13T02:52:31.925 INFO:tasks.workunit.client.1.smithi142.stdout:2/73: write d1/fa [123435,9244] 0 2024-09-13T02:52:31.926 INFO:tasks.workunit.client.0.smithi098.stdout:1/36: rename c6 to d9/ce 0 2024-09-13T02:52:31.926 INFO:tasks.workunit.client.0.smithi098.stdout:1/37: chown c5 101802 1 2024-09-13T02:52:31.926 INFO:tasks.workunit.client.1.smithi142.stdout:7/117: readlink d10/d13/l18 0 2024-09-13T02:52:31.927 INFO:tasks.workunit.client.0.smithi098.stdout:7/30: dwrite f3 [0,4194304] 0 2024-09-13T02:52:31.928 INFO:tasks.workunit.client.1.smithi142.stdout:7/118: chown fc 194 1 2024-09-13T02:52:31.929 INFO:tasks.workunit.client.1.smithi142.stdout:8/90: dwrite d0/d1/f1b [0,4194304] 0 2024-09-13T02:52:31.929 INFO:tasks.workunit.client.0.smithi098.stdout:1/38: chown d9/lb 166 1 2024-09-13T02:52:31.930 INFO:tasks.workunit.client.1.smithi142.stdout:8/91: dread - d0/d1/f13 zero size 2024-09-13T02:52:31.931 INFO:tasks.workunit.client.1.smithi142.stdout:3/141: symlink d12/d16/l2a 0 2024-09-13T02:52:31.938 INFO:tasks.workunit.client.0.smithi098.stdout:1/39: dread f4 [0,4194304] 0 2024-09-13T02:52:31.939 INFO:tasks.workunit.client.0.smithi098.stdout:1/40: read f8 [3206114,85410] 0 2024-09-13T02:52:31.942 INFO:tasks.workunit.client.0.smithi098.stdout:7/31: creat d6/fc x:0 0 0 2024-09-13T02:52:31.944 INFO:tasks.workunit.client.1.smithi142.stdout:7/119: rmdir d10/d13 39 2024-09-13T02:52:31.953 INFO:tasks.workunit.client.0.smithi098.stdout:7/32: rename l0 to d6/ld 0 2024-09-13T02:52:31.955 INFO:tasks.workunit.client.1.smithi142.stdout:4/114: link d0/df/f17 d0/d3/d9/f22 0 2024-09-13T02:52:31.956 INFO:tasks.workunit.client.1.smithi142.stdout:2/74: mkdir d1/de/d12/d13 0 2024-09-13T02:52:31.958 INFO:tasks.workunit.client.0.smithi098.stdout:7/33: dwrite f5 [4194304,4194304] 0 2024-09-13T02:52:31.959 INFO:tasks.workunit.client.0.smithi098.stdout:7/34: write f3 [5205615,28886] 0 2024-09-13T02:52:31.961 INFO:tasks.workunit.client.1.smithi142.stdout:4/115: creat d0/df/f23 x:0 0 0 2024-09-13T02:52:31.963 INFO:tasks.workunit.client.1.smithi142.stdout:7/120: mkdir d10/d13/d1d/d25 0 2024-09-13T02:52:31.964 INFO:tasks.workunit.client.1.smithi142.stdout:7/121: fsync fa 0 2024-09-13T02:52:31.965 INFO:tasks.workunit.client.1.smithi142.stdout:7/122: fdatasync d10/d13/f1e 0 2024-09-13T02:52:31.965 INFO:tasks.workunit.client.1.smithi142.stdout:5/142: fsync d8/f15 0 2024-09-13T02:52:31.968 INFO:tasks.workunit.client.1.smithi142.stdout:8/92: truncate d0/d6/dc/fe 3222988 0 2024-09-13T02:52:31.969 INFO:tasks.workunit.client.1.smithi142.stdout:4/116: write d0/df/f17 [3257458,82737] 0 2024-09-13T02:52:31.970 INFO:tasks.workunit.client.1.smithi142.stdout:8/93: fsync d0/d1/f10 0 2024-09-13T02:52:31.970 INFO:tasks.workunit.client.1.smithi142.stdout:2/75: link d1/f9 d1/de/d12/d13/f14 0 2024-09-13T02:52:31.972 INFO:tasks.workunit.client.1.smithi142.stdout:8/94: chown d0/d6/dc/fe 29 1 2024-09-13T02:52:31.972 INFO:tasks.workunit.client.1.smithi142.stdout:2/76: rename d1/de/d12 to d1/de/d12/d15 22 2024-09-13T02:52:31.972 INFO:tasks.workunit.client.1.smithi142.stdout:4/117: readlink d0/d3/la 0 2024-09-13T02:52:31.973 INFO:tasks.workunit.client.1.smithi142.stdout:2/77: chown d1/de 1 1 2024-09-13T02:52:31.973 INFO:tasks.workunit.client.1.smithi142.stdout:7/123: dread d10/d13/f1c [0,4194304] 0 2024-09-13T02:52:31.974 INFO:tasks.workunit.client.1.smithi142.stdout:8/95: readlink d0/d1/d8/df/l15 0 2024-09-13T02:52:31.974 INFO:tasks.workunit.client.1.smithi142.stdout:7/124: chown d10/c11 21375755 1 2024-09-13T02:52:31.975 INFO:tasks.workunit.client.1.smithi142.stdout:5/143: dread d8/f1b [0,4194304] 0 2024-09-13T02:52:31.978 INFO:tasks.workunit.client.1.smithi142.stdout:8/96: symlink d0/d1/d8/l1c 0 2024-09-13T02:52:31.981 INFO:tasks.workunit.client.1.smithi142.stdout:4/118: symlink d0/l24 0 2024-09-13T02:52:31.985 INFO:tasks.workunit.client.1.smithi142.stdout:8/97: dwrite d0/d1/f10 [0,4194304] 0 2024-09-13T02:52:31.987 INFO:tasks.workunit.client.1.smithi142.stdout:8/98: chown d0/d1/d8/df 506597842 1 2024-09-13T02:52:31.987 INFO:tasks.workunit.client.1.smithi142.stdout:0/166: write d10/f13 [1965124,119049] 0 2024-09-13T02:52:31.992 INFO:tasks.workunit.client.1.smithi142.stdout:4/119: dwrite d0/d3/d9/f11 [4194304,4194304] 0 2024-09-13T02:52:31.992 INFO:tasks.workunit.client.1.smithi142.stdout:8/99: creat d0/d1/d8/f1d x:0 0 0 2024-09-13T02:52:31.993 INFO:tasks.workunit.client.1.smithi142.stdout:7/125: dread fa [0,4194304] 0 2024-09-13T02:52:31.994 INFO:tasks.workunit.client.1.smithi142.stdout:8/100: dread - d0/d6/dc/f18 zero size 2024-09-13T02:52:31.995 INFO:tasks.workunit.client.1.smithi142.stdout:8/101: chown d0/d1/fa 36474 1 2024-09-13T02:52:31.996 INFO:tasks.workunit.client.1.smithi142.stdout:4/120: mknod d0/df/c25 0 2024-09-13T02:52:31.997 INFO:tasks.workunit.client.1.smithi142.stdout:7/126: symlink d10/d13/d1d/l26 0 2024-09-13T02:52:31.997 INFO:tasks.workunit.client.1.smithi142.stdout:7/127: fdatasync ff 0 2024-09-13T02:52:32.003 INFO:tasks.workunit.client.1.smithi142.stdout:7/128: dwrite fc [0,4194304] 0 2024-09-13T02:52:32.006 INFO:tasks.workunit.client.1.smithi142.stdout:1/180: write d12/d13/d1d/d26/f2b [5234271,3186] 0 2024-09-13T02:52:32.010 INFO:tasks.workunit.client.1.smithi142.stdout:7/129: link d10/d13/l18 d10/d13/d22/l27 0 2024-09-13T02:52:32.011 INFO:tasks.workunit.client.1.smithi142.stdout:1/181: write d12/d13/d20/f35 [2769961,11441] 0 2024-09-13T02:52:32.012 INFO:tasks.workunit.client.1.smithi142.stdout:7/130: read d10/d13/f1e [3408324,36614] 0 2024-09-13T02:52:32.012 INFO:tasks.workunit.client.1.smithi142.stdout:1/182: fsync d12/d13/f16 0 2024-09-13T02:52:32.020 INFO:tasks.workunit.client.1.smithi142.stdout:1/183: link d12/l1f d12/d13/d20/d27/l3a 0 2024-09-13T02:52:32.021 INFO:tasks.workunit.client.1.smithi142.stdout:7/131: getdents d10/d13 0 2024-09-13T02:52:32.022 INFO:tasks.workunit.client.1.smithi142.stdout:1/184: write f1 [1157935,3552] 0 2024-09-13T02:52:32.023 INFO:tasks.workunit.client.1.smithi142.stdout:1/185: dread - d12/d13/d20/f38 zero size 2024-09-13T02:52:32.025 INFO:tasks.workunit.client.1.smithi142.stdout:4/121: dread d0/df/f17 [0,4194304] 0 2024-09-13T02:52:32.025 INFO:tasks.workunit.client.1.smithi142.stdout:4/122: chown d0 14 1 2024-09-13T02:52:32.026 INFO:tasks.workunit.client.1.smithi142.stdout:1/186: rmdir d12/d13/d20/d2c 39 2024-09-13T02:52:32.027 INFO:tasks.workunit.client.1.smithi142.stdout:1/187: truncate d12/d13/d1d/f25 118890 0 2024-09-13T02:52:32.028 INFO:tasks.workunit.client.1.smithi142.stdout:4/123: write d0/d3/d9/f22 [4848503,127647] 0 2024-09-13T02:52:32.028 INFO:tasks.workunit.client.1.smithi142.stdout:1/188: write d12/d13/f16 [4367713,109315] 0 2024-09-13T02:52:32.029 INFO:tasks.workunit.client.1.smithi142.stdout:4/124: chown d0/lc 30335401 1 2024-09-13T02:52:32.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/189: mknod d12/d39/c3b 0 2024-09-13T02:52:32.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/190: fdatasync d12/d13/d1d/f21 0 2024-09-13T02:52:32.032 INFO:tasks.workunit.client.0.smithi098.stdout:9/24: stat d2/d6/l9 0 2024-09-13T02:52:32.033 INFO:tasks.workunit.client.1.smithi142.stdout:6/166: write d1/d7/d19/f2f [5366672,25847] 0 2024-09-13T02:52:32.034 INFO:tasks.workunit.client.0.smithi098.stdout:9/25: mknod d2/d6/ca 0 2024-09-13T02:52:32.035 INFO:tasks.workunit.client.1.smithi142.stdout:6/167: write d1/dd/f35 [595030,71957] 0 2024-09-13T02:52:32.035 INFO:tasks.workunit.client.0.smithi098.stdout:9/26: write d2/f4 [5157359,25739] 0 2024-09-13T02:52:32.036 INFO:tasks.workunit.client.1.smithi142.stdout:1/191: dread d12/d13/d1d/f21 [0,4194304] 0 2024-09-13T02:52:32.038 INFO:tasks.workunit.client.0.smithi098.stdout:7/35: chown d6/la 58 1 2024-09-13T02:52:32.039 INFO:tasks.workunit.client.1.smithi142.stdout:4/125: link d0/d3/c12 d0/d3/d13/c26 0 2024-09-13T02:52:32.041 INFO:tasks.workunit.client.0.smithi098.stdout:7/36: creat d6/fe x:0 0 0 2024-09-13T02:52:32.041 INFO:tasks.workunit.client.0.smithi098.stdout:7/37: dread - d6/fe zero size 2024-09-13T02:52:32.042 INFO:tasks.workunit.client.0.smithi098.stdout:7/38: fdatasync f5 0 2024-09-13T02:52:32.045 INFO:tasks.workunit.client.1.smithi142.stdout:4/126: dread d0/d3/f7 [4194304,4194304] 0 2024-09-13T02:52:32.046 INFO:tasks.workunit.client.1.smithi142.stdout:1/192: unlink d12/d13/c18 0 2024-09-13T02:52:32.046 INFO:tasks.workunit.client.1.smithi142.stdout:9/166: write dd/f10 [227967,11480] 0 2024-09-13T02:52:32.046 INFO:tasks.workunit.client.1.smithi142.stdout:4/127: stat d0/df 0 2024-09-13T02:52:32.048 INFO:tasks.workunit.client.0.smithi098.stdout:7/39: unlink d6/la 0 2024-09-13T02:52:32.051 INFO:tasks.workunit.client.1.smithi142.stdout:9/167: symlink dd/d17/d25/l3f 0 2024-09-13T02:52:32.051 INFO:tasks.workunit.client.0.smithi098.stdout:1/41: rmdir d9 39 2024-09-13T02:52:32.051 INFO:tasks.workunit.client.0.smithi098.stdout:1/42: chown f1 1120769 1 2024-09-13T02:52:32.053 INFO:tasks.workunit.client.0.smithi098.stdout:1/43: write d9/fa [575666,44622] 0 2024-09-13T02:52:32.053 INFO:tasks.workunit.client.0.smithi098.stdout:1/44: stat d9/fa 0 2024-09-13T02:52:32.056 INFO:tasks.workunit.client.1.smithi142.stdout:9/168: rename dd/l2f to dd/d17/d25/d3e/l40 0 2024-09-13T02:52:32.058 INFO:tasks.workunit.client.0.smithi098.stdout:1/45: mknod d9/cf 0 2024-09-13T02:52:32.059 INFO:tasks.workunit.client.0.smithi098.stdout:1/46: truncate d9/fa 1108993 0 2024-09-13T02:52:32.059 INFO:tasks.workunit.client.1.smithi142.stdout:3/142: read d12/d16/f21 [1401055,130030] 0 2024-09-13T02:52:32.061 INFO:tasks.workunit.client.1.smithi142.stdout:9/169: dread dd/f1d [0,4194304] 0 2024-09-13T02:52:32.061 INFO:tasks.workunit.client.1.smithi142.stdout:4/128: dread d0/d3/f7 [0,4194304] 0 2024-09-13T02:52:32.062 INFO:tasks.workunit.client.1.smithi142.stdout:9/170: write dd/d17/d25/f29 [1922877,43384] 0 2024-09-13T02:52:32.064 INFO:tasks.workunit.client.1.smithi142.stdout:3/143: read d12/d16/f24 [683709,72193] 0 2024-09-13T02:52:32.064 INFO:tasks.workunit.client.1.smithi142.stdout:9/171: write dd/d17/f2b [784573,17628] 0 2024-09-13T02:52:32.069 INFO:tasks.workunit.client.1.smithi142.stdout:3/144: write d12/d16/f17 [1775553,69169] 0 2024-09-13T02:52:32.071 INFO:tasks.workunit.client.1.smithi142.stdout:4/129: dwrite d0/d3/d13/f1a [0,4194304] 0 2024-09-13T02:52:32.072 INFO:tasks.workunit.client.1.smithi142.stdout:5/144: truncate d8/f1c 4170197 0 2024-09-13T02:52:32.073 INFO:tasks.workunit.client.1.smithi142.stdout:0/167: truncate d10/f13 1728560 0 2024-09-13T02:52:32.074 INFO:tasks.workunit.client.1.smithi142.stdout:0/168: dread - d10/d15/d1a/d28/f3e zero size 2024-09-13T02:52:32.075 INFO:tasks.workunit.client.1.smithi142.stdout:4/130: rename d0/d3/d9/c10 to d0/d3/d21/c27 0 2024-09-13T02:52:32.075 INFO:tasks.workunit.client.1.smithi142.stdout:7/132: getdents d10/d13/d1d 0 2024-09-13T02:52:32.077 INFO:tasks.workunit.client.1.smithi142.stdout:5/145: truncate d8/d24/f27 447473 0 2024-09-13T02:52:32.079 INFO:tasks.workunit.client.1.smithi142.stdout:5/146: fdatasync d8/f1f 0 2024-09-13T02:52:32.079 INFO:tasks.workunit.client.1.smithi142.stdout:3/145: dwrite d12/d16/f20 [0,4194304] 0 2024-09-13T02:52:32.079 INFO:tasks.workunit.client.1.smithi142.stdout:3/146: chown d12 3 1 2024-09-13T02:52:32.081 INFO:tasks.workunit.client.1.smithi142.stdout:0/169: rename ca to d10/d15/d36/c44 0 2024-09-13T02:52:32.086 INFO:tasks.workunit.client.1.smithi142.stdout:4/131: dwrite d0/df/f17 [0,4194304] 0 2024-09-13T02:52:32.088 INFO:tasks.workunit.client.1.smithi142.stdout:4/132: read d0/d3/d9/f22 [3621374,20190] 0 2024-09-13T02:52:32.088 INFO:tasks.workunit.client.1.smithi142.stdout:1/193: readlink d12/d1b/l1c 0 2024-09-13T02:52:32.090 INFO:tasks.workunit.client.1.smithi142.stdout:4/133: write d0/df/f17 [4351453,96416] 0 2024-09-13T02:52:32.092 INFO:tasks.workunit.client.1.smithi142.stdout:4/134: write d0/d3/d9/f20 [495313,124152] 0 2024-09-13T02:52:32.093 INFO:tasks.workunit.client.1.smithi142.stdout:0/170: dwrite d10/d15/d1a/f22 [0,4194304] 0 2024-09-13T02:52:32.094 INFO:tasks.workunit.client.1.smithi142.stdout:2/78: sync 2024-09-13T02:52:32.098 INFO:tasks.workunit.client.1.smithi142.stdout:4/135: dread d0/f14 [0,4194304] 0 2024-09-13T02:52:32.100 INFO:tasks.workunit.client.1.smithi142.stdout:7/133: dread fe [0,4194304] 0 2024-09-13T02:52:32.101 INFO:tasks.workunit.client.1.smithi142.stdout:1/194: mkdir d12/d13/d20/d27/d3c 0 2024-09-13T02:52:32.101 INFO:tasks.workunit.client.1.smithi142.stdout:7/134: dread - d10/d13/f20 zero size 2024-09-13T02:52:32.102 INFO:tasks.workunit.client.1.smithi142.stdout:7/135: write d10/d13/f20 [619875,98129] 0 2024-09-13T02:52:32.104 INFO:tasks.workunit.client.1.smithi142.stdout:3/147: creat d12/f2b x:0 0 0 2024-09-13T02:52:32.109 INFO:tasks.workunit.client.1.smithi142.stdout:2/79: mknod d1/de/c16 0 2024-09-13T02:52:32.111 INFO:tasks.workunit.client.1.smithi142.stdout:3/148: dwrite d12/f13 [0,4194304] 0 2024-09-13T02:52:32.111 INFO:tasks.workunit.client.0.smithi098.stdout:7/40: getdents d6 0 2024-09-13T02:52:32.111 INFO:tasks.workunit.client.0.smithi098.stdout:1/47: write f1 [4271246,63661] 0 2024-09-13T02:52:32.112 INFO:tasks.workunit.client.1.smithi142.stdout:9/172: write dd/fe [2091897,67537] 0 2024-09-13T02:52:32.112 INFO:tasks.workunit.client.1.smithi142.stdout:9/173: stat dd/f16 0 2024-09-13T02:52:32.116 INFO:tasks.workunit.client.1.smithi142.stdout:4/136: mknod d0/d3/d21/c28 0 2024-09-13T02:52:32.116 INFO:tasks.workunit.client.1.smithi142.stdout:9/174: write dd/f1f [550703,12845] 0 2024-09-13T02:52:32.120 INFO:tasks.workunit.client.1.smithi142.stdout:4/137: fsync d0/d3/d9/f11 0 2024-09-13T02:52:32.123 INFO:tasks.workunit.client.1.smithi142.stdout:3/149: dwrite d12/d16/f20 [4194304,4194304] 0 2024-09-13T02:52:32.125 INFO:tasks.workunit.client.1.smithi142.stdout:9/175: dwrite f8 [0,4194304] 0 2024-09-13T02:52:32.125 INFO:tasks.workunit.client.1.smithi142.stdout:5/147: getdents d8/d24 0 2024-09-13T02:52:32.129 INFO:tasks.workunit.client.1.smithi142.stdout:2/80: rename d1/f7 to d1/de/f17 0 2024-09-13T02:52:32.132 INFO:tasks.workunit.client.1.smithi142.stdout:9/176: dwrite f8 [0,4194304] 0 2024-09-13T02:52:32.140 INFO:tasks.workunit.client.1.smithi142.stdout:1/195: dread d12/d1b/f2f [0,4194304] 0 2024-09-13T02:52:32.144 INFO:tasks.workunit.client.1.smithi142.stdout:7/136: getdents d10/d13/d1d/d25 0 2024-09-13T02:52:32.146 INFO:tasks.workunit.client.1.smithi142.stdout:4/138: creat d0/df/f29 x:0 0 0 2024-09-13T02:52:32.152 INFO:tasks.workunit.client.1.smithi142.stdout:4/139: dwrite d0/d3/d9/f11 [4194304,4194304] 0 2024-09-13T02:52:32.155 INFO:tasks.workunit.client.1.smithi142.stdout:2/81: creat d1/de/f18 x:0 0 0 2024-09-13T02:52:32.157 INFO:tasks.workunit.client.1.smithi142.stdout:9/177: mkdir dd/d17/d35/d41 0 2024-09-13T02:52:32.164 INFO:tasks.workunit.client.1.smithi142.stdout:1/196: creat d12/f3d x:0 0 0 2024-09-13T02:52:32.174 INFO:tasks.workunit.client.1.smithi142.stdout:4/140: unlink d0/df/f17 0 2024-09-13T02:52:32.177 INFO:tasks.workunit.client.1.smithi142.stdout:2/82: rename d1/fa to d1/de/d12/f19 0 2024-09-13T02:52:32.178 INFO:tasks.workunit.client.1.smithi142.stdout:9/178: creat dd/d17/d25/f42 x:0 0 0 2024-09-13T02:52:32.179 INFO:tasks.workunit.client.1.smithi142.stdout:9/179: chown dd 1991 1 2024-09-13T02:52:32.182 INFO:tasks.workunit.client.1.smithi142.stdout:8/102: sync 2024-09-13T02:52:32.184 INFO:tasks.workunit.client.1.smithi142.stdout:5/148: link d8/c14 d8/c2a 0 2024-09-13T02:52:32.185 INFO:tasks.workunit.client.1.smithi142.stdout:9/180: dwrite dd/d17/d25/f2d [0,4194304] 0 2024-09-13T02:52:32.186 INFO:tasks.workunit.client.1.smithi142.stdout:9/181: write dd/d17/d25/f29 [1313467,18807] 0 2024-09-13T02:52:32.190 INFO:tasks.workunit.client.1.smithi142.stdout:4/141: chown d0/d3/d9/f22 1809 1 2024-09-13T02:52:32.193 INFO:tasks.workunit.client.1.smithi142.stdout:2/83: creat d1/de/d12/f1a x:0 0 0 2024-09-13T02:52:32.204 INFO:tasks.workunit.client.1.smithi142.stdout:8/103: dread d0/d1/d8/f12 [0,4194304] 0 2024-09-13T02:52:32.209 INFO:tasks.workunit.client.1.smithi142.stdout:4/142: creat d0/d3/d21/f2a x:0 0 0 2024-09-13T02:52:32.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/137: truncate fc 1290080 0 2024-09-13T02:52:32.210 INFO:tasks.workunit.client.1.smithi142.stdout:6/168: sync 2024-09-13T02:52:32.210 INFO:tasks.workunit.client.1.smithi142.stdout:8/104: dwrite d0/d1/f3 [0,4194304] 0 2024-09-13T02:52:32.212 INFO:tasks.workunit.client.1.smithi142.stdout:3/150: truncate d12/d16/d25/f26 3530650 0 2024-09-13T02:52:32.213 INFO:tasks.workunit.client.1.smithi142.stdout:1/197: creat d12/d13/d20/f3e x:0 0 0 2024-09-13T02:52:32.215 INFO:tasks.workunit.client.1.smithi142.stdout:7/138: dwrite f8 [4194304,4194304] 0 2024-09-13T02:52:32.216 INFO:tasks.workunit.client.1.smithi142.stdout:7/139: read d10/d13/f1c [1389088,97287] 0 2024-09-13T02:52:32.233 INFO:tasks.workunit.client.1.smithi142.stdout:8/105: rename d0/d1/f13 to d0/d1/d8/df/f1e 0 2024-09-13T02:52:32.236 INFO:tasks.workunit.client.1.smithi142.stdout:8/106: dread d0/d1/d8/f12 [0,4194304] 0 2024-09-13T02:52:32.254 INFO:tasks.workunit.client.1.smithi142.stdout:2/84: link d1/de/c16 d1/de/d12/d13/c1b 0 2024-09-13T02:52:32.257 INFO:tasks.workunit.client.1.smithi142.stdout:0/171: sync 2024-09-13T02:52:32.258 INFO:tasks.workunit.client.1.smithi142.stdout:0/172: write f9 [2866947,102711] 0 2024-09-13T02:52:32.260 INFO:tasks.workunit.client.1.smithi142.stdout:0/173: write d10/d23/f25 [1427344,129555] 0 2024-09-13T02:52:32.261 INFO:tasks.workunit.client.1.smithi142.stdout:3/151: mknod d12/d16/c2c 0 2024-09-13T02:52:32.263 INFO:tasks.workunit.client.1.smithi142.stdout:0/174: truncate d10/d15/d1a/d28/f3e 7846 0 2024-09-13T02:52:32.264 INFO:tasks.workunit.client.1.smithi142.stdout:5/149: getdents d8 0 2024-09-13T02:52:32.265 INFO:tasks.workunit.client.1.smithi142.stdout:8/107: dwrite d0/d1/d8/df/f1e [0,4194304] 0 2024-09-13T02:52:32.265 INFO:tasks.workunit.client.1.smithi142.stdout:7/140: symlink d10/l28 0 2024-09-13T02:52:32.266 INFO:tasks.workunit.client.1.smithi142.stdout:8/108: dread - d0/d6/dc/f18 zero size 2024-09-13T02:52:32.266 INFO:tasks.workunit.client.1.smithi142.stdout:8/109: write d0/d1/f10 [2226940,104609] 0 2024-09-13T02:52:32.268 INFO:tasks.workunit.client.1.smithi142.stdout:9/182: getdents dd 0 2024-09-13T02:52:32.269 INFO:tasks.workunit.client.1.smithi142.stdout:6/169: creat d1/f3d x:0 0 0 2024-09-13T02:52:32.269 INFO:tasks.workunit.client.1.smithi142.stdout:6/170: chown d1/f10 300758 1 2024-09-13T02:52:32.270 INFO:tasks.workunit.client.1.smithi142.stdout:6/171: write d1/dd/f22 [1331188,60402] 0 2024-09-13T02:52:32.274 INFO:tasks.workunit.client.1.smithi142.stdout:6/172: dread d1/dd/f26 [0,4194304] 0 2024-09-13T02:52:32.280 INFO:tasks.workunit.client.1.smithi142.stdout:1/198: creat d12/d13/f3f x:0 0 0 2024-09-13T02:52:32.282 INFO:tasks.workunit.client.1.smithi142.stdout:5/150: unlink l6 0 2024-09-13T02:52:32.283 INFO:tasks.workunit.client.1.smithi142.stdout:0/175: mkdir d10/d15/d45 0 2024-09-13T02:52:32.285 INFO:tasks.workunit.client.1.smithi142.stdout:1/199: dread d12/d13/d1d/d26/f2b [0,4194304] 0 2024-09-13T02:52:32.287 INFO:tasks.workunit.client.1.smithi142.stdout:1/200: write d12/d13/d1d/f25 [302300,29331] 0 2024-09-13T02:52:32.289 INFO:tasks.workunit.client.1.smithi142.stdout:1/201: rename d12/d13 to d12/d13/d1d/d26/d40 22 2024-09-13T02:52:32.290 INFO:tasks.workunit.client.1.smithi142.stdout:9/183: mknod dd/d17/d35/c43 0 2024-09-13T02:52:32.291 INFO:tasks.workunit.client.1.smithi142.stdout:0/176: dread d10/d23/f2a [0,4194304] 0 2024-09-13T02:52:32.291 INFO:tasks.workunit.client.1.smithi142.stdout:9/184: dread - dd/d17/d25/f38 zero size 2024-09-13T02:52:32.292 INFO:tasks.workunit.client.1.smithi142.stdout:0/177: write d10/d15/f2d [5062179,92621] 0 2024-09-13T02:52:32.300 INFO:tasks.workunit.client.1.smithi142.stdout:4/143: dread d0/d3/d9/f11 [0,4194304] 0 2024-09-13T02:52:32.302 INFO:tasks.workunit.client.1.smithi142.stdout:5/151: symlink d8/l2b 0 2024-09-13T02:52:32.306 INFO:tasks.workunit.client.1.smithi142.stdout:7/141: symlink d10/l29 0 2024-09-13T02:52:32.306 INFO:tasks.workunit.client.1.smithi142.stdout:7/142: stat d10/d13/d1d 0 2024-09-13T02:52:32.306 INFO:tasks.workunit.client.1.smithi142.stdout:7/143: chown d10/l29 983526124 1 2024-09-13T02:52:32.314 INFO:tasks.workunit.client.1.smithi142.stdout:1/202: rmdir d12/d13 39 2024-09-13T02:52:32.320 INFO:tasks.workunit.client.1.smithi142.stdout:5/152: dread d8/f1c [0,4194304] 0 2024-09-13T02:52:32.321 INFO:tasks.workunit.client.1.smithi142.stdout:9/185: mkdir dd/d17/d44 0 2024-09-13T02:52:32.323 INFO:tasks.workunit.client.1.smithi142.stdout:0/178: creat d10/d15/f46 x:0 0 0 2024-09-13T02:52:32.326 INFO:tasks.workunit.client.1.smithi142.stdout:0/179: dread d10/d15/f2d [0,4194304] 0 2024-09-13T02:52:32.338 INFO:tasks.workunit.client.1.smithi142.stdout:1/203: fsync d12/d13/d20/f35 0 2024-09-13T02:52:32.339 INFO:tasks.workunit.client.1.smithi142.stdout:8/110: write d0/d6/dc/fe [1425543,1867] 0 2024-09-13T02:52:32.340 INFO:tasks.workunit.client.1.smithi142.stdout:1/204: write d12/d13/d20/d27/f30 [646090,43392] 0 2024-09-13T02:52:32.341 INFO:tasks.workunit.client.1.smithi142.stdout:1/205: fsync d12/d13/d1d/f21 0 2024-09-13T02:52:32.341 INFO:tasks.workunit.client.1.smithi142.stdout:2/85: getdents d1 0 2024-09-13T02:52:32.341 INFO:tasks.workunit.client.1.smithi142.stdout:8/111: write d0/d1/f10 [3824385,13958] 0 2024-09-13T02:52:32.343 INFO:tasks.workunit.client.1.smithi142.stdout:5/153: write f5 [9503158,10640] 0 2024-09-13T02:52:32.346 INFO:tasks.workunit.client.1.smithi142.stdout:0/180: symlink d10/d23/l47 0 2024-09-13T02:52:32.346 INFO:tasks.workunit.client.1.smithi142.stdout:1/206: dread d12/f22 [0,4194304] 0 2024-09-13T02:52:32.347 INFO:tasks.workunit.client.1.smithi142.stdout:0/181: stat d10/d15/d1a 0 2024-09-13T02:52:32.348 INFO:tasks.workunit.client.1.smithi142.stdout:0/182: truncate d10/d15/d1a/d28/f3e 427507 0 2024-09-13T02:52:32.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/186: sync 2024-09-13T02:52:32.491 INFO:tasks.workunit.client.1.smithi142.stdout:2/86: rmdir d1/de/d12/d13 39 2024-09-13T02:52:32.493 INFO:tasks.workunit.client.1.smithi142.stdout:8/112: mknod d0/d6/dc/c1f 0 2024-09-13T02:52:32.497 INFO:tasks.workunit.client.1.smithi142.stdout:5/154: rename c2 to d8/c2c 0 2024-09-13T02:52:32.498 INFO:tasks.workunit.client.1.smithi142.stdout:8/113: dread d0/d1/fa [0,4194304] 0 2024-09-13T02:52:32.499 INFO:tasks.workunit.client.1.smithi142.stdout:6/173: getdents d1/dd/d16 0 2024-09-13T02:52:32.500 INFO:tasks.workunit.client.1.smithi142.stdout:6/174: write d1/dd/f22 [48949,15944] 0 2024-09-13T02:52:32.501 INFO:tasks.workunit.client.1.smithi142.stdout:3/152: getdents d12/d16/d25 0 2024-09-13T02:52:32.504 INFO:tasks.workunit.client.1.smithi142.stdout:4/144: rename d0/d3 to d0/d2b 0 2024-09-13T02:52:32.506 INFO:tasks.workunit.client.1.smithi142.stdout:6/175: dwrite d1/dd/d16/f1c [0,4194304] 0 2024-09-13T02:52:32.509 INFO:tasks.workunit.client.1.smithi142.stdout:0/183: dread d10/d23/f2a [0,4194304] 0 2024-09-13T02:52:32.516 INFO:tasks.workunit.client.1.smithi142.stdout:7/144: dwrite fc [0,4194304] 0 2024-09-13T02:52:32.518 INFO:tasks.workunit.client.1.smithi142.stdout:7/145: write d10/f17 [729186,52269] 0 2024-09-13T02:52:32.519 INFO:tasks.workunit.client.1.smithi142.stdout:7/146: write fa [2465262,113638] 0 2024-09-13T02:52:32.520 INFO:tasks.workunit.client.1.smithi142.stdout:7/147: chown d10/d13/l19 60933 1 2024-09-13T02:52:32.526 INFO:tasks.workunit.client.1.smithi142.stdout:3/153: fsync d12/f22 0 2024-09-13T02:52:32.527 INFO:tasks.workunit.client.1.smithi142.stdout:4/145: rmdir d0/d2b/d13 39 2024-09-13T02:52:32.527 INFO:tasks.workunit.client.1.smithi142.stdout:3/154: write d12/f13 [3847062,62628] 0 2024-09-13T02:52:32.528 INFO:tasks.workunit.client.1.smithi142.stdout:4/146: dread - d0/df/f29 zero size 2024-09-13T02:52:32.529 INFO:tasks.workunit.client.1.smithi142.stdout:4/147: write d0/df/f1f [421092,86313] 0 2024-09-13T02:52:32.531 INFO:tasks.workunit.client.1.smithi142.stdout:6/176: creat d1/d7/f3e x:0 0 0 2024-09-13T02:52:32.533 INFO:tasks.workunit.client.1.smithi142.stdout:7/148: fdatasync fc 0 2024-09-13T02:52:32.537 INFO:tasks.workunit.client.1.smithi142.stdout:1/207: write d12/d13/d1d/d26/f2b [2188149,118270] 0 2024-09-13T02:52:32.537 INFO:tasks.workunit.client.1.smithi142.stdout:0/184: rmdir d10/d15/d1a 39 2024-09-13T02:52:32.542 INFO:tasks.workunit.client.1.smithi142.stdout:5/155: mkdir d8/d24/d26/d2d 0 2024-09-13T02:52:32.542 INFO:tasks.workunit.client.1.smithi142.stdout:9/187: dwrite dd/ff [0,4194304] 0 2024-09-13T02:52:32.544 INFO:tasks.workunit.client.1.smithi142.stdout:9/188: readlink dd/d17/d25/l3f 0 2024-09-13T02:52:32.546 INFO:tasks.workunit.client.1.smithi142.stdout:2/87: dwrite d1/de/f17 [0,4194304] 0 2024-09-13T02:52:32.553 INFO:tasks.workunit.client.1.smithi142.stdout:3/155: mknod d12/d16/d25/c2d 0 2024-09-13T02:52:32.558 INFO:tasks.workunit.client.1.smithi142.stdout:6/177: mknod d1/dd/d18/c3f 0 2024-09-13T02:52:32.560 INFO:tasks.workunit.client.1.smithi142.stdout:7/149: fsync d10/d13/f1c 0 2024-09-13T02:52:32.561 INFO:tasks.workunit.client.1.smithi142.stdout:5/156: dread d8/f1e [0,4194304] 0 2024-09-13T02:52:32.561 INFO:tasks.workunit.client.1.smithi142.stdout:7/150: stat ff 0 2024-09-13T02:52:32.561 INFO:tasks.workunit.client.1.smithi142.stdout:3/156: dwrite d12/f19 [0,4194304] 0 2024-09-13T02:52:32.562 INFO:tasks.workunit.client.1.smithi142.stdout:3/157: fdatasync fe 0 2024-09-13T02:52:32.563 INFO:tasks.workunit.client.1.smithi142.stdout:1/208: unlink d12/c15 0 2024-09-13T02:52:32.565 INFO:tasks.workunit.client.1.smithi142.stdout:4/148: dwrite d0/d2b/f7 [0,4194304] 0 2024-09-13T02:52:32.566 INFO:tasks.workunit.client.1.smithi142.stdout:7/151: read d10/f16 [2800457,51149] 0 2024-09-13T02:52:32.569 INFO:tasks.workunit.client.1.smithi142.stdout:4/149: truncate d0/df/f23 1014498 0 2024-09-13T02:52:32.569 INFO:tasks.workunit.client.1.smithi142.stdout:5/157: read d8/f10 [7965249,115838] 0 2024-09-13T02:52:32.571 INFO:tasks.workunit.client.1.smithi142.stdout:8/114: link d0/d1/d8/c19 d0/d6/dc/c20 0 2024-09-13T02:52:32.573 INFO:tasks.workunit.client.1.smithi142.stdout:2/88: symlink d1/de/l1c 0 2024-09-13T02:52:32.574 INFO:tasks.workunit.client.1.smithi142.stdout:2/89: chown d1/ld 494306994 1 2024-09-13T02:52:32.574 INFO:tasks.workunit.client.1.smithi142.stdout:6/178: rmdir d1/d7 39 2024-09-13T02:52:32.580 INFO:tasks.workunit.client.1.smithi142.stdout:1/209: symlink d12/d13/d1d/l41 0 2024-09-13T02:52:32.584 INFO:tasks.workunit.client.1.smithi142.stdout:5/158: rmdir d8/d24/d26 39 2024-09-13T02:52:32.584 INFO:tasks.workunit.client.1.smithi142.stdout:5/159: fdatasync d8/fc 0 2024-09-13T02:52:32.586 INFO:tasks.workunit.client.1.smithi142.stdout:8/115: mknod d0/d6/dc/c21 0 2024-09-13T02:52:32.589 INFO:tasks.workunit.client.1.smithi142.stdout:2/90: creat d1/de/d12/d13/f1d x:0 0 0 2024-09-13T02:52:32.590 INFO:tasks.workunit.client.1.smithi142.stdout:2/91: stat d1/de/d12/d13 0 2024-09-13T02:52:32.590 INFO:tasks.workunit.client.1.smithi142.stdout:2/92: read d1/ff [999662,82195] 0 2024-09-13T02:52:32.591 INFO:tasks.workunit.client.1.smithi142.stdout:3/158: dread d12/f28 [0,4194304] 0 2024-09-13T02:52:32.595 INFO:tasks.workunit.client.1.smithi142.stdout:6/179: dread d1/dd/d16/f3c [0,4194304] 0 2024-09-13T02:52:32.595 INFO:tasks.workunit.client.1.smithi142.stdout:0/185: creat d10/d15/d1a/d1e/d42/f48 x:0 0 0 2024-09-13T02:52:32.596 INFO:tasks.workunit.client.1.smithi142.stdout:1/210: rmdir d12/d13 39 2024-09-13T02:52:32.597 INFO:tasks.workunit.client.1.smithi142.stdout:1/211: chown d12/c34 940 1 2024-09-13T02:52:32.603 INFO:tasks.workunit.client.1.smithi142.stdout:5/160: rename d8/fc to d8/f2e 0 2024-09-13T02:52:32.603 INFO:tasks.workunit.client.1.smithi142.stdout:5/161: stat d8/f2e 0 2024-09-13T02:52:32.604 INFO:tasks.workunit.client.1.smithi142.stdout:8/116: mknod d0/d6/dc/c22 0 2024-09-13T02:52:32.636 INFO:tasks.workunit.client.0.smithi098.stdout:7/41: link f3 d6/ff 0 2024-09-13T02:52:32.640 INFO:tasks.workunit.client.0.smithi098.stdout:1/48: dwrite f4 [0,4194304] 0 2024-09-13T02:52:32.644 INFO:tasks.workunit.client.0.smithi098.stdout:7/42: dwrite d6/ff [4194304,4194304] 0 2024-09-13T02:52:32.645 INFO:tasks.workunit.client.0.smithi098.stdout:1/49: getdents d9 0 2024-09-13T02:52:32.647 INFO:tasks.workunit.client.0.smithi098.stdout:7/43: creat d6/f10 x:0 0 0 2024-09-13T02:52:32.647 INFO:tasks.workunit.client.1.smithi142.stdout:6/180: readlink d1/dd/l14 0 2024-09-13T02:52:32.648 INFO:tasks.workunit.client.1.smithi142.stdout:3/159: chown d12/d16/f17 1 1 2024-09-13T02:52:32.649 INFO:tasks.workunit.client.1.smithi142.stdout:4/150: mknod d0/d2b/d13/c2c 0 2024-09-13T02:52:32.650 INFO:tasks.workunit.client.1.smithi142.stdout:0/186: dread d10/d23/f25 [0,4194304] 0 2024-09-13T02:52:32.650 INFO:tasks.workunit.client.0.smithi098.stdout:1/50: link d9/fa d9/f10 0 2024-09-13T02:52:32.651 INFO:tasks.workunit.client.1.smithi142.stdout:1/212: write d12/d13/d1d/f25 [684471,33445] 0 2024-09-13T02:52:32.652 INFO:tasks.workunit.client.1.smithi142.stdout:9/189: dwrite f3 [4194304,4194304] 0 2024-09-13T02:52:32.653 INFO:tasks.workunit.client.1.smithi142.stdout:6/181: fdatasync d1/dd/f26 0 2024-09-13T02:52:32.655 INFO:tasks.workunit.client.0.smithi098.stdout:7/44: dwrite d6/fe [0,4194304] 0 2024-09-13T02:52:32.657 INFO:tasks.workunit.client.0.smithi098.stdout:1/51: unlink l7 0 2024-09-13T02:52:32.659 INFO:tasks.workunit.client.0.smithi098.stdout:7/45: creat d6/f11 x:0 0 0 2024-09-13T02:52:32.662 INFO:tasks.workunit.client.0.smithi098.stdout:1/52: rename c5 to d9/c11 0 2024-09-13T02:52:32.664 INFO:tasks.workunit.client.0.smithi098.stdout:7/46: mknod d6/c12 0 2024-09-13T02:52:32.665 INFO:tasks.workunit.client.1.smithi142.stdout:3/160: dwrite d12/d16/f20 [4194304,4194304] 0 2024-09-13T02:52:32.665 INFO:tasks.workunit.client.0.smithi098.stdout:7/47: read - d6/fc zero size 2024-09-13T02:52:32.667 INFO:tasks.workunit.client.0.smithi098.stdout:1/53: fdatasync d9/f10 0 2024-09-13T02:52:32.668 INFO:tasks.workunit.client.1.smithi142.stdout:9/190: symlink dd/d17/d25/l45 0 2024-09-13T02:52:32.669 INFO:tasks.workunit.client.1.smithi142.stdout:9/191: read dd/f1b [338041,99546] 0 2024-09-13T02:52:32.671 INFO:tasks.workunit.client.1.smithi142.stdout:3/161: dread d12/f13 [0,4194304] 0 2024-09-13T02:52:32.672 INFO:tasks.workunit.client.1.smithi142.stdout:6/182: rename d1/dd/f26 to d1/dd/d18/d32/f40 0 2024-09-13T02:52:32.674 INFO:tasks.workunit.client.0.smithi098.stdout:7/48: dwrite d6/fe [0,4194304] 0 2024-09-13T02:52:32.674 INFO:tasks.workunit.client.0.smithi098.stdout:1/54: mkdir d9/d12 0 2024-09-13T02:52:32.676 INFO:tasks.workunit.client.1.smithi142.stdout:4/151: mkdir d0/d2b/d2d 0 2024-09-13T02:52:32.678 INFO:tasks.workunit.client.1.smithi142.stdout:0/187: mknod d10/c49 0 2024-09-13T02:52:32.679 INFO:tasks.workunit.client.1.smithi142.stdout:0/188: dread - d10/d15/d1a/d28/d35/f40 zero size 2024-09-13T02:52:32.680 INFO:tasks.workunit.client.0.smithi098.stdout:1/55: mkdir d9/d13 0 2024-09-13T02:52:32.680 INFO:tasks.workunit.client.1.smithi142.stdout:0/189: chown d10/l24 83006 1 2024-09-13T02:52:32.680 INFO:tasks.workunit.client.1.smithi142.stdout:0/190: chown d10/d15/d1a/d28/l2b 1691965 1 2024-09-13T02:52:32.681 INFO:tasks.workunit.client.1.smithi142.stdout:5/162: creat d8/d24/d26/d2d/f2f x:0 0 0 2024-09-13T02:52:32.682 INFO:tasks.workunit.client.1.smithi142.stdout:0/191: write d10/d15/d1a/d1e/d42/f48 [573179,120336] 0 2024-09-13T02:52:32.686 INFO:tasks.workunit.client.0.smithi098.stdout:1/56: dwrite f8 [0,4194304] 0 2024-09-13T02:52:32.690 INFO:tasks.workunit.client.1.smithi142.stdout:9/192: symlink dd/d17/l46 0 2024-09-13T02:52:32.691 INFO:tasks.workunit.client.0.smithi098.stdout:1/57: mknod d9/d13/c14 0 2024-09-13T02:52:32.693 INFO:tasks.workunit.client.1.smithi142.stdout:0/192: symlink d10/d15/d1a/d1e/d42/l4a 0 2024-09-13T02:52:32.695 INFO:tasks.workunit.client.1.smithi142.stdout:5/163: mknod d8/d24/c30 0 2024-09-13T02:52:32.697 INFO:tasks.workunit.client.1.smithi142.stdout:4/152: creat d0/d2b/d13/f2e x:0 0 0 2024-09-13T02:52:32.701 INFO:tasks.workunit.client.1.smithi142.stdout:4/153: write d0/df/f29 [881868,65126] 0 2024-09-13T02:52:32.701 INFO:tasks.workunit.client.1.smithi142.stdout:5/164: creat d8/d24/d26/f31 x:0 0 0 2024-09-13T02:52:32.702 INFO:tasks.workunit.client.1.smithi142.stdout:9/193: dwrite dd/f1f [0,4194304] 0 2024-09-13T02:52:32.703 INFO:tasks.workunit.client.1.smithi142.stdout:5/165: readlink d8/l18 0 2024-09-13T02:52:32.704 INFO:tasks.workunit.client.1.smithi142.stdout:6/183: dwrite d1/dd/d16/f13 [0,4194304] 0 2024-09-13T02:52:32.704 INFO:tasks.workunit.client.1.smithi142.stdout:1/213: dread d12/d13/f19 [0,4194304] 0 2024-09-13T02:52:32.707 INFO:tasks.workunit.client.1.smithi142.stdout:9/194: rmdir dd 39 2024-09-13T02:52:32.710 INFO:tasks.workunit.client.1.smithi142.stdout:1/214: rename f5 to d12/d13/d1d/f42 0 2024-09-13T02:52:32.710 INFO:tasks.workunit.client.1.smithi142.stdout:5/166: rename d8/d24 to d8/d24/d26/d2d/d32 22 2024-09-13T02:52:32.710 INFO:tasks.workunit.client.1.smithi142.stdout:1/215: stat c2 0 2024-09-13T02:52:32.711 INFO:tasks.workunit.client.1.smithi142.stdout:1/216: chown d12/d1b 3362950 1 2024-09-13T02:52:32.711 INFO:tasks.workunit.client.1.smithi142.stdout:7/152: sync 2024-09-13T02:52:32.713 INFO:tasks.workunit.client.1.smithi142.stdout:4/154: dread d0/d2b/d9/f22 [0,4194304] 0 2024-09-13T02:52:32.716 INFO:tasks.workunit.client.1.smithi142.stdout:7/153: mknod d10/d13/c2a 0 2024-09-13T02:52:32.720 INFO:tasks.workunit.client.1.smithi142.stdout:7/154: mkdir d10/d13/d1d/d2b 0 2024-09-13T02:52:32.720 INFO:tasks.workunit.client.1.smithi142.stdout:9/195: dwrite dd/f36 [0,4194304] 0 2024-09-13T02:52:32.729 INFO:tasks.workunit.client.0.smithi098.stdout:7/49: truncate f3 929206 0 2024-09-13T02:52:32.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:32 smithi098 ceph-mon[27886]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 1010 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 7.7 MiB/s wr, 280 op/s 2024-09-13T02:52:32.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:32 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:32.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:32 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:32.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:32 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:52:32.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:32 smithi098 ceph-mon[27886]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:52:32.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:32 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:32.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:32 smithi098 ceph-mon[27886]: Upgrade: Need to upgrade myself (mgr.smithi142.jutrvi) 2024-09-13T02:52:32.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:32 smithi098 ceph-mon[27886]: Upgrade: Need to upgrade myself (mgr.smithi142.jutrvi) 2024-09-13T02:52:32.735 INFO:tasks.workunit.client.0.smithi098.stdout:1/58: fsync f8 0 2024-09-13T02:52:32.735 INFO:tasks.workunit.client.0.smithi098.stdout:7/50: dwrite d6/f10 [0,4194304] 0 2024-09-13T02:52:32.740 INFO:tasks.workunit.client.0.smithi098.stdout:1/59: rename d9/cd to d9/d12/c15 0 2024-09-13T02:52:32.749 INFO:tasks.workunit.client.0.smithi098.stdout:7/51: fsync d6/f10 0 2024-09-13T02:52:32.749 INFO:tasks.workunit.client.0.smithi098.stdout:7/52: write d6/f10 [4096536,42929] 0 2024-09-13T02:52:32.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:32 smithi142 ceph-mon[33443]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 1010 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 7.7 MiB/s wr, 280 op/s 2024-09-13T02:52:32.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:32 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:32.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:32 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:32.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:32 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:52:32.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:32 smithi142 ceph-mon[33443]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:52:32.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:32 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:32.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:32 smithi142 ceph-mon[33443]: Upgrade: Need to upgrade myself (mgr.smithi142.jutrvi) 2024-09-13T02:52:32.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:32 smithi142 ceph-mon[33443]: Upgrade: Need to upgrade myself (mgr.smithi142.jutrvi) 2024-09-13T02:52:32.752 INFO:tasks.workunit.client.0.smithi098.stdout:7/53: creat d6/f13 x:0 0 0 2024-09-13T02:52:32.752 INFO:tasks.workunit.client.0.smithi098.stdout:7/54: fsync d6/fe 0 2024-09-13T02:52:32.753 INFO:tasks.workunit.client.0.smithi098.stdout:7/55: unlink d6/ld 0 2024-09-13T02:52:32.756 INFO:tasks.workunit.client.0.smithi098.stdout:7/56: dread f5 [0,4194304] 0 2024-09-13T02:52:32.757 INFO:tasks.workunit.client.0.smithi098.stdout:7/57: write f5 [3198577,110056] 0 2024-09-13T02:52:32.759 INFO:tasks.workunit.client.0.smithi098.stdout:7/58: mkdir d6/d14 0 2024-09-13T02:52:32.765 INFO:tasks.workunit.client.0.smithi098.stdout:7/59: truncate d6/f10 1153262 0 2024-09-13T02:52:32.770 INFO:tasks.workunit.client.0.smithi098.stdout:7/60: dwrite d6/ff [0,4194304] 0 2024-09-13T02:52:32.771 INFO:tasks.workunit.client.0.smithi098.stdout:7/61: readlink d6/l9 0 2024-09-13T02:52:32.775 INFO:tasks.workunit.client.0.smithi098.stdout:7/62: read d6/f10 [930173,7854] 0 2024-09-13T02:52:32.776 INFO:tasks.workunit.client.0.smithi098.stdout:7/63: write f3 [4228833,96666] 0 2024-09-13T02:52:32.778 INFO:tasks.workunit.client.0.smithi098.stdout:7/64: creat d6/f15 x:0 0 0 2024-09-13T02:52:32.780 INFO:tasks.workunit.client.0.smithi098.stdout:7/65: mknod d6/c16 0 2024-09-13T02:52:32.780 INFO:tasks.workunit.client.0.smithi098.stdout:7/66: chown c1 3069011 1 2024-09-13T02:52:32.782 INFO:tasks.workunit.client.0.smithi098.stdout:7/67: symlink d6/d14/l17 0 2024-09-13T02:52:32.785 INFO:tasks.workunit.client.1.smithi142.stdout:2/93: sync 2024-09-13T02:52:32.789 INFO:tasks.workunit.client.0.smithi098.stdout:7/68: dwrite d6/f15 [0,4194304] 0 2024-09-13T02:52:32.791 INFO:tasks.workunit.client.0.smithi098.stdout:7/69: symlink d6/l18 0 2024-09-13T02:52:32.791 INFO:tasks.workunit.client.1.smithi142.stdout:3/162: write d12/f19 [5180455,354] 0 2024-09-13T02:52:32.791 INFO:tasks.workunit.client.1.smithi142.stdout:9/196: chown l9 259744 1 2024-09-13T02:52:32.792 INFO:tasks.workunit.client.1.smithi142.stdout:4/155: getdents d0/d2b/d13 0 2024-09-13T02:52:32.793 INFO:tasks.workunit.client.1.smithi142.stdout:0/193: write d10/d23/f2a [338263,1866] 0 2024-09-13T02:52:32.793 INFO:tasks.workunit.client.0.smithi098.stdout:7/70: creat d6/f19 x:0 0 0 2024-09-13T02:52:32.794 INFO:tasks.workunit.client.1.smithi142.stdout:9/197: truncate dd/d17/f2b 1367609 0 2024-09-13T02:52:32.795 INFO:tasks.workunit.client.1.smithi142.stdout:7/155: creat d10/d13/d1d/f2c x:0 0 0 2024-09-13T02:52:32.796 INFO:tasks.workunit.client.0.smithi098.stdout:7/71: mknod d6/d14/c1a 0 2024-09-13T02:52:32.802 INFO:tasks.workunit.client.1.smithi142.stdout:9/198: mkdir dd/d47 0 2024-09-13T02:52:32.802 INFO:tasks.workunit.client.1.smithi142.stdout:1/217: dwrite d12/f22 [4194304,4194304] 0 2024-09-13T02:52:32.802 INFO:tasks.workunit.client.1.smithi142.stdout:0/194: mkdir d10/d15/d1a/d1e/d42/d4b 0 2024-09-13T02:52:32.803 INFO:tasks.workunit.client.1.smithi142.stdout:0/195: chown f9 10 1 2024-09-13T02:52:32.804 INFO:tasks.workunit.client.1.smithi142.stdout:2/94: link d1/de/d12/f1a d1/f1e 0 2024-09-13T02:52:32.804 INFO:tasks.workunit.client.1.smithi142.stdout:0/196: write d10/d23/f2a [420732,117513] 0 2024-09-13T02:52:32.806 INFO:tasks.workunit.client.0.smithi098.stdout:7/72: rmdir d6 39 2024-09-13T02:52:32.806 INFO:tasks.workunit.client.1.smithi142.stdout:7/156: creat d10/d13/d1d/f2d x:0 0 0 2024-09-13T02:52:32.812 INFO:tasks.workunit.client.1.smithi142.stdout:4/156: creat d0/d2b/d9/f2f x:0 0 0 2024-09-13T02:52:32.813 INFO:tasks.workunit.client.0.smithi098.stdout:7/73: dwrite f3 [0,4194304] 0 2024-09-13T02:52:32.816 INFO:tasks.workunit.client.1.smithi142.stdout:3/163: dwrite d12/d16/f24 [0,4194304] 0 2024-09-13T02:52:32.817 INFO:tasks.workunit.client.1.smithi142.stdout:0/197: dwrite d10/d23/f2f [0,4194304] 0 2024-09-13T02:52:32.817 INFO:tasks.workunit.client.1.smithi142.stdout:7/157: dread d10/d13/f1c [0,4194304] 0 2024-09-13T02:52:32.819 INFO:tasks.workunit.client.1.smithi142.stdout:7/158: write d10/d13/f20 [1691101,8222] 0 2024-09-13T02:52:32.819 INFO:tasks.workunit.client.1.smithi142.stdout:3/164: chown d12/l1e 468754 1 2024-09-13T02:52:32.819 INFO:tasks.workunit.client.1.smithi142.stdout:4/157: mkdir d0/d2b/d21/d30 0 2024-09-13T02:52:32.820 INFO:tasks.workunit.client.0.smithi098.stdout:7/74: mknod d6/c1b 0 2024-09-13T02:52:32.823 INFO:tasks.workunit.client.1.smithi142.stdout:2/95: rename d1/de/d12 to d1/de/d1f 0 2024-09-13T02:52:32.825 INFO:tasks.workunit.client.1.smithi142.stdout:1/218: creat d12/d1b/f43 x:0 0 0 2024-09-13T02:52:32.827 INFO:tasks.workunit.client.0.smithi098.stdout:7/75: unlink c4 0 2024-09-13T02:52:32.827 INFO:tasks.workunit.client.0.smithi098.stdout:7/76: chown d6 225529 1 2024-09-13T02:52:32.830 INFO:tasks.workunit.client.1.smithi142.stdout:0/198: unlink d10/d15/c16 0 2024-09-13T02:52:32.830 INFO:tasks.workunit.client.1.smithi142.stdout:0/199: chown d10/d15/d45 15062 1 2024-09-13T02:52:32.835 INFO:tasks.workunit.client.1.smithi142.stdout:4/158: rmdir d0/df 39 2024-09-13T02:52:32.840 INFO:tasks.workunit.client.1.smithi142.stdout:2/96: creat d1/de/f20 x:0 0 0 2024-09-13T02:52:32.843 INFO:tasks.workunit.client.1.smithi142.stdout:0/200: symlink d10/d15/d30/l4c 0 2024-09-13T02:52:32.843 INFO:tasks.workunit.client.1.smithi142.stdout:3/165: dread d12/d16/f17 [0,4194304] 0 2024-09-13T02:52:32.843 INFO:tasks.workunit.client.0.smithi098.stdout:7/77: getdents d6/d14 0 2024-09-13T02:52:32.845 INFO:tasks.workunit.client.1.smithi142.stdout:9/199: link dd/d17/d25/c30 dd/d17/d35/d41/c48 0 2024-09-13T02:52:32.845 INFO:tasks.workunit.client.1.smithi142.stdout:0/201: dread f9 [4194304,4194304] 0 2024-09-13T02:52:32.846 INFO:tasks.workunit.client.1.smithi142.stdout:4/159: write d0/d2b/d9/f20 [563168,21557] 0 2024-09-13T02:52:32.847 INFO:tasks.workunit.client.1.smithi142.stdout:4/160: chown d0/lc 106 1 2024-09-13T02:52:32.847 INFO:tasks.workunit.client.0.smithi098.stdout:7/78: dread d6/f15 [0,4194304] 0 2024-09-13T02:52:32.852 INFO:tasks.workunit.client.1.smithi142.stdout:0/202: dwrite d10/d15/d21/f3c [0,4194304] 0 2024-09-13T02:52:32.855 INFO:tasks.workunit.client.1.smithi142.stdout:2/97: dread f0 [0,4194304] 0 2024-09-13T02:52:32.871 INFO:tasks.workunit.client.1.smithi142.stdout:8/117: sync 2024-09-13T02:52:32.872 INFO:tasks.workunit.client.0.smithi098.stdout:7/79: mknod d6/c1c 0 2024-09-13T02:52:32.873 INFO:tasks.workunit.client.1.smithi142.stdout:7/159: mkdir d10/d13/d1d/d25/d2e 0 2024-09-13T02:52:32.873 INFO:tasks.workunit.client.1.smithi142.stdout:7/160: chown fc 0 1 2024-09-13T02:52:32.874 INFO:tasks.workunit.client.0.smithi098.stdout:7/80: creat d6/d14/f1d x:0 0 0 2024-09-13T02:52:32.925 INFO:tasks.workunit.client.1.smithi142.stdout:1/219: creat d12/d13/d20/d2c/f44 x:0 0 0 2024-09-13T02:52:32.927 INFO:tasks.workunit.client.0.smithi098.stdout:7/81: mkdir d6/d1e 0 2024-09-13T02:52:32.929 INFO:tasks.workunit.client.1.smithi142.stdout:9/200: mknod dd/d17/d25/c49 0 2024-09-13T02:52:32.931 INFO:tasks.workunit.client.0.smithi098.stdout:7/82: creat d6/d1e/f1f x:0 0 0 2024-09-13T02:52:32.934 INFO:tasks.workunit.client.1.smithi142.stdout:2/98: unlink d1/f4 0 2024-09-13T02:52:32.935 INFO:tasks.workunit.client.0.smithi098.stdout:7/83: mknod d6/d14/c20 0 2024-09-13T02:52:32.935 INFO:tasks.workunit.client.0.smithi098.stdout:7/84: stat d6/cb 0 2024-09-13T02:52:32.936 INFO:tasks.workunit.client.1.smithi142.stdout:8/118: mkdir d0/d6/d23 0 2024-09-13T02:52:32.937 INFO:tasks.workunit.client.1.smithi142.stdout:8/119: write d0/d1/d8/df/f1e [4152687,5331] 0 2024-09-13T02:52:32.938 INFO:tasks.workunit.client.1.smithi142.stdout:8/120: dread - d0/d6/dc/f18 zero size 2024-09-13T02:52:32.939 INFO:tasks.workunit.client.1.smithi142.stdout:8/121: chown d0/d1/d8/df/l15 0 1 2024-09-13T02:52:32.939 INFO:tasks.workunit.client.0.smithi098.stdout:7/85: dread f3 [0,4194304] 0 2024-09-13T02:52:32.940 INFO:tasks.workunit.client.1.smithi142.stdout:8/122: write d0/fb [3317246,104678] 0 2024-09-13T02:52:32.940 INFO:tasks.workunit.client.0.smithi098.stdout:7/86: readlink d6/d14/l17 0 2024-09-13T02:52:32.941 INFO:tasks.workunit.client.0.smithi098.stdout:7/87: chown d6/d14/f1d 165417915 1 2024-09-13T02:52:32.941 INFO:tasks.workunit.client.1.smithi142.stdout:7/161: rename l5 to d10/d13/d1d/d2b/l2f 0 2024-09-13T02:52:32.941 INFO:tasks.workunit.client.0.smithi098.stdout:7/88: fsync d6/f11 0 2024-09-13T02:52:32.942 INFO:tasks.workunit.client.0.smithi098.stdout:7/89: dread - d6/d1e/f1f zero size 2024-09-13T02:52:32.943 INFO:tasks.workunit.client.1.smithi142.stdout:6/184: sync 2024-09-13T02:52:32.946 INFO:tasks.workunit.client.0.smithi098.stdout:7/90: symlink d6/d1e/l21 0 2024-09-13T02:52:32.947 INFO:tasks.workunit.client.1.smithi142.stdout:4/161: mkdir d0/d2b/d2d/d31 0 2024-09-13T02:52:32.947 INFO:tasks.workunit.client.1.smithi142.stdout:8/123: dwrite d0/d1/f3 [0,4194304] 0 2024-09-13T02:52:32.949 INFO:tasks.workunit.client.0.smithi098.stdout:7/91: creat d6/d14/f22 x:0 0 0 2024-09-13T02:52:32.952 INFO:tasks.workunit.client.0.smithi098.stdout:7/92: chown d6/d14 1 1 2024-09-13T02:52:32.952 INFO:tasks.workunit.client.1.smithi142.stdout:0/203: symlink d10/d15/d45/l4d 0 2024-09-13T02:52:32.952 INFO:tasks.workunit.client.1.smithi142.stdout:7/162: dwrite d10/d13/d1d/f2d [0,4194304] 0 2024-09-13T02:52:32.955 INFO:tasks.workunit.client.1.smithi142.stdout:9/201: write dd/f1c [391737,23732] 0 2024-09-13T02:52:32.956 INFO:tasks.workunit.client.0.smithi098.stdout:7/93: creat d6/d1e/f23 x:0 0 0 2024-09-13T02:52:32.956 INFO:tasks.workunit.client.1.smithi142.stdout:9/202: write dd/d17/d25/f38 [646959,28108] 0 2024-09-13T02:52:32.956 INFO:tasks.workunit.client.0.smithi098.stdout:7/94: dread - d6/d1e/f1f zero size 2024-09-13T02:52:32.961 INFO:tasks.workunit.client.1.smithi142.stdout:1/220: mkdir d12/d13/d45 0 2024-09-13T02:52:32.963 INFO:tasks.workunit.client.0.smithi098.stdout:7/95: mkdir d6/d24 0 2024-09-13T02:52:32.964 INFO:tasks.workunit.client.0.smithi098.stdout:7/96: write d6/d14/f1d [781029,56775] 0 2024-09-13T02:52:32.969 INFO:tasks.workunit.client.1.smithi142.stdout:1/221: dwrite d12/d13/d20/f38 [0,4194304] 0 2024-09-13T02:52:32.969 INFO:tasks.workunit.client.1.smithi142.stdout:6/185: dread d1/dd/d16/f2c [0,4194304] 0 2024-09-13T02:52:32.969 INFO:tasks.workunit.client.1.smithi142.stdout:0/204: unlink d10/d15/d1a/d28/d35/f40 0 2024-09-13T02:52:32.970 INFO:tasks.workunit.client.1.smithi142.stdout:1/222: write f1 [8079886,31669] 0 2024-09-13T02:52:32.974 INFO:tasks.workunit.client.0.smithi098.stdout:7/97: truncate d6/fe 1071673 0 2024-09-13T02:52:32.975 INFO:tasks.workunit.client.1.smithi142.stdout:2/99: symlink d1/de/d1f/l21 0 2024-09-13T02:52:32.977 INFO:tasks.workunit.client.1.smithi142.stdout:5/167: sync 2024-09-13T02:52:32.978 INFO:tasks.workunit.client.1.smithi142.stdout:3/166: sync 2024-09-13T02:52:32.980 INFO:tasks.workunit.client.0.smithi098.stdout:7/98: mknod d6/d24/c25 0 2024-09-13T02:52:32.981 INFO:tasks.workunit.client.0.smithi098.stdout:7/99: chown d6/l9 213326702 1 2024-09-13T02:52:32.981 INFO:tasks.workunit.client.1.smithi142.stdout:4/162: mkdir d0/d2b/d2d/d31/d32 0 2024-09-13T02:52:32.981 INFO:tasks.workunit.client.1.smithi142.stdout:5/168: dread d8/f1c [0,4194304] 0 2024-09-13T02:52:32.983 INFO:tasks.workunit.client.1.smithi142.stdout:8/124: rename d0/d1/d8/df/f1e to d0/d6/f24 0 2024-09-13T02:52:32.984 INFO:tasks.workunit.client.0.smithi098.stdout:7/100: fdatasync d6/f15 0 2024-09-13T02:52:32.986 INFO:tasks.workunit.client.1.smithi142.stdout:8/125: dread d0/d1/d8/f12 [0,4194304] 0 2024-09-13T02:52:32.988 INFO:tasks.workunit.client.0.smithi098.stdout:7/101: creat d6/d24/f26 x:0 0 0 2024-09-13T02:52:32.989 INFO:tasks.workunit.client.1.smithi142.stdout:0/205: symlink d10/d15/d1a/d1e/l4e 0 2024-09-13T02:52:32.992 INFO:tasks.workunit.client.1.smithi142.stdout:9/203: creat dd/d17/d44/f4a x:0 0 0 2024-09-13T02:52:32.993 INFO:tasks.workunit.client.0.smithi098.stdout:7/102: rename d6/fe to d6/d14/f27 0 2024-09-13T02:52:32.994 INFO:tasks.workunit.client.1.smithi142.stdout:2/100: stat d1 0 2024-09-13T02:52:32.995 INFO:tasks.workunit.client.1.smithi142.stdout:4/163: symlink d0/d2b/d13/l33 0 2024-09-13T02:52:32.995 INFO:tasks.workunit.client.1.smithi142.stdout:5/169: mknod d8/c33 0 2024-09-13T02:52:32.996 INFO:tasks.workunit.client.1.smithi142.stdout:1/223: dwrite d12/d13/f19 [0,4194304] 0 2024-09-13T02:52:32.996 INFO:tasks.workunit.client.1.smithi142.stdout:8/126: symlink d0/d6/l25 0 2024-09-13T02:52:32.997 INFO:tasks.workunit.client.1.smithi142.stdout:0/206: rename d10/d23/f2a to d10/d23/f4f 0 2024-09-13T02:52:32.997 INFO:tasks.workunit.client.1.smithi142.stdout:7/163: link d10/c11 d10/d13/d21/c30 0 2024-09-13T02:52:33.000 INFO:tasks.workunit.client.1.smithi142.stdout:7/164: read f8 [2333665,82792] 0 2024-09-13T02:52:33.002 INFO:tasks.workunit.client.1.smithi142.stdout:6/186: creat d1/f41 x:0 0 0 2024-09-13T02:52:33.005 INFO:tasks.workunit.client.0.smithi098.stdout:7/103: truncate d6/d14/f27 402160 0 2024-09-13T02:52:33.006 INFO:tasks.workunit.client.1.smithi142.stdout:8/127: truncate d0/d1/fa 1248800 0 2024-09-13T02:52:33.008 INFO:tasks.workunit.client.0.smithi098.stdout:7/104: creat d6/d24/f28 x:0 0 0 2024-09-13T02:52:33.008 INFO:tasks.workunit.client.1.smithi142.stdout:6/187: dwrite d1/dd/d18/d32/f3b [0,4194304] 0 2024-09-13T02:52:33.009 INFO:tasks.workunit.client.1.smithi142.stdout:9/204: mknod dd/d17/d35/d41/c4b 0 2024-09-13T02:52:33.011 INFO:tasks.workunit.client.1.smithi142.stdout:2/101: creat d1/de/f22 x:0 0 0 2024-09-13T02:52:33.013 INFO:tasks.workunit.client.1.smithi142.stdout:4/164: mknod d0/c34 0 2024-09-13T02:52:33.013 INFO:tasks.workunit.client.1.smithi142.stdout:4/165: readlink d0/lb 0 2024-09-13T02:52:33.019 INFO:tasks.workunit.client.1.smithi142.stdout:7/165: mkdir d10/d31 0 2024-09-13T02:52:33.021 INFO:tasks.workunit.client.1.smithi142.stdout:2/102: creat d1/de/f23 x:0 0 0 2024-09-13T02:52:33.022 INFO:tasks.workunit.client.1.smithi142.stdout:1/224: creat d12/d1b/f46 x:0 0 0 2024-09-13T02:52:33.023 INFO:tasks.workunit.client.1.smithi142.stdout:4/166: fsync d0/d2b/d9/f22 0 2024-09-13T02:52:33.025 INFO:tasks.workunit.client.1.smithi142.stdout:6/188: mkdir d1/d7/d42 0 2024-09-13T02:52:33.027 INFO:tasks.workunit.client.1.smithi142.stdout:0/207: link d10/c49 d10/d15/d1a/d28/c50 0 2024-09-13T02:52:33.027 INFO:tasks.workunit.client.1.smithi142.stdout:5/170: write d8/f1c [4105124,76740] 0 2024-09-13T02:52:33.027 INFO:tasks.workunit.client.1.smithi142.stdout:7/166: dwrite d10/d13/f20 [0,4194304] 0 2024-09-13T02:52:33.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/225: unlink d12/d13/d20/d2c/c33 0 2024-09-13T02:52:33.033 INFO:tasks.workunit.client.1.smithi142.stdout:4/167: chown d0/d2b/d13/c26 217 1 2024-09-13T02:52:33.034 INFO:tasks.workunit.client.1.smithi142.stdout:6/189: mknod d1/dd/d16/c43 0 2024-09-13T02:52:33.034 INFO:tasks.workunit.client.1.smithi142.stdout:1/226: chown d12/d13/d1d/f25 8 1 2024-09-13T02:52:33.035 INFO:tasks.workunit.client.1.smithi142.stdout:3/167: dwrite d12/d16/f21 [0,4194304] 0 2024-09-13T02:52:33.037 INFO:tasks.workunit.client.1.smithi142.stdout:4/168: write d0/d2b/d9/f2f [884746,83651] 0 2024-09-13T02:52:33.037 INFO:tasks.workunit.client.0.smithi098.stdout:7/105: dwrite d6/f15 [0,4194304] 0 2024-09-13T02:52:33.038 INFO:tasks.workunit.client.1.smithi142.stdout:8/128: write d0/d6/f24 [2551744,15002] 0 2024-09-13T02:52:33.039 INFO:tasks.workunit.client.1.smithi142.stdout:1/227: write d12/d13/f16 [2727816,29996] 0 2024-09-13T02:52:33.040 INFO:tasks.workunit.client.1.smithi142.stdout:9/205: getdents dd/d17/d44 0 2024-09-13T02:52:33.042 INFO:tasks.workunit.client.0.smithi098.stdout:7/106: creat d6/f29 x:0 0 0 2024-09-13T02:52:33.043 INFO:tasks.workunit.client.0.smithi098.stdout:7/107: read - d6/d14/f22 zero size 2024-09-13T02:52:33.044 INFO:tasks.workunit.client.1.smithi142.stdout:8/129: write d0/fb [1415480,64596] 0 2024-09-13T02:52:33.046 INFO:tasks.workunit.client.1.smithi142.stdout:7/167: mkdir d10/d13/d1d/d25/d2e/d32 0 2024-09-13T02:52:33.046 INFO:tasks.workunit.client.1.smithi142.stdout:0/208: dread d10/d15/d21/f3c [0,4194304] 0 2024-09-13T02:52:33.047 INFO:tasks.workunit.client.0.smithi098.stdout:7/108: mkdir d6/d24/d2a 0 2024-09-13T02:52:33.048 INFO:tasks.workunit.client.0.smithi098.stdout:7/109: write d6/d24/f28 [581348,60078] 0 2024-09-13T02:52:33.049 INFO:tasks.workunit.client.0.smithi098.stdout:7/110: dread - d6/d14/f22 zero size 2024-09-13T02:52:33.050 INFO:tasks.workunit.client.1.smithi142.stdout:5/171: dwrite d8/f1b [0,4194304] 0 2024-09-13T02:52:33.050 INFO:tasks.workunit.client.0.smithi098.stdout:7/111: write d6/f29 [500162,116324] 0 2024-09-13T02:52:33.050 INFO:tasks.workunit.client.1.smithi142.stdout:9/206: truncate dd/d17/d25/f33 57097 0 2024-09-13T02:52:33.052 INFO:tasks.workunit.client.1.smithi142.stdout:0/209: write d10/d15/d1a/f22 [2090630,9645] 0 2024-09-13T02:52:33.053 INFO:tasks.workunit.client.1.smithi142.stdout:4/169: write d0/df/f23 [1441362,23525] 0 2024-09-13T02:52:33.053 INFO:tasks.workunit.client.0.smithi098.stdout:7/112: creat d6/d14/f2b x:0 0 0 2024-09-13T02:52:33.053 INFO:tasks.workunit.client.1.smithi142.stdout:3/168: dread d12/d16/f24 [0,4194304] 0 2024-09-13T02:52:33.054 INFO:tasks.workunit.client.0.smithi098.stdout:7/113: write d6/d14/f1d [1130265,74965] 0 2024-09-13T02:52:33.058 INFO:tasks.workunit.client.1.smithi142.stdout:6/190: unlink d1/d7/c34 0 2024-09-13T02:52:33.058 INFO:tasks.workunit.client.1.smithi142.stdout:1/228: creat d12/d13/d20/d2c/f47 x:0 0 0 2024-09-13T02:52:33.062 INFO:tasks.workunit.client.1.smithi142.stdout:7/168: unlink fc 0 2024-09-13T02:52:33.064 INFO:tasks.workunit.client.1.smithi142.stdout:7/169: stat d10 0 2024-09-13T02:52:33.065 INFO:tasks.workunit.client.1.smithi142.stdout:7/170: readlink d10/l12 0 2024-09-13T02:52:33.065 INFO:tasks.workunit.client.1.smithi142.stdout:1/229: read d12/d1b/f2f [2684631,52628] 0 2024-09-13T02:52:33.065 INFO:tasks.workunit.client.1.smithi142.stdout:8/130: dwrite d0/d1/f1b [0,4194304] 0 2024-09-13T02:52:33.066 INFO:tasks.workunit.client.0.smithi098.stdout:7/114: getdents d6 0 2024-09-13T02:52:33.067 INFO:tasks.workunit.client.1.smithi142.stdout:7/171: readlink d10/d13/d21/l24 0 2024-09-13T02:52:33.068 INFO:tasks.workunit.client.1.smithi142.stdout:2/103: dwrite d1/de/f17 [4194304,4194304] 0 2024-09-13T02:52:33.069 INFO:tasks.workunit.client.0.smithi098.stdout:7/115: creat d6/d24/f2c x:0 0 0 2024-09-13T02:52:33.069 INFO:tasks.workunit.client.1.smithi142.stdout:4/170: unlink d0/df/c25 0 2024-09-13T02:52:33.070 INFO:tasks.workunit.client.0.smithi098.stdout:7/116: write f5 [7644673,77309] 0 2024-09-13T02:52:33.070 INFO:tasks.workunit.client.1.smithi142.stdout:3/169: mkdir d12/d16/d25/d2e 0 2024-09-13T02:52:33.070 INFO:tasks.workunit.client.1.smithi142.stdout:5/172: mknod d8/c34 0 2024-09-13T02:52:33.070 INFO:tasks.workunit.client.1.smithi142.stdout:1/230: write d12/d13/d1d/d26/f2b [1020526,24274] 0 2024-09-13T02:52:33.072 INFO:tasks.workunit.client.1.smithi142.stdout:3/170: dread - d12/f2b zero size 2024-09-13T02:52:33.073 INFO:tasks.workunit.client.1.smithi142.stdout:1/231: stat d12/d13/f16 0 2024-09-13T02:52:33.074 INFO:tasks.workunit.client.0.smithi098.stdout:7/117: creat d6/d24/d2a/f2d x:0 0 0 2024-09-13T02:52:33.074 INFO:tasks.workunit.client.1.smithi142.stdout:6/191: dread d1/dd/d16/f2c [0,4194304] 0 2024-09-13T02:52:33.075 INFO:tasks.workunit.client.0.smithi098.stdout:7/118: chown d6/l18 1785252 1 2024-09-13T02:52:33.075 INFO:tasks.workunit.client.1.smithi142.stdout:4/171: chown d0/d2b/d9/f20 2 1 2024-09-13T02:52:33.075 INFO:tasks.workunit.client.1.smithi142.stdout:0/210: chown d10/d15/d30/c31 32061 1 2024-09-13T02:52:33.076 INFO:tasks.workunit.client.1.smithi142.stdout:9/207: link dd/f36 dd/f4c 0 2024-09-13T02:52:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:5/173: dread d8/f1b [0,4194304] 0 2024-09-13T02:52:33.079 INFO:tasks.workunit.client.1.smithi142.stdout:7/172: rename d10/d13/d1d/l26 to d10/d13/d1d/d25/d2e/l33 0 2024-09-13T02:52:33.081 INFO:tasks.workunit.client.1.smithi142.stdout:7/173: write d10/d13/f1e [3865739,17547] 0 2024-09-13T02:52:33.081 INFO:tasks.workunit.client.1.smithi142.stdout:6/192: unlink d1/l1a 0 2024-09-13T02:52:33.081 INFO:tasks.workunit.client.1.smithi142.stdout:3/171: fsync d12/d16/f24 0 2024-09-13T02:52:33.083 INFO:tasks.workunit.client.1.smithi142.stdout:4/172: mkdir d0/d2b/d21/d35 0 2024-09-13T02:52:33.088 INFO:tasks.workunit.client.1.smithi142.stdout:0/211: rename d10/d15/d1a/d28 to d10/d15/d21/d51 0 2024-09-13T02:52:33.089 INFO:tasks.workunit.client.1.smithi142.stdout:3/172: dwrite d12/f22 [0,4194304] 0 2024-09-13T02:52:33.090 INFO:tasks.workunit.client.1.smithi142.stdout:9/208: getdents dd/d47 0 2024-09-13T02:52:33.091 INFO:tasks.workunit.client.0.smithi098.stdout:7/119: fsync d6/d14/f2b 0 2024-09-13T02:52:33.093 INFO:tasks.workunit.client.1.smithi142.stdout:7/174: mkdir d10/d34 0 2024-09-13T02:52:33.094 INFO:tasks.workunit.client.1.smithi142.stdout:1/232: creat d12/d13/d20/f48 x:0 0 0 2024-09-13T02:52:33.094 INFO:tasks.workunit.client.1.smithi142.stdout:4/173: dwrite d0/d2b/d9/f20 [0,4194304] 0 2024-09-13T02:52:33.095 INFO:tasks.workunit.client.0.smithi098.stdout:7/120: creat d6/d14/f2e x:0 0 0 2024-09-13T02:52:33.096 INFO:tasks.workunit.client.0.smithi098.stdout:7/121: write f5 [4954609,81567] 0 2024-09-13T02:52:33.098 INFO:tasks.workunit.client.1.smithi142.stdout:6/193: rename d1/dd/d16/f13 to d1/d7/d42/f44 0 2024-09-13T02:52:33.099 INFO:tasks.workunit.client.1.smithi142.stdout:0/212: creat d10/d15/d1a/d1e/d42/f52 x:0 0 0 2024-09-13T02:52:33.102 INFO:tasks.workunit.client.0.smithi098.stdout:7/122: creat d6/d24/d2a/f2f x:0 0 0 2024-09-13T02:52:33.103 INFO:tasks.workunit.client.0.smithi098.stdout:7/123: rename d6/d24/d2a to d6/d24/d2a/d30 22 2024-09-13T02:52:33.104 INFO:tasks.workunit.client.0.smithi098.stdout:7/124: chown d6/d14/c1a 280116 1 2024-09-13T02:52:33.108 INFO:tasks.workunit.client.0.smithi098.stdout:7/125: creat d6/d24/d2a/f31 x:0 0 0 2024-09-13T02:52:33.111 INFO:tasks.workunit.client.1.smithi142.stdout:7/175: rename fa to d10/d13/d22/f35 0 2024-09-13T02:52:33.113 INFO:tasks.workunit.client.1.smithi142.stdout:6/194: creat d1/d7/d19/f45 x:0 0 0 2024-09-13T02:52:33.117 INFO:tasks.workunit.client.1.smithi142.stdout:3/173: creat d12/d16/d25/d2e/f2f x:0 0 0 2024-09-13T02:52:33.120 INFO:tasks.workunit.client.1.smithi142.stdout:4/174: write d0/d2b/d13/f16 [3330899,24207] 0 2024-09-13T02:52:33.121 INFO:tasks.workunit.client.0.smithi098.stdout:7/126: dwrite d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:33.122 INFO:tasks.workunit.client.1.smithi142.stdout:3/174: dwrite fe [0,4194304] 0 2024-09-13T02:52:33.122 INFO:tasks.workunit.client.1.smithi142.stdout:1/233: creat d12/d13/d20/d27/d3c/f49 x:0 0 0 2024-09-13T02:52:33.123 INFO:tasks.workunit.client.0.smithi098.stdout:7/127: write d6/d24/d2a/f31 [973921,45576] 0 2024-09-13T02:52:33.123 INFO:tasks.workunit.client.1.smithi142.stdout:3/175: write fe [1315310,100457] 0 2024-09-13T02:52:33.124 INFO:tasks.workunit.client.0.smithi098.stdout:7/128: dread - d6/fc zero size 2024-09-13T02:52:33.128 INFO:tasks.workunit.client.1.smithi142.stdout:6/195: unlink d1/l20 0 2024-09-13T02:52:33.133 INFO:tasks.workunit.client.1.smithi142.stdout:5/174: dwrite d8/f15 [0,4194304] 0 2024-09-13T02:52:33.137 INFO:tasks.workunit.client.1.smithi142.stdout:3/176: chown d12/d16/c1a 21549121 1 2024-09-13T02:52:33.145 INFO:tasks.workunit.client.1.smithi142.stdout:6/196: mknod d1/d7/d42/c46 0 2024-09-13T02:52:33.147 INFO:tasks.workunit.client.1.smithi142.stdout:0/213: link f9 d10/d15/d21/d51/d35/f53 0 2024-09-13T02:52:33.148 INFO:tasks.workunit.client.1.smithi142.stdout:0/214: dread - d10/d15/f46 zero size 2024-09-13T02:52:33.151 INFO:tasks.workunit.client.1.smithi142.stdout:5/175: symlink d8/d24/d26/d2d/l35 0 2024-09-13T02:52:33.156 INFO:tasks.workunit.client.1.smithi142.stdout:7/176: truncate d10/d13/f1c 1298460 0 2024-09-13T02:52:33.161 INFO:tasks.workunit.client.1.smithi142.stdout:6/197: mkdir d1/dd/d16/d47 0 2024-09-13T02:52:33.161 INFO:tasks.workunit.client.1.smithi142.stdout:6/198: read - d1/dd/f29 zero size 2024-09-13T02:52:33.161 INFO:tasks.workunit.client.1.smithi142.stdout:0/215: creat d10/d15/d21/d51/f54 x:0 0 0 2024-09-13T02:52:33.161 INFO:tasks.workunit.client.1.smithi142.stdout:0/216: truncate d10/d15/d1a/d1e/d42/f48 1118549 0 2024-09-13T02:52:33.161 INFO:tasks.workunit.client.1.smithi142.stdout:1/234: link d12/l24 d12/d13/d1d/l4a 0 2024-09-13T02:52:33.164 INFO:tasks.workunit.client.1.smithi142.stdout:4/175: truncate d0/d2b/f7 881699 0 2024-09-13T02:52:33.165 INFO:tasks.workunit.client.1.smithi142.stdout:7/177: unlink fe 0 2024-09-13T02:52:33.166 INFO:tasks.workunit.client.1.smithi142.stdout:7/178: chown d10/d13/d1d/d25 0 1 2024-09-13T02:52:33.166 INFO:tasks.workunit.client.1.smithi142.stdout:0/217: dwrite fd [0,4194304] 0 2024-09-13T02:52:33.166 INFO:tasks.workunit.client.1.smithi142.stdout:6/199: mkdir d1/d7/d19/d48 0 2024-09-13T02:52:33.167 INFO:tasks.workunit.client.1.smithi142.stdout:5/176: symlink d8/d24/l36 0 2024-09-13T02:52:33.173 INFO:tasks.workunit.client.1.smithi142.stdout:4/176: symlink d0/d2b/d21/l36 0 2024-09-13T02:52:33.174 INFO:tasks.workunit.client.1.smithi142.stdout:7/179: creat d10/d13/d1d/f36 x:0 0 0 2024-09-13T02:52:33.176 INFO:tasks.workunit.client.1.smithi142.stdout:0/218: unlink d10/d15/d1a/c1d 0 2024-09-13T02:52:33.180 INFO:tasks.workunit.client.1.smithi142.stdout:3/177: link d12/d16/l23 d12/d16/d25/l30 0 2024-09-13T02:52:33.181 INFO:tasks.workunit.client.1.smithi142.stdout:1/235: link d12/d13/d20/d27/f37 d12/d13/d20/d27/f4b 0 2024-09-13T02:52:33.183 INFO:tasks.workunit.client.1.smithi142.stdout:0/219: creat d10/d15/d21/d51/d35/f55 x:0 0 0 2024-09-13T02:52:33.184 INFO:tasks.workunit.client.1.smithi142.stdout:6/200: creat d1/dd/f49 x:0 0 0 2024-09-13T02:52:33.186 INFO:tasks.workunit.client.1.smithi142.stdout:7/180: mkdir d10/d37 0 2024-09-13T02:52:33.187 INFO:tasks.workunit.client.1.smithi142.stdout:8/131: sync 2024-09-13T02:52:33.187 INFO:tasks.workunit.client.1.smithi142.stdout:2/104: sync 2024-09-13T02:52:33.187 INFO:tasks.workunit.client.1.smithi142.stdout:9/209: sync 2024-09-13T02:52:33.191 INFO:tasks.workunit.client.1.smithi142.stdout:1/236: mknod d12/d13/d20/c4c 0 2024-09-13T02:52:33.191 INFO:tasks.workunit.client.1.smithi142.stdout:9/210: dread dd/f1c [0,4194304] 0 2024-09-13T02:52:33.192 INFO:tasks.workunit.client.1.smithi142.stdout:1/237: write f1 [4853061,21532] 0 2024-09-13T02:52:33.193 INFO:tasks.workunit.client.1.smithi142.stdout:2/105: write d1/f9 [5848143,85912] 0 2024-09-13T02:52:33.193 INFO:tasks.workunit.client.1.smithi142.stdout:9/211: dread dd/f1c [0,4194304] 0 2024-09-13T02:52:33.196 INFO:tasks.workunit.client.1.smithi142.stdout:8/132: creat d0/d1/d8/f26 x:0 0 0 2024-09-13T02:52:33.199 INFO:tasks.workunit.client.1.smithi142.stdout:9/212: dwrite dd/f1f [0,4194304] 0 2024-09-13T02:52:33.199 INFO:tasks.workunit.client.1.smithi142.stdout:6/201: mkdir d1/d4a 0 2024-09-13T02:52:33.200 INFO:tasks.workunit.client.1.smithi142.stdout:6/202: fdatasync d1/d7/f2a 0 2024-09-13T02:52:33.201 INFO:tasks.workunit.client.1.smithi142.stdout:7/181: creat d10/d34/f38 x:0 0 0 2024-09-13T02:52:33.202 INFO:tasks.workunit.client.1.smithi142.stdout:7/182: fsync d10/d13/f1e 0 2024-09-13T02:52:33.205 INFO:tasks.workunit.client.1.smithi142.stdout:4/177: write d0/d2b/f7 [456952,47204] 0 2024-09-13T02:52:33.212 INFO:tasks.workunit.client.1.smithi142.stdout:2/106: fdatasync d1/de/d1f/f1a 0 2024-09-13T02:52:33.215 INFO:tasks.workunit.client.1.smithi142.stdout:8/133: creat d0/d1/f27 x:0 0 0 2024-09-13T02:52:33.217 INFO:tasks.workunit.client.1.smithi142.stdout:9/213: mkdir dd/d17/d35/d4d 0 2024-09-13T02:52:33.219 INFO:tasks.workunit.client.1.smithi142.stdout:6/203: creat d1/d7/d19/f4b x:0 0 0 2024-09-13T02:52:33.220 INFO:tasks.workunit.client.1.smithi142.stdout:8/134: dwrite d0/d1/d8/f1d [0,4194304] 0 2024-09-13T02:52:33.225 INFO:tasks.workunit.client.1.smithi142.stdout:4/178: read d0/f14 [2863485,87162] 0 2024-09-13T02:52:33.227 INFO:tasks.workunit.client.1.smithi142.stdout:8/135: dwrite d0/d1/d8/f26 [0,4194304] 0 2024-09-13T02:52:33.228 INFO:tasks.workunit.client.1.smithi142.stdout:8/136: read - d0/d1/f17 zero size 2024-09-13T02:52:33.231 INFO:tasks.workunit.client.1.smithi142.stdout:5/177: truncate f5 3961438 0 2024-09-13T02:52:33.233 INFO:tasks.workunit.client.1.smithi142.stdout:3/178: rename d12/d16/d25/l30 to d12/d16/l31 0 2024-09-13T02:52:33.239 INFO:tasks.workunit.client.1.smithi142.stdout:6/204: rmdir d1/d7/d42 39 2024-09-13T02:52:33.240 INFO:tasks.workunit.client.1.smithi142.stdout:6/205: write d1/d7/f2a [3566349,30656] 0 2024-09-13T02:52:33.241 INFO:tasks.workunit.client.1.smithi142.stdout:7/183: mkdir d10/d37/d39 0 2024-09-13T02:52:33.242 INFO:tasks.workunit.client.1.smithi142.stdout:6/206: write d1/d7/d19/f2f [4916812,124648] 0 2024-09-13T02:52:33.245 INFO:tasks.workunit.client.1.smithi142.stdout:4/179: mknod d0/d2b/d2d/d31/c37 0 2024-09-13T02:52:33.247 INFO:tasks.workunit.client.1.smithi142.stdout:8/137: mkdir d0/d1/d8/df/d28 0 2024-09-13T02:52:33.252 INFO:tasks.workunit.client.1.smithi142.stdout:3/179: unlink d12/d16/l2a 0 2024-09-13T02:52:33.253 INFO:tasks.workunit.client.1.smithi142.stdout:9/214: symlink dd/d47/l4e 0 2024-09-13T02:52:33.256 INFO:tasks.workunit.client.1.smithi142.stdout:7/184: rmdir d10/d13/d1d/d2b 39 2024-09-13T02:52:33.257 INFO:tasks.workunit.client.1.smithi142.stdout:7/185: chown d10/d13/l19 102 1 2024-09-13T02:52:33.271 INFO:tasks.workunit.client.1.smithi142.stdout:9/215: dwrite dd/f1a [0,4194304] 0 2024-09-13T02:52:33.272 INFO:tasks.workunit.client.1.smithi142.stdout:9/216: readlink dd/l15 0 2024-09-13T02:52:33.273 INFO:tasks.workunit.client.1.smithi142.stdout:8/138: creat d0/d1/d8/f29 x:0 0 0 2024-09-13T02:52:33.273 INFO:tasks.workunit.client.1.smithi142.stdout:2/107: creat d1/de/d1f/f24 x:0 0 0 2024-09-13T02:52:33.273 INFO:tasks.workunit.client.1.smithi142.stdout:5/178: mknod d8/d24/c37 0 2024-09-13T02:52:33.274 INFO:tasks.workunit.client.1.smithi142.stdout:8/139: readlink d0/d1/d8/df/l15 0 2024-09-13T02:52:33.274 INFO:tasks.workunit.client.1.smithi142.stdout:3/180: symlink d12/d16/d25/l32 0 2024-09-13T02:52:33.275 INFO:tasks.workunit.client.1.smithi142.stdout:7/186: symlink d10/d13/d21/l3a 0 2024-09-13T02:52:33.278 INFO:tasks.workunit.client.1.smithi142.stdout:9/217: mkdir dd/d17/d4f 0 2024-09-13T02:52:33.280 INFO:tasks.workunit.client.1.smithi142.stdout:1/238: rename d12/d13/d20/f3e to d12/f4d 0 2024-09-13T02:52:33.282 INFO:tasks.workunit.client.1.smithi142.stdout:5/179: fsync d8/f10 0 2024-09-13T02:52:33.287 INFO:tasks.workunit.client.1.smithi142.stdout:4/180: creat d0/d2b/f38 x:0 0 0 2024-09-13T02:52:33.287 INFO:tasks.workunit.client.1.smithi142.stdout:4/181: chown d0/df/f1f 33805157 1 2024-09-13T02:52:33.288 INFO:tasks.workunit.client.1.smithi142.stdout:9/218: symlink dd/d17/d44/l50 0 2024-09-13T02:52:33.290 INFO:tasks.workunit.client.1.smithi142.stdout:9/219: dread dd/d17/d25/f33 [0,4194304] 0 2024-09-13T02:52:33.293 INFO:tasks.workunit.client.1.smithi142.stdout:9/220: dread dd/d17/d25/f38 [0,4194304] 0 2024-09-13T02:52:33.293 INFO:tasks.workunit.client.1.smithi142.stdout:9/221: chown dd/d17/l46 0 1 2024-09-13T02:52:33.294 INFO:tasks.workunit.client.1.smithi142.stdout:5/180: creat d8/d24/d26/d2d/f38 x:0 0 0 2024-09-13T02:52:33.295 INFO:tasks.workunit.client.0.smithi098.stdout:7/129: rename d6/c1c to d6/c32 0 2024-09-13T02:52:33.296 INFO:tasks.workunit.client.1.smithi142.stdout:3/181: mknod d12/d16/c33 0 2024-09-13T02:52:33.297 INFO:tasks.workunit.client.1.smithi142.stdout:8/140: link d0/d6/f24 d0/d6/f2a 0 2024-09-13T02:52:33.301 INFO:tasks.workunit.client.1.smithi142.stdout:8/141: dread d0/d1/f1b [0,4194304] 0 2024-09-13T02:52:33.304 INFO:tasks.workunit.client.1.smithi142.stdout:9/222: mknod dd/d17/d35/c51 0 2024-09-13T02:52:33.304 INFO:tasks.workunit.client.1.smithi142.stdout:9/223: fdatasync dd/d17/d35/f3d 0 2024-09-13T02:52:33.307 INFO:tasks.workunit.client.1.smithi142.stdout:4/182: mknod d0/d2b/d9/c39 0 2024-09-13T02:52:33.312 INFO:tasks.workunit.client.1.smithi142.stdout:1/239: truncate d12/d13/f17 1104788 0 2024-09-13T02:52:33.313 INFO:tasks.workunit.client.1.smithi142.stdout:9/224: fdatasync dd/f1c 0 2024-09-13T02:52:33.313 INFO:tasks.workunit.client.1.smithi142.stdout:4/183: dread d0/df/f23 [0,4194304] 0 2024-09-13T02:52:33.313 INFO:tasks.workunit.client.1.smithi142.stdout:7/187: link d10/c11 d10/d13/d1d/d25/c3b 0 2024-09-13T02:52:33.318 INFO:tasks.workunit.client.1.smithi142.stdout:0/220: sync 2024-09-13T02:52:33.318 INFO:tasks.workunit.client.1.smithi142.stdout:9/225: mknod dd/d17/d35/d41/c52 0 2024-09-13T02:52:33.320 INFO:tasks.workunit.client.1.smithi142.stdout:1/240: symlink d12/d13/d20/l4e 0 2024-09-13T02:52:33.321 INFO:tasks.workunit.client.1.smithi142.stdout:3/182: getdents d12/d16/d25 0 2024-09-13T02:52:33.323 INFO:tasks.workunit.client.1.smithi142.stdout:9/226: rename dd/d17/d35/f3d to dd/d17/d25/f53 0 2024-09-13T02:52:33.323 INFO:tasks.workunit.client.1.smithi142.stdout:9/227: readlink dd/d17/l27 0 2024-09-13T02:52:33.324 INFO:tasks.workunit.client.1.smithi142.stdout:9/228: stat dd/l12 0 2024-09-13T02:52:33.325 INFO:tasks.workunit.client.1.smithi142.stdout:1/241: mkdir d12/d13/d1d/d26/d4f 0 2024-09-13T02:52:33.326 INFO:tasks.workunit.client.1.smithi142.stdout:3/183: rmdir d12/d16/d25 39 2024-09-13T02:52:33.328 INFO:tasks.workunit.client.1.smithi142.stdout:9/229: rename dd/d47/l4e to dd/d17/d4f/l54 0 2024-09-13T02:52:33.339 INFO:tasks.workunit.client.0.smithi098.stdout:7/130: dwrite d6/d14/f27 [0,4194304] 0 2024-09-13T02:52:33.344 INFO:tasks.workunit.client.0.smithi098.stdout:7/131: dread d6/d14/f1d [0,4194304] 0 2024-09-13T02:52:33.346 INFO:tasks.workunit.client.0.smithi098.stdout:7/132: rename d6/d1e/l21 to d6/d1e/l33 0 2024-09-13T02:52:33.346 INFO:tasks.workunit.client.0.smithi098.stdout:7/133: chown d6/cb 88063 1 2024-09-13T02:52:33.347 INFO:tasks.workunit.client.0.smithi098.stdout:7/134: truncate d6/d1e/f23 630293 0 2024-09-13T02:52:33.357 INFO:tasks.workunit.client.1.smithi142.stdout:4/184: getdents d0/d2b/d13 0 2024-09-13T02:52:33.357 INFO:tasks.workunit.client.1.smithi142.stdout:9/230: rmdir dd 39 2024-09-13T02:52:33.358 INFO:tasks.workunit.client.1.smithi142.stdout:1/242: rename l4 to d12/d13/d20/d27/d3c/l50 0 2024-09-13T02:52:33.359 INFO:tasks.workunit.client.1.smithi142.stdout:5/181: write d8/f1e [695132,102356] 0 2024-09-13T02:52:33.359 INFO:tasks.workunit.client.1.smithi142.stdout:8/142: truncate d0/d1/f3 1478884 0 2024-09-13T02:52:33.360 INFO:tasks.workunit.client.1.smithi142.stdout:5/182: dread - d8/d24/d26/f31 zero size 2024-09-13T02:52:33.364 INFO:tasks.workunit.client.1.smithi142.stdout:7/188: dwrite d10/d13/f1c [0,4194304] 0 2024-09-13T02:52:33.393 INFO:tasks.workunit.client.1.smithi142.stdout:6/207: sync 2024-09-13T02:52:33.470 INFO:tasks.workunit.client.1.smithi142.stdout:2/108: sync 2024-09-13T02:52:33.470 INFO:tasks.workunit.client.1.smithi142.stdout:2/109: dread - d1/de/f22 zero size 2024-09-13T02:52:33.489 INFO:tasks.workunit.client.1.smithi142.stdout:0/221: sync 2024-09-13T02:52:33.489 INFO:tasks.workunit.client.1.smithi142.stdout:6/208: sync 2024-09-13T02:52:33.505 INFO:tasks.workunit.client.0.smithi098.stdout:7/135: rename d6/d24/d2a/f2f to d6/d14/f34 0 2024-09-13T02:52:33.508 INFO:tasks.workunit.client.1.smithi142.stdout:3/184: symlink d12/d16/d25/l34 0 2024-09-13T02:52:33.510 INFO:tasks.workunit.client.0.smithi098.stdout:7/136: chown d6/c32 3663895 1 2024-09-13T02:52:33.512 INFO:tasks.workunit.client.1.smithi142.stdout:4/185: unlink d0/d2b/f7 0 2024-09-13T02:52:33.515 INFO:tasks.workunit.client.1.smithi142.stdout:1/243: symlink d12/d13/d1d/d26/l51 0 2024-09-13T02:52:33.515 INFO:tasks.workunit.client.1.smithi142.stdout:1/244: dread - d12/f4d zero size 2024-09-13T02:52:33.517 INFO:tasks.workunit.client.1.smithi142.stdout:5/183: write d8/f2e [3443884,116417] 0 2024-09-13T02:52:33.520 INFO:tasks.workunit.client.0.smithi098.stdout:7/137: rmdir d6/d1e 39 2024-09-13T02:52:33.523 INFO:tasks.workunit.client.1.smithi142.stdout:2/110: symlink d1/de/l25 0 2024-09-13T02:52:33.525 INFO:tasks.workunit.client.1.smithi142.stdout:6/209: creat d1/dd/d16/f4c x:0 0 0 2024-09-13T02:52:33.526 INFO:tasks.workunit.client.1.smithi142.stdout:0/222: creat d10/d15/d45/f56 x:0 0 0 2024-09-13T02:52:33.529 INFO:tasks.workunit.client.1.smithi142.stdout:3/185: chown d12/d16/c1d 42 1 2024-09-13T02:52:33.534 INFO:tasks.workunit.client.1.smithi142.stdout:8/143: mkdir d0/d6/d23/d2b 0 2024-09-13T02:52:33.536 INFO:tasks.workunit.client.1.smithi142.stdout:5/184: mknod d8/c39 0 2024-09-13T02:52:33.536 INFO:tasks.workunit.client.1.smithi142.stdout:7/189: getdents d10/d31 0 2024-09-13T02:52:33.538 INFO:tasks.workunit.client.1.smithi142.stdout:2/111: creat d1/de/f26 x:0 0 0 2024-09-13T02:52:33.539 INFO:tasks.workunit.client.1.smithi142.stdout:2/112: rename d1/de to d1/de/d1f/d13/d27 22 2024-09-13T02:52:33.539 INFO:tasks.workunit.client.1.smithi142.stdout:6/210: mkdir d1/dd/d16/d4d 0 2024-09-13T02:52:33.539 INFO:tasks.workunit.client.1.smithi142.stdout:2/113: fdatasync d1/de/f17 0 2024-09-13T02:52:33.540 INFO:tasks.workunit.client.1.smithi142.stdout:7/190: dread d10/d13/f20 [0,4194304] 0 2024-09-13T02:52:33.541 INFO:tasks.workunit.client.1.smithi142.stdout:6/211: truncate d1/d7/d19/f4b 66914 0 2024-09-13T02:52:33.544 INFO:tasks.workunit.client.0.smithi098.stdout:7/138: truncate d6/d24/f28 96980 0 2024-09-13T02:52:33.544 INFO:tasks.workunit.client.0.smithi098.stdout:7/139: dread - d6/fc zero size 2024-09-13T02:52:33.547 INFO:tasks.workunit.client.1.smithi142.stdout:5/185: unlink d8/c16 0 2024-09-13T02:52:33.548 INFO:tasks.workunit.client.1.smithi142.stdout:0/223: dread d10/f13 [0,4194304] 0 2024-09-13T02:52:33.548 INFO:tasks.workunit.client.1.smithi142.stdout:6/212: dwrite d1/d7/f3e [0,4194304] 0 2024-09-13T02:52:33.549 INFO:tasks.workunit.client.0.smithi098.stdout:7/140: rename d6/f29 to d6/d24/d2a/f35 0 2024-09-13T02:52:33.550 INFO:tasks.workunit.client.1.smithi142.stdout:6/213: chown d1/dd/d16/f3c 4873345 1 2024-09-13T02:52:33.553 INFO:tasks.workunit.client.1.smithi142.stdout:2/114: stat d1/f1e 0 2024-09-13T02:52:33.553 INFO:tasks.workunit.client.1.smithi142.stdout:4/186: dwrite d0/f14 [0,4194304] 0 2024-09-13T02:52:33.555 INFO:tasks.workunit.client.1.smithi142.stdout:4/187: readlink d0/d2b/d21/l36 0 2024-09-13T02:52:33.559 INFO:tasks.workunit.client.1.smithi142.stdout:7/191: creat d10/d13/d1d/d25/d2e/f3c x:0 0 0 2024-09-13T02:52:33.559 INFO:tasks.workunit.client.0.smithi098.stdout:7/141: dwrite d6/d14/f34 [0,4194304] 0 2024-09-13T02:52:33.560 INFO:tasks.workunit.client.1.smithi142.stdout:6/214: dwrite d1/dd/d18/d32/f3b [0,4194304] 0 2024-09-13T02:52:33.560 INFO:tasks.workunit.client.1.smithi142.stdout:7/192: write d10/d13/d1d/f2d [815270,108190] 0 2024-09-13T02:52:33.561 INFO:tasks.workunit.client.0.smithi098.stdout:7/142: write d6/f15 [3755001,29298] 0 2024-09-13T02:52:33.561 INFO:tasks.workunit.client.1.smithi142.stdout:6/215: chown d1/dd/d16/c43 1 1 2024-09-13T02:52:33.564 INFO:tasks.workunit.client.1.smithi142.stdout:7/193: dread - d10/d13/d1d/f36 zero size 2024-09-13T02:52:33.564 INFO:tasks.workunit.client.1.smithi142.stdout:1/245: link d12/d1b/f43 d12/d1b/f52 0 2024-09-13T02:52:33.568 INFO:tasks.workunit.client.1.smithi142.stdout:5/186: symlink d8/l3a 0 2024-09-13T02:52:33.571 INFO:tasks.workunit.client.0.smithi098.stdout:7/143: link d6/d14/f22 d6/d1e/f36 0 2024-09-13T02:52:33.571 INFO:tasks.workunit.client.1.smithi142.stdout:2/115: symlink d1/de/l28 0 2024-09-13T02:52:33.572 INFO:tasks.workunit.client.0.smithi098.stdout:7/144: truncate d6/d24/f2c 858018 0 2024-09-13T02:52:33.572 INFO:tasks.workunit.client.1.smithi142.stdout:9/231: link dd/d17/d4f/l54 dd/d17/d4f/l55 0 2024-09-13T02:52:33.577 INFO:tasks.workunit.client.1.smithi142.stdout:6/216: write d1/d7/f3a [161624,17907] 0 2024-09-13T02:52:33.578 INFO:tasks.workunit.client.1.smithi142.stdout:6/217: truncate d1/dd/d16/f4c 875469 0 2024-09-13T02:52:33.580 INFO:tasks.workunit.client.1.smithi142.stdout:1/246: mkdir d12/d13/d20/d27/d3c/d53 0 2024-09-13T02:52:33.581 INFO:tasks.workunit.client.0.smithi098.stdout:7/145: dwrite d6/d14/f2b [0,4194304] 0 2024-09-13T02:52:33.582 INFO:tasks.workunit.client.0.smithi098.stdout:7/146: chown d6/f13 6018 1 2024-09-13T02:52:33.583 INFO:tasks.workunit.client.0.smithi098.stdout:7/147: write d6/f11 [458853,72697] 0 2024-09-13T02:52:33.584 INFO:tasks.workunit.client.1.smithi142.stdout:5/187: unlink d8/f10 0 2024-09-13T02:52:33.586 INFO:tasks.workunit.client.1.smithi142.stdout:3/186: getdents d12 0 2024-09-13T02:52:33.590 INFO:tasks.workunit.client.1.smithi142.stdout:8/144: link d0/d1/f3 d0/d6/d23/f2c 0 2024-09-13T02:52:33.590 INFO:tasks.workunit.client.0.smithi098.stdout:7/148: link d6/c12 d6/d24/c37 0 2024-09-13T02:52:33.592 INFO:tasks.workunit.client.0.smithi098.stdout:7/149: truncate d6/d24/d2a/f2d 671581 0 2024-09-13T02:52:33.592 INFO:tasks.workunit.client.1.smithi142.stdout:2/116: dread d1/ff [0,4194304] 0 2024-09-13T02:52:33.593 INFO:tasks.workunit.client.1.smithi142.stdout:6/218: rename d1/dd/d18 to d1/dd/d16/d4e 0 2024-09-13T02:52:33.595 INFO:tasks.workunit.client.1.smithi142.stdout:3/187: rmdir d12 39 2024-09-13T02:52:33.597 INFO:tasks.workunit.client.1.smithi142.stdout:1/247: link d12/d13/d20/f38 d12/d13/d20/d27/d3c/d53/f54 0 2024-09-13T02:52:33.600 INFO:tasks.workunit.client.1.smithi142.stdout:7/194: dwrite d10/d13/d1d/f23 [0,4194304] 0 2024-09-13T02:52:33.601 INFO:tasks.workunit.client.0.smithi098.stdout:7/150: fsync d6/d14/f2b 0 2024-09-13T02:52:33.601 INFO:tasks.workunit.client.0.smithi098.stdout:7/151: dread - d6/fc zero size 2024-09-13T02:52:33.602 INFO:tasks.workunit.client.1.smithi142.stdout:8/145: creat d0/d1/d8/df/d28/f2d x:0 0 0 2024-09-13T02:52:33.605 INFO:tasks.workunit.client.1.smithi142.stdout:1/248: write d12/d13/d20/f38 [1414854,103268] 0 2024-09-13T02:52:33.605 INFO:tasks.workunit.client.1.smithi142.stdout:3/188: fsync d12/d16/d25/d2e/f2f 0 2024-09-13T02:52:33.606 INFO:tasks.workunit.client.0.smithi098.stdout:7/152: link d6/d14/f22 d6/d14/f38 0 2024-09-13T02:52:33.607 INFO:tasks.workunit.client.1.smithi142.stdout:8/146: chown d0/c4 35348 1 2024-09-13T02:52:33.607 INFO:tasks.workunit.client.1.smithi142.stdout:2/117: dwrite d1/f9 [4194304,4194304] 0 2024-09-13T02:52:33.608 INFO:tasks.workunit.client.1.smithi142.stdout:0/224: truncate d10/d15/d21/f3c 3340135 0 2024-09-13T02:52:33.609 INFO:tasks.workunit.client.1.smithi142.stdout:6/219: dwrite d1/d7/d19/f45 [0,4194304] 0 2024-09-13T02:52:33.609 INFO:tasks.workunit.client.0.smithi098.stdout:7/153: rmdir d6/d1e 39 2024-09-13T02:52:33.610 INFO:tasks.workunit.client.1.smithi142.stdout:6/220: dread - d1/f41 zero size 2024-09-13T02:52:33.611 INFO:tasks.workunit.client.1.smithi142.stdout:2/118: dread d1/de/f10 [0,4194304] 0 2024-09-13T02:52:33.614 INFO:tasks.workunit.client.1.smithi142.stdout:4/188: truncate d0/f14 3399097 0 2024-09-13T02:52:33.614 INFO:tasks.workunit.client.1.smithi142.stdout:8/147: chown d0/d1/f1b 816797422 1 2024-09-13T02:52:33.616 INFO:tasks.workunit.client.1.smithi142.stdout:7/195: link d10/f17 d10/d13/f3d 0 2024-09-13T02:52:33.618 INFO:tasks.workunit.client.0.smithi098.stdout:7/154: dwrite d6/f15 [4194304,4194304] 0 2024-09-13T02:52:33.621 INFO:tasks.workunit.client.1.smithi142.stdout:1/249: rename d12/d13/d20/d2c to d12/d39/d55 0 2024-09-13T02:52:33.622 INFO:tasks.workunit.client.1.smithi142.stdout:1/250: chown d12/d13/d20/f38 2 1 2024-09-13T02:52:33.623 INFO:tasks.workunit.client.1.smithi142.stdout:0/225: creat d10/d15/d45/f57 x:0 0 0 2024-09-13T02:52:33.624 INFO:tasks.workunit.client.1.smithi142.stdout:1/251: chown d12/d13/f16 11 1 2024-09-13T02:52:33.626 INFO:tasks.workunit.client.0.smithi098.stdout:7/155: dwrite d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:33.627 INFO:tasks.workunit.client.1.smithi142.stdout:5/188: dwrite f5 [0,4194304] 0 2024-09-13T02:52:33.628 INFO:tasks.workunit.client.1.smithi142.stdout:2/119: unlink d1/de/d1f/f24 0 2024-09-13T02:52:33.630 INFO:tasks.workunit.client.1.smithi142.stdout:4/189: unlink d0/lb 0 2024-09-13T02:52:33.630 INFO:tasks.workunit.client.1.smithi142.stdout:2/120: write d1/de/f23 [216851,1121] 0 2024-09-13T02:52:33.636 INFO:tasks.workunit.client.1.smithi142.stdout:6/221: creat d1/dd/d16/d4d/f4f x:0 0 0 2024-09-13T02:52:33.636 INFO:tasks.workunit.client.0.smithi098.stdout:7/156: link c1 d6/d1e/c39 0 2024-09-13T02:52:33.638 INFO:tasks.workunit.client.0.smithi098.stdout:7/157: write d6/f13 [308364,78951] 0 2024-09-13T02:52:33.638 INFO:tasks.workunit.client.1.smithi142.stdout:5/189: symlink d8/d24/d26/l3b 0 2024-09-13T02:52:33.639 INFO:tasks.workunit.client.0.smithi098.stdout:7/158: chown d6/d14/f27 24150 1 2024-09-13T02:52:33.640 INFO:tasks.workunit.client.1.smithi142.stdout:3/189: creat d12/d16/f35 x:0 0 0 2024-09-13T02:52:33.642 INFO:tasks.workunit.client.1.smithi142.stdout:2/121: write d1/f6 [155680,114434] 0 2024-09-13T02:52:33.645 INFO:tasks.workunit.client.0.smithi098.stdout:7/159: creat d6/d24/d2a/f3a x:0 0 0 2024-09-13T02:52:33.646 INFO:tasks.workunit.client.1.smithi142.stdout:7/196: getdents d10/d13/d1d/d25/d2e/d32 0 2024-09-13T02:52:33.648 INFO:tasks.workunit.client.1.smithi142.stdout:9/232: sync 2024-09-13T02:52:33.649 INFO:tasks.workunit.client.1.smithi142.stdout:0/226: getdents d10/d15/d1a/d1e/d42/d4b 0 2024-09-13T02:52:33.649 INFO:tasks.workunit.client.1.smithi142.stdout:2/122: dwrite d1/de/f23 [0,4194304] 0 2024-09-13T02:52:33.649 INFO:tasks.workunit.client.1.smithi142.stdout:6/222: rmdir d1/d7/d19/d30 39 2024-09-13T02:52:33.650 INFO:tasks.workunit.client.1.smithi142.stdout:6/223: dread - d1/f25 zero size 2024-09-13T02:52:33.651 INFO:tasks.workunit.client.0.smithi098.stdout:7/160: symlink d6/l3b 0 2024-09-13T02:52:33.651 INFO:tasks.workunit.client.0.smithi098.stdout:7/161: chown d6/d24/d2a/f3a 907 1 2024-09-13T02:52:33.652 INFO:tasks.workunit.client.1.smithi142.stdout:5/190: truncate d8/fe 782376 0 2024-09-13T02:52:33.652 INFO:tasks.workunit.client.0.smithi098.stdout:7/162: write d6/f19 [706691,13772] 0 2024-09-13T02:52:33.653 INFO:tasks.workunit.client.1.smithi142.stdout:3/190: fdatasync d12/f28 0 2024-09-13T02:52:33.654 INFO:tasks.workunit.client.1.smithi142.stdout:4/190: creat d0/d2b/d21/d30/f3a x:0 0 0 2024-09-13T02:52:33.657 INFO:tasks.workunit.client.1.smithi142.stdout:9/233: creat dd/d17/d25/d3e/f56 x:0 0 0 2024-09-13T02:52:33.659 INFO:tasks.workunit.client.0.smithi098.stdout:7/163: link d6/d24/d2a/f31 d6/d1e/f3c 0 2024-09-13T02:52:33.659 INFO:tasks.workunit.client.1.smithi142.stdout:9/234: write dd/f18 [991182,118048] 0 2024-09-13T02:52:33.660 INFO:tasks.workunit.client.1.smithi142.stdout:5/191: dread d8/f19 [0,4194304] 0 2024-09-13T02:52:33.661 INFO:tasks.workunit.client.1.smithi142.stdout:0/227: creat d10/d23/f58 x:0 0 0 2024-09-13T02:52:33.661 INFO:tasks.workunit.client.1.smithi142.stdout:3/191: dwrite d12/f22 [0,4194304] 0 2024-09-13T02:52:33.663 INFO:tasks.workunit.client.1.smithi142.stdout:8/148: write d0/d1/f1b [2050715,98342] 0 2024-09-13T02:52:33.664 INFO:tasks.workunit.client.1.smithi142.stdout:5/192: truncate d8/d24/d26/f31 478564 0 2024-09-13T02:52:33.664 INFO:tasks.workunit.client.1.smithi142.stdout:3/192: truncate d12/d16/f35 651323 0 2024-09-13T02:52:33.665 INFO:tasks.workunit.client.1.smithi142.stdout:3/193: readlink lf 0 2024-09-13T02:52:33.669 INFO:tasks.workunit.client.1.smithi142.stdout:1/252: getdents d12/d13 0 2024-09-13T02:52:33.670 INFO:tasks.workunit.client.1.smithi142.stdout:7/197: symlink d10/d13/d1d/l3e 0 2024-09-13T02:52:33.671 INFO:tasks.workunit.client.0.smithi098.stdout:7/164: dwrite d6/d14/f1d [0,4194304] 0 2024-09-13T02:52:33.672 INFO:tasks.workunit.client.1.smithi142.stdout:5/193: dwrite d8/d24/f27 [0,4194304] 0 2024-09-13T02:52:33.673 INFO:tasks.workunit.client.1.smithi142.stdout:2/123: mkdir d1/d29 0 2024-09-13T02:52:33.676 INFO:tasks.workunit.client.0.smithi098.stdout:7/165: read d6/d24/d2a/f31 [427527,92947] 0 2024-09-13T02:52:33.677 INFO:tasks.workunit.client.0.smithi098.stdout:7/166: write d6/f11 [533697,53448] 0 2024-09-13T02:52:33.679 INFO:tasks.workunit.client.0.smithi098.stdout:7/167: chown d6/d24/d2a/f31 1390121 1 2024-09-13T02:52:33.681 INFO:tasks.workunit.client.1.smithi142.stdout:0/228: creat d10/d15/d36/f59 x:0 0 0 2024-09-13T02:52:33.682 INFO:tasks.workunit.client.1.smithi142.stdout:4/191: dread d0/d2b/d13/f1e [0,4194304] 0 2024-09-13T02:52:33.683 INFO:tasks.workunit.client.1.smithi142.stdout:9/235: dread dd/f1d [0,4194304] 0 2024-09-13T02:52:33.684 INFO:tasks.workunit.client.1.smithi142.stdout:9/236: write dd/f18 [1877964,118613] 0 2024-09-13T02:52:33.686 INFO:tasks.workunit.client.1.smithi142.stdout:8/149: rmdir d0/d1/d8/df/d28 39 2024-09-13T02:52:33.695 INFO:tasks.workunit.client.1.smithi142.stdout:7/198: symlink d10/d13/l3f 0 2024-09-13T02:52:33.696 INFO:tasks.workunit.client.0.smithi098.stdout:7/168: write d6/d1e/f3c [1161126,26196] 0 2024-09-13T02:52:33.696 INFO:tasks.workunit.client.0.smithi098.stdout:7/169: stat d6/d14/f2e 0 2024-09-13T02:52:33.697 INFO:tasks.workunit.client.1.smithi142.stdout:6/224: creat d1/d7/f50 x:0 0 0 2024-09-13T02:52:33.699 INFO:tasks.workunit.client.0.smithi098.stdout:7/170: dread - d6/d14/f22 zero size 2024-09-13T02:52:33.704 INFO:tasks.workunit.client.1.smithi142.stdout:9/237: rename dd/d17/d35/c43 to dd/d17/d25/c57 0 2024-09-13T02:52:33.704 INFO:tasks.workunit.client.1.smithi142.stdout:9/238: chown dd/d17/l21 6 1 2024-09-13T02:52:33.705 INFO:tasks.workunit.client.1.smithi142.stdout:8/150: mkdir d0/d6/dc/d2e 0 2024-09-13T02:52:33.706 INFO:tasks.workunit.client.1.smithi142.stdout:3/194: mknod d12/d16/c36 0 2024-09-13T02:52:33.707 INFO:tasks.workunit.client.1.smithi142.stdout:1/253: creat d12/d13/d20/d27/d3c/d53/f56 x:0 0 0 2024-09-13T02:52:33.707 INFO:tasks.workunit.client.1.smithi142.stdout:1/254: stat d12/d13/d20 0 2024-09-13T02:52:33.708 INFO:tasks.workunit.client.1.smithi142.stdout:7/199: write fd [41180,5003] 0 2024-09-13T02:52:33.709 INFO:tasks.workunit.client.0.smithi098.stdout:7/171: getdents d6/d14 0 2024-09-13T02:52:33.709 INFO:tasks.workunit.client.1.smithi142.stdout:1/255: truncate d12/d13/d20/d27/f30 891690 0 2024-09-13T02:52:33.711 INFO:tasks.workunit.client.1.smithi142.stdout:6/225: symlink d1/dd/d16/d4e/l51 0 2024-09-13T02:52:33.713 INFO:tasks.workunit.client.0.smithi098.stdout:7/172: read d6/d24/f28 [10562,97577] 0 2024-09-13T02:52:33.714 INFO:tasks.workunit.client.1.smithi142.stdout:2/124: truncate d1/de/f17 6568199 0 2024-09-13T02:52:33.715 INFO:tasks.workunit.client.1.smithi142.stdout:0/229: mknod d10/d15/c5a 0 2024-09-13T02:52:33.716 INFO:tasks.workunit.client.1.smithi142.stdout:0/230: fdatasync d10/d15/d36/f59 0 2024-09-13T02:52:33.716 INFO:tasks.workunit.client.1.smithi142.stdout:9/239: write dd/d17/d25/f53 [56767,96770] 0 2024-09-13T02:52:33.716 INFO:tasks.workunit.client.1.smithi142.stdout:8/151: creat d0/d6/dc/f2f x:0 0 0 2024-09-13T02:52:33.717 INFO:tasks.workunit.client.1.smithi142.stdout:3/195: mknod d12/c37 0 2024-09-13T02:52:33.718 INFO:tasks.workunit.client.1.smithi142.stdout:8/152: dread - d0/d6/dc/f18 zero size 2024-09-13T02:52:33.718 INFO:tasks.workunit.client.1.smithi142.stdout:5/194: creat d8/d24/f3c x:0 0 0 2024-09-13T02:52:33.721 INFO:tasks.workunit.client.1.smithi142.stdout:2/125: creat d1/de/d1f/d13/f2a x:0 0 0 2024-09-13T02:52:33.721 INFO:tasks.workunit.client.1.smithi142.stdout:9/240: creat dd/f58 x:0 0 0 2024-09-13T02:52:33.722 INFO:tasks.workunit.client.1.smithi142.stdout:2/126: dread - d1/de/d1f/d13/f2a zero size 2024-09-13T02:52:33.723 INFO:tasks.workunit.client.1.smithi142.stdout:0/231: rename l4 to d10/d15/d21/d51/d35/l5b 0 2024-09-13T02:52:33.724 INFO:tasks.workunit.client.1.smithi142.stdout:7/200: mkdir d10/d13/d1d/d2b/d40 0 2024-09-13T02:52:33.726 INFO:tasks.workunit.client.1.smithi142.stdout:8/153: mkdir d0/d6/d23/d30 0 2024-09-13T02:52:33.728 INFO:tasks.workunit.client.1.smithi142.stdout:5/195: rmdir d8/d24/d26 39 2024-09-13T02:52:33.731 INFO:tasks.workunit.client.1.smithi142.stdout:9/241: rename dd/f1c to dd/d17/d35/d41/f59 0 2024-09-13T02:52:33.733 INFO:tasks.workunit.client.1.smithi142.stdout:0/232: creat d10/d15/d1a/d3a/f5c x:0 0 0 2024-09-13T02:52:33.734 INFO:tasks.workunit.client.1.smithi142.stdout:4/192: dwrite d0/d2b/d9/f22 [0,4194304] 0 2024-09-13T02:52:33.735 INFO:tasks.workunit.client.1.smithi142.stdout:6/226: truncate d1/dd/f22 358110 0 2024-09-13T02:52:33.736 INFO:tasks.workunit.client.1.smithi142.stdout:5/196: dwrite d8/d24/f3c [0,4194304] 0 2024-09-13T02:52:33.737 INFO:tasks.workunit.client.1.smithi142.stdout:1/256: getdents d12/d13/d20/d27 0 2024-09-13T02:52:33.739 INFO:tasks.workunit.client.1.smithi142.stdout:2/127: write d1/f5 [2142892,19381] 0 2024-09-13T02:52:33.739 INFO:tasks.workunit.client.1.smithi142.stdout:9/242: mknod dd/d17/d44/c5a 0 2024-09-13T02:52:33.741 INFO:tasks.workunit.client.1.smithi142.stdout:0/233: symlink d10/d15/d36/l5d 0 2024-09-13T02:52:33.741 INFO:tasks.workunit.client.1.smithi142.stdout:7/201: write d10/f17 [920685,99119] 0 2024-09-13T02:52:33.742 INFO:tasks.workunit.client.1.smithi142.stdout:6/227: chown d1/dd/d16/d4e/d32/f3b 7035980 1 2024-09-13T02:52:33.742 INFO:tasks.workunit.client.1.smithi142.stdout:8/154: mknod d0/d1/d8/df/c31 0 2024-09-13T02:52:33.743 INFO:tasks.workunit.client.1.smithi142.stdout:7/202: stat ff 0 2024-09-13T02:52:33.744 INFO:tasks.workunit.client.1.smithi142.stdout:0/234: readlink d10/d15/l27 0 2024-09-13T02:52:33.745 INFO:tasks.workunit.client.1.smithi142.stdout:3/196: truncate d12/d16/d25/f26 2309086 0 2024-09-13T02:52:33.747 INFO:tasks.workunit.client.1.smithi142.stdout:5/197: dread - d8/d24/d26/d2d/f2f zero size 2024-09-13T02:52:33.748 INFO:tasks.workunit.client.1.smithi142.stdout:7/203: fdatasync d10/d13/f3d 0 2024-09-13T02:52:33.751 INFO:tasks.workunit.client.1.smithi142.stdout:6/228: unlink d1/d7/l38 0 2024-09-13T02:52:33.753 INFO:tasks.workunit.client.1.smithi142.stdout:0/235: dread d10/d15/d21/d51/f3e [0,4194304] 0 2024-09-13T02:52:33.756 INFO:tasks.workunit.client.1.smithi142.stdout:9/243: dwrite dd/f1f [0,4194304] 0 2024-09-13T02:52:33.758 INFO:tasks.workunit.client.1.smithi142.stdout:1/257: dwrite d12/d13/d20/d27/d3c/d53/f54 [4194304,4194304] 0 2024-09-13T02:52:33.759 INFO:tasks.workunit.client.1.smithi142.stdout:8/155: truncate d0/d6/f2a 3978251 0 2024-09-13T02:52:33.759 INFO:tasks.workunit.client.1.smithi142.stdout:4/193: dwrite d0/d2b/d13/f1a [0,4194304] 0 2024-09-13T02:52:33.764 INFO:tasks.workunit.client.1.smithi142.stdout:0/236: symlink d10/d15/d1a/d1e/d42/l5e 0 2024-09-13T02:52:33.764 INFO:tasks.workunit.client.1.smithi142.stdout:2/128: getdents d1/de/d1f 0 2024-09-13T02:52:33.765 INFO:tasks.workunit.client.1.smithi142.stdout:3/197: dread d12/d16/f20 [4194304,4194304] 0 2024-09-13T02:52:33.766 INFO:tasks.workunit.client.1.smithi142.stdout:6/229: mkdir d1/d7/d19/d52 0 2024-09-13T02:52:33.767 INFO:tasks.workunit.client.1.smithi142.stdout:9/244: symlink dd/d17/l5b 0 2024-09-13T02:52:33.768 INFO:tasks.workunit.client.1.smithi142.stdout:5/198: rename d8/f1c to d8/d24/f3d 0 2024-09-13T02:52:33.769 INFO:tasks.workunit.client.1.smithi142.stdout:7/204: dwrite ff [0,4194304] 0 2024-09-13T02:52:33.770 INFO:tasks.workunit.client.1.smithi142.stdout:9/245: fdatasync dd/d17/f39 0 2024-09-13T02:52:33.779 INFO:tasks.workunit.client.1.smithi142.stdout:4/194: dread d0/f14 [0,4194304] 0 2024-09-13T02:52:33.781 INFO:tasks.workunit.client.1.smithi142.stdout:7/205: mkdir d10/d37/d41 0 2024-09-13T02:52:33.783 INFO:tasks.workunit.client.1.smithi142.stdout:0/237: dwrite d10/d15/d1a/f22 [4194304,4194304] 0 2024-09-13T02:52:33.784 INFO:tasks.workunit.client.1.smithi142.stdout:9/246: creat dd/d17/d44/f5c x:0 0 0 2024-09-13T02:52:33.787 INFO:tasks.workunit.client.1.smithi142.stdout:6/230: mkdir d1/dd/d53 0 2024-09-13T02:52:33.787 INFO:tasks.workunit.client.1.smithi142.stdout:0/238: rmdir d10/d15/d1a/d1e 39 2024-09-13T02:52:33.788 INFO:tasks.workunit.client.1.smithi142.stdout:1/258: rename d12/d1b/f2f to d12/f57 0 2024-09-13T02:52:33.790 INFO:tasks.workunit.client.1.smithi142.stdout:9/247: creat dd/d17/d25/d3e/f5d x:0 0 0 2024-09-13T02:52:33.791 INFO:tasks.workunit.client.1.smithi142.stdout:3/198: dwrite d12/d16/f29 [0,4194304] 0 2024-09-13T02:52:33.791 INFO:tasks.workunit.client.1.smithi142.stdout:0/239: readlink d10/d15/d1a/d1e/d42/l5e 0 2024-09-13T02:52:33.792 INFO:tasks.workunit.client.1.smithi142.stdout:3/199: fdatasync d12/d16/f21 0 2024-09-13T02:52:33.793 INFO:tasks.workunit.client.1.smithi142.stdout:7/206: creat d10/f42 x:0 0 0 2024-09-13T02:52:33.795 INFO:tasks.workunit.client.1.smithi142.stdout:6/231: getdents d1/d4a 0 2024-09-13T02:52:33.795 INFO:tasks.workunit.client.1.smithi142.stdout:1/259: chown d12/d13/d1d/l29 5688429 1 2024-09-13T02:52:33.797 INFO:tasks.workunit.client.1.smithi142.stdout:3/200: fsync d12/f2b 0 2024-09-13T02:52:33.798 INFO:tasks.workunit.client.1.smithi142.stdout:3/201: read d12/d16/f35 [547568,88787] 0 2024-09-13T02:52:33.800 INFO:tasks.workunit.client.1.smithi142.stdout:3/202: write d12/d16/d25/d2e/f2f [558266,110760] 0 2024-09-13T02:52:33.800 INFO:tasks.workunit.client.1.smithi142.stdout:8/156: truncate d0/d1/f3 9824 0 2024-09-13T02:52:33.801 INFO:tasks.workunit.client.1.smithi142.stdout:6/232: stat d1/c1e 0 2024-09-13T02:52:33.802 INFO:tasks.workunit.client.1.smithi142.stdout:6/233: dread - d1/d7/f24 zero size 2024-09-13T02:52:33.802 INFO:tasks.workunit.client.1.smithi142.stdout:1/260: stat d12/d1b/c2a 0 2024-09-13T02:52:33.804 INFO:tasks.workunit.client.1.smithi142.stdout:6/234: write d1/d7/f2a [4510865,92997] 0 2024-09-13T02:52:33.805 INFO:tasks.workunit.client.1.smithi142.stdout:5/199: rename f5 to d8/d24/f3e 0 2024-09-13T02:52:33.807 INFO:tasks.workunit.client.1.smithi142.stdout:2/129: dwrite d1/de/d1f/d13/f14 [0,4194304] 0 2024-09-13T02:52:33.808 INFO:tasks.workunit.client.1.smithi142.stdout:5/200: truncate d8/d24/d26/d2d/f2f 28514 0 2024-09-13T02:52:33.808 INFO:tasks.workunit.client.1.smithi142.stdout:7/207: creat d10/d31/f43 x:0 0 0 2024-09-13T02:52:33.809 INFO:tasks.workunit.client.1.smithi142.stdout:3/203: fsync d12/f19 0 2024-09-13T02:52:33.811 INFO:tasks.workunit.client.1.smithi142.stdout:8/157: symlink d0/d1/l32 0 2024-09-13T02:52:33.812 INFO:tasks.workunit.client.1.smithi142.stdout:1/261: rmdir d12/d13/d1d/d26 39 2024-09-13T02:52:33.815 INFO:tasks.workunit.client.1.smithi142.stdout:6/235: unlink d1/d7/la 0 2024-09-13T02:52:33.817 INFO:tasks.workunit.client.1.smithi142.stdout:6/236: rename d1/d4a to d1/d4a/d54 22 2024-09-13T02:52:33.818 INFO:tasks.workunit.client.1.smithi142.stdout:9/248: dwrite f5 [0,4194304] 0 2024-09-13T02:52:33.820 INFO:tasks.workunit.client.1.smithi142.stdout:2/130: mkdir d1/d29/d2b 0 2024-09-13T02:52:33.821 INFO:tasks.workunit.client.1.smithi142.stdout:0/240: dwrite d10/f13 [0,4194304] 0 2024-09-13T02:52:33.821 INFO:tasks.workunit.client.1.smithi142.stdout:3/204: read d12/d16/f35 [562949,95158] 0 2024-09-13T02:52:33.825 INFO:tasks.workunit.client.1.smithi142.stdout:2/131: chown d1/de/f22 1393811 1 2024-09-13T02:52:33.825 INFO:tasks.workunit.client.1.smithi142.stdout:5/201: mkdir d8/d24/d3f 0 2024-09-13T02:52:33.829 INFO:tasks.workunit.client.1.smithi142.stdout:7/208: fsync d10/d31/f43 0 2024-09-13T02:52:33.831 INFO:tasks.workunit.client.1.smithi142.stdout:3/205: write d12/d16/f24 [28847,70686] 0 2024-09-13T02:52:33.831 INFO:tasks.workunit.client.1.smithi142.stdout:9/249: rename dd/l2a to dd/d17/d25/d3e/l5e 0 2024-09-13T02:52:33.835 INFO:tasks.workunit.client.1.smithi142.stdout:0/241: dread d10/d23/f25 [0,4194304] 0 2024-09-13T02:52:33.835 INFO:tasks.workunit.client.1.smithi142.stdout:9/250: chown dd/l23 1986 1 2024-09-13T02:52:33.836 INFO:tasks.workunit.client.1.smithi142.stdout:2/132: write d1/ff [3647972,57787] 0 2024-09-13T02:52:33.838 INFO:tasks.workunit.client.1.smithi142.stdout:6/237: dread d1/d7/f3e [0,4194304] 0 2024-09-13T02:52:33.838 INFO:tasks.workunit.client.1.smithi142.stdout:1/262: truncate d12/d13/d20/d27/f30 312731 0 2024-09-13T02:52:33.840 INFO:tasks.workunit.client.1.smithi142.stdout:7/209: truncate d10/d13/d1d/f2c 841529 0 2024-09-13T02:52:33.841 INFO:tasks.workunit.client.1.smithi142.stdout:2/133: mkdir d1/d2c 0 2024-09-13T02:52:33.844 INFO:tasks.workunit.client.1.smithi142.stdout:9/251: rename dd/d47 to dd/d17/d5f 0 2024-09-13T02:52:33.844 INFO:tasks.workunit.client.1.smithi142.stdout:1/263: readlink d12/d13/d20/d27/l36 0 2024-09-13T02:52:33.844 INFO:tasks.workunit.client.1.smithi142.stdout:6/238: chown d1/dd/d16/c43 195 1 2024-09-13T02:52:33.845 INFO:tasks.workunit.client.1.smithi142.stdout:8/158: dwrite d0/d1/f3 [0,4194304] 0 2024-09-13T02:52:33.847 INFO:tasks.workunit.client.1.smithi142.stdout:5/202: dread d8/f1e [0,4194304] 0 2024-09-13T02:52:33.848 INFO:tasks.workunit.client.1.smithi142.stdout:3/206: dwrite d12/f2b [0,4194304] 0 2024-09-13T02:52:33.862 INFO:tasks.workunit.client.1.smithi142.stdout:0/242: unlink d10/d15/d1a/d1e/d42/l4a 0 2024-09-13T02:52:33.865 INFO:tasks.workunit.client.1.smithi142.stdout:9/252: dread dd/d17/d25/f33 [0,4194304] 0 2024-09-13T02:52:33.865 INFO:tasks.workunit.client.1.smithi142.stdout:9/253: stat l1 0 2024-09-13T02:52:33.866 INFO:tasks.workunit.client.1.smithi142.stdout:9/254: chown dd/d17/d25/f2d 47 1 2024-09-13T02:52:33.880 INFO:tasks.workunit.client.1.smithi142.stdout:4/195: sync 2024-09-13T02:52:33.893 INFO:tasks.workunit.client.1.smithi142.stdout:3/207: mkdir d12/d16/d25/d2e/d38 0 2024-09-13T02:52:33.894 INFO:tasks.workunit.client.1.smithi142.stdout:3/208: read d12/f2b [1390978,116877] 0 2024-09-13T02:52:33.894 INFO:tasks.workunit.client.1.smithi142.stdout:2/134: mkdir d1/d2d 0 2024-09-13T02:52:33.895 INFO:tasks.workunit.client.1.smithi142.stdout:7/210: mkdir d10/d13/d1d/d44 0 2024-09-13T02:52:33.895 INFO:tasks.workunit.client.1.smithi142.stdout:1/264: mknod d12/c58 0 2024-09-13T02:52:33.896 INFO:tasks.workunit.client.1.smithi142.stdout:1/265: truncate d12/d13/d20/d27/f37 1005834 0 2024-09-13T02:52:33.896 INFO:tasks.workunit.client.1.smithi142.stdout:6/239: symlink d1/dd/d16/d47/l55 0 2024-09-13T02:52:33.897 INFO:tasks.workunit.client.1.smithi142.stdout:6/240: write d1/f3d [980493,20384] 0 2024-09-13T02:52:33.898 INFO:tasks.workunit.client.1.smithi142.stdout:5/203: creat d8/d24/d3f/f40 x:0 0 0 2024-09-13T02:52:33.898 INFO:tasks.workunit.client.1.smithi142.stdout:9/255: mknod dd/d17/d5f/c60 0 2024-09-13T02:52:33.899 INFO:tasks.workunit.client.1.smithi142.stdout:5/204: chown d8/f1f 4241 1 2024-09-13T02:52:33.901 INFO:tasks.workunit.client.1.smithi142.stdout:2/135: unlink d1/de/d1f/d13/f14 0 2024-09-13T02:52:33.903 INFO:tasks.workunit.client.1.smithi142.stdout:7/211: read d10/f16 [966667,71868] 0 2024-09-13T02:52:33.903 INFO:tasks.workunit.client.1.smithi142.stdout:8/159: link d0/d6/c9 d0/d6/c33 0 2024-09-13T02:52:33.904 INFO:tasks.workunit.client.1.smithi142.stdout:8/160: dread - d0/d1/f17 zero size 2024-09-13T02:52:33.904 INFO:tasks.workunit.client.1.smithi142.stdout:1/266: rename f1 to d12/d13/d20/d27/d3c/f59 0 2024-09-13T02:52:33.905 INFO:tasks.workunit.client.1.smithi142.stdout:4/196: dwrite d0/d2b/d9/f11 [4194304,4194304] 0 2024-09-13T02:52:33.906 INFO:tasks.workunit.client.1.smithi142.stdout:8/161: fsync d0/d1/f17 0 2024-09-13T02:52:33.906 INFO:tasks.workunit.client.1.smithi142.stdout:9/256: mknod dd/d17/c61 0 2024-09-13T02:52:33.911 INFO:tasks.workunit.client.1.smithi142.stdout:2/136: fsync d1/de/d1f/f1a 0 2024-09-13T02:52:33.914 INFO:tasks.workunit.client.1.smithi142.stdout:9/257: dwrite dd/f10 [0,4194304] 0 2024-09-13T02:52:33.915 INFO:tasks.workunit.client.1.smithi142.stdout:7/212: rmdir d10/d13/d21 39 2024-09-13T02:52:33.916 INFO:tasks.workunit.client.1.smithi142.stdout:6/241: dwrite d1/dd/d16/d4e/d32/f40 [4194304,4194304] 0 2024-09-13T02:52:33.916 INFO:tasks.workunit.client.1.smithi142.stdout:7/213: write d10/d13/f3d [730200,27965] 0 2024-09-13T02:52:33.917 INFO:tasks.workunit.client.1.smithi142.stdout:6/242: readlink d1/dd/le 0 2024-09-13T02:52:33.921 INFO:tasks.workunit.client.1.smithi142.stdout:1/267: rename d12/d13/d20/f35 to d12/d13/f5a 0 2024-09-13T02:52:33.921 INFO:tasks.workunit.client.1.smithi142.stdout:0/243: truncate d10/d23/f25 2353245 0 2024-09-13T02:52:33.922 INFO:tasks.workunit.client.1.smithi142.stdout:4/197: mknod d0/d2b/d2d/d31/c3b 0 2024-09-13T02:52:33.924 INFO:tasks.workunit.client.1.smithi142.stdout:3/209: truncate d12/f19 714562 0 2024-09-13T02:52:33.925 INFO:tasks.workunit.client.1.smithi142.stdout:2/137: fdatasync d1/de/d1f/f1a 0 2024-09-13T02:52:33.926 INFO:tasks.workunit.client.1.smithi142.stdout:2/138: chown d1/de/d1f/d13 8138 1 2024-09-13T02:52:33.927 INFO:tasks.workunit.client.1.smithi142.stdout:7/214: write d10/d13/f20 [675129,85036] 0 2024-09-13T02:52:33.927 INFO:tasks.workunit.client.1.smithi142.stdout:2/139: write d1/de/f26 [99941,103221] 0 2024-09-13T02:52:33.927 INFO:tasks.workunit.client.1.smithi142.stdout:5/205: creat d8/d24/f41 x:0 0 0 2024-09-13T02:52:33.929 INFO:tasks.workunit.client.1.smithi142.stdout:9/258: rename dd/d17/f39 to dd/d17/d25/f62 0 2024-09-13T02:52:33.930 INFO:tasks.workunit.client.1.smithi142.stdout:9/259: stat dd/d17/d25/l31 0 2024-09-13T02:52:33.930 INFO:tasks.workunit.client.1.smithi142.stdout:0/244: rmdir d10/d15/d1a/d3a 39 2024-09-13T02:52:33.930 INFO:tasks.workunit.client.1.smithi142.stdout:9/260: fdatasync dd/f1a 0 2024-09-13T02:52:33.931 INFO:tasks.workunit.client.1.smithi142.stdout:3/210: read d12/f2b [1808337,69819] 0 2024-09-13T02:52:33.932 INFO:tasks.workunit.client.1.smithi142.stdout:6/243: creat d1/d7/d19/d52/f56 x:0 0 0 2024-09-13T02:52:33.933 INFO:tasks.workunit.client.1.smithi142.stdout:6/244: dread - d1/dd/f49 zero size 2024-09-13T02:52:33.934 INFO:tasks.workunit.client.1.smithi142.stdout:8/162: rename d0/d1/d8/df/l16 to d0/d1/d8/df/l34 0 2024-09-13T02:52:33.935 INFO:tasks.workunit.client.1.smithi142.stdout:4/198: getdents d0/d2b/d21/d35 0 2024-09-13T02:52:33.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/245: write d1/dd/f35 [1535852,64898] 0 2024-09-13T02:52:33.936 INFO:tasks.workunit.client.1.smithi142.stdout:5/206: mkdir d8/d24/d42 0 2024-09-13T02:52:33.940 INFO:tasks.workunit.client.1.smithi142.stdout:7/215: truncate d10/d13/f1e 1746984 0 2024-09-13T02:52:33.943 INFO:tasks.workunit.client.1.smithi142.stdout:9/261: dwrite dd/d17/d25/d3e/f5d [0,4194304] 0 2024-09-13T02:52:33.945 INFO:tasks.workunit.client.1.smithi142.stdout:7/216: write d10/d13/f3d [1789644,99373] 0 2024-09-13T02:52:33.947 INFO:tasks.workunit.client.1.smithi142.stdout:3/211: dread d12/d16/f24 [0,4194304] 0 2024-09-13T02:52:33.948 INFO:tasks.workunit.client.1.smithi142.stdout:6/246: mkdir d1/dd/d57 0 2024-09-13T02:52:33.952 INFO:tasks.workunit.client.1.smithi142.stdout:5/207: dwrite d8/f1f [4194304,4194304] 0 2024-09-13T02:52:33.953 INFO:tasks.workunit.client.1.smithi142.stdout:5/208: readlink d8/lf 0 2024-09-13T02:52:33.953 INFO:tasks.workunit.client.1.smithi142.stdout:7/217: mkdir d10/d13/d1d/d25/d45 0 2024-09-13T02:52:33.957 INFO:tasks.workunit.client.1.smithi142.stdout:0/245: getdents d10/d15/d1a/d3a 0 2024-09-13T02:52:33.958 INFO:tasks.workunit.client.1.smithi142.stdout:6/247: mknod d1/dd/d16/d47/c58 0 2024-09-13T02:52:33.960 INFO:tasks.workunit.client.1.smithi142.stdout:3/212: dwrite d12/d16/f17 [0,4194304] 0 2024-09-13T02:52:33.964 INFO:tasks.workunit.client.1.smithi142.stdout:7/218: mknod d10/d37/c46 0 2024-09-13T02:52:34.011 INFO:tasks.workunit.client.1.smithi142.stdout:9/262: rmdir dd/d17/d35/d4d 0 2024-09-13T02:52:34.018 INFO:tasks.workunit.client.1.smithi142.stdout:3/213: dwrite fe [0,4194304] 0 2024-09-13T02:52:34.018 INFO:tasks.workunit.client.1.smithi142.stdout:4/199: dwrite d0/d2b/d13/f1e [0,4194304] 0 2024-09-13T02:52:34.018 INFO:tasks.workunit.client.1.smithi142.stdout:8/163: dwrite d0/d1/fa [0,4194304] 0 2024-09-13T02:52:34.018 INFO:tasks.workunit.client.1.smithi142.stdout:0/246: truncate d10/d23/f2f 2070100 0 2024-09-13T02:52:34.019 INFO:tasks.workunit.client.1.smithi142.stdout:5/209: link d8/d24/c30 d8/d24/d26/c43 0 2024-09-13T02:52:34.019 INFO:tasks.workunit.client.1.smithi142.stdout:9/263: rmdir dd/d17/d35 39 2024-09-13T02:52:34.023 INFO:tasks.workunit.client.1.smithi142.stdout:4/200: chown d0/d2b/f38 45 1 2024-09-13T02:52:34.025 INFO:tasks.workunit.client.1.smithi142.stdout:5/210: chown d8/d24/f27 165535 1 2024-09-13T02:52:34.025 INFO:tasks.workunit.client.1.smithi142.stdout:4/201: read - d0/d2b/f38 zero size 2024-09-13T02:52:34.028 INFO:tasks.workunit.client.1.smithi142.stdout:5/211: fdatasync d8/d24/f27 0 2024-09-13T02:52:34.028 INFO:tasks.workunit.client.1.smithi142.stdout:4/202: stat d0/d2b/d21/d35 0 2024-09-13T02:52:34.044 INFO:tasks.workunit.client.1.smithi142.stdout:2/140: sync 2024-09-13T02:52:34.061 INFO:tasks.workunit.client.1.smithi142.stdout:0/247: mknod d10/d15/d30/c5f 0 2024-09-13T02:52:34.062 INFO:tasks.workunit.client.1.smithi142.stdout:0/248: dread - d10/d15/f46 zero size 2024-09-13T02:52:34.062 INFO:tasks.workunit.client.1.smithi142.stdout:0/249: stat d10/l12 0 2024-09-13T02:52:34.064 INFO:tasks.workunit.client.1.smithi142.stdout:9/264: unlink dd/f10 0 2024-09-13T02:52:34.066 INFO:tasks.workunit.client.1.smithi142.stdout:7/219: creat d10/f47 x:0 0 0 2024-09-13T02:52:34.067 INFO:tasks.workunit.client.1.smithi142.stdout:1/268: rename d12/d13/f5a to d12/d13/d1d/f5b 0 2024-09-13T02:52:34.069 INFO:tasks.workunit.client.1.smithi142.stdout:4/203: write d0/df/f1f [1410434,36760] 0 2024-09-13T02:52:34.070 INFO:tasks.workunit.client.1.smithi142.stdout:5/212: write d8/f19 [2261071,118765] 0 2024-09-13T02:52:34.070 INFO:tasks.workunit.client.1.smithi142.stdout:3/214: symlink d12/d16/l39 0 2024-09-13T02:52:34.070 INFO:tasks.workunit.client.1.smithi142.stdout:3/215: stat l6 0 2024-09-13T02:52:34.071 INFO:tasks.workunit.client.1.smithi142.stdout:0/250: unlink d10/d15/d36/l5d 0 2024-09-13T02:52:34.075 INFO:tasks.workunit.client.1.smithi142.stdout:3/216: dread d12/d16/f17 [0,4194304] 0 2024-09-13T02:52:34.076 INFO:tasks.workunit.client.1.smithi142.stdout:8/164: rename d0/d6/d23/d30 to d0/d1/d35 0 2024-09-13T02:52:34.080 INFO:tasks.workunit.client.1.smithi142.stdout:4/204: symlink d0/d2b/d13/l3c 0 2024-09-13T02:52:34.080 INFO:tasks.workunit.client.1.smithi142.stdout:6/248: sync 2024-09-13T02:52:34.081 INFO:tasks.workunit.client.1.smithi142.stdout:6/249: write d1/dd/f35 [198301,35921] 0 2024-09-13T02:52:34.082 INFO:tasks.workunit.client.1.smithi142.stdout:7/220: symlink d10/d13/d1d/d2b/d40/l48 0 2024-09-13T02:52:34.084 INFO:tasks.workunit.client.1.smithi142.stdout:7/221: chown d10/d13/d1d/d2b/d40 1349448 1 2024-09-13T02:52:34.084 INFO:tasks.workunit.client.1.smithi142.stdout:3/217: rmdir d12/d16/d25 39 2024-09-13T02:52:34.085 INFO:tasks.workunit.client.1.smithi142.stdout:3/218: chown d12/f2b 0 1 2024-09-13T02:52:34.085 INFO:tasks.workunit.client.1.smithi142.stdout:8/165: unlink d0/d1/f17 0 2024-09-13T02:52:34.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/219: chown d12/f2b 154823 1 2024-09-13T02:52:34.086 INFO:tasks.workunit.client.1.smithi142.stdout:0/251: dread d10/d15/d21/f3c [0,4194304] 0 2024-09-13T02:52:34.088 INFO:tasks.workunit.client.1.smithi142.stdout:5/213: truncate d8/fe 847230 0 2024-09-13T02:52:34.089 INFO:tasks.workunit.client.1.smithi142.stdout:5/214: dread - d8/f13 zero size 2024-09-13T02:52:34.090 INFO:tasks.workunit.client.1.smithi142.stdout:4/205: dread d0/df/f23 [0,4194304] 0 2024-09-13T02:52:34.090 INFO:tasks.workunit.client.1.smithi142.stdout:5/215: write d8/d24/d26/d2d/f2f [129337,14221] 0 2024-09-13T02:52:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:8/166: creat d0/d1/d8/f36 x:0 0 0 2024-09-13T02:52:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:2/141: link d1/de/l25 d1/l2e 0 2024-09-13T02:52:34.096 INFO:tasks.workunit.client.1.smithi142.stdout:4/206: dread d0/df/f29 [0,4194304] 0 2024-09-13T02:52:34.098 INFO:tasks.workunit.client.1.smithi142.stdout:9/265: link dd/d17/c2c dd/d17/d35/d41/c63 0 2024-09-13T02:52:34.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/207: write d0/df/f1f [319821,123848] 0 2024-09-13T02:52:34.100 INFO:tasks.workunit.client.1.smithi142.stdout:8/167: unlink d0/d6/l14 0 2024-09-13T02:52:34.101 INFO:tasks.workunit.client.1.smithi142.stdout:4/208: chown d0/d2b/d9 28256244 1 2024-09-13T02:52:34.101 INFO:tasks.workunit.client.1.smithi142.stdout:5/216: dwrite d8/d24/d26/d2d/f38 [0,4194304] 0 2024-09-13T02:52:34.108 INFO:tasks.workunit.client.1.smithi142.stdout:9/266: rename dd/d17/d35/d41/c52 to dd/d17/d25/c64 0 2024-09-13T02:52:34.109 INFO:tasks.workunit.client.1.smithi142.stdout:8/168: dwrite d0/d1/d8/f36 [0,4194304] 0 2024-09-13T02:52:34.110 INFO:tasks.workunit.client.1.smithi142.stdout:9/267: write dd/d17/d25/d3e/f56 [1037891,45662] 0 2024-09-13T02:52:34.113 INFO:tasks.workunit.client.1.smithi142.stdout:3/220: fsync d12/d16/d25/f26 0 2024-09-13T02:52:34.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/142: creat d1/f2f x:0 0 0 2024-09-13T02:52:34.116 INFO:tasks.workunit.client.1.smithi142.stdout:2/143: write d1/f5 [5311513,9391] 0 2024-09-13T02:52:34.119 INFO:tasks.workunit.client.1.smithi142.stdout:4/209: creat d0/d2b/d2d/d31/d32/f3d x:0 0 0 2024-09-13T02:52:34.122 INFO:tasks.workunit.client.1.smithi142.stdout:8/169: mkdir d0/d1/d35/d37 0 2024-09-13T02:52:34.126 INFO:tasks.workunit.client.1.smithi142.stdout:2/144: creat d1/d29/f30 x:0 0 0 2024-09-13T02:52:34.130 INFO:tasks.workunit.client.1.smithi142.stdout:4/210: dwrite d0/d2b/d2d/d31/d32/f3d [0,4194304] 0 2024-09-13T02:52:34.131 INFO:tasks.workunit.client.1.smithi142.stdout:3/221: mknod d12/d16/c3a 0 2024-09-13T02:52:34.133 INFO:tasks.workunit.client.1.smithi142.stdout:8/170: dwrite d0/d1/fa [0,4194304] 0 2024-09-13T02:52:34.136 INFO:tasks.workunit.client.1.smithi142.stdout:2/145: mkdir d1/de/d31 0 2024-09-13T02:52:34.136 INFO:tasks.workunit.client.1.smithi142.stdout:9/268: link dd/c32 dd/d17/d44/c65 0 2024-09-13T02:52:34.138 INFO:tasks.workunit.client.1.smithi142.stdout:4/211: mknod d0/df/c3e 0 2024-09-13T02:52:34.140 INFO:tasks.workunit.client.1.smithi142.stdout:4/212: write d0/d2b/d9/f11 [2054201,117419] 0 2024-09-13T02:52:34.141 INFO:tasks.workunit.client.1.smithi142.stdout:9/269: mknod dd/c66 0 2024-09-13T02:52:34.142 INFO:tasks.workunit.client.1.smithi142.stdout:8/171: dwrite d0/d6/dc/f2f [0,4194304] 0 2024-09-13T02:52:34.146 INFO:tasks.workunit.client.1.smithi142.stdout:2/146: symlink d1/d2d/l32 0 2024-09-13T02:52:34.148 INFO:tasks.workunit.client.1.smithi142.stdout:9/270: creat dd/d17/d4f/f67 x:0 0 0 2024-09-13T02:52:34.149 INFO:tasks.workunit.client.1.smithi142.stdout:4/213: symlink d0/d2b/d9/l3f 0 2024-09-13T02:52:34.151 INFO:tasks.workunit.client.1.smithi142.stdout:8/172: mknod d0/d6/dc/d2e/c38 0 2024-09-13T02:52:34.153 INFO:tasks.workunit.client.1.smithi142.stdout:9/271: truncate dd/d17/d25/f33 1080128 0 2024-09-13T02:52:34.155 INFO:tasks.workunit.client.1.smithi142.stdout:9/272: write dd/d17/d44/f4a [780798,15244] 0 2024-09-13T02:52:34.155 INFO:tasks.workunit.client.1.smithi142.stdout:9/273: chown dd/d17/d25/l3f 0 1 2024-09-13T02:52:34.156 INFO:tasks.workunit.client.1.smithi142.stdout:7/222: rmdir d10/d13/d1d 39 2024-09-13T02:52:34.157 INFO:tasks.workunit.client.1.smithi142.stdout:7/223: write fd [3065155,112030] 0 2024-09-13T02:52:34.158 INFO:tasks.workunit.client.1.smithi142.stdout:2/147: rename d1/f6 to d1/de/d1f/d13/f33 0 2024-09-13T02:52:34.158 INFO:tasks.workunit.client.1.smithi142.stdout:1/269: creat d12/d13/d20/f5c x:0 0 0 2024-09-13T02:52:34.162 INFO:tasks.workunit.client.1.smithi142.stdout:7/224: rmdir d10/d31 39 2024-09-13T02:52:34.165 INFO:tasks.workunit.client.1.smithi142.stdout:9/274: mkdir dd/d17/d68 0 2024-09-13T02:52:34.169 INFO:tasks.workunit.client.1.smithi142.stdout:7/225: mknod d10/d31/c49 0 2024-09-13T02:52:34.169 INFO:tasks.workunit.client.1.smithi142.stdout:7/226: readlink d10/l29 0 2024-09-13T02:52:34.170 INFO:tasks.workunit.client.1.smithi142.stdout:1/270: creat d12/d1b/f5d x:0 0 0 2024-09-13T02:52:34.171 INFO:tasks.workunit.client.1.smithi142.stdout:9/275: mkdir dd/d17/d69 0 2024-09-13T02:52:34.173 INFO:tasks.workunit.client.1.smithi142.stdout:9/276: stat dd/d17/c2c 0 2024-09-13T02:52:34.174 INFO:tasks.workunit.client.1.smithi142.stdout:1/271: fdatasync d12/d13/f17 0 2024-09-13T02:52:34.174 INFO:tasks.workunit.client.1.smithi142.stdout:0/252: dwrite d10/d15/d21/f3c [0,4194304] 0 2024-09-13T02:52:34.175 INFO:tasks.workunit.client.1.smithi142.stdout:6/250: mkdir d1/d59 0 2024-09-13T02:52:34.176 INFO:tasks.workunit.client.1.smithi142.stdout:7/227: mknod d10/d13/d1d/d44/c4a 0 2024-09-13T02:52:34.176 INFO:tasks.workunit.client.1.smithi142.stdout:0/253: dread - d10/d15/d36/f59 zero size 2024-09-13T02:52:34.177 INFO:tasks.workunit.client.1.smithi142.stdout:6/251: chown d1/dd/d16/d47 285733726 1 2024-09-13T02:52:34.178 INFO:tasks.workunit.client.1.smithi142.stdout:7/228: unlink d10/c14 0 2024-09-13T02:52:34.184 INFO:tasks.workunit.client.1.smithi142.stdout:0/254: rename f9 to d10/d15/d45/f60 0 2024-09-13T02:52:34.185 INFO:tasks.workunit.client.1.smithi142.stdout:1/272: getdents d12/d13 0 2024-09-13T02:52:34.189 INFO:tasks.workunit.client.1.smithi142.stdout:4/214: rmdir d0/d2b/d2d 39 2024-09-13T02:52:34.190 INFO:tasks.workunit.client.1.smithi142.stdout:4/215: write d0/d2b/f38 [840489,125617] 0 2024-09-13T02:52:34.193 INFO:tasks.workunit.client.1.smithi142.stdout:0/255: creat d10/d15/d1a/d1e/d42/d4b/f61 x:0 0 0 2024-09-13T02:52:34.193 INFO:tasks.workunit.client.1.smithi142.stdout:7/229: link d10/d13/d1d/d25/d2e/l33 d10/d13/d1d/d25/d45/l4b 0 2024-09-13T02:52:34.194 INFO:tasks.workunit.client.1.smithi142.stdout:7/230: chown d10/d34/f38 1 1 2024-09-13T02:52:34.195 INFO:tasks.workunit.client.1.smithi142.stdout:6/252: rename d1/dd/d16/d47/l55 to d1/d7/d19/l5a 0 2024-09-13T02:52:34.196 INFO:tasks.workunit.client.1.smithi142.stdout:6/253: chown d1/dd/d16/d4e/c3f 212152377 1 2024-09-13T02:52:34.197 INFO:tasks.workunit.client.1.smithi142.stdout:0/256: rmdir d10/d15/d36 39 2024-09-13T02:52:34.197 INFO:tasks.workunit.client.1.smithi142.stdout:6/254: fsync d1/dd/f29 0 2024-09-13T02:52:34.197 INFO:tasks.workunit.client.1.smithi142.stdout:4/216: dwrite d0/d2b/d9/f2f [0,4194304] 0 2024-09-13T02:52:34.205 INFO:tasks.workunit.client.1.smithi142.stdout:4/217: symlink d0/d2b/d13/l40 0 2024-09-13T02:52:34.206 INFO:tasks.workunit.client.1.smithi142.stdout:8/173: rmdir d0/d6/dc 39 2024-09-13T02:52:34.207 INFO:tasks.workunit.client.1.smithi142.stdout:8/174: write d0/d1/d8/f29 [953199,49801] 0 2024-09-13T02:52:34.209 INFO:tasks.workunit.client.1.smithi142.stdout:2/148: fsync d1/de/f17 0 2024-09-13T02:52:34.210 INFO:tasks.workunit.client.1.smithi142.stdout:4/218: dread d0/df/f1f [0,4194304] 0 2024-09-13T02:52:34.211 INFO:tasks.workunit.client.1.smithi142.stdout:4/219: chown d0/d2b/d9/f11 4897419 1 2024-09-13T02:52:34.212 INFO:tasks.workunit.client.1.smithi142.stdout:8/175: mknod d0/d1/d35/d37/c39 0 2024-09-13T02:52:34.213 INFO:tasks.workunit.client.1.smithi142.stdout:2/149: rmdir d1/de 39 2024-09-13T02:52:34.214 INFO:tasks.workunit.client.1.smithi142.stdout:2/150: stat d1/d29/f30 0 2024-09-13T02:52:34.216 INFO:tasks.workunit.client.1.smithi142.stdout:2/151: read - d1/f1e zero size 2024-09-13T02:52:34.216 INFO:tasks.workunit.client.1.smithi142.stdout:8/176: symlink d0/d1/l3a 0 2024-09-13T02:52:34.217 INFO:tasks.workunit.client.1.smithi142.stdout:5/217: dwrite f0 [0,4194304] 0 2024-09-13T02:52:34.217 INFO:tasks.workunit.client.1.smithi142.stdout:5/218: readlink d8/d24/d26/l3b 0 2024-09-13T02:52:34.218 INFO:tasks.workunit.client.1.smithi142.stdout:5/219: read d8/d24/f3c [1673950,96781] 0 2024-09-13T02:52:34.219 INFO:tasks.workunit.client.1.smithi142.stdout:2/152: chown d1/de/d31 173 1 2024-09-13T02:52:34.220 INFO:tasks.workunit.client.1.smithi142.stdout:2/153: write d1/ff [254002,67328] 0 2024-09-13T02:52:34.220 INFO:tasks.workunit.client.1.smithi142.stdout:4/220: creat d0/d2b/f41 x:0 0 0 2024-09-13T02:52:34.223 INFO:tasks.workunit.client.1.smithi142.stdout:6/255: dread d1/dd/d16/f1c [0,4194304] 0 2024-09-13T02:52:34.223 INFO:tasks.workunit.client.1.smithi142.stdout:8/177: truncate d0/d6/dc/f18 145916 0 2024-09-13T02:52:34.223 INFO:tasks.workunit.client.1.smithi142.stdout:6/256: dread - d1/dd/d16/d4d/f4f zero size 2024-09-13T02:52:34.224 INFO:tasks.workunit.client.1.smithi142.stdout:8/178: write d0/d1/f27 [68309,79522] 0 2024-09-13T02:52:34.224 INFO:tasks.workunit.client.1.smithi142.stdout:6/257: chown d1/d7/cb 0 1 2024-09-13T02:52:34.225 INFO:tasks.workunit.client.1.smithi142.stdout:5/220: rename f3 to d8/f44 0 2024-09-13T02:52:34.228 INFO:tasks.workunit.client.1.smithi142.stdout:8/179: dread d0/d1/d8/f1d [0,4194304] 0 2024-09-13T02:52:34.229 INFO:tasks.workunit.client.1.smithi142.stdout:8/180: readlink d0/d1/d8/df/l15 0 2024-09-13T02:52:34.234 INFO:tasks.workunit.client.1.smithi142.stdout:5/221: mkdir d8/d24/d26/d45 0 2024-09-13T02:52:34.237 INFO:tasks.workunit.client.1.smithi142.stdout:2/154: write d1/fb [2981319,11821] 0 2024-09-13T02:52:34.239 INFO:tasks.workunit.client.1.smithi142.stdout:5/222: fdatasync d8/f15 0 2024-09-13T02:52:34.239 INFO:tasks.workunit.client.1.smithi142.stdout:1/273: dwrite d12/d1b/f43 [0,4194304] 0 2024-09-13T02:52:34.241 INFO:tasks.workunit.client.1.smithi142.stdout:8/181: fsync d0/d6/f2a 0 2024-09-13T02:52:34.241 INFO:tasks.workunit.client.1.smithi142.stdout:1/274: read - d12/d13/f3f zero size 2024-09-13T02:52:34.243 INFO:tasks.workunit.client.1.smithi142.stdout:8/182: chown d0/d1/d35/d37 20 1 2024-09-13T02:52:34.243 INFO:tasks.workunit.client.1.smithi142.stdout:7/231: dwrite d10/f16 [0,4194304] 0 2024-09-13T02:52:34.244 INFO:tasks.workunit.client.1.smithi142.stdout:2/155: chown d1/fc 93662 1 2024-09-13T02:52:34.245 INFO:tasks.workunit.client.1.smithi142.stdout:5/223: write d8/f1b [5011619,88648] 0 2024-09-13T02:52:34.246 INFO:tasks.workunit.client.1.smithi142.stdout:1/275: write d12/d13/d20/f38 [778730,37922] 0 2024-09-13T02:52:34.247 INFO:tasks.workunit.client.1.smithi142.stdout:7/232: write d10/d13/f1c [1249267,107888] 0 2024-09-13T02:52:34.248 INFO:tasks.workunit.client.1.smithi142.stdout:6/258: getdents d1/dd/d16/d4e/d32 0 2024-09-13T02:52:34.250 INFO:tasks.workunit.client.1.smithi142.stdout:7/233: write d10/f16 [2416680,127466] 0 2024-09-13T02:52:34.254 INFO:tasks.workunit.client.1.smithi142.stdout:4/221: dread d0/d2b/d13/f1a [0,4194304] 0 2024-09-13T02:52:34.255 INFO:tasks.workunit.client.1.smithi142.stdout:5/224: unlink d8/d24/f27 0 2024-09-13T02:52:34.257 INFO:tasks.workunit.client.1.smithi142.stdout:4/222: write d0/d2b/f38 [1247430,76450] 0 2024-09-13T02:52:34.259 INFO:tasks.workunit.client.1.smithi142.stdout:5/225: truncate d8/d24/f3d 4539296 0 2024-09-13T02:52:34.260 INFO:tasks.workunit.client.1.smithi142.stdout:7/234: dread d10/f16 [0,4194304] 0 2024-09-13T02:52:34.261 INFO:tasks.workunit.client.1.smithi142.stdout:2/156: creat d1/d29/d2b/f34 x:0 0 0 2024-09-13T02:52:34.261 INFO:tasks.workunit.client.1.smithi142.stdout:6/259: dread d1/dd/d16/d4e/d32/f3b [0,4194304] 0 2024-09-13T02:52:34.263 INFO:tasks.workunit.client.1.smithi142.stdout:5/226: symlink d8/d24/d26/d2d/l46 0 2024-09-13T02:52:34.265 INFO:tasks.workunit.client.1.smithi142.stdout:6/260: write d1/dd/d16/d4d/f4f [750997,91878] 0 2024-09-13T02:52:34.266 INFO:tasks.workunit.client.1.smithi142.stdout:7/235: symlink d10/l4c 0 2024-09-13T02:52:34.266 INFO:tasks.workunit.client.1.smithi142.stdout:5/227: mkdir d8/d47 0 2024-09-13T02:52:34.268 INFO:tasks.workunit.client.1.smithi142.stdout:6/261: fdatasync d1/d7/f50 0 2024-09-13T02:52:34.268 INFO:tasks.workunit.client.1.smithi142.stdout:8/183: dread d0/d6/dc/fe [0,4194304] 0 2024-09-13T02:52:34.271 INFO:tasks.workunit.client.1.smithi142.stdout:7/236: mknod d10/c4d 0 2024-09-13T02:52:34.271 INFO:tasks.workunit.client.1.smithi142.stdout:8/184: symlink d0/l3b 0 2024-09-13T02:52:34.272 INFO:tasks.workunit.client.1.smithi142.stdout:7/237: fdatasync d10/f17 0 2024-09-13T02:52:34.272 INFO:tasks.workunit.client.1.smithi142.stdout:2/157: dread d1/de/d1f/d13/f33 [0,4194304] 0 2024-09-13T02:52:34.273 INFO:tasks.workunit.client.1.smithi142.stdout:4/223: dwrite d0/f14 [0,4194304] 0 2024-09-13T02:52:34.274 INFO:tasks.workunit.client.1.smithi142.stdout:1/276: dread d12/d13/f16 [0,4194304] 0 2024-09-13T02:52:34.274 INFO:tasks.workunit.client.1.smithi142.stdout:6/262: symlink d1/dd/d53/l5b 0 2024-09-13T02:52:34.276 INFO:tasks.workunit.client.1.smithi142.stdout:7/238: creat d10/d31/f4e x:0 0 0 2024-09-13T02:52:34.277 INFO:tasks.workunit.client.1.smithi142.stdout:4/224: write d0/d2b/d13/f16 [2821142,22623] 0 2024-09-13T02:52:34.298 INFO:tasks.workunit.client.1.smithi142.stdout:3/222: sync 2024-09-13T02:52:34.312 INFO:tasks.workunit.client.1.smithi142.stdout:6/263: symlink d1/dd/d53/l5c 0 2024-09-13T02:52:34.312 INFO:tasks.workunit.client.1.smithi142.stdout:1/277: write d12/f4d [427219,72193] 0 2024-09-13T02:52:34.313 INFO:tasks.workunit.client.1.smithi142.stdout:7/239: creat d10/d13/d1d/d25/d2e/f4f x:0 0 0 2024-09-13T02:52:34.314 INFO:tasks.workunit.client.1.smithi142.stdout:3/223: fdatasync d12/d16/d25/d2e/f2f 0 2024-09-13T02:52:34.314 INFO:tasks.workunit.client.1.smithi142.stdout:2/158: creat d1/f35 x:0 0 0 2024-09-13T02:52:34.315 INFO:tasks.workunit.client.1.smithi142.stdout:4/225: chown d0/d2b/d2d/d31 468 1 2024-09-13T02:52:34.316 INFO:tasks.workunit.client.1.smithi142.stdout:6/264: chown d1/d7/d19/l5a 1745 1 2024-09-13T02:52:34.316 INFO:tasks.workunit.client.1.smithi142.stdout:7/240: read d10/d13/d1d/f23 [7586431,514] 0 2024-09-13T02:52:34.318 INFO:tasks.workunit.client.1.smithi142.stdout:2/159: fdatasync d1/de/f10 0 2024-09-13T02:52:34.318 INFO:tasks.workunit.client.1.smithi142.stdout:1/278: creat d12/d13/d20/f5e x:0 0 0 2024-09-13T02:52:34.319 INFO:tasks.workunit.client.1.smithi142.stdout:4/226: unlink d0/d2b/d2d/d31/c37 0 2024-09-13T02:52:34.320 INFO:tasks.workunit.client.1.smithi142.stdout:5/228: dread d8/f44 [0,4194304] 0 2024-09-13T02:52:34.321 INFO:tasks.workunit.client.1.smithi142.stdout:6/265: mknod d1/d7/d19/c5d 0 2024-09-13T02:52:34.321 INFO:tasks.workunit.client.1.smithi142.stdout:4/227: stat d0/d2b/d9 0 2024-09-13T02:52:34.322 INFO:tasks.workunit.client.1.smithi142.stdout:7/241: symlink d10/d37/d39/l50 0 2024-09-13T02:52:34.323 INFO:tasks.workunit.client.1.smithi142.stdout:2/160: truncate d1/de/d1f/d13/f2a 131798 0 2024-09-13T02:52:34.324 INFO:tasks.workunit.client.1.smithi142.stdout:3/224: dwrite d12/d16/f21 [0,4194304] 0 2024-09-13T02:52:34.324 INFO:tasks.workunit.client.1.smithi142.stdout:1/279: symlink d12/d13/d45/l5f 0 2024-09-13T02:52:34.324 INFO:tasks.workunit.client.1.smithi142.stdout:7/242: truncate fd 3786580 0 2024-09-13T02:52:34.324 INFO:tasks.workunit.client.1.smithi142.stdout:5/229: write d8/f1e [1894209,89998] 0 2024-09-13T02:52:34.326 INFO:tasks.workunit.client.1.smithi142.stdout:6/266: mknod d1/dd/d16/d4d/c5e 0 2024-09-13T02:52:34.328 INFO:tasks.workunit.client.1.smithi142.stdout:4/228: symlink d0/l42 0 2024-09-13T02:52:34.328 INFO:tasks.workunit.client.1.smithi142.stdout:5/230: dread - d8/d24/d3f/f40 zero size 2024-09-13T02:52:34.328 INFO:tasks.workunit.client.1.smithi142.stdout:3/225: mkdir d12/d16/d25/d3b 0 2024-09-13T02:52:34.329 INFO:tasks.workunit.client.1.smithi142.stdout:1/280: creat d12/d13/d45/f60 x:0 0 0 2024-09-13T02:52:34.330 INFO:tasks.workunit.client.1.smithi142.stdout:7/243: mknod d10/d13/d1d/d44/c51 0 2024-09-13T02:52:34.331 INFO:tasks.workunit.client.1.smithi142.stdout:6/267: write d1/d7/d19/f2f [6002402,24958] 0 2024-09-13T02:52:34.332 INFO:tasks.workunit.client.1.smithi142.stdout:1/281: read - d12/d1b/f46 zero size 2024-09-13T02:52:34.333 INFO:tasks.workunit.client.1.smithi142.stdout:4/229: write d0/d2b/d2d/d31/d32/f3d [1027773,1248] 0 2024-09-13T02:52:34.335 INFO:tasks.workunit.client.1.smithi142.stdout:7/244: chown d10/d13/d1d/f36 67798 1 2024-09-13T02:52:34.336 INFO:tasks.workunit.client.1.smithi142.stdout:5/231: symlink d8/d24/d26/d2d/l48 0 2024-09-13T02:52:34.337 INFO:tasks.workunit.client.1.smithi142.stdout:2/161: dwrite d1/ff [0,4194304] 0 2024-09-13T02:52:34.338 INFO:tasks.workunit.client.1.smithi142.stdout:4/230: mkdir d0/d2b/d2d/d31/d43 0 2024-09-13T02:52:34.340 INFO:tasks.workunit.client.1.smithi142.stdout:6/268: write d1/dd/d16/f2c [5241872,6988] 0 2024-09-13T02:52:34.343 INFO:tasks.workunit.client.1.smithi142.stdout:4/231: chown d0/d2b/d21/c27 358349 1 2024-09-13T02:52:34.344 INFO:tasks.workunit.client.1.smithi142.stdout:2/162: chown d1/de/d1f/d13/f33 1996 1 2024-09-13T02:52:34.345 INFO:tasks.workunit.client.1.smithi142.stdout:1/282: rename d12/d13/f16 to d12/d13/d1d/f61 0 2024-09-13T02:52:34.347 INFO:tasks.workunit.client.1.smithi142.stdout:5/232: getdents d8/d24/d42 0 2024-09-13T02:52:34.347 INFO:tasks.workunit.client.1.smithi142.stdout:3/226: dwrite d12/f22 [4194304,4194304] 0 2024-09-13T02:52:34.350 INFO:tasks.workunit.client.1.smithi142.stdout:6/269: mkdir d1/d7/d5f 0 2024-09-13T02:52:34.351 INFO:tasks.workunit.client.1.smithi142.stdout:7/245: dwrite ff [0,4194304] 0 2024-09-13T02:52:34.352 INFO:tasks.workunit.client.1.smithi142.stdout:4/232: rename d0/d2b/d13/l40 to d0/d2b/d2d/d31/d32/l44 0 2024-09-13T02:52:34.353 INFO:tasks.workunit.client.1.smithi142.stdout:7/246: readlink d10/l29 0 2024-09-13T02:52:34.356 INFO:tasks.workunit.client.1.smithi142.stdout:4/233: write d0/d2b/d9/f22 [2839842,3429] 0 2024-09-13T02:52:34.359 INFO:tasks.workunit.client.1.smithi142.stdout:5/233: rmdir d8/d24/d42 0 2024-09-13T02:52:34.360 INFO:tasks.workunit.client.1.smithi142.stdout:4/234: symlink d0/d2b/d21/l45 0 2024-09-13T02:52:34.361 INFO:tasks.workunit.client.1.smithi142.stdout:1/283: write d12/d13/d1d/f5b [3549170,55077] 0 2024-09-13T02:52:34.361 INFO:tasks.workunit.client.1.smithi142.stdout:3/227: dread d12/d16/f20 [4194304,4194304] 0 2024-09-13T02:52:34.363 INFO:tasks.workunit.client.1.smithi142.stdout:1/284: dread - d12/f3d zero size 2024-09-13T02:52:34.366 INFO:tasks.workunit.client.1.smithi142.stdout:4/235: creat d0/d2b/d2d/d31/d43/f46 x:0 0 0 2024-09-13T02:52:34.368 INFO:tasks.workunit.client.1.smithi142.stdout:7/247: dwrite d10/f16 [4194304,4194304] 0 2024-09-13T02:52:34.371 INFO:tasks.workunit.client.1.smithi142.stdout:5/234: dwrite d8/d24/d26/d2d/f38 [0,4194304] 0 2024-09-13T02:52:34.371 INFO:tasks.workunit.client.1.smithi142.stdout:3/228: read d12/f19 [668478,39522] 0 2024-09-13T02:52:34.371 INFO:tasks.workunit.client.1.smithi142.stdout:1/285: rename d12/d13/d1d/f21 to d12/d13/d20/d27/f62 0 2024-09-13T02:52:34.375 INFO:tasks.workunit.client.1.smithi142.stdout:1/286: write d12/d13/d20/f38 [4676409,122277] 0 2024-09-13T02:52:34.381 INFO:tasks.workunit.client.1.smithi142.stdout:3/229: dwrite d12/d16/f21 [0,4194304] 0 2024-09-13T02:52:34.382 INFO:tasks.workunit.client.1.smithi142.stdout:5/235: mkdir d8/d24/d26/d49 0 2024-09-13T02:52:34.383 INFO:tasks.workunit.client.1.smithi142.stdout:5/236: write d8/f1e [3317413,61489] 0 2024-09-13T02:52:34.384 INFO:tasks.workunit.client.1.smithi142.stdout:1/287: creat d12/d13/d20/d27/d3c/d53/f63 x:0 0 0 2024-09-13T02:52:34.385 INFO:tasks.workunit.client.1.smithi142.stdout:4/236: fdatasync d0/d2b/d13/f1e 0 2024-09-13T02:52:34.392 INFO:tasks.workunit.client.1.smithi142.stdout:5/237: mkdir d8/d24/d3f/d4a 0 2024-09-13T02:52:34.392 INFO:tasks.workunit.client.1.smithi142.stdout:1/288: truncate d12/d13/d45/f60 104964 0 2024-09-13T02:52:34.395 INFO:tasks.workunit.client.1.smithi142.stdout:7/248: rename d10/d13/d22/l27 to d10/l52 0 2024-09-13T02:52:34.396 INFO:tasks.workunit.client.1.smithi142.stdout:3/230: mkdir d12/d16/d3c 0 2024-09-13T02:52:34.398 INFO:tasks.workunit.client.1.smithi142.stdout:1/289: creat d12/d39/d55/f64 x:0 0 0 2024-09-13T02:52:34.430 INFO:tasks.workunit.client.1.smithi142.stdout:9/277: sync 2024-09-13T02:52:34.430 INFO:tasks.workunit.client.1.smithi142.stdout:0/257: sync 2024-09-13T02:52:34.443 INFO:tasks.workunit.client.1.smithi142.stdout:4/237: symlink d0/d2b/d9/l47 0 2024-09-13T02:52:34.443 INFO:tasks.workunit.client.1.smithi142.stdout:7/249: mkdir d10/d13/d1d/d2b/d53 0 2024-09-13T02:52:34.444 INFO:tasks.workunit.client.1.smithi142.stdout:5/238: mkdir d8/d24/d3f/d4a/d4b 0 2024-09-13T02:52:34.445 INFO:tasks.workunit.client.1.smithi142.stdout:3/231: symlink d12/d16/d3c/l3d 0 2024-09-13T02:52:34.446 INFO:tasks.workunit.client.1.smithi142.stdout:3/232: fsync d12/d16/f29 0 2024-09-13T02:52:34.446 INFO:tasks.workunit.client.1.smithi142.stdout:0/258: mkdir d10/d15/d1a/d62 0 2024-09-13T02:52:34.447 INFO:tasks.workunit.client.1.smithi142.stdout:5/239: mknod d8/d24/d26/c4c 0 2024-09-13T02:52:34.448 INFO:tasks.workunit.client.1.smithi142.stdout:0/259: write d10/d15/d21/d51/d35/f55 [734690,73234] 0 2024-09-13T02:52:34.448 INFO:tasks.workunit.client.1.smithi142.stdout:5/240: readlink d8/lf 0 2024-09-13T02:52:34.448 INFO:tasks.workunit.client.1.smithi142.stdout:7/250: mknod d10/d13/d1d/d2b/d40/c54 0 2024-09-13T02:52:34.449 INFO:tasks.workunit.client.1.smithi142.stdout:5/241: stat d8/fd 0 2024-09-13T02:52:34.449 INFO:tasks.workunit.client.1.smithi142.stdout:9/278: link f5 dd/d17/d25/f6a 0 2024-09-13T02:52:34.450 INFO:tasks.workunit.client.1.smithi142.stdout:1/290: creat d12/f65 x:0 0 0 2024-09-13T02:52:34.451 INFO:tasks.workunit.client.1.smithi142.stdout:0/260: symlink d10/d15/d30/l63 0 2024-09-13T02:52:34.454 INFO:tasks.workunit.client.1.smithi142.stdout:0/261: stat d10/d15/d1a/d3a 0 2024-09-13T02:52:34.455 INFO:tasks.workunit.client.1.smithi142.stdout:3/233: creat d12/d16/f3e x:0 0 0 2024-09-13T02:52:34.455 INFO:tasks.workunit.client.1.smithi142.stdout:9/279: write dd/d17/d25/f29 [5034402,75228] 0 2024-09-13T02:52:34.455 INFO:tasks.workunit.client.1.smithi142.stdout:4/238: dwrite d0/d2b/d13/f1a [0,4194304] 0 2024-09-13T02:52:34.456 INFO:tasks.workunit.client.1.smithi142.stdout:5/242: dread d8/d24/d26/d2d/f2f [0,4194304] 0 2024-09-13T02:52:34.458 INFO:tasks.workunit.client.1.smithi142.stdout:7/251: rename d10/d13/d1d/d25/d2e to d10/d13/d1d/d2b/d55 0 2024-09-13T02:52:34.459 INFO:tasks.workunit.client.1.smithi142.stdout:4/239: write d0/d2b/d13/f1e [717237,87919] 0 2024-09-13T02:52:34.460 INFO:tasks.workunit.client.1.smithi142.stdout:9/280: creat dd/d17/d4f/f6b x:0 0 0 2024-09-13T02:52:34.461 INFO:tasks.workunit.client.1.smithi142.stdout:0/262: read d10/d15/d45/f60 [3010591,24323] 0 2024-09-13T02:52:34.462 INFO:tasks.workunit.client.1.smithi142.stdout:9/281: dread - dd/d17/f28 zero size 2024-09-13T02:52:34.463 INFO:tasks.workunit.client.1.smithi142.stdout:1/291: dwrite d12/d39/d55/f44 [0,4194304] 0 2024-09-13T02:52:34.465 INFO:tasks.workunit.client.1.smithi142.stdout:9/282: dread - dd/d17/d44/f5c zero size 2024-09-13T02:52:34.466 INFO:tasks.workunit.client.1.smithi142.stdout:7/252: fsync d10/d13/d1d/f23 0 2024-09-13T02:52:34.467 INFO:tasks.workunit.client.1.smithi142.stdout:4/240: mkdir d0/d2b/d2d/d31/d43/d48 0 2024-09-13T02:52:34.471 INFO:tasks.workunit.client.1.smithi142.stdout:7/253: write d10/d31/f4e [677763,47634] 0 2024-09-13T02:52:34.471 INFO:tasks.workunit.client.1.smithi142.stdout:4/241: dread - d0/d2b/d2d/d31/d43/f46 zero size 2024-09-13T02:52:34.472 INFO:tasks.workunit.client.1.smithi142.stdout:5/243: dread d8/d24/f3c [0,4194304] 0 2024-09-13T02:52:34.475 INFO:tasks.workunit.client.1.smithi142.stdout:0/263: dwrite fd [0,4194304] 0 2024-09-13T02:52:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:1/292: rename d12/d39 to d12/d13/d20/d66 0 2024-09-13T02:52:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:0/264: fsync d10/f13 0 2024-09-13T02:52:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:4/242: symlink d0/df/l49 0 2024-09-13T02:52:34.478 INFO:tasks.workunit.client.1.smithi142.stdout:1/293: chown d12/d1b/f5d 6896 1 2024-09-13T02:52:34.479 INFO:tasks.workunit.client.1.smithi142.stdout:4/243: fdatasync d0/d2b/d13/f1e 0 2024-09-13T02:52:34.480 INFO:tasks.workunit.client.1.smithi142.stdout:7/254: rename d10/d37 to d10/d13/d1d/d2b/d56 0 2024-09-13T02:52:34.482 INFO:tasks.workunit.client.1.smithi142.stdout:4/244: fsync d0/d2b/d21/f2a 0 2024-09-13T02:52:34.482 INFO:tasks.workunit.client.1.smithi142.stdout:9/283: truncate f3 125429 0 2024-09-13T02:52:34.483 INFO:tasks.workunit.client.1.smithi142.stdout:1/294: creat d12/d13/d20/d27/d3c/f67 x:0 0 0 2024-09-13T02:52:34.485 INFO:tasks.workunit.client.1.smithi142.stdout:5/244: dwrite d8/d24/f3e [0,4194304] 0 2024-09-13T02:52:34.489 INFO:tasks.workunit.client.1.smithi142.stdout:0/265: dwrite d10/d15/d21/d51/f54 [0,4194304] 0 2024-09-13T02:52:34.490 INFO:tasks.workunit.client.1.smithi142.stdout:9/284: symlink dd/d17/l6c 0 2024-09-13T02:52:34.494 INFO:tasks.workunit.client.1.smithi142.stdout:1/295: truncate d12/d13/d20/d27/f37 1741826 0 2024-09-13T02:52:34.495 INFO:tasks.workunit.client.1.smithi142.stdout:5/245: dread d8/d24/d26/d2d/f2f [0,4194304] 0 2024-09-13T02:52:34.496 INFO:tasks.workunit.client.1.smithi142.stdout:4/245: truncate d0/d2b/d13/f16 3753976 0 2024-09-13T02:52:34.501 INFO:tasks.workunit.client.1.smithi142.stdout:7/255: dwrite d10/d13/d1d/d2b/d55/f3c [0,4194304] 0 2024-09-13T02:52:34.502 INFO:tasks.workunit.client.1.smithi142.stdout:7/256: fdatasync d10/f16 0 2024-09-13T02:52:34.504 INFO:tasks.workunit.client.1.smithi142.stdout:1/296: mknod d12/d13/d1d/d26/c68 0 2024-09-13T02:52:34.504 INFO:tasks.workunit.client.1.smithi142.stdout:7/257: dread - d10/d34/f38 zero size 2024-09-13T02:52:34.504 INFO:tasks.workunit.client.1.smithi142.stdout:5/246: mkdir d8/d24/d4d 0 2024-09-13T02:52:34.504 INFO:tasks.workunit.client.1.smithi142.stdout:4/246: symlink d0/d2b/d2d/d31/d32/l4a 0 2024-09-13T02:52:34.505 INFO:tasks.workunit.client.1.smithi142.stdout:9/285: link l2 dd/d17/d69/l6d 0 2024-09-13T02:52:34.508 INFO:tasks.workunit.client.1.smithi142.stdout:7/258: unlink d10/d13/l19 0 2024-09-13T02:52:34.511 INFO:tasks.workunit.client.1.smithi142.stdout:1/297: dread d12/d13/d20/d27/d3c/d53/f54 [4194304,4194304] 0 2024-09-13T02:52:34.511 INFO:tasks.workunit.client.1.smithi142.stdout:0/266: link d10/d15/l1b d10/d15/l64 0 2024-09-13T02:52:34.512 INFO:tasks.workunit.client.1.smithi142.stdout:7/259: rmdir d10/d13/d22 39 2024-09-13T02:52:34.515 INFO:tasks.workunit.client.1.smithi142.stdout:1/298: creat d12/d13/d20/d66/f69 x:0 0 0 2024-09-13T02:52:34.516 INFO:tasks.workunit.client.1.smithi142.stdout:7/260: unlink d10/d13/c1a 0 2024-09-13T02:52:34.517 INFO:tasks.workunit.client.1.smithi142.stdout:4/247: mknod d0/d2b/d2d/d31/d43/d48/c4b 0 2024-09-13T02:52:34.518 INFO:tasks.workunit.client.1.smithi142.stdout:1/299: write d12/d13/d1d/f61 [4544581,83902] 0 2024-09-13T02:52:34.518 INFO:tasks.workunit.client.1.smithi142.stdout:1/300: readlink l9 0 2024-09-13T02:52:34.519 INFO:tasks.workunit.client.1.smithi142.stdout:1/301: chown d12/d1b 8016337 1 2024-09-13T02:52:34.520 INFO:tasks.workunit.client.1.smithi142.stdout:0/267: getdents d10 0 2024-09-13T02:52:34.524 INFO:tasks.workunit.client.1.smithi142.stdout:1/302: creat d12/d13/d1d/d26/f6a x:0 0 0 2024-09-13T02:52:34.526 INFO:tasks.workunit.client.1.smithi142.stdout:1/303: unlink d12/f3d 0 2024-09-13T02:52:34.526 INFO:tasks.workunit.client.1.smithi142.stdout:0/268: dread d10/d23/f25 [0,4194304] 0 2024-09-13T02:52:34.531 INFO:tasks.workunit.client.1.smithi142.stdout:1/304: creat d12/d13/f6b x:0 0 0 2024-09-13T02:52:34.531 INFO:tasks.workunit.client.1.smithi142.stdout:0/269: creat d10/d15/d1a/f65 x:0 0 0 2024-09-13T02:52:34.533 INFO:tasks.workunit.client.1.smithi142.stdout:9/286: write dd/f1b [1465851,35215] 0 2024-09-13T02:52:34.535 INFO:tasks.workunit.client.1.smithi142.stdout:5/247: truncate d8/d24/d26/d2d/f38 818401 0 2024-09-13T02:52:34.536 INFO:tasks.workunit.client.1.smithi142.stdout:9/287: mknod dd/d17/d25/c6e 0 2024-09-13T02:52:34.537 INFO:tasks.workunit.client.1.smithi142.stdout:5/248: fdatasync d8/d24/d26/f31 0 2024-09-13T02:52:34.538 INFO:tasks.workunit.client.1.smithi142.stdout:1/305: dwrite d12/f65 [0,4194304] 0 2024-09-13T02:52:34.538 INFO:tasks.workunit.client.1.smithi142.stdout:8/185: sync 2024-09-13T02:52:34.539 INFO:tasks.workunit.client.1.smithi142.stdout:4/248: dread d0/d2b/d9/f22 [0,4194304] 0 2024-09-13T02:52:34.542 INFO:tasks.workunit.client.1.smithi142.stdout:9/288: mknod dd/d17/d44/c6f 0 2024-09-13T02:52:34.543 INFO:tasks.workunit.client.1.smithi142.stdout:9/289: fsync f8 0 2024-09-13T02:52:34.546 INFO:tasks.workunit.client.1.smithi142.stdout:9/290: mknod dd/d17/d35/d41/c70 0 2024-09-13T02:52:34.547 INFO:tasks.workunit.client.1.smithi142.stdout:8/186: link d0/d1/d8/f36 d0/d1/f3c 0 2024-09-13T02:52:34.548 INFO:tasks.workunit.client.1.smithi142.stdout:8/187: fdatasync d0/d6/d23/f2c 0 2024-09-13T02:52:34.549 INFO:tasks.workunit.client.1.smithi142.stdout:5/249: rename d8/l18 to d8/d24/l4e 0 2024-09-13T02:52:34.550 INFO:tasks.workunit.client.1.smithi142.stdout:4/249: link d0/d2b/d9/f2f d0/f4c 0 2024-09-13T02:52:34.552 INFO:tasks.workunit.client.1.smithi142.stdout:9/291: fsync dd/d17/d35/d41/f59 0 2024-09-13T02:52:34.553 INFO:tasks.workunit.client.1.smithi142.stdout:8/188: link d0/d1/f10 d0/d6/d23/f3d 0 2024-09-13T02:52:34.557 INFO:tasks.workunit.client.1.smithi142.stdout:1/306: rename d12/d13/d20/d27/f62 to d12/d13/d1d/f6c 0 2024-09-13T02:52:34.557 INFO:tasks.workunit.client.1.smithi142.stdout:8/189: stat d0/d6/c33 0 2024-09-13T02:52:34.557 INFO:tasks.workunit.client.1.smithi142.stdout:1/307: chown d12/d13/d20/f48 122780 1 2024-09-13T02:52:34.558 INFO:tasks.workunit.client.1.smithi142.stdout:9/292: mknod dd/d17/d68/c71 0 2024-09-13T02:52:34.559 INFO:tasks.workunit.client.1.smithi142.stdout:1/308: chown d12/d13/f17 284429 1 2024-09-13T02:52:34.560 INFO:tasks.workunit.client.1.smithi142.stdout:9/293: truncate fb 1117966 0 2024-09-13T02:52:34.563 INFO:tasks.workunit.client.1.smithi142.stdout:8/190: link d0/d6/l25 d0/d6/dc/d2e/l3e 0 2024-09-13T02:52:34.563 INFO:tasks.workunit.client.1.smithi142.stdout:9/294: write dd/d17/d25/d3e/f5d [4171454,41757] 0 2024-09-13T02:52:34.565 INFO:tasks.workunit.client.1.smithi142.stdout:9/295: chown dd/l20 35 1 2024-09-13T02:52:34.566 INFO:tasks.workunit.client.1.smithi142.stdout:1/309: dwrite d12/d13/d20/d66/d55/f47 [0,4194304] 0 2024-09-13T02:52:34.566 INFO:tasks.workunit.client.1.smithi142.stdout:9/296: fsync dd/d17/d4f/f6b 0 2024-09-13T02:52:34.568 INFO:tasks.workunit.client.1.smithi142.stdout:5/250: truncate d8/d24/f3e 2983512 0 2024-09-13T02:52:34.570 INFO:tasks.workunit.client.1.smithi142.stdout:5/251: stat d8/d24/d26/d2d/l35 0 2024-09-13T02:52:34.571 INFO:tasks.workunit.client.1.smithi142.stdout:1/310: read d12/f57 [430141,97465] 0 2024-09-13T02:52:34.571 INFO:tasks.workunit.client.1.smithi142.stdout:9/297: symlink dd/d17/d35/d41/l72 0 2024-09-13T02:52:34.572 INFO:tasks.workunit.client.1.smithi142.stdout:1/311: readlink d12/d13/d20/l2e 0 2024-09-13T02:52:34.574 INFO:tasks.workunit.client.1.smithi142.stdout:9/298: truncate dd/d17/d25/f38 1411861 0 2024-09-13T02:52:34.576 INFO:tasks.workunit.client.1.smithi142.stdout:1/312: rename d12/d13/d20/d27/f37 to d12/d13/d20/d27/d3c/f6d 0 2024-09-13T02:52:34.577 INFO:tasks.workunit.client.1.smithi142.stdout:1/313: chown d12/d13/d20/d27/d3c/f6d 32441384 1 2024-09-13T02:52:34.578 INFO:tasks.workunit.client.1.smithi142.stdout:1/314: write d12/d1b/f52 [74325,56274] 0 2024-09-13T02:52:34.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/299: truncate dd/f1d 1830260 0 2024-09-13T02:52:34.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/300: chown dd/d17/d25/d3e/f5d 10352773 1 2024-09-13T02:52:34.590 INFO:tasks.workunit.client.1.smithi142.stdout:9/301: dread - dd/f16 zero size 2024-09-13T02:52:34.591 INFO:tasks.workunit.client.1.smithi142.stdout:9/302: symlink dd/d17/d68/l73 0 2024-09-13T02:52:34.597 INFO:tasks.workunit.client.1.smithi142.stdout:9/303: link dd/d17/l5b dd/d17/l74 0 2024-09-13T02:52:34.597 INFO:tasks.workunit.client.1.smithi142.stdout:9/304: chown dd/f58 15 1 2024-09-13T02:52:34.597 INFO:tasks.workunit.client.1.smithi142.stdout:9/305: dread - dd/d17/d25/f62 zero size 2024-09-13T02:52:34.597 INFO:tasks.workunit.client.1.smithi142.stdout:1/315: dread d12/d13/d20/d27/d3c/f59 [0,4194304] 0 2024-09-13T02:52:34.597 INFO:tasks.workunit.client.1.smithi142.stdout:9/306: symlink dd/d17/d4f/l75 0 2024-09-13T02:52:34.598 INFO:tasks.workunit.client.1.smithi142.stdout:9/307: write dd/d17/d4f/f67 [215592,40286] 0 2024-09-13T02:52:34.598 INFO:tasks.workunit.client.1.smithi142.stdout:1/316: mknod d12/d1b/c6e 0 2024-09-13T02:52:34.603 INFO:tasks.workunit.client.1.smithi142.stdout:1/317: unlink d12/d1b/f43 0 2024-09-13T02:52:34.607 INFO:tasks.workunit.client.1.smithi142.stdout:1/318: rename d12/d13/d1d/f25 to d12/d13/d20/d27/d3c/d53/f6f 0 2024-09-13T02:52:34.611 INFO:tasks.workunit.client.1.smithi142.stdout:1/319: dread d12/d13/d20/d66/d55/f47 [0,4194304] 0 2024-09-13T02:52:34.612 INFO:tasks.workunit.client.1.smithi142.stdout:1/320: chown c2 11 1 2024-09-13T02:52:34.613 INFO:tasks.workunit.client.1.smithi142.stdout:1/321: chown d12/d13/d20/d27/d3c/f59 215 1 2024-09-13T02:52:34.615 INFO:tasks.workunit.client.1.smithi142.stdout:9/308: dread dd/d17/d25/f6a [4194304,4194304] 0 2024-09-13T02:52:34.618 INFO:tasks.workunit.client.1.smithi142.stdout:1/322: chown d12/d1b/l1c 245942 1 2024-09-13T02:52:34.618 INFO:tasks.workunit.client.1.smithi142.stdout:1/323: write d12/f65 [2461895,92941] 0 2024-09-13T02:52:34.621 INFO:tasks.workunit.client.1.smithi142.stdout:9/309: getdents dd/d17/d4f 0 2024-09-13T02:52:34.622 INFO:tasks.workunit.client.1.smithi142.stdout:1/324: symlink d12/d13/l70 0 2024-09-13T02:52:34.623 INFO:tasks.workunit.client.1.smithi142.stdout:9/310: creat dd/d17/d35/f76 x:0 0 0 2024-09-13T02:52:34.623 INFO:tasks.workunit.client.1.smithi142.stdout:9/311: chown dd/f58 3251 1 2024-09-13T02:52:34.623 INFO:tasks.workunit.client.1.smithi142.stdout:1/325: mkdir d12/d13/d20/d27/d3c/d71 0 2024-09-13T02:52:34.624 INFO:tasks.workunit.client.1.smithi142.stdout:9/312: stat dd/d17/d44/f5c 0 2024-09-13T02:52:34.629 INFO:tasks.workunit.client.1.smithi142.stdout:1/326: dwrite d12/f65 [0,4194304] 0 2024-09-13T02:52:34.630 INFO:tasks.workunit.client.1.smithi142.stdout:9/313: dwrite dd/d17/d25/f42 [0,4194304] 0 2024-09-13T02:52:34.637 INFO:tasks.workunit.client.1.smithi142.stdout:1/327: mkdir d12/d13/d1d/d26/d4f/d72 0 2024-09-13T02:52:34.638 INFO:tasks.workunit.client.1.smithi142.stdout:1/328: chown d12/d13/d1d/f6c 509 1 2024-09-13T02:52:34.641 INFO:tasks.workunit.client.1.smithi142.stdout:9/314: dwrite dd/d17/f26 [0,4194304] 0 2024-09-13T02:52:34.642 INFO:tasks.workunit.client.1.smithi142.stdout:1/329: dread d12/d13/d20/d27/f4b [0,4194304] 0 2024-09-13T02:52:34.646 INFO:tasks.workunit.client.1.smithi142.stdout:9/315: dread dd/d17/d25/f6a [4194304,4194304] 0 2024-09-13T02:52:34.646 INFO:tasks.workunit.client.1.smithi142.stdout:1/330: mknod d12/d13/d45/c73 0 2024-09-13T02:52:34.647 INFO:tasks.workunit.client.1.smithi142.stdout:1/331: rmdir d12/d13/d1d 39 2024-09-13T02:52:34.651 INFO:tasks.workunit.client.1.smithi142.stdout:1/332: dread - d12/d1b/f46 zero size 2024-09-13T02:52:34.652 INFO:tasks.workunit.client.1.smithi142.stdout:1/333: chown d12/f65 0 1 2024-09-13T02:52:34.653 INFO:tasks.workunit.client.1.smithi142.stdout:9/316: dwrite dd/d17/d44/f4a [0,4194304] 0 2024-09-13T02:52:34.656 INFO:tasks.workunit.client.1.smithi142.stdout:9/317: mknod dd/d17/d25/c77 0 2024-09-13T02:52:34.658 INFO:tasks.workunit.client.1.smithi142.stdout:1/334: creat d12/d13/d20/f74 x:0 0 0 2024-09-13T02:52:34.660 INFO:tasks.workunit.client.1.smithi142.stdout:1/335: dread - d12/d13/d1d/d26/f6a zero size 2024-09-13T02:52:34.662 INFO:tasks.workunit.client.1.smithi142.stdout:2/163: sync 2024-09-13T02:52:34.663 INFO:tasks.workunit.client.1.smithi142.stdout:2/164: readlink d1/de/l1c 0 2024-09-13T02:52:34.663 INFO:tasks.workunit.client.1.smithi142.stdout:1/336: symlink d12/d13/d20/d27/d3c/d53/l75 0 2024-09-13T02:52:34.668 INFO:tasks.workunit.client.1.smithi142.stdout:1/337: rename d12/d13/d20/d27/f30 to d12/d13/d45/f76 0 2024-09-13T02:52:34.670 INFO:tasks.workunit.client.1.smithi142.stdout:2/165: dwrite d1/de/f20 [0,4194304] 0 2024-09-13T02:52:34.671 INFO:tasks.workunit.client.1.smithi142.stdout:2/166: fdatasync d1/f5 0 2024-09-13T02:52:34.678 INFO:tasks.workunit.client.1.smithi142.stdout:9/318: dread dd/d17/d25/f6a [0,4194304] 0 2024-09-13T02:52:34.679 INFO:tasks.workunit.client.1.smithi142.stdout:9/319: truncate dd/f16 938669 0 2024-09-13T02:52:34.680 INFO:tasks.workunit.client.1.smithi142.stdout:9/320: creat dd/d17/d25/f78 x:0 0 0 2024-09-13T02:52:34.681 INFO:tasks.workunit.client.1.smithi142.stdout:1/338: truncate d12/f22 1767184 0 2024-09-13T02:52:34.681 INFO:tasks.workunit.client.1.smithi142.stdout:1/339: readlink d12/d13/d20/l4e 0 2024-09-13T02:52:34.682 INFO:tasks.workunit.client.1.smithi142.stdout:9/321: mknod dd/d17/d69/c79 0 2024-09-13T02:52:34.683 INFO:tasks.workunit.client.1.smithi142.stdout:1/340: mkdir d12/d13/d77 0 2024-09-13T02:52:34.686 INFO:tasks.workunit.client.1.smithi142.stdout:1/341: mkdir d12/d13/d20/d66/d55/d78 0 2024-09-13T02:52:34.691 INFO:tasks.workunit.client.1.smithi142.stdout:1/342: rmdir d12/d13/d20/d66/d55/d78 0 2024-09-13T02:52:34.692 INFO:tasks.workunit.client.1.smithi142.stdout:1/343: dread - d12/d13/d1d/d26/f6a zero size 2024-09-13T02:52:34.694 INFO:tasks.workunit.client.1.smithi142.stdout:1/344: chown d12/d13/d20/d27/d3c/d53/f54 836860 1 2024-09-13T02:52:34.694 INFO:tasks.workunit.client.1.smithi142.stdout:9/322: dwrite dd/d17/d25/f38 [0,4194304] 0 2024-09-13T02:52:34.697 INFO:tasks.workunit.client.1.smithi142.stdout:9/323: creat dd/d17/d4f/f7a x:0 0 0 2024-09-13T02:52:34.698 INFO:tasks.workunit.client.1.smithi142.stdout:1/345: mknod d12/d13/d1d/c79 0 2024-09-13T02:52:34.699 INFO:tasks.workunit.client.1.smithi142.stdout:1/346: truncate d12/d13/d20/f5c 1001330 0 2024-09-13T02:52:34.699 INFO:tasks.workunit.client.1.smithi142.stdout:9/324: mkdir dd/d17/d5f/d7b 0 2024-09-13T02:52:34.700 INFO:tasks.workunit.client.1.smithi142.stdout:9/325: write dd/d17/d35/f76 [187069,111893] 0 2024-09-13T02:52:34.702 INFO:tasks.workunit.client.1.smithi142.stdout:9/326: stat dd/d17/d25/d3e/f5d 0 2024-09-13T02:52:34.702 INFO:tasks.workunit.client.1.smithi142.stdout:1/347: unlink d12/d13/d20/d27/d3c/f49 0 2024-09-13T02:52:34.704 INFO:tasks.workunit.client.1.smithi142.stdout:9/327: rename dd/d17/d35/d41/c4b to dd/d17/d68/c7c 0 2024-09-13T02:52:34.705 INFO:tasks.workunit.client.1.smithi142.stdout:9/328: chown dd/d17/d4f/f6b 1407 1 2024-09-13T02:52:34.706 INFO:tasks.workunit.client.1.smithi142.stdout:1/348: creat d12/f7a x:0 0 0 2024-09-13T02:52:34.706 INFO:tasks.workunit.client.1.smithi142.stdout:9/329: getdents dd/d17/d5f/d7b 0 2024-09-13T02:52:34.708 INFO:tasks.workunit.client.1.smithi142.stdout:1/349: mknod d12/d1b/c7b 0 2024-09-13T02:52:34.713 INFO:tasks.workunit.client.1.smithi142.stdout:9/330: dwrite dd/d17/f2b [0,4194304] 0 2024-09-13T02:52:34.715 INFO:tasks.workunit.client.1.smithi142.stdout:1/350: dwrite d12/d13/d1d/d26/f6a [0,4194304] 0 2024-09-13T02:52:34.716 INFO:tasks.workunit.client.1.smithi142.stdout:1/351: chown d12/d13/d1d/d26/f2b 962733 1 2024-09-13T02:52:34.717 INFO:tasks.workunit.client.1.smithi142.stdout:1/352: chown d12/d13/d20/d66/d55 740811910 1 2024-09-13T02:52:34.720 INFO:tasks.workunit.client.1.smithi142.stdout:9/331: creat dd/d17/f7d x:0 0 0 2024-09-13T02:52:34.722 INFO:tasks.workunit.client.1.smithi142.stdout:9/332: dread - dd/d17/d4f/f6b zero size 2024-09-13T02:52:34.726 INFO:tasks.workunit.client.1.smithi142.stdout:1/353: dwrite d12/d13/d20/f48 [0,4194304] 0 2024-09-13T02:52:34.728 INFO:tasks.workunit.client.1.smithi142.stdout:9/333: getdents dd/d17/d69 0 2024-09-13T02:52:34.729 INFO:tasks.workunit.client.1.smithi142.stdout:1/354: write d12/d13/f3f [220839,104347] 0 2024-09-13T02:52:34.730 INFO:tasks.workunit.client.1.smithi142.stdout:9/334: creat dd/f7e x:0 0 0 2024-09-13T02:52:34.732 INFO:tasks.workunit.client.1.smithi142.stdout:1/355: write d12/d13/d1d/d26/f2b [664329,112347] 0 2024-09-13T02:52:34.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:34 smithi098 ceph-mon[27886]: pgmap v16: 65 pgs: 65 active+clean; 350 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s rd, 23 MiB/s wr, 294 op/s 2024-09-13T02:52:34.734 INFO:tasks.workunit.client.1.smithi142.stdout:9/335: creat dd/d17/d5f/d7b/f7f x:0 0 0 2024-09-13T02:52:34.734 INFO:tasks.workunit.client.1.smithi142.stdout:9/336: chown dd/f11 28 1 2024-09-13T02:52:34.738 INFO:tasks.workunit.client.1.smithi142.stdout:9/337: rename f3 to dd/d17/d4f/f80 0 2024-09-13T02:52:34.739 INFO:tasks.workunit.client.1.smithi142.stdout:9/338: chown dd/c32 258852921 1 2024-09-13T02:52:34.742 INFO:tasks.workunit.client.1.smithi142.stdout:9/339: dread f5 [4194304,4194304] 0 2024-09-13T02:52:34.745 INFO:tasks.workunit.client.1.smithi142.stdout:9/340: unlink dd/d17/f7d 0 2024-09-13T02:52:34.748 INFO:tasks.workunit.client.1.smithi142.stdout:9/341: rename dd/d17/l27 to dd/d17/d25/l81 0 2024-09-13T02:52:34.750 INFO:tasks.workunit.client.1.smithi142.stdout:9/342: mkdir dd/d17/d44/d82 0 2024-09-13T02:52:34.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:34 smithi142 ceph-mon[33443]: pgmap v16: 65 pgs: 65 active+clean; 350 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s rd, 23 MiB/s wr, 294 op/s 2024-09-13T02:52:34.752 INFO:tasks.workunit.client.1.smithi142.stdout:9/343: creat dd/d17/d35/d41/f83 x:0 0 0 2024-09-13T02:52:34.756 INFO:tasks.workunit.client.1.smithi142.stdout:9/344: getdents dd/d17/d25/d3e 0 2024-09-13T02:52:34.757 INFO:tasks.workunit.client.1.smithi142.stdout:1/356: dread d12/d13/d1d/f42 [0,4194304] 0 2024-09-13T02:52:34.761 INFO:tasks.workunit.client.1.smithi142.stdout:1/357: creat d12/d13/d45/f7c x:0 0 0 2024-09-13T02:52:34.762 INFO:tasks.workunit.client.1.smithi142.stdout:1/358: chown d12/d13/d20/d27/f4b 10454 1 2024-09-13T02:52:34.763 INFO:tasks.workunit.client.1.smithi142.stdout:9/345: rename dd/d17/d35 to dd/d17/d69/d84 0 2024-09-13T02:52:34.768 INFO:tasks.workunit.client.1.smithi142.stdout:1/359: rmdir d12 39 2024-09-13T02:52:34.773 INFO:tasks.workunit.client.1.smithi142.stdout:9/346: link dd/d17/d4f/l54 dd/d17/d69/d84/d41/l85 0 2024-09-13T02:52:34.776 INFO:tasks.workunit.client.1.smithi142.stdout:3/234: sync 2024-09-13T02:52:34.777 INFO:tasks.workunit.client.1.smithi142.stdout:6/270: sync 2024-09-13T02:52:34.780 INFO:tasks.workunit.client.1.smithi142.stdout:9/347: dwrite dd/d17/d5f/d7b/f7f [0,4194304] 0 2024-09-13T02:52:34.780 INFO:tasks.workunit.client.1.smithi142.stdout:6/271: mkdir d1/d7/d5f/d60 0 2024-09-13T02:52:34.781 INFO:tasks.workunit.client.1.smithi142.stdout:6/272: stat d1/dd/d16/c21 0 2024-09-13T02:52:34.782 INFO:tasks.workunit.client.1.smithi142.stdout:6/273: dread - d1/dd/f29 zero size 2024-09-13T02:52:34.783 INFO:tasks.workunit.client.1.smithi142.stdout:9/348: mknod dd/c86 0 2024-09-13T02:52:34.785 INFO:tasks.workunit.client.1.smithi142.stdout:3/235: getdents d12/d16 0 2024-09-13T02:52:34.785 INFO:tasks.workunit.client.1.smithi142.stdout:1/360: dread fd [0,4194304] 0 2024-09-13T02:52:34.786 INFO:tasks.workunit.client.1.smithi142.stdout:6/274: symlink d1/dd/d16/d4e/l61 0 2024-09-13T02:52:34.790 INFO:tasks.workunit.client.1.smithi142.stdout:3/236: creat d12/d16/d25/d3b/f3f x:0 0 0 2024-09-13T02:52:34.790 INFO:tasks.workunit.client.1.smithi142.stdout:1/361: fsync d12/d13/d20/d27/d3c/d53/f56 0 2024-09-13T02:52:34.791 INFO:tasks.workunit.client.1.smithi142.stdout:6/275: mknod d1/d7/d19/d30/c62 0 2024-09-13T02:52:34.792 INFO:tasks.workunit.client.1.smithi142.stdout:9/349: dwrite dd/d17/d5f/d7b/f7f [0,4194304] 0 2024-09-13T02:52:34.793 INFO:tasks.workunit.client.1.smithi142.stdout:9/350: readlink dd/l23 0 2024-09-13T02:52:34.797 INFO:tasks.workunit.client.1.smithi142.stdout:3/237: link d12/f28 d12/d16/d25/f40 0 2024-09-13T02:52:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:1/362: dread d12/d13/d1d/d26/f6a [0,4194304] 0 2024-09-13T02:52:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:7/261: sync 2024-09-13T02:52:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:2/167: sync 2024-09-13T02:52:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:4/250: sync 2024-09-13T02:52:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:8/191: sync 2024-09-13T02:52:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:0/270: sync 2024-09-13T02:52:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:5/252: sync 2024-09-13T02:52:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:6/276: rename d1/dd/d16/d4e/d32/f3b to d1/d7/d19/d48/f63 0 2024-09-13T02:52:34.802 INFO:tasks.workunit.client.1.smithi142.stdout:1/363: unlink d12/d13/f17 0 2024-09-13T02:52:34.804 INFO:tasks.workunit.client.1.smithi142.stdout:0/271: dread - d10/d15/d1a/d3a/f5c zero size 2024-09-13T02:52:34.806 INFO:tasks.workunit.client.1.smithi142.stdout:4/251: creat d0/d2b/d2d/d31/d43/d48/f4d x:0 0 0 2024-09-13T02:52:34.807 INFO:tasks.workunit.client.1.smithi142.stdout:6/277: creat d1/dd/d16/d4e/d32/f64 x:0 0 0 2024-09-13T02:52:34.808 INFO:tasks.workunit.client.1.smithi142.stdout:9/351: truncate f7 1033990 0 2024-09-13T02:52:34.809 INFO:tasks.workunit.client.1.smithi142.stdout:1/364: readlink d12/d13/d20/l4e 0 2024-09-13T02:52:34.810 INFO:tasks.workunit.client.1.smithi142.stdout:3/238: write d12/d16/d25/f26 [2181259,43363] 0 2024-09-13T02:52:34.813 INFO:tasks.workunit.client.1.smithi142.stdout:6/278: rmdir d1/dd/d53 39 2024-09-13T02:52:34.815 INFO:tasks.workunit.client.1.smithi142.stdout:3/239: chown d12/l18 1 1 2024-09-13T02:52:34.816 INFO:tasks.workunit.client.1.smithi142.stdout:9/352: dread dd/f11 [0,4194304] 0 2024-09-13T02:52:34.818 INFO:tasks.workunit.client.1.smithi142.stdout:1/365: rmdir d12/d13/d1d/d26/d4f 39 2024-09-13T02:52:34.822 INFO:tasks.workunit.client.1.smithi142.stdout:6/279: mkdir d1/d7/d5f/d60/d65 0 2024-09-13T02:52:34.823 INFO:tasks.workunit.client.1.smithi142.stdout:5/253: dwrite d8/f1f [4194304,4194304] 0 2024-09-13T02:52:34.823 INFO:tasks.workunit.client.1.smithi142.stdout:8/192: dread d0/d6/dc/f2f [0,4194304] 0 2024-09-13T02:52:34.826 INFO:tasks.workunit.client.1.smithi142.stdout:0/272: getdents d10/d15/d1a/d1e/d42 0 2024-09-13T02:52:34.826 INFO:tasks.workunit.client.1.smithi142.stdout:1/366: dread - d12/d13/d20/d66/d55/f64 zero size 2024-09-13T02:52:34.827 INFO:tasks.workunit.client.1.smithi142.stdout:4/252: dwrite d0/d2b/d9/f20 [0,4194304] 0 2024-09-13T02:52:34.828 INFO:tasks.workunit.client.1.smithi142.stdout:3/240: rename d12/f2b to d12/d16/d25/f41 0 2024-09-13T02:52:34.829 INFO:tasks.workunit.client.1.smithi142.stdout:8/193: chown d0/d1/d8/f12 338 1 2024-09-13T02:52:34.830 INFO:tasks.workunit.client.1.smithi142.stdout:6/280: creat d1/d7/d19/d30/f66 x:0 0 0 2024-09-13T02:52:34.833 INFO:tasks.workunit.client.1.smithi142.stdout:4/253: creat d0/d2b/d21/d30/f4e x:0 0 0 2024-09-13T02:52:34.835 INFO:tasks.workunit.client.1.smithi142.stdout:2/168: dread d1/de/f23 [0,4194304] 0 2024-09-13T02:52:34.835 INFO:tasks.workunit.client.1.smithi142.stdout:3/241: chown d12 9895 1 2024-09-13T02:52:34.839 INFO:tasks.workunit.client.1.smithi142.stdout:6/281: creat d1/d7/d19/d30/f67 x:0 0 0 2024-09-13T02:52:34.841 INFO:tasks.workunit.client.1.smithi142.stdout:0/273: creat d10/d15/d1a/f66 x:0 0 0 2024-09-13T02:52:34.842 INFO:tasks.workunit.client.1.smithi142.stdout:9/353: dwrite dd/d17/f26 [0,4194304] 0 2024-09-13T02:52:34.844 INFO:tasks.workunit.client.1.smithi142.stdout:5/254: dwrite d8/f2e [0,4194304] 0 2024-09-13T02:52:34.849 INFO:tasks.workunit.client.1.smithi142.stdout:6/282: chown d1/d7/d19/d30 376115 1 2024-09-13T02:52:34.849 INFO:tasks.workunit.client.1.smithi142.stdout:2/169: mknod d1/d2d/c36 0 2024-09-13T02:52:34.850 INFO:tasks.workunit.client.1.smithi142.stdout:1/367: dread d12/d13/d1d/f42 [0,4194304] 0 2024-09-13T02:52:34.852 INFO:tasks.workunit.client.1.smithi142.stdout:3/242: unlink d12/d16/f35 0 2024-09-13T02:52:34.854 INFO:tasks.workunit.client.1.smithi142.stdout:7/262: dread f8 [4194304,4194304] 0 2024-09-13T02:52:34.855 INFO:tasks.workunit.client.1.smithi142.stdout:8/194: dwrite d0/d1/fa [0,4194304] 0 2024-09-13T02:52:34.856 INFO:tasks.workunit.client.1.smithi142.stdout:6/283: readlink d1/dd/d16/d4e/l61 0 2024-09-13T02:52:34.856 INFO:tasks.workunit.client.1.smithi142.stdout:1/368: mkdir d12/d13/d20/d66/d7d 0 2024-09-13T02:52:34.857 INFO:tasks.workunit.client.1.smithi142.stdout:9/354: chown dd/d17/d69/d84/d41/c70 5074 1 2024-09-13T02:52:34.857 INFO:tasks.workunit.client.1.smithi142.stdout:4/254: dread d0/d2b/f38 [0,4194304] 0 2024-09-13T02:52:34.858 INFO:tasks.workunit.client.1.smithi142.stdout:5/255: getdents d8/d24 0 2024-09-13T02:52:34.862 INFO:tasks.workunit.client.1.smithi142.stdout:4/255: readlink d0/d2b/d13/l3c 0 2024-09-13T02:52:34.862 INFO:tasks.workunit.client.1.smithi142.stdout:9/355: fsync dd/d17/d25/f2d 0 2024-09-13T02:52:34.863 INFO:tasks.workunit.client.1.smithi142.stdout:8/195: write d0/d6/dc/f18 [392268,26855] 0 2024-09-13T02:52:34.864 INFO:tasks.workunit.client.1.smithi142.stdout:7/263: mkdir d10/d34/d57 0 2024-09-13T02:52:34.865 INFO:tasks.workunit.client.1.smithi142.stdout:2/170: link d1/d29/d2b/f34 d1/de/d1f/f37 0 2024-09-13T02:52:34.866 INFO:tasks.workunit.client.1.smithi142.stdout:1/369: dread fe [0,4194304] 0 2024-09-13T02:52:34.867 INFO:tasks.workunit.client.1.smithi142.stdout:4/256: chown d0/d2b/d2d/d31/d43 7433 1 2024-09-13T02:52:34.868 INFO:tasks.workunit.client.1.smithi142.stdout:9/356: mkdir dd/d87 0 2024-09-13T02:52:34.869 INFO:tasks.workunit.client.1.smithi142.stdout:1/370: read d12/d13/d20/d66/d55/f44 [2321964,71657] 0 2024-09-13T02:52:34.869 INFO:tasks.workunit.client.1.smithi142.stdout:2/171: symlink d1/d29/d2b/l38 0 2024-09-13T02:52:34.870 INFO:tasks.workunit.client.1.smithi142.stdout:5/256: creat d8/d47/f4f x:0 0 0 2024-09-13T02:52:34.872 INFO:tasks.workunit.client.1.smithi142.stdout:4/257: unlink d0/d2b/d13/f1a 0 2024-09-13T02:52:34.873 INFO:tasks.workunit.client.1.smithi142.stdout:4/258: dread - d0/d2b/d2d/d31/d43/d48/f4d zero size 2024-09-13T02:52:34.874 INFO:tasks.workunit.client.1.smithi142.stdout:5/257: dread d8/f2e [0,4194304] 0 2024-09-13T02:52:34.877 INFO:tasks.workunit.client.1.smithi142.stdout:1/371: write d12/d1b/f5d [781922,9294] 0 2024-09-13T02:52:34.877 INFO:tasks.workunit.client.1.smithi142.stdout:2/172: creat d1/d29/d2b/f39 x:0 0 0 2024-09-13T02:52:34.878 INFO:tasks.workunit.client.1.smithi142.stdout:1/372: chown d12/d13/d1d/d26 0 1 2024-09-13T02:52:34.880 INFO:tasks.workunit.client.1.smithi142.stdout:7/264: mknod d10/d13/d1d/d25/d45/c58 0 2024-09-13T02:52:34.880 INFO:tasks.workunit.client.1.smithi142.stdout:5/258: dread d8/f1f [4194304,4194304] 0 2024-09-13T02:52:34.881 INFO:tasks.workunit.client.1.smithi142.stdout:7/265: stat d10/d13/d1d/d25/d45 0 2024-09-13T02:52:34.881 INFO:tasks.workunit.client.1.smithi142.stdout:5/259: stat d8/c1d 0 2024-09-13T02:52:34.881 INFO:tasks.workunit.client.1.smithi142.stdout:1/373: truncate d12/d13/d20/d66/f69 940637 0 2024-09-13T02:52:34.883 INFO:tasks.workunit.client.1.smithi142.stdout:3/243: write d12/f28 [2794541,101710] 0 2024-09-13T02:52:34.884 INFO:tasks.workunit.client.1.smithi142.stdout:7/266: dread ff [0,4194304] 0 2024-09-13T02:52:34.885 INFO:tasks.workunit.client.1.smithi142.stdout:9/357: rename dd/d17/d68/c7c to dd/d17/d69/c88 0 2024-09-13T02:52:34.885 INFO:tasks.workunit.client.1.smithi142.stdout:9/358: chown dd/f1f 3044 1 2024-09-13T02:52:34.885 INFO:tasks.workunit.client.1.smithi142.stdout:6/284: getdents d1/d7/d42 0 2024-09-13T02:52:34.887 INFO:tasks.workunit.client.1.smithi142.stdout:2/173: symlink d1/de/l3a 0 2024-09-13T02:52:34.887 INFO:tasks.workunit.client.1.smithi142.stdout:6/285: read - d1/d7/d19/d30/f66 zero size 2024-09-13T02:52:34.887 INFO:tasks.workunit.client.1.smithi142.stdout:4/259: mknod d0/d2b/d21/d35/c4f 0 2024-09-13T02:52:34.888 INFO:tasks.workunit.client.1.smithi142.stdout:0/274: dread d10/d15/d45/f60 [0,4194304] 0 2024-09-13T02:52:34.890 INFO:tasks.workunit.client.1.smithi142.stdout:0/275: fsync d10/d15/d21/d51/d35/f55 0 2024-09-13T02:52:34.892 INFO:tasks.workunit.client.1.smithi142.stdout:7/267: rmdir d10/d13/d1d/d2b/d40 39 2024-09-13T02:52:34.893 INFO:tasks.workunit.client.1.smithi142.stdout:9/359: creat dd/d17/d69/f89 x:0 0 0 2024-09-13T02:52:34.894 INFO:tasks.workunit.client.1.smithi142.stdout:5/260: getdents d8/d24/d4d 0 2024-09-13T02:52:34.894 INFO:tasks.workunit.client.1.smithi142.stdout:5/261: dread - d8/f13 zero size 2024-09-13T02:52:34.895 INFO:tasks.workunit.client.1.smithi142.stdout:4/260: creat d0/d2b/d2d/d31/d32/f50 x:0 0 0 2024-09-13T02:52:34.895 INFO:tasks.workunit.client.1.smithi142.stdout:5/262: write d8/d47/f4f [742083,92808] 0 2024-09-13T02:52:34.897 INFO:tasks.workunit.client.1.smithi142.stdout:4/261: read d0/d2b/d9/f2f [1804100,112532] 0 2024-09-13T02:52:34.898 INFO:tasks.workunit.client.1.smithi142.stdout:0/276: mknod d10/d15/d1a/d1e/c67 0 2024-09-13T02:52:34.900 INFO:tasks.workunit.client.1.smithi142.stdout:7/268: creat d10/d13/d1d/d2b/d56/f59 x:0 0 0 2024-09-13T02:52:34.901 INFO:tasks.workunit.client.1.smithi142.stdout:9/360: mknod dd/d17/d44/c8a 0 2024-09-13T02:52:34.903 INFO:tasks.workunit.client.1.smithi142.stdout:1/374: creat d12/d13/d1d/d26/d4f/d72/f7e x:0 0 0 2024-09-13T02:52:34.904 INFO:tasks.workunit.client.1.smithi142.stdout:5/263: creat d8/d24/d3f/d4a/f50 x:0 0 0 2024-09-13T02:52:34.905 INFO:tasks.workunit.client.1.smithi142.stdout:4/262: symlink d0/d2b/d21/d30/l51 0 2024-09-13T02:52:34.906 INFO:tasks.workunit.client.1.smithi142.stdout:0/277: unlink d10/d15/d30/l4c 0 2024-09-13T02:52:34.906 INFO:tasks.workunit.client.1.smithi142.stdout:3/244: truncate d12/d16/f17 807542 0 2024-09-13T02:52:34.907 INFO:tasks.workunit.client.1.smithi142.stdout:1/375: dread d12/d13/d20/d66/f69 [0,4194304] 0 2024-09-13T02:52:34.908 INFO:tasks.workunit.client.1.smithi142.stdout:7/269: creat d10/d34/f5a x:0 0 0 2024-09-13T02:52:34.908 INFO:tasks.workunit.client.1.smithi142.stdout:2/174: mknod d1/de/d1f/d13/c3b 0 2024-09-13T02:52:34.909 INFO:tasks.workunit.client.1.smithi142.stdout:9/361: dwrite dd/d17/d25/d3e/f56 [0,4194304] 0 2024-09-13T02:52:34.911 INFO:tasks.workunit.client.1.smithi142.stdout:7/270: truncate d10/f47 330792 0 2024-09-13T02:52:34.911 INFO:tasks.workunit.client.1.smithi142.stdout:4/263: mknod d0/df/c52 0 2024-09-13T02:52:34.912 INFO:tasks.workunit.client.1.smithi142.stdout:6/286: truncate d1/dd/d16/f1c 7896947 0 2024-09-13T02:52:34.913 INFO:tasks.workunit.client.1.smithi142.stdout:5/264: symlink d8/d24/d26/d45/l51 0 2024-09-13T02:52:34.914 INFO:tasks.workunit.client.1.smithi142.stdout:5/265: fdatasync d8/f13 0 2024-09-13T02:52:34.914 INFO:tasks.workunit.client.1.smithi142.stdout:2/175: creat d1/de/d1f/d13/f3c x:0 0 0 2024-09-13T02:52:34.915 INFO:tasks.workunit.client.1.smithi142.stdout:1/376: dread d12/d13/d1d/f42 [0,4194304] 0 2024-09-13T02:52:34.916 INFO:tasks.workunit.client.1.smithi142.stdout:7/271: creat d10/d34/f5b x:0 0 0 2024-09-13T02:52:34.917 INFO:tasks.workunit.client.1.smithi142.stdout:3/245: mknod d12/c42 0 2024-09-13T02:52:34.920 INFO:tasks.workunit.client.1.smithi142.stdout:6/287: unlink d1/dd/d16/d47/c58 0 2024-09-13T02:52:34.921 INFO:tasks.workunit.client.1.smithi142.stdout:6/288: dread - d1/dd/f29 zero size 2024-09-13T02:52:34.925 INFO:tasks.workunit.client.1.smithi142.stdout:7/272: mkdir d10/d13/d1d/d25/d5c 0 2024-09-13T02:52:34.926 INFO:tasks.workunit.client.1.smithi142.stdout:3/246: unlink d12/c42 0 2024-09-13T02:52:34.927 INFO:tasks.workunit.client.1.smithi142.stdout:5/266: dwrite d8/f2e [0,4194304] 0 2024-09-13T02:52:34.929 INFO:tasks.workunit.client.1.smithi142.stdout:6/289: creat d1/d7/d5f/f68 x:0 0 0 2024-09-13T02:52:34.932 INFO:tasks.workunit.client.1.smithi142.stdout:4/264: creat d0/d2b/d9/f53 x:0 0 0 2024-09-13T02:52:34.933 INFO:tasks.workunit.client.1.smithi142.stdout:0/278: dread d10/f19 [0,4194304] 0 2024-09-13T02:52:34.935 INFO:tasks.workunit.client.1.smithi142.stdout:3/247: chown d12/f22 4477 1 2024-09-13T02:52:34.935 INFO:tasks.workunit.client.1.smithi142.stdout:3/248: readlink l7 0 2024-09-13T02:52:34.937 INFO:tasks.workunit.client.1.smithi142.stdout:1/377: rmdir d12/d13/d77 0 2024-09-13T02:52:34.937 INFO:tasks.workunit.client.1.smithi142.stdout:9/362: write dd/f13 [4638543,15063] 0 2024-09-13T02:52:34.939 INFO:tasks.workunit.client.1.smithi142.stdout:2/176: link d1/fc d1/de/d31/f3d 0 2024-09-13T02:52:34.944 INFO:tasks.workunit.client.1.smithi142.stdout:5/267: symlink d8/d24/d4d/l52 0 2024-09-13T02:52:34.946 INFO:tasks.workunit.client.1.smithi142.stdout:1/378: write d12/d13/d20/d66/d55/f47 [1811818,74385] 0 2024-09-13T02:52:34.946 INFO:tasks.workunit.client.1.smithi142.stdout:9/363: mknod dd/d17/d25/d3e/c8b 0 2024-09-13T02:52:34.948 INFO:tasks.workunit.client.1.smithi142.stdout:6/290: symlink d1/dd/l69 0 2024-09-13T02:52:34.950 INFO:tasks.workunit.client.1.smithi142.stdout:1/379: dread d12/d13/d1d/f42 [0,4194304] 0 2024-09-13T02:52:34.952 INFO:tasks.workunit.client.1.smithi142.stdout:7/273: rmdir d10/d13/d1d/d2b/d53 0 2024-09-13T02:52:34.953 INFO:tasks.workunit.client.1.smithi142.stdout:1/380: dread d12/f4d [0,4194304] 0 2024-09-13T02:52:34.954 INFO:tasks.workunit.client.1.smithi142.stdout:3/249: readlink d12/d16/d25/l32 0 2024-09-13T02:52:34.954 INFO:tasks.workunit.client.1.smithi142.stdout:5/268: rmdir d8/d24/d26/d2d 39 2024-09-13T02:52:34.956 INFO:tasks.workunit.client.1.smithi142.stdout:9/364: symlink dd/d17/d25/d3e/l8c 0 2024-09-13T02:52:34.957 INFO:tasks.workunit.client.1.smithi142.stdout:9/365: read dd/d17/d25/f38 [266790,109598] 0 2024-09-13T02:52:34.957 INFO:tasks.workunit.client.1.smithi142.stdout:4/265: write d0/f4c [3894574,63034] 0 2024-09-13T02:52:34.957 INFO:tasks.workunit.client.1.smithi142.stdout:1/381: dread d12/d13/d20/d27/d3c/d53/f6f [0,4194304] 0 2024-09-13T02:52:34.958 INFO:tasks.workunit.client.1.smithi142.stdout:1/382: truncate d12/f7a 101218 0 2024-09-13T02:52:34.959 INFO:tasks.workunit.client.1.smithi142.stdout:4/266: read d0/df/f23 [60668,103936] 0 2024-09-13T02:52:34.961 INFO:tasks.workunit.client.1.smithi142.stdout:5/269: mknod d8/d47/c53 0 2024-09-13T02:52:34.963 INFO:tasks.workunit.client.1.smithi142.stdout:9/366: symlink dd/d17/d69/d84/l8d 0 2024-09-13T02:52:34.964 INFO:tasks.workunit.client.1.smithi142.stdout:1/383: write d12/d13/d20/f38 [5727396,2519] 0 2024-09-13T02:52:34.965 INFO:tasks.workunit.client.1.smithi142.stdout:4/267: rename d0/f14 to d0/d2b/d21/d30/f54 0 2024-09-13T02:52:34.966 INFO:tasks.workunit.client.1.smithi142.stdout:2/177: dwrite d1/f9 [4194304,4194304] 0 2024-09-13T02:52:34.966 INFO:tasks.workunit.client.1.smithi142.stdout:4/268: readlink d0/d2b/le 0 2024-09-13T02:52:34.971 INFO:tasks.workunit.client.1.smithi142.stdout:5/270: creat d8/d24/d26/d45/f54 x:0 0 0 2024-09-13T02:52:34.972 INFO:tasks.workunit.client.1.smithi142.stdout:7/274: creat d10/d13/d1d/f5d x:0 0 0 2024-09-13T02:52:34.975 INFO:tasks.workunit.client.1.smithi142.stdout:7/275: dread d10/d13/d1d/d2b/d55/f3c [0,4194304] 0 2024-09-13T02:52:34.976 INFO:tasks.workunit.client.1.smithi142.stdout:3/250: creat d12/d16/f43 x:0 0 0 2024-09-13T02:52:34.978 INFO:tasks.workunit.client.1.smithi142.stdout:4/269: creat d0/d2b/d2d/d31/f55 x:0 0 0 2024-09-13T02:52:34.979 INFO:tasks.workunit.client.1.smithi142.stdout:6/291: getdents d1/dd/d16/d4e/d32 0 2024-09-13T02:52:34.982 INFO:tasks.workunit.client.1.smithi142.stdout:6/292: dread - d1/d7/d19/d30/f67 zero size 2024-09-13T02:52:34.982 INFO:tasks.workunit.client.1.smithi142.stdout:9/367: mkdir dd/d87/d8e 0 2024-09-13T02:52:34.983 INFO:tasks.workunit.client.1.smithi142.stdout:3/251: creat d12/d16/d25/d3b/f44 x:0 0 0 2024-09-13T02:52:34.984 INFO:tasks.workunit.client.1.smithi142.stdout:2/178: truncate d1/de/d31/f3d 565722 0 2024-09-13T02:52:34.985 INFO:tasks.workunit.client.1.smithi142.stdout:7/276: dwrite d10/d34/f38 [0,4194304] 0 2024-09-13T02:52:34.985 INFO:tasks.workunit.client.1.smithi142.stdout:6/293: fdatasync d1/f3d 0 2024-09-13T02:52:34.988 INFO:tasks.workunit.client.1.smithi142.stdout:1/384: link d12/d13/d20/d27/d3c/d53/f56 d12/d13/d20/d66/d55/f7f 0 2024-09-13T02:52:34.993 INFO:tasks.workunit.client.1.smithi142.stdout:9/368: rename dd/d17/d25/f2d to dd/d87/f8f 0 2024-09-13T02:52:34.994 INFO:tasks.workunit.client.1.smithi142.stdout:4/270: dwrite d0/d2b/d2d/d31/d43/d48/f4d [0,4194304] 0 2024-09-13T02:52:34.996 INFO:tasks.workunit.client.1.smithi142.stdout:3/252: creat d12/d16/d25/d2e/d38/f45 x:0 0 0 2024-09-13T02:52:34.998 INFO:tasks.workunit.client.1.smithi142.stdout:2/179: creat d1/de/d1f/f3e x:0 0 0 2024-09-13T02:52:34.999 INFO:tasks.workunit.client.1.smithi142.stdout:5/271: dwrite d8/f15 [0,4194304] 0 2024-09-13T02:52:34.999 INFO:tasks.workunit.client.1.smithi142.stdout:7/277: dwrite d10/d13/d1d/f23 [4194304,4194304] 0 2024-09-13T02:52:35.000 INFO:tasks.workunit.client.1.smithi142.stdout:5/272: chown d8/c39 136211374 1 2024-09-13T02:52:35.002 INFO:tasks.workunit.client.1.smithi142.stdout:7/278: write d10/d13/f3d [2313157,44770] 0 2024-09-13T02:52:35.002 INFO:tasks.workunit.client.1.smithi142.stdout:9/369: unlink dd/d17/d25/f78 0 2024-09-13T02:52:35.003 INFO:tasks.workunit.client.1.smithi142.stdout:5/273: write d8/f44 [3023558,111135] 0 2024-09-13T02:52:35.008 INFO:tasks.workunit.client.1.smithi142.stdout:1/385: creat d12/d1b/f80 x:0 0 0 2024-09-13T02:52:35.009 INFO:tasks.workunit.client.1.smithi142.stdout:8/196: sync 2024-09-13T02:52:35.021 INFO:tasks.workunit.client.1.smithi142.stdout:6/294: getdents d1/d7/d19/d52 0 2024-09-13T02:52:35.021 INFO:tasks.workunit.client.1.smithi142.stdout:4/271: write d0/d2b/d9/f22 [793683,97250] 0 2024-09-13T02:52:35.021 INFO:tasks.workunit.client.1.smithi142.stdout:7/279: readlink d10/d13/d21/l3a 0 2024-09-13T02:52:35.022 INFO:tasks.workunit.client.1.smithi142.stdout:5/274: write d8/d24/f3d [402473,103281] 0 2024-09-13T02:52:35.023 INFO:tasks.workunit.client.1.smithi142.stdout:8/197: rename d0/l3b to d0/l3f 0 2024-09-13T02:52:35.024 INFO:tasks.workunit.client.1.smithi142.stdout:3/253: write d12/f19 [668611,78653] 0 2024-09-13T02:52:35.024 INFO:tasks.workunit.client.1.smithi142.stdout:9/370: rename f7 to dd/d17/d69/d84/d41/f90 0 2024-09-13T02:52:35.024 INFO:tasks.workunit.client.1.smithi142.stdout:5/275: readlink d8/d24/d4d/l52 0 2024-09-13T02:52:35.025 INFO:tasks.workunit.client.1.smithi142.stdout:6/295: mkdir d1/d7/d5f/d6a 0 2024-09-13T02:52:35.027 INFO:tasks.workunit.client.1.smithi142.stdout:6/296: stat d1/f25 0 2024-09-13T02:52:35.030 INFO:tasks.workunit.client.1.smithi142.stdout:7/280: rename d10/f16 to d10/d13/d1d/d2b/d40/f5e 0 2024-09-13T02:52:35.031 INFO:tasks.workunit.client.1.smithi142.stdout:5/276: symlink d8/d24/d26/l55 0 2024-09-13T02:52:35.031 INFO:tasks.workunit.client.1.smithi142.stdout:6/297: dread - d1/d7/d19/d30/f66 zero size 2024-09-13T02:52:35.031 INFO:tasks.workunit.client.1.smithi142.stdout:3/254: creat d12/f46 x:0 0 0 2024-09-13T02:52:35.034 INFO:tasks.workunit.client.1.smithi142.stdout:4/272: getdents d0/d2b/d2d/d31/d32 0 2024-09-13T02:52:35.036 INFO:tasks.workunit.client.1.smithi142.stdout:3/255: read fe [2836477,25461] 0 2024-09-13T02:52:35.037 INFO:tasks.workunit.client.1.smithi142.stdout:5/277: write d8/f44 [4808225,27308] 0 2024-09-13T02:52:35.040 INFO:tasks.workunit.client.1.smithi142.stdout:1/386: dwrite d12/d13/d20/d66/d55/f7f [0,4194304] 0 2024-09-13T02:52:35.042 INFO:tasks.workunit.client.1.smithi142.stdout:3/256: stat d12/d16/d25/f40 0 2024-09-13T02:52:35.042 INFO:tasks.workunit.client.1.smithi142.stdout:6/298: write d1/dd/d16/f4c [1484018,99799] 0 2024-09-13T02:52:35.044 INFO:tasks.workunit.client.1.smithi142.stdout:1/387: chown d12/f7a 46680 1 2024-09-13T02:52:35.044 INFO:tasks.workunit.client.1.smithi142.stdout:8/198: dwrite d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:35.044 INFO:tasks.workunit.client.1.smithi142.stdout:4/273: fdatasync d0/d2b/f38 0 2024-09-13T02:52:35.046 INFO:tasks.workunit.client.1.smithi142.stdout:9/371: dwrite dd/d17/d44/f5c [0,4194304] 0 2024-09-13T02:52:35.047 INFO:tasks.workunit.client.1.smithi142.stdout:1/388: chown d12/d13/d45/f60 26 1 2024-09-13T02:52:35.050 INFO:tasks.workunit.client.1.smithi142.stdout:5/278: creat d8/d24/d3f/d4a/d4b/f56 x:0 0 0 2024-09-13T02:52:35.051 INFO:tasks.workunit.client.1.smithi142.stdout:4/274: write d0/d2b/d21/d30/f4e [692548,84889] 0 2024-09-13T02:52:35.054 INFO:tasks.workunit.client.1.smithi142.stdout:6/299: unlink d1/f10 0 2024-09-13T02:52:35.055 INFO:tasks.workunit.client.1.smithi142.stdout:3/257: rmdir d12/d16/d25 39 2024-09-13T02:52:35.055 INFO:tasks.workunit.client.1.smithi142.stdout:8/199: mkdir d0/d6/dc/d40 0 2024-09-13T02:52:35.056 INFO:tasks.workunit.client.1.smithi142.stdout:7/281: truncate d10/d31/f4e 546744 0 2024-09-13T02:52:35.058 INFO:tasks.workunit.client.1.smithi142.stdout:4/275: chown d0/d2b/d13/f2e 1 1 2024-09-13T02:52:35.059 INFO:tasks.workunit.client.1.smithi142.stdout:1/389: mkdir d12/d13/d20/d27/d3c/d71/d81 0 2024-09-13T02:52:35.060 INFO:tasks.workunit.client.1.smithi142.stdout:9/372: dwrite dd/f16 [0,4194304] 0 2024-09-13T02:52:35.060 INFO:tasks.workunit.client.1.smithi142.stdout:6/300: read d1/dd/d16/f2c [180462,125626] 0 2024-09-13T02:52:35.061 INFO:tasks.workunit.client.1.smithi142.stdout:3/258: fdatasync d12/d16/f17 0 2024-09-13T02:52:35.063 INFO:tasks.workunit.client.1.smithi142.stdout:9/373: readlink dd/d17/l6c 0 2024-09-13T02:52:35.063 INFO:tasks.workunit.client.1.smithi142.stdout:6/301: stat d1/d7/d19/d30/f66 0 2024-09-13T02:52:35.064 INFO:tasks.workunit.client.1.smithi142.stdout:8/200: mkdir d0/d6/dc/d40/d41 0 2024-09-13T02:52:35.066 INFO:tasks.workunit.client.1.smithi142.stdout:5/279: link d8/l2b d8/d24/d4d/l57 0 2024-09-13T02:52:35.067 INFO:tasks.workunit.client.1.smithi142.stdout:4/276: mknod d0/d2b/c56 0 2024-09-13T02:52:35.068 INFO:tasks.workunit.client.1.smithi142.stdout:1/390: symlink d12/l82 0 2024-09-13T02:52:35.069 INFO:tasks.workunit.client.1.smithi142.stdout:9/374: mkdir dd/d17/d4f/d91 0 2024-09-13T02:52:35.070 INFO:tasks.workunit.client.1.smithi142.stdout:5/280: stat d8/d24/d4d 0 2024-09-13T02:52:35.070 INFO:tasks.workunit.client.1.smithi142.stdout:8/201: readlink d0/d1/d8/df/l34 0 2024-09-13T02:52:35.073 INFO:tasks.workunit.client.1.smithi142.stdout:7/282: dwrite d10/f42 [0,4194304] 0 2024-09-13T02:52:35.073 INFO:tasks.workunit.client.1.smithi142.stdout:9/375: chown l1 913783 1 2024-09-13T02:52:35.074 INFO:tasks.workunit.client.1.smithi142.stdout:4/277: rename d0/d2b/d9 to d0/df/d57 0 2024-09-13T02:52:35.076 INFO:tasks.workunit.client.1.smithi142.stdout:5/281: symlink d8/l58 0 2024-09-13T02:52:35.079 INFO:tasks.workunit.client.1.smithi142.stdout:3/259: dwrite d12/f22 [4194304,4194304] 0 2024-09-13T02:52:35.081 INFO:tasks.workunit.client.1.smithi142.stdout:3/260: chown l6 632 1 2024-09-13T02:52:35.082 INFO:tasks.workunit.client.1.smithi142.stdout:8/202: mknod d0/d1/c42 0 2024-09-13T02:52:35.084 INFO:tasks.workunit.client.1.smithi142.stdout:9/376: symlink dd/d17/d5f/d7b/l92 0 2024-09-13T02:52:35.085 INFO:tasks.workunit.client.1.smithi142.stdout:1/391: mkdir d12/d13/d20/d66/d7d/d83 0 2024-09-13T02:52:35.087 INFO:tasks.workunit.client.1.smithi142.stdout:4/278: creat d0/d2b/d2d/d31/d32/f58 x:0 0 0 2024-09-13T02:52:35.088 INFO:tasks.workunit.client.1.smithi142.stdout:6/302: dwrite d1/d7/d19/d30/f66 [0,4194304] 0 2024-09-13T02:52:35.088 INFO:tasks.workunit.client.1.smithi142.stdout:7/283: mkdir d10/d13/d1d/d2b/d56/d5f 0 2024-09-13T02:52:35.088 INFO:tasks.workunit.client.1.smithi142.stdout:8/203: rmdir d0/d6/d23 39 2024-09-13T02:52:35.090 INFO:tasks.workunit.client.1.smithi142.stdout:6/303: fsync d1/dd/d16/f4c 0 2024-09-13T02:52:35.091 INFO:tasks.workunit.client.1.smithi142.stdout:8/204: chown d0/d6 38382767 1 2024-09-13T02:52:35.091 INFO:tasks.workunit.client.1.smithi142.stdout:7/284: write d10/d34/f5b [508520,23132] 0 2024-09-13T02:52:35.092 INFO:tasks.workunit.client.1.smithi142.stdout:3/261: fsync d12/d16/f20 0 2024-09-13T02:52:35.097 INFO:tasks.workunit.client.1.smithi142.stdout:6/304: symlink d1/d7/d5f/d60/l6b 0 2024-09-13T02:52:35.098 INFO:tasks.workunit.client.1.smithi142.stdout:1/392: dread d12/d13/d1d/d26/f2b [4194304,4194304] 0 2024-09-13T02:52:35.098 INFO:tasks.workunit.client.1.smithi142.stdout:7/285: fsync d10/d13/d1d/f23 0 2024-09-13T02:52:35.098 INFO:tasks.workunit.client.1.smithi142.stdout:5/282: dwrite d8/d24/f3d [4194304,4194304] 0 2024-09-13T02:52:35.099 INFO:tasks.workunit.client.1.smithi142.stdout:0/279: sync 2024-09-13T02:52:35.100 INFO:tasks.workunit.client.1.smithi142.stdout:6/305: chown d1/dd 335424 1 2024-09-13T02:52:35.103 INFO:tasks.workunit.client.1.smithi142.stdout:9/377: dread fb [0,4194304] 0 2024-09-13T02:52:35.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/205: rename d0/d1/d8/df/l15 to d0/d6/dc/d40/l43 0 2024-09-13T02:52:35.104 INFO:tasks.workunit.client.1.smithi142.stdout:1/393: dread - d12/d13/d20/d66/d55/f64 zero size 2024-09-13T02:52:35.106 INFO:tasks.workunit.client.1.smithi142.stdout:3/262: creat d12/d16/d25/f47 x:0 0 0 2024-09-13T02:52:35.107 INFO:tasks.workunit.client.1.smithi142.stdout:4/279: dwrite d0/df/f1f [0,4194304] 0 2024-09-13T02:52:35.108 INFO:tasks.workunit.client.1.smithi142.stdout:5/283: creat d8/d24/f59 x:0 0 0 2024-09-13T02:52:35.114 INFO:tasks.workunit.client.1.smithi142.stdout:6/306: mknod d1/dd/d16/d4e/c6c 0 2024-09-13T02:52:35.117 INFO:tasks.workunit.client.1.smithi142.stdout:8/206: symlink d0/l44 0 2024-09-13T02:52:35.119 INFO:tasks.workunit.client.1.smithi142.stdout:0/280: dwrite d10/d15/d1a/f22 [4194304,4194304] 0 2024-09-13T02:52:35.122 INFO:tasks.workunit.client.1.smithi142.stdout:9/378: dwrite dd/f1b [0,4194304] 0 2024-09-13T02:52:35.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/280: fsync d0/d2b/d13/f16 0 2024-09-13T02:52:35.123 INFO:tasks.workunit.client.1.smithi142.stdout:0/281: dread - d10/d15/d1a/f66 zero size 2024-09-13T02:52:35.125 INFO:tasks.workunit.client.1.smithi142.stdout:3/263: dwrite d12/f19 [0,4194304] 0 2024-09-13T02:52:35.125 INFO:tasks.workunit.client.1.smithi142.stdout:7/286: write ff [997457,109985] 0 2024-09-13T02:52:35.127 INFO:tasks.workunit.client.1.smithi142.stdout:5/284: truncate d8/d24/d26/d2d/f2f 675485 0 2024-09-13T02:52:35.128 INFO:tasks.workunit.client.1.smithi142.stdout:3/264: chown l7 40496136 1 2024-09-13T02:52:35.128 INFO:tasks.workunit.client.1.smithi142.stdout:5/285: fsync d8/f44 0 2024-09-13T02:52:35.131 INFO:tasks.workunit.client.1.smithi142.stdout:3/265: write d12/f46 [132902,13403] 0 2024-09-13T02:52:35.131 INFO:tasks.workunit.client.1.smithi142.stdout:1/394: mknod d12/d13/d20/c84 0 2024-09-13T02:52:35.132 INFO:tasks.workunit.client.1.smithi142.stdout:8/207: rename d0/d1 to d0/d6/dc/d45 0 2024-09-13T02:52:35.134 INFO:tasks.workunit.client.1.smithi142.stdout:3/266: dread - d12/d16/d25/d2e/d38/f45 zero size 2024-09-13T02:52:35.135 INFO:tasks.workunit.client.1.smithi142.stdout:2/180: sync 2024-09-13T02:52:35.136 INFO:tasks.workunit.client.1.smithi142.stdout:0/282: fdatasync d10/d15/f2d 0 2024-09-13T02:52:35.136 INFO:tasks.workunit.client.1.smithi142.stdout:7/287: mkdir d10/d13/d1d/d44/d60 0 2024-09-13T02:52:35.136 INFO:tasks.workunit.client.1.smithi142.stdout:4/281: symlink d0/d2b/d2d/d31/d43/d48/l59 0 2024-09-13T02:52:35.138 INFO:tasks.workunit.client.1.smithi142.stdout:4/282: chown d0/d2b/d13 3 1 2024-09-13T02:52:35.140 INFO:tasks.workunit.client.1.smithi142.stdout:6/307: creat d1/d7/f6d x:0 0 0 2024-09-13T02:52:35.140 INFO:tasks.workunit.client.1.smithi142.stdout:5/286: symlink d8/d24/d3f/d4a/d4b/l5a 0 2024-09-13T02:52:35.141 INFO:tasks.workunit.client.1.smithi142.stdout:7/288: symlink d10/d31/l61 0 2024-09-13T02:52:35.142 INFO:tasks.workunit.client.1.smithi142.stdout:4/283: fdatasync d0/d2b/d2d/d31/d43/f46 0 2024-09-13T02:52:35.142 INFO:tasks.workunit.client.1.smithi142.stdout:0/283: symlink d10/d15/d21/l68 0 2024-09-13T02:52:35.143 INFO:tasks.workunit.client.1.smithi142.stdout:9/379: truncate dd/f1a 162487 0 2024-09-13T02:52:35.144 INFO:tasks.workunit.client.1.smithi142.stdout:2/181: creat d1/d2c/f3f x:0 0 0 2024-09-13T02:52:35.145 INFO:tasks.workunit.client.1.smithi142.stdout:5/287: symlink d8/d24/l5b 0 2024-09-13T02:52:35.146 INFO:tasks.workunit.client.1.smithi142.stdout:0/284: dread - d10/d15/d1a/d1e/d42/d4b/f61 zero size 2024-09-13T02:52:35.147 INFO:tasks.workunit.client.1.smithi142.stdout:7/289: creat d10/d34/d57/f62 x:0 0 0 2024-09-13T02:52:35.148 INFO:tasks.workunit.client.1.smithi142.stdout:3/267: dwrite d12/d16/d25/f26 [0,4194304] 0 2024-09-13T02:52:35.148 INFO:tasks.workunit.client.1.smithi142.stdout:4/284: write d0/d2b/d2d/d31/d32/f50 [834745,43774] 0 2024-09-13T02:52:35.148 INFO:tasks.workunit.client.1.smithi142.stdout:5/288: chown d8/d24/d26/d2d/l35 987350 1 2024-09-13T02:52:35.149 INFO:tasks.workunit.client.1.smithi142.stdout:0/285: readlink d10/d15/d1a/d1e/l4e 0 2024-09-13T02:52:35.178 INFO:tasks.workunit.client.1.smithi142.stdout:9/380: read f8 [1916674,78601] 0 2024-09-13T02:52:35.178 INFO:tasks.workunit.client.1.smithi142.stdout:3/268: mkdir d12/d16/d25/d2e/d48 0 2024-09-13T02:52:35.179 INFO:tasks.workunit.client.1.smithi142.stdout:4/285: stat d0/d2b/d2d/d31/d32/l4a 0 2024-09-13T02:52:35.179 INFO:tasks.workunit.client.1.smithi142.stdout:0/286: chown cc 1683 1 2024-09-13T02:52:35.186 INFO:tasks.workunit.client.1.smithi142.stdout:0/287: write d10/d15/d1a/f22 [3163712,5962] 0 2024-09-13T02:52:35.189 INFO:tasks.workunit.client.1.smithi142.stdout:7/290: dread d10/d34/f38 [0,4194304] 0 2024-09-13T02:52:35.192 INFO:tasks.workunit.client.1.smithi142.stdout:7/291: fsync ff 0 2024-09-13T02:52:35.193 INFO:tasks.workunit.client.1.smithi142.stdout:5/289: dwrite d8/f2e [4194304,4194304] 0 2024-09-13T02:52:35.193 INFO:tasks.workunit.client.1.smithi142.stdout:3/269: creat d12/d16/d25/d2e/f49 x:0 0 0 2024-09-13T02:52:35.195 INFO:tasks.workunit.client.1.smithi142.stdout:4/286: creat d0/d2b/d2d/d31/d43/f5a x:0 0 0 2024-09-13T02:52:35.199 INFO:tasks.workunit.client.1.smithi142.stdout:9/381: creat dd/d17/d4f/d91/f93 x:0 0 0 2024-09-13T02:52:35.200 INFO:tasks.workunit.client.1.smithi142.stdout:7/292: read - d10/d13/d1d/d2b/d55/f4f zero size 2024-09-13T02:52:35.200 INFO:tasks.workunit.client.1.smithi142.stdout:6/308: dread d1/d7/d19/f45 [0,4194304] 0 2024-09-13T02:52:35.200 INFO:tasks.workunit.client.1.smithi142.stdout:8/208: dwrite d0/d6/dc/d45/d8/f1d [4194304,4194304] 0 2024-09-13T02:52:35.200 INFO:tasks.workunit.client.1.smithi142.stdout:3/270: chown d12/d16/f17 1426480428 1 2024-09-13T02:52:35.201 INFO:tasks.workunit.client.1.smithi142.stdout:1/395: dwrite d12/d13/d20/d66/f69 [0,4194304] 0 2024-09-13T02:52:35.202 INFO:tasks.workunit.client.1.smithi142.stdout:0/288: truncate d10/d15/d36/f59 771015 0 2024-09-13T02:52:35.202 INFO:tasks.workunit.client.1.smithi142.stdout:9/382: readlink dd/d17/d25/d3e/l5e 0 2024-09-13T02:52:35.203 INFO:tasks.workunit.client.1.smithi142.stdout:0/289: stat d10/l12 0 2024-09-13T02:52:35.203 INFO:tasks.workunit.client.1.smithi142.stdout:7/293: chown d10/d13/d1d/f5d 1 1 2024-09-13T02:52:35.204 INFO:tasks.workunit.client.1.smithi142.stdout:0/290: readlink d10/l14 0 2024-09-13T02:52:35.207 INFO:tasks.workunit.client.1.smithi142.stdout:9/383: symlink dd/l94 0 2024-09-13T02:52:35.207 INFO:tasks.workunit.client.1.smithi142.stdout:0/291: dread - d10/d15/f46 zero size 2024-09-13T02:52:35.208 INFO:tasks.workunit.client.1.smithi142.stdout:6/309: unlink d1/d7/d19/d48/f63 0 2024-09-13T02:52:35.212 INFO:tasks.workunit.client.1.smithi142.stdout:8/209: mkdir d0/d6/dc/d40/d46 0 2024-09-13T02:52:35.212 INFO:tasks.workunit.client.1.smithi142.stdout:7/294: creat d10/d31/f63 x:0 0 0 2024-09-13T02:52:35.213 INFO:tasks.workunit.client.1.smithi142.stdout:4/287: read d0/df/f29 [433336,129769] 0 2024-09-13T02:52:35.213 INFO:tasks.workunit.client.1.smithi142.stdout:6/310: dread d1/d7/d19/f4b [0,4194304] 0 2024-09-13T02:52:35.213 INFO:tasks.workunit.client.1.smithi142.stdout:9/384: mkdir dd/d17/d44/d95 0 2024-09-13T02:52:35.214 INFO:tasks.workunit.client.1.smithi142.stdout:5/290: link d8/d24/f3d d8/d24/d26/f5c 0 2024-09-13T02:52:35.217 INFO:tasks.workunit.client.1.smithi142.stdout:3/271: rename l7 to d12/l4a 0 2024-09-13T02:52:35.219 INFO:tasks.workunit.client.1.smithi142.stdout:4/288: creat d0/d2b/d2d/d31/d43/d48/f5b x:0 0 0 2024-09-13T02:52:35.222 INFO:tasks.workunit.client.1.smithi142.stdout:0/292: dwrite d10/d23/f58 [0,4194304] 0 2024-09-13T02:52:35.225 INFO:tasks.workunit.client.1.smithi142.stdout:5/291: link d8/d24/d26/d2d/l48 d8/d24/d3f/l5d 0 2024-09-13T02:52:35.226 INFO:tasks.workunit.client.1.smithi142.stdout:3/272: creat d12/d16/d25/d2e/d48/f4b x:0 0 0 2024-09-13T02:52:35.227 INFO:tasks.workunit.client.1.smithi142.stdout:0/293: rename d10/c1f to d10/d23/c69 0 2024-09-13T02:52:35.228 INFO:tasks.workunit.client.1.smithi142.stdout:6/311: dwrite d1/d7/d19/d52/f56 [0,4194304] 0 2024-09-13T02:52:35.229 INFO:tasks.workunit.client.1.smithi142.stdout:6/312: chown d1/dd/le 6 1 2024-09-13T02:52:35.230 INFO:tasks.workunit.client.1.smithi142.stdout:5/292: symlink d8/d24/d3f/l5e 0 2024-09-13T02:52:35.230 INFO:tasks.workunit.client.1.smithi142.stdout:6/313: dread - d1/d7/d5f/f68 zero size 2024-09-13T02:52:35.230 INFO:tasks.workunit.client.1.smithi142.stdout:5/293: stat d8/d24/f3d 0 2024-09-13T02:52:35.234 INFO:tasks.workunit.client.1.smithi142.stdout:1/396: dread d12/d13/d1d/f5b [0,4194304] 0 2024-09-13T02:52:35.238 INFO:tasks.workunit.client.1.smithi142.stdout:5/294: link d8/d24/d3f/d4a/d4b/f56 d8/d24/f5f 0 2024-09-13T02:52:35.239 INFO:tasks.workunit.client.1.smithi142.stdout:5/295: write d8/d24/f41 [41587,23226] 0 2024-09-13T02:52:35.239 INFO:tasks.workunit.client.1.smithi142.stdout:5/296: readlink d8/d24/l36 0 2024-09-13T02:52:35.242 INFO:tasks.workunit.client.1.smithi142.stdout:1/397: link d12/d1b/f46 d12/d13/d20/d66/d7d/f85 0 2024-09-13T02:52:35.245 INFO:tasks.workunit.client.1.smithi142.stdout:1/398: write fe [1293161,121793] 0 2024-09-13T02:52:35.247 INFO:tasks.workunit.client.1.smithi142.stdout:8/210: dwrite d0/d6/f24 [0,4194304] 0 2024-09-13T02:52:35.249 INFO:tasks.workunit.client.1.smithi142.stdout:6/314: truncate d1/dd/d16/d4e/d32/f40 249158 0 2024-09-13T02:52:35.251 INFO:tasks.workunit.client.1.smithi142.stdout:5/297: link d8/d24/d3f/f40 d8/d24/d26/f60 0 2024-09-13T02:52:35.251 INFO:tasks.workunit.client.1.smithi142.stdout:1/399: mknod d12/d13/d20/d66/c86 0 2024-09-13T02:52:35.251 INFO:tasks.workunit.client.1.smithi142.stdout:9/385: dwrite dd/f4c [0,4194304] 0 2024-09-13T02:52:35.252 INFO:tasks.workunit.client.1.smithi142.stdout:8/211: unlink d0/d6/dc/d45/f27 0 2024-09-13T02:52:35.252 INFO:tasks.workunit.client.1.smithi142.stdout:3/273: dread d12/f28 [0,4194304] 0 2024-09-13T02:52:35.254 INFO:tasks.workunit.client.1.smithi142.stdout:0/294: truncate d10/d15/d1a/d1e/d42/f52 515076 0 2024-09-13T02:52:35.255 INFO:tasks.workunit.client.1.smithi142.stdout:6/315: mknod d1/dd/d53/c6e 0 2024-09-13T02:52:35.257 INFO:tasks.workunit.client.1.smithi142.stdout:3/274: readlink d12/l4a 0 2024-09-13T02:52:35.261 INFO:tasks.workunit.client.1.smithi142.stdout:0/295: symlink d10/d15/d45/l6a 0 2024-09-13T02:52:35.266 INFO:tasks.workunit.client.1.smithi142.stdout:1/400: dwrite d12/d13/f3f [0,4194304] 0 2024-09-13T02:52:35.267 INFO:tasks.workunit.client.1.smithi142.stdout:9/386: dwrite dd/d17/d25/f29 [0,4194304] 0 2024-09-13T02:52:35.270 INFO:tasks.workunit.client.1.smithi142.stdout:9/387: dread fa [0,4194304] 0 2024-09-13T02:52:35.273 INFO:tasks.workunit.client.1.smithi142.stdout:8/212: write d0/d6/dc/d45/f10 [5079903,53205] 0 2024-09-13T02:52:35.278 INFO:tasks.workunit.client.1.smithi142.stdout:0/296: unlink d10/c17 0 2024-09-13T02:52:35.278 INFO:tasks.workunit.client.1.smithi142.stdout:1/401: mknod d12/d1b/c87 0 2024-09-13T02:52:35.281 INFO:tasks.workunit.client.1.smithi142.stdout:5/298: dwrite d8/f19 [0,4194304] 0 2024-09-13T02:52:35.281 INFO:tasks.workunit.client.1.smithi142.stdout:6/316: link d1/dd/f22 d1/d7/d19/d52/f6f 0 2024-09-13T02:52:35.282 INFO:tasks.workunit.client.1.smithi142.stdout:9/388: truncate f8 3802240 0 2024-09-13T02:52:35.282 INFO:tasks.workunit.client.1.smithi142.stdout:1/402: chown d12/d13/d20/c4c 14307518 1 2024-09-13T02:52:35.284 INFO:tasks.workunit.client.1.smithi142.stdout:8/213: link d0/d6/dc/c22 d0/d6/dc/d40/d46/c47 0 2024-09-13T02:52:35.285 INFO:tasks.workunit.client.1.smithi142.stdout:1/403: write d12/d13/d20/d66/d55/f7f [211216,20930] 0 2024-09-13T02:52:35.287 INFO:tasks.workunit.client.1.smithi142.stdout:5/299: mkdir d8/d24/d26/d61 0 2024-09-13T02:52:35.290 INFO:tasks.workunit.client.1.smithi142.stdout:8/214: creat d0/d6/dc/d45/f48 x:0 0 0 2024-09-13T02:52:35.292 INFO:tasks.workunit.client.1.smithi142.stdout:5/300: mkdir d8/d24/d26/d45/d62 0 2024-09-13T02:52:35.294 INFO:tasks.workunit.client.1.smithi142.stdout:6/317: dwrite d1/dd/d16/f4c [0,4194304] 0 2024-09-13T02:52:35.295 INFO:tasks.workunit.client.1.smithi142.stdout:9/389: dread dd/d17/d4f/f80 [0,4194304] 0 2024-09-13T02:52:35.296 INFO:tasks.workunit.client.1.smithi142.stdout:1/404: rename d12/d13/d20/d66/c86 to d12/d13/d20/d27/d3c/d71/d81/c88 0 2024-09-13T02:52:35.298 INFO:tasks.workunit.client.1.smithi142.stdout:5/301: truncate d8/d24/d3f/f40 429473 0 2024-09-13T02:52:35.298 INFO:tasks.workunit.client.1.smithi142.stdout:1/405: chown d12/d13/d1d/l23 7 1 2024-09-13T02:52:35.301 INFO:tasks.workunit.client.1.smithi142.stdout:8/215: rename d0/d6/dc/d45/d8/f26 to d0/d6/dc/f49 0 2024-09-13T02:52:35.301 INFO:tasks.workunit.client.1.smithi142.stdout:3/275: dread d12/f13 [0,4194304] 0 2024-09-13T02:52:35.303 INFO:tasks.workunit.client.1.smithi142.stdout:9/390: dread dd/d17/d25/f53 [0,4194304] 0 2024-09-13T02:52:35.303 INFO:tasks.workunit.client.1.smithi142.stdout:6/318: dread d1/dd/d16/d4d/f4f [0,4194304] 0 2024-09-13T02:52:35.306 INFO:tasks.workunit.client.1.smithi142.stdout:1/406: unlink d12/d13/d1d/f42 0 2024-09-13T02:52:35.307 INFO:tasks.workunit.client.1.smithi142.stdout:0/297: write d10/d15/f2d [1873666,130537] 0 2024-09-13T02:52:35.308 INFO:tasks.workunit.client.1.smithi142.stdout:3/276: write fe [2106271,127145] 0 2024-09-13T02:52:35.309 INFO:tasks.workunit.client.1.smithi142.stdout:5/302: mkdir d8/d24/d26/d63 0 2024-09-13T02:52:35.311 INFO:tasks.workunit.client.1.smithi142.stdout:1/407: dread d12/d13/d20/f5c [0,4194304] 0 2024-09-13T02:52:35.311 INFO:tasks.workunit.client.1.smithi142.stdout:9/391: creat dd/d87/f96 x:0 0 0 2024-09-13T02:52:35.313 INFO:tasks.workunit.client.1.smithi142.stdout:6/319: write d1/d7/f3e [1512633,53380] 0 2024-09-13T02:52:35.317 INFO:tasks.workunit.client.1.smithi142.stdout:3/277: dread d12/f22 [4194304,4194304] 0 2024-09-13T02:52:35.318 INFO:tasks.workunit.client.1.smithi142.stdout:0/298: dwrite d10/d15/f46 [0,4194304] 0 2024-09-13T02:52:35.320 INFO:tasks.workunit.client.1.smithi142.stdout:8/216: link d0/d6/dc/d45/d8/l1c d0/d6/d23/d2b/l4a 0 2024-09-13T02:52:35.322 INFO:tasks.workunit.client.1.smithi142.stdout:8/217: stat d0/d6/dc/f18 0 2024-09-13T02:52:35.322 INFO:tasks.workunit.client.1.smithi142.stdout:3/278: creat d12/d16/d25/d2e/f4c x:0 0 0 2024-09-13T02:52:35.322 INFO:tasks.workunit.client.1.smithi142.stdout:1/408: creat d12/d13/d1d/f89 x:0 0 0 2024-09-13T02:52:35.328 INFO:tasks.workunit.client.1.smithi142.stdout:3/279: mkdir d12/d16/d25/d2e/d38/d4d 0 2024-09-13T02:52:35.328 INFO:tasks.workunit.client.1.smithi142.stdout:8/218: mknod d0/d6/dc/d45/d8/c4b 0 2024-09-13T02:52:35.329 INFO:tasks.workunit.client.1.smithi142.stdout:0/299: dwrite d10/d15/d1a/d3a/f3b [0,4194304] 0 2024-09-13T02:52:35.378 INFO:tasks.workunit.client.1.smithi142.stdout:9/392: dwrite fb [0,4194304] 0 2024-09-13T02:52:35.381 INFO:tasks.workunit.client.1.smithi142.stdout:8/219: rename d0/d6/dc/d45/f48 to d0/f4c 0 2024-09-13T02:52:35.385 INFO:tasks.workunit.client.1.smithi142.stdout:0/300: link d10/d15/d1a/d3a/f3b d10/d15/d1a/f6b 0 2024-09-13T02:52:35.387 INFO:tasks.workunit.client.1.smithi142.stdout:1/409: dwrite d12/d13/d20/d27/d3c/d53/f6f [0,4194304] 0 2024-09-13T02:52:35.387 INFO:tasks.workunit.client.1.smithi142.stdout:3/280: dwrite d12/d16/f17 [0,4194304] 0 2024-09-13T02:52:35.389 INFO:tasks.workunit.client.1.smithi142.stdout:1/410: fdatasync d12/d13/d20/f5e 0 2024-09-13T02:52:35.389 INFO:tasks.workunit.client.1.smithi142.stdout:0/301: write d10/d15/d1a/d1e/d42/f48 [1826420,69674] 0 2024-09-13T02:52:35.390 INFO:tasks.workunit.client.1.smithi142.stdout:1/411: chown d12/d13/d20/d66/d7d/d83 825785 1 2024-09-13T02:52:35.392 INFO:tasks.workunit.client.1.smithi142.stdout:3/281: symlink d12/d16/d25/l4e 0 2024-09-13T02:52:35.395 INFO:tasks.workunit.client.1.smithi142.stdout:0/302: mkdir d10/d6c 0 2024-09-13T02:52:35.397 INFO:tasks.workunit.client.1.smithi142.stdout:1/412: dwrite d12/d13/d20/d66/d55/f47 [0,4194304] 0 2024-09-13T02:52:35.399 INFO:tasks.workunit.client.1.smithi142.stdout:3/282: rmdir d12/d16/d3c 39 2024-09-13T02:52:35.402 INFO:tasks.workunit.client.1.smithi142.stdout:0/303: creat d10/d6c/f6d x:0 0 0 2024-09-13T02:52:35.404 INFO:tasks.workunit.client.1.smithi142.stdout:8/220: truncate d0/d6/f24 209115 0 2024-09-13T02:52:35.409 INFO:tasks.workunit.client.1.smithi142.stdout:2/182: sync 2024-09-13T02:52:35.410 INFO:tasks.workunit.client.1.smithi142.stdout:3/283: dwrite d12/d16/d25/f47 [0,4194304] 0 2024-09-13T02:52:35.411 INFO:tasks.workunit.client.1.smithi142.stdout:2/183: creat d1/d2d/f40 x:0 0 0 2024-09-13T02:52:35.414 INFO:tasks.workunit.client.1.smithi142.stdout:3/284: creat d12/d16/d25/f4f x:0 0 0 2024-09-13T02:52:35.415 INFO:tasks.workunit.client.1.smithi142.stdout:2/184: fsync d1/de/d1f/f19 0 2024-09-13T02:52:35.415 INFO:tasks.workunit.client.1.smithi142.stdout:8/221: dwrite d0/d6/dc/fe [0,4194304] 0 2024-09-13T02:52:35.416 INFO:tasks.workunit.client.1.smithi142.stdout:2/185: fdatasync d1/d29/d2b/f39 0 2024-09-13T02:52:35.417 INFO:tasks.workunit.client.1.smithi142.stdout:8/222: write d0/d6/dc/fe [446567,59187] 0 2024-09-13T02:52:35.420 INFO:tasks.workunit.client.1.smithi142.stdout:8/223: write d0/d6/dc/d45/f10 [1742176,106537] 0 2024-09-13T02:52:35.422 INFO:tasks.workunit.client.1.smithi142.stdout:2/186: fdatasync d1/fc 0 2024-09-13T02:52:35.425 INFO:tasks.workunit.client.1.smithi142.stdout:8/224: write d0/d6/dc/d45/d8/df/d28/f2d [334517,9255] 0 2024-09-13T02:52:35.427 INFO:tasks.workunit.client.1.smithi142.stdout:2/187: symlink d1/d2c/l41 0 2024-09-13T02:52:35.429 INFO:tasks.workunit.client.1.smithi142.stdout:2/188: write d1/de/f26 [1104289,72421] 0 2024-09-13T02:52:35.431 INFO:tasks.workunit.client.1.smithi142.stdout:8/225: dread d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:35.434 INFO:tasks.workunit.client.1.smithi142.stdout:2/189: read f0 [3844227,106603] 0 2024-09-13T02:52:35.435 INFO:tasks.workunit.client.1.smithi142.stdout:2/190: chown d1/de/d1f/d13/f1d 3603195 1 2024-09-13T02:52:35.436 INFO:tasks.workunit.client.1.smithi142.stdout:1/413: dread d12/f22 [0,4194304] 0 2024-09-13T02:52:35.437 INFO:tasks.workunit.client.1.smithi142.stdout:2/191: mkdir d1/d42 0 2024-09-13T02:52:35.439 INFO:tasks.workunit.client.1.smithi142.stdout:1/414: dread - d12/d13/d1d/d26/d4f/d72/f7e zero size 2024-09-13T02:52:35.441 INFO:tasks.workunit.client.1.smithi142.stdout:1/415: stat d12/d13/d20/d27/d3c/d53/f63 0 2024-09-13T02:52:35.442 INFO:tasks.workunit.client.1.smithi142.stdout:8/226: dwrite d0/d6/f2a [0,4194304] 0 2024-09-13T02:52:35.443 INFO:tasks.workunit.client.1.smithi142.stdout:2/192: getdents d1/de 0 2024-09-13T02:52:35.444 INFO:tasks.workunit.client.1.smithi142.stdout:2/193: dread - d1/de/f18 zero size 2024-09-13T02:52:35.445 INFO:tasks.workunit.client.1.smithi142.stdout:8/227: mkdir d0/d6/dc/d40/d4d 0 2024-09-13T02:52:35.446 INFO:tasks.workunit.client.1.smithi142.stdout:2/194: read d1/de/f10 [638306,1794] 0 2024-09-13T02:52:35.447 INFO:tasks.workunit.client.1.smithi142.stdout:3/285: dread d12/d16/d25/f41 [0,4194304] 0 2024-09-13T02:52:35.449 INFO:tasks.workunit.client.1.smithi142.stdout:8/228: unlink d0/d6/c9 0 2024-09-13T02:52:35.450 INFO:tasks.workunit.client.1.smithi142.stdout:2/195: symlink d1/d29/l43 0 2024-09-13T02:52:35.451 INFO:tasks.workunit.client.1.smithi142.stdout:2/196: dread - d1/de/d1f/f37 zero size 2024-09-13T02:52:35.453 INFO:tasks.workunit.client.1.smithi142.stdout:3/286: creat d12/d16/d25/d2e/d38/d4d/f50 x:0 0 0 2024-09-13T02:52:35.453 INFO:tasks.workunit.client.1.smithi142.stdout:3/287: readlink lf 0 2024-09-13T02:52:35.454 INFO:tasks.workunit.client.1.smithi142.stdout:2/197: read d1/de/f20 [1171165,49463] 0 2024-09-13T02:52:35.455 INFO:tasks.workunit.client.1.smithi142.stdout:3/288: rmdir d12/d16/d3c 39 2024-09-13T02:52:35.456 INFO:tasks.workunit.client.1.smithi142.stdout:2/198: mkdir d1/d42/d44 0 2024-09-13T02:52:35.462 INFO:tasks.workunit.client.1.smithi142.stdout:2/199: dwrite d1/d2d/f40 [0,4194304] 0 2024-09-13T02:52:35.466 INFO:tasks.workunit.client.1.smithi142.stdout:2/200: mknod d1/d42/d44/c45 0 2024-09-13T02:52:35.470 INFO:tasks.workunit.client.1.smithi142.stdout:3/289: truncate d12/d16/f24 1745333 0 2024-09-13T02:52:35.471 INFO:tasks.workunit.client.1.smithi142.stdout:2/201: rmdir d1 39 2024-09-13T02:52:35.471 INFO:tasks.workunit.client.1.smithi142.stdout:3/290: fdatasync d12/d16/d25/f47 0 2024-09-13T02:52:35.475 INFO:tasks.workunit.client.1.smithi142.stdout:8/229: dread d0/d6/dc/d45/f3 [0,4194304] 0 2024-09-13T02:52:35.493 INFO:tasks.workunit.client.1.smithi142.stdout:4/289: sync 2024-09-13T02:52:35.493 INFO:tasks.workunit.client.1.smithi142.stdout:7/295: sync 2024-09-13T02:52:35.504 INFO:tasks.workunit.client.1.smithi142.stdout:2/202: getdents d1 0 2024-09-13T02:52:35.506 INFO:tasks.workunit.client.1.smithi142.stdout:4/290: write d0/d2b/d2d/d31/f55 [792914,30607] 0 2024-09-13T02:52:35.510 INFO:tasks.workunit.client.1.smithi142.stdout:7/296: mkdir d10/d64 0 2024-09-13T02:52:35.513 INFO:tasks.workunit.client.1.smithi142.stdout:8/230: creat d0/d6/dc/d40/d41/f4e x:0 0 0 2024-09-13T02:52:35.513 INFO:tasks.workunit.client.1.smithi142.stdout:4/291: mknod d0/d2b/c5c 0 2024-09-13T02:52:35.519 INFO:tasks.workunit.client.1.smithi142.stdout:8/231: symlink d0/d6/dc/d45/d35/l4f 0 2024-09-13T02:52:35.521 INFO:tasks.workunit.client.1.smithi142.stdout:4/292: creat d0/df/f5d x:0 0 0 2024-09-13T02:52:35.521 INFO:tasks.workunit.client.1.smithi142.stdout:2/203: dwrite d1/de/d31/f3d [0,4194304] 0 2024-09-13T02:52:35.522 INFO:tasks.workunit.client.1.smithi142.stdout:3/291: dread d12/d16/f29 [0,4194304] 0 2024-09-13T02:52:35.523 INFO:tasks.workunit.client.1.smithi142.stdout:2/204: write d1/de/f26 [209064,72147] 0 2024-09-13T02:52:35.524 INFO:tasks.workunit.client.1.smithi142.stdout:2/205: stat d1/de/d1f/d13/c1b 0 2024-09-13T02:52:35.524 INFO:tasks.workunit.client.1.smithi142.stdout:8/232: symlink d0/d6/dc/d45/d8/l50 0 2024-09-13T02:52:35.525 INFO:tasks.workunit.client.1.smithi142.stdout:8/233: readlink d0/d6/dc/d45/d8/df/l34 0 2024-09-13T02:52:35.527 INFO:tasks.workunit.client.1.smithi142.stdout:3/292: rmdir d12/d16/d3c 39 2024-09-13T02:52:35.528 INFO:tasks.workunit.client.1.smithi142.stdout:2/206: mkdir d1/de/d31/d46 0 2024-09-13T02:52:35.530 INFO:tasks.workunit.client.1.smithi142.stdout:2/207: mkdir d1/d29/d2b/d47 0 2024-09-13T02:52:35.532 INFO:tasks.workunit.client.1.smithi142.stdout:2/208: creat d1/f48 x:0 0 0 2024-09-13T02:52:35.534 INFO:tasks.workunit.client.1.smithi142.stdout:8/234: link d0/d6/dc/d45/d8/l1c d0/d6/dc/d45/d8/df/d28/l51 0 2024-09-13T02:52:35.536 INFO:tasks.workunit.client.1.smithi142.stdout:3/293: dwrite d12/d16/f3e [0,4194304] 0 2024-09-13T02:52:35.538 INFO:tasks.workunit.client.1.smithi142.stdout:3/294: read d12/f22 [2277293,42432] 0 2024-09-13T02:52:35.543 INFO:tasks.workunit.client.1.smithi142.stdout:8/235: dwrite d0/d6/d23/f2c [0,4194304] 0 2024-09-13T02:52:35.543 INFO:tasks.workunit.client.1.smithi142.stdout:3/295: rename d12/d16/f20 to d12/d16/d25/d3b/f51 0 2024-09-13T02:52:35.552 INFO:tasks.workunit.client.1.smithi142.stdout:8/236: dread d0/d6/dc/d45/d8/f29 [0,4194304] 0 2024-09-13T02:52:35.553 INFO:tasks.workunit.client.1.smithi142.stdout:8/237: readlink d0/d6/dc/d2e/l3e 0 2024-09-13T02:52:35.554 INFO:tasks.workunit.client.1.smithi142.stdout:3/296: truncate d12/d16/f3e 2252133 0 2024-09-13T02:52:35.555 INFO:tasks.workunit.client.1.smithi142.stdout:8/238: rmdir d0/d6 39 2024-09-13T02:52:35.557 INFO:tasks.workunit.client.1.smithi142.stdout:3/297: unlink d12/f46 0 2024-09-13T02:52:35.559 INFO:tasks.workunit.client.1.smithi142.stdout:3/298: link d12/d16/d25/d2e/f4c d12/d16/d25/d2e/d48/f52 0 2024-09-13T02:52:35.562 INFO:tasks.workunit.client.1.smithi142.stdout:8/239: dwrite d0/d6/dc/fe [4194304,4194304] 0 2024-09-13T02:52:35.569 INFO:tasks.workunit.client.1.smithi142.stdout:3/299: truncate d12/d16/d25/d3b/f51 7615056 0 2024-09-13T02:52:35.569 INFO:tasks.workunit.client.1.smithi142.stdout:8/240: dwrite d0/d6/dc/d45/f1b [0,4194304] 0 2024-09-13T02:52:35.571 INFO:tasks.workunit.client.1.smithi142.stdout:8/241: write d0/d6/dc/d45/f1b [2156848,13122] 0 2024-09-13T02:52:35.572 INFO:tasks.workunit.client.1.smithi142.stdout:3/300: mkdir d12/d16/d25/d2e/d38/d4d/d53 0 2024-09-13T02:52:35.575 INFO:tasks.workunit.client.1.smithi142.stdout:3/301: mknod d12/d16/d25/d2e/d38/d4d/d53/c54 0 2024-09-13T02:52:35.576 INFO:tasks.workunit.client.1.smithi142.stdout:3/302: read d12/d16/d25/f26 [2550851,67642] 0 2024-09-13T02:52:35.576 INFO:tasks.workunit.client.1.smithi142.stdout:3/303: readlink l6 0 2024-09-13T02:52:35.580 INFO:tasks.workunit.client.1.smithi142.stdout:3/304: mkdir d12/d16/d25/d2e/d38/d4d/d53/d55 0 2024-09-13T02:52:35.581 INFO:tasks.workunit.client.1.smithi142.stdout:3/305: write d12/d16/d25/d2e/d38/f45 [203764,26278] 0 2024-09-13T02:52:35.581 INFO:tasks.workunit.client.1.smithi142.stdout:3/306: chown d12/d16/d25/d2e 927664637 1 2024-09-13T02:52:35.582 INFO:tasks.workunit.client.1.smithi142.stdout:3/307: chown d12/d16/d25/d2e/d38/f45 25 1 2024-09-13T02:52:35.584 INFO:tasks.workunit.client.1.smithi142.stdout:3/308: write d12/d16/d25/f40 [1123926,80471] 0 2024-09-13T02:52:35.590 INFO:tasks.workunit.client.1.smithi142.stdout:3/309: dwrite d12/d16/d25/d2e/d38/f45 [0,4194304] 0 2024-09-13T02:52:35.590 INFO:tasks.workunit.client.1.smithi142.stdout:9/393: sync 2024-09-13T02:52:35.590 INFO:tasks.workunit.client.1.smithi142.stdout:5/303: sync 2024-09-13T02:52:35.590 INFO:tasks.workunit.client.1.smithi142.stdout:6/320: sync 2024-09-13T02:52:35.593 INFO:tasks.workunit.client.1.smithi142.stdout:5/304: mkdir d8/d24/d64 0 2024-09-13T02:52:35.593 INFO:tasks.workunit.client.1.smithi142.stdout:3/310: mknod d12/d16/d25/d2e/d38/c56 0 2024-09-13T02:52:35.594 INFO:tasks.workunit.client.1.smithi142.stdout:9/394: fdatasync dd/d17/d25/f53 0 2024-09-13T02:52:35.595 INFO:tasks.workunit.client.1.smithi142.stdout:6/321: mkdir d1/dd/d16/d4e/d70 0 2024-09-13T02:52:35.595 INFO:tasks.workunit.client.1.smithi142.stdout:9/395: chown dd/d17/d44/c6f 16 1 2024-09-13T02:52:35.596 INFO:tasks.workunit.client.1.smithi142.stdout:5/305: mkdir d8/d47/d65 0 2024-09-13T02:52:35.597 INFO:tasks.workunit.client.1.smithi142.stdout:5/306: write d8/f44 [3445763,119616] 0 2024-09-13T02:52:35.599 INFO:tasks.workunit.client.1.smithi142.stdout:5/307: fdatasync d8/d24/f41 0 2024-09-13T02:52:35.601 INFO:tasks.workunit.client.1.smithi142.stdout:9/396: dread dd/f13 [4194304,4194304] 0 2024-09-13T02:52:35.602 INFO:tasks.workunit.client.1.smithi142.stdout:9/397: write dd/f36 [125876,71742] 0 2024-09-13T02:52:35.602 INFO:tasks.workunit.client.1.smithi142.stdout:5/308: creat d8/f66 x:0 0 0 2024-09-13T02:52:35.606 INFO:tasks.workunit.client.1.smithi142.stdout:9/398: rmdir dd/d17 39 2024-09-13T02:52:35.608 INFO:tasks.workunit.client.1.smithi142.stdout:6/322: dread d1/dd/f22 [0,4194304] 0 2024-09-13T02:52:35.608 INFO:tasks.workunit.client.1.smithi142.stdout:5/309: dwrite d8/fd [0,4194304] 0 2024-09-13T02:52:35.609 INFO:tasks.workunit.client.1.smithi142.stdout:9/399: fdatasync dd/d17/d69/d84/f76 0 2024-09-13T02:52:35.610 INFO:tasks.workunit.client.1.smithi142.stdout:5/310: fsync d8/d24/f3c 0 2024-09-13T02:52:35.613 INFO:tasks.workunit.client.1.smithi142.stdout:5/311: dread d8/d24/d3f/f40 [0,4194304] 0 2024-09-13T02:52:35.614 INFO:tasks.workunit.client.1.smithi142.stdout:9/400: symlink dd/d17/d25/d3e/l97 0 2024-09-13T02:52:35.615 INFO:tasks.workunit.client.1.smithi142.stdout:6/323: dread d1/dd/d16/f4c [0,4194304] 0 2024-09-13T02:52:35.618 INFO:tasks.workunit.client.1.smithi142.stdout:5/312: symlink d8/d24/d3f/d4a/d4b/l67 0 2024-09-13T02:52:35.620 INFO:tasks.workunit.client.1.smithi142.stdout:9/401: unlink dd/d17/d25/f38 0 2024-09-13T02:52:35.621 INFO:tasks.workunit.client.1.smithi142.stdout:6/324: chown d1/dd/d16/c17 1488 1 2024-09-13T02:52:35.621 INFO:tasks.workunit.client.1.smithi142.stdout:6/325: dread - d1/d7/d19/d30/f67 zero size 2024-09-13T02:52:35.623 INFO:tasks.workunit.client.1.smithi142.stdout:3/311: truncate d12/d16/f3e 1278991 0 2024-09-13T02:52:35.623 INFO:tasks.workunit.client.1.smithi142.stdout:3/312: write d12/d16/f17 [3258347,93032] 0 2024-09-13T02:52:35.625 INFO:tasks.workunit.client.1.smithi142.stdout:3/313: read fe [1040928,75919] 0 2024-09-13T02:52:35.629 INFO:tasks.workunit.client.1.smithi142.stdout:9/402: mkdir dd/d98 0 2024-09-13T02:52:35.630 INFO:tasks.workunit.client.1.smithi142.stdout:3/314: dwrite fe [0,4194304] 0 2024-09-13T02:52:35.630 INFO:tasks.workunit.client.1.smithi142.stdout:9/403: write dd/f58 [999848,71702] 0 2024-09-13T02:52:35.634 INFO:tasks.workunit.client.1.smithi142.stdout:5/313: truncate d8/d24/f3c 1838045 0 2024-09-13T02:52:35.637 INFO:tasks.workunit.client.1.smithi142.stdout:5/314: write d8/f2e [3503965,59561] 0 2024-09-13T02:52:35.638 INFO:tasks.workunit.client.1.smithi142.stdout:5/315: stat d8/f15 0 2024-09-13T02:52:35.638 INFO:tasks.workunit.client.1.smithi142.stdout:3/315: dread d12/d16/f29 [0,4194304] 0 2024-09-13T02:52:35.639 INFO:tasks.workunit.client.1.smithi142.stdout:5/316: dread - d8/f13 zero size 2024-09-13T02:52:35.642 INFO:tasks.workunit.client.1.smithi142.stdout:9/404: dwrite dd/d17/d4f/f67 [0,4194304] 0 2024-09-13T02:52:35.643 INFO:tasks.workunit.client.1.smithi142.stdout:3/316: truncate d12/d16/d25/d2e/f49 257347 0 2024-09-13T02:52:35.643 INFO:tasks.workunit.client.1.smithi142.stdout:6/326: dwrite d1/d7/d19/d52/f6f [0,4194304] 0 2024-09-13T02:52:35.646 INFO:tasks.workunit.client.1.smithi142.stdout:6/327: stat d1/dd/d16/d4e/l1b 0 2024-09-13T02:52:35.648 INFO:tasks.workunit.client.1.smithi142.stdout:9/405: mkdir dd/d17/d44/d82/d99 0 2024-09-13T02:52:35.649 INFO:tasks.workunit.client.1.smithi142.stdout:9/406: fsync dd/d17/d25/f53 0 2024-09-13T02:52:35.651 INFO:tasks.workunit.client.1.smithi142.stdout:6/328: symlink d1/dd/d57/l71 0 2024-09-13T02:52:35.651 INFO:tasks.workunit.client.1.smithi142.stdout:3/317: write d12/f13 [2523316,108875] 0 2024-09-13T02:52:35.653 INFO:tasks.workunit.client.1.smithi142.stdout:6/329: write d1/dd/f35 [2077270,97936] 0 2024-09-13T02:52:35.655 INFO:tasks.workunit.client.1.smithi142.stdout:9/407: unlink dd/d17/l21 0 2024-09-13T02:52:35.656 INFO:tasks.workunit.client.1.smithi142.stdout:6/330: write d1/d7/f50 [698916,80358] 0 2024-09-13T02:52:35.658 INFO:tasks.workunit.client.1.smithi142.stdout:6/331: write d1/d7/d19/d52/f56 [3447236,126957] 0 2024-09-13T02:52:35.658 INFO:tasks.workunit.client.1.smithi142.stdout:9/408: creat dd/d17/d4f/d91/f9a x:0 0 0 2024-09-13T02:52:35.661 INFO:tasks.workunit.client.1.smithi142.stdout:9/409: write dd/d17/d69/d84/d41/f83 [972460,103489] 0 2024-09-13T02:52:35.662 INFO:tasks.workunit.client.1.smithi142.stdout:6/332: unlink d1/dd/l39 0 2024-09-13T02:52:35.663 INFO:tasks.workunit.client.1.smithi142.stdout:6/333: write d1/d7/d5f/f68 [638182,111185] 0 2024-09-13T02:52:35.663 INFO:tasks.workunit.client.1.smithi142.stdout:9/410: creat dd/d17/d68/f9b x:0 0 0 2024-09-13T02:52:35.664 INFO:tasks.workunit.client.1.smithi142.stdout:6/334: chown d1/f41 32446 1 2024-09-13T02:52:35.665 INFO:tasks.workunit.client.1.smithi142.stdout:5/317: read d8/d24/f3c [929668,130458] 0 2024-09-13T02:52:35.666 INFO:tasks.workunit.client.1.smithi142.stdout:9/411: mknod dd/d17/d69/c9c 0 2024-09-13T02:52:35.669 INFO:tasks.workunit.client.1.smithi142.stdout:9/412: symlink dd/d17/d4f/l9d 0 2024-09-13T02:52:35.672 INFO:tasks.workunit.client.1.smithi142.stdout:6/335: rename d1/dd/d16/d4e/d70 to d1/dd/d72 0 2024-09-13T02:52:35.674 INFO:tasks.workunit.client.1.smithi142.stdout:9/413: symlink dd/d17/d25/l9e 0 2024-09-13T02:52:35.675 INFO:tasks.workunit.client.1.smithi142.stdout:6/336: dread d1/d7/d5f/f68 [0,4194304] 0 2024-09-13T02:52:35.678 INFO:tasks.workunit.client.1.smithi142.stdout:3/318: dwrite d12/d16/d25/d3b/f51 [0,4194304] 0 2024-09-13T02:52:35.683 INFO:tasks.workunit.client.1.smithi142.stdout:6/337: rmdir d1/d7/d19/d30 39 2024-09-13T02:52:35.685 INFO:tasks.workunit.client.1.smithi142.stdout:3/319: creat d12/d16/d25/d2e/d38/f57 x:0 0 0 2024-09-13T02:52:35.685 INFO:tasks.workunit.client.1.smithi142.stdout:5/318: write d8/f1f [4279358,38446] 0 2024-09-13T02:52:35.686 INFO:tasks.workunit.client.1.smithi142.stdout:6/338: creat d1/dd/d53/f73 x:0 0 0 2024-09-13T02:52:35.687 INFO:tasks.workunit.client.1.smithi142.stdout:0/304: sync 2024-09-13T02:52:35.687 INFO:tasks.workunit.client.1.smithi142.stdout:1/416: sync 2024-09-13T02:52:35.692 INFO:tasks.workunit.client.1.smithi142.stdout:6/339: rename d1/dd/d16/d4e/c36 to d1/dd/d16/d4e/c74 0 2024-09-13T02:52:35.696 INFO:tasks.workunit.client.1.smithi142.stdout:0/305: unlink d10/d15/d1a/f65 0 2024-09-13T02:52:35.697 INFO:tasks.workunit.client.1.smithi142.stdout:1/417: write d12/d13/d1d/f6c [3316356,105622] 0 2024-09-13T02:52:35.697 INFO:tasks.workunit.client.1.smithi142.stdout:3/320: rmdir d12 39 2024-09-13T02:52:35.698 INFO:tasks.workunit.client.1.smithi142.stdout:6/340: dwrite d1/dd/f49 [0,4194304] 0 2024-09-13T02:52:35.700 INFO:tasks.workunit.client.1.smithi142.stdout:6/341: chown d1/dd/d53/f73 228576153 1 2024-09-13T02:52:35.703 INFO:tasks.workunit.client.1.smithi142.stdout:0/306: unlink d10/d15/f2d 0 2024-09-13T02:52:35.708 INFO:tasks.workunit.client.1.smithi142.stdout:1/418: mknod d12/d13/d1d/d26/d4f/c8a 0 2024-09-13T02:52:35.711 INFO:tasks.workunit.client.1.smithi142.stdout:6/342: dwrite d1/dd/f49 [4194304,4194304] 0 2024-09-13T02:52:35.712 INFO:tasks.workunit.client.1.smithi142.stdout:6/343: chown c0 3 1 2024-09-13T02:52:35.713 INFO:tasks.workunit.client.1.smithi142.stdout:5/319: getdents d8/d24/d3f/d4a 0 2024-09-13T02:52:35.714 INFO:tasks.workunit.client.1.smithi142.stdout:1/419: unlink d12/c58 0 2024-09-13T02:52:35.719 INFO:tasks.workunit.client.1.smithi142.stdout:6/344: stat d1/d7/d19/d30/c62 0 2024-09-13T02:52:35.719 INFO:tasks.workunit.client.1.smithi142.stdout:7/297: sync 2024-09-13T02:52:35.719 INFO:tasks.workunit.client.1.smithi142.stdout:2/209: sync 2024-09-13T02:52:35.720 INFO:tasks.workunit.client.1.smithi142.stdout:6/345: write d1/d7/f6d [638470,105094] 0 2024-09-13T02:52:35.722 INFO:tasks.workunit.client.1.smithi142.stdout:3/321: link d12/d16/d25/d2e/f2f d12/f58 0 2024-09-13T02:52:35.723 INFO:tasks.workunit.client.1.smithi142.stdout:5/320: mkdir d8/d24/d64/d68 0 2024-09-13T02:52:35.723 INFO:tasks.workunit.client.1.smithi142.stdout:1/420: dwrite d12/d13/d1d/f89 [0,4194304] 0 2024-09-13T02:52:35.725 INFO:tasks.workunit.client.1.smithi142.stdout:5/321: write d8/f13 [1022484,33545] 0 2024-09-13T02:52:35.728 INFO:tasks.workunit.client.1.smithi142.stdout:9/414: truncate dd/d17/d5f/d7b/f7f 1642155 0 2024-09-13T02:52:35.791 INFO:tasks.workunit.client.1.smithi142.stdout:0/307: getdents d10 0 2024-09-13T02:52:35.791 INFO:tasks.workunit.client.1.smithi142.stdout:5/322: dread - d8/d24/f5f zero size 2024-09-13T02:52:35.792 INFO:tasks.workunit.client.1.smithi142.stdout:7/298: dwrite d10/d13/f3d [0,4194304] 0 2024-09-13T02:52:35.796 INFO:tasks.workunit.client.1.smithi142.stdout:0/308: write d10/d15/d45/f56 [155040,22286] 0 2024-09-13T02:52:35.796 INFO:tasks.workunit.client.1.smithi142.stdout:6/346: dread d1/dd/f22 [0,4194304] 0 2024-09-13T02:52:35.796 INFO:tasks.workunit.client.1.smithi142.stdout:9/415: getdents dd/d17/d44/d82/d99 0 2024-09-13T02:52:35.801 INFO:tasks.workunit.client.1.smithi142.stdout:2/210: dwrite d1/f48 [0,4194304] 0 2024-09-13T02:52:35.802 INFO:tasks.workunit.client.1.smithi142.stdout:1/421: dwrite d12/d13/d20/d66/d55/f64 [0,4194304] 0 2024-09-13T02:52:35.803 INFO:tasks.workunit.client.1.smithi142.stdout:9/416: write dd/f16 [3085434,3833] 0 2024-09-13T02:52:35.806 INFO:tasks.workunit.client.1.smithi142.stdout:9/417: mknod dd/d17/d68/c9f 0 2024-09-13T02:52:35.807 INFO:tasks.workunit.client.1.smithi142.stdout:1/422: symlink d12/d13/d20/d66/d7d/l8b 0 2024-09-13T02:52:35.809 INFO:tasks.workunit.client.1.smithi142.stdout:0/309: creat d10/d15/f6e x:0 0 0 2024-09-13T02:52:35.812 INFO:tasks.workunit.client.1.smithi142.stdout:9/418: creat dd/d17/d44/fa0 x:0 0 0 2024-09-13T02:52:35.812 INFO:tasks.workunit.client.1.smithi142.stdout:2/211: dwrite d1/de/d31/f3d [4194304,4194304] 0 2024-09-13T02:52:35.813 INFO:tasks.workunit.client.1.smithi142.stdout:9/419: truncate f5 8472938 0 2024-09-13T02:52:35.815 INFO:tasks.workunit.client.1.smithi142.stdout:9/420: write dd/d17/d25/d3e/f56 [1045858,64287] 0 2024-09-13T02:52:35.815 INFO:tasks.workunit.client.1.smithi142.stdout:0/310: truncate d10/d15/d45/f60 4972231 0 2024-09-13T02:52:35.816 INFO:tasks.workunit.client.1.smithi142.stdout:5/323: truncate d8/d24/f3e 3655602 0 2024-09-13T02:52:35.817 INFO:tasks.workunit.client.1.smithi142.stdout:2/212: symlink d1/de/d1f/d13/l49 0 2024-09-13T02:52:35.825 INFO:tasks.workunit.client.1.smithi142.stdout:2/213: read - d1/d29/d2b/f39 zero size 2024-09-13T02:52:35.825 INFO:tasks.workunit.client.1.smithi142.stdout:1/423: creat d12/d13/d20/f8c x:0 0 0 2024-09-13T02:52:35.825 INFO:tasks.workunit.client.1.smithi142.stdout:0/311: rename d10/d15/d1a/d1e/d42/l5e to d10/d23/l6f 0 2024-09-13T02:52:35.827 INFO:tasks.workunit.client.1.smithi142.stdout:5/324: getdents d8/d24/d26/d61 0 2024-09-13T02:52:35.828 INFO:tasks.workunit.client.1.smithi142.stdout:1/424: unlink d12/d13/d1d/l29 0 2024-09-13T02:52:35.828 INFO:tasks.workunit.client.1.smithi142.stdout:5/325: dread d8/d24/d26/f60 [0,4194304] 0 2024-09-13T02:52:35.829 INFO:tasks.workunit.client.1.smithi142.stdout:9/421: creat dd/d17/fa1 x:0 0 0 2024-09-13T02:52:35.832 INFO:tasks.workunit.client.1.smithi142.stdout:9/422: symlink dd/d17/d44/d82/d99/la2 0 2024-09-13T02:52:35.833 INFO:tasks.workunit.client.1.smithi142.stdout:1/425: creat d12/d13/d1d/f8d x:0 0 0 2024-09-13T02:52:35.834 INFO:tasks.workunit.client.1.smithi142.stdout:9/423: fdatasync dd/d17/d44/f4a 0 2024-09-13T02:52:35.835 INFO:tasks.workunit.client.1.smithi142.stdout:9/424: readlink dd/d17/d4f/l9d 0 2024-09-13T02:52:35.835 INFO:tasks.workunit.client.1.smithi142.stdout:1/426: fsync d12/f57 0 2024-09-13T02:52:35.836 INFO:tasks.workunit.client.1.smithi142.stdout:5/326: dwrite d8/d24/d3f/d4a/f50 [0,4194304] 0 2024-09-13T02:52:35.836 INFO:tasks.workunit.client.1.smithi142.stdout:9/425: chown dd/d17/l46 91184 1 2024-09-13T02:52:35.837 INFO:tasks.workunit.client.1.smithi142.stdout:5/327: dread - d8/d24/f59 zero size 2024-09-13T02:52:35.837 INFO:tasks.workunit.client.1.smithi142.stdout:1/427: write d12/d13/d20/d66/d55/f7f [585233,123400] 0 2024-09-13T02:52:35.841 INFO:tasks.workunit.client.1.smithi142.stdout:8/242: sync 2024-09-13T02:52:35.841 INFO:tasks.workunit.client.1.smithi142.stdout:4/293: sync 2024-09-13T02:52:35.844 INFO:tasks.workunit.client.1.smithi142.stdout:6/347: dread d1/d7/f2a [0,4194304] 0 2024-09-13T02:52:35.845 INFO:tasks.workunit.client.1.smithi142.stdout:5/328: rename d8/d24/d26/d2d/l46 to d8/l69 0 2024-09-13T02:52:35.845 INFO:tasks.workunit.client.1.smithi142.stdout:5/329: readlink d8/l23 0 2024-09-13T02:52:35.847 INFO:tasks.workunit.client.1.smithi142.stdout:9/426: mkdir dd/d87/d8e/da3 0 2024-09-13T02:52:35.847 INFO:tasks.workunit.client.1.smithi142.stdout:8/243: fdatasync d0/d6/dc/d45/d8/f29 0 2024-09-13T02:52:35.850 INFO:tasks.workunit.client.1.smithi142.stdout:6/348: unlink d1/dd/d16/c33 0 2024-09-13T02:52:35.850 INFO:tasks.workunit.client.1.smithi142.stdout:2/214: write d1/de/d1f/f37 [163399,118841] 0 2024-09-13T02:52:35.852 INFO:tasks.workunit.client.1.smithi142.stdout:2/215: dread - d1/de/d1f/d13/f3c zero size 2024-09-13T02:52:35.854 INFO:tasks.workunit.client.1.smithi142.stdout:4/294: creat d0/d2b/d13/f5e x:0 0 0 2024-09-13T02:52:35.855 INFO:tasks.workunit.client.1.smithi142.stdout:6/349: rmdir d1/d7 39 2024-09-13T02:52:35.858 INFO:tasks.workunit.client.1.smithi142.stdout:2/216: creat d1/de/d1f/d13/f4a x:0 0 0 2024-09-13T02:52:35.859 INFO:tasks.workunit.client.1.smithi142.stdout:0/312: dwrite d10/d15/d1a/d3a/f3b [0,4194304] 0 2024-09-13T02:52:35.860 INFO:tasks.workunit.client.1.smithi142.stdout:5/330: creat d8/d24/d26/f6a x:0 0 0 2024-09-13T02:52:35.862 INFO:tasks.workunit.client.1.smithi142.stdout:9/427: dwrite dd/f1f [0,4194304] 0 2024-09-13T02:52:35.862 INFO:tasks.workunit.client.1.smithi142.stdout:8/244: getdents d0/d6/dc/d2e 0 2024-09-13T02:52:35.863 INFO:tasks.workunit.client.1.smithi142.stdout:6/350: mknod d1/d7/d19/d30/c75 0 2024-09-13T02:52:35.870 INFO:tasks.workunit.client.1.smithi142.stdout:9/428: chown dd/c32 26815106 1 2024-09-13T02:52:35.870 INFO:tasks.workunit.client.1.smithi142.stdout:4/295: dwrite d0/df/f5d [0,4194304] 0 2024-09-13T02:52:35.872 INFO:tasks.workunit.client.1.smithi142.stdout:5/331: write d8/d24/f5f [374944,20872] 0 2024-09-13T02:52:35.875 INFO:tasks.workunit.client.1.smithi142.stdout:1/428: dwrite d12/d13/d20/f5c [0,4194304] 0 2024-09-13T02:52:35.875 INFO:tasks.workunit.client.1.smithi142.stdout:4/296: dread - d0/d2b/d2d/d31/d43/f46 zero size 2024-09-13T02:52:35.876 INFO:tasks.workunit.client.1.smithi142.stdout:0/313: truncate d10/d15/d21/d51/f3e 38691 0 2024-09-13T02:52:35.876 INFO:tasks.workunit.client.1.smithi142.stdout:5/332: fdatasync d8/fe 0 2024-09-13T02:52:35.877 INFO:tasks.workunit.client.1.smithi142.stdout:8/245: rename d0/d6/dc/c1f to d0/d6/dc/d2e/c52 0 2024-09-13T02:52:35.881 INFO:tasks.workunit.client.1.smithi142.stdout:4/297: creat d0/d2b/d21/d35/f5f x:0 0 0 2024-09-13T02:52:35.882 INFO:tasks.workunit.client.1.smithi142.stdout:9/429: symlink dd/d17/la4 0 2024-09-13T02:52:35.883 INFO:tasks.workunit.client.1.smithi142.stdout:9/430: chown l1 0 1 2024-09-13T02:52:35.883 INFO:tasks.workunit.client.1.smithi142.stdout:8/246: creat d0/d6/dc/d45/d8/df/d28/f53 x:0 0 0 2024-09-13T02:52:35.884 INFO:tasks.workunit.client.1.smithi142.stdout:5/333: dread d8/d24/d3f/d4a/f50 [0,4194304] 0 2024-09-13T02:52:35.885 INFO:tasks.workunit.client.1.smithi142.stdout:9/431: write dd/d17/d25/f42 [972350,80578] 0 2024-09-13T02:52:35.945 INFO:tasks.workunit.client.1.smithi142.stdout:3/322: sync 2024-09-13T02:52:35.976 INFO:tasks.workunit.client.1.smithi142.stdout:2/217: truncate d1/de/f23 2677268 0 2024-09-13T02:52:35.976 INFO:tasks.workunit.client.1.smithi142.stdout:8/247: fsync d0/d6/dc/f49 0 2024-09-13T02:52:35.977 INFO:tasks.workunit.client.1.smithi142.stdout:8/248: fdatasync d0/d6/dc/f49 0 2024-09-13T02:52:35.977 INFO:tasks.workunit.client.1.smithi142.stdout:5/334: mknod d8/d24/d64/c6b 0 2024-09-13T02:52:35.977 INFO:tasks.workunit.client.1.smithi142.stdout:4/298: sync 2024-09-13T02:52:35.977 INFO:tasks.workunit.client.1.smithi142.stdout:7/299: sync 2024-09-13T02:52:35.979 INFO:tasks.workunit.client.1.smithi142.stdout:8/249: chown d0/d6/dc/f49 13 1 2024-09-13T02:52:35.979 INFO:tasks.workunit.client.1.smithi142.stdout:1/429: getdents d12/d13/d20/d66/d55 0 2024-09-13T02:52:35.979 INFO:tasks.workunit.client.1.smithi142.stdout:7/300: chown d10/f47 230 1 2024-09-13T02:52:35.981 INFO:tasks.workunit.client.1.smithi142.stdout:9/432: mkdir dd/d87/d8e/da3/da5 0 2024-09-13T02:52:35.982 INFO:tasks.workunit.client.1.smithi142.stdout:0/314: truncate d10/d15/f46 3288966 0 2024-09-13T02:52:35.983 INFO:tasks.workunit.client.1.smithi142.stdout:3/323: mknod d12/d16/d25/d2e/d38/d4d/d53/d55/c59 0 2024-09-13T02:52:35.984 INFO:tasks.workunit.client.1.smithi142.stdout:4/299: creat d0/d2b/d2d/d31/f60 x:0 0 0 2024-09-13T02:52:35.984 INFO:tasks.workunit.client.1.smithi142.stdout:9/433: readlink dd/d17/l6c 0 2024-09-13T02:52:35.985 INFO:tasks.workunit.client.1.smithi142.stdout:1/430: write d12/d13/d20/d27/d3c/d53/f63 [800873,5549] 0 2024-09-13T02:52:35.986 INFO:tasks.workunit.client.1.smithi142.stdout:6/351: dwrite d1/dd/d16/d4e/d32/f40 [0,4194304] 0 2024-09-13T02:52:35.989 INFO:tasks.workunit.client.1.smithi142.stdout:3/324: dread - d12/d16/d25/d2e/f4c zero size 2024-09-13T02:52:35.989 INFO:tasks.workunit.client.1.smithi142.stdout:9/434: fdatasync dd/d17/d44/f5c 0 2024-09-13T02:52:35.992 INFO:tasks.workunit.client.1.smithi142.stdout:1/431: dread - d12/d13/d20/f5e zero size 2024-09-13T02:52:35.993 INFO:tasks.workunit.client.1.smithi142.stdout:2/218: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T02:52:35.995 INFO:tasks.workunit.client.1.smithi142.stdout:8/250: dread d0/fb [4194304,4194304] 0 2024-09-13T02:52:35.996 INFO:tasks.workunit.client.1.smithi142.stdout:5/335: dread d8/f19 [0,4194304] 0 2024-09-13T02:52:35.996 INFO:tasks.workunit.client.1.smithi142.stdout:0/315: fdatasync d10/d15/f46 0 2024-09-13T02:52:35.996 INFO:tasks.workunit.client.1.smithi142.stdout:2/219: chown d1/de/f20 130268 1 2024-09-13T02:52:35.997 INFO:tasks.workunit.client.1.smithi142.stdout:8/251: readlink d0/d6/dc/d45/l32 0 2024-09-13T02:52:35.997 INFO:tasks.workunit.client.1.smithi142.stdout:7/301: rmdir d10/d13/d1d/d44/d60 0 2024-09-13T02:52:35.999 INFO:tasks.workunit.client.1.smithi142.stdout:6/352: mkdir d1/d7/d5f/d60/d76 0 2024-09-13T02:52:36.000 INFO:tasks.workunit.client.1.smithi142.stdout:3/325: mkdir d12/d16/d25/d2e/d38/d5a 0 2024-09-13T02:52:36.000 INFO:tasks.workunit.client.1.smithi142.stdout:8/252: write d0/d6/dc/d45/d8/f1d [9097915,121973] 0 2024-09-13T02:52:36.002 INFO:tasks.workunit.client.1.smithi142.stdout:3/326: dread - d12/d16/d25/d3b/f44 zero size 2024-09-13T02:52:36.002 INFO:tasks.workunit.client.1.smithi142.stdout:2/220: write d1/ff [1841399,8211] 0 2024-09-13T02:52:36.004 INFO:tasks.workunit.client.1.smithi142.stdout:4/300: dwrite d0/d2b/d13/f1e [0,4194304] 0 2024-09-13T02:52:36.005 INFO:tasks.workunit.client.1.smithi142.stdout:9/435: fdatasync dd/f11 0 2024-09-13T02:52:36.008 INFO:tasks.workunit.client.1.smithi142.stdout:1/432: rename d12/c34 to d12/d13/d20/d66/d55/c8e 0 2024-09-13T02:52:36.008 INFO:tasks.workunit.client.1.smithi142.stdout:7/302: mkdir d10/d34/d65 0 2024-09-13T02:52:36.012 INFO:tasks.workunit.client.1.smithi142.stdout:0/316: mknod d10/d15/c70 0 2024-09-13T02:52:36.012 INFO:tasks.workunit.client.1.smithi142.stdout:2/221: dwrite d1/de/d1f/d13/f33 [4194304,4194304] 0 2024-09-13T02:52:36.018 INFO:tasks.workunit.client.1.smithi142.stdout:1/433: fdatasync d12/d13/d1d/d26/f6a 0 2024-09-13T02:52:36.018 INFO:tasks.workunit.client.1.smithi142.stdout:7/303: mknod d10/d13/d1d/d44/c66 0 2024-09-13T02:52:36.018 INFO:tasks.workunit.client.1.smithi142.stdout:3/327: mknod d12/d16/d25/d2e/d38/d5a/c5b 0 2024-09-13T02:52:36.019 INFO:tasks.workunit.client.1.smithi142.stdout:0/317: creat d10/d6c/f71 x:0 0 0 2024-09-13T02:52:36.021 INFO:tasks.workunit.client.1.smithi142.stdout:7/304: stat d10/d13/l18 0 2024-09-13T02:52:36.022 INFO:tasks.workunit.client.1.smithi142.stdout:8/253: dwrite d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:36.022 INFO:tasks.workunit.client.1.smithi142.stdout:3/328: write d12/d16/f17 [2727896,117527] 0 2024-09-13T02:52:36.024 INFO:tasks.workunit.client.1.smithi142.stdout:0/318: write d10/d15/d21/d51/f54 [2333033,14450] 0 2024-09-13T02:52:36.024 INFO:tasks.workunit.client.1.smithi142.stdout:8/254: truncate d0/f4c 801461 0 2024-09-13T02:52:36.028 INFO:tasks.workunit.client.1.smithi142.stdout:7/305: fsync f8 0 2024-09-13T02:52:36.029 INFO:tasks.workunit.client.1.smithi142.stdout:0/319: symlink d10/l72 0 2024-09-13T02:52:36.030 INFO:tasks.workunit.client.1.smithi142.stdout:3/329: rename d12/d16/d25/d3b to d12/d16/d25/d2e/d48/d5c 0 2024-09-13T02:52:36.033 INFO:tasks.workunit.client.1.smithi142.stdout:9/436: dwrite dd/d17/d4f/f80 [0,4194304] 0 2024-09-13T02:52:36.033 INFO:tasks.workunit.client.1.smithi142.stdout:5/336: dread d8/f15 [0,4194304] 0 2024-09-13T02:52:36.033 INFO:tasks.workunit.client.1.smithi142.stdout:7/306: creat d10/d13/d1d/d2b/d55/f67 x:0 0 0 2024-09-13T02:52:36.034 INFO:tasks.workunit.client.1.smithi142.stdout:5/337: stat d8/f15 0 2024-09-13T02:52:36.035 INFO:tasks.workunit.client.1.smithi142.stdout:9/437: readlink dd/d17/d69/d84/l3b 0 2024-09-13T02:52:36.038 INFO:tasks.workunit.client.1.smithi142.stdout:5/338: write d8/d24/d26/d45/f54 [536788,75789] 0 2024-09-13T02:52:36.038 INFO:tasks.workunit.client.1.smithi142.stdout:3/330: unlink d12/d16/d25/d2e/d48/f4b 0 2024-09-13T02:52:36.040 INFO:tasks.workunit.client.1.smithi142.stdout:9/438: write dd/d17/d25/f53 [1046158,66527] 0 2024-09-13T02:52:36.040 INFO:tasks.workunit.client.1.smithi142.stdout:5/339: write d8/f2e [5034210,97804] 0 2024-09-13T02:52:36.040 INFO:tasks.workunit.client.1.smithi142.stdout:3/331: truncate d12/f13 4903939 0 2024-09-13T02:52:36.041 INFO:tasks.workunit.client.1.smithi142.stdout:7/307: creat d10/d13/d1d/d2b/d56/d41/f68 x:0 0 0 2024-09-13T02:52:36.045 INFO:tasks.workunit.client.1.smithi142.stdout:4/301: dread d0/d2b/d2d/d31/d32/f3d [0,4194304] 0 2024-09-13T02:52:36.046 INFO:tasks.workunit.client.1.smithi142.stdout:3/332: fdatasync d12/d16/d25/f41 0 2024-09-13T02:52:36.047 INFO:tasks.workunit.client.1.smithi142.stdout:5/340: dread d8/fd [0,4194304] 0 2024-09-13T02:52:36.047 INFO:tasks.workunit.client.1.smithi142.stdout:4/302: stat d0/d2b/d13/f5e 0 2024-09-13T02:52:36.048 INFO:tasks.workunit.client.1.smithi142.stdout:3/333: chown d12/d16/d25/d2e/d48/d5c 765093 1 2024-09-13T02:52:36.048 INFO:tasks.workunit.client.1.smithi142.stdout:4/303: chown d0/d2b/d21/f2a 421878 1 2024-09-13T02:52:36.048 INFO:tasks.workunit.client.1.smithi142.stdout:3/334: write d12/f28 [4146919,33840] 0 2024-09-13T02:52:36.049 INFO:tasks.workunit.client.1.smithi142.stdout:9/439: truncate dd/d17/d69/d84/d41/f90 1717160 0 2024-09-13T02:52:36.049 INFO:tasks.workunit.client.1.smithi142.stdout:0/320: write d10/d15/d1a/d1e/d42/d4b/f61 [428781,60260] 0 2024-09-13T02:52:36.051 INFO:tasks.workunit.client.1.smithi142.stdout:0/321: fsync d10/d15/f6e 0 2024-09-13T02:52:36.052 INFO:tasks.workunit.client.1.smithi142.stdout:7/308: rename d10/d34/d57/f62 to d10/d13/d22/f69 0 2024-09-13T02:52:36.053 INFO:tasks.workunit.client.1.smithi142.stdout:5/341: read d8/d24/d26/f5c [7667325,122260] 0 2024-09-13T02:52:36.054 INFO:tasks.workunit.client.1.smithi142.stdout:3/335: creat d12/d16/d25/d2e/d38/d4d/d53/d55/f5d x:0 0 0 2024-09-13T02:52:36.055 INFO:tasks.workunit.client.1.smithi142.stdout:9/440: rename dd/d17/d25/l9e to dd/d17/d69/d84/la6 0 2024-09-13T02:52:36.056 INFO:tasks.workunit.client.1.smithi142.stdout:0/322: rename d10/d15 to d10/d15/d21/d51/d73 22 2024-09-13T02:52:36.058 INFO:tasks.workunit.client.1.smithi142.stdout:4/304: dwrite d0/d2b/d13/f1e [4194304,4194304] 0 2024-09-13T02:52:36.059 INFO:tasks.workunit.client.1.smithi142.stdout:3/336: rename d12/d16/d25/d2e/d38 to d12/d16/d25/d2e/d38/d4d/d53/d55/d5e 22 2024-09-13T02:52:36.060 INFO:tasks.workunit.client.1.smithi142.stdout:7/309: getdents d10/d13/d1d/d2b/d56/d5f 0 2024-09-13T02:52:36.061 INFO:tasks.workunit.client.1.smithi142.stdout:0/323: rmdir d10/d15/d21/d51 39 2024-09-13T02:52:36.061 INFO:tasks.workunit.client.1.smithi142.stdout:7/310: write d10/d13/d1d/d2b/d56/d41/f68 [909333,126394] 0 2024-09-13T02:52:36.065 INFO:tasks.workunit.client.1.smithi142.stdout:4/305: unlink d0/d2b/d2d/d31/d32/l4a 0 2024-09-13T02:52:36.065 INFO:tasks.workunit.client.1.smithi142.stdout:8/255: dread d0/d6/dc/d45/d8/f36 [0,4194304] 0 2024-09-13T02:52:36.066 INFO:tasks.workunit.client.1.smithi142.stdout:7/311: dread d10/d34/f5b [0,4194304] 0 2024-09-13T02:52:36.066 INFO:tasks.workunit.client.1.smithi142.stdout:3/337: creat d12/d16/d25/d2e/d48/f5f x:0 0 0 2024-09-13T02:52:36.066 INFO:tasks.workunit.client.1.smithi142.stdout:8/256: chown d0/d6/dc/d45/d35/d37/c39 330697 1 2024-09-13T02:52:36.067 INFO:tasks.workunit.client.1.smithi142.stdout:8/257: chown d0/d6/d23/d2b 140573 1 2024-09-13T02:52:36.071 INFO:tasks.workunit.client.1.smithi142.stdout:7/312: creat d10/d13/d1d/d2b/d56/f6a x:0 0 0 2024-09-13T02:52:36.072 INFO:tasks.workunit.client.1.smithi142.stdout:5/342: write d8/d24/d26/d2d/f38 [1626171,109188] 0 2024-09-13T02:52:36.073 INFO:tasks.workunit.client.1.smithi142.stdout:9/441: write f8 [320914,47200] 0 2024-09-13T02:52:36.073 INFO:tasks.workunit.client.1.smithi142.stdout:4/306: dwrite d0/d2b/d13/f2e [0,4194304] 0 2024-09-13T02:52:36.074 INFO:tasks.workunit.client.1.smithi142.stdout:8/258: write d0/d6/dc/f2f [785413,13722] 0 2024-09-13T02:52:36.076 INFO:tasks.workunit.client.1.smithi142.stdout:9/442: write dd/d17/d44/f4a [3457490,36303] 0 2024-09-13T02:52:36.077 INFO:tasks.workunit.client.1.smithi142.stdout:5/343: fdatasync d8/d24/f3e 0 2024-09-13T02:52:36.078 INFO:tasks.workunit.client.1.smithi142.stdout:4/307: truncate d0/d2b/d21/d35/f5f 753010 0 2024-09-13T02:52:36.081 INFO:tasks.workunit.client.1.smithi142.stdout:3/338: getdents d12/d16/d25/d2e/d38 0 2024-09-13T02:52:36.083 INFO:tasks.workunit.client.1.smithi142.stdout:8/259: creat d0/d6/dc/d45/d35/d37/f54 x:0 0 0 2024-09-13T02:52:36.084 INFO:tasks.workunit.client.0.smithi098.stdout:0/2: sync 2024-09-13T02:52:36.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/339: write d12/d16/d25/f40 [4713625,71607] 0 2024-09-13T02:52:36.088 INFO:tasks.workunit.client.1.smithi142.stdout:5/344: creat d8/d24/d26/d45/d62/f6c x:0 0 0 2024-09-13T02:52:36.088 INFO:tasks.workunit.client.0.smithi098.stdout:0/3: getdents . 0 2024-09-13T02:52:36.088 INFO:tasks.workunit.client.0.smithi098.stdout:0/4: fsync - no filename 2024-09-13T02:52:36.090 INFO:tasks.workunit.client.1.smithi142.stdout:8/260: read d0/d6/f24 [1825975,42708] 0 2024-09-13T02:52:36.091 INFO:tasks.workunit.client.1.smithi142.stdout:4/308: dwrite d0/d2b/d13/f1e [0,4194304] 0 2024-09-13T02:52:36.092 INFO:tasks.workunit.client.1.smithi142.stdout:9/443: dwrite dd/d17/d4f/d91/f93 [0,4194304] 0 2024-09-13T02:52:36.093 INFO:tasks.workunit.client.1.smithi142.stdout:5/345: mknod d8/d47/c6d 0 2024-09-13T02:52:36.093 INFO:tasks.workunit.client.0.smithi098.stdout:0/5: link c0 c2 0 2024-09-13T02:52:36.094 INFO:tasks.workunit.client.1.smithi142.stdout:5/346: chown d8/d24/d64 2018752 1 2024-09-13T02:52:36.094 INFO:tasks.workunit.client.1.smithi142.stdout:8/261: write d0/d6/dc/d40/d41/f4e [741182,7737] 0 2024-09-13T02:52:36.097 INFO:tasks.workunit.client.1.smithi142.stdout:3/340: dread d12/d16/f29 [0,4194304] 0 2024-09-13T02:52:36.098 INFO:tasks.workunit.client.0.smithi098.stdout:0/6: link c2 c3 0 2024-09-13T02:52:36.098 INFO:tasks.workunit.client.0.smithi098.stdout:0/7: dread - no filename 2024-09-13T02:52:36.098 INFO:tasks.workunit.client.0.smithi098.stdout:0/8: dwrite - no filename 2024-09-13T02:52:36.098 INFO:tasks.workunit.client.0.smithi098.stdout:0/9: write - no filename 2024-09-13T02:52:36.099 INFO:tasks.workunit.client.1.smithi142.stdout:7/313: dread d10/d13/d1d/f23 [0,4194304] 0 2024-09-13T02:52:36.100 INFO:tasks.workunit.client.1.smithi142.stdout:5/347: dread d8/f19 [0,4194304] 0 2024-09-13T02:52:36.100 INFO:tasks.workunit.client.1.smithi142.stdout:4/309: mknod d0/d2b/c61 0 2024-09-13T02:52:36.100 INFO:tasks.workunit.client.1.smithi142.stdout:7/314: truncate d10/d13/d1d/f2d 4884751 0 2024-09-13T02:52:36.101 INFO:tasks.workunit.client.1.smithi142.stdout:7/315: chown d10/d13/c2a 0 1 2024-09-13T02:52:36.103 INFO:tasks.workunit.client.1.smithi142.stdout:5/348: read d8/d24/d3f/d4a/d4b/f56 [13850,70447] 0 2024-09-13T02:52:36.104 INFO:tasks.workunit.client.1.smithi142.stdout:3/341: creat d12/d16/d25/f60 x:0 0 0 2024-09-13T02:52:36.105 INFO:tasks.workunit.client.1.smithi142.stdout:8/262: creat d0/d6/d23/d2b/f55 x:0 0 0 2024-09-13T02:52:36.106 INFO:tasks.workunit.client.1.smithi142.stdout:9/444: read dd/d17/f2b [2956587,105199] 0 2024-09-13T02:52:36.106 INFO:tasks.workunit.client.0.smithi098.stdout:0/10: chown c2 475275 1 2024-09-13T02:52:36.106 INFO:tasks.workunit.client.0.smithi098.stdout:0/11: dwrite - no filename 2024-09-13T02:52:36.107 INFO:tasks.workunit.client.1.smithi142.stdout:5/349: dread d8/d24/d26/f60 [0,4194304] 0 2024-09-13T02:52:36.108 INFO:tasks.workunit.client.1.smithi142.stdout:8/263: stat d0/d6/dc/fe 0 2024-09-13T02:52:36.108 INFO:tasks.workunit.client.1.smithi142.stdout:5/350: fdatasync d8/f1e 0 2024-09-13T02:52:36.109 INFO:tasks.workunit.client.1.smithi142.stdout:4/310: dwrite d0/df/d57/f11 [4194304,4194304] 0 2024-09-13T02:52:36.110 INFO:tasks.workunit.client.0.smithi098.stdout:0/12: creat f4 x:0 0 0 2024-09-13T02:52:36.111 INFO:tasks.workunit.client.1.smithi142.stdout:3/342: mknod d12/d16/d25/d2e/d48/c61 0 2024-09-13T02:52:36.113 INFO:tasks.workunit.client.0.smithi098.stdout:0/13: chown c3 3887601 1 2024-09-13T02:52:36.113 INFO:tasks.workunit.client.0.smithi098.stdout:0/14: truncate f4 372873 0 2024-09-13T02:52:36.115 INFO:tasks.workunit.client.0.smithi098.stdout:0/15: dread f4 [0,4194304] 0 2024-09-13T02:52:36.116 INFO:tasks.workunit.client.1.smithi142.stdout:5/351: dwrite d8/f1e [4194304,4194304] 0 2024-09-13T02:52:36.116 INFO:tasks.workunit.client.1.smithi142.stdout:4/311: symlink d0/d2b/d2d/l62 0 2024-09-13T02:52:36.116 INFO:tasks.workunit.client.1.smithi142.stdout:6/353: sync 2024-09-13T02:52:36.116 INFO:tasks.workunit.client.1.smithi142.stdout:0/324: dread d10/d23/f58 [0,4194304] 0 2024-09-13T02:52:36.117 INFO:tasks.workunit.client.0.smithi098.stdout:0/16: dread f4 [0,4194304] 0 2024-09-13T02:52:36.117 INFO:tasks.workunit.client.1.smithi142.stdout:5/352: read d8/fd [3863453,35798] 0 2024-09-13T02:52:36.118 INFO:tasks.workunit.client.1.smithi142.stdout:0/325: chown d10/d15/d45/l6a 15 1 2024-09-13T02:52:36.118 INFO:tasks.workunit.client.1.smithi142.stdout:9/445: mkdir dd/d17/da7 0 2024-09-13T02:52:36.120 INFO:tasks.workunit.client.1.smithi142.stdout:0/326: write d10/d15/d45/f56 [326648,84283] 0 2024-09-13T02:52:36.120 INFO:tasks.workunit.client.0.smithi098.stdout:0/17: write f4 [640099,50048] 0 2024-09-13T02:52:36.122 INFO:tasks.workunit.client.1.smithi142.stdout:7/316: creat d10/d13/d1d/d2b/f6b x:0 0 0 2024-09-13T02:52:36.124 INFO:tasks.workunit.client.1.smithi142.stdout:6/354: fdatasync d1/dd/d16/f3c 0 2024-09-13T02:52:36.125 INFO:tasks.workunit.client.1.smithi142.stdout:0/327: dread d10/d15/d1a/d1e/d42/d4b/f61 [0,4194304] 0 2024-09-13T02:52:36.126 INFO:tasks.workunit.client.1.smithi142.stdout:0/328: fdatasync d10/d15/d1a/f22 0 2024-09-13T02:52:36.126 INFO:tasks.workunit.client.1.smithi142.stdout:4/312: creat d0/d2b/d2d/d31/d43/f63 x:0 0 0 2024-09-13T02:52:36.128 INFO:tasks.workunit.client.1.smithi142.stdout:5/353: symlink d8/d24/d26/d45/d62/l6e 0 2024-09-13T02:52:36.130 INFO:tasks.workunit.client.1.smithi142.stdout:3/343: creat d12/d16/d3c/f62 x:0 0 0 2024-09-13T02:52:36.131 INFO:tasks.workunit.client.1.smithi142.stdout:7/317: symlink d10/d13/d21/l6c 0 2024-09-13T02:52:36.132 INFO:tasks.workunit.client.1.smithi142.stdout:6/355: dread d1/f3d [0,4194304] 0 2024-09-13T02:52:36.133 INFO:tasks.workunit.client.1.smithi142.stdout:0/329: creat d10/d15/d1a/d1e/d42/d4b/f74 x:0 0 0 2024-09-13T02:52:36.133 INFO:tasks.workunit.client.0.smithi098.stdout:0/18: dread f4 [0,4194304] 0 2024-09-13T02:52:36.133 INFO:tasks.workunit.client.1.smithi142.stdout:9/446: dread dd/f1a [0,4194304] 0 2024-09-13T02:52:36.134 INFO:tasks.workunit.client.1.smithi142.stdout:7/318: write d10/d31/f43 [590460,107403] 0 2024-09-13T02:52:36.135 INFO:tasks.workunit.client.0.smithi098.stdout:0/19: dread f4 [0,4194304] 0 2024-09-13T02:52:36.135 INFO:tasks.workunit.client.1.smithi142.stdout:5/354: dread d8/d24/d3f/d4a/f50 [0,4194304] 0 2024-09-13T02:52:36.137 INFO:tasks.workunit.client.1.smithi142.stdout:9/447: write dd/d17/d25/f53 [15752,55343] 0 2024-09-13T02:52:36.138 INFO:tasks.workunit.client.1.smithi142.stdout:4/313: getdents d0/d2b/d2d/d31 0 2024-09-13T02:52:36.138 INFO:tasks.workunit.client.0.smithi098.stdout:0/20: rename c0 to c5 0 2024-09-13T02:52:36.141 INFO:tasks.workunit.client.0.smithi098.stdout:0/21: symlink l6 0 2024-09-13T02:52:36.142 INFO:tasks.workunit.client.1.smithi142.stdout:7/319: dread d10/d13/d1d/d2b/d56/d41/f68 [0,4194304] 0 2024-09-13T02:52:36.143 INFO:tasks.workunit.client.1.smithi142.stdout:5/355: creat d8/d24/d4d/f6f x:0 0 0 2024-09-13T02:52:36.144 INFO:tasks.workunit.client.1.smithi142.stdout:6/356: dwrite d1/dd/d53/f73 [0,4194304] 0 2024-09-13T02:52:36.146 INFO:tasks.workunit.client.1.smithi142.stdout:5/356: dread d8/d24/d3f/f40 [0,4194304] 0 2024-09-13T02:52:36.147 INFO:tasks.workunit.client.0.smithi098.stdout:0/22: write f4 [655598,56053] 0 2024-09-13T02:52:36.147 INFO:tasks.workunit.client.1.smithi142.stdout:8/264: truncate d0/fb 3847258 0 2024-09-13T02:52:36.148 INFO:tasks.workunit.client.1.smithi142.stdout:5/357: truncate d8/d24/d26/f6a 942378 0 2024-09-13T02:52:36.150 INFO:tasks.workunit.client.1.smithi142.stdout:5/358: chown d8/c29 10144894 1 2024-09-13T02:52:36.151 INFO:tasks.workunit.client.1.smithi142.stdout:3/344: link d12/d16/f17 d12/d16/d25/d2e/d38/d4d/d53/d55/f63 0 2024-09-13T02:52:36.151 INFO:tasks.workunit.client.1.smithi142.stdout:8/265: dread - d0/d6/dc/d45/d35/d37/f54 zero size 2024-09-13T02:52:36.151 INFO:tasks.workunit.client.1.smithi142.stdout:7/320: dread d10/d13/d1d/f23 [0,4194304] 0 2024-09-13T02:52:36.152 INFO:tasks.workunit.client.0.smithi098.stdout:0/23: symlink l7 0 2024-09-13T02:52:36.153 INFO:tasks.workunit.client.1.smithi142.stdout:8/266: chown d0/d6/dc/d45/f3 11 1 2024-09-13T02:52:36.154 INFO:tasks.workunit.client.1.smithi142.stdout:5/359: dread d8/d24/d26/f60 [0,4194304] 0 2024-09-13T02:52:36.154 INFO:tasks.workunit.client.1.smithi142.stdout:9/448: rename dd/d17/da7 to dd/d17/d44/d82/d99/da8 0 2024-09-13T02:52:36.157 INFO:tasks.workunit.client.0.smithi098.stdout:0/24: creat f8 x:0 0 0 2024-09-13T02:52:36.159 INFO:tasks.workunit.client.1.smithi142.stdout:0/330: dread d10/f13 [0,4194304] 0 2024-09-13T02:52:36.160 INFO:tasks.workunit.client.1.smithi142.stdout:9/449: dwrite dd/d17/f26 [0,4194304] 0 2024-09-13T02:52:36.161 INFO:tasks.workunit.client.1.smithi142.stdout:0/331: truncate d10/d15/d45/f57 871870 0 2024-09-13T02:52:36.161 INFO:tasks.workunit.client.1.smithi142.stdout:3/345: creat d12/d16/d25/d2e/d38/d4d/f64 x:0 0 0 2024-09-13T02:52:36.163 INFO:tasks.workunit.client.1.smithi142.stdout:7/321: rmdir d10/d13/d1d/d25 39 2024-09-13T02:52:36.163 INFO:tasks.workunit.client.1.smithi142.stdout:0/332: dread - d10/d15/d1a/d3a/f5c zero size 2024-09-13T02:52:36.165 INFO:tasks.workunit.client.0.smithi098.stdout:0/25: dwrite f4 [0,4194304] 0 2024-09-13T02:52:36.165 INFO:tasks.workunit.client.1.smithi142.stdout:8/267: write d0/d6/dc/d45/d8/f36 [1471044,58099] 0 2024-09-13T02:52:36.166 INFO:tasks.workunit.client.0.smithi098.stdout:0/26: truncate f4 4850843 0 2024-09-13T02:52:36.166 INFO:tasks.workunit.client.0.smithi098.stdout:0/27: readlink l7 0 2024-09-13T02:52:36.166 INFO:tasks.workunit.client.1.smithi142.stdout:8/268: stat d0/d6/dc/d45/d8/df/d28 0 2024-09-13T02:52:36.167 INFO:tasks.workunit.client.1.smithi142.stdout:5/360: dread d8/d24/f5f [0,4194304] 0 2024-09-13T02:52:36.169 INFO:tasks.workunit.client.1.smithi142.stdout:9/450: creat dd/d17/d69/d84/fa9 x:0 0 0 2024-09-13T02:52:36.175 INFO:tasks.workunit.client.1.smithi142.stdout:0/333: symlink d10/d15/d1a/d1e/l75 0 2024-09-13T02:52:36.176 INFO:tasks.workunit.client.0.smithi098.stdout:0/28: dwrite f8 [0,4194304] 0 2024-09-13T02:52:36.179 INFO:tasks.workunit.client.1.smithi142.stdout:6/357: rmdir d1/dd/d72 0 2024-09-13T02:52:36.180 INFO:tasks.workunit.client.1.smithi142.stdout:2/222: sync 2024-09-13T02:52:36.181 INFO:tasks.workunit.client.1.smithi142.stdout:8/269: creat d0/d6/dc/d45/d35/f56 x:0 0 0 2024-09-13T02:52:36.182 INFO:tasks.workunit.client.1.smithi142.stdout:0/334: dwrite d10/d15/d21/f3c [0,4194304] 0 2024-09-13T02:52:36.183 INFO:tasks.workunit.client.0.smithi098.stdout:0/29: rename l1 to l9 0 2024-09-13T02:52:36.183 INFO:tasks.workunit.client.1.smithi142.stdout:2/223: stat d1/de/d1f/f37 0 2024-09-13T02:52:36.183 INFO:tasks.workunit.client.1.smithi142.stdout:4/314: dwrite d0/df/f23 [0,4194304] 0 2024-09-13T02:52:36.184 INFO:tasks.workunit.client.0.smithi098.stdout:0/30: write f4 [554557,80265] 0 2024-09-13T02:52:36.184 INFO:tasks.workunit.client.1.smithi142.stdout:5/361: write d8/d24/d3f/d4a/f50 [5089303,103928] 0 2024-09-13T02:52:36.186 INFO:tasks.workunit.client.1.smithi142.stdout:9/451: write fb [698561,123799] 0 2024-09-13T02:52:36.190 INFO:tasks.workunit.client.1.smithi142.stdout:7/322: mkdir d10/d13/d1d/d25/d45/d6d 0 2024-09-13T02:52:36.191 INFO:tasks.workunit.client.1.smithi142.stdout:9/452: chown cc 124190914 1 2024-09-13T02:52:36.192 INFO:tasks.workunit.client.1.smithi142.stdout:6/358: symlink d1/dd/d16/l77 0 2024-09-13T02:52:36.195 INFO:tasks.workunit.client.1.smithi142.stdout:7/323: dread d10/d13/d1d/f23 [4194304,4194304] 0 2024-09-13T02:52:36.198 INFO:tasks.workunit.client.1.smithi142.stdout:5/362: symlink d8/l70 0 2024-09-13T02:52:36.202 INFO:tasks.workunit.client.1.smithi142.stdout:6/359: mkdir d1/dd/d53/d78 0 2024-09-13T02:52:36.203 INFO:tasks.workunit.client.1.smithi142.stdout:0/335: creat d10/d15/d21/d51/d35/f76 x:0 0 0 2024-09-13T02:52:36.206 INFO:tasks.workunit.client.1.smithi142.stdout:4/315: symlink d0/l64 0 2024-09-13T02:52:36.208 INFO:tasks.workunit.client.1.smithi142.stdout:5/363: rename d8/fd to d8/d24/d26/d61/f71 0 2024-09-13T02:52:36.209 INFO:tasks.workunit.client.1.smithi142.stdout:3/346: getdents d12/d16/d25/d2e/d48/d5c 0 2024-09-13T02:52:36.209 INFO:tasks.workunit.client.1.smithi142.stdout:5/364: readlink d8/d24/d4d/l52 0 2024-09-13T02:52:36.212 INFO:tasks.workunit.client.1.smithi142.stdout:7/324: creat d10/d34/d65/f6e x:0 0 0 2024-09-13T02:52:36.213 INFO:tasks.workunit.client.0.smithi098.stdout:0/31: truncate f4 1088375 0 2024-09-13T02:52:36.213 INFO:tasks.workunit.client.1.smithi142.stdout:7/325: write d10/d13/d1d/f2c [1271295,11884] 0 2024-09-13T02:52:36.217 INFO:tasks.workunit.client.1.smithi142.stdout:0/336: fsync d10/d15/d21/d51/d35/f76 0 2024-09-13T02:52:36.218 INFO:tasks.workunit.client.1.smithi142.stdout:0/337: write d10/d15/d45/f57 [276758,20597] 0 2024-09-13T02:52:36.219 INFO:tasks.workunit.client.0.smithi098.stdout:0/32: dwrite f8 [0,4194304] 0 2024-09-13T02:52:36.219 INFO:tasks.workunit.client.1.smithi142.stdout:0/338: write d10/d15/d36/f59 [755347,50932] 0 2024-09-13T02:52:36.220 INFO:tasks.workunit.client.0.smithi098.stdout:0/33: chown f4 20568182 1 2024-09-13T02:52:36.220 INFO:tasks.workunit.client.1.smithi142.stdout:5/365: rename d8/c39 to d8/d24/d3f/d4a/c72 0 2024-09-13T02:52:36.221 INFO:tasks.workunit.client.1.smithi142.stdout:8/270: truncate d0/d6/dc/d45/d8/f1d 8548137 0 2024-09-13T02:52:36.221 INFO:tasks.workunit.client.1.smithi142.stdout:5/366: truncate d8/d24/d26/f31 1223977 0 2024-09-13T02:52:36.223 INFO:tasks.workunit.client.1.smithi142.stdout:6/360: mknod d1/d7/d19/c79 0 2024-09-13T02:52:36.227 INFO:tasks.workunit.client.1.smithi142.stdout:8/271: dread d0/d6/dc/d45/d8/f36 [0,4194304] 0 2024-09-13T02:52:36.229 INFO:tasks.workunit.client.1.smithi142.stdout:7/326: mknod d10/d34/d65/c6f 0 2024-09-13T02:52:36.232 INFO:tasks.workunit.client.1.smithi142.stdout:6/361: dwrite d1/d7/f3e [0,4194304] 0 2024-09-13T02:52:36.237 INFO:tasks.workunit.client.1.smithi142.stdout:7/327: write d10/d13/f20 [2076733,27254] 0 2024-09-13T02:52:36.237 INFO:tasks.workunit.client.1.smithi142.stdout:6/362: dread - d1/dd/d16/d4e/d32/f64 zero size 2024-09-13T02:52:36.237 INFO:tasks.workunit.client.1.smithi142.stdout:4/316: dwrite d0/df/f29 [0,4194304] 0 2024-09-13T02:52:36.237 INFO:tasks.workunit.client.1.smithi142.stdout:0/339: creat d10/d15/d1a/d1e/d42/f77 x:0 0 0 2024-09-13T02:52:36.237 INFO:tasks.workunit.client.0.smithi098.stdout:2/2: sync 2024-09-13T02:52:36.238 INFO:tasks.workunit.client.0.smithi098.stdout:6/2: sync 2024-09-13T02:52:36.238 INFO:tasks.workunit.client.0.smithi098.stdout:2/3: write - no filename 2024-09-13T02:52:36.238 INFO:tasks.workunit.client.0.smithi098.stdout:5/0: sync 2024-09-13T02:52:36.238 INFO:tasks.workunit.client.0.smithi098.stdout:0/34: truncate f8 3174454 0 2024-09-13T02:52:36.240 INFO:tasks.workunit.client.1.smithi142.stdout:3/347: truncate d12/f22 2485629 0 2024-09-13T02:52:36.241 INFO:tasks.workunit.client.0.smithi098.stdout:5/1: mkdir d0 0 2024-09-13T02:52:36.241 INFO:tasks.workunit.client.1.smithi142.stdout:2/224: getdents d1/d42 0 2024-09-13T02:52:36.242 INFO:tasks.workunit.client.0.smithi098.stdout:2/4: creat f0 x:0 0 0 2024-09-13T02:52:36.244 INFO:tasks.workunit.client.1.smithi142.stdout:3/348: write d12/d16/d25/d2e/d38/f45 [1569573,12101] 0 2024-09-13T02:52:36.244 INFO:tasks.workunit.client.0.smithi098.stdout:6/3: mknod c0 0 2024-09-13T02:52:36.247 INFO:tasks.workunit.client.1.smithi142.stdout:6/363: rmdir d1/dd/d16 39 2024-09-13T02:52:36.248 INFO:tasks.workunit.client.1.smithi142.stdout:7/328: dwrite d10/d13/d1d/d2b/d56/f59 [0,4194304] 0 2024-09-13T02:52:36.250 INFO:tasks.workunit.client.0.smithi098.stdout:2/5: dwrite f0 [0,4194304] 0 2024-09-13T02:52:36.251 INFO:tasks.workunit.client.0.smithi098.stdout:5/2: mkdir d0/d1 0 2024-09-13T02:52:36.253 INFO:tasks.workunit.client.1.smithi142.stdout:0/340: mknod d10/d15/d1a/d1e/d42/c78 0 2024-09-13T02:52:36.256 INFO:tasks.workunit.client.1.smithi142.stdout:3/349: dwrite d12/d16/d25/d2e/d48/f5f [0,4194304] 0 2024-09-13T02:52:36.256 INFO:tasks.workunit.client.1.smithi142.stdout:5/367: creat d8/d24/d26/d63/f73 x:0 0 0 2024-09-13T02:52:36.258 INFO:tasks.workunit.client.1.smithi142.stdout:5/368: chown d8/d47/d65 34549 1 2024-09-13T02:52:36.259 INFO:tasks.workunit.client.1.smithi142.stdout:4/317: rename d0/d2b/d13 to d0/d2b/d2d/d65 0 2024-09-13T02:52:36.260 INFO:tasks.workunit.client.1.smithi142.stdout:5/369: rename d8/d47 to d8/d47/d74 22 2024-09-13T02:52:36.261 INFO:tasks.workunit.client.1.smithi142.stdout:7/329: dwrite d10/d34/f5a [0,4194304] 0 2024-09-13T02:52:36.261 INFO:tasks.workunit.client.1.smithi142.stdout:4/318: chown d0/d2b/d21 652558 1 2024-09-13T02:52:36.262 INFO:tasks.workunit.client.0.smithi098.stdout:2/6: mkdir d1 0 2024-09-13T02:52:36.264 INFO:tasks.workunit.client.0.smithi098.stdout:4/17: sync 2024-09-13T02:52:36.265 INFO:tasks.workunit.client.0.smithi098.stdout:8/22: sync 2024-09-13T02:52:36.265 INFO:tasks.workunit.client.0.smithi098.stdout:3/9: sync 2024-09-13T02:52:36.266 INFO:tasks.workunit.client.1.smithi142.stdout:8/272: link d0/d6/dc/d40/d41/f4e d0/d6/dc/d2e/f57 0 2024-09-13T02:52:36.267 INFO:tasks.workunit.client.1.smithi142.stdout:4/319: read - d0/d2b/d21/d30/f3a zero size 2024-09-13T02:52:36.268 INFO:tasks.workunit.client.0.smithi098.stdout:2/7: dread f0 [0,4194304] 0 2024-09-13T02:52:36.268 INFO:tasks.workunit.client.0.smithi098.stdout:2/8: readlink - no filename 2024-09-13T02:52:36.270 INFO:tasks.workunit.client.1.smithi142.stdout:1/434: sync 2024-09-13T02:52:36.271 INFO:tasks.workunit.client.1.smithi142.stdout:8/273: chown d0/d6/dc/d45/d8/f29 0 1 2024-09-13T02:52:36.272 INFO:tasks.workunit.client.1.smithi142.stdout:1/435: write fe [1673729,31879] 0 2024-09-13T02:52:36.272 INFO:tasks.workunit.client.0.smithi098.stdout:0/35: getdents . 0 2024-09-13T02:52:36.273 INFO:tasks.workunit.client.1.smithi142.stdout:2/225: dwrite d1/f2f [0,4194304] 0 2024-09-13T02:52:36.274 INFO:tasks.workunit.client.1.smithi142.stdout:1/436: write d12/d13/d1d/f6c [4917411,6257] 0 2024-09-13T02:52:36.280 INFO:tasks.workunit.client.1.smithi142.stdout:0/341: mkdir d10/d15/d21/d51/d79 0 2024-09-13T02:52:36.282 INFO:tasks.workunit.client.0.smithi098.stdout:3/10: chown l2 216938 1 2024-09-13T02:52:36.285 INFO:tasks.workunit.client.0.smithi098.stdout:8/23: symlink d2/l4 0 2024-09-13T02:52:36.286 INFO:tasks.workunit.client.0.smithi098.stdout:8/24: write d2/f3 [964131,126322] 0 2024-09-13T02:52:36.286 INFO:tasks.workunit.client.1.smithi142.stdout:9/453: sync 2024-09-13T02:52:36.287 INFO:tasks.workunit.client.0.smithi098.stdout:5/3: creat d0/d1/f2 x:0 0 0 2024-09-13T02:52:36.288 INFO:tasks.workunit.client.1.smithi142.stdout:9/454: fsync dd/d17/d69/d84/fa9 0 2024-09-13T02:52:36.289 INFO:tasks.workunit.client.1.smithi142.stdout:5/370: rename d8/f44 to d8/d24/d3f/f75 0 2024-09-13T02:52:36.290 INFO:tasks.workunit.client.0.smithi098.stdout:6/4: link c0 c1 0 2024-09-13T02:52:36.293 INFO:tasks.workunit.client.1.smithi142.stdout:8/274: fdatasync d0/d6/f24 0 2024-09-13T02:52:36.294 INFO:tasks.workunit.client.1.smithi142.stdout:6/364: creat d1/d7/d5f/d6a/f7a x:0 0 0 2024-09-13T02:52:36.297 INFO:tasks.workunit.client.0.smithi098.stdout:5/4: unlink d0/d1/f2 0 2024-09-13T02:52:36.298 INFO:tasks.workunit.client.0.smithi098.stdout:2/9: creat d1/f2 x:0 0 0 2024-09-13T02:52:36.299 INFO:tasks.workunit.client.0.smithi098.stdout:2/10: readlink - no filename 2024-09-13T02:52:36.299 INFO:tasks.workunit.client.1.smithi142.stdout:1/437: creat d12/d13/d20/d66/d55/f8f x:0 0 0 2024-09-13T02:52:36.300 INFO:tasks.workunit.client.0.smithi098.stdout:3/11: dwrite f1 [0,4194304] 0 2024-09-13T02:52:36.300 INFO:tasks.workunit.client.1.smithi142.stdout:1/438: chown d12/d1b/c7b 0 1 2024-09-13T02:52:36.301 INFO:tasks.workunit.client.0.smithi098.stdout:8/25: read d2/f3 [773261,70994] 0 2024-09-13T02:52:36.306 INFO:tasks.workunit.client.0.smithi098.stdout:4/18: write f0 [2357163,1855] 0 2024-09-13T02:52:36.308 INFO:tasks.workunit.client.1.smithi142.stdout:4/320: mknod d0/d2b/c66 0 2024-09-13T02:52:36.309 INFO:tasks.workunit.client.0.smithi098.stdout:2/11: write f0 [4397625,14076] 0 2024-09-13T02:52:36.311 INFO:tasks.workunit.client.1.smithi142.stdout:5/371: rename d8/d24/c30 to d8/d24/d26/d45/d62/c76 0 2024-09-13T02:52:36.311 INFO:tasks.workunit.client.1.smithi142.stdout:9/455: dwrite f5 [0,4194304] 0 2024-09-13T02:52:36.312 INFO:tasks.workunit.client.0.smithi098.stdout:3/12: symlink l3 0 2024-09-13T02:52:36.313 INFO:tasks.workunit.client.1.smithi142.stdout:7/330: symlink d10/d13/d1d/d2b/d56/d5f/l70 0 2024-09-13T02:52:36.314 INFO:tasks.workunit.client.0.smithi098.stdout:2/12: fdatasync f0 0 2024-09-13T02:52:36.314 INFO:tasks.workunit.client.1.smithi142.stdout:9/456: truncate dd/d17/d69/d84/fa9 209254 0 2024-09-13T02:52:36.316 INFO:tasks.workunit.client.1.smithi142.stdout:6/365: mkdir d1/dd/d57/d7b 0 2024-09-13T02:52:36.318 INFO:tasks.workunit.client.1.smithi142.stdout:2/226: symlink d1/d29/d2b/d47/l4b 0 2024-09-13T02:52:36.319 INFO:tasks.workunit.client.1.smithi142.stdout:2/227: stat d1/de/d31/f3d 0 2024-09-13T02:52:36.320 INFO:tasks.workunit.client.1.smithi142.stdout:5/372: dwrite d8/d24/d26/d2d/f38 [0,4194304] 0 2024-09-13T02:52:36.321 INFO:tasks.workunit.client.0.smithi098.stdout:4/19: rename l1 to l2 0 2024-09-13T02:52:36.322 INFO:tasks.workunit.client.0.smithi098.stdout:3/13: dwrite f1 [4194304,4194304] 0 2024-09-13T02:52:36.323 INFO:tasks.workunit.client.0.smithi098.stdout:4/20: chown f0 28690 1 2024-09-13T02:52:36.325 INFO:tasks.workunit.client.0.smithi098.stdout:8/26: dwrite d2/f3 [0,4194304] 0 2024-09-13T02:52:36.325 INFO:tasks.workunit.client.0.smithi098.stdout:4/21: write f0 [96643,46620] 0 2024-09-13T02:52:36.328 INFO:tasks.workunit.client.0.smithi098.stdout:4/22: write f0 [3324389,32229] 0 2024-09-13T02:52:36.332 INFO:tasks.workunit.client.0.smithi098.stdout:0/36: truncate f8 2126254 0 2024-09-13T02:52:36.333 INFO:tasks.workunit.client.1.smithi142.stdout:4/321: rmdir d0/df/d57 39 2024-09-13T02:52:36.335 INFO:tasks.workunit.client.0.smithi098.stdout:8/27: dread d2/f3 [0,4194304] 0 2024-09-13T02:52:36.335 INFO:tasks.workunit.client.0.smithi098.stdout:2/13: mkdir d1/d3 0 2024-09-13T02:52:36.339 INFO:tasks.workunit.client.1.smithi142.stdout:9/457: mknod dd/d17/d68/caa 0 2024-09-13T02:52:36.340 INFO:tasks.workunit.client.0.smithi098.stdout:3/14: creat f4 x:0 0 0 2024-09-13T02:52:36.340 INFO:tasks.workunit.client.1.smithi142.stdout:6/366: fsync d1/d7/d19/f45 0 2024-09-13T02:52:36.341 INFO:tasks.workunit.client.1.smithi142.stdout:2/228: symlink d1/d29/l4c 0 2024-09-13T02:52:36.342 INFO:tasks.workunit.client.1.smithi142.stdout:2/229: chown d1/de/d1f/d13/f33 1 1 2024-09-13T02:52:36.343 INFO:tasks.workunit.client.1.smithi142.stdout:2/230: fdatasync d1/f48 0 2024-09-13T02:52:36.344 INFO:tasks.workunit.client.1.smithi142.stdout:3/350: link d12/d16/l39 d12/d16/d25/d2e/d38/d4d/d53/d55/l65 0 2024-09-13T02:52:36.345 INFO:tasks.workunit.client.1.smithi142.stdout:3/351: stat d12/d16/d25/d2e/d48/c61 0 2024-09-13T02:52:36.346 INFO:tasks.workunit.client.0.smithi098.stdout:0/37: creat fa x:0 0 0 2024-09-13T02:52:36.347 INFO:tasks.workunit.client.0.smithi098.stdout:8/28: symlink d2/l5 0 2024-09-13T02:52:36.347 INFO:tasks.workunit.client.1.smithi142.stdout:7/331: mknod d10/d13/d1d/d2b/d55/d32/c71 0 2024-09-13T02:52:36.349 INFO:tasks.workunit.client.1.smithi142.stdout:2/231: dwrite d1/d29/f30 [0,4194304] 0 2024-09-13T02:52:36.349 INFO:tasks.workunit.client.0.smithi098.stdout:2/14: unlink d1/f2 0 2024-09-13T02:52:36.350 INFO:tasks.workunit.client.1.smithi142.stdout:9/458: mkdir dd/d17/d4f/d91/dab 0 2024-09-13T02:52:36.351 INFO:tasks.workunit.client.0.smithi098.stdout:5/5: getdents d0 0 2024-09-13T02:52:36.351 INFO:tasks.workunit.client.0.smithi098.stdout:5/6: dread - no filename 2024-09-13T02:52:36.352 INFO:tasks.workunit.client.1.smithi142.stdout:6/367: mknod d1/d7/d5f/d6a/c7c 0 2024-09-13T02:52:36.353 INFO:tasks.workunit.client.1.smithi142.stdout:5/373: creat d8/d24/d64/d68/f77 x:0 0 0 2024-09-13T02:52:36.357 INFO:tasks.workunit.client.0.smithi098.stdout:4/23: link f0 f3 0 2024-09-13T02:52:36.358 INFO:tasks.workunit.client.1.smithi142.stdout:1/439: creat d12/d13/d1d/f90 x:0 0 0 2024-09-13T02:52:36.361 INFO:tasks.workunit.client.1.smithi142.stdout:0/342: sync 2024-09-13T02:52:36.361 INFO:tasks.workunit.client.1.smithi142.stdout:8/275: sync 2024-09-13T02:52:36.363 INFO:tasks.workunit.client.0.smithi098.stdout:8/29: dread f1 [0,4194304] 0 2024-09-13T02:52:36.367 INFO:tasks.workunit.client.0.smithi098.stdout:8/30: dread d2/f3 [0,4194304] 0 2024-09-13T02:52:36.369 INFO:tasks.workunit.client.1.smithi142.stdout:3/352: rename d12/d16/d25/d2e/d38/d4d/d53/d55 to d12/d16/d25/d2e/d48/d5c/d66 0 2024-09-13T02:52:36.370 INFO:tasks.workunit.client.0.smithi098.stdout:5/7: mknod d0/d1/c3 0 2024-09-13T02:52:36.370 INFO:tasks.workunit.client.0.smithi098.stdout:5/8: stat d0/d1/c3 0 2024-09-13T02:52:36.371 INFO:tasks.workunit.client.1.smithi142.stdout:7/332: rename d10/d31/c49 to d10/d31/c72 0 2024-09-13T02:52:36.374 INFO:tasks.workunit.client.1.smithi142.stdout:2/232: dwrite d1/fc [4194304,4194304] 0 2024-09-13T02:52:36.375 INFO:tasks.workunit.client.1.smithi142.stdout:9/459: unlink dd/d17/d25/d3e/l8c 0 2024-09-13T02:52:36.375 INFO:tasks.workunit.client.1.smithi142.stdout:1/440: dread d12/d13/d20/d27/d3c/d53/f54 [0,4194304] 0 2024-09-13T02:52:36.376 INFO:tasks.workunit.client.0.smithi098.stdout:4/24: symlink l4 0 2024-09-13T02:52:36.383 INFO:tasks.workunit.client.1.smithi142.stdout:8/276: dread d0/d6/dc/f49 [0,4194304] 0 2024-09-13T02:52:36.384 INFO:tasks.workunit.client.0.smithi098.stdout:8/31: creat d2/f6 x:0 0 0 2024-09-13T02:52:36.385 INFO:tasks.workunit.client.1.smithi142.stdout:4/322: creat d0/d2b/f67 x:0 0 0 2024-09-13T02:52:36.386 INFO:tasks.workunit.client.1.smithi142.stdout:4/323: fdatasync d0/df/f23 0 2024-09-13T02:52:36.386 INFO:tasks.workunit.client.0.smithi098.stdout:5/9: mknod d0/d1/c4 0 2024-09-13T02:52:36.386 INFO:tasks.workunit.client.1.smithi142.stdout:4/324: fdatasync d0/d2b/d2d/d31/d43/d48/f4d 0 2024-09-13T02:52:36.387 INFO:tasks.workunit.client.1.smithi142.stdout:4/325: read - d0/d2b/d2d/d65/f5e zero size 2024-09-13T02:52:36.388 INFO:tasks.workunit.client.1.smithi142.stdout:0/343: unlink d10/l72 0 2024-09-13T02:52:36.389 INFO:tasks.workunit.client.0.smithi098.stdout:3/15: link l3 l5 0 2024-09-13T02:52:36.394 INFO:tasks.workunit.client.1.smithi142.stdout:3/353: symlink d12/d16/d25/l67 0 2024-09-13T02:52:36.396 INFO:tasks.workunit.client.1.smithi142.stdout:7/333: mkdir d10/d13/d1d/d2b/d56/d5f/d73 0 2024-09-13T02:52:36.398 INFO:tasks.workunit.client.0.smithi098.stdout:2/15: truncate f0 3163646 0 2024-09-13T02:52:36.399 INFO:tasks.workunit.client.0.smithi098.stdout:4/25: dwrite f3 [0,4194304] 0 2024-09-13T02:52:36.402 INFO:tasks.workunit.client.1.smithi142.stdout:9/460: creat dd/d17/d25/fac x:0 0 0 2024-09-13T02:52:36.404 INFO:tasks.workunit.client.0.smithi098.stdout:5/10: symlink d0/l5 0 2024-09-13T02:52:36.405 INFO:tasks.workunit.client.1.smithi142.stdout:6/368: creat d1/d4a/f7d x:0 0 0 2024-09-13T02:52:36.409 INFO:tasks.workunit.client.0.smithi098.stdout:3/16: unlink l2 0 2024-09-13T02:52:36.409 INFO:tasks.workunit.client.0.smithi098.stdout:3/17: truncate f4 892487 0 2024-09-13T02:52:36.409 INFO:tasks.workunit.client.1.smithi142.stdout:1/441: mknod d12/d13/d20/d27/d3c/c91 0 2024-09-13T02:52:36.411 INFO:tasks.workunit.client.0.smithi098.stdout:0/38: write f8 [3017511,92885] 0 2024-09-13T02:52:36.416 INFO:tasks.workunit.client.0.smithi098.stdout:2/16: mkdir d1/d4 0 2024-09-13T02:52:36.417 INFO:tasks.workunit.client.1.smithi142.stdout:8/277: mknod d0/d6/d23/d2b/c58 0 2024-09-13T02:52:36.417 INFO:tasks.workunit.client.0.smithi098.stdout:5/11: creat d0/d1/f6 x:0 0 0 2024-09-13T02:52:36.418 INFO:tasks.workunit.client.0.smithi098.stdout:8/32: fsync d2/f6 0 2024-09-13T02:52:36.419 INFO:tasks.workunit.client.0.smithi098.stdout:5/12: truncate d0/d1/f6 716361 0 2024-09-13T02:52:36.420 INFO:tasks.workunit.client.0.smithi098.stdout:8/33: chown d2/l4 50304246 1 2024-09-13T02:52:36.420 INFO:tasks.workunit.client.0.smithi098.stdout:3/18: creat f6 x:0 0 0 2024-09-13T02:52:36.422 INFO:tasks.workunit.client.1.smithi142.stdout:4/326: rmdir d0/d2b/d21 39 2024-09-13T02:52:36.423 INFO:tasks.workunit.client.1.smithi142.stdout:4/327: stat d0/d2b/c12 0 2024-09-13T02:52:36.425 INFO:tasks.workunit.client.0.smithi098.stdout:4/26: rename f0 to f5 0 2024-09-13T02:52:36.426 INFO:tasks.workunit.client.0.smithi098.stdout:4/27: chown l4 12057697 1 2024-09-13T02:52:36.426 INFO:tasks.workunit.client.1.smithi142.stdout:3/354: mknod d12/d16/d25/d2e/d38/c68 0 2024-09-13T02:52:36.427 INFO:tasks.workunit.client.0.smithi098.stdout:2/17: fsync f0 0 2024-09-13T02:52:36.428 INFO:tasks.workunit.client.1.smithi142.stdout:8/278: dread d0/d6/dc/f2f [0,4194304] 0 2024-09-13T02:52:36.428 INFO:tasks.workunit.client.0.smithi098.stdout:2/18: chown d1/d4 1 1 2024-09-13T02:52:36.429 INFO:tasks.workunit.client.1.smithi142.stdout:7/334: mknod d10/d13/d1d/d2b/d55/d32/c74 0 2024-09-13T02:52:36.429 INFO:tasks.workunit.client.1.smithi142.stdout:7/335: dread - d10/d34/d65/f6e zero size 2024-09-13T02:52:36.430 INFO:tasks.workunit.client.0.smithi098.stdout:5/13: symlink d0/d1/l7 0 2024-09-13T02:52:36.431 INFO:tasks.workunit.client.1.smithi142.stdout:2/233: creat d1/de/d31/d46/f4d x:0 0 0 2024-09-13T02:52:36.432 INFO:tasks.workunit.client.0.smithi098.stdout:3/19: mkdir d7 0 2024-09-13T02:52:36.434 INFO:tasks.workunit.client.0.smithi098.stdout:8/34: symlink d2/l7 0 2024-09-13T02:52:36.435 INFO:tasks.workunit.client.1.smithi142.stdout:5/374: truncate d8/d24/d26/d61/f71 1386218 0 2024-09-13T02:52:36.437 INFO:tasks.workunit.client.1.smithi142.stdout:1/442: rename d12/d13/d20/d66/d7d/d83 to d12/d13/d20/d27/d3c/d71/d81/d92 0 2024-09-13T02:52:36.439 INFO:tasks.workunit.client.0.smithi098.stdout:3/20: dwrite f4 [0,4194304] 0 2024-09-13T02:52:36.440 INFO:tasks.workunit.client.0.smithi098.stdout:4/28: fdatasync f5 0 2024-09-13T02:52:36.441 INFO:tasks.workunit.client.0.smithi098.stdout:4/29: write f5 [611132,66998] 0 2024-09-13T02:52:36.441 INFO:tasks.workunit.client.1.smithi142.stdout:4/328: creat d0/d2b/d2d/d31/d43/d48/f68 x:0 0 0 2024-09-13T02:52:36.444 INFO:tasks.workunit.client.0.smithi098.stdout:0/39: write f4 [1078704,122601] 0 2024-09-13T02:52:36.447 INFO:tasks.workunit.client.0.smithi098.stdout:5/14: creat d0/d1/f8 x:0 0 0 2024-09-13T02:52:36.449 INFO:tasks.workunit.client.1.smithi142.stdout:7/336: creat d10/d13/d1d/d25/f75 x:0 0 0 2024-09-13T02:52:36.450 INFO:tasks.workunit.client.0.smithi098.stdout:8/35: mknod d2/c8 0 2024-09-13T02:52:36.456 INFO:tasks.workunit.client.0.smithi098.stdout:4/30: mkdir d6 0 2024-09-13T02:52:36.457 INFO:tasks.workunit.client.0.smithi098.stdout:3/21: fsync f4 0 2024-09-13T02:52:36.459 INFO:tasks.workunit.client.1.smithi142.stdout:5/375: dwrite d8/d24/d26/d2d/f2f [0,4194304] 0 2024-09-13T02:52:36.460 INFO:tasks.workunit.client.0.smithi098.stdout:2/19: mknod d1/d4/c5 0 2024-09-13T02:52:36.461 INFO:tasks.workunit.client.0.smithi098.stdout:2/20: readlink - no filename 2024-09-13T02:52:36.461 INFO:tasks.workunit.client.1.smithi142.stdout:1/443: mknod d12/d13/d20/d27/d3c/d71/c93 0 2024-09-13T02:52:36.462 INFO:tasks.workunit.client.0.smithi098.stdout:0/40: creat fb x:0 0 0 2024-09-13T02:52:36.463 INFO:tasks.workunit.client.0.smithi098.stdout:0/41: read f4 [883672,13777] 0 2024-09-13T02:52:36.463 INFO:tasks.workunit.client.0.smithi098.stdout:4/31: dwrite f3 [0,4194304] 0 2024-09-13T02:52:36.466 INFO:tasks.workunit.client.1.smithi142.stdout:3/355: write d12/d16/d25/f26 [4954476,91450] 0 2024-09-13T02:52:36.467 INFO:tasks.workunit.client.1.smithi142.stdout:3/356: stat d12/d16/d25/d2e/d48/d5c 0 2024-09-13T02:52:36.473 INFO:tasks.workunit.client.1.smithi142.stdout:0/344: mkdir d10/d15/d1a/d7a 0 2024-09-13T02:52:36.473 INFO:tasks.workunit.client.1.smithi142.stdout:0/345: readlink d10/d15/l27 0 2024-09-13T02:52:36.474 INFO:tasks.workunit.client.0.smithi098.stdout:0/42: dwrite fa [0,4194304] 0 2024-09-13T02:52:36.474 INFO:tasks.workunit.client.1.smithi142.stdout:0/346: write d10/d15/f46 [3051877,9460] 0 2024-09-13T02:52:36.475 INFO:tasks.workunit.client.1.smithi142.stdout:1/444: dread d12/d13/d20/f48 [0,4194304] 0 2024-09-13T02:52:36.476 INFO:tasks.workunit.client.0.smithi098.stdout:0/43: write f8 [3057133,115094] 0 2024-09-13T02:52:36.476 INFO:tasks.workunit.client.0.smithi098.stdout:0/44: stat l6 0 2024-09-13T02:52:36.478 INFO:tasks.workunit.client.1.smithi142.stdout:8/279: unlink d0/d6/dc/d45/d8/f1d 0 2024-09-13T02:52:36.479 INFO:tasks.workunit.client.0.smithi098.stdout:2/21: symlink d1/l6 0 2024-09-13T02:52:36.479 INFO:tasks.workunit.client.1.smithi142.stdout:6/369: sync 2024-09-13T02:52:36.486 INFO:tasks.workunit.client.1.smithi142.stdout:8/280: dwrite d0/d6/dc/d45/d35/d37/f54 [0,4194304] 0 2024-09-13T02:52:36.487 INFO:tasks.workunit.client.1.smithi142.stdout:2/234: rename d1/de/l25 to d1/de/d1f/d13/l4e 0 2024-09-13T02:52:36.487 INFO:tasks.workunit.client.1.smithi142.stdout:5/376: symlink d8/d24/d64/d68/l78 0 2024-09-13T02:52:36.488 INFO:tasks.workunit.client.1.smithi142.stdout:2/235: write d1/f2f [4174195,53996] 0 2024-09-13T02:52:36.490 INFO:tasks.workunit.client.1.smithi142.stdout:4/329: mknod d0/c69 0 2024-09-13T02:52:36.490 INFO:tasks.workunit.client.0.smithi098.stdout:3/22: getdents d7 0 2024-09-13T02:52:36.491 INFO:tasks.workunit.client.1.smithi142.stdout:3/357: rmdir d12/d16/d3c 39 2024-09-13T02:52:36.493 INFO:tasks.workunit.client.0.smithi098.stdout:0/45: dread f8 [0,4194304] 0 2024-09-13T02:52:36.495 INFO:tasks.workunit.client.0.smithi098.stdout:2/22: creat d1/d4/f7 x:0 0 0 2024-09-13T02:52:36.497 INFO:tasks.workunit.client.1.smithi142.stdout:1/445: mknod d12/d13/d20/d27/d3c/d71/c94 0 2024-09-13T02:52:36.498 INFO:tasks.workunit.client.0.smithi098.stdout:4/32: symlink d6/l7 0 2024-09-13T02:52:36.499 INFO:tasks.workunit.client.0.smithi098.stdout:4/33: chown f3 228 1 2024-09-13T02:52:36.502 INFO:tasks.workunit.client.1.smithi142.stdout:1/446: dwrite d12/d13/d20/f5e [0,4194304] 0 2024-09-13T02:52:36.503 INFO:tasks.workunit.client.0.smithi098.stdout:8/36: dwrite f1 [0,4194304] 0 2024-09-13T02:52:36.504 INFO:tasks.workunit.client.0.smithi098.stdout:9/27: sync 2024-09-13T02:52:36.505 INFO:tasks.workunit.client.0.smithi098.stdout:7/173: sync 2024-09-13T02:52:36.505 INFO:tasks.workunit.client.0.smithi098.stdout:1/60: sync 2024-09-13T02:52:36.506 INFO:tasks.workunit.client.1.smithi142.stdout:9/461: link dd/d17/d69/d84/d41/l85 dd/d87/d8e/lad 0 2024-09-13T02:52:36.507 INFO:tasks.workunit.client.0.smithi098.stdout:9/28: write d2/f4 [4650845,23297] 0 2024-09-13T02:52:36.507 INFO:tasks.workunit.client.0.smithi098.stdout:4/34: dread f5 [0,4194304] 0 2024-09-13T02:52:36.508 INFO:tasks.workunit.client.0.smithi098.stdout:5/15: truncate d0/d1/f6 322711 0 2024-09-13T02:52:36.508 INFO:tasks.workunit.client.1.smithi142.stdout:7/337: dwrite d10/d13/d1d/d2b/d56/d41/f68 [0,4194304] 0 2024-09-13T02:52:36.510 INFO:tasks.workunit.client.1.smithi142.stdout:7/338: write ff [1988748,130575] 0 2024-09-13T02:52:36.510 INFO:tasks.workunit.client.1.smithi142.stdout:8/281: chown d0/d6/dc/d40/l43 65 1 2024-09-13T02:52:36.510 INFO:tasks.workunit.client.1.smithi142.stdout:7/339: fsync d10/f47 0 2024-09-13T02:52:36.511 INFO:tasks.workunit.client.1.smithi142.stdout:7/340: fsync d10/d13/d1d/f2d 0 2024-09-13T02:52:36.511 INFO:tasks.workunit.client.0.smithi098.stdout:2/23: creat d1/f8 x:0 0 0 2024-09-13T02:52:36.511 INFO:tasks.workunit.client.0.smithi098.stdout:9/29: chown d2/f4 22 1 2024-09-13T02:52:36.512 INFO:tasks.workunit.client.0.smithi098.stdout:2/24: write f0 [4137573,14711] 0 2024-09-13T02:52:36.512 INFO:tasks.workunit.client.1.smithi142.stdout:8/282: truncate d0/d6/dc/d2e/f57 1343932 0 2024-09-13T02:52:36.515 INFO:tasks.workunit.client.0.smithi098.stdout:2/25: write f0 [835933,102789] 0 2024-09-13T02:52:36.516 INFO:tasks.workunit.client.0.smithi098.stdout:1/61: dread d9/fa [0,4194304] 0 2024-09-13T02:52:36.518 INFO:tasks.workunit.client.0.smithi098.stdout:3/23: rename l5 to d7/l8 0 2024-09-13T02:52:36.518 INFO:tasks.workunit.client.0.smithi098.stdout:6/5: sync 2024-09-13T02:52:36.519 INFO:tasks.workunit.client.0.smithi098.stdout:6/6: dwrite - no filename 2024-09-13T02:52:36.519 INFO:tasks.workunit.client.0.smithi098.stdout:6/7: dwrite - no filename 2024-09-13T02:52:36.519 INFO:tasks.workunit.client.0.smithi098.stdout:6/8: write - no filename 2024-09-13T02:52:36.519 INFO:tasks.workunit.client.0.smithi098.stdout:6/9: write - no filename 2024-09-13T02:52:36.520 INFO:tasks.workunit.client.1.smithi142.stdout:8/283: dwrite d0/d6/dc/f49 [0,4194304] 0 2024-09-13T02:52:36.520 INFO:tasks.workunit.client.0.smithi098.stdout:1/62: write d9/f10 [1323975,124167] 0 2024-09-13T02:52:36.521 INFO:tasks.workunit.client.0.smithi098.stdout:3/24: write f6 [488361,45188] 0 2024-09-13T02:52:36.522 INFO:tasks.workunit.client.1.smithi142.stdout:5/377: creat d8/d24/d26/d45/f79 x:0 0 0 2024-09-13T02:52:36.524 INFO:tasks.workunit.client.0.smithi098.stdout:3/25: truncate f6 1342218 0 2024-09-13T02:52:36.524 INFO:tasks.workunit.client.0.smithi098.stdout:0/46: link f4 fc 0 2024-09-13T02:52:36.524 INFO:tasks.workunit.client.0.smithi098.stdout:7/174: dwrite d6/fc [0,4194304] 0 2024-09-13T02:52:36.525 INFO:tasks.workunit.client.0.smithi098.stdout:0/47: dread - fb zero size 2024-09-13T02:52:36.527 INFO:tasks.workunit.client.1.smithi142.stdout:2/236: mknod d1/de/d31/d46/c4f 0 2024-09-13T02:52:36.528 INFO:tasks.workunit.client.0.smithi098.stdout:8/37: rmdir d2 39 2024-09-13T02:52:36.528 INFO:tasks.workunit.client.0.smithi098.stdout:8/38: stat f1 0 2024-09-13T02:52:36.532 INFO:tasks.workunit.client.1.smithi142.stdout:4/330: readlink d0/df/d57/l47 0 2024-09-13T02:52:36.534 INFO:tasks.workunit.client.1.smithi142.stdout:4/331: write d0/d2b/d2d/d31/d43/f5a [811551,6021] 0 2024-09-13T02:52:36.535 INFO:tasks.workunit.client.1.smithi142.stdout:3/358: creat d12/d16/d25/d2e/d38/d4d/f69 x:0 0 0 2024-09-13T02:52:36.536 INFO:tasks.workunit.client.1.smithi142.stdout:3/359: dread - d12/d16/f43 zero size 2024-09-13T02:52:36.537 INFO:tasks.workunit.client.0.smithi098.stdout:7/175: dwrite d6/d24/d2a/f3a [0,4194304] 0 2024-09-13T02:52:36.538 INFO:tasks.workunit.client.1.smithi142.stdout:4/332: write d0/d2b/d2d/d31/d43/f46 [976116,33923] 0 2024-09-13T02:52:36.539 INFO:tasks.workunit.client.0.smithi098.stdout:7/176: stat d6/d1e/f23 0 2024-09-13T02:52:36.539 INFO:tasks.workunit.client.1.smithi142.stdout:3/360: fsync d12/d16/d25/d2e/d48/d5c/f51 0 2024-09-13T02:52:36.540 INFO:tasks.workunit.client.1.smithi142.stdout:6/370: mkdir d1/d7/d5f/d60/d76/d7e 0 2024-09-13T02:52:36.547 INFO:tasks.workunit.client.0.smithi098.stdout:9/30: rename d2/d6/ca to d2/d6/cb 0 2024-09-13T02:52:36.547 INFO:tasks.workunit.client.1.smithi142.stdout:6/371: dwrite d1/d7/d5f/d6a/f7a [0,4194304] 0 2024-09-13T02:52:36.552 INFO:tasks.workunit.client.0.smithi098.stdout:2/26: mkdir d1/d4/d9 0 2024-09-13T02:52:36.553 INFO:tasks.workunit.client.0.smithi098.stdout:2/27: stat d1/d4/d9 0 2024-09-13T02:52:36.555 INFO:tasks.workunit.client.1.smithi142.stdout:1/447: dwrite d12/d13/d20/d27/d3c/d53/f54 [4194304,4194304] 0 2024-09-13T02:52:36.562 INFO:tasks.workunit.client.1.smithi142.stdout:7/341: unlink d10/d13/d1d/d2b/d40/c54 0 2024-09-13T02:52:36.562 INFO:tasks.workunit.client.0.smithi098.stdout:0/48: mkdir dd 0 2024-09-13T02:52:36.563 INFO:tasks.workunit.client.1.smithi142.stdout:7/342: readlink d10/d13/d1d/d2b/d40/l48 0 2024-09-13T02:52:36.565 INFO:tasks.workunit.client.1.smithi142.stdout:8/284: creat d0/d6/dc/f59 x:0 0 0 2024-09-13T02:52:36.573 INFO:tasks.workunit.client.0.smithi098.stdout:0/49: dwrite fa [0,4194304] 0 2024-09-13T02:52:36.577 INFO:tasks.workunit.client.1.smithi142.stdout:3/361: creat d12/d16/d25/d2e/d48/f6a x:0 0 0 2024-09-13T02:52:36.580 INFO:tasks.workunit.client.0.smithi098.stdout:8/39: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:52:36.582 INFO:tasks.workunit.client.0.smithi098.stdout:7/177: creat d6/d24/f3d x:0 0 0 2024-09-13T02:52:36.583 INFO:tasks.workunit.client.0.smithi098.stdout:7/178: fdatasync d6/f11 0 2024-09-13T02:52:36.585 INFO:tasks.workunit.client.1.smithi142.stdout:9/462: symlink dd/lae 0 2024-09-13T02:52:36.585 INFO:tasks.workunit.client.0.smithi098.stdout:8/40: dread f1 [0,4194304] 0 2024-09-13T02:52:36.586 INFO:tasks.workunit.client.0.smithi098.stdout:8/41: fdatasync f1 0 2024-09-13T02:52:36.587 INFO:tasks.workunit.client.0.smithi098.stdout:2/28: rmdir d1/d4 39 2024-09-13T02:52:36.590 INFO:tasks.workunit.client.1.smithi142.stdout:1/448: creat d12/d13/d20/d27/d3c/f95 x:0 0 0 2024-09-13T02:52:36.590 INFO:tasks.workunit.client.0.smithi098.stdout:6/10: unlink c0 0 2024-09-13T02:52:36.595 INFO:tasks.workunit.client.1.smithi142.stdout:4/333: creat d0/d2b/d21/d35/f6a x:0 0 0 2024-09-13T02:52:36.597 INFO:tasks.workunit.client.1.smithi142.stdout:3/362: mkdir d12/d16/d25/d2e/d38/d6b 0 2024-09-13T02:52:36.597 INFO:tasks.workunit.client.0.smithi098.stdout:4/35: truncate f3 2617302 0 2024-09-13T02:52:36.598 INFO:tasks.workunit.client.1.smithi142.stdout:0/347: dwrite d10/d23/f2f [0,4194304] 0 2024-09-13T02:52:36.601 INFO:tasks.workunit.client.0.smithi098.stdout:5/16: dwrite d0/d1/f6 [0,4194304] 0 2024-09-13T02:52:36.601 INFO:tasks.workunit.client.1.smithi142.stdout:9/463: mkdir dd/d17/d44/d82/d99/daf 0 2024-09-13T02:52:36.603 INFO:tasks.workunit.client.1.smithi142.stdout:1/449: mkdir d12/d13/d20/d27/d3c/d71/d96 0 2024-09-13T02:52:36.604 INFO:tasks.workunit.client.1.smithi142.stdout:1/450: chown d12/d13/d45/f7c 114830558 1 2024-09-13T02:52:36.609 INFO:tasks.workunit.client.0.smithi098.stdout:7/179: mknod d6/d24/d2a/c3e 0 2024-09-13T02:52:36.610 INFO:tasks.workunit.client.1.smithi142.stdout:8/285: creat d0/d6/dc/d40/d46/f5a x:0 0 0 2024-09-13T02:52:36.610 INFO:tasks.workunit.client.0.smithi098.stdout:7/180: write d6/d24/f3d [546653,48475] 0 2024-09-13T02:52:36.611 INFO:tasks.workunit.client.0.smithi098.stdout:8/42: creat d2/f9 x:0 0 0 2024-09-13T02:52:36.613 INFO:tasks.workunit.client.1.smithi142.stdout:4/334: symlink d0/d2b/d21/d35/l6b 0 2024-09-13T02:52:36.614 INFO:tasks.workunit.client.0.smithi098.stdout:2/29: write d1/d4/f7 [359743,56485] 0 2024-09-13T02:52:36.617 INFO:tasks.workunit.client.1.smithi142.stdout:1/451: dread d12/d13/d20/d66/d55/f7f [0,4194304] 0 2024-09-13T02:52:36.619 INFO:tasks.workunit.client.0.smithi098.stdout:0/50: mknod dd/ce 0 2024-09-13T02:52:36.619 INFO:tasks.workunit.client.0.smithi098.stdout:0/51: dread - fb zero size 2024-09-13T02:52:36.621 INFO:tasks.workunit.client.0.smithi098.stdout:9/31: truncate d2/f4 1800695 0 2024-09-13T02:52:36.622 INFO:tasks.workunit.client.1.smithi142.stdout:5/378: sync 2024-09-13T02:52:36.623 INFO:tasks.workunit.client.1.smithi142.stdout:6/372: dread d1/dd/d16/f1c [0,4194304] 0 2024-09-13T02:52:36.624 INFO:tasks.workunit.client.1.smithi142.stdout:6/373: write d1/d7/d19/d30/f66 [1546354,128900] 0 2024-09-13T02:52:36.626 INFO:tasks.workunit.client.1.smithi142.stdout:8/286: unlink d0/d6/dc/f2f 0 2024-09-13T02:52:36.628 INFO:tasks.workunit.client.1.smithi142.stdout:4/335: creat d0/d2b/d2d/f6c x:0 0 0 2024-09-13T02:52:36.631 INFO:tasks.workunit.client.0.smithi098.stdout:5/17: fsync d0/d1/f6 0 2024-09-13T02:52:36.632 INFO:tasks.workunit.client.0.smithi098.stdout:6/11: creat f2 x:0 0 0 2024-09-13T02:52:36.633 INFO:tasks.workunit.client.0.smithi098.stdout:5/18: truncate d0/d1/f8 1401 0 2024-09-13T02:52:36.633 INFO:tasks.workunit.client.0.smithi098.stdout:6/12: chown f2 2256 1 2024-09-13T02:52:36.635 INFO:tasks.workunit.client.0.smithi098.stdout:7/181: mknod d6/d1e/c3f 0 2024-09-13T02:52:36.637 INFO:tasks.workunit.client.1.smithi142.stdout:1/452: mknod d12/d13/d20/d27/c97 0 2024-09-13T02:52:36.639 INFO:tasks.workunit.client.1.smithi142.stdout:9/464: creat dd/d17/d44/d95/fb0 x:0 0 0 2024-09-13T02:52:36.641 INFO:tasks.workunit.client.0.smithi098.stdout:1/63: getdents d9 0 2024-09-13T02:52:36.644 INFO:tasks.workunit.client.1.smithi142.stdout:5/379: unlink d8/l3a 0 2024-09-13T02:52:36.645 INFO:tasks.workunit.client.0.smithi098.stdout:0/52: mkdir dd/df 0 2024-09-13T02:52:36.645 INFO:tasks.workunit.client.0.smithi098.stdout:1/64: dread f4 [0,4194304] 0 2024-09-13T02:52:36.645 INFO:tasks.workunit.client.1.smithi142.stdout:5/380: dread d8/d24/d26/f31 [0,4194304] 0 2024-09-13T02:52:36.646 INFO:tasks.workunit.client.1.smithi142.stdout:7/343: getdents d10/d13/d1d/d2b/d56/d5f 0 2024-09-13T02:52:36.647 INFO:tasks.workunit.client.1.smithi142.stdout:7/344: dread - d10/d13/d1d/d2b/d55/f4f zero size 2024-09-13T02:52:36.647 INFO:tasks.workunit.client.1.smithi142.stdout:7/345: chown ff 0 1 2024-09-13T02:52:36.650 INFO:tasks.workunit.client.1.smithi142.stdout:6/374: mknod d1/d7/d19/d48/c7f 0 2024-09-13T02:52:36.652 INFO:tasks.workunit.client.1.smithi142.stdout:3/363: write d12/d16/f24 [1450081,76850] 0 2024-09-13T02:52:36.652 INFO:tasks.workunit.client.1.smithi142.stdout:6/375: read d1/d7/f2a [2205656,34808] 0 2024-09-13T02:52:36.652 INFO:tasks.workunit.client.0.smithi098.stdout:5/19: creat d0/d1/f9 x:0 0 0 2024-09-13T02:52:36.653 INFO:tasks.workunit.client.1.smithi142.stdout:7/346: dwrite d10/d13/d1d/d2b/d55/f67 [0,4194304] 0 2024-09-13T02:52:36.653 INFO:tasks.workunit.client.1.smithi142.stdout:3/364: chown d12/d16/d25/d2e 31667 1 2024-09-13T02:52:36.654 INFO:tasks.workunit.client.1.smithi142.stdout:6/376: write d1/d7/d5f/d6a/f7a [1162132,90482] 0 2024-09-13T02:52:36.654 INFO:tasks.workunit.client.1.smithi142.stdout:7/347: write d10/f42 [3469033,111141] 0 2024-09-13T02:52:36.654 INFO:tasks.workunit.client.1.smithi142.stdout:8/287: mknod d0/d6/dc/d2e/c5b 0 2024-09-13T02:52:36.655 INFO:tasks.workunit.client.0.smithi098.stdout:7/182: fsync d6/f10 0 2024-09-13T02:52:36.656 INFO:tasks.workunit.client.0.smithi098.stdout:7/183: write d6/d24/f2c [1424543,69075] 0 2024-09-13T02:52:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:3/365: chown d12/d16/d25/d2e/d48/f5f 365036 1 2024-09-13T02:52:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:4/336: mkdir d0/d2b/d21/d35/d6d 0 2024-09-13T02:52:36.659 INFO:tasks.workunit.client.1.smithi142.stdout:6/377: chown d1/dd/d16/c43 327153522 1 2024-09-13T02:52:36.660 INFO:tasks.workunit.client.1.smithi142.stdout:0/348: creat d10/f7b x:0 0 0 2024-09-13T02:52:36.661 INFO:tasks.workunit.client.1.smithi142.stdout:1/453: creat d12/d13/d20/d66/d7d/f98 x:0 0 0 2024-09-13T02:52:36.662 INFO:tasks.workunit.client.1.smithi142.stdout:1/454: stat d12/d13/d1d/d26/c68 0 2024-09-13T02:52:36.664 INFO:tasks.workunit.client.1.smithi142.stdout:8/288: dwrite d0/d6/d23/f3d [0,4194304] 0 2024-09-13T02:52:36.668 INFO:tasks.workunit.client.0.smithi098.stdout:9/32: symlink d2/lc 0 2024-09-13T02:52:36.671 INFO:tasks.workunit.client.1.smithi142.stdout:8/289: dread d0/d6/dc/d45/f10 [4194304,4194304] 0 2024-09-13T02:52:36.673 INFO:tasks.workunit.client.1.smithi142.stdout:3/366: creat d12/d16/d25/d2e/f6c x:0 0 0 2024-09-13T02:52:36.674 INFO:tasks.workunit.client.1.smithi142.stdout:7/348: dwrite d10/d13/d22/f69 [0,4194304] 0 2024-09-13T02:52:36.675 INFO:tasks.workunit.client.0.smithi098.stdout:7/184: mknod d6/d24/c40 0 2024-09-13T02:52:36.675 INFO:tasks.workunit.client.1.smithi142.stdout:7/349: fsync d10/d31/f63 0 2024-09-13T02:52:36.676 INFO:tasks.workunit.client.1.smithi142.stdout:3/367: read fe [2744923,37056] 0 2024-09-13T02:52:36.678 INFO:tasks.workunit.client.0.smithi098.stdout:2/30: creat d1/fa x:0 0 0 2024-09-13T02:52:36.679 INFO:tasks.workunit.client.0.smithi098.stdout:2/31: write d1/f8 [37735,30265] 0 2024-09-13T02:52:36.681 INFO:tasks.workunit.client.0.smithi098.stdout:2/32: write d1/f8 [679004,103554] 0 2024-09-13T02:52:36.682 INFO:tasks.workunit.client.0.smithi098.stdout:0/53: getdents dd/df 0 2024-09-13T02:52:36.683 INFO:tasks.workunit.client.1.smithi142.stdout:5/381: dwrite d8/d24/d26/f60 [0,4194304] 0 2024-09-13T02:52:36.685 INFO:tasks.workunit.client.1.smithi142.stdout:8/290: readlink d0/d6/l25 0 2024-09-13T02:52:36.691 INFO:tasks.workunit.client.0.smithi098.stdout:6/13: link f2 f3 0 2024-09-13T02:52:36.695 INFO:tasks.workunit.client.1.smithi142.stdout:7/350: unlink d10/d13/d22/f35 0 2024-09-13T02:52:36.695 INFO:tasks.workunit.client.1.smithi142.stdout:7/351: fsync d10/d13/d1d/d25/f75 0 2024-09-13T02:52:36.696 INFO:tasks.workunit.client.0.smithi098.stdout:8/43: getdents d2 0 2024-09-13T02:52:36.697 INFO:tasks.workunit.client.0.smithi098.stdout:8/44: chown d2/c8 262342043 1 2024-09-13T02:52:36.700 INFO:tasks.workunit.client.0.smithi098.stdout:0/54: creat dd/f10 x:0 0 0 2024-09-13T02:52:36.701 INFO:tasks.workunit.client.1.smithi142.stdout:5/382: creat d8/d24/d3f/d4a/f7a x:0 0 0 2024-09-13T02:52:36.702 INFO:tasks.workunit.client.1.smithi142.stdout:5/383: read d8/d24/d26/d2d/f2f [882861,41143] 0 2024-09-13T02:52:36.702 INFO:tasks.workunit.client.0.smithi098.stdout:1/65: truncate f8 4049247 0 2024-09-13T02:52:36.705 INFO:tasks.workunit.client.0.smithi098.stdout:4/36: dread f3 [0,4194304] 0 2024-09-13T02:52:36.705 INFO:tasks.workunit.client.0.smithi098.stdout:4/37: chown l4 3734 1 2024-09-13T02:52:36.706 INFO:tasks.workunit.client.0.smithi098.stdout:4/38: read f3 [1266818,31932] 0 2024-09-13T02:52:36.710 INFO:tasks.workunit.client.0.smithi098.stdout:5/20: link d0/d1/c4 d0/d1/ca 0 2024-09-13T02:52:36.713 INFO:tasks.workunit.client.1.smithi142.stdout:0/349: rename d10/d23/f58 to d10/f7c 0 2024-09-13T02:52:36.714 INFO:tasks.workunit.client.0.smithi098.stdout:9/33: write d2/f4 [1948154,34847] 0 2024-09-13T02:52:36.715 INFO:tasks.workunit.client.0.smithi098.stdout:9/34: write d2/f4 [250997,76001] 0 2024-09-13T02:52:36.717 INFO:tasks.workunit.client.1.smithi142.stdout:0/350: dread d10/d15/d21/d51/d35/f55 [0,4194304] 0 2024-09-13T02:52:36.717 INFO:tasks.workunit.client.0.smithi098.stdout:2/33: mkdir d1/d4/d9/db 0 2024-09-13T02:52:36.718 INFO:tasks.workunit.client.1.smithi142.stdout:3/368: truncate d12/d16/f21 3291534 0 2024-09-13T02:52:36.718 INFO:tasks.workunit.client.0.smithi098.stdout:2/34: write d1/f8 [1645325,70196] 0 2024-09-13T02:52:36.720 INFO:tasks.workunit.client.0.smithi098.stdout:2/35: write f0 [4198583,90371] 0 2024-09-13T02:52:36.721 INFO:tasks.workunit.client.1.smithi142.stdout:5/384: mknod d8/d24/d26/d2d/c7b 0 2024-09-13T02:52:36.722 INFO:tasks.workunit.client.0.smithi098.stdout:4/39: readlink l2 0 2024-09-13T02:52:36.724 INFO:tasks.workunit.client.1.smithi142.stdout:6/378: getdents d1/d7/d5f/d60/d76 0 2024-09-13T02:52:36.725 INFO:tasks.workunit.client.1.smithi142.stdout:6/379: truncate d1/d7/d42/f44 4898074 0 2024-09-13T02:52:36.726 INFO:tasks.workunit.client.1.smithi142.stdout:6/380: chown d1/dd/d16/d4e/l61 117 1 2024-09-13T02:52:36.727 INFO:tasks.workunit.client.1.smithi142.stdout:2/237: sync 2024-09-13T02:52:36.727 INFO:tasks.workunit.client.1.smithi142.stdout:6/381: dread d1/f3d [0,4194304] 0 2024-09-13T02:52:36.729 INFO:tasks.workunit.client.0.smithi098.stdout:5/21: mknod d0/cb 0 2024-09-13T02:52:36.729 INFO:tasks.workunit.client.0.smithi098.stdout:5/22: dread - d0/d1/f9 zero size 2024-09-13T02:52:36.731 INFO:tasks.workunit.client.0.smithi098.stdout:7/185: creat d6/f41 x:0 0 0 2024-09-13T02:52:36.732 INFO:tasks.workunit.client.1.smithi142.stdout:1/455: getdents d12/d13/d1d/d26 0 2024-09-13T02:52:36.733 INFO:tasks.workunit.client.1.smithi142.stdout:6/382: dwrite d1/d7/d19/d30/f67 [0,4194304] 0 2024-09-13T02:52:36.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:36 smithi098 ceph-mon[27886]: pgmap v17: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 78 MiB/s wr, 326 op/s 2024-09-13T02:52:36.738 INFO:tasks.workunit.client.0.smithi098.stdout:5/23: dwrite d0/d1/f9 [0,4194304] 0 2024-09-13T02:52:36.739 INFO:tasks.workunit.client.0.smithi098.stdout:7/186: dread d6/d14/f1d [0,4194304] 0 2024-09-13T02:52:36.739 INFO:tasks.workunit.client.0.smithi098.stdout:5/24: read d0/d1/f8 [950,87236] 0 2024-09-13T02:52:36.740 INFO:tasks.workunit.client.1.smithi142.stdout:6/383: dwrite d1/d7/d19/d30/f66 [0,4194304] 0 2024-09-13T02:52:36.740 INFO:tasks.workunit.client.1.smithi142.stdout:8/291: creat d0/f5c x:0 0 0 2024-09-13T02:52:36.741 INFO:tasks.workunit.client.0.smithi098.stdout:7/187: truncate d6/d1e/f1f 817817 0 2024-09-13T02:52:36.741 INFO:tasks.workunit.client.0.smithi098.stdout:5/25: dread d0/d1/f8 [0,4194304] 0 2024-09-13T02:52:36.742 INFO:tasks.workunit.client.0.smithi098.stdout:7/188: truncate d6/f19 1666202 0 2024-09-13T02:52:36.743 INFO:tasks.workunit.client.0.smithi098.stdout:5/26: write d0/d1/f6 [3133624,34911] 0 2024-09-13T02:52:36.744 INFO:tasks.workunit.client.0.smithi098.stdout:0/55: rename c2 to dd/df/c11 0 2024-09-13T02:52:36.745 INFO:tasks.workunit.client.0.smithi098.stdout:7/189: read d6/d24/f28 [13599,112479] 0 2024-09-13T02:52:36.745 INFO:tasks.workunit.client.1.smithi142.stdout:8/292: dwrite d0/d6/dc/d45/f1b [0,4194304] 0 2024-09-13T02:52:36.746 INFO:tasks.workunit.client.0.smithi098.stdout:7/190: chown d6/f19 11375667 1 2024-09-13T02:52:36.747 INFO:tasks.workunit.client.1.smithi142.stdout:2/238: creat d1/de/d31/f50 x:0 0 0 2024-09-13T02:52:36.748 INFO:tasks.workunit.client.1.smithi142.stdout:7/352: creat d10/d13/f76 x:0 0 0 2024-09-13T02:52:36.750 INFO:tasks.workunit.client.0.smithi098.stdout:4/40: unlink f5 0 2024-09-13T02:52:36.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:36 smithi142 ceph-mon[33443]: pgmap v17: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 78 MiB/s wr, 326 op/s 2024-09-13T02:52:36.751 INFO:tasks.workunit.client.0.smithi098.stdout:6/14: creat f4 x:0 0 0 2024-09-13T02:52:36.752 INFO:tasks.workunit.client.1.smithi142.stdout:0/351: symlink d10/d15/d1a/d7a/l7d 0 2024-09-13T02:52:36.754 INFO:tasks.workunit.client.0.smithi098.stdout:8/45: link d2/l4 d2/la 0 2024-09-13T02:52:36.754 INFO:tasks.workunit.client.1.smithi142.stdout:1/456: fsync d12/d13/f19 0 2024-09-13T02:52:36.755 INFO:tasks.workunit.client.1.smithi142.stdout:1/457: chown d12/d13/d1d/f61 366 1 2024-09-13T02:52:36.755 INFO:tasks.workunit.client.0.smithi098.stdout:8/46: write d2/f6 [400036,45777] 0 2024-09-13T02:52:36.757 INFO:tasks.workunit.client.0.smithi098.stdout:9/35: mkdir d2/dd 0 2024-09-13T02:52:36.759 INFO:tasks.workunit.client.0.smithi098.stdout:3/26: sync 2024-09-13T02:52:36.762 INFO:tasks.workunit.client.1.smithi142.stdout:1/458: dwrite d12/d13/d20/d27/d3c/f67 [0,4194304] 0 2024-09-13T02:52:36.762 INFO:tasks.workunit.client.0.smithi098.stdout:9/36: dread d2/f4 [0,4194304] 0 2024-09-13T02:52:36.763 INFO:tasks.workunit.client.0.smithi098.stdout:5/27: creat d0/d1/fc x:0 0 0 2024-09-13T02:52:36.763 INFO:tasks.workunit.client.1.smithi142.stdout:1/459: readlink d12/d13/d1d/d26/l51 0 2024-09-13T02:52:36.764 INFO:tasks.workunit.client.0.smithi098.stdout:9/37: chown d2/f7 33689058 1 2024-09-13T02:52:36.765 INFO:tasks.workunit.client.0.smithi098.stdout:5/28: dread - d0/d1/fc zero size 2024-09-13T02:52:36.765 INFO:tasks.workunit.client.1.smithi142.stdout:1/460: write d12/d13/d1d/d26/d4f/d72/f7e [932578,36621] 0 2024-09-13T02:52:36.765 INFO:tasks.workunit.client.0.smithi098.stdout:2/36: rename d1/d3 to d1/d4/dc 0 2024-09-13T02:52:36.766 INFO:tasks.workunit.client.0.smithi098.stdout:5/29: readlink d0/l5 0 2024-09-13T02:52:36.769 INFO:tasks.workunit.client.1.smithi142.stdout:0/352: mknod d10/d15/d1a/d7a/c7e 0 2024-09-13T02:52:36.769 INFO:tasks.workunit.client.0.smithi098.stdout:2/37: fsync d1/d4/f7 0 2024-09-13T02:52:36.770 INFO:tasks.workunit.client.1.smithi142.stdout:3/369: link d12/d16/d25/d2e/d48/d5c/d66/f63 d12/d16/d25/d2e/d38/f6d 0 2024-09-13T02:52:36.771 INFO:tasks.workunit.client.1.smithi142.stdout:1/461: dwrite d12/d13/d20/f38 [0,4194304] 0 2024-09-13T02:52:36.772 INFO:tasks.workunit.client.0.smithi098.stdout:3/27: dwrite f1 [0,4194304] 0 2024-09-13T02:52:36.772 INFO:tasks.workunit.client.1.smithi142.stdout:1/462: fsync d12/d13/d1d/f61 0 2024-09-13T02:52:36.773 INFO:tasks.workunit.client.0.smithi098.stdout:7/191: mkdir d6/d14/d42 0 2024-09-13T02:52:36.773 INFO:tasks.workunit.client.1.smithi142.stdout:5/385: link d8/d24/d26/d2d/c7b d8/d47/c7c 0 2024-09-13T02:52:36.776 INFO:tasks.workunit.client.0.smithi098.stdout:3/28: write f4 [895747,127832] 0 2024-09-13T02:52:36.779 INFO:tasks.workunit.client.1.smithi142.stdout:3/370: dwrite d12/d16/d25/f40 [0,4194304] 0 2024-09-13T02:52:36.779 INFO:tasks.workunit.client.1.smithi142.stdout:4/337: sync 2024-09-13T02:52:36.779 INFO:tasks.workunit.client.1.smithi142.stdout:9/465: sync 2024-09-13T02:52:36.780 INFO:tasks.workunit.client.0.smithi098.stdout:9/38: dwrite d2/f7 [0,4194304] 0 2024-09-13T02:52:36.781 INFO:tasks.workunit.client.1.smithi142.stdout:3/371: dread - d12/d16/d25/f60 zero size 2024-09-13T02:52:36.782 INFO:tasks.workunit.client.1.smithi142.stdout:3/372: fdatasync d12/d16/d25/d2e/d48/d5c/d66/f5d 0 2024-09-13T02:52:36.784 INFO:tasks.workunit.client.1.smithi142.stdout:7/353: dread d10/d31/f4e [0,4194304] 0 2024-09-13T02:52:36.787 INFO:tasks.workunit.client.0.smithi098.stdout:2/38: dwrite d1/f8 [0,4194304] 0 2024-09-13T02:52:36.793 INFO:tasks.workunit.client.1.smithi142.stdout:5/386: dread d8/d24/d26/d61/f71 [0,4194304] 0 2024-09-13T02:52:36.794 INFO:tasks.workunit.client.0.smithi098.stdout:7/192: dwrite d6/f10 [0,4194304] 0 2024-09-13T02:52:36.794 INFO:tasks.workunit.client.0.smithi098.stdout:2/39: chown d1/d4/d9/db 32642 1 2024-09-13T02:52:36.800 INFO:tasks.workunit.client.1.smithi142.stdout:5/387: dwrite d8/d24/f41 [0,4194304] 0 2024-09-13T02:52:36.802 INFO:tasks.workunit.client.1.smithi142.stdout:9/466: creat dd/d17/d25/fb1 x:0 0 0 2024-09-13T02:52:36.804 INFO:tasks.workunit.client.0.smithi098.stdout:5/30: dwrite d0/d1/f8 [0,4194304] 0 2024-09-13T02:52:36.805 INFO:tasks.workunit.client.0.smithi098.stdout:1/66: link d9/d12/c15 d9/c16 0 2024-09-13T02:52:36.805 INFO:tasks.workunit.client.0.smithi098.stdout:7/193: truncate d6/d24/d2a/f31 2044807 0 2024-09-13T02:52:36.805 INFO:tasks.workunit.client.1.smithi142.stdout:9/467: dread - dd/d17/d44/fa0 zero size 2024-09-13T02:52:36.807 INFO:tasks.workunit.client.1.smithi142.stdout:2/239: dread d1/f5 [4194304,4194304] 0 2024-09-13T02:52:36.807 INFO:tasks.workunit.client.0.smithi098.stdout:1/67: readlink d9/lb 0 2024-09-13T02:52:36.807 INFO:tasks.workunit.client.0.smithi098.stdout:7/194: fsync d6/d24/f2c 0 2024-09-13T02:52:36.808 INFO:tasks.workunit.client.1.smithi142.stdout:9/468: readlink dd/d17/l6c 0 2024-09-13T02:52:36.811 INFO:tasks.workunit.client.0.smithi098.stdout:9/39: unlink d2/f7 0 2024-09-13T02:52:36.813 INFO:tasks.workunit.client.0.smithi098.stdout:2/40: dread d1/d4/f7 [0,4194304] 0 2024-09-13T02:52:36.813 INFO:tasks.workunit.client.0.smithi098.stdout:2/41: dread - d1/fa zero size 2024-09-13T02:52:36.814 INFO:tasks.workunit.client.1.smithi142.stdout:3/373: dread d12/f19 [0,4194304] 0 2024-09-13T02:52:36.814 INFO:tasks.workunit.client.0.smithi098.stdout:2/42: dread - d1/fa zero size 2024-09-13T02:52:36.816 INFO:tasks.workunit.client.1.smithi142.stdout:0/353: symlink d10/d6c/l7f 0 2024-09-13T02:52:36.817 INFO:tasks.workunit.client.1.smithi142.stdout:2/240: dwrite d1/d29/f30 [0,4194304] 0 2024-09-13T02:52:36.823 INFO:tasks.workunit.client.1.smithi142.stdout:5/388: fsync d8/d24/f5f 0 2024-09-13T02:52:36.826 INFO:tasks.workunit.client.0.smithi098.stdout:5/31: rename d0/l5 to d0/ld 0 2024-09-13T02:52:36.832 INFO:tasks.workunit.client.0.smithi098.stdout:7/195: creat d6/d14/f43 x:0 0 0 2024-09-13T02:52:36.833 INFO:tasks.workunit.client.0.smithi098.stdout:7/196: chown d6 80343 1 2024-09-13T02:52:36.835 INFO:tasks.workunit.client.0.smithi098.stdout:0/56: write fc [1321883,98966] 0 2024-09-13T02:52:36.836 INFO:tasks.workunit.client.1.smithi142.stdout:9/469: mknod dd/d87/d8e/da3/cb2 0 2024-09-13T02:52:36.837 INFO:tasks.workunit.client.0.smithi098.stdout:1/68: creat d9/d13/f17 x:0 0 0 2024-09-13T02:52:36.838 INFO:tasks.workunit.client.0.smithi098.stdout:1/69: fdatasync d9/d13/f17 0 2024-09-13T02:52:36.839 INFO:tasks.workunit.client.1.smithi142.stdout:3/374: creat d12/d16/d25/d2e/d48/d5c/f6e x:0 0 0 2024-09-13T02:52:36.840 INFO:tasks.workunit.client.1.smithi142.stdout:0/354: creat d10/d6c/f80 x:0 0 0 2024-09-13T02:52:36.842 INFO:tasks.workunit.client.0.smithi098.stdout:2/43: unlink f0 0 2024-09-13T02:52:36.843 INFO:tasks.workunit.client.0.smithi098.stdout:2/44: fdatasync d1/d4/f7 0 2024-09-13T02:52:36.845 INFO:tasks.workunit.client.1.smithi142.stdout:6/384: truncate d1/dd/f22 598451 0 2024-09-13T02:52:36.845 INFO:tasks.workunit.client.0.smithi098.stdout:2/45: dread d1/d4/f7 [0,4194304] 0 2024-09-13T02:52:36.846 INFO:tasks.workunit.client.0.smithi098.stdout:2/46: read d1/f8 [746003,46156] 0 2024-09-13T02:52:36.848 INFO:tasks.workunit.client.1.smithi142.stdout:2/241: dwrite d1/d2c/f3f [0,4194304] 0 2024-09-13T02:52:36.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/293: truncate d0/d6/dc/d45/d8/f12 210585 0 2024-09-13T02:52:36.853 INFO:tasks.workunit.client.1.smithi142.stdout:5/389: rmdir d8/d24/d64/d68 39 2024-09-13T02:52:36.853 INFO:tasks.workunit.client.0.smithi098.stdout:4/41: getdents d6 0 2024-09-13T02:52:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:4/338: rename d0/d2b/d2d/d31/d43/d48/f5b to d0/d2b/d2d/d65/f6e 0 2024-09-13T02:52:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:4/339: stat d0/d2b/d2d/d65/l3c 0 2024-09-13T02:52:36.858 INFO:tasks.workunit.client.0.smithi098.stdout:7/197: creat d6/d14/f44 x:0 0 0 2024-09-13T02:52:36.861 INFO:tasks.workunit.client.0.smithi098.stdout:0/57: symlink dd/l12 0 2024-09-13T02:52:36.861 INFO:tasks.workunit.client.0.smithi098.stdout:8/47: dwrite f1 [4194304,4194304] 0 2024-09-13T02:52:36.861 INFO:tasks.workunit.client.0.smithi098.stdout:7/198: chown d6/d14/f22 164753239 1 2024-09-13T02:52:36.861 INFO:tasks.workunit.client.1.smithi142.stdout:3/375: chown l11 47802 1 2024-09-13T02:52:36.864 INFO:tasks.workunit.client.0.smithi098.stdout:0/58: read fc [998160,93670] 0 2024-09-13T02:52:36.865 INFO:tasks.workunit.client.1.smithi142.stdout:9/470: dwrite dd/d17/f2b [0,4194304] 0 2024-09-13T02:52:36.866 INFO:tasks.workunit.client.0.smithi098.stdout:9/40: creat d2/dd/fe x:0 0 0 2024-09-13T02:52:36.870 INFO:tasks.workunit.client.1.smithi142.stdout:1/463: dwrite d12/d13/d20/d66/d55/f7f [0,4194304] 0 2024-09-13T02:52:36.872 INFO:tasks.workunit.client.1.smithi142.stdout:3/376: dread d12/d16/d25/f41 [0,4194304] 0 2024-09-13T02:52:36.874 INFO:tasks.workunit.client.1.smithi142.stdout:8/294: creat d0/d6/dc/d45/d35/d37/f5d x:0 0 0 2024-09-13T02:52:36.876 INFO:tasks.workunit.client.0.smithi098.stdout:2/47: creat d1/d4/d9/fd x:0 0 0 2024-09-13T02:52:36.877 INFO:tasks.workunit.client.1.smithi142.stdout:8/295: dread - d0/d6/d23/d2b/f55 zero size 2024-09-13T02:52:36.878 INFO:tasks.workunit.client.1.smithi142.stdout:8/296: chown d0/f5c 82137138 1 2024-09-13T02:52:36.881 INFO:tasks.workunit.client.1.smithi142.stdout:1/464: dwrite d12/d13/d1d/f6c [0,4194304] 0 2024-09-13T02:52:36.883 INFO:tasks.workunit.client.1.smithi142.stdout:1/465: write d12/d13/d1d/f61 [4550261,21133] 0 2024-09-13T02:52:36.888 INFO:tasks.workunit.client.1.smithi142.stdout:6/385: creat d1/dd/d53/d78/f80 x:0 0 0 2024-09-13T02:52:36.892 INFO:tasks.workunit.client.0.smithi098.stdout:8/48: rename d2/l5 to d2/lb 0 2024-09-13T02:52:36.906 INFO:tasks.workunit.client.0.smithi098.stdout:0/59: rename l7 to dd/l13 0 2024-09-13T02:52:36.906 INFO:tasks.workunit.client.0.smithi098.stdout:8/49: rename d2 to d2/dc 22 2024-09-13T02:52:36.908 INFO:tasks.workunit.client.1.smithi142.stdout:8/297: symlink d0/d6/dc/l5e 0 2024-09-13T02:52:36.908 INFO:tasks.workunit.client.1.smithi142.stdout:8/298: stat d0/d6/dc/d40 0 2024-09-13T02:52:36.908 INFO:tasks.workunit.client.1.smithi142.stdout:8/299: fsync d0/d6/dc/d45/d8/f29 0 2024-09-13T02:52:36.909 INFO:tasks.workunit.client.0.smithi098.stdout:9/41: symlink d2/d6/lf 0 2024-09-13T02:52:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:8/300: write d0/d6/dc/d45/d35/d37/f54 [2403733,25636] 0 2024-09-13T02:52:36.914 INFO:tasks.workunit.client.0.smithi098.stdout:8/50: dread f1 [0,4194304] 0 2024-09-13T02:52:36.916 INFO:tasks.workunit.client.0.smithi098.stdout:1/70: dwrite f4 [4194304,4194304] 0 2024-09-13T02:52:36.917 INFO:tasks.workunit.client.0.smithi098.stdout:2/48: write d1/f8 [1212551,86329] 0 2024-09-13T02:52:36.918 INFO:tasks.workunit.client.1.smithi142.stdout:0/355: truncate d10/d15/d21/d51/f54 1655992 0 2024-09-13T02:52:36.919 INFO:tasks.workunit.client.0.smithi098.stdout:4/42: creat d6/f8 x:0 0 0 2024-09-13T02:52:36.919 INFO:tasks.workunit.client.0.smithi098.stdout:2/49: write d1/d4/d9/fd [929441,35700] 0 2024-09-13T02:52:36.920 INFO:tasks.workunit.client.0.smithi098.stdout:5/32: link d0/cb d0/ce 0 2024-09-13T02:52:36.925 INFO:tasks.workunit.client.1.smithi142.stdout:5/390: rmdir d8/d24/d26/d49 0 2024-09-13T02:52:36.926 INFO:tasks.workunit.client.0.smithi098.stdout:5/33: write d0/d1/f8 [5030979,43640] 0 2024-09-13T02:52:36.927 INFO:tasks.workunit.client.0.smithi098.stdout:2/50: fsync d1/f8 0 2024-09-13T02:52:36.929 INFO:tasks.workunit.client.0.smithi098.stdout:7/199: mkdir d6/d14/d42/d45 0 2024-09-13T02:52:36.932 INFO:tasks.workunit.client.1.smithi142.stdout:7/354: rename d10/d34/d65/c6f to d10/c77 0 2024-09-13T02:52:36.933 INFO:tasks.workunit.client.1.smithi142.stdout:7/355: chown d10/d13/f1c 0 1 2024-09-13T02:52:36.933 INFO:tasks.workunit.client.1.smithi142.stdout:7/356: write d10/d13/d1d/f23 [946424,34775] 0 2024-09-13T02:52:36.935 INFO:tasks.workunit.client.0.smithi098.stdout:4/43: dwrite d6/f8 [0,4194304] 0 2024-09-13T02:52:36.935 INFO:tasks.workunit.client.0.smithi098.stdout:0/60: mkdir dd/d14 0 2024-09-13T02:52:36.938 INFO:tasks.workunit.client.1.smithi142.stdout:2/242: sync 2024-09-13T02:52:36.939 INFO:tasks.workunit.client.0.smithi098.stdout:1/71: dwrite d9/fa [0,4194304] 0 2024-09-13T02:52:36.940 INFO:tasks.workunit.client.1.smithi142.stdout:1/466: mknod d12/d13/d20/d27/d3c/d71/d96/c99 0 2024-09-13T02:52:36.943 INFO:tasks.workunit.client.0.smithi098.stdout:9/42: rmdir d2/d6 39 2024-09-13T02:52:36.949 INFO:tasks.workunit.client.0.smithi098.stdout:4/44: dwrite d6/f8 [0,4194304] 0 2024-09-13T02:52:36.949 INFO:tasks.workunit.client.1.smithi142.stdout:3/377: creat d12/d16/f6f x:0 0 0 2024-09-13T02:52:36.950 INFO:tasks.workunit.client.0.smithi098.stdout:8/51: rmdir d2 39 2024-09-13T02:52:36.960 INFO:tasks.workunit.client.0.smithi098.stdout:5/34: creat d0/ff x:0 0 0 2024-09-13T02:52:36.966 INFO:tasks.workunit.client.0.smithi098.stdout:2/51: unlink d1/d4/d9/fd 0 2024-09-13T02:52:36.970 INFO:tasks.workunit.client.1.smithi142.stdout:2/243: creat d1/d2c/f51 x:0 0 0 2024-09-13T02:52:36.970 INFO:tasks.workunit.client.0.smithi098.stdout:0/61: mknod dd/df/c15 0 2024-09-13T02:52:36.974 INFO:tasks.workunit.client.1.smithi142.stdout:6/386: creat d1/d7/d19/f81 x:0 0 0 2024-09-13T02:52:36.974 INFO:tasks.workunit.client.1.smithi142.stdout:6/387: readlink d1/dd/d16/d4e/l1b 0 2024-09-13T02:52:36.975 INFO:tasks.workunit.client.1.smithi142.stdout:6/388: write d1/dd/d16/d4e/d32/f40 [2090330,94700] 0 2024-09-13T02:52:36.975 INFO:tasks.workunit.client.1.smithi142.stdout:3/378: symlink d12/d16/d25/d2e/d48/d5c/d66/l70 0 2024-09-13T02:52:36.976 INFO:tasks.workunit.client.1.smithi142.stdout:6/389: dread - d1/d4a/f7d zero size 2024-09-13T02:52:36.977 INFO:tasks.workunit.client.0.smithi098.stdout:1/72: rmdir d9/d13 39 2024-09-13T02:52:36.981 INFO:tasks.workunit.client.1.smithi142.stdout:6/390: dwrite d1/f3d [0,4194304] 0 2024-09-13T02:52:36.983 INFO:tasks.workunit.client.0.smithi098.stdout:8/52: dread - d2/f9 zero size 2024-09-13T02:52:36.987 INFO:tasks.workunit.client.1.smithi142.stdout:4/340: rename d0/d2b/d2d/d65/l19 to d0/d2b/d21/d35/l6f 0 2024-09-13T02:52:36.987 INFO:tasks.workunit.client.1.smithi142.stdout:4/341: dread - d0/d2b/d2d/d31/d43/f63 zero size 2024-09-13T02:52:36.988 INFO:tasks.workunit.client.0.smithi098.stdout:7/200: dwrite d6/d14/f22 [0,4194304] 0 2024-09-13T02:52:36.991 INFO:tasks.workunit.client.0.smithi098.stdout:5/35: mkdir d0/d10 0 2024-09-13T02:52:36.993 INFO:tasks.workunit.client.1.smithi142.stdout:0/356: write d10/d15/d21/d51/f3e [257458,1649] 0 2024-09-13T02:52:36.996 INFO:tasks.workunit.client.0.smithi098.stdout:2/52: creat d1/d4/d9/fe x:0 0 0 2024-09-13T02:52:36.996 INFO:tasks.workunit.client.1.smithi142.stdout:2/244: creat d1/d29/d2b/f52 x:0 0 0 2024-09-13T02:52:36.997 INFO:tasks.workunit.client.1.smithi142.stdout:2/245: chown d1/d2c/f3f 11473 1 2024-09-13T02:52:36.998 INFO:tasks.workunit.client.0.smithi098.stdout:7/201: dwrite d6/f15 [8388608,4194304] 0 2024-09-13T02:52:37.000 INFO:tasks.workunit.client.1.smithi142.stdout:2/246: dread d1/fc [4194304,4194304] 0 2024-09-13T02:52:37.000 INFO:tasks.workunit.client.0.smithi098.stdout:7/202: readlink l2 0 2024-09-13T02:52:37.005 INFO:tasks.workunit.client.0.smithi098.stdout:0/62: dread f8 [0,4194304] 0 2024-09-13T02:52:37.008 INFO:tasks.workunit.client.0.smithi098.stdout:7/203: dread d6/d1e/f36 [0,4194304] 0 2024-09-13T02:52:37.012 INFO:tasks.workunit.client.0.smithi098.stdout:5/36: rename d0/d1/f6 to d0/d1/f11 0 2024-09-13T02:52:37.014 INFO:tasks.workunit.client.0.smithi098.stdout:8/53: dwrite d2/f3 [0,4194304] 0 2024-09-13T02:52:37.014 INFO:tasks.workunit.client.1.smithi142.stdout:8/301: getdents d0/d6/dc/d45/d8/df 0 2024-09-13T02:52:37.014 INFO:tasks.workunit.client.0.smithi098.stdout:8/54: stat d2/f3 0 2024-09-13T02:52:37.016 INFO:tasks.workunit.client.1.smithi142.stdout:0/357: creat d10/d15/d1a/d7a/f81 x:0 0 0 2024-09-13T02:52:37.018 INFO:tasks.workunit.client.0.smithi098.stdout:9/43: rename d2/f4 to d2/f10 0 2024-09-13T02:52:37.021 INFO:tasks.workunit.client.1.smithi142.stdout:3/379: mknod d12/d16/c71 0 2024-09-13T02:52:37.022 INFO:tasks.workunit.client.0.smithi098.stdout:8/55: dwrite d2/f9 [0,4194304] 0 2024-09-13T02:52:37.023 INFO:tasks.workunit.client.0.smithi098.stdout:0/63: readlink dd/l13 0 2024-09-13T02:52:37.024 INFO:tasks.workunit.client.0.smithi098.stdout:7/204: mkdir d6/d24/d46 0 2024-09-13T02:52:37.024 INFO:tasks.workunit.client.0.smithi098.stdout:8/56: stat d2/f9 0 2024-09-13T02:52:37.025 INFO:tasks.workunit.client.0.smithi098.stdout:7/205: readlink d6/l9 0 2024-09-13T02:52:37.025 INFO:tasks.workunit.client.0.smithi098.stdout:7/206: fsync d6/f19 0 2024-09-13T02:52:37.026 INFO:tasks.workunit.client.1.smithi142.stdout:5/391: getdents d8 0 2024-09-13T02:52:37.026 INFO:tasks.workunit.client.0.smithi098.stdout:8/57: write d2/f3 [4276884,64243] 0 2024-09-13T02:52:37.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/467: truncate d12/d13/d45/f60 101380 0 2024-09-13T02:52:37.033 INFO:tasks.workunit.client.1.smithi142.stdout:7/357: link d10/c11 d10/d13/d1d/d25/d5c/c78 0 2024-09-13T02:52:37.034 INFO:tasks.workunit.client.0.smithi098.stdout:4/45: truncate d6/f8 259972 0 2024-09-13T02:52:37.035 INFO:tasks.workunit.client.1.smithi142.stdout:8/302: mkdir d0/d6/dc/d45/d5f 0 2024-09-13T02:52:37.035 INFO:tasks.workunit.client.1.smithi142.stdout:6/391: write d1/d7/d19/f4b [1005676,41704] 0 2024-09-13T02:52:37.037 INFO:tasks.workunit.client.1.smithi142.stdout:6/392: truncate d1/dd/d53/d78/f80 630233 0 2024-09-13T02:52:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:6/393: stat d1/dd/f49 0 2024-09-13T02:52:37.039 INFO:tasks.workunit.client.0.smithi098.stdout:1/73: write f8 [3783988,73120] 0 2024-09-13T02:52:37.040 INFO:tasks.workunit.client.1.smithi142.stdout:6/394: truncate d1/dd/d16/d4d/f4f 1137285 0 2024-09-13T02:52:37.041 INFO:tasks.workunit.client.1.smithi142.stdout:3/380: rmdir d12/d16/d25/d2e/d38/d4d 39 2024-09-13T02:52:37.041 INFO:tasks.workunit.client.1.smithi142.stdout:5/392: dread d8/f15 [0,4194304] 0 2024-09-13T02:52:37.041 INFO:tasks.workunit.client.1.smithi142.stdout:5/393: chown d8/c1a 3888 1 2024-09-13T02:52:37.047 INFO:tasks.workunit.client.1.smithi142.stdout:9/471: rename dd/f1a to dd/d17/fb3 0 2024-09-13T02:52:37.051 INFO:tasks.workunit.client.1.smithi142.stdout:4/342: creat d0/df/d57/f70 x:0 0 0 2024-09-13T02:52:37.052 INFO:tasks.workunit.client.0.smithi098.stdout:8/58: mkdir d2/dd 0 2024-09-13T02:52:37.056 INFO:tasks.workunit.client.0.smithi098.stdout:2/53: rmdir d1/d4/d9/db 0 2024-09-13T02:52:37.057 INFO:tasks.workunit.client.0.smithi098.stdout:5/37: creat d0/d10/f12 x:0 0 0 2024-09-13T02:52:37.057 INFO:tasks.workunit.client.0.smithi098.stdout:0/64: write f8 [458204,109760] 0 2024-09-13T02:52:37.057 INFO:tasks.workunit.client.1.smithi142.stdout:4/343: dwrite d0/d2b/d2d/d31/d43/f46 [0,4194304] 0 2024-09-13T02:52:37.058 INFO:tasks.workunit.client.0.smithi098.stdout:4/46: mknod d6/c9 0 2024-09-13T02:52:37.059 INFO:tasks.workunit.client.1.smithi142.stdout:3/381: creat d12/d16/d25/d2e/d38/d5a/f72 x:0 0 0 2024-09-13T02:52:37.061 INFO:tasks.workunit.client.1.smithi142.stdout:5/394: dread - d8/d24/d64/d68/f77 zero size 2024-09-13T02:52:37.065 INFO:tasks.workunit.client.0.smithi098.stdout:1/74: write d9/d13/f17 [955467,91746] 0 2024-09-13T02:52:37.065 INFO:tasks.workunit.client.0.smithi098.stdout:7/207: mkdir d6/d47 0 2024-09-13T02:52:37.065 INFO:tasks.workunit.client.1.smithi142.stdout:4/344: dwrite d0/d2b/d21/f2a [0,4194304] 0 2024-09-13T02:52:37.067 INFO:tasks.workunit.client.0.smithi098.stdout:2/54: dwrite d1/f8 [0,4194304] 0 2024-09-13T02:52:37.068 INFO:tasks.workunit.client.1.smithi142.stdout:1/468: unlink d12/d1b/c6e 0 2024-09-13T02:52:37.069 INFO:tasks.workunit.client.1.smithi142.stdout:1/469: truncate d12/f7a 879107 0 2024-09-13T02:52:37.070 INFO:tasks.workunit.client.0.smithi098.stdout:6/15: sync 2024-09-13T02:52:37.071 INFO:tasks.workunit.client.0.smithi098.stdout:3/29: sync 2024-09-13T02:52:37.071 INFO:tasks.workunit.client.0.smithi098.stdout:5/38: dwrite d0/d1/fc [0,4194304] 0 2024-09-13T02:52:37.071 INFO:tasks.workunit.client.0.smithi098.stdout:2/55: read d1/f8 [270361,104711] 0 2024-09-13T02:52:37.075 INFO:tasks.workunit.client.0.smithi098.stdout:8/59: creat d2/fe x:0 0 0 2024-09-13T02:52:37.075 INFO:tasks.workunit.client.0.smithi098.stdout:6/16: chown f2 894615 1 2024-09-13T02:52:37.076 INFO:tasks.workunit.client.0.smithi098.stdout:0/65: rmdir dd/df 39 2024-09-13T02:52:37.077 INFO:tasks.workunit.client.0.smithi098.stdout:8/60: stat d2/l7 0 2024-09-13T02:52:37.079 INFO:tasks.workunit.client.0.smithi098.stdout:1/75: dread f8 [0,4194304] 0 2024-09-13T02:52:37.080 INFO:tasks.workunit.client.0.smithi098.stdout:4/47: mknod d6/ca 0 2024-09-13T02:52:37.083 INFO:tasks.workunit.client.0.smithi098.stdout:7/208: dwrite d6/d24/d2a/f31 [0,4194304] 0 2024-09-13T02:52:37.084 INFO:tasks.workunit.client.1.smithi142.stdout:6/395: link d1/d7/d19/f45 d1/d7/d19/d52/f82 0 2024-09-13T02:52:37.091 INFO:tasks.workunit.client.0.smithi098.stdout:9/44: dwrite d2/f10 [0,4194304] 0 2024-09-13T02:52:37.093 INFO:tasks.workunit.client.1.smithi142.stdout:9/472: link dd/d87/f96 dd/d17/d69/d84/fb4 0 2024-09-13T02:52:37.094 INFO:tasks.workunit.client.0.smithi098.stdout:3/30: mkdir d7/d9 0 2024-09-13T02:52:37.095 INFO:tasks.workunit.client.0.smithi098.stdout:3/31: chown f6 13512402 1 2024-09-13T02:52:37.095 INFO:tasks.workunit.client.1.smithi142.stdout:5/395: creat d8/d24/d26/d2d/f7d x:0 0 0 2024-09-13T02:52:37.097 INFO:tasks.workunit.client.0.smithi098.stdout:5/39: symlink d0/d10/l13 0 2024-09-13T02:52:37.100 INFO:tasks.workunit.client.0.smithi098.stdout:2/56: rename d1/l6 to d1/d4/d9/lf 0 2024-09-13T02:52:37.101 INFO:tasks.workunit.client.1.smithi142.stdout:5/396: dwrite f0 [0,4194304] 0 2024-09-13T02:52:37.102 INFO:tasks.workunit.client.1.smithi142.stdout:1/470: symlink d12/d13/d1d/d26/l9a 0 2024-09-13T02:52:37.103 INFO:tasks.workunit.client.1.smithi142.stdout:1/471: chown d12/d13/d20/d66 45 1 2024-09-13T02:52:37.105 INFO:tasks.workunit.client.0.smithi098.stdout:5/40: dwrite d0/d1/f8 [4194304,4194304] 0 2024-09-13T02:52:37.106 INFO:tasks.workunit.client.0.smithi098.stdout:5/41: dread - d0/d10/f12 zero size 2024-09-13T02:52:37.110 INFO:tasks.workunit.client.1.smithi142.stdout:0/358: getdents d10/d15/d30 0 2024-09-13T02:52:37.114 INFO:tasks.workunit.client.1.smithi142.stdout:6/396: symlink d1/dd/d16/d47/l83 0 2024-09-13T02:52:37.115 INFO:tasks.workunit.client.0.smithi098.stdout:4/48: read d6/f8 [49176,59789] 0 2024-09-13T02:52:37.116 INFO:tasks.workunit.client.0.smithi098.stdout:7/209: mkdir d6/d24/d2a/d48 0 2024-09-13T02:52:37.117 INFO:tasks.workunit.client.1.smithi142.stdout:2/247: getdents d1/d2d 0 2024-09-13T02:52:37.119 INFO:tasks.workunit.client.0.smithi098.stdout:7/210: dread d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:37.120 INFO:tasks.workunit.client.1.smithi142.stdout:9/473: rename fa to dd/d87/d8e/da3/da5/fb5 0 2024-09-13T02:52:37.121 INFO:tasks.workunit.client.1.smithi142.stdout:8/303: sync 2024-09-13T02:52:37.126 INFO:tasks.workunit.client.0.smithi098.stdout:0/66: write f4 [849914,16958] 0 2024-09-13T02:52:37.127 INFO:tasks.workunit.client.1.smithi142.stdout:1/472: symlink d12/d13/d20/d27/d3c/d71/d81/l9b 0 2024-09-13T02:52:37.128 INFO:tasks.workunit.client.1.smithi142.stdout:7/358: link d10/d13/d1d/d2b/d55/l33 d10/d13/d1d/d25/d5c/l79 0 2024-09-13T02:52:37.129 INFO:tasks.workunit.client.0.smithi098.stdout:2/57: read d1/f8 [1639118,10404] 0 2024-09-13T02:52:37.130 INFO:tasks.workunit.client.1.smithi142.stdout:6/397: creat d1/d7/d5f/d6a/f84 x:0 0 0 2024-09-13T02:52:37.132 INFO:tasks.workunit.client.1.smithi142.stdout:1/473: dwrite d12/d13/d20/d66/f69 [0,4194304] 0 2024-09-13T02:52:37.132 INFO:tasks.workunit.client.0.smithi098.stdout:1/76: rename d9/fa to d9/d12/f18 0 2024-09-13T02:52:37.133 INFO:tasks.workunit.client.0.smithi098.stdout:2/58: dread d1/f8 [0,4194304] 0 2024-09-13T02:52:37.134 INFO:tasks.workunit.client.0.smithi098.stdout:2/59: fsync d1/d4/f7 0 2024-09-13T02:52:37.135 INFO:tasks.workunit.client.0.smithi098.stdout:6/17: mkdir d5 0 2024-09-13T02:52:37.136 INFO:tasks.workunit.client.0.smithi098.stdout:6/18: chown d5 0 1 2024-09-13T02:52:37.139 INFO:tasks.workunit.client.1.smithi142.stdout:0/359: dread d10/f7c [0,4194304] 0 2024-09-13T02:52:37.140 INFO:tasks.workunit.client.0.smithi098.stdout:5/42: mkdir d0/d14 0 2024-09-13T02:52:37.141 INFO:tasks.workunit.client.0.smithi098.stdout:5/43: dread - d0/ff zero size 2024-09-13T02:52:37.142 INFO:tasks.workunit.client.0.smithi098.stdout:2/60: dwrite d1/d4/f7 [0,4194304] 0 2024-09-13T02:52:37.143 INFO:tasks.workunit.client.0.smithi098.stdout:2/61: chown d1/d4 149 1 2024-09-13T02:52:37.144 INFO:tasks.workunit.client.0.smithi098.stdout:4/49: fsync d6/f8 0 2024-09-13T02:52:37.146 INFO:tasks.workunit.client.1.smithi142.stdout:0/360: dwrite d10/d15/d1a/f22 [8388608,4194304] 0 2024-09-13T02:52:37.147 INFO:tasks.workunit.client.1.smithi142.stdout:2/248: dread d1/de/d1f/d13/f33 [0,4194304] 0 2024-09-13T02:52:37.149 INFO:tasks.workunit.client.1.smithi142.stdout:2/249: fdatasync d1/de/d1f/d13/f4a 0 2024-09-13T02:52:37.149 INFO:tasks.workunit.client.0.smithi098.stdout:7/211: write d6/ff [1107855,110798] 0 2024-09-13T02:52:37.150 INFO:tasks.workunit.client.1.smithi142.stdout:2/250: stat d1/d42 0 2024-09-13T02:52:37.150 INFO:tasks.workunit.client.0.smithi098.stdout:3/32: creat d7/d9/fa x:0 0 0 2024-09-13T02:52:37.151 INFO:tasks.workunit.client.0.smithi098.stdout:7/212: write d6/f11 [751121,78125] 0 2024-09-13T02:52:37.152 INFO:tasks.workunit.client.1.smithi142.stdout:2/251: truncate d1/ff 4991003 0 2024-09-13T02:52:37.152 INFO:tasks.workunit.client.1.smithi142.stdout:7/359: unlink d10/l28 0 2024-09-13T02:52:37.154 INFO:tasks.workunit.client.0.smithi098.stdout:7/213: truncate d6/d14/f44 180913 0 2024-09-13T02:52:37.155 INFO:tasks.workunit.client.0.smithi098.stdout:7/214: chown d6/d24/d46 9 1 2024-09-13T02:52:37.159 INFO:tasks.workunit.client.0.smithi098.stdout:3/33: dwrite f6 [0,4194304] 0 2024-09-13T02:52:37.159 INFO:tasks.workunit.client.0.smithi098.stdout:7/215: truncate d6/d24/d2a/f31 4544967 0 2024-09-13T02:52:37.160 INFO:tasks.workunit.client.0.smithi098.stdout:9/45: rename d2/lc to d2/dd/l11 0 2024-09-13T02:52:37.162 INFO:tasks.workunit.client.1.smithi142.stdout:5/397: truncate d8/f13 835601 0 2024-09-13T02:52:37.164 INFO:tasks.workunit.client.0.smithi098.stdout:7/216: dread d6/f10 [0,4194304] 0 2024-09-13T02:52:37.165 INFO:tasks.workunit.client.1.smithi142.stdout:9/474: creat dd/d17/d44/d82/d99/daf/fb6 x:0 0 0 2024-09-13T02:52:37.169 INFO:tasks.workunit.client.1.smithi142.stdout:4/345: getdents d0/d2b/d21/d30 0 2024-09-13T02:52:37.170 INFO:tasks.workunit.client.1.smithi142.stdout:4/346: read - d0/d2b/d21/d35/f6a zero size 2024-09-13T02:52:37.170 INFO:tasks.workunit.client.1.smithi142.stdout:4/347: dread - d0/d2b/d21/d35/f6a zero size 2024-09-13T02:52:37.171 INFO:tasks.workunit.client.1.smithi142.stdout:8/304: truncate d0/d6/dc/d45/d8/f12 1129153 0 2024-09-13T02:52:37.175 INFO:tasks.workunit.client.0.smithi098.stdout:5/44: mkdir d0/d15 0 2024-09-13T02:52:37.176 INFO:tasks.workunit.client.0.smithi098.stdout:7/217: dwrite d6/f41 [0,4194304] 0 2024-09-13T02:52:37.176 INFO:tasks.workunit.client.1.smithi142.stdout:0/361: dread d10/d15/d1a/d1e/d42/d4b/f61 [0,4194304] 0 2024-09-13T02:52:37.176 INFO:tasks.workunit.client.1.smithi142.stdout:2/252: creat d1/d2d/f53 x:0 0 0 2024-09-13T02:52:37.177 INFO:tasks.workunit.client.1.smithi142.stdout:0/362: fdatasync d10/d6c/f71 0 2024-09-13T02:52:37.178 INFO:tasks.workunit.client.1.smithi142.stdout:0/363: chown d10/d15/d1a/d1e/c67 2692 1 2024-09-13T02:52:37.180 INFO:tasks.workunit.client.0.smithi098.stdout:2/62: unlink d1/fa 0 2024-09-13T02:52:37.180 INFO:tasks.workunit.client.0.smithi098.stdout:6/19: write f2 [588999,71119] 0 2024-09-13T02:52:37.181 INFO:tasks.workunit.client.0.smithi098.stdout:1/77: dwrite d9/f10 [4194304,4194304] 0 2024-09-13T02:52:37.182 INFO:tasks.workunit.client.1.smithi142.stdout:5/398: dread d8/f1b [0,4194304] 0 2024-09-13T02:52:37.184 INFO:tasks.workunit.client.0.smithi098.stdout:2/63: dread - d1/d4/d9/fe zero size 2024-09-13T02:52:37.184 INFO:tasks.workunit.client.0.smithi098.stdout:4/50: mkdir d6/db 0 2024-09-13T02:52:37.187 INFO:tasks.workunit.client.1.smithi142.stdout:3/382: getdents d12/d16/d25/d2e/d38/d4d/d53 0 2024-09-13T02:52:37.189 INFO:tasks.workunit.client.0.smithi098.stdout:1/78: dread d9/d13/f17 [0,4194304] 0 2024-09-13T02:52:37.189 INFO:tasks.workunit.client.1.smithi142.stdout:7/360: dread d10/d13/f1c [0,4194304] 0 2024-09-13T02:52:37.191 INFO:tasks.workunit.client.0.smithi098.stdout:0/67: chown dd/df/c11 89 1 2024-09-13T02:52:37.191 INFO:tasks.workunit.client.0.smithi098.stdout:3/34: rmdir d7 39 2024-09-13T02:52:37.193 INFO:tasks.workunit.client.1.smithi142.stdout:9/475: mkdir dd/d17/d44/d82/d99/da8/db7 0 2024-09-13T02:52:37.193 INFO:tasks.workunit.client.1.smithi142.stdout:7/361: chown d10/d34/d57 813905 1 2024-09-13T02:52:37.193 INFO:tasks.workunit.client.1.smithi142.stdout:4/348: mknod d0/d2b/d21/c71 0 2024-09-13T02:52:37.193 INFO:tasks.workunit.client.1.smithi142.stdout:9/476: chown dd/d17/l6c 61 1 2024-09-13T02:52:37.194 INFO:tasks.workunit.client.0.smithi098.stdout:9/46: readlink d2/dd/l11 0 2024-09-13T02:52:37.195 INFO:tasks.workunit.client.0.smithi098.stdout:9/47: fdatasync d2/f10 0 2024-09-13T02:52:37.195 INFO:tasks.workunit.client.1.smithi142.stdout:2/253: write f0 [5039170,16764] 0 2024-09-13T02:52:37.196 INFO:tasks.workunit.client.0.smithi098.stdout:9/48: chown d2/f10 672485526 1 2024-09-13T02:52:37.196 INFO:tasks.workunit.client.1.smithi142.stdout:0/364: rmdir d10/d23 39 2024-09-13T02:52:37.198 INFO:tasks.workunit.client.0.smithi098.stdout:8/61: link d2/lb d2/lf 0 2024-09-13T02:52:37.198 INFO:tasks.workunit.client.1.smithi142.stdout:6/398: link d1/dd/d53/c6e d1/dd/d16/d4d/c85 0 2024-09-13T02:52:37.200 INFO:tasks.workunit.client.1.smithi142.stdout:1/474: creat d12/d13/d1d/f9c x:0 0 0 2024-09-13T02:52:37.201 INFO:tasks.workunit.client.1.smithi142.stdout:3/383: mkdir d12/d16/d25/d2e/d48/d5c/d73 0 2024-09-13T02:52:37.208 INFO:tasks.workunit.client.1.smithi142.stdout:4/349: mknod d0/d2b/d2d/d31/c72 0 2024-09-13T02:52:37.209 INFO:tasks.workunit.client.1.smithi142.stdout:4/350: write d0/d2b/d21/d30/f4e [1042766,47976] 0 2024-09-13T02:52:37.211 INFO:tasks.workunit.client.1.smithi142.stdout:7/362: fsync d10/d13/d1d/d2b/d55/f3c 0 2024-09-13T02:52:37.213 INFO:tasks.workunit.client.0.smithi098.stdout:2/64: symlink d1/d4/dc/l10 0 2024-09-13T02:52:37.213 INFO:tasks.workunit.client.1.smithi142.stdout:0/365: dread d10/d15/d21/f3c [0,4194304] 0 2024-09-13T02:52:37.213 INFO:tasks.workunit.client.1.smithi142.stdout:9/477: mkdir dd/d17/d5f/d7b/db8 0 2024-09-13T02:52:37.214 INFO:tasks.workunit.client.1.smithi142.stdout:9/478: fdatasync dd/d17/d44/f5c 0 2024-09-13T02:52:37.214 INFO:tasks.workunit.client.1.smithi142.stdout:9/479: fdatasync f8 0 2024-09-13T02:52:37.214 INFO:tasks.workunit.client.1.smithi142.stdout:2/254: fdatasync d1/de/f20 0 2024-09-13T02:52:37.216 INFO:tasks.workunit.client.1.smithi142.stdout:2/255: fdatasync d1/de/d1f/d13/f2a 0 2024-09-13T02:52:37.217 INFO:tasks.workunit.client.1.smithi142.stdout:2/256: read d1/f5 [2978363,80810] 0 2024-09-13T02:52:37.219 INFO:tasks.workunit.client.1.smithi142.stdout:6/399: symlink d1/dd/d16/d4e/l86 0 2024-09-13T02:52:37.224 INFO:tasks.workunit.client.1.smithi142.stdout:0/366: dread d10/d15/d1a/f6b [0,4194304] 0 2024-09-13T02:52:37.225 INFO:tasks.workunit.client.0.smithi098.stdout:9/49: rename d2/c5 to d2/dd/c12 0 2024-09-13T02:52:37.225 INFO:tasks.workunit.client.1.smithi142.stdout:0/367: truncate d10/d15/d45/f56 546797 0 2024-09-13T02:52:37.225 INFO:tasks.workunit.client.1.smithi142.stdout:0/368: fdatasync d10/d15/d21/d51/d35/f76 0 2024-09-13T02:52:37.226 INFO:tasks.workunit.client.1.smithi142.stdout:0/369: chown d10/d15/d1a/f22 392 1 2024-09-13T02:52:37.227 INFO:tasks.workunit.client.0.smithi098.stdout:8/62: read f1 [2882342,111947] 0 2024-09-13T02:52:37.227 INFO:tasks.workunit.client.1.smithi142.stdout:0/370: write d10/d15/d21/d51/d35/f55 [190137,124325] 0 2024-09-13T02:52:37.228 INFO:tasks.workunit.client.0.smithi098.stdout:7/218: mkdir d6/d49 0 2024-09-13T02:52:37.231 INFO:tasks.workunit.client.1.smithi142.stdout:7/363: readlink d10/d13/d1d/d2b/l2f 0 2024-09-13T02:52:37.233 INFO:tasks.workunit.client.0.smithi098.stdout:6/20: mknod d5/c6 0 2024-09-13T02:52:37.236 INFO:tasks.workunit.client.0.smithi098.stdout:9/50: dwrite d2/dd/fe [0,4194304] 0 2024-09-13T02:52:37.237 INFO:tasks.workunit.client.0.smithi098.stdout:1/79: dwrite f1 [0,4194304] 0 2024-09-13T02:52:37.237 INFO:tasks.workunit.client.0.smithi098.stdout:2/65: creat d1/d4/dc/f11 x:0 0 0 2024-09-13T02:52:37.238 INFO:tasks.workunit.client.0.smithi098.stdout:5/45: truncate d0/d1/f9 3867290 0 2024-09-13T02:52:37.240 INFO:tasks.workunit.client.1.smithi142.stdout:9/480: mkdir dd/d17/d5f/d7b/db9 0 2024-09-13T02:52:37.241 INFO:tasks.workunit.client.0.smithi098.stdout:4/51: creat d6/db/fc x:0 0 0 2024-09-13T02:52:37.243 INFO:tasks.workunit.client.0.smithi098.stdout:3/35: symlink d7/d9/lb 0 2024-09-13T02:52:37.244 INFO:tasks.workunit.client.1.smithi142.stdout:2/257: dread - d1/f35 zero size 2024-09-13T02:52:37.245 INFO:tasks.workunit.client.1.smithi142.stdout:2/258: fdatasync d1/de/d1f/f19 0 2024-09-13T02:52:37.246 INFO:tasks.workunit.client.0.smithi098.stdout:3/36: chown d7/d9/fa 15 1 2024-09-13T02:52:37.247 INFO:tasks.workunit.client.1.smithi142.stdout:6/400: mkdir d1/d7/d19/d30/d87 0 2024-09-13T02:52:37.247 INFO:tasks.workunit.client.1.smithi142.stdout:2/259: chown d1/de/d1f/d13/f33 60537 1 2024-09-13T02:52:37.247 INFO:tasks.workunit.client.1.smithi142.stdout:1/475: readlink d12/d13/d1d/d26/l51 0 2024-09-13T02:52:37.248 INFO:tasks.workunit.client.0.smithi098.stdout:9/51: dread d2/dd/fe [0,4194304] 0 2024-09-13T02:52:37.248 INFO:tasks.workunit.client.0.smithi098.stdout:3/37: stat f1 0 2024-09-13T02:52:37.248 INFO:tasks.workunit.client.1.smithi142.stdout:2/260: chown d1/d29/d2b/d47 27 1 2024-09-13T02:52:37.249 INFO:tasks.workunit.client.0.smithi098.stdout:7/219: symlink d6/d24/d2a/l4a 0 2024-09-13T02:52:37.249 INFO:tasks.workunit.client.0.smithi098.stdout:2/66: dread d1/f8 [0,4194304] 0 2024-09-13T02:52:37.250 INFO:tasks.workunit.client.0.smithi098.stdout:1/80: dwrite f1 [0,4194304] 0 2024-09-13T02:52:37.250 INFO:tasks.workunit.client.0.smithi098.stdout:2/67: stat d1/d4/f7 0 2024-09-13T02:52:37.251 INFO:tasks.workunit.client.1.smithi142.stdout:3/384: mknod d12/d16/c74 0 2024-09-13T02:52:37.254 INFO:tasks.workunit.client.1.smithi142.stdout:7/364: dread d10/d34/f5a [0,4194304] 0 2024-09-13T02:52:37.254 INFO:tasks.workunit.client.1.smithi142.stdout:4/351: rename d0/d2b/d2d/d65/l33 to d0/d2b/d2d/d31/d43/d48/l73 0 2024-09-13T02:52:37.254 INFO:tasks.workunit.client.0.smithi098.stdout:6/21: mknod d5/c7 0 2024-09-13T02:52:37.255 INFO:tasks.workunit.client.0.smithi098.stdout:6/22: chown d5/c7 5 1 2024-09-13T02:52:37.257 INFO:tasks.workunit.client.1.smithi142.stdout:2/261: dwrite d1/d29/f30 [0,4194304] 0 2024-09-13T02:52:37.263 INFO:tasks.workunit.client.0.smithi098.stdout:0/68: truncate f8 123949 0 2024-09-13T02:52:37.263 INFO:tasks.workunit.client.0.smithi098.stdout:0/69: chown fb 1695 1 2024-09-13T02:52:37.264 INFO:tasks.workunit.client.1.smithi142.stdout:8/305: sync 2024-09-13T02:52:37.264 INFO:tasks.workunit.client.0.smithi098.stdout:4/52: rmdir d6/db 39 2024-09-13T02:52:37.272 INFO:tasks.workunit.client.1.smithi142.stdout:6/401: mkdir d1/d7/d42/d88 0 2024-09-13T02:52:37.272 INFO:tasks.workunit.client.0.smithi098.stdout:0/70: dwrite fa [0,4194304] 0 2024-09-13T02:52:37.273 INFO:tasks.workunit.client.0.smithi098.stdout:3/38: creat d7/fc x:0 0 0 2024-09-13T02:52:37.276 INFO:tasks.workunit.client.1.smithi142.stdout:1/476: unlink d12/d13/d20/f5e 0 2024-09-13T02:52:37.277 INFO:tasks.workunit.client.1.smithi142.stdout:1/477: write d12/d13/d20/d66/d55/f47 [803428,48395] 0 2024-09-13T02:52:37.277 INFO:tasks.workunit.client.1.smithi142.stdout:1/478: dread - d12/d13/d45/f7c zero size 2024-09-13T02:52:37.281 INFO:tasks.workunit.client.0.smithi098.stdout:3/39: dwrite f6 [0,4194304] 0 2024-09-13T02:52:37.282 INFO:tasks.workunit.client.0.smithi098.stdout:1/81: mkdir d9/d13/d19 0 2024-09-13T02:52:37.283 INFO:tasks.workunit.client.1.smithi142.stdout:3/385: fsync d12/d16/d25/f41 0 2024-09-13T02:52:37.283 INFO:tasks.workunit.client.0.smithi098.stdout:1/82: write f8 [2554879,32302] 0 2024-09-13T02:52:37.284 INFO:tasks.workunit.client.0.smithi098.stdout:1/83: chown d9/d12 7647 1 2024-09-13T02:52:37.285 INFO:tasks.workunit.client.0.smithi098.stdout:1/84: write d9/f10 [7405537,26100] 0 2024-09-13T02:52:37.289 INFO:tasks.workunit.client.1.smithi142.stdout:0/371: mknod d10/d23/c82 0 2024-09-13T02:52:37.294 INFO:tasks.workunit.client.0.smithi098.stdout:1/85: fsync f1 0 2024-09-13T02:52:37.302 INFO:tasks.workunit.client.0.smithi098.stdout:8/63: truncate d2/f6 1636611 0 2024-09-13T02:52:37.304 INFO:tasks.workunit.client.1.smithi142.stdout:1/479: creat d12/d13/d20/d27/d3c/d71/f9d x:0 0 0 2024-09-13T02:52:37.306 INFO:tasks.workunit.client.1.smithi142.stdout:7/365: dread ff [0,4194304] 0 2024-09-13T02:52:37.306 INFO:tasks.workunit.client.0.smithi098.stdout:3/40: rmdir d7 39 2024-09-13T02:52:37.309 INFO:tasks.workunit.client.1.smithi142.stdout:3/386: chown d12/d16/c2c 13438685 1 2024-09-13T02:52:37.312 INFO:tasks.workunit.client.1.smithi142.stdout:5/399: sync 2024-09-13T02:52:37.313 INFO:tasks.workunit.client.1.smithi142.stdout:0/372: mknod d10/d6c/c83 0 2024-09-13T02:52:37.313 INFO:tasks.workunit.client.1.smithi142.stdout:5/400: read - d8/d24/d26/d2d/f7d zero size 2024-09-13T02:52:37.315 INFO:tasks.workunit.client.0.smithi098.stdout:2/68: rename d1/d4/dc/f11 to d1/d4/f12 0 2024-09-13T02:52:37.315 INFO:tasks.workunit.client.0.smithi098.stdout:6/23: rename d5 to d5/d8 22 2024-09-13T02:52:37.317 INFO:tasks.workunit.client.1.smithi142.stdout:2/262: dread d1/fb [0,4194304] 0 2024-09-13T02:52:37.318 INFO:tasks.workunit.client.1.smithi142.stdout:9/481: write dd/fe [1646899,1934] 0 2024-09-13T02:52:37.318 INFO:tasks.workunit.client.0.smithi098.stdout:5/46: link d0/d1/c3 d0/d14/c16 0 2024-09-13T02:52:37.320 INFO:tasks.workunit.client.1.smithi142.stdout:8/306: unlink d0/d6/dc/d45/d8/df/d28/l51 0 2024-09-13T02:52:37.320 INFO:tasks.workunit.client.0.smithi098.stdout:7/220: truncate d6/fc 1873089 0 2024-09-13T02:52:37.321 INFO:tasks.workunit.client.1.smithi142.stdout:8/307: write d0/d6/dc/d45/d35/d37/f5d [294944,86015] 0 2024-09-13T02:52:37.322 INFO:tasks.workunit.client.1.smithi142.stdout:8/308: write d0/d6/dc/d45/d35/f56 [585736,103032] 0 2024-09-13T02:52:37.328 INFO:tasks.workunit.client.0.smithi098.stdout:9/52: truncate d2/dd/fe 2876289 0 2024-09-13T02:52:37.328 INFO:tasks.workunit.client.0.smithi098.stdout:9/53: read d2/f10 [2429504,9928] 0 2024-09-13T02:52:37.331 INFO:tasks.workunit.client.1.smithi142.stdout:3/387: creat d12/d16/d25/d2e/f75 x:0 0 0 2024-09-13T02:52:37.332 INFO:tasks.workunit.client.0.smithi098.stdout:6/24: rename f2 to d5/f9 0 2024-09-13T02:52:37.333 INFO:tasks.workunit.client.0.smithi098.stdout:1/86: mknod d9/d13/d19/c1a 0 2024-09-13T02:52:37.335 INFO:tasks.workunit.client.0.smithi098.stdout:6/25: dread f3 [0,4194304] 0 2024-09-13T02:52:37.336 INFO:tasks.workunit.client.0.smithi098.stdout:6/26: read d5/f9 [276081,50620] 0 2024-09-13T02:52:37.336 INFO:tasks.workunit.client.0.smithi098.stdout:2/69: fsync d1/d4/f12 0 2024-09-13T02:52:37.339 INFO:tasks.workunit.client.1.smithi142.stdout:4/352: link d0/d2b/d2d/d31/d32/f58 d0/d2b/f74 0 2024-09-13T02:52:37.344 INFO:tasks.workunit.client.0.smithi098.stdout:4/53: write f3 [2412365,72176] 0 2024-09-13T02:52:37.345 INFO:tasks.workunit.client.1.smithi142.stdout:6/402: write d1/dd/f22 [470330,5572] 0 2024-09-13T02:52:37.345 INFO:tasks.workunit.client.1.smithi142.stdout:2/263: truncate d1/de/d31/f3d 7562319 0 2024-09-13T02:52:37.345 INFO:tasks.workunit.client.1.smithi142.stdout:2/264: write d1/de/d1f/d13/f2a [609824,26008] 0 2024-09-13T02:52:37.346 INFO:tasks.workunit.client.0.smithi098.stdout:3/41: mknod d7/d9/cd 0 2024-09-13T02:52:37.347 INFO:tasks.workunit.client.1.smithi142.stdout:9/482: creat dd/d17/d5f/fba x:0 0 0 2024-09-13T02:52:37.348 INFO:tasks.workunit.client.0.smithi098.stdout:9/54: symlink d2/dd/l13 0 2024-09-13T02:52:37.353 INFO:tasks.workunit.client.0.smithi098.stdout:5/47: rename d0/d14 to d0/d15/d17 0 2024-09-13T02:52:37.353 INFO:tasks.workunit.client.0.smithi098.stdout:5/48: chown d0/d15 132086 1 2024-09-13T02:52:37.357 INFO:tasks.workunit.client.0.smithi098.stdout:7/221: mknod d6/d49/c4b 0 2024-09-13T02:52:37.360 INFO:tasks.workunit.client.0.smithi098.stdout:5/49: dwrite d0/d1/f8 [0,4194304] 0 2024-09-13T02:52:37.361 INFO:tasks.workunit.client.0.smithi098.stdout:6/27: mknod d5/ca 0 2024-09-13T02:52:37.363 INFO:tasks.workunit.client.1.smithi142.stdout:5/401: link d8/d24/d4d/f6f d8/d24/d26/d61/f7e 0 2024-09-13T02:52:37.364 INFO:tasks.workunit.client.0.smithi098.stdout:2/70: readlink d1/d4/d9/lf 0 2024-09-13T02:52:37.369 INFO:tasks.workunit.client.1.smithi142.stdout:5/402: dwrite d8/f1e [0,4194304] 0 2024-09-13T02:52:37.369 INFO:tasks.workunit.client.1.smithi142.stdout:7/366: write fd [1397001,69216] 0 2024-09-13T02:52:37.373 INFO:tasks.workunit.client.0.smithi098.stdout:3/42: creat d7/fe x:0 0 0 2024-09-13T02:52:37.373 INFO:tasks.workunit.client.1.smithi142.stdout:1/480: creat d12/d13/d1d/f9e x:0 0 0 2024-09-13T02:52:37.374 INFO:tasks.workunit.client.0.smithi098.stdout:3/43: stat d7/d9/fa 0 2024-09-13T02:52:37.374 INFO:tasks.workunit.client.0.smithi098.stdout:3/44: chown f6 23 1 2024-09-13T02:52:37.374 INFO:tasks.workunit.client.0.smithi098.stdout:3/45: rename d7 to d7/d9/df 22 2024-09-13T02:52:37.379 INFO:tasks.workunit.client.1.smithi142.stdout:4/353: mkdir d0/d2b/d75 0 2024-09-13T02:52:37.379 INFO:tasks.workunit.client.1.smithi142.stdout:5/403: dwrite d8/d24/d26/d63/f73 [0,4194304] 0 2024-09-13T02:52:37.380 INFO:tasks.workunit.client.0.smithi098.stdout:7/222: mkdir d6/d14/d4c 0 2024-09-13T02:52:37.381 INFO:tasks.workunit.client.1.smithi142.stdout:9/483: fdatasync dd/d17/fb3 0 2024-09-13T02:52:37.383 INFO:tasks.workunit.client.1.smithi142.stdout:8/309: link d0/d6/dc/ld d0/d6/dc/d40/l60 0 2024-09-13T02:52:37.394 INFO:tasks.workunit.client.1.smithi142.stdout:0/373: rename d10/d23/c69 to d10/c84 0 2024-09-13T02:52:37.395 INFO:tasks.workunit.client.0.smithi098.stdout:6/28: dwrite d5/f9 [0,4194304] 0 2024-09-13T02:52:37.396 INFO:tasks.workunit.client.1.smithi142.stdout:0/374: dread d10/d15/d1a/d1e/d42/d4b/f61 [0,4194304] 0 2024-09-13T02:52:37.396 INFO:tasks.workunit.client.1.smithi142.stdout:0/375: chown d10/d15/d1a/d7a 1555773 1 2024-09-13T02:52:37.398 INFO:tasks.workunit.client.0.smithi098.stdout:8/64: link d2/la d2/l10 0 2024-09-13T02:52:37.398 INFO:tasks.workunit.client.0.smithi098.stdout:8/65: dread - d2/fe zero size 2024-09-13T02:52:37.399 INFO:tasks.workunit.client.0.smithi098.stdout:8/66: chown d2/c8 58 1 2024-09-13T02:52:37.400 INFO:tasks.workunit.client.0.smithi098.stdout:1/87: truncate d9/d12/f18 6191295 0 2024-09-13T02:52:37.401 INFO:tasks.workunit.client.1.smithi142.stdout:1/481: mknod d12/d13/d20/d27/d3c/d71/d96/c9f 0 2024-09-13T02:52:37.403 INFO:tasks.workunit.client.0.smithi098.stdout:9/55: creat d2/d6/f14 x:0 0 0 2024-09-13T02:52:37.404 INFO:tasks.workunit.client.0.smithi098.stdout:9/56: write d2/f10 [1698041,85375] 0 2024-09-13T02:52:37.405 INFO:tasks.workunit.client.0.smithi098.stdout:9/57: stat d2/d6/l9 0 2024-09-13T02:52:37.405 INFO:tasks.workunit.client.0.smithi098.stdout:9/58: dread - d2/d6/f14 zero size 2024-09-13T02:52:37.406 INFO:tasks.workunit.client.0.smithi098.stdout:7/223: unlink d6/d24/d2a/f35 0 2024-09-13T02:52:37.408 INFO:tasks.workunit.client.1.smithi142.stdout:2/265: creat d1/f54 x:0 0 0 2024-09-13T02:52:37.408 INFO:tasks.workunit.client.1.smithi142.stdout:5/404: dread d8/f2e [0,4194304] 0 2024-09-13T02:52:37.413 INFO:tasks.workunit.client.1.smithi142.stdout:8/310: mkdir d0/d6/dc/d45/d35/d61 0 2024-09-13T02:52:37.414 INFO:tasks.workunit.client.0.smithi098.stdout:4/54: creat d6/fd x:0 0 0 2024-09-13T02:52:37.415 INFO:tasks.workunit.client.1.smithi142.stdout:7/367: unlink d10/d13/d21/c30 0 2024-09-13T02:52:37.417 INFO:tasks.workunit.client.1.smithi142.stdout:3/388: getdents d12/d16/d25 0 2024-09-13T02:52:37.420 INFO:tasks.workunit.client.0.smithi098.stdout:9/59: mknod d2/dd/c15 0 2024-09-13T02:52:37.420 INFO:tasks.workunit.client.0.smithi098.stdout:9/60: dread - d2/d6/f14 zero size 2024-09-13T02:52:37.422 INFO:tasks.workunit.client.0.smithi098.stdout:7/224: creat d6/d14/f4d x:0 0 0 2024-09-13T02:52:37.424 INFO:tasks.workunit.client.1.smithi142.stdout:5/405: dwrite d8/d24/d26/d63/f73 [4194304,4194304] 0 2024-09-13T02:52:37.425 INFO:tasks.workunit.client.1.smithi142.stdout:4/354: unlink d0/c18 0 2024-09-13T02:52:37.426 INFO:tasks.workunit.client.1.smithi142.stdout:5/406: truncate d8/d24/f59 204000 0 2024-09-13T02:52:37.427 INFO:tasks.workunit.client.0.smithi098.stdout:6/29: link f3 d5/fb 0 2024-09-13T02:52:37.430 INFO:tasks.workunit.client.0.smithi098.stdout:1/88: symlink d9/l1b 0 2024-09-13T02:52:37.433 INFO:tasks.workunit.client.0.smithi098.stdout:2/71: truncate d1/f8 1788683 0 2024-09-13T02:52:37.434 INFO:tasks.workunit.client.1.smithi142.stdout:2/266: dwrite d1/de/d1f/d13/f4a [0,4194304] 0 2024-09-13T02:52:37.435 INFO:tasks.workunit.client.0.smithi098.stdout:5/50: dwrite d0/d1/f9 [4194304,4194304] 0 2024-09-13T02:52:37.438 INFO:tasks.workunit.client.0.smithi098.stdout:2/72: dread d1/d4/f7 [0,4194304] 0 2024-09-13T02:52:37.440 INFO:tasks.workunit.client.1.smithi142.stdout:8/311: chown d0/d6/dc/c22 938486587 1 2024-09-13T02:52:37.440 INFO:tasks.workunit.client.0.smithi098.stdout:2/73: write d1/d4/d9/fe [1040396,121654] 0 2024-09-13T02:52:37.444 INFO:tasks.workunit.client.0.smithi098.stdout:4/55: mknod d6/ce 0 2024-09-13T02:52:37.446 INFO:tasks.workunit.client.1.smithi142.stdout:3/389: mknod d12/d16/d25/d2e/d38/d4d/c76 0 2024-09-13T02:52:37.448 INFO:tasks.workunit.client.1.smithi142.stdout:3/390: write d12/d16/d25/d2e/f49 [285103,123418] 0 2024-09-13T02:52:37.449 INFO:tasks.workunit.client.1.smithi142.stdout:6/403: rename d1/d7/d19/c1d to d1/dd/d53/d78/c89 0 2024-09-13T02:52:37.450 INFO:tasks.workunit.client.1.smithi142.stdout:0/376: getdents d10/d15/d21/d51/d79 0 2024-09-13T02:52:37.451 INFO:tasks.workunit.client.1.smithi142.stdout:6/404: dread - d1/d7/d19/f81 zero size 2024-09-13T02:52:37.451 INFO:tasks.workunit.client.1.smithi142.stdout:4/355: symlink d0/d2b/d2d/d31/d32/l76 0 2024-09-13T02:52:37.452 INFO:tasks.workunit.client.1.smithi142.stdout:4/356: fsync d0/d2b/d2d/d31/d43/d48/f68 0 2024-09-13T02:52:37.452 INFO:tasks.workunit.client.1.smithi142.stdout:5/407: rmdir d8 39 2024-09-13T02:52:37.453 INFO:tasks.workunit.client.0.smithi098.stdout:3/46: getdents d7/d9 0 2024-09-13T02:52:37.453 INFO:tasks.workunit.client.1.smithi142.stdout:4/357: readlink d0/d2b/d21/l45 0 2024-09-13T02:52:37.453 INFO:tasks.workunit.client.1.smithi142.stdout:4/358: chown d0/d2b/c56 39099172 1 2024-09-13T02:52:37.454 INFO:tasks.workunit.client.0.smithi098.stdout:3/47: chown d7/fc 10238 1 2024-09-13T02:52:37.459 INFO:tasks.workunit.client.0.smithi098.stdout:5/51: creat d0/d15/f18 x:0 0 0 2024-09-13T02:52:37.461 INFO:tasks.workunit.client.0.smithi098.stdout:7/225: creat d6/d24/d2a/d48/f4e x:0 0 0 2024-09-13T02:52:37.462 INFO:tasks.workunit.client.0.smithi098.stdout:7/226: write d6/f15 [11539373,122317] 0 2024-09-13T02:52:37.462 INFO:tasks.workunit.client.1.smithi142.stdout:7/368: mknod d10/d64/c7a 0 2024-09-13T02:52:37.462 INFO:tasks.workunit.client.0.smithi098.stdout:2/74: dread - d1/d4/f12 zero size 2024-09-13T02:52:37.465 INFO:tasks.workunit.client.0.smithi098.stdout:4/56: fdatasync d6/f8 0 2024-09-13T02:52:37.466 INFO:tasks.workunit.client.1.smithi142.stdout:3/391: mknod d12/d16/d25/c77 0 2024-09-13T02:52:37.468 INFO:tasks.workunit.client.0.smithi098.stdout:6/30: unlink c1 0 2024-09-13T02:52:37.468 INFO:tasks.workunit.client.0.smithi098.stdout:6/31: chown d5/c7 117284161 1 2024-09-13T02:52:37.469 INFO:tasks.workunit.client.0.smithi098.stdout:6/32: chown f4 5 1 2024-09-13T02:52:37.470 INFO:tasks.workunit.client.1.smithi142.stdout:1/482: rename d12/d13/d20/d27/d3c/d53 to d12/d13/d20/d66/d55/da0 0 2024-09-13T02:52:37.471 INFO:tasks.workunit.client.1.smithi142.stdout:3/392: dwrite d12/d16/f24 [0,4194304] 0 2024-09-13T02:52:37.472 INFO:tasks.workunit.client.0.smithi098.stdout:3/48: rmdir d7 39 2024-09-13T02:52:37.473 INFO:tasks.workunit.client.1.smithi142.stdout:8/312: write d0/d6/d23/f3d [450972,113848] 0 2024-09-13T02:52:37.474 INFO:tasks.workunit.client.1.smithi142.stdout:6/405: mknod d1/d7/d19/d30/c8a 0 2024-09-13T02:52:37.477 INFO:tasks.workunit.client.1.smithi142.stdout:4/359: chown d0/d2b/d2d/d65/c2c 505840 1 2024-09-13T02:52:37.477 INFO:tasks.workunit.client.0.smithi098.stdout:5/52: mkdir d0/d15/d19 0 2024-09-13T02:52:37.478 INFO:tasks.workunit.client.1.smithi142.stdout:4/360: fsync d0/df/f5d 0 2024-09-13T02:52:37.479 INFO:tasks.workunit.client.1.smithi142.stdout:2/267: creat d1/d42/f55 x:0 0 0 2024-09-13T02:52:37.480 INFO:tasks.workunit.client.1.smithi142.stdout:2/268: readlink d1/de/d1f/d13/l49 0 2024-09-13T02:52:37.482 INFO:tasks.workunit.client.1.smithi142.stdout:9/484: getdents dd/d17/d4f/d91 0 2024-09-13T02:52:37.482 INFO:tasks.workunit.client.1.smithi142.stdout:5/408: dwrite d8/d24/d26/d45/f54 [0,4194304] 0 2024-09-13T02:52:37.483 INFO:tasks.workunit.client.1.smithi142.stdout:9/485: chown dd/d17/d69/d84/l3b 0 1 2024-09-13T02:52:37.484 INFO:tasks.workunit.client.0.smithi098.stdout:7/227: rmdir d6/d49 39 2024-09-13T02:52:37.484 INFO:tasks.workunit.client.1.smithi142.stdout:9/486: write dd/d17/d5f/fba [685851,86502] 0 2024-09-13T02:52:37.485 INFO:tasks.workunit.client.1.smithi142.stdout:9/487: readlink dd/d17/d69/d84/l8d 0 2024-09-13T02:52:37.489 INFO:tasks.workunit.client.0.smithi098.stdout:4/57: unlink f3 0 2024-09-13T02:52:37.490 INFO:tasks.workunit.client.0.smithi098.stdout:4/58: readlink d6/l7 0 2024-09-13T02:52:37.490 INFO:tasks.workunit.client.0.smithi098.stdout:4/59: fsync d6/fd 0 2024-09-13T02:52:37.491 INFO:tasks.workunit.client.0.smithi098.stdout:6/33: creat d5/fc x:0 0 0 2024-09-13T02:52:37.493 INFO:tasks.workunit.client.0.smithi098.stdout:1/89: creat d9/f1c x:0 0 0 2024-09-13T02:52:37.495 INFO:tasks.workunit.client.1.smithi142.stdout:6/406: rmdir d1/d7/d19/d30 39 2024-09-13T02:52:37.496 INFO:tasks.workunit.client.0.smithi098.stdout:9/61: getdents d2/dd 0 2024-09-13T02:52:37.496 INFO:tasks.workunit.client.0.smithi098.stdout:9/62: dread - d2/d6/f14 zero size 2024-09-13T02:52:37.498 INFO:tasks.workunit.client.0.smithi098.stdout:5/53: mkdir d0/d1/d1a 0 2024-09-13T02:52:37.498 INFO:tasks.workunit.client.0.smithi098.stdout:5/54: stat d0/d15/d17 0 2024-09-13T02:52:37.499 INFO:tasks.workunit.client.0.smithi098.stdout:5/55: chown d0/d15/d17 114723 1 2024-09-13T02:52:37.500 INFO:tasks.workunit.client.0.smithi098.stdout:5/56: chown d0/d1/ca 118 1 2024-09-13T02:52:37.500 INFO:tasks.workunit.client.1.smithi142.stdout:6/407: dwrite d1/f3d [4194304,4194304] 0 2024-09-13T02:52:37.500 INFO:tasks.workunit.client.0.smithi098.stdout:5/57: truncate d0/ff 688838 0 2024-09-13T02:52:37.502 INFO:tasks.workunit.client.0.smithi098.stdout:2/75: mknod d1/c13 0 2024-09-13T02:52:37.502 INFO:tasks.workunit.client.0.smithi098.stdout:2/76: chown d1/d4/f12 4425962 1 2024-09-13T02:52:37.503 INFO:tasks.workunit.client.1.smithi142.stdout:0/377: write d10/d15/d21/d51/f54 [1707437,68892] 0 2024-09-13T02:52:37.504 INFO:tasks.workunit.client.1.smithi142.stdout:2/269: creat d1/de/f56 x:0 0 0 2024-09-13T02:52:37.507 INFO:tasks.workunit.client.1.smithi142.stdout:0/378: write d10/d15/d21/d51/d35/f55 [1283105,14956] 0 2024-09-13T02:52:37.509 INFO:tasks.workunit.client.0.smithi098.stdout:4/60: write d6/f8 [612304,47753] 0 2024-09-13T02:52:37.509 INFO:tasks.workunit.client.1.smithi142.stdout:6/408: dwrite d1/dd/d53/d78/f80 [0,4194304] 0 2024-09-13T02:52:37.510 INFO:tasks.workunit.client.1.smithi142.stdout:6/409: stat d1/dd/d16/l77 0 2024-09-13T02:52:37.513 INFO:tasks.workunit.client.1.smithi142.stdout:5/409: write d8/d24/d26/f5c [8303811,45233] 0 2024-09-13T02:52:37.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/410: write d8/fe [1490578,106074] 0 2024-09-13T02:52:37.519 INFO:tasks.workunit.client.0.smithi098.stdout:3/49: mknod d7/d9/c10 0 2024-09-13T02:52:37.520 INFO:tasks.workunit.client.1.smithi142.stdout:3/393: unlink d12/d16/c36 0 2024-09-13T02:52:37.521 INFO:tasks.workunit.client.0.smithi098.stdout:4/61: dwrite d6/fd [0,4194304] 0 2024-09-13T02:52:37.521 INFO:tasks.workunit.client.1.smithi142.stdout:3/394: readlink d12/d16/d25/l4e 0 2024-09-13T02:52:37.523 INFO:tasks.workunit.client.1.smithi142.stdout:8/313: mkdir d0/d6/dc/d40/d4d/d62 0 2024-09-13T02:52:37.524 INFO:tasks.workunit.client.0.smithi098.stdout:6/34: dwrite d5/fb [0,4194304] 0 2024-09-13T02:52:37.525 INFO:tasks.workunit.client.0.smithi098.stdout:7/228: creat d6/d49/f4f x:0 0 0 2024-09-13T02:52:37.526 INFO:tasks.workunit.client.1.smithi142.stdout:3/395: dwrite d12/d16/f6f [0,4194304] 0 2024-09-13T02:52:37.526 INFO:tasks.workunit.client.1.smithi142.stdout:3/396: stat lf 0 2024-09-13T02:52:37.530 INFO:tasks.workunit.client.0.smithi098.stdout:5/58: mkdir d0/d15/d17/d1b 0 2024-09-13T02:52:37.531 INFO:tasks.workunit.client.1.smithi142.stdout:4/361: symlink d0/d2b/d21/d35/d6d/l77 0 2024-09-13T02:52:37.532 INFO:tasks.workunit.client.1.smithi142.stdout:4/362: read d0/d2b/d21/f2a [3539416,52350] 0 2024-09-13T02:52:37.532 INFO:tasks.workunit.client.0.smithi098.stdout:3/50: dwrite f1 [0,4194304] 0 2024-09-13T02:52:37.532 INFO:tasks.workunit.client.1.smithi142.stdout:4/363: chown d0/d2b/d21/d35/f5f 1433 1 2024-09-13T02:52:37.534 INFO:tasks.workunit.client.1.smithi142.stdout:2/270: creat d1/de/f57 x:0 0 0 2024-09-13T02:52:37.534 INFO:tasks.workunit.client.1.smithi142.stdout:2/271: dread - d1/de/d1f/d13/f3c zero size 2024-09-13T02:52:37.535 INFO:tasks.workunit.client.0.smithi098.stdout:6/35: dread f3 [0,4194304] 0 2024-09-13T02:52:37.536 INFO:tasks.workunit.client.1.smithi142.stdout:4/364: dread d0/d2b/d2d/d31/d43/f46 [0,4194304] 0 2024-09-13T02:52:37.537 INFO:tasks.workunit.client.0.smithi098.stdout:6/36: chown d5/fc 844512802 1 2024-09-13T02:52:37.540 INFO:tasks.workunit.client.0.smithi098.stdout:7/229: dwrite d6/d24/f3d [0,4194304] 0 2024-09-13T02:52:37.542 INFO:tasks.workunit.client.0.smithi098.stdout:3/51: truncate d7/d9/fa 864423 0 2024-09-13T02:52:37.543 INFO:tasks.workunit.client.0.smithi098.stdout:3/52: read f6 [2027800,85508] 0 2024-09-13T02:52:37.543 INFO:tasks.workunit.client.0.smithi098.stdout:1/90: write d9/d13/f17 [1900775,120050] 0 2024-09-13T02:52:37.546 INFO:tasks.workunit.client.0.smithi098.stdout:1/91: fsync f8 0 2024-09-13T02:52:37.552 INFO:tasks.workunit.client.0.smithi098.stdout:9/63: write d2/dd/fe [2538276,84309] 0 2024-09-13T02:52:37.552 INFO:tasks.workunit.client.0.smithi098.stdout:1/92: rename d9 to d9/d13/d19/d1d 22 2024-09-13T02:52:37.555 INFO:tasks.workunit.client.1.smithi142.stdout:6/410: unlink d1/dd/d16/l77 0 2024-09-13T02:52:37.556 INFO:tasks.workunit.client.0.smithi098.stdout:6/37: dwrite f4 [0,4194304] 0 2024-09-13T02:52:37.559 INFO:tasks.workunit.client.0.smithi098.stdout:6/38: chown f4 245768639 1 2024-09-13T02:52:37.561 INFO:tasks.workunit.client.1.smithi142.stdout:1/483: creat d12/fa1 x:0 0 0 2024-09-13T02:52:37.562 INFO:tasks.workunit.client.0.smithi098.stdout:7/230: dwrite d6/f11 [0,4194304] 0 2024-09-13T02:52:37.565 INFO:tasks.workunit.client.1.smithi142.stdout:5/411: chown d8/d24/c28 196490754 1 2024-09-13T02:52:37.567 INFO:tasks.workunit.client.0.smithi098.stdout:9/64: dwrite d2/dd/fe [0,4194304] 0 2024-09-13T02:52:37.570 INFO:tasks.workunit.client.1.smithi142.stdout:8/314: creat d0/d6/dc/d45/d35/f63 x:0 0 0 2024-09-13T02:52:37.572 INFO:tasks.workunit.client.0.smithi098.stdout:3/53: symlink d7/l11 0 2024-09-13T02:52:37.573 INFO:tasks.workunit.client.1.smithi142.stdout:0/379: dread d10/f13 [0,4194304] 0 2024-09-13T02:52:37.574 INFO:tasks.workunit.client.1.smithi142.stdout:0/380: truncate d10/d23/f4f 1858472 0 2024-09-13T02:52:37.580 INFO:tasks.workunit.client.1.smithi142.stdout:4/365: creat d0/d2b/d2d/d31/d43/d48/f78 x:0 0 0 2024-09-13T02:52:37.581 INFO:tasks.workunit.client.1.smithi142.stdout:4/366: write d0/df/f5d [2697519,31410] 0 2024-09-13T02:52:37.584 INFO:tasks.workunit.client.1.smithi142.stdout:7/369: getdents d10 0 2024-09-13T02:52:37.586 INFO:tasks.workunit.client.1.smithi142.stdout:1/484: rmdir d12/d13/d20/d66 39 2024-09-13T02:52:37.586 INFO:tasks.workunit.client.0.smithi098.stdout:6/39: write f3 [440439,107441] 0 2024-09-13T02:52:37.587 INFO:tasks.workunit.client.1.smithi142.stdout:1/485: chown d12/d13/d1d/f89 1532704 1 2024-09-13T02:52:37.587 INFO:tasks.workunit.client.0.smithi098.stdout:6/40: chown d5/c7 5526 1 2024-09-13T02:52:37.588 INFO:tasks.workunit.client.0.smithi098.stdout:6/41: write d5/fb [851746,99483] 0 2024-09-13T02:52:37.590 INFO:tasks.workunit.client.1.smithi142.stdout:5/412: creat d8/d24/d26/d61/f7f x:0 0 0 2024-09-13T02:52:37.591 INFO:tasks.workunit.client.1.smithi142.stdout:8/315: mkdir d0/d6/d23/d64 0 2024-09-13T02:52:37.596 INFO:tasks.workunit.client.1.smithi142.stdout:0/381: mkdir d10/d15/d1a/d1e/d42/d4b/d85 0 2024-09-13T02:52:37.601 INFO:tasks.workunit.client.1.smithi142.stdout:2/272: mknod d1/d29/c58 0 2024-09-13T02:52:37.601 INFO:tasks.workunit.client.1.smithi142.stdout:0/382: dread d10/d15/d36/f59 [0,4194304] 0 2024-09-13T02:52:37.601 INFO:tasks.workunit.client.1.smithi142.stdout:6/411: dread d1/d7/f2a [0,4194304] 0 2024-09-13T02:52:37.602 INFO:tasks.workunit.client.1.smithi142.stdout:9/488: getdents dd/d87/d8e/da3/da5 0 2024-09-13T02:52:37.603 INFO:tasks.workunit.client.1.smithi142.stdout:3/397: dread d12/d16/d25/d2e/d38/f6d [0,4194304] 0 2024-09-13T02:52:37.604 INFO:tasks.workunit.client.1.smithi142.stdout:4/367: rename d0/df/d57/f20 to d0/d2b/d21/d35/f79 0 2024-09-13T02:52:37.605 INFO:tasks.workunit.client.1.smithi142.stdout:7/370: mknod d10/d34/d57/c7b 0 2024-09-13T02:52:37.606 INFO:tasks.workunit.client.1.smithi142.stdout:1/486: creat d12/d13/d20/d27/d3c/fa2 x:0 0 0 2024-09-13T02:52:37.606 INFO:tasks.workunit.client.1.smithi142.stdout:1/487: write d12/d13/f6b [907141,75415] 0 2024-09-13T02:52:37.607 INFO:tasks.workunit.client.1.smithi142.stdout:5/413: unlink d8/f1e 0 2024-09-13T02:52:37.607 INFO:tasks.workunit.client.1.smithi142.stdout:5/414: chown d8/d24/d26/d2d/f7d 6863 1 2024-09-13T02:52:37.608 INFO:tasks.workunit.client.1.smithi142.stdout:8/316: creat d0/d6/dc/d45/f65 x:0 0 0 2024-09-13T02:52:37.609 INFO:tasks.workunit.client.1.smithi142.stdout:2/273: dread - d1/d2c/f51 zero size 2024-09-13T02:52:37.610 INFO:tasks.workunit.client.1.smithi142.stdout:6/412: creat d1/d7/d42/f8b x:0 0 0 2024-09-13T02:52:37.611 INFO:tasks.workunit.client.1.smithi142.stdout:9/489: mknod dd/d17/d44/cbb 0 2024-09-13T02:52:37.613 INFO:tasks.workunit.client.1.smithi142.stdout:9/490: write dd/d17/d4f/f80 [1405289,63887] 0 2024-09-13T02:52:37.614 INFO:tasks.workunit.client.1.smithi142.stdout:8/317: dwrite d0/d6/dc/d45/fa [0,4194304] 0 2024-09-13T02:52:37.615 INFO:tasks.workunit.client.1.smithi142.stdout:6/413: dread d1/d7/d19/f4b [0,4194304] 0 2024-09-13T02:52:37.616 INFO:tasks.workunit.client.1.smithi142.stdout:0/383: rename d10/d6c/f80 to d10/d15/d30/f86 0 2024-09-13T02:52:37.619 INFO:tasks.workunit.client.1.smithi142.stdout:1/488: fsync d12/d13/d20/d66/d55/da0/f63 0 2024-09-13T02:52:37.621 INFO:tasks.workunit.client.1.smithi142.stdout:2/274: mkdir d1/de/d1f/d13/d59 0 2024-09-13T02:52:37.625 INFO:tasks.workunit.client.0.smithi098.stdout:4/62: rename d6/ce to d6/cf 0 2024-09-13T02:52:37.626 INFO:tasks.workunit.client.0.smithi098.stdout:9/65: rename d2/d6/l9 to d2/d6/l16 0 2024-09-13T02:52:37.626 INFO:tasks.workunit.client.0.smithi098.stdout:3/54: mknod d7/d9/c12 0 2024-09-13T02:52:37.628 INFO:tasks.workunit.client.1.smithi142.stdout:8/318: symlink d0/d6/dc/d40/l66 0 2024-09-13T02:52:37.630 INFO:tasks.workunit.client.0.smithi098.stdout:1/93: mknod d9/c1e 0 2024-09-13T02:52:37.630 INFO:tasks.workunit.client.0.smithi098.stdout:2/77: write d1/f8 [1622523,78798] 0 2024-09-13T02:52:37.630 INFO:tasks.workunit.client.0.smithi098.stdout:5/59: rmdir d0/d15/d17/d1b 0 2024-09-13T02:52:37.630 INFO:tasks.workunit.client.0.smithi098.stdout:3/55: stat d7/l11 0 2024-09-13T02:52:37.630 INFO:tasks.workunit.client.0.smithi098.stdout:4/63: write d6/fd [2088153,36752] 0 2024-09-13T02:52:37.631 INFO:tasks.workunit.client.1.smithi142.stdout:4/368: getdents d0/d2b/d21/d30 0 2024-09-13T02:52:37.631 INFO:tasks.workunit.client.0.smithi098.stdout:7/231: creat d6/d24/d46/f50 x:0 0 0 2024-09-13T02:52:37.632 INFO:tasks.workunit.client.0.smithi098.stdout:6/42: mknod d5/cd 0 2024-09-13T02:52:37.676 INFO:tasks.workunit.client.0.smithi098.stdout:6/43: chown d5/ca 2081353 1 2024-09-13T02:52:37.677 INFO:tasks.workunit.client.0.smithi098.stdout:9/66: dread d2/f10 [0,4194304] 0 2024-09-13T02:52:37.677 INFO:tasks.workunit.client.1.smithi142.stdout:7/371: rename d10/d13/d1d/d2b/f6b to d10/d64/f7c 0 2024-09-13T02:52:37.679 INFO:tasks.workunit.client.1.smithi142.stdout:7/372: read d10/d13/d1d/d2b/d40/f5e [6776121,114981] 0 2024-09-13T02:52:37.680 INFO:tasks.workunit.client.1.smithi142.stdout:0/384: creat d10/d23/f87 x:0 0 0 2024-09-13T02:52:37.681 INFO:tasks.workunit.client.1.smithi142.stdout:9/491: dread dd/ff [0,4194304] 0 2024-09-13T02:52:37.681 INFO:tasks.workunit.client.1.smithi142.stdout:9/492: write dd/ff [4626291,12261] 0 2024-09-13T02:52:37.682 INFO:tasks.workunit.client.1.smithi142.stdout:9/493: write dd/ff [4538541,45927] 0 2024-09-13T02:52:37.683 INFO:tasks.workunit.client.0.smithi098.stdout:7/232: dwrite d6/d14/f44 [0,4194304] 0 2024-09-13T02:52:37.697 INFO:tasks.workunit.client.0.smithi098.stdout:1/94: mkdir d9/d13/d1f 0 2024-09-13T02:52:37.698 INFO:tasks.workunit.client.0.smithi098.stdout:9/67: dwrite d2/d6/f14 [0,4194304] 0 2024-09-13T02:52:37.699 INFO:tasks.workunit.client.1.smithi142.stdout:6/414: unlink d1/dd/d16/d47/l83 0 2024-09-13T02:52:37.701 INFO:tasks.workunit.client.1.smithi142.stdout:5/415: creat d8/d47/d65/f80 x:0 0 0 2024-09-13T02:52:37.705 INFO:tasks.workunit.client.0.smithi098.stdout:5/60: rename d0/d15/d19 to d0/d15/d17/d1c 0 2024-09-13T02:52:37.706 INFO:tasks.workunit.client.0.smithi098.stdout:9/68: dwrite d2/dd/fe [4194304,4194304] 0 2024-09-13T02:52:37.706 INFO:tasks.workunit.client.0.smithi098.stdout:5/61: dread - d0/d10/f12 zero size 2024-09-13T02:52:37.708 INFO:tasks.workunit.client.0.smithi098.stdout:3/56: rename d7/d9/c12 to d7/d9/c13 0 2024-09-13T02:52:37.709 INFO:tasks.workunit.client.0.smithi098.stdout:3/57: truncate d7/fe 214736 0 2024-09-13T02:52:37.710 INFO:tasks.workunit.client.1.smithi142.stdout:5/416: dwrite d8/d24/d64/d68/f77 [0,4194304] 0 2024-09-13T02:52:37.710 INFO:tasks.workunit.client.1.smithi142.stdout:3/398: dwrite d12/f58 [0,4194304] 0 2024-09-13T02:52:37.711 INFO:tasks.workunit.client.1.smithi142.stdout:5/417: stat d8/l23 0 2024-09-13T02:52:37.712 INFO:tasks.workunit.client.0.smithi098.stdout:6/44: mkdir d5/de 0 2024-09-13T02:52:37.712 INFO:tasks.workunit.client.0.smithi098.stdout:6/45: readlink - no filename 2024-09-13T02:52:37.719 INFO:tasks.workunit.client.1.smithi142.stdout:4/369: creat d0/d2b/d21/d30/f7a x:0 0 0 2024-09-13T02:52:37.720 INFO:tasks.workunit.client.0.smithi098.stdout:6/46: dwrite d5/fc [0,4194304] 0 2024-09-13T02:52:37.726 INFO:tasks.workunit.client.0.smithi098.stdout:7/233: dread d6/f10 [0,4194304] 0 2024-09-13T02:52:37.727 INFO:tasks.workunit.client.1.smithi142.stdout:0/385: chown d10/d23/l6f 39 1 2024-09-13T02:52:37.729 INFO:tasks.workunit.client.1.smithi142.stdout:0/386: truncate d10/d15/d1a/f66 598636 0 2024-09-13T02:52:37.732 INFO:tasks.workunit.client.0.smithi098.stdout:4/64: mkdir d6/d10 0 2024-09-13T02:52:37.733 INFO:tasks.workunit.client.1.smithi142.stdout:9/494: creat dd/d17/d25/fbc x:0 0 0 2024-09-13T02:52:37.735 INFO:tasks.workunit.client.1.smithi142.stdout:0/387: dwrite d10/d15/d1a/f22 [0,4194304] 0 2024-09-13T02:52:37.737 INFO:tasks.workunit.client.1.smithi142.stdout:6/415: creat d1/d7/d42/f8c x:0 0 0 2024-09-13T02:52:37.739 INFO:tasks.workunit.client.0.smithi098.stdout:9/69: creat d2/dd/f17 x:0 0 0 2024-09-13T02:52:37.739 INFO:tasks.workunit.client.1.smithi142.stdout:6/416: stat d1/dd/d16/d4e/l61 0 2024-09-13T02:52:37.739 INFO:tasks.workunit.client.0.smithi098.stdout:9/70: readlink d2/dd/l13 0 2024-09-13T02:52:37.740 INFO:tasks.workunit.client.1.smithi142.stdout:6/417: write d1/d7/d42/f8c [491371,86619] 0 2024-09-13T02:52:37.741 INFO:tasks.workunit.client.0.smithi098.stdout:5/62: rename d0/d10/f12 to d0/d15/d17/d1c/f1d 0 2024-09-13T02:52:37.745 INFO:tasks.workunit.client.1.smithi142.stdout:2/275: mknod d1/de/d1f/c5a 0 2024-09-13T02:52:37.749 INFO:tasks.workunit.client.1.smithi142.stdout:5/418: mkdir d8/d24/d26/d45/d81 0 2024-09-13T02:52:37.750 INFO:tasks.workunit.client.1.smithi142.stdout:7/373: dwrite ff [4194304,4194304] 0 2024-09-13T02:52:37.751 INFO:tasks.workunit.client.0.smithi098.stdout:7/234: write d6/d14/f38 [5068855,34623] 0 2024-09-13T02:52:37.751 INFO:tasks.workunit.client.0.smithi098.stdout:7/235: stat d6/c32 0 2024-09-13T02:52:37.754 INFO:tasks.workunit.client.1.smithi142.stdout:8/319: dread d0/fb [0,4194304] 0 2024-09-13T02:52:37.755 INFO:tasks.workunit.client.1.smithi142.stdout:4/370: rename d0/d2b/d21/l36 to d0/d2b/d2d/l7b 0 2024-09-13T02:52:37.756 INFO:tasks.workunit.client.1.smithi142.stdout:3/399: dwrite d12/d16/d3c/f62 [0,4194304] 0 2024-09-13T02:52:37.758 INFO:tasks.workunit.client.1.smithi142.stdout:0/388: fdatasync d10/d15/d1a/f22 0 2024-09-13T02:52:37.758 INFO:tasks.workunit.client.0.smithi098.stdout:9/71: truncate d2/f10 1890621 0 2024-09-13T02:52:37.759 INFO:tasks.workunit.client.1.smithi142.stdout:0/389: read - d10/d15/d1a/d7a/f81 zero size 2024-09-13T02:52:37.760 INFO:tasks.workunit.client.1.smithi142.stdout:0/390: read d10/d15/d1a/f22 [10047667,13216] 0 2024-09-13T02:52:37.761 INFO:tasks.workunit.client.0.smithi098.stdout:5/63: creat d0/d15/d17/f1e x:0 0 0 2024-09-13T02:52:37.763 INFO:tasks.workunit.client.0.smithi098.stdout:6/47: mknod d5/de/cf 0 2024-09-13T02:52:37.763 INFO:tasks.workunit.client.1.smithi142.stdout:3/400: dwrite d12/d16/d25/f40 [4194304,4194304] 0 2024-09-13T02:52:37.765 INFO:tasks.workunit.client.1.smithi142.stdout:1/489: creat d12/d13/d1d/d26/fa3 x:0 0 0 2024-09-13T02:52:37.770 INFO:tasks.workunit.client.0.smithi098.stdout:4/65: creat d6/d10/f11 x:0 0 0 2024-09-13T02:52:37.770 INFO:tasks.workunit.client.1.smithi142.stdout:6/418: write d1/d7/f2a [3919413,103892] 0 2024-09-13T02:52:37.770 INFO:tasks.workunit.client.0.smithi098.stdout:4/66: readlink d6/l7 0 2024-09-13T02:52:37.771 INFO:tasks.workunit.client.1.smithi142.stdout:2/276: creat d1/d42/d44/f5b x:0 0 0 2024-09-13T02:52:37.773 INFO:tasks.workunit.client.0.smithi098.stdout:7/236: rmdir d6 39 2024-09-13T02:52:37.774 INFO:tasks.workunit.client.0.smithi098.stdout:2/78: getdents d1/d4/dc 0 2024-09-13T02:52:37.777 INFO:tasks.workunit.client.0.smithi098.stdout:6/48: symlink d5/l10 0 2024-09-13T02:52:37.778 INFO:tasks.workunit.client.0.smithi098.stdout:1/95: getdents d9 0 2024-09-13T02:52:37.780 INFO:tasks.workunit.client.0.smithi098.stdout:1/96: write f8 [4400035,71339] 0 2024-09-13T02:52:37.782 INFO:tasks.workunit.client.1.smithi142.stdout:8/320: rename d0/d6/dc/d45/l32 to d0/d6/d23/l67 0 2024-09-13T02:52:37.784 INFO:tasks.workunit.client.0.smithi098.stdout:6/49: dread d5/f9 [0,4194304] 0 2024-09-13T02:52:37.789 INFO:tasks.workunit.client.0.smithi098.stdout:1/97: dwrite f1 [4194304,4194304] 0 2024-09-13T02:52:37.789 INFO:tasks.workunit.client.1.smithi142.stdout:3/401: mkdir d12/d16/d25/d2e/d38/d4d/d53/d78 0 2024-09-13T02:52:37.790 INFO:tasks.workunit.client.0.smithi098.stdout:1/98: fsync d9/f1c 0 2024-09-13T02:52:37.791 INFO:tasks.workunit.client.0.smithi098.stdout:6/50: dread d5/fc [0,4194304] 0 2024-09-13T02:52:37.794 INFO:tasks.workunit.client.1.smithi142.stdout:2/277: fsync d1/d42/d44/f5b 0 2024-09-13T02:52:37.797 INFO:tasks.workunit.client.0.smithi098.stdout:7/237: rename d6/d24/d2a/f2d to d6/d24/d2a/f51 0 2024-09-13T02:52:37.797 INFO:tasks.workunit.client.1.smithi142.stdout:5/419: mkdir d8/d24/d26/d45/d81/d82 0 2024-09-13T02:52:37.798 INFO:tasks.workunit.client.1.smithi142.stdout:7/374: mknod d10/d13/c7d 0 2024-09-13T02:52:37.799 INFO:tasks.workunit.client.1.smithi142.stdout:4/371: dread d0/f4c [0,4194304] 0 2024-09-13T02:52:37.804 INFO:tasks.workunit.client.1.smithi142.stdout:7/375: read d10/f42 [3342707,62143] 0 2024-09-13T02:52:37.805 INFO:tasks.workunit.client.1.smithi142.stdout:7/376: truncate d10/f47 1170175 0 2024-09-13T02:52:37.805 INFO:tasks.workunit.client.1.smithi142.stdout:0/391: rename d10/d15 to d10/d6c/d88 0 2024-09-13T02:52:37.806 INFO:tasks.workunit.client.0.smithi098.stdout:2/79: write d1/d4/f12 [35807,118019] 0 2024-09-13T02:52:37.807 INFO:tasks.workunit.client.0.smithi098.stdout:2/80: chown d1/d4/dc 735751 1 2024-09-13T02:52:37.808 INFO:tasks.workunit.client.0.smithi098.stdout:2/81: read d1/d4/d9/fe [590613,77187] 0 2024-09-13T02:52:37.809 INFO:tasks.workunit.client.0.smithi098.stdout:2/82: rename d1 to d1/d4/d9/d14 22 2024-09-13T02:52:37.811 INFO:tasks.workunit.client.1.smithi142.stdout:8/321: chown d0/d6/dc/d45/d8/l1c 5273683 1 2024-09-13T02:52:37.812 INFO:tasks.workunit.client.0.smithi098.stdout:2/83: write d1/d4/f12 [475584,11111] 0 2024-09-13T02:52:37.812 INFO:tasks.workunit.client.1.smithi142.stdout:0/392: dwrite d10/d23/f2f [0,4194304] 0 2024-09-13T02:52:37.812 INFO:tasks.workunit.client.1.smithi142.stdout:9/495: link dd/d17/d69/c9c dd/d17/d25/d3e/cbd 0 2024-09-13T02:52:37.812 INFO:tasks.workunit.client.1.smithi142.stdout:8/322: dread - d0/d6/dc/d45/d8/df/d28/f53 zero size 2024-09-13T02:52:37.813 INFO:tasks.workunit.client.0.smithi098.stdout:4/67: truncate d6/f8 654056 0 2024-09-13T02:52:37.813 INFO:tasks.workunit.client.1.smithi142.stdout:3/402: mkdir d12/d16/d3c/d79 0 2024-09-13T02:52:37.820 INFO:tasks.workunit.client.1.smithi142.stdout:2/278: creat d1/d29/d2b/f5c x:0 0 0 2024-09-13T02:52:37.823 INFO:tasks.workunit.client.0.smithi098.stdout:4/68: dwrite d6/fd [0,4194304] 0 2024-09-13T02:52:37.825 INFO:tasks.workunit.client.1.smithi142.stdout:5/420: write d8/f15 [2967490,51270] 0 2024-09-13T02:52:37.826 INFO:tasks.workunit.client.1.smithi142.stdout:4/372: dread d0/d2b/d2d/d65/f1e [4194304,4194304] 0 2024-09-13T02:52:37.828 INFO:tasks.workunit.client.0.smithi098.stdout:5/64: getdents d0/d15 0 2024-09-13T02:52:37.830 INFO:tasks.workunit.client.0.smithi098.stdout:6/51: dwrite d5/f9 [4194304,4194304] 0 2024-09-13T02:52:37.834 INFO:tasks.workunit.client.1.smithi142.stdout:7/377: mkdir d10/d13/d1d/d2b/d55/d32/d7e 0 2024-09-13T02:52:37.834 INFO:tasks.workunit.client.1.smithi142.stdout:5/421: dwrite d8/d24/f59 [0,4194304] 0 2024-09-13T02:52:37.838 INFO:tasks.workunit.client.0.smithi098.stdout:5/65: dwrite d0/d1/f8 [0,4194304] 0 2024-09-13T02:52:37.839 INFO:tasks.workunit.client.0.smithi098.stdout:5/66: dread - d0/d15/f18 zero size 2024-09-13T02:52:37.839 INFO:tasks.workunit.client.1.smithi142.stdout:9/496: creat dd/d17/d44/d82/d99/daf/fbe x:0 0 0 2024-09-13T02:52:37.840 INFO:tasks.workunit.client.0.smithi098.stdout:2/84: mkdir d1/d4/d9/d15 0 2024-09-13T02:52:37.841 INFO:tasks.workunit.client.1.smithi142.stdout:8/323: readlink d0/d6/dc/d40/l60 0 2024-09-13T02:52:37.844 INFO:tasks.workunit.client.0.smithi098.stdout:7/238: write d6/f10 [640893,93262] 0 2024-09-13T02:52:37.846 INFO:tasks.workunit.client.1.smithi142.stdout:3/403: unlink d12/d16/d25/d2e/f75 0 2024-09-13T02:52:37.847 INFO:tasks.workunit.client.1.smithi142.stdout:9/497: dwrite dd/d17/d25/fac [0,4194304] 0 2024-09-13T02:52:37.849 INFO:tasks.workunit.client.0.smithi098.stdout:7/239: dread d6/f41 [0,4194304] 0 2024-09-13T02:52:37.849 INFO:tasks.workunit.client.1.smithi142.stdout:1/490: creat d12/fa4 x:0 0 0 2024-09-13T02:52:37.850 INFO:tasks.workunit.client.1.smithi142.stdout:3/404: chown d12/d16/d25/d2e/f6c 19 1 2024-09-13T02:52:37.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/324: dwrite d0/d6/dc/d45/d35/d37/f54 [0,4194304] 0 2024-09-13T02:52:37.854 INFO:tasks.workunit.client.0.smithi098.stdout:6/52: rmdir d5/de 39 2024-09-13T02:52:37.854 INFO:tasks.workunit.client.1.smithi142.stdout:8/325: readlink d0/d6/dc/d45/d35/l4f 0 2024-09-13T02:52:37.858 INFO:tasks.workunit.client.0.smithi098.stdout:1/99: link d9/cc d9/d13/d19/c20 0 2024-09-13T02:52:37.860 INFO:tasks.workunit.client.1.smithi142.stdout:5/422: rename d8/d24/d26/d61/f7f to d8/d24/d26/d61/f83 0 2024-09-13T02:52:37.862 INFO:tasks.workunit.client.1.smithi142.stdout:5/423: chown d8/d24/d26/d61/f83 324681 1 2024-09-13T02:52:37.864 INFO:tasks.workunit.client.1.smithi142.stdout:0/393: symlink d10/d6c/d88/d1a/d1e/d42/d4b/d85/l89 0 2024-09-13T02:52:37.864 INFO:tasks.workunit.client.0.smithi098.stdout:4/69: creat d6/db/f12 x:0 0 0 2024-09-13T02:52:37.869 INFO:tasks.workunit.client.1.smithi142.stdout:0/394: dwrite d10/d6c/d88/d45/f56 [0,4194304] 0 2024-09-13T02:52:37.870 INFO:tasks.workunit.client.1.smithi142.stdout:9/498: write dd/d17/d25/f62 [708339,92190] 0 2024-09-13T02:52:37.871 INFO:tasks.workunit.client.0.smithi098.stdout:1/100: creat d9/d13/d19/f21 x:0 0 0 2024-09-13T02:52:37.873 INFO:tasks.workunit.client.1.smithi142.stdout:2/279: symlink d1/de/d1f/l5d 0 2024-09-13T02:52:37.877 INFO:tasks.workunit.client.1.smithi142.stdout:1/491: creat d12/d13/d20/d27/fa5 x:0 0 0 2024-09-13T02:52:37.878 INFO:tasks.workunit.client.1.smithi142.stdout:0/395: dwrite d10/d6c/d88/d1a/d1e/d42/f77 [0,4194304] 0 2024-09-13T02:52:37.878 INFO:tasks.workunit.client.1.smithi142.stdout:8/326: symlink d0/d6/dc/d45/d8/l68 0 2024-09-13T02:52:37.880 INFO:tasks.workunit.client.0.smithi098.stdout:7/240: rename d6/d24/c37 to d6/d24/d46/c52 0 2024-09-13T02:52:37.880 INFO:tasks.workunit.client.1.smithi142.stdout:8/327: stat d0/d6/d23/f2c 0 2024-09-13T02:52:37.880 INFO:tasks.workunit.client.1.smithi142.stdout:0/396: readlink d10/d6c/d88/d1a/d1e/l34 0 2024-09-13T02:52:37.881 INFO:tasks.workunit.client.1.smithi142.stdout:4/373: mknod d0/d2b/d75/c7c 0 2024-09-13T02:52:37.882 INFO:tasks.workunit.client.0.smithi098.stdout:6/53: rmdir d5/de 39 2024-09-13T02:52:37.883 INFO:tasks.workunit.client.0.smithi098.stdout:6/54: write f3 [9147488,29828] 0 2024-09-13T02:52:37.885 INFO:tasks.workunit.client.1.smithi142.stdout:1/492: dwrite d12/d13/f3f [0,4194304] 0 2024-09-13T02:52:37.886 INFO:tasks.workunit.client.1.smithi142.stdout:7/378: dread d10/d13/f1e [0,4194304] 0 2024-09-13T02:52:37.887 INFO:tasks.workunit.client.1.smithi142.stdout:7/379: dread - d10/d13/f76 zero size 2024-09-13T02:52:37.890 INFO:tasks.workunit.client.0.smithi098.stdout:7/241: mknod d6/d1e/c53 0 2024-09-13T02:52:37.890 INFO:tasks.workunit.client.0.smithi098.stdout:7/242: stat d6/d14/c20 0 2024-09-13T02:52:37.892 INFO:tasks.workunit.client.1.smithi142.stdout:9/499: rmdir dd/d17/d44/d95 39 2024-09-13T02:52:37.894 INFO:tasks.workunit.client.1.smithi142.stdout:7/380: dwrite d10/d13/d1d/f23 [4194304,4194304] 0 2024-09-13T02:52:37.900 INFO:tasks.workunit.client.0.smithi098.stdout:2/85: getdents d1 0 2024-09-13T02:52:37.901 INFO:tasks.workunit.client.0.smithi098.stdout:2/86: chown d1/d4/d9/d15 1044301 1 2024-09-13T02:52:37.903 INFO:tasks.workunit.client.0.smithi098.stdout:2/87: dread d1/f8 [0,4194304] 0 2024-09-13T02:52:37.905 INFO:tasks.workunit.client.1.smithi142.stdout:8/328: unlink d0/d6/d23/f2c 0 2024-09-13T02:52:37.908 INFO:tasks.workunit.client.1.smithi142.stdout:4/374: creat d0/d2b/d21/f7d x:0 0 0 2024-09-13T02:52:37.911 INFO:tasks.workunit.client.1.smithi142.stdout:1/493: write d12/d13/d1d/d26/d4f/d72/f7e [1731479,123606] 0 2024-09-13T02:52:37.911 INFO:tasks.workunit.client.0.smithi098.stdout:6/55: creat d5/de/f11 x:0 0 0 2024-09-13T02:52:37.914 INFO:tasks.workunit.client.1.smithi142.stdout:5/424: dwrite d8/f19 [0,4194304] 0 2024-09-13T02:52:37.916 INFO:tasks.workunit.client.1.smithi142.stdout:9/500: rmdir dd/d17/d25/d3e 39 2024-09-13T02:52:37.918 INFO:tasks.workunit.client.1.smithi142.stdout:4/375: dwrite d0/d2b/d2d/d31/d43/d48/f4d [0,4194304] 0 2024-09-13T02:52:37.920 INFO:tasks.workunit.client.0.smithi098.stdout:2/88: unlink d1/d4/dc/l10 0 2024-09-13T02:52:37.920 INFO:tasks.workunit.client.0.smithi098.stdout:6/56: dwrite f3 [4194304,4194304] 0 2024-09-13T02:52:37.922 INFO:tasks.workunit.client.1.smithi142.stdout:1/494: dwrite d12/d13/d20/d66/d55/f8f [0,4194304] 0 2024-09-13T02:52:37.923 INFO:tasks.workunit.client.1.smithi142.stdout:0/397: dread d10/d6c/d88/d45/f60 [0,4194304] 0 2024-09-13T02:52:37.924 INFO:tasks.workunit.client.1.smithi142.stdout:0/398: read d10/f7c [1265624,6970] 0 2024-09-13T02:52:37.926 INFO:tasks.workunit.client.1.smithi142.stdout:1/495: read d12/d13/d20/f38 [7916626,127499] 0 2024-09-13T02:52:37.927 INFO:tasks.workunit.client.1.smithi142.stdout:7/381: symlink d10/d13/d1d/d2b/d56/l7f 0 2024-09-13T02:52:37.928 INFO:tasks.workunit.client.0.smithi098.stdout:4/70: link d6/f8 d6/d10/f13 0 2024-09-13T02:52:37.928 INFO:tasks.workunit.client.1.smithi142.stdout:1/496: dread - d12/d13/d1d/f9c zero size 2024-09-13T02:52:37.929 INFO:tasks.workunit.client.0.smithi098.stdout:1/101: dwrite d9/f10 [4194304,4194304] 0 2024-09-13T02:52:37.929 INFO:tasks.workunit.client.1.smithi142.stdout:1/497: readlink d12/d13/d20/l2e 0 2024-09-13T02:52:37.930 INFO:tasks.workunit.client.0.smithi098.stdout:7/243: dwrite d6/f41 [0,4194304] 0 2024-09-13T02:52:37.931 INFO:tasks.workunit.client.0.smithi098.stdout:1/102: stat d9/c11 0 2024-09-13T02:52:37.931 INFO:tasks.workunit.client.0.smithi098.stdout:4/71: chown d6/l7 530 1 2024-09-13T02:52:37.931 INFO:tasks.workunit.client.0.smithi098.stdout:4/72: stat d6 0 2024-09-13T02:52:37.931 INFO:tasks.workunit.client.1.smithi142.stdout:1/498: chown d12/d13/d20/f74 365979110 1 2024-09-13T02:52:37.931 INFO:tasks.workunit.client.1.smithi142.stdout:0/399: dread d10/f13 [0,4194304] 0 2024-09-13T02:52:37.932 INFO:tasks.workunit.client.1.smithi142.stdout:8/329: readlink d0/d6/d23/l67 0 2024-09-13T02:52:37.933 INFO:tasks.workunit.client.1.smithi142.stdout:0/400: dread - d10/d6c/d88/f6e zero size 2024-09-13T02:52:37.936 INFO:tasks.workunit.client.1.smithi142.stdout:5/425: creat d8/d24/d26/d2d/f84 x:0 0 0 2024-09-13T02:52:37.938 INFO:tasks.workunit.client.0.smithi098.stdout:4/73: fsync d6/d10/f13 0 2024-09-13T02:52:37.938 INFO:tasks.workunit.client.1.smithi142.stdout:9/501: symlink dd/d17/d4f/lbf 0 2024-09-13T02:52:37.939 INFO:tasks.workunit.client.0.smithi098.stdout:4/74: dread - d6/db/f12 zero size 2024-09-13T02:52:37.939 INFO:tasks.workunit.client.1.smithi142.stdout:4/376: rmdir d0/d2b/d75 39 2024-09-13T02:52:37.939 INFO:tasks.workunit.client.1.smithi142.stdout:9/502: readlink dd/d17/d25/l31 0 2024-09-13T02:52:37.944 INFO:tasks.workunit.client.0.smithi098.stdout:7/244: dread d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:37.945 INFO:tasks.workunit.client.1.smithi142.stdout:7/382: truncate d10/d13/f1e 1426235 0 2024-09-13T02:52:37.945 INFO:tasks.workunit.client.1.smithi142.stdout:7/383: write d10/d13/d1d/f5d [388590,120130] 0 2024-09-13T02:52:37.946 INFO:tasks.workunit.client.1.smithi142.stdout:7/384: chown d10/d13/d1d/d2b/d55/f3c 1212778 1 2024-09-13T02:52:37.947 INFO:tasks.workunit.client.0.smithi098.stdout:4/75: readlink l2 0 2024-09-13T02:52:37.948 INFO:tasks.workunit.client.1.smithi142.stdout:1/499: symlink d12/d13/d20/d66/la6 0 2024-09-13T02:52:37.948 INFO:tasks.workunit.client.1.smithi142.stdout:0/401: symlink d10/d6c/d88/d1a/d1e/d42/d4b/d85/l8a 0 2024-09-13T02:52:37.950 INFO:tasks.workunit.client.1.smithi142.stdout:0/402: write d10/d6c/d88/d21/d51/d35/f55 [2172492,67561] 0 2024-09-13T02:52:37.951 INFO:tasks.workunit.client.1.smithi142.stdout:2/280: getdents d1/de/d1f/d13 0 2024-09-13T02:52:37.953 INFO:tasks.workunit.client.0.smithi098.stdout:7/245: dwrite d6/d24/d2a/d48/f4e [0,4194304] 0 2024-09-13T02:52:37.954 INFO:tasks.workunit.client.1.smithi142.stdout:7/385: creat d10/d13/d1d/d2b/d40/f80 x:0 0 0 2024-09-13T02:52:37.957 INFO:tasks.workunit.client.0.smithi098.stdout:7/246: chown d6/d24/d46/c52 9588883 1 2024-09-13T02:52:37.958 INFO:tasks.workunit.client.0.smithi098.stdout:7/247: write d6/d1e/f23 [346699,101467] 0 2024-09-13T02:52:37.959 INFO:tasks.workunit.client.0.smithi098.stdout:4/76: link d6/l7 d6/l14 0 2024-09-13T02:52:37.961 INFO:tasks.workunit.client.1.smithi142.stdout:4/377: mkdir d0/d7e 0 2024-09-13T02:52:37.962 INFO:tasks.workunit.client.1.smithi142.stdout:7/386: dwrite d10/d13/d1d/d2b/d56/f6a [0,4194304] 0 2024-09-13T02:52:37.963 INFO:tasks.workunit.client.0.smithi098.stdout:7/248: rename d6/d24/f2c to d6/d49/f54 0 2024-09-13T02:52:37.964 INFO:tasks.workunit.client.1.smithi142.stdout:9/503: mkdir dd/d17/d5f/d7b/db8/dc0 0 2024-09-13T02:52:37.965 INFO:tasks.workunit.client.0.smithi098.stdout:7/249: write d6/d24/d2a/d48/f4e [1147618,115419] 0 2024-09-13T02:52:37.965 INFO:tasks.workunit.client.1.smithi142.stdout:6/419: sync 2024-09-13T02:52:37.968 INFO:tasks.workunit.client.1.smithi142.stdout:8/330: rename d0/d6/d23/d2b/f55 to d0/f69 0 2024-09-13T02:52:37.968 INFO:tasks.workunit.client.0.smithi098.stdout:4/77: creat d6/f15 x:0 0 0 2024-09-13T02:52:37.968 INFO:tasks.workunit.client.1.smithi142.stdout:9/504: read dd/d17/d4f/f67 [2468659,28891] 0 2024-09-13T02:52:37.969 INFO:tasks.workunit.client.1.smithi142.stdout:9/505: fdatasync f8 0 2024-09-13T02:52:37.970 INFO:tasks.workunit.client.1.smithi142.stdout:4/378: symlink d0/d2b/d2d/l7f 0 2024-09-13T02:52:37.972 INFO:tasks.workunit.client.0.smithi098.stdout:7/250: mkdir d6/d1e/d55 0 2024-09-13T02:52:37.974 INFO:tasks.workunit.client.1.smithi142.stdout:6/420: dwrite d1/d7/f50 [0,4194304] 0 2024-09-13T02:52:37.974 INFO:tasks.workunit.client.1.smithi142.stdout:7/387: creat d10/f81 x:0 0 0 2024-09-13T02:52:37.975 INFO:tasks.workunit.client.1.smithi142.stdout:2/281: link d1/de/f18 d1/de/d1f/d13/f5e 0 2024-09-13T02:52:37.976 INFO:tasks.workunit.client.1.smithi142.stdout:2/282: chown d1/d29 96 1 2024-09-13T02:52:37.977 INFO:tasks.workunit.client.0.smithi098.stdout:4/78: dwrite d6/db/f12 [0,4194304] 0 2024-09-13T02:52:37.982 INFO:tasks.workunit.client.0.smithi098.stdout:2/89: write d1/d4/d9/fe [1516129,113821] 0 2024-09-13T02:52:37.987 INFO:tasks.workunit.client.1.smithi142.stdout:8/331: creat d0/d6/dc/d45/f6a x:0 0 0 2024-09-13T02:52:37.987 INFO:tasks.workunit.client.0.smithi098.stdout:4/79: mknod d6/c16 0 2024-09-13T02:52:37.989 INFO:tasks.workunit.client.0.smithi098.stdout:6/57: truncate d5/f9 7024867 0 2024-09-13T02:52:37.989 INFO:tasks.workunit.client.0.smithi098.stdout:6/58: stat d5 0 2024-09-13T02:52:37.995 INFO:tasks.workunit.client.1.smithi142.stdout:4/379: unlink d0/d2b/d21/d35/d6d/l77 0 2024-09-13T02:52:37.996 INFO:tasks.workunit.client.0.smithi098.stdout:6/59: dwrite f4 [0,4194304] 0 2024-09-13T02:52:38.007 INFO:tasks.workunit.client.1.smithi142.stdout:5/426: truncate d8/d24/d64/d68/f77 930501 0 2024-09-13T02:52:38.010 INFO:tasks.workunit.client.0.smithi098.stdout:4/80: symlink d6/l17 0 2024-09-13T02:52:38.012 INFO:tasks.workunit.client.0.smithi098.stdout:6/60: symlink d5/l12 0 2024-09-13T02:52:38.016 INFO:tasks.workunit.client.1.smithi142.stdout:4/380: unlink d0/d2b/d2d/d31/d43/f63 0 2024-09-13T02:52:38.022 INFO:tasks.workunit.client.0.smithi098.stdout:4/81: creat d6/f18 x:0 0 0 2024-09-13T02:52:38.023 INFO:tasks.workunit.client.0.smithi098.stdout:4/82: dread - d6/f18 zero size 2024-09-13T02:52:38.023 INFO:tasks.workunit.client.1.smithi142.stdout:0/403: link d10/l12 d10/d6c/d88/d1a/d1e/d42/l8b 0 2024-09-13T02:52:38.024 INFO:tasks.workunit.client.1.smithi142.stdout:2/283: dwrite d1/f9 [4194304,4194304] 0 2024-09-13T02:52:38.028 INFO:tasks.workunit.client.0.smithi098.stdout:7/251: write d6/d24/f28 [803902,128028] 0 2024-09-13T02:52:38.030 INFO:tasks.workunit.client.0.smithi098.stdout:7/252: read d6/d24/d2a/f31 [1985342,69303] 0 2024-09-13T02:52:38.030 INFO:tasks.workunit.client.0.smithi098.stdout:4/83: dwrite d6/fd [0,4194304] 0 2024-09-13T02:52:38.031 INFO:tasks.workunit.client.0.smithi098.stdout:4/84: chown d6/fd 3844896 1 2024-09-13T02:52:38.035 INFO:tasks.workunit.client.1.smithi142.stdout:6/421: creat d1/d7/f8d x:0 0 0 2024-09-13T02:52:38.037 INFO:tasks.workunit.client.0.smithi098.stdout:6/61: write d5/fb [6240633,33483] 0 2024-09-13T02:52:38.039 INFO:tasks.workunit.client.1.smithi142.stdout:5/427: symlink d8/d24/d26/l85 0 2024-09-13T02:52:38.041 INFO:tasks.workunit.client.0.smithi098.stdout:4/85: chown l4 1316769 1 2024-09-13T02:52:38.042 INFO:tasks.workunit.client.1.smithi142.stdout:7/388: rmdir d10 39 2024-09-13T02:52:38.044 INFO:tasks.workunit.client.0.smithi098.stdout:7/253: mknod d6/d24/d2a/c56 0 2024-09-13T02:52:38.045 INFO:tasks.workunit.client.0.smithi098.stdout:2/90: truncate d1/d4/d9/fe 667329 0 2024-09-13T02:52:38.047 INFO:tasks.workunit.client.1.smithi142.stdout:0/404: creat d10/d6c/d88/d21/d51/d35/f8c x:0 0 0 2024-09-13T02:52:38.049 INFO:tasks.workunit.client.1.smithi142.stdout:8/332: creat d0/f6b x:0 0 0 2024-09-13T02:52:38.050 INFO:tasks.workunit.client.1.smithi142.stdout:8/333: dread - d0/d6/dc/d45/d35/f63 zero size 2024-09-13T02:52:38.050 INFO:tasks.workunit.client.1.smithi142.stdout:8/334: chown d0/f4c 92636 1 2024-09-13T02:52:38.052 INFO:tasks.workunit.client.1.smithi142.stdout:9/506: link dd/d17/d44/cbb dd/d17/d25/cc1 0 2024-09-13T02:52:38.055 INFO:tasks.workunit.client.1.smithi142.stdout:6/422: symlink d1/dd/d16/d4e/d32/l8e 0 2024-09-13T02:52:38.055 INFO:tasks.workunit.client.1.smithi142.stdout:4/381: rmdir d0/d2b 39 2024-09-13T02:52:38.059 INFO:tasks.workunit.client.1.smithi142.stdout:5/428: rename d8/d24/d26/d2d/f38 to d8/d24/d3f/d4a/f86 0 2024-09-13T02:52:38.060 INFO:tasks.workunit.client.0.smithi098.stdout:2/91: symlink d1/d4/dc/l16 0 2024-09-13T02:52:38.060 INFO:tasks.workunit.client.1.smithi142.stdout:6/423: dwrite d1/f3d [4194304,4194304] 0 2024-09-13T02:52:38.060 INFO:tasks.workunit.client.1.smithi142.stdout:6/424: chown d1/d7/f3e 8311 1 2024-09-13T02:52:38.062 INFO:tasks.workunit.client.0.smithi098.stdout:6/62: mkdir d5/d13 0 2024-09-13T02:52:38.063 INFO:tasks.workunit.client.0.smithi098.stdout:6/63: write f3 [5413089,57135] 0 2024-09-13T02:52:38.065 INFO:tasks.workunit.client.0.smithi098.stdout:4/86: mknod d6/c19 0 2024-09-13T02:52:38.066 INFO:tasks.workunit.client.0.smithi098.stdout:4/87: chown d6/f18 0 1 2024-09-13T02:52:38.067 INFO:tasks.workunit.client.1.smithi142.stdout:0/405: creat d10/d23/f8d x:0 0 0 2024-09-13T02:52:38.070 INFO:tasks.workunit.client.1.smithi142.stdout:8/335: mkdir d0/d6/dc/d40/d46/d6c 0 2024-09-13T02:52:38.072 INFO:tasks.workunit.client.1.smithi142.stdout:8/336: write d0/d6/dc/d45/f65 [757397,114527] 0 2024-09-13T02:52:38.073 INFO:tasks.workunit.client.1.smithi142.stdout:6/425: dread d1/dd/f35 [0,4194304] 0 2024-09-13T02:52:38.076 INFO:tasks.workunit.client.1.smithi142.stdout:4/382: chown d0/d2b/d2d/d31/d32/f3d 409559964 1 2024-09-13T02:52:38.077 INFO:tasks.workunit.client.1.smithi142.stdout:4/383: chown d0/d2b/d2d/d31/f55 23945 1 2024-09-13T02:52:38.078 INFO:tasks.workunit.client.1.smithi142.stdout:6/426: dwrite d1/dd/f22 [0,4194304] 0 2024-09-13T02:52:38.081 INFO:tasks.workunit.client.1.smithi142.stdout:4/384: read d0/df/f23 [1685215,88075] 0 2024-09-13T02:52:38.083 INFO:tasks.workunit.client.1.smithi142.stdout:4/385: fsync d0/d2b/d21/d35/f5f 0 2024-09-13T02:52:38.083 INFO:tasks.workunit.client.1.smithi142.stdout:3/405: sync 2024-09-13T02:52:38.084 INFO:tasks.workunit.client.1.smithi142.stdout:3/406: chown l11 25 1 2024-09-13T02:52:38.084 INFO:tasks.workunit.client.1.smithi142.stdout:6/427: dwrite d1/dd/d53/d78/f80 [0,4194304] 0 2024-09-13T02:52:38.131 INFO:tasks.workunit.client.1.smithi142.stdout:1/500: sync 2024-09-13T02:52:38.171 INFO:tasks.workunit.client.0.smithi098.stdout:0/71: sync 2024-09-13T02:52:38.172 INFO:tasks.workunit.client.1.smithi142.stdout:2/284: sync 2024-09-13T02:52:38.173 INFO:tasks.workunit.client.0.smithi098.stdout:4/88: rmdir d6/d10 39 2024-09-13T02:52:38.176 INFO:tasks.workunit.client.0.smithi098.stdout:7/254: rmdir d6/d1e/d55 0 2024-09-13T02:52:38.180 INFO:tasks.workunit.client.0.smithi098.stdout:6/64: getdents d5/d13 0 2024-09-13T02:52:38.183 INFO:tasks.workunit.client.1.smithi142.stdout:0/406: mknod d10/d6c/d88/d21/d51/d35/c8e 0 2024-09-13T02:52:38.183 INFO:tasks.workunit.client.0.smithi098.stdout:7/255: dwrite d6/f19 [0,4194304] 0 2024-09-13T02:52:38.183 INFO:tasks.workunit.client.1.smithi142.stdout:0/407: write d10/d6c/d88/d21/d51/f3e [560935,29482] 0 2024-09-13T02:52:38.184 INFO:tasks.workunit.client.1.smithi142.stdout:9/507: mknod dd/d17/d44/d95/cc2 0 2024-09-13T02:52:38.185 INFO:tasks.workunit.client.1.smithi142.stdout:9/508: chown dd/d17/d44/d82/d99/daf/fbe 406 1 2024-09-13T02:52:38.186 INFO:tasks.workunit.client.1.smithi142.stdout:9/509: chown dd/d17/d4f/l9d 63 1 2024-09-13T02:52:38.186 INFO:tasks.workunit.client.1.smithi142.stdout:9/510: dread - dd/d17/f28 zero size 2024-09-13T02:52:38.187 INFO:tasks.workunit.client.1.smithi142.stdout:0/408: dread d10/d6c/d88/d45/f56 [0,4194304] 0 2024-09-13T02:52:38.191 INFO:tasks.workunit.client.0.smithi098.stdout:7/256: dwrite d6/d24/d46/f50 [0,4194304] 0 2024-09-13T02:52:38.195 INFO:tasks.workunit.client.0.smithi098.stdout:6/65: mkdir d5/de/d14 0 2024-09-13T02:52:38.197 INFO:tasks.workunit.client.0.smithi098.stdout:7/257: dread d6/f41 [0,4194304] 0 2024-09-13T02:52:38.200 INFO:tasks.workunit.client.1.smithi142.stdout:6/428: mkdir d1/dd/d53/d78/d8f 0 2024-09-13T02:52:38.201 INFO:tasks.workunit.client.0.smithi098.stdout:2/92: getdents d1/d4 0 2024-09-13T02:52:38.203 INFO:tasks.workunit.client.1.smithi142.stdout:1/501: symlink d12/d13/d20/d27/d3c/d71/d81/d92/la7 0 2024-09-13T02:52:38.204 INFO:tasks.workunit.client.1.smithi142.stdout:2/285: rename d1/de/l1c to d1/de/l5f 0 2024-09-13T02:52:38.205 INFO:tasks.workunit.client.1.smithi142.stdout:2/286: stat d1/de/d31 0 2024-09-13T02:52:38.206 INFO:tasks.workunit.client.0.smithi098.stdout:7/258: dwrite d6/d49/f4f [0,4194304] 0 2024-09-13T02:52:38.207 INFO:tasks.workunit.client.0.smithi098.stdout:0/72: creat dd/f16 x:0 0 0 2024-09-13T02:52:38.215 INFO:tasks.workunit.client.0.smithi098.stdout:0/73: dwrite f4 [0,4194304] 0 2024-09-13T02:52:38.216 INFO:tasks.workunit.client.0.smithi098.stdout:0/74: stat dd/d14 0 2024-09-13T02:52:38.217 INFO:tasks.workunit.client.0.smithi098.stdout:7/259: mkdir d6/d24/d2a/d57 0 2024-09-13T02:52:38.217 INFO:tasks.workunit.client.0.smithi098.stdout:0/75: write fb [318022,84703] 0 2024-09-13T02:52:38.217 INFO:tasks.workunit.client.1.smithi142.stdout:9/511: readlink dd/l20 0 2024-09-13T02:52:38.223 INFO:tasks.workunit.client.0.smithi098.stdout:6/66: creat d5/f15 x:0 0 0 2024-09-13T02:52:38.225 INFO:tasks.workunit.client.0.smithi098.stdout:7/260: fdatasync d6/f41 0 2024-09-13T02:52:38.226 INFO:tasks.workunit.client.0.smithi098.stdout:7/261: fdatasync d6/f10 0 2024-09-13T02:52:38.230 INFO:tasks.workunit.client.1.smithi142.stdout:3/407: getdents d12/d16/d25/d2e/d38/d6b 0 2024-09-13T02:52:38.232 INFO:tasks.workunit.client.1.smithi142.stdout:6/429: chown d1/d7/d19/d30/f67 14 1 2024-09-13T02:52:38.232 INFO:tasks.workunit.client.0.smithi098.stdout:7/262: dwrite d6/f19 [0,4194304] 0 2024-09-13T02:52:38.233 INFO:tasks.workunit.client.1.smithi142.stdout:2/287: rmdir d1/d42 39 2024-09-13T02:52:38.237 INFO:tasks.workunit.client.0.smithi098.stdout:6/67: symlink d5/d13/l16 0 2024-09-13T02:52:38.237 INFO:tasks.workunit.client.1.smithi142.stdout:6/430: dwrite d1/d7/f2a [0,4194304] 0 2024-09-13T02:52:38.237 INFO:tasks.workunit.client.0.smithi098.stdout:6/68: dread - d5/de/f11 zero size 2024-09-13T02:52:38.238 INFO:tasks.workunit.client.0.smithi098.stdout:7/263: rmdir d6/d24 39 2024-09-13T02:52:38.240 INFO:tasks.workunit.client.1.smithi142.stdout:9/512: mknod dd/d17/d44/d95/cc3 0 2024-09-13T02:52:38.241 INFO:tasks.workunit.client.0.smithi098.stdout:0/76: rmdir dd/d14 0 2024-09-13T02:52:38.243 INFO:tasks.workunit.client.1.smithi142.stdout:8/337: rmdir d0/d6/dc/d45/d5f 0 2024-09-13T02:52:38.243 INFO:tasks.workunit.client.0.smithi098.stdout:7/264: dread d6/d49/f4f [0,4194304] 0 2024-09-13T02:52:38.244 INFO:tasks.workunit.client.0.smithi098.stdout:7/265: chown f5 4031 1 2024-09-13T02:52:38.245 INFO:tasks.workunit.client.1.smithi142.stdout:0/409: mkdir d10/d6c/d88/d21/d8f 0 2024-09-13T02:52:38.246 INFO:tasks.workunit.client.0.smithi098.stdout:0/77: dread f4 [0,4194304] 0 2024-09-13T02:52:38.248 INFO:tasks.workunit.client.0.smithi098.stdout:6/69: rename d5/cd to d5/d13/c17 0 2024-09-13T02:52:38.249 INFO:tasks.workunit.client.1.smithi142.stdout:4/386: rename d0/df/c52 to d0/d2b/c80 0 2024-09-13T02:52:38.252 INFO:tasks.workunit.client.1.smithi142.stdout:3/408: mknod d12/d16/d25/d2e/d38/d5a/c7a 0 2024-09-13T02:52:38.254 INFO:tasks.workunit.client.1.smithi142.stdout:4/387: dwrite d0/df/f29 [0,4194304] 0 2024-09-13T02:52:38.254 INFO:tasks.workunit.client.1.smithi142.stdout:3/409: write d12/d16/d25/d2e/d48/d5c/f44 [390931,44854] 0 2024-09-13T02:52:38.255 INFO:tasks.workunit.client.1.smithi142.stdout:4/388: dread - d0/df/d57/f70 zero size 2024-09-13T02:52:38.256 INFO:tasks.workunit.client.1.smithi142.stdout:2/288: mkdir d1/de/d1f/d13/d60 0 2024-09-13T02:52:38.256 INFO:tasks.workunit.client.1.smithi142.stdout:3/410: write d12/d16/d25/d2e/d48/d5c/f44 [1260378,86088] 0 2024-09-13T02:52:38.258 INFO:tasks.workunit.client.1.smithi142.stdout:5/429: getdents d8/d24/d3f/d4a 0 2024-09-13T02:52:38.259 INFO:tasks.workunit.client.1.smithi142.stdout:2/289: dread - d1/f54 zero size 2024-09-13T02:52:38.259 INFO:tasks.workunit.client.1.smithi142.stdout:6/431: mkdir d1/d7/d19/d48/d90 0 2024-09-13T02:52:38.260 INFO:tasks.workunit.client.0.smithi098.stdout:7/266: symlink d6/d24/d2a/l58 0 2024-09-13T02:52:38.265 INFO:tasks.workunit.client.1.smithi142.stdout:8/338: unlink d0/d6/dc/d40/l43 0 2024-09-13T02:52:38.267 INFO:tasks.workunit.client.0.smithi098.stdout:7/267: unlink d6/l9 0 2024-09-13T02:52:38.269 INFO:tasks.workunit.client.1.smithi142.stdout:7/389: rename ff to d10/d64/f82 0 2024-09-13T02:52:38.273 INFO:tasks.workunit.client.1.smithi142.stdout:4/389: mkdir d0/d2b/d21/d35/d6d/d81 0 2024-09-13T02:52:38.275 INFO:tasks.workunit.client.1.smithi142.stdout:3/411: creat d12/d16/d25/d2e/f7b x:0 0 0 2024-09-13T02:52:38.275 INFO:tasks.workunit.client.0.smithi098.stdout:6/70: truncate f3 4658614 0 2024-09-13T02:52:38.277 INFO:tasks.workunit.client.1.smithi142.stdout:9/513: creat dd/d17/d44/d82/d99/da8/db7/fc4 x:0 0 0 2024-09-13T02:52:38.278 INFO:tasks.workunit.client.1.smithi142.stdout:6/432: creat d1/dd/d57/f91 x:0 0 0 2024-09-13T02:52:38.281 INFO:tasks.workunit.client.1.smithi142.stdout:8/339: unlink d0/d6/dc/d45/d8/l68 0 2024-09-13T02:52:38.282 INFO:tasks.workunit.client.1.smithi142.stdout:6/433: dread d1/d7/d19/d52/f6f [0,4194304] 0 2024-09-13T02:52:38.285 INFO:tasks.workunit.client.1.smithi142.stdout:7/390: fsync d10/d13/d1d/d2b/d56/f59 0 2024-09-13T02:52:38.289 INFO:tasks.workunit.client.1.smithi142.stdout:1/502: rename d12/d13/d20/d27/d3c/f67 to d12/d13/d45/fa8 0 2024-09-13T02:52:38.289 INFO:tasks.workunit.client.1.smithi142.stdout:5/430: dread f0 [0,4194304] 0 2024-09-13T02:52:38.289 INFO:tasks.workunit.client.1.smithi142.stdout:4/390: mkdir d0/d2b/d2d/d31/d32/d82 0 2024-09-13T02:52:38.290 INFO:tasks.workunit.client.1.smithi142.stdout:4/391: stat d0/d2b/d21/d30/f3a 0 2024-09-13T02:52:38.290 INFO:tasks.workunit.client.1.smithi142.stdout:8/340: dwrite d0/f5c [0,4194304] 0 2024-09-13T02:52:38.293 INFO:tasks.workunit.client.0.smithi098.stdout:6/71: dwrite d5/f9 [0,4194304] 0 2024-09-13T02:52:38.295 INFO:tasks.workunit.client.0.smithi098.stdout:6/72: fsync f4 0 2024-09-13T02:52:38.307 INFO:tasks.workunit.client.1.smithi142.stdout:6/434: write d1/d7/d19/f2f [6618702,94088] 0 2024-09-13T02:52:38.308 INFO:tasks.workunit.client.1.smithi142.stdout:2/290: link d1/de/f10 d1/de/f61 0 2024-09-13T02:52:38.309 INFO:tasks.workunit.client.1.smithi142.stdout:4/392: creat d0/d2b/d21/d35/f83 x:0 0 0 2024-09-13T02:52:38.310 INFO:tasks.workunit.client.0.smithi098.stdout:6/73: dwrite d5/fc [0,4194304] 0 2024-09-13T02:52:38.315 INFO:tasks.workunit.client.0.smithi098.stdout:6/74: mkdir d5/d18 0 2024-09-13T02:52:38.315 INFO:tasks.workunit.client.0.smithi098.stdout:6/75: chown d5/de/cf 362274 1 2024-09-13T02:52:38.317 INFO:tasks.workunit.client.1.smithi142.stdout:2/291: creat d1/de/d31/f62 x:0 0 0 2024-09-13T02:52:38.318 INFO:tasks.workunit.client.1.smithi142.stdout:4/393: unlink d0/d2b/d2d/f6c 0 2024-09-13T02:52:38.319 INFO:tasks.workunit.client.1.smithi142.stdout:4/394: read d0/f4c [3340556,99728] 0 2024-09-13T02:52:38.322 INFO:tasks.workunit.client.1.smithi142.stdout:0/410: rename d10/d6c/d88/d1a/d1e/d42/f52 to d10/d6c/d88/d1a/f90 0 2024-09-13T02:52:38.322 INFO:tasks.workunit.client.1.smithi142.stdout:3/412: link l11 d12/l7c 0 2024-09-13T02:52:38.324 INFO:tasks.workunit.client.1.smithi142.stdout:7/391: link d10/d64/f7c d10/d13/d1d/f83 0 2024-09-13T02:52:38.325 INFO:tasks.workunit.client.1.smithi142.stdout:6/435: creat d1/dd/d53/d78/d8f/f92 x:0 0 0 2024-09-13T02:52:38.326 INFO:tasks.workunit.client.1.smithi142.stdout:7/392: stat d10/d13/f20 0 2024-09-13T02:52:38.326 INFO:tasks.workunit.client.1.smithi142.stdout:2/292: unlink d1/d29/d2b/f39 0 2024-09-13T02:52:38.326 INFO:tasks.workunit.client.1.smithi142.stdout:8/341: link d0/d6/dc/d45/d8/l1c d0/d6/dc/d45/l6d 0 2024-09-13T02:52:38.329 INFO:tasks.workunit.client.1.smithi142.stdout:1/503: dwrite d12/d13/d20/d66/d55/f44 [0,4194304] 0 2024-09-13T02:52:38.331 INFO:tasks.workunit.client.1.smithi142.stdout:0/411: dwrite d10/d6c/d88/d21/d51/f3e [0,4194304] 0 2024-09-13T02:52:38.333 INFO:tasks.workunit.client.1.smithi142.stdout:0/412: chown d10/d6c/d88 612576164 1 2024-09-13T02:52:38.337 INFO:tasks.workunit.client.1.smithi142.stdout:9/514: rename dd/ff to dd/d17/d5f/fc5 0 2024-09-13T02:52:38.337 INFO:tasks.workunit.client.1.smithi142.stdout:4/395: write d0/d2b/d21/d30/f54 [3372403,32955] 0 2024-09-13T02:52:38.339 INFO:tasks.workunit.client.1.smithi142.stdout:6/436: dwrite d1/dd/f49 [4194304,4194304] 0 2024-09-13T02:52:38.342 INFO:tasks.workunit.client.1.smithi142.stdout:1/504: dwrite d12/f7a [0,4194304] 0 2024-09-13T02:52:38.347 INFO:tasks.workunit.client.1.smithi142.stdout:1/505: fdatasync d12/d13/d20/d27/d3c/d71/f9d 0 2024-09-13T02:52:38.348 INFO:tasks.workunit.client.1.smithi142.stdout:8/342: mknod d0/d6/dc/d45/d8/df/c6e 0 2024-09-13T02:52:38.351 INFO:tasks.workunit.client.1.smithi142.stdout:0/413: fdatasync d10/d6c/d88/d1a/f6b 0 2024-09-13T02:52:38.352 INFO:tasks.workunit.client.1.smithi142.stdout:2/293: dread d1/fb [0,4194304] 0 2024-09-13T02:52:38.354 INFO:tasks.workunit.client.1.smithi142.stdout:9/515: write dd/f18 [2249335,16051] 0 2024-09-13T02:52:38.354 INFO:tasks.workunit.client.1.smithi142.stdout:0/414: readlink d10/d6c/d88/d21/d51/l2b 0 2024-09-13T02:52:38.354 INFO:tasks.workunit.client.1.smithi142.stdout:8/343: dread d0/d6/dc/d45/d35/f56 [0,4194304] 0 2024-09-13T02:52:38.360 INFO:tasks.workunit.client.1.smithi142.stdout:1/506: mkdir d12/d13/d1d/d26/d4f/da9 0 2024-09-13T02:52:38.363 INFO:tasks.workunit.client.1.smithi142.stdout:3/413: dwrite d12/d16/d25/d2e/f4c [0,4194304] 0 2024-09-13T02:52:38.364 INFO:tasks.workunit.client.1.smithi142.stdout:9/516: write dd/d87/f8f [4666945,99528] 0 2024-09-13T02:52:38.366 INFO:tasks.workunit.client.1.smithi142.stdout:9/517: chown fb 1262 1 2024-09-13T02:52:38.367 INFO:tasks.workunit.client.1.smithi142.stdout:7/393: rename d10/l4c to d10/d31/l84 0 2024-09-13T02:52:38.367 INFO:tasks.workunit.client.1.smithi142.stdout:5/431: sync 2024-09-13T02:52:38.369 INFO:tasks.workunit.client.1.smithi142.stdout:7/394: chown d10/d13/d1d/d2b/d56/d41 156529 1 2024-09-13T02:52:38.369 INFO:tasks.workunit.client.1.smithi142.stdout:5/432: fsync d8/d24/d26/d45/f79 0 2024-09-13T02:52:38.369 INFO:tasks.workunit.client.1.smithi142.stdout:1/507: mkdir d12/d13/d20/d27/d3c/d71/d81/d92/daa 0 2024-09-13T02:52:38.371 INFO:tasks.workunit.client.1.smithi142.stdout:7/395: chown d10/d13/d1d/d25/d5c 77839 1 2024-09-13T02:52:38.374 INFO:tasks.workunit.client.1.smithi142.stdout:6/437: creat d1/d7/d19/f93 x:0 0 0 2024-09-13T02:52:38.375 INFO:tasks.workunit.client.1.smithi142.stdout:0/415: creat d10/d6c/d88/d21/f91 x:0 0 0 2024-09-13T02:52:38.376 INFO:tasks.workunit.client.1.smithi142.stdout:7/396: creat d10/d13/d1d/d2b/d56/f85 x:0 0 0 2024-09-13T02:52:38.377 INFO:tasks.workunit.client.1.smithi142.stdout:3/414: dread d12/f19 [0,4194304] 0 2024-09-13T02:52:38.378 INFO:tasks.workunit.client.1.smithi142.stdout:9/518: mknod dd/d17/d25/cc6 0 2024-09-13T02:52:38.380 INFO:tasks.workunit.client.1.smithi142.stdout:6/438: creat d1/dd/d16/d47/f94 x:0 0 0 2024-09-13T02:52:38.380 INFO:tasks.workunit.client.1.smithi142.stdout:9/519: dread - dd/d17/d4f/d91/f9a zero size 2024-09-13T02:52:38.381 INFO:tasks.workunit.client.1.smithi142.stdout:6/439: fdatasync d1/f41 0 2024-09-13T02:52:38.381 INFO:tasks.workunit.client.1.smithi142.stdout:1/508: dwrite d12/d13/d1d/d26/fa3 [0,4194304] 0 2024-09-13T02:52:38.381 INFO:tasks.workunit.client.1.smithi142.stdout:4/396: dread d0/df/f1f [0,4194304] 0 2024-09-13T02:52:38.382 INFO:tasks.workunit.client.1.smithi142.stdout:6/440: chown d1/dd/d53 15 1 2024-09-13T02:52:38.383 INFO:tasks.workunit.client.1.smithi142.stdout:0/416: creat d10/d6c/d88/d21/d51/f92 x:0 0 0 2024-09-13T02:52:38.387 INFO:tasks.workunit.client.1.smithi142.stdout:6/441: stat d1/dd/d16/d4e/l51 0 2024-09-13T02:52:38.387 INFO:tasks.workunit.client.1.smithi142.stdout:4/397: stat d0/l24 0 2024-09-13T02:52:38.388 INFO:tasks.workunit.client.1.smithi142.stdout:9/520: creat dd/d17/d44/d82/d99/da8/fc7 x:0 0 0 2024-09-13T02:52:38.388 INFO:tasks.workunit.client.1.smithi142.stdout:6/442: chown d1/dd/f22 54841082 1 2024-09-13T02:52:38.388 INFO:tasks.workunit.client.1.smithi142.stdout:3/415: mkdir d12/d16/d3c/d7d 0 2024-09-13T02:52:38.389 INFO:tasks.workunit.client.1.smithi142.stdout:8/344: truncate d0/d6/dc/d45/f65 154387 0 2024-09-13T02:52:38.391 INFO:tasks.workunit.client.1.smithi142.stdout:7/397: rmdir d10/d13/d1d 39 2024-09-13T02:52:38.393 INFO:tasks.workunit.client.1.smithi142.stdout:9/521: creat dd/d87/d8e/fc8 x:0 0 0 2024-09-13T02:52:38.393 INFO:tasks.workunit.client.1.smithi142.stdout:1/509: dread d12/d13/d20/d66/d55/f8f [0,4194304] 0 2024-09-13T02:52:38.394 INFO:tasks.workunit.client.1.smithi142.stdout:0/417: dwrite fd [0,4194304] 0 2024-09-13T02:52:38.395 INFO:tasks.workunit.client.1.smithi142.stdout:6/443: fsync d1/d7/d5f/f68 0 2024-09-13T02:52:38.397 INFO:tasks.workunit.client.1.smithi142.stdout:8/345: read d0/d6/f24 [3773609,99728] 0 2024-09-13T02:52:38.397 INFO:tasks.workunit.client.1.smithi142.stdout:6/444: stat d1/d7/d42/f8c 0 2024-09-13T02:52:38.407 INFO:tasks.workunit.client.1.smithi142.stdout:4/398: rmdir d0/d2b/d21/d35/d6d/d81 0 2024-09-13T02:52:38.409 INFO:tasks.workunit.client.1.smithi142.stdout:2/294: dread d1/de/d31/f3d [0,4194304] 0 2024-09-13T02:52:38.411 INFO:tasks.workunit.client.1.smithi142.stdout:1/510: rename d12/d13/d20/l2e to d12/lab 0 2024-09-13T02:52:38.412 INFO:tasks.workunit.client.1.smithi142.stdout:3/416: dread d12/d16/f3e [0,4194304] 0 2024-09-13T02:52:38.417 INFO:tasks.workunit.client.1.smithi142.stdout:1/511: read d12/d13/f3f [2269297,121461] 0 2024-09-13T02:52:38.418 INFO:tasks.workunit.client.1.smithi142.stdout:5/433: dread d8/d24/d3f/f75 [0,4194304] 0 2024-09-13T02:52:38.418 INFO:tasks.workunit.client.1.smithi142.stdout:0/418: link d10/c2e d10/d6c/d88/d1a/d7a/c93 0 2024-09-13T02:52:38.418 INFO:tasks.workunit.client.1.smithi142.stdout:2/295: truncate d1/d2d/f53 183637 0 2024-09-13T02:52:38.419 INFO:tasks.workunit.client.1.smithi142.stdout:6/445: dwrite d1/dd/d16/d4d/f4f [0,4194304] 0 2024-09-13T02:52:38.420 INFO:tasks.workunit.client.1.smithi142.stdout:5/434: write d8/d24/d26/d2d/f7d [965028,117621] 0 2024-09-13T02:52:38.421 INFO:tasks.workunit.client.1.smithi142.stdout:7/398: rename d10/l29 to d10/d34/d57/l86 0 2024-09-13T02:52:38.423 INFO:tasks.workunit.client.1.smithi142.stdout:4/399: getdents d0/d2b/d2d/d31/d32 0 2024-09-13T02:52:38.424 INFO:tasks.workunit.client.1.smithi142.stdout:5/435: dread - d8/d24/d26/d45/f79 zero size 2024-09-13T02:52:38.426 INFO:tasks.workunit.client.1.smithi142.stdout:2/296: stat d1/f5 0 2024-09-13T02:52:38.426 INFO:tasks.workunit.client.1.smithi142.stdout:2/297: write d1/d2d/f53 [731757,59864] 0 2024-09-13T02:52:38.428 INFO:tasks.workunit.client.1.smithi142.stdout:0/419: unlink d10/d6c/d88/d21/d51/l2b 0 2024-09-13T02:52:38.428 INFO:tasks.workunit.client.1.smithi142.stdout:2/298: write d1/d2d/f40 [951370,111588] 0 2024-09-13T02:52:38.429 INFO:tasks.workunit.client.1.smithi142.stdout:2/299: write d1/de/d31/d46/f4d [133378,41753] 0 2024-09-13T02:52:38.431 INFO:tasks.workunit.client.1.smithi142.stdout:3/417: mkdir d12/d16/d25/d2e/d38/d4d/d53/d78/d7e 0 2024-09-13T02:52:38.432 INFO:tasks.workunit.client.1.smithi142.stdout:4/400: mknod d0/d2b/d2d/c84 0 2024-09-13T02:52:38.432 INFO:tasks.workunit.client.1.smithi142.stdout:3/418: dread - d12/d16/d25/d2e/d38/d4d/f50 zero size 2024-09-13T02:52:38.433 INFO:tasks.workunit.client.1.smithi142.stdout:5/436: write d8/f1b [1168566,35691] 0 2024-09-13T02:52:38.434 INFO:tasks.workunit.client.1.smithi142.stdout:3/419: write d12/d16/d25/d2e/f4c [3586359,5215] 0 2024-09-13T02:52:38.434 INFO:tasks.workunit.client.1.smithi142.stdout:4/401: truncate d0/d2b/d21/d35/f83 927614 0 2024-09-13T02:52:38.435 INFO:tasks.workunit.client.1.smithi142.stdout:0/420: unlink d10/d6c/d88/d1a/d7a/l7d 0 2024-09-13T02:52:38.501 INFO:tasks.workunit.client.0.smithi098.stdout:8/67: sync 2024-09-13T02:52:38.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/68: rmdir d2 39 2024-09-13T02:52:38.504 INFO:tasks.workunit.client.0.smithi098.stdout:8/69: write d2/fe [607894,121021] 0 2024-09-13T02:52:38.505 INFO:tasks.workunit.client.1.smithi142.stdout:8/346: rename d0/d6/d23/d2b/l4a to d0/d6/dc/d45/d35/l6f 0 2024-09-13T02:52:38.505 INFO:tasks.workunit.client.1.smithi142.stdout:7/399: symlink d10/d13/d1d/d2b/d55/d32/l87 0 2024-09-13T02:52:38.505 INFO:tasks.workunit.client.1.smithi142.stdout:5/437: rmdir d8/d24/d64/d68 39 2024-09-13T02:52:38.505 INFO:tasks.workunit.client.0.smithi098.stdout:8/70: write d2/f3 [4779907,60656] 0 2024-09-13T02:52:38.506 INFO:tasks.workunit.client.0.smithi098.stdout:8/71: write d2/f3 [3632718,114561] 0 2024-09-13T02:52:38.507 INFO:tasks.workunit.client.1.smithi142.stdout:4/402: symlink d0/d2b/d21/l85 0 2024-09-13T02:52:38.509 INFO:tasks.workunit.client.0.smithi098.stdout:8/72: mkdir d2/dd/d11 0 2024-09-13T02:52:38.509 INFO:tasks.workunit.client.1.smithi142.stdout:0/421: write d10/d6c/d88/d1a/f22 [5931762,37267] 0 2024-09-13T02:52:38.509 INFO:tasks.workunit.client.1.smithi142.stdout:7/400: fsync d10/d13/d1d/d2b/d56/f85 0 2024-09-13T02:52:38.510 INFO:tasks.workunit.client.0.smithi098.stdout:8/73: chown d2/f9 6505 1 2024-09-13T02:52:38.511 INFO:tasks.workunit.client.1.smithi142.stdout:5/438: write d8/d24/d26/d45/f79 [978881,79802] 0 2024-09-13T02:52:38.511 INFO:tasks.workunit.client.1.smithi142.stdout:6/446: rename d1/dd/d16/d4d/f4f to d1/d7/d5f/d6a/f95 0 2024-09-13T02:52:38.512 INFO:tasks.workunit.client.1.smithi142.stdout:8/347: mknod d0/d6/dc/d45/d35/d37/c70 0 2024-09-13T02:52:38.512 INFO:tasks.workunit.client.1.smithi142.stdout:0/422: stat d10/d23/f8d 0 2024-09-13T02:52:38.513 INFO:tasks.workunit.client.1.smithi142.stdout:7/401: chown d10/d13/d1d/d2b/d55/d32/d7e 92 1 2024-09-13T02:52:38.514 INFO:tasks.workunit.client.0.smithi098.stdout:8/74: dread d2/f9 [0,4194304] 0 2024-09-13T02:52:38.514 INFO:tasks.workunit.client.0.smithi098.stdout:8/75: chown d2/la 193271107 1 2024-09-13T02:52:38.515 INFO:tasks.workunit.client.1.smithi142.stdout:8/348: chown d0/d6/dc/d40/l66 620 1 2024-09-13T02:52:38.516 INFO:tasks.workunit.client.0.smithi098.stdout:8/76: write d2/fe [1339196,48082] 0 2024-09-13T02:52:38.516 INFO:tasks.workunit.client.1.smithi142.stdout:5/439: creat d8/d24/d3f/f87 x:0 0 0 2024-09-13T02:52:38.517 INFO:tasks.workunit.client.1.smithi142.stdout:3/420: dwrite d12/d16/d25/f60 [0,4194304] 0 2024-09-13T02:52:38.518 INFO:tasks.workunit.client.1.smithi142.stdout:8/349: fdatasync d0/d6/dc/f18 0 2024-09-13T02:52:38.518 INFO:tasks.workunit.client.1.smithi142.stdout:1/512: dread d12/d13/d1d/f6c [0,4194304] 0 2024-09-13T02:52:38.523 INFO:tasks.workunit.client.1.smithi142.stdout:6/447: dwrite d1/dd/d53/f73 [0,4194304] 0 2024-09-13T02:52:38.523 INFO:tasks.workunit.client.1.smithi142.stdout:6/448: write d1/dd/f29 [732060,13197] 0 2024-09-13T02:52:38.525 INFO:tasks.workunit.client.1.smithi142.stdout:0/423: symlink d10/l94 0 2024-09-13T02:52:38.525 INFO:tasks.workunit.client.0.smithi098.stdout:8/77: symlink d2/dd/d11/l12 0 2024-09-13T02:52:38.525 INFO:tasks.workunit.client.1.smithi142.stdout:6/449: chown d1/dd/d16/d4e/l1b 154064 1 2024-09-13T02:52:38.526 INFO:tasks.workunit.client.1.smithi142.stdout:1/513: dwrite d12/d13/d1d/f89 [0,4194304] 0 2024-09-13T02:52:38.528 INFO:tasks.workunit.client.0.smithi098.stdout:8/78: mknod d2/dd/c13 0 2024-09-13T02:52:38.528 INFO:tasks.workunit.client.0.smithi098.stdout:8/79: readlink d2/la 0 2024-09-13T02:52:38.532 INFO:tasks.workunit.client.1.smithi142.stdout:5/440: creat d8/d24/d4d/f88 x:0 0 0 2024-09-13T02:52:38.532 INFO:tasks.workunit.client.0.smithi098.stdout:8/80: symlink d2/dd/d11/l14 0 2024-09-13T02:52:38.533 INFO:tasks.workunit.client.1.smithi142.stdout:5/441: chown d8/d24/f5f 8 1 2024-09-13T02:52:38.535 INFO:tasks.workunit.client.1.smithi142.stdout:8/350: creat d0/d6/dc/d45/d8/f71 x:0 0 0 2024-09-13T02:52:38.540 INFO:tasks.workunit.client.0.smithi098.stdout:8/81: dwrite d2/fe [0,4194304] 0 2024-09-13T02:52:38.541 INFO:tasks.workunit.client.1.smithi142.stdout:6/450: rename d1/dd/d16/d47/f94 to d1/d7/d19/d48/f96 0 2024-09-13T02:52:38.541 INFO:tasks.workunit.client.1.smithi142.stdout:6/451: write d1/dd/d16/f1c [1306602,87149] 0 2024-09-13T02:52:38.542 INFO:tasks.workunit.client.1.smithi142.stdout:6/452: fdatasync d1/d7/d19/d30/f66 0 2024-09-13T02:52:38.545 INFO:tasks.workunit.client.1.smithi142.stdout:1/514: rmdir d12 39 2024-09-13T02:52:38.550 INFO:tasks.workunit.client.1.smithi142.stdout:9/522: sync 2024-09-13T02:52:38.551 INFO:tasks.workunit.client.1.smithi142.stdout:6/453: dread d1/d7/f3a [0,4194304] 0 2024-09-13T02:52:38.552 INFO:tasks.workunit.client.0.smithi098.stdout:8/82: creat d2/f15 x:0 0 0 2024-09-13T02:52:38.553 INFO:tasks.workunit.client.1.smithi142.stdout:6/454: fdatasync d1/dd/d16/d4e/d32/f40 0 2024-09-13T02:52:38.553 INFO:tasks.workunit.client.1.smithi142.stdout:8/351: creat d0/d6/dc/f72 x:0 0 0 2024-09-13T02:52:38.553 INFO:tasks.workunit.client.1.smithi142.stdout:4/403: link d0/d2b/d2d/d31/d32/f58 d0/d2b/d2d/d31/d32/d82/f86 0 2024-09-13T02:52:38.556 INFO:tasks.workunit.client.1.smithi142.stdout:4/404: dread d0/d2b/d21/d35/f5f [0,4194304] 0 2024-09-13T02:52:38.557 INFO:tasks.workunit.client.0.smithi098.stdout:8/83: rename d2/f3 to d2/dd/d11/f16 0 2024-09-13T02:52:38.558 INFO:tasks.workunit.client.0.smithi098.stdout:8/84: readlink d2/dd/d11/l12 0 2024-09-13T02:52:38.561 INFO:tasks.workunit.client.0.smithi098.stdout:8/85: creat d2/dd/f17 x:0 0 0 2024-09-13T02:52:38.562 INFO:tasks.workunit.client.1.smithi142.stdout:4/405: dwrite d0/d2b/d2d/d65/f2e [0,4194304] 0 2024-09-13T02:52:38.565 INFO:tasks.workunit.client.1.smithi142.stdout:7/402: write d10/d13/f1e [1158443,52728] 0 2024-09-13T02:52:38.566 INFO:tasks.workunit.client.0.smithi098.stdout:8/86: creat d2/dd/d11/f18 x:0 0 0 2024-09-13T02:52:38.567 INFO:tasks.workunit.client.1.smithi142.stdout:9/523: mkdir dd/d17/d44/d82/d99/daf/dc9 0 2024-09-13T02:52:38.567 INFO:tasks.workunit.client.1.smithi142.stdout:5/442: symlink d8/d24/d26/d45/d81/d82/l89 0 2024-09-13T02:52:38.569 INFO:tasks.workunit.client.0.smithi098.stdout:8/87: symlink d2/l19 0 2024-09-13T02:52:38.570 INFO:tasks.workunit.client.0.smithi098.stdout:8/88: truncate d2/dd/d11/f16 5745170 0 2024-09-13T02:52:38.572 INFO:tasks.workunit.client.0.smithi098.stdout:8/89: write d2/dd/d11/f18 [619300,36255] 0 2024-09-13T02:52:38.573 INFO:tasks.workunit.client.1.smithi142.stdout:6/455: readlink d1/dd/l14 0 2024-09-13T02:52:38.573 INFO:tasks.workunit.client.1.smithi142.stdout:6/456: dread - d1/d7/f8d zero size 2024-09-13T02:52:38.574 INFO:tasks.workunit.client.1.smithi142.stdout:8/352: creat d0/d6/dc/d45/f73 x:0 0 0 2024-09-13T02:52:38.576 INFO:tasks.workunit.client.0.smithi098.stdout:8/90: dread d2/dd/d11/f16 [0,4194304] 0 2024-09-13T02:52:38.579 INFO:tasks.workunit.client.1.smithi142.stdout:3/421: getdents d12/d16/d25/d2e 0 2024-09-13T02:52:38.579 INFO:tasks.workunit.client.1.smithi142.stdout:3/422: write d12/d16/d25/f40 [1671895,75266] 0 2024-09-13T02:52:38.581 INFO:tasks.workunit.client.1.smithi142.stdout:1/515: fdatasync d12/f4d 0 2024-09-13T02:52:38.581 INFO:tasks.workunit.client.1.smithi142.stdout:1/516: stat c2 0 2024-09-13T02:52:38.582 INFO:tasks.workunit.client.1.smithi142.stdout:4/406: stat d0/d2b/d2d/d31/d32/d82/f86 0 2024-09-13T02:52:38.583 INFO:tasks.workunit.client.1.smithi142.stdout:1/517: write d12/d13/d20/d66/d55/da0/f6f [4030913,117148] 0 2024-09-13T02:52:38.589 INFO:tasks.workunit.client.1.smithi142.stdout:6/457: symlink d1/dd/d53/d78/d8f/l97 0 2024-09-13T02:52:38.590 INFO:tasks.workunit.client.1.smithi142.stdout:6/458: dread - d1/d7/d5f/d6a/f84 zero size 2024-09-13T02:52:38.591 INFO:tasks.workunit.client.1.smithi142.stdout:6/459: write d1/d7/f8d [450695,104774] 0 2024-09-13T02:52:38.592 INFO:tasks.workunit.client.1.smithi142.stdout:3/423: chown d12/d16/c1d 52342 1 2024-09-13T02:52:38.595 INFO:tasks.workunit.client.1.smithi142.stdout:4/407: truncate d0/d2b/d2d/d65/f1e 4068493 0 2024-09-13T02:52:38.596 INFO:tasks.workunit.client.0.smithi098.stdout:8/91: write d2/f6 [1684136,84140] 0 2024-09-13T02:52:38.598 INFO:tasks.workunit.client.1.smithi142.stdout:8/353: creat d0/d6/dc/d40/d4d/d62/f74 x:0 0 0 2024-09-13T02:52:38.599 INFO:tasks.workunit.client.0.smithi098.stdout:8/92: creat d2/f1a x:0 0 0 2024-09-13T02:52:38.600 INFO:tasks.workunit.client.1.smithi142.stdout:6/460: unlink d1/dd/d16/d4e/l86 0 2024-09-13T02:52:38.602 INFO:tasks.workunit.client.1.smithi142.stdout:7/403: dwrite d10/d34/f5b [0,4194304] 0 2024-09-13T02:52:38.603 INFO:tasks.workunit.client.1.smithi142.stdout:9/524: mkdir dd/d98/dca 0 2024-09-13T02:52:38.604 INFO:tasks.workunit.client.1.smithi142.stdout:5/443: dwrite d8/d24/d26/d61/f71 [0,4194304] 0 2024-09-13T02:52:38.604 INFO:tasks.workunit.client.1.smithi142.stdout:4/408: dread d0/d2b/d21/d30/f4e [0,4194304] 0 2024-09-13T02:52:38.606 INFO:tasks.workunit.client.1.smithi142.stdout:4/409: fsync d0/df/d57/f22 0 2024-09-13T02:52:38.609 INFO:tasks.workunit.client.1.smithi142.stdout:4/410: chown d0/d2b/d2d/d31 43 1 2024-09-13T02:52:38.609 INFO:tasks.workunit.client.1.smithi142.stdout:3/424: creat d12/d16/d25/d2e/d38/d6b/f7f x:0 0 0 2024-09-13T02:52:38.609 INFO:tasks.workunit.client.0.smithi098.stdout:8/93: write f1 [5297105,32560] 0 2024-09-13T02:52:38.610 INFO:tasks.workunit.client.0.smithi098.stdout:3/58: sync 2024-09-13T02:52:38.611 INFO:tasks.workunit.client.0.smithi098.stdout:8/94: write d2/dd/f17 [221328,96000] 0 2024-09-13T02:52:38.612 INFO:tasks.workunit.client.0.smithi098.stdout:8/95: write d2/f15 [591175,119472] 0 2024-09-13T02:52:38.613 INFO:tasks.workunit.client.0.smithi098.stdout:8/96: chown d2/l19 8340948 1 2024-09-13T02:52:38.615 INFO:tasks.workunit.client.1.smithi142.stdout:6/461: dwrite d1/dd/d57/f91 [0,4194304] 0 2024-09-13T02:52:38.615 INFO:tasks.workunit.client.1.smithi142.stdout:8/354: mkdir d0/d75 0 2024-09-13T02:52:38.617 INFO:tasks.workunit.client.0.smithi098.stdout:8/97: creat d2/f1b x:0 0 0 2024-09-13T02:52:38.617 INFO:tasks.workunit.client.1.smithi142.stdout:6/462: write d1/dd/f49 [6320209,34598] 0 2024-09-13T02:52:38.617 INFO:tasks.workunit.client.0.smithi098.stdout:8/98: fsync d2/f1a 0 2024-09-13T02:52:38.620 INFO:tasks.workunit.client.1.smithi142.stdout:4/411: chown d0/d2b/c80 4058855 1 2024-09-13T02:52:38.620 INFO:tasks.workunit.client.1.smithi142.stdout:1/518: link d12/d13/d1d/l41 d12/d1b/lac 0 2024-09-13T02:52:38.621 INFO:tasks.workunit.client.0.smithi098.stdout:8/99: symlink d2/dd/d11/l1c 0 2024-09-13T02:52:38.623 INFO:tasks.workunit.client.1.smithi142.stdout:3/425: mknod d12/d16/d25/c80 0 2024-09-13T02:52:38.624 INFO:tasks.workunit.client.1.smithi142.stdout:9/525: mkdir dd/dcb 0 2024-09-13T02:52:38.624 INFO:tasks.workunit.client.1.smithi142.stdout:3/426: dread - d12/d16/f43 zero size 2024-09-13T02:52:38.626 INFO:tasks.workunit.client.0.smithi098.stdout:8/100: mkdir d2/dd/d11/d1d 0 2024-09-13T02:52:38.627 INFO:tasks.workunit.client.1.smithi142.stdout:4/412: dwrite d0/df/d57/f70 [0,4194304] 0 2024-09-13T02:52:38.627 INFO:tasks.workunit.client.1.smithi142.stdout:3/427: write d12/d16/d25/d2e/d48/f52 [4555196,54488] 0 2024-09-13T02:52:38.630 INFO:tasks.workunit.client.0.smithi098.stdout:8/101: symlink d2/dd/d11/d1d/l1e 0 2024-09-13T02:52:38.630 INFO:tasks.workunit.client.1.smithi142.stdout:8/355: truncate d0/d6/dc/d45/d35/f56 270204 0 2024-09-13T02:52:38.632 INFO:tasks.workunit.client.1.smithi142.stdout:2/300: sync 2024-09-13T02:52:38.632 INFO:tasks.workunit.client.1.smithi142.stdout:7/404: getdents d10/d13/d1d/d2b/d56/d5f/d73 0 2024-09-13T02:52:38.634 INFO:tasks.workunit.client.1.smithi142.stdout:9/526: dwrite dd/d17/d25/f42 [0,4194304] 0 2024-09-13T02:52:38.635 INFO:tasks.workunit.client.1.smithi142.stdout:6/463: symlink d1/d59/l98 0 2024-09-13T02:52:38.636 INFO:tasks.workunit.client.1.smithi142.stdout:5/444: creat d8/d24/d26/f8a x:0 0 0 2024-09-13T02:52:38.637 INFO:tasks.workunit.client.1.smithi142.stdout:1/519: mknod d12/d13/d1d/d26/d4f/da9/cad 0 2024-09-13T02:52:38.640 INFO:tasks.workunit.client.1.smithi142.stdout:6/464: truncate d1/d7/d5f/d6a/f84 851357 0 2024-09-13T02:52:38.640 INFO:tasks.workunit.client.1.smithi142.stdout:4/413: mkdir d0/d2b/d2d/d65/d87 0 2024-09-13T02:52:38.642 INFO:tasks.workunit.client.1.smithi142.stdout:7/405: dread d10/f47 [0,4194304] 0 2024-09-13T02:52:38.647 INFO:tasks.workunit.client.1.smithi142.stdout:5/445: dwrite d8/d24/f3e [0,4194304] 0 2024-09-13T02:52:38.648 INFO:tasks.workunit.client.1.smithi142.stdout:4/414: read d0/d2b/d2d/d31/d32/f3d [3045460,25090] 0 2024-09-13T02:52:38.649 INFO:tasks.workunit.client.1.smithi142.stdout:3/428: rename d12/d16/d25/d2e/d48/d5c/d66/l65 to d12/d16/d25/d2e/d38/d4d/l81 0 2024-09-13T02:52:38.652 INFO:tasks.workunit.client.1.smithi142.stdout:9/527: unlink dd/d17/d69/c88 0 2024-09-13T02:52:38.653 INFO:tasks.workunit.client.1.smithi142.stdout:6/465: fdatasync d1/d7/f3a 0 2024-09-13T02:52:38.655 INFO:tasks.workunit.client.1.smithi142.stdout:8/356: dwrite d0/d6/dc/d45/d8/df/d28/f2d [0,4194304] 0 2024-09-13T02:52:38.656 INFO:tasks.workunit.client.1.smithi142.stdout:7/406: dwrite d10/d13/d1d/f5d [0,4194304] 0 2024-09-13T02:52:38.659 INFO:tasks.workunit.client.1.smithi142.stdout:1/520: symlink d12/lae 0 2024-09-13T02:52:38.662 INFO:tasks.workunit.client.1.smithi142.stdout:2/301: creat d1/de/d1f/f63 x:0 0 0 2024-09-13T02:52:38.664 INFO:tasks.workunit.client.0.smithi098.stdout:8/102: rmdir d2 39 2024-09-13T02:52:38.665 INFO:tasks.workunit.client.1.smithi142.stdout:9/528: dwrite dd/d17/d69/d84/d41/f83 [0,4194304] 0 2024-09-13T02:52:38.665 INFO:tasks.workunit.client.1.smithi142.stdout:9/529: stat dd/d17/d44/d82/d99/da8/db7 0 2024-09-13T02:52:38.666 INFO:tasks.workunit.client.1.smithi142.stdout:5/446: mkdir d8/d24/d3f/d4a/d4b/d8b 0 2024-09-13T02:52:38.667 INFO:tasks.workunit.client.1.smithi142.stdout:9/530: chown dd/d17/d44/d82/d99/da8/db7/fc4 11983638 1 2024-09-13T02:52:38.668 INFO:tasks.workunit.client.1.smithi142.stdout:5/447: write d8/d24/d26/f60 [2906681,41556] 0 2024-09-13T02:52:38.669 INFO:tasks.workunit.client.1.smithi142.stdout:5/448: fsync d8/d24/f3d 0 2024-09-13T02:52:38.669 INFO:tasks.workunit.client.1.smithi142.stdout:3/429: mknod d12/d16/d25/d2e/d48/d5c/c82 0 2024-09-13T02:52:38.670 INFO:tasks.workunit.client.0.smithi098.stdout:8/103: stat d2/f1b 0 2024-09-13T02:52:38.671 INFO:tasks.workunit.client.0.smithi098.stdout:8/104: fdatasync f1 0 2024-09-13T02:52:38.674 INFO:tasks.workunit.client.1.smithi142.stdout:0/424: sync 2024-09-13T02:52:38.675 INFO:tasks.workunit.client.1.smithi142.stdout:0/425: write d10/d6c/d88/d1a/f22 [4024528,83253] 0 2024-09-13T02:52:38.677 INFO:tasks.workunit.client.0.smithi098.stdout:8/105: dread d2/dd/d11/f18 [0,4194304] 0 2024-09-13T02:52:38.677 INFO:tasks.workunit.client.1.smithi142.stdout:7/407: mkdir d10/d64/d88 0 2024-09-13T02:52:38.682 INFO:tasks.workunit.client.1.smithi142.stdout:1/521: write d12/d13/d20/d27/d3c/f59 [8187726,60448] 0 2024-09-13T02:52:38.688 INFO:tasks.workunit.client.1.smithi142.stdout:9/531: creat dd/d17/d69/d84/d41/fcc x:0 0 0 2024-09-13T02:52:38.688 INFO:tasks.workunit.client.1.smithi142.stdout:5/449: mkdir d8/d24/d26/d45/d81/d8c 0 2024-09-13T02:52:38.690 INFO:tasks.workunit.client.1.smithi142.stdout:0/426: chown d10/c49 27248 1 2024-09-13T02:52:38.691 INFO:tasks.workunit.client.1.smithi142.stdout:0/427: truncate d10/d23/f87 816011 0 2024-09-13T02:52:38.692 INFO:tasks.workunit.client.1.smithi142.stdout:6/466: link d1/dd/d57/f91 d1/d7/d5f/d6a/f99 0 2024-09-13T02:52:38.692 INFO:tasks.workunit.client.1.smithi142.stdout:1/522: symlink d12/d13/d20/d66/laf 0 2024-09-13T02:52:38.696 INFO:tasks.workunit.client.1.smithi142.stdout:2/302: rename d1/de/d1f/f1a to d1/d2d/f64 0 2024-09-13T02:52:38.696 INFO:tasks.workunit.client.1.smithi142.stdout:4/415: creat d0/df/d57/f88 x:0 0 0 2024-09-13T02:52:38.697 INFO:tasks.workunit.client.1.smithi142.stdout:7/408: dwrite d10/d64/f82 [8388608,4194304] 0 2024-09-13T02:52:38.697 INFO:tasks.workunit.client.1.smithi142.stdout:4/416: readlink d0/d2b/d2d/l62 0 2024-09-13T02:52:38.698 INFO:tasks.workunit.client.1.smithi142.stdout:4/417: fsync d0/d2b/d2d/d31/d32/f50 0 2024-09-13T02:52:38.698 INFO:tasks.workunit.client.1.smithi142.stdout:0/428: fsync d10/f7c 0 2024-09-13T02:52:38.700 INFO:tasks.workunit.client.1.smithi142.stdout:9/532: creat dd/dcb/fcd x:0 0 0 2024-09-13T02:52:38.701 INFO:tasks.workunit.client.1.smithi142.stdout:1/523: symlink d12/d13/d20/d27/d3c/d71/d81/d92/lb0 0 2024-09-13T02:52:38.701 INFO:tasks.workunit.client.1.smithi142.stdout:0/429: write d10/d6c/d88/d21/d51/d35/f55 [1156114,110200] 0 2024-09-13T02:52:38.702 INFO:tasks.workunit.client.1.smithi142.stdout:2/303: symlink d1/de/d31/d46/l65 0 2024-09-13T02:52:38.704 INFO:tasks.workunit.client.1.smithi142.stdout:1/524: write d12/d13/d1d/f8d [951565,62550] 0 2024-09-13T02:52:38.706 INFO:tasks.workunit.client.1.smithi142.stdout:8/357: getdents d0/d6/dc/d40 0 2024-09-13T02:52:38.709 INFO:tasks.workunit.client.1.smithi142.stdout:9/533: dwrite dd/d17/d4f/f7a [0,4194304] 0 2024-09-13T02:52:38.713 INFO:tasks.workunit.client.1.smithi142.stdout:1/525: dwrite d12/d13/d1d/f9e [0,4194304] 0 2024-09-13T02:52:38.714 INFO:tasks.workunit.client.0.smithi098.stdout:8/106: dwrite d2/fe [4194304,4194304] 0 2024-09-13T02:52:38.715 INFO:tasks.workunit.client.1.smithi142.stdout:2/304: read - d1/f1e zero size 2024-09-13T02:52:38.715 INFO:tasks.workunit.client.1.smithi142.stdout:1/526: write d12/fa1 [473322,37301] 0 2024-09-13T02:52:38.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:38 smithi098 ceph-mon[27886]: pgmap v18: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 76 MiB/s wr, 224 op/s 2024-09-13T02:52:38.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:38 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:38.737 INFO:tasks.workunit.client.1.smithi142.stdout:8/358: stat d0/d6/dc/d45/d8/df/l34 0 2024-09-13T02:52:38.739 INFO:tasks.workunit.client.0.smithi098.stdout:8/107: mkdir d2/dd/d11/d1f 0 2024-09-13T02:52:38.739 INFO:tasks.workunit.client.1.smithi142.stdout:4/418: rmdir d0/df 39 2024-09-13T02:52:38.741 INFO:tasks.workunit.client.1.smithi142.stdout:3/430: truncate d12/f58 1597988 0 2024-09-13T02:52:38.745 INFO:tasks.workunit.client.1.smithi142.stdout:0/430: mkdir d10/d95 0 2024-09-13T02:52:38.745 INFO:tasks.workunit.client.1.smithi142.stdout:7/409: write d10/d13/d1d/d2b/d55/f3c [1500357,45989] 0 2024-09-13T02:52:38.746 INFO:tasks.workunit.client.1.smithi142.stdout:5/450: getdents d8/d24/d3f 0 2024-09-13T02:52:38.746 INFO:tasks.workunit.client.1.smithi142.stdout:7/410: read d10/d31/f43 [602048,47080] 0 2024-09-13T02:52:38.747 INFO:tasks.workunit.client.1.smithi142.stdout:6/467: getdents d1/dd 0 2024-09-13T02:52:38.748 INFO:tasks.workunit.client.0.smithi098.stdout:8/108: rmdir d2/dd/d11/d1f 0 2024-09-13T02:52:38.748 INFO:tasks.workunit.client.1.smithi142.stdout:7/411: chown d10/d13/d1d/d2b/l2f 225316 1 2024-09-13T02:52:38.749 INFO:tasks.workunit.client.1.smithi142.stdout:1/527: truncate d12/d13/d20/d27/d3c/f6d 1243675 0 2024-09-13T02:52:38.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:38 smithi142 ceph-mon[33443]: pgmap v18: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 76 MiB/s wr, 224 op/s 2024-09-13T02:52:38.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:38 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:38.752 INFO:tasks.workunit.client.0.smithi098.stdout:8/109: creat d2/dd/d11/d1d/f20 x:0 0 0 2024-09-13T02:52:38.752 INFO:tasks.workunit.client.1.smithi142.stdout:9/534: creat dd/d17/d5f/d7b/db8/dc0/fce x:0 0 0 2024-09-13T02:52:38.754 INFO:tasks.workunit.client.1.smithi142.stdout:6/468: dwrite d1/f41 [0,4194304] 0 2024-09-13T02:52:38.755 INFO:tasks.workunit.client.1.smithi142.stdout:2/305: mknod d1/de/d1f/d13/d59/c66 0 2024-09-13T02:52:38.755 INFO:tasks.workunit.client.1.smithi142.stdout:0/431: read d10/d6c/d88/d21/f3c [1579194,113661] 0 2024-09-13T02:52:38.755 INFO:tasks.workunit.client.1.smithi142.stdout:2/306: chown d1/de/d1f/d13 4181 1 2024-09-13T02:52:38.756 INFO:tasks.workunit.client.1.smithi142.stdout:5/451: dread d8/d47/f4f [0,4194304] 0 2024-09-13T02:52:38.757 INFO:tasks.workunit.client.1.smithi142.stdout:2/307: truncate d1/d29/d2b/f52 105456 0 2024-09-13T02:52:38.759 INFO:tasks.workunit.client.1.smithi142.stdout:1/528: unlink d12/d13/d20/d27/d3c/f95 0 2024-09-13T02:52:38.759 INFO:tasks.workunit.client.0.smithi098.stdout:8/110: dwrite d2/dd/f17 [0,4194304] 0 2024-09-13T02:52:38.761 INFO:tasks.workunit.client.1.smithi142.stdout:2/308: write d1/de/f17 [6253547,68564] 0 2024-09-13T02:52:38.762 INFO:tasks.workunit.client.1.smithi142.stdout:3/431: creat d12/d16/d3c/d79/f83 x:0 0 0 2024-09-13T02:52:38.766 INFO:tasks.workunit.client.1.smithi142.stdout:7/412: dwrite d10/d34/f5a [0,4194304] 0 2024-09-13T02:52:38.767 INFO:tasks.workunit.client.1.smithi142.stdout:6/469: creat d1/d7/d5f/d60/f9a x:0 0 0 2024-09-13T02:52:38.771 INFO:tasks.workunit.client.0.smithi098.stdout:8/111: getdents d2/dd 0 2024-09-13T02:52:38.771 INFO:tasks.workunit.client.1.smithi142.stdout:9/535: dread dd/d17/d25/f33 [0,4194304] 0 2024-09-13T02:52:38.771 INFO:tasks.workunit.client.1.smithi142.stdout:1/529: dwrite d12/d13/d20/d66/d55/f7f [0,4194304] 0 2024-09-13T02:52:38.771 INFO:tasks.workunit.client.1.smithi142.stdout:9/536: write f8 [2356019,82203] 0 2024-09-13T02:52:38.773 INFO:tasks.workunit.client.1.smithi142.stdout:1/530: fdatasync d12/d13/d1d/d26/fa3 0 2024-09-13T02:52:38.775 INFO:tasks.workunit.client.1.smithi142.stdout:1/531: read d12/d13/d1d/d26/fa3 [2644852,53284] 0 2024-09-13T02:52:38.776 INFO:tasks.workunit.client.1.smithi142.stdout:2/309: unlink d1/d2c/l41 0 2024-09-13T02:52:38.778 INFO:tasks.workunit.client.1.smithi142.stdout:3/432: symlink d12/d16/d25/l84 0 2024-09-13T02:52:38.778 INFO:tasks.workunit.client.1.smithi142.stdout:0/432: mknod d10/d6c/d88/d21/d51/d79/c96 0 2024-09-13T02:52:38.781 INFO:tasks.workunit.client.1.smithi142.stdout:3/433: stat d12/d16/d25/d2e/d38/d4d/d53/d78/d7e 0 2024-09-13T02:52:38.781 INFO:tasks.workunit.client.1.smithi142.stdout:5/452: mkdir d8/d24/d26/d45/d81/d8c/d8d 0 2024-09-13T02:52:38.784 INFO:tasks.workunit.client.1.smithi142.stdout:6/470: unlink d1/dd/d16/d4e/c3f 0 2024-09-13T02:52:38.786 INFO:tasks.workunit.client.1.smithi142.stdout:2/310: dwrite d1/d29/d2b/f5c [0,4194304] 0 2024-09-13T02:52:38.786 INFO:tasks.workunit.client.1.smithi142.stdout:9/537: symlink dd/d17/d68/lcf 0 2024-09-13T02:52:38.786 INFO:tasks.workunit.client.1.smithi142.stdout:6/471: readlink d1/dd/d16/d4e/l51 0 2024-09-13T02:52:38.787 INFO:tasks.workunit.client.1.smithi142.stdout:8/359: dread d0/d6/dc/d45/f3 [0,4194304] 0 2024-09-13T02:52:38.789 INFO:tasks.workunit.client.1.smithi142.stdout:4/419: creat d0/df/d57/f89 x:0 0 0 2024-09-13T02:52:38.790 INFO:tasks.workunit.client.1.smithi142.stdout:0/433: mknod d10/d6c/d88/d1a/d1e/c97 0 2024-09-13T02:52:38.793 INFO:tasks.workunit.client.1.smithi142.stdout:5/453: fdatasync d8/d24/d3f/d4a/f86 0 2024-09-13T02:52:38.795 INFO:tasks.workunit.client.1.smithi142.stdout:3/434: creat d12/d16/d25/d2e/d38/d4d/d53/d78/f85 x:0 0 0 2024-09-13T02:52:38.796 INFO:tasks.workunit.client.1.smithi142.stdout:6/472: symlink d1/d59/l9b 0 2024-09-13T02:52:38.797 INFO:tasks.workunit.client.1.smithi142.stdout:4/420: dwrite d0/df/d57/f22 [0,4194304] 0 2024-09-13T02:52:38.799 INFO:tasks.workunit.client.1.smithi142.stdout:4/421: write d0/d2b/d2d/d31/d43/d48/f78 [346939,83058] 0 2024-09-13T02:52:38.800 INFO:tasks.workunit.client.1.smithi142.stdout:9/538: mknod dd/d17/d5f/d7b/cd0 0 2024-09-13T02:52:38.801 INFO:tasks.workunit.client.1.smithi142.stdout:0/434: symlink d10/d6c/l98 0 2024-09-13T02:52:38.802 INFO:tasks.workunit.client.1.smithi142.stdout:5/454: readlink d8/d24/d4d/l57 0 2024-09-13T02:52:38.803 INFO:tasks.workunit.client.1.smithi142.stdout:2/311: dread d1/de/f17 [0,4194304] 0 2024-09-13T02:52:38.804 INFO:tasks.workunit.client.1.smithi142.stdout:6/473: creat d1/d7/d19/d48/f9c x:0 0 0 2024-09-13T02:52:38.807 INFO:tasks.workunit.client.1.smithi142.stdout:8/360: mkdir d0/d6/d76 0 2024-09-13T02:52:38.810 INFO:tasks.workunit.client.1.smithi142.stdout:5/455: mkdir d8/d24/d26/d45/d8e 0 2024-09-13T02:52:38.811 INFO:tasks.workunit.client.1.smithi142.stdout:1/532: dread d12/d13/d20/d66/d55/f47 [0,4194304] 0 2024-09-13T02:52:38.811 INFO:tasks.workunit.client.1.smithi142.stdout:8/361: chown d0/d6/dc/d45/d35/d37 968136 1 2024-09-13T02:52:38.812 INFO:tasks.workunit.client.1.smithi142.stdout:2/312: mknod d1/d29/c67 0 2024-09-13T02:52:38.812 INFO:tasks.workunit.client.1.smithi142.stdout:7/413: write d10/d13/d1d/f5d [5050320,100433] 0 2024-09-13T02:52:38.815 INFO:tasks.workunit.client.1.smithi142.stdout:4/422: dwrite d0/d2b/d2d/d31/d43/d48/f4d [0,4194304] 0 2024-09-13T02:52:38.815 INFO:tasks.workunit.client.1.smithi142.stdout:9/539: dwrite dd/d17/d5f/d7b/db8/dc0/fce [0,4194304] 0 2024-09-13T02:52:38.816 INFO:tasks.workunit.client.1.smithi142.stdout:1/533: fsync d12/d13/d20/d66/d55/f44 0 2024-09-13T02:52:38.817 INFO:tasks.workunit.client.1.smithi142.stdout:0/435: dread d10/d6c/d88/d21/d51/f54 [0,4194304] 0 2024-09-13T02:52:38.818 INFO:tasks.workunit.client.1.smithi142.stdout:5/456: creat d8/d24/d3f/f8f x:0 0 0 2024-09-13T02:52:38.819 INFO:tasks.workunit.client.1.smithi142.stdout:9/540: dread - dd/d17/d25/fbc zero size 2024-09-13T02:52:38.823 INFO:tasks.workunit.client.1.smithi142.stdout:9/541: fsync dd/f16 0 2024-09-13T02:52:38.825 INFO:tasks.workunit.client.1.smithi142.stdout:3/435: link d12/d16/l23 d12/d16/d3c/d79/l86 0 2024-09-13T02:52:38.827 INFO:tasks.workunit.client.1.smithi142.stdout:0/436: fsync d10/d6c/d88/d21/d51/f92 0 2024-09-13T02:52:38.830 INFO:tasks.workunit.client.1.smithi142.stdout:5/457: rename d8/d24/d4d to d8/d24/d26/d2d/d90 0 2024-09-13T02:52:38.830 INFO:tasks.workunit.client.1.smithi142.stdout:6/474: dwrite d1/d7/d42/f44 [0,4194304] 0 2024-09-13T02:52:38.831 INFO:tasks.workunit.client.1.smithi142.stdout:2/313: dwrite d1/de/d1f/f19 [0,4194304] 0 2024-09-13T02:52:38.831 INFO:tasks.workunit.client.1.smithi142.stdout:3/436: chown d12/d16/d25/d2e/d48/d5c/d66/f63 959 1 2024-09-13T02:52:38.832 INFO:tasks.workunit.client.1.smithi142.stdout:2/314: truncate d1/f1e 1034637 0 2024-09-13T02:52:38.833 INFO:tasks.workunit.client.1.smithi142.stdout:4/423: rmdir d0/d2b/d21/d35/d6d 0 2024-09-13T02:52:38.833 INFO:tasks.workunit.client.1.smithi142.stdout:4/424: readlink d0/d2b/la 0 2024-09-13T02:52:38.835 INFO:tasks.workunit.client.1.smithi142.stdout:9/542: mkdir dd/d17/d44/d95/dd1 0 2024-09-13T02:52:38.837 INFO:tasks.workunit.client.1.smithi142.stdout:9/543: write dd/f11 [267868,43191] 0 2024-09-13T02:52:38.840 INFO:tasks.workunit.client.1.smithi142.stdout:5/458: unlink d8/l2b 0 2024-09-13T02:52:38.842 INFO:tasks.workunit.client.1.smithi142.stdout:3/437: creat d12/d16/d25/d2e/d38/d5a/f87 x:0 0 0 2024-09-13T02:52:38.843 INFO:tasks.workunit.client.1.smithi142.stdout:2/315: creat d1/d29/d2b/d47/f68 x:0 0 0 2024-09-13T02:52:38.844 INFO:tasks.workunit.client.1.smithi142.stdout:8/362: dread d0/fb [0,4194304] 0 2024-09-13T02:52:38.846 INFO:tasks.workunit.client.1.smithi142.stdout:8/363: write d0/d6/d23/f3d [4371807,108323] 0 2024-09-13T02:52:38.847 INFO:tasks.workunit.client.1.smithi142.stdout:8/364: chown d0/d6 115917 1 2024-09-13T02:52:38.848 INFO:tasks.workunit.client.1.smithi142.stdout:9/544: creat dd/d17/d44/d95/fd2 x:0 0 0 2024-09-13T02:52:38.848 INFO:tasks.workunit.client.1.smithi142.stdout:7/414: dwrite d10/f42 [0,4194304] 0 2024-09-13T02:52:38.850 INFO:tasks.workunit.client.1.smithi142.stdout:0/437: fdatasync d10/f19 0 2024-09-13T02:52:38.851 INFO:tasks.workunit.client.1.smithi142.stdout:0/438: chown d10/d6c/d88/d1a/d1e/l4e 15436836 1 2024-09-13T02:52:38.852 INFO:tasks.workunit.client.1.smithi142.stdout:6/475: mknod d1/d7/d19/d48/d90/c9d 0 2024-09-13T02:52:38.854 INFO:tasks.workunit.client.1.smithi142.stdout:5/459: rename d8/d24/d3f/d4a/d4b/l67 to d8/d24/d26/d2d/d90/l91 0 2024-09-13T02:52:38.856 INFO:tasks.workunit.client.1.smithi142.stdout:1/534: truncate d12/d13/d1d/f61 4521026 0 2024-09-13T02:52:38.858 INFO:tasks.workunit.client.1.smithi142.stdout:8/365: fsync d0/f69 0 2024-09-13T02:52:38.860 INFO:tasks.workunit.client.1.smithi142.stdout:7/415: read d10/d34/f38 [1688818,31089] 0 2024-09-13T02:52:38.860 INFO:tasks.workunit.client.1.smithi142.stdout:9/545: creat dd/d17/d44/d95/fd3 x:0 0 0 2024-09-13T02:52:38.861 INFO:tasks.workunit.client.1.smithi142.stdout:1/535: write d12/d13/d20/d66/d55/f64 [565498,114773] 0 2024-09-13T02:52:38.861 INFO:tasks.workunit.client.1.smithi142.stdout:6/476: creat d1/d7/d19/d48/d90/f9e x:0 0 0 2024-09-13T02:52:38.862 INFO:tasks.workunit.client.1.smithi142.stdout:2/316: read d1/f2f [682266,89241] 0 2024-09-13T02:52:38.863 INFO:tasks.workunit.client.1.smithi142.stdout:0/439: dread d10/d6c/d88/d21/d51/f3e [0,4194304] 0 2024-09-13T02:52:38.864 INFO:tasks.workunit.client.1.smithi142.stdout:3/438: dread d12/d16/f17 [0,4194304] 0 2024-09-13T02:52:38.865 INFO:tasks.workunit.client.1.smithi142.stdout:7/416: creat d10/d13/d1d/d44/f89 x:0 0 0 2024-09-13T02:52:38.867 INFO:tasks.workunit.client.1.smithi142.stdout:2/317: symlink d1/d29/d2b/l69 0 2024-09-13T02:52:38.868 INFO:tasks.workunit.client.1.smithi142.stdout:0/440: readlink d10/d6c/d88/d21/l68 0 2024-09-13T02:52:38.869 INFO:tasks.workunit.client.1.smithi142.stdout:3/439: stat d12/d16/d25/d2e/d38/d5a/c7a 0 2024-09-13T02:52:38.869 INFO:tasks.workunit.client.1.smithi142.stdout:4/425: dwrite d0/d2b/d2d/d31/d43/f46 [0,4194304] 0 2024-09-13T02:52:38.873 INFO:tasks.workunit.client.1.smithi142.stdout:1/536: creat d12/d13/d1d/d26/d4f/fb1 x:0 0 0 2024-09-13T02:52:38.877 INFO:tasks.workunit.client.1.smithi142.stdout:0/441: truncate d10/d6c/d88/d30/f86 901403 0 2024-09-13T02:52:38.877 INFO:tasks.workunit.client.1.smithi142.stdout:7/417: mknod d10/d34/d65/c8a 0 2024-09-13T02:52:38.878 INFO:tasks.workunit.client.1.smithi142.stdout:9/546: dwrite dd/f1f [0,4194304] 0 2024-09-13T02:52:38.879 INFO:tasks.workunit.client.1.smithi142.stdout:7/418: read d10/d31/f4e [443232,96116] 0 2024-09-13T02:52:38.881 INFO:tasks.workunit.client.1.smithi142.stdout:4/426: write d0/d2b/d21/d35/f79 [4301852,77351] 0 2024-09-13T02:52:38.884 INFO:tasks.workunit.client.1.smithi142.stdout:7/419: chown d10/d13/d1d/d2b/d40 75619 1 2024-09-13T02:52:38.884 INFO:tasks.workunit.client.1.smithi142.stdout:0/442: creat d10/d6c/d88/d1a/d3a/f99 x:0 0 0 2024-09-13T02:52:38.884 INFO:tasks.workunit.client.1.smithi142.stdout:9/547: creat dd/d17/d5f/fd4 x:0 0 0 2024-09-13T02:52:38.886 INFO:tasks.workunit.client.1.smithi142.stdout:4/427: creat d0/d2b/d21/d30/f8a x:0 0 0 2024-09-13T02:52:38.888 INFO:tasks.workunit.client.1.smithi142.stdout:0/443: write d10/d6c/d88/f6e [213322,18278] 0 2024-09-13T02:52:38.888 INFO:tasks.workunit.client.1.smithi142.stdout:3/440: link c5 d12/d16/d25/d2e/d38/c88 0 2024-09-13T02:52:38.888 INFO:tasks.workunit.client.1.smithi142.stdout:5/460: dwrite d8/d24/d26/d2d/d90/f6f [0,4194304] 0 2024-09-13T02:52:38.890 INFO:tasks.workunit.client.1.smithi142.stdout:4/428: fsync d0/d2b/d21/d30/f7a 0 2024-09-13T02:52:38.890 INFO:tasks.workunit.client.1.smithi142.stdout:7/420: creat d10/d13/d1d/d2b/d40/f8b x:0 0 0 2024-09-13T02:52:38.893 INFO:tasks.workunit.client.1.smithi142.stdout:2/318: truncate d1/f9 5542477 0 2024-09-13T02:52:38.894 INFO:tasks.workunit.client.1.smithi142.stdout:5/461: rmdir d8/d24/d3f/d4a 39 2024-09-13T02:52:38.902 INFO:tasks.workunit.client.1.smithi142.stdout:6/477: dread d1/d7/d5f/d6a/f7a [0,4194304] 0 2024-09-13T02:52:38.902 INFO:tasks.workunit.client.1.smithi142.stdout:7/421: fsync d10/d13/d1d/d2b/d56/f6a 0 2024-09-13T02:52:38.902 INFO:tasks.workunit.client.1.smithi142.stdout:2/319: fsync d1/f2f 0 2024-09-13T02:52:38.902 INFO:tasks.workunit.client.1.smithi142.stdout:6/478: fdatasync d1/dd/d53/d78/f80 0 2024-09-13T02:52:38.902 INFO:tasks.workunit.client.1.smithi142.stdout:5/462: read d8/d24/d26/f60 [1331756,82052] 0 2024-09-13T02:52:38.903 INFO:tasks.workunit.client.1.smithi142.stdout:0/444: rename d10/d6c/d88/l64 to d10/d6c/d88/d36/l9a 0 2024-09-13T02:52:38.905 INFO:tasks.workunit.client.1.smithi142.stdout:8/366: dread d0/d6/f24 [0,4194304] 0 2024-09-13T02:52:38.907 INFO:tasks.workunit.client.1.smithi142.stdout:9/548: getdents dd/d17/d4f 0 2024-09-13T02:52:38.908 INFO:tasks.workunit.client.1.smithi142.stdout:7/422: mkdir d10/d13/d1d/d2b/d55/d32/d8c 0 2024-09-13T02:52:38.908 INFO:tasks.workunit.client.1.smithi142.stdout:3/441: truncate d12/d16/d25/d2e/d48/d5c/f51 6158468 0 2024-09-13T02:52:38.909 INFO:tasks.workunit.client.1.smithi142.stdout:5/463: unlink d8/fe 0 2024-09-13T02:52:38.909 INFO:tasks.workunit.client.1.smithi142.stdout:4/429: dwrite d0/d2b/d2d/d31/d43/f5a [0,4194304] 0 2024-09-13T02:52:38.912 INFO:tasks.workunit.client.1.smithi142.stdout:2/320: rename f0 to d1/de/d1f/d13/d59/f6a 0 2024-09-13T02:52:38.912 INFO:tasks.workunit.client.1.smithi142.stdout:5/464: read d8/f2e [6066343,47654] 0 2024-09-13T02:52:38.914 INFO:tasks.workunit.client.1.smithi142.stdout:1/537: dread d12/d13/d1d/d26/f2b [0,4194304] 0 2024-09-13T02:52:38.916 INFO:tasks.workunit.client.1.smithi142.stdout:1/538: fdatasync d12/d13/d20/d66/d7d/f98 0 2024-09-13T02:52:38.916 INFO:tasks.workunit.client.1.smithi142.stdout:9/549: mknod dd/d17/d44/d82/d99/cd5 0 2024-09-13T02:52:38.919 INFO:tasks.workunit.client.1.smithi142.stdout:6/479: link d1/d7/d19/d48/f9c d1/dd/d16/f9f 0 2024-09-13T02:52:38.922 INFO:tasks.workunit.client.1.smithi142.stdout:1/539: dwrite d12/d13/d1d/d26/d4f/d72/f7e [0,4194304] 0 2024-09-13T02:52:38.924 INFO:tasks.workunit.client.1.smithi142.stdout:4/430: creat d0/d2b/d2d/d31/f8b x:0 0 0 2024-09-13T02:52:38.925 INFO:tasks.workunit.client.1.smithi142.stdout:4/431: fsync d0/d2b/d21/d35/f79 0 2024-09-13T02:52:38.926 INFO:tasks.workunit.client.1.smithi142.stdout:3/442: rename d12/d16/d25/d2e/d38/d4d/f64 to d12/d16/d25/d2e/d38/d6b/f89 0 2024-09-13T02:52:38.927 INFO:tasks.workunit.client.1.smithi142.stdout:0/445: truncate fd 1774558 0 2024-09-13T02:52:38.928 INFO:tasks.workunit.client.1.smithi142.stdout:8/367: getdents d0/d6/dc/d45/d35/d61 0 2024-09-13T02:52:38.930 INFO:tasks.workunit.client.1.smithi142.stdout:2/321: fdatasync d1/de/f23 0 2024-09-13T02:52:38.933 INFO:tasks.workunit.client.1.smithi142.stdout:1/540: dwrite d12/d13/d1d/d26/d4f/fb1 [0,4194304] 0 2024-09-13T02:52:38.934 INFO:tasks.workunit.client.1.smithi142.stdout:1/541: write d12/fa4 [919034,126860] 0 2024-09-13T02:52:38.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/550: link dd/d17/f26 dd/d17/d44/d82/d99/daf/dc9/fd6 0 2024-09-13T02:52:38.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/551: readlink dd/l20 0 2024-09-13T02:52:38.935 INFO:tasks.workunit.client.1.smithi142.stdout:3/443: rmdir d12/d16/d25/d2e/d38/d4d/d53 39 2024-09-13T02:52:38.938 INFO:tasks.workunit.client.1.smithi142.stdout:0/446: write d10/d6c/d88/d45/f56 [92087,38063] 0 2024-09-13T02:52:38.939 INFO:tasks.workunit.client.1.smithi142.stdout:6/480: symlink d1/la0 0 2024-09-13T02:52:38.940 INFO:tasks.workunit.client.1.smithi142.stdout:6/481: readlink d1/d59/l9b 0 2024-09-13T02:52:38.943 INFO:tasks.workunit.client.1.smithi142.stdout:7/423: link d10/d13/d1d/d2b/d40/l48 d10/d31/l8d 0 2024-09-13T02:52:38.943 INFO:tasks.workunit.client.1.smithi142.stdout:0/447: dread d10/d6c/d88/d45/f60 [4194304,4194304] 0 2024-09-13T02:52:38.943 INFO:tasks.workunit.client.1.smithi142.stdout:1/542: dwrite d12/d13/d20/f8c [0,4194304] 0 2024-09-13T02:52:38.944 INFO:tasks.workunit.client.1.smithi142.stdout:7/424: fdatasync d10/f42 0 2024-09-13T02:52:38.945 INFO:tasks.workunit.client.1.smithi142.stdout:1/543: chown d12/d13/d1d/d26/d4f 2434877 1 2024-09-13T02:52:38.946 INFO:tasks.workunit.client.1.smithi142.stdout:2/322: creat d1/de/d1f/d13/f6b x:0 0 0 2024-09-13T02:52:38.947 INFO:tasks.workunit.client.1.smithi142.stdout:7/425: chown d10/d13/d1d/d2b/d40/f80 220 1 2024-09-13T02:52:38.950 INFO:tasks.workunit.client.1.smithi142.stdout:8/368: mkdir d0/d6/dc/d45/d35/d61/d77 0 2024-09-13T02:52:38.953 INFO:tasks.workunit.client.1.smithi142.stdout:5/465: rmdir d8/d24/d3f/d4a/d4b/d8b 0 2024-09-13T02:52:38.954 INFO:tasks.workunit.client.1.smithi142.stdout:4/432: link d0/d2b/d21/d35/f83 d0/d2b/d2d/d31/d32/d82/f8c 0 2024-09-13T02:52:38.955 INFO:tasks.workunit.client.1.smithi142.stdout:5/466: dread - d8/d24/d26/d2d/f84 zero size 2024-09-13T02:52:38.955 INFO:tasks.workunit.client.1.smithi142.stdout:6/482: rename d1/d7/d19/d30/f66 to d1/d7/d19/d48/fa1 0 2024-09-13T02:52:38.956 INFO:tasks.workunit.client.1.smithi142.stdout:0/448: mkdir d10/d6c/d88/d21/d51/d35/d9b 0 2024-09-13T02:52:38.958 INFO:tasks.workunit.client.1.smithi142.stdout:6/483: chown d1/d59/l98 12926959 1 2024-09-13T02:52:38.958 INFO:tasks.workunit.client.1.smithi142.stdout:8/369: dwrite d0/d6/dc/f72 [0,4194304] 0 2024-09-13T02:52:38.959 INFO:tasks.workunit.client.1.smithi142.stdout:2/323: mkdir d1/de/d31/d6c 0 2024-09-13T02:52:38.960 INFO:tasks.workunit.client.1.smithi142.stdout:3/444: creat d12/d16/d25/d2e/d38/d4d/d53/d78/f8a x:0 0 0 2024-09-13T02:52:38.962 INFO:tasks.workunit.client.1.smithi142.stdout:8/370: write d0/d6/dc/d45/f6a [435948,125362] 0 2024-09-13T02:52:38.965 INFO:tasks.workunit.client.1.smithi142.stdout:0/449: truncate d10/d6c/d88/d1a/d1e/d42/d4b/f74 808902 0 2024-09-13T02:52:38.967 INFO:tasks.workunit.client.1.smithi142.stdout:4/433: mknod d0/d2b/d2d/d31/d32/d82/c8d 0 2024-09-13T02:52:38.969 INFO:tasks.workunit.client.1.smithi142.stdout:7/426: creat d10/d13/d1d/d2b/f8e x:0 0 0 2024-09-13T02:52:38.970 INFO:tasks.workunit.client.1.smithi142.stdout:4/434: write d0/df/f23 [4340235,126224] 0 2024-09-13T02:52:38.971 INFO:tasks.workunit.client.1.smithi142.stdout:1/544: getdents d12/d13/d20/d66 0 2024-09-13T02:52:38.971 INFO:tasks.workunit.client.1.smithi142.stdout:7/427: fdatasync d10/d13/d22/f69 0 2024-09-13T02:52:38.974 INFO:tasks.workunit.client.1.smithi142.stdout:1/545: read fd [805460,60485] 0 2024-09-13T02:52:38.974 INFO:tasks.workunit.client.1.smithi142.stdout:2/324: dwrite d1/de/d1f/f19 [4194304,4194304] 0 2024-09-13T02:52:38.974 INFO:tasks.workunit.client.1.smithi142.stdout:8/371: dread d0/d6/dc/f72 [0,4194304] 0 2024-09-13T02:52:38.974 INFO:tasks.workunit.client.1.smithi142.stdout:7/428: stat d10/d13/d1d/d2b/d55 0 2024-09-13T02:52:38.975 INFO:tasks.workunit.client.1.smithi142.stdout:6/484: link d1/d7/d5f/f68 d1/d7/d19/d30/fa2 0 2024-09-13T02:52:38.977 INFO:tasks.workunit.client.1.smithi142.stdout:9/552: truncate fb 2522463 0 2024-09-13T02:52:38.978 INFO:tasks.workunit.client.1.smithi142.stdout:5/467: link d8/d24/d26/c4c d8/d24/d64/c92 0 2024-09-13T02:52:38.978 INFO:tasks.workunit.client.1.smithi142.stdout:9/553: chown dd/d17/d69/d84/d41/f83 7398292 1 2024-09-13T02:52:38.980 INFO:tasks.workunit.client.1.smithi142.stdout:6/485: creat d1/d59/fa3 x:0 0 0 2024-09-13T02:52:38.984 INFO:tasks.workunit.client.1.smithi142.stdout:3/445: dread fe [0,4194304] 0 2024-09-13T02:52:38.985 INFO:tasks.workunit.client.1.smithi142.stdout:3/446: dread - d12/d16/d25/d2e/f6c zero size 2024-09-13T02:52:38.986 INFO:tasks.workunit.client.1.smithi142.stdout:0/450: rename d10/d6c/d88/d30/l32 to d10/d6c/d88/d1a/l9c 0 2024-09-13T02:52:38.989 INFO:tasks.workunit.client.1.smithi142.stdout:4/435: creat d0/f8e x:0 0 0 2024-09-13T02:52:38.989 INFO:tasks.workunit.client.1.smithi142.stdout:7/429: creat d10/d13/d1d/d2b/d55/d32/d7e/f8f x:0 0 0 2024-09-13T02:52:38.989 INFO:tasks.workunit.client.1.smithi142.stdout:9/554: dread dd/f1d [0,4194304] 0 2024-09-13T02:52:38.990 INFO:tasks.workunit.client.1.smithi142.stdout:4/436: fsync d0/d2b/f67 0 2024-09-13T02:52:38.990 INFO:tasks.workunit.client.1.smithi142.stdout:7/430: dread - d10/d13/d1d/f83 zero size 2024-09-13T02:52:38.992 INFO:tasks.workunit.client.1.smithi142.stdout:2/325: rename d1/d29/d2b to d1/de/d31/d6c/d6d 0 2024-09-13T02:52:38.992 INFO:tasks.workunit.client.1.smithi142.stdout:4/437: fsync d0/d2b/d2d/d31/f60 0 2024-09-13T02:52:38.994 INFO:tasks.workunit.client.1.smithi142.stdout:4/438: fdatasync d0/d2b/d2d/d65/f2e 0 2024-09-13T02:52:38.994 INFO:tasks.workunit.client.1.smithi142.stdout:3/447: rmdir d12/d16/d25/d2e/d38/d4d/d53/d78 39 2024-09-13T02:52:38.996 INFO:tasks.workunit.client.1.smithi142.stdout:3/448: dread - d12/d16/d25/d2e/d48/d5c/f3f zero size 2024-09-13T02:52:38.996 INFO:tasks.workunit.client.1.smithi142.stdout:5/468: dwrite d8/d24/d26/d2d/d90/f6f [0,4194304] 0 2024-09-13T02:52:38.996 INFO:tasks.workunit.client.1.smithi142.stdout:5/469: stat d8/d24/f59 0 2024-09-13T02:52:38.997 INFO:tasks.workunit.client.1.smithi142.stdout:1/546: truncate d12/f65 3787691 0 2024-09-13T02:52:39.000 INFO:tasks.workunit.client.1.smithi142.stdout:6/486: truncate d1/dd/f22 1446432 0 2024-09-13T02:52:39.001 INFO:tasks.workunit.client.1.smithi142.stdout:7/431: rmdir d10/d13/d1d/d25 39 2024-09-13T02:52:39.004 INFO:tasks.workunit.client.1.smithi142.stdout:7/432: write d10/d13/f1e [185511,116050] 0 2024-09-13T02:52:39.005 INFO:tasks.workunit.client.1.smithi142.stdout:0/451: mknod d10/d6c/d88/d1a/d62/c9d 0 2024-09-13T02:52:39.005 INFO:tasks.workunit.client.1.smithi142.stdout:3/449: dwrite d12/d16/d25/d2e/d38/d5a/f87 [0,4194304] 0 2024-09-13T02:52:39.008 INFO:tasks.workunit.client.1.smithi142.stdout:2/326: dread d1/de/d1f/d13/f33 [4194304,4194304] 0 2024-09-13T02:52:39.008 INFO:tasks.workunit.client.1.smithi142.stdout:1/547: rmdir d12/d13/d1d/d26/d4f 39 2024-09-13T02:52:39.008 INFO:tasks.workunit.client.1.smithi142.stdout:5/470: write d8/d24/d26/f31 [646812,69504] 0 2024-09-13T02:52:39.012 INFO:tasks.workunit.client.1.smithi142.stdout:9/555: mknod dd/d17/d44/d95/dd1/cd7 0 2024-09-13T02:52:39.013 INFO:tasks.workunit.client.1.smithi142.stdout:6/487: creat d1/d7/d42/fa4 x:0 0 0 2024-09-13T02:52:39.014 INFO:tasks.workunit.client.1.smithi142.stdout:1/548: stat d12/d13/d20/d27/d3c/d71/d96/c99 0 2024-09-13T02:52:39.016 INFO:tasks.workunit.client.1.smithi142.stdout:9/556: chown dd/d17/d5f/d7b/db9 9178147 1 2024-09-13T02:52:39.018 INFO:tasks.workunit.client.1.smithi142.stdout:6/488: truncate d1/f25 577538 0 2024-09-13T02:52:39.019 INFO:tasks.workunit.client.1.smithi142.stdout:5/471: creat d8/d24/d26/d45/d81/d82/f93 x:0 0 0 2024-09-13T02:52:39.019 INFO:tasks.workunit.client.1.smithi142.stdout:0/452: symlink d10/d6c/d88/l9e 0 2024-09-13T02:52:39.025 INFO:tasks.workunit.client.1.smithi142.stdout:2/327: dwrite d1/f54 [0,4194304] 0 2024-09-13T02:52:39.026 INFO:tasks.workunit.client.1.smithi142.stdout:9/557: dread - dd/d17/d69/d84/d41/fcc zero size 2024-09-13T02:52:39.026 INFO:tasks.workunit.client.1.smithi142.stdout:4/439: dwrite d0/df/d57/f2f [0,4194304] 0 2024-09-13T02:52:39.030 INFO:tasks.workunit.client.1.smithi142.stdout:9/558: stat dd/d17/d4f/f67 0 2024-09-13T02:52:39.030 INFO:tasks.workunit.client.1.smithi142.stdout:4/440: chown d0/df/f1f 28723 1 2024-09-13T02:52:39.030 INFO:tasks.workunit.client.1.smithi142.stdout:3/450: dwrite d12/d16/d25/d2e/d48/d5c/d66/f5d [0,4194304] 0 2024-09-13T02:52:39.033 INFO:tasks.workunit.client.1.smithi142.stdout:2/328: read d1/d29/f30 [2765308,56664] 0 2024-09-13T02:52:39.034 INFO:tasks.workunit.client.1.smithi142.stdout:4/441: write d0/d2b/f41 [857860,105416] 0 2024-09-13T02:52:39.039 INFO:tasks.workunit.client.1.smithi142.stdout:1/549: dread d12/d13/d1d/d26/f2b [0,4194304] 0 2024-09-13T02:52:39.040 INFO:tasks.workunit.client.1.smithi142.stdout:7/433: dwrite d10/d13/d1d/d25/f75 [0,4194304] 0 2024-09-13T02:52:39.048 INFO:tasks.workunit.client.1.smithi142.stdout:3/451: dwrite d12/d16/d25/d2e/d48/f6a [0,4194304] 0 2024-09-13T02:52:39.051 INFO:tasks.workunit.client.1.smithi142.stdout:4/442: dwrite d0/d2b/d2d/d31/d43/d48/f4d [0,4194304] 0 2024-09-13T02:52:39.051 INFO:tasks.workunit.client.1.smithi142.stdout:4/443: fsync d0/d2b/d21/d30/f3a 0 2024-09-13T02:52:39.065 INFO:tasks.workunit.client.1.smithi142.stdout:9/559: dread dd/d17/d4f/f80 [0,4194304] 0 2024-09-13T02:52:39.072 INFO:tasks.workunit.client.1.smithi142.stdout:0/453: creat d10/d6c/f9f x:0 0 0 2024-09-13T02:52:39.076 INFO:tasks.workunit.client.1.smithi142.stdout:6/489: symlink d1/d7/d42/la5 0 2024-09-13T02:52:39.081 INFO:tasks.workunit.client.1.smithi142.stdout:2/329: creat d1/d2d/f6e x:0 0 0 2024-09-13T02:52:39.093 INFO:tasks.workunit.client.1.smithi142.stdout:0/454: creat d10/d6c/d88/d21/d51/d79/fa0 x:0 0 0 2024-09-13T02:52:39.094 INFO:tasks.workunit.client.1.smithi142.stdout:0/455: write d10/d6c/d88/d1a/f22 [6384718,1570] 0 2024-09-13T02:52:39.099 INFO:tasks.workunit.client.1.smithi142.stdout:7/434: mknod d10/d13/d1d/d2b/c90 0 2024-09-13T02:52:39.101 INFO:tasks.workunit.client.1.smithi142.stdout:1/550: rename d12/d1b/f52 to d12/d13/d20/d66/d55/da0/fb2 0 2024-09-13T02:52:39.105 INFO:tasks.workunit.client.1.smithi142.stdout:4/444: creat d0/d2b/d75/f8f x:0 0 0 2024-09-13T02:52:39.105 INFO:tasks.workunit.client.1.smithi142.stdout:4/445: chown d0/d2b/f67 4496 1 2024-09-13T02:52:39.105 INFO:tasks.workunit.client.1.smithi142.stdout:9/560: getdents dd/d17/d5f/d7b/db9 0 2024-09-13T02:52:39.105 INFO:tasks.workunit.client.1.smithi142.stdout:4/446: write d0/df/d57/f53 [1012481,97274] 0 2024-09-13T02:52:39.106 INFO:tasks.workunit.client.1.smithi142.stdout:0/456: creat d10/d6c/d88/d1a/d1e/d42/fa1 x:0 0 0 2024-09-13T02:52:39.107 INFO:tasks.workunit.client.1.smithi142.stdout:6/490: mkdir d1/da6 0 2024-09-13T02:52:39.107 INFO:tasks.workunit.client.1.smithi142.stdout:0/457: fdatasync d10/d6c/d88/d21/d51/d35/f55 0 2024-09-13T02:52:39.112 INFO:tasks.workunit.client.1.smithi142.stdout:9/561: symlink dd/d17/d5f/ld8 0 2024-09-13T02:52:39.113 INFO:tasks.workunit.client.1.smithi142.stdout:6/491: dwrite d1/d7/d19/f2f [0,4194304] 0 2024-09-13T02:52:39.115 INFO:tasks.workunit.client.1.smithi142.stdout:4/447: creat d0/d2b/d21/d35/f90 x:0 0 0 2024-09-13T02:52:39.115 INFO:tasks.workunit.client.1.smithi142.stdout:1/551: dread d12/f7a [0,4194304] 0 2024-09-13T02:52:39.115 INFO:tasks.workunit.client.1.smithi142.stdout:6/492: read - d1/d7/d19/d48/f9c zero size 2024-09-13T02:52:39.120 INFO:tasks.workunit.client.1.smithi142.stdout:3/452: link d12/d16/c33 d12/d16/d3c/d7d/c8b 0 2024-09-13T02:52:39.122 INFO:tasks.workunit.client.1.smithi142.stdout:9/562: chown dd/l94 44470 1 2024-09-13T02:52:39.126 INFO:tasks.workunit.client.1.smithi142.stdout:3/453: dwrite d12/d16/d25/d2e/d38/d5a/f72 [0,4194304] 0 2024-09-13T02:52:39.129 INFO:tasks.workunit.client.1.smithi142.stdout:3/454: fdatasync d12/d16/d25/d2e/d48/d5c/f3f 0 2024-09-13T02:52:39.129 INFO:tasks.workunit.client.1.smithi142.stdout:6/493: write d1/dd/d16/f4c [3982352,113320] 0 2024-09-13T02:52:39.131 INFO:tasks.workunit.client.1.smithi142.stdout:6/494: readlink d1/d59/l98 0 2024-09-13T02:52:39.134 INFO:tasks.workunit.client.1.smithi142.stdout:1/552: dwrite d12/d13/d1d/d26/d4f/fb1 [4194304,4194304] 0 2024-09-13T02:52:39.137 INFO:tasks.workunit.client.1.smithi142.stdout:9/563: chown dd/f13 6512 1 2024-09-13T02:52:39.143 INFO:tasks.workunit.client.0.smithi098.stdout:9/72: sync 2024-09-13T02:52:39.150 INFO:tasks.workunit.client.1.smithi142.stdout:9/564: creat dd/dcb/fd9 x:0 0 0 2024-09-13T02:52:39.155 INFO:tasks.workunit.client.1.smithi142.stdout:0/458: getdents d10/d6c/d88/d1a/d7a 0 2024-09-13T02:52:39.160 INFO:tasks.workunit.client.1.smithi142.stdout:5/472: unlink d8/d24/d26/l85 0 2024-09-13T02:52:39.161 INFO:tasks.workunit.client.1.smithi142.stdout:9/565: write dd/f4c [3758133,38390] 0 2024-09-13T02:52:39.163 INFO:tasks.workunit.client.1.smithi142.stdout:9/566: fsync dd/d17/d25/f29 0 2024-09-13T02:52:39.163 INFO:tasks.workunit.client.1.smithi142.stdout:5/473: read d8/d24/d26/d63/f73 [896491,74767] 0 2024-09-13T02:52:39.164 INFO:tasks.workunit.client.1.smithi142.stdout:9/567: write dd/d17/fa1 [473230,41070] 0 2024-09-13T02:52:39.164 INFO:tasks.workunit.client.1.smithi142.stdout:6/495: creat d1/d7/fa7 x:0 0 0 2024-09-13T02:52:39.166 INFO:tasks.workunit.client.1.smithi142.stdout:9/568: dread - dd/d17/d25/fb1 zero size 2024-09-13T02:52:39.166 INFO:tasks.workunit.client.1.smithi142.stdout:3/455: dread d12/d16/f6f [0,4194304] 0 2024-09-13T02:52:39.170 INFO:tasks.workunit.client.1.smithi142.stdout:5/474: chown d8/d24/d26/d2d/l48 7731 1 2024-09-13T02:52:39.172 INFO:tasks.workunit.client.1.smithi142.stdout:6/496: mkdir d1/dd/d53/d78/d8f/da8 0 2024-09-13T02:52:39.174 INFO:tasks.workunit.client.1.smithi142.stdout:9/569: creat dd/d17/d44/d82/d99/da8/fda x:0 0 0 2024-09-13T02:52:39.174 INFO:tasks.workunit.client.1.smithi142.stdout:8/372: sync 2024-09-13T02:52:39.174 INFO:tasks.workunit.client.1.smithi142.stdout:9/570: fdatasync dd/d17/f28 0 2024-09-13T02:52:39.178 INFO:tasks.workunit.client.1.smithi142.stdout:9/571: mkdir dd/d87/d8e/da3/ddb 0 2024-09-13T02:52:39.179 INFO:tasks.workunit.client.1.smithi142.stdout:6/497: truncate d1/d7/d5f/f68 249300 0 2024-09-13T02:52:39.180 INFO:tasks.workunit.client.1.smithi142.stdout:3/456: getdents d12/d16/d25 0 2024-09-13T02:52:39.182 INFO:tasks.workunit.client.1.smithi142.stdout:6/498: mknod d1/d7/d5f/ca9 0 2024-09-13T02:52:39.205 INFO:tasks.workunit.client.1.smithi142.stdout:3/457: dread - d12/d16/d25/d2e/d38/d4d/d53/d78/f85 zero size 2024-09-13T02:52:39.205 INFO:tasks.workunit.client.1.smithi142.stdout:7/435: write d10/f47 [1543603,55427] 0 2024-09-13T02:52:39.207 INFO:tasks.workunit.client.1.smithi142.stdout:5/475: dread d8/d24/d26/d2d/f2f [0,4194304] 0 2024-09-13T02:52:39.208 INFO:tasks.workunit.client.1.smithi142.stdout:6/499: fdatasync d1/d7/d5f/d6a/f7a 0 2024-09-13T02:52:39.210 INFO:tasks.workunit.client.1.smithi142.stdout:6/500: chown d1/dd/f35 225 1 2024-09-13T02:52:39.211 INFO:tasks.workunit.client.1.smithi142.stdout:2/330: dwrite d1/de/d1f/d13/f1d [0,4194304] 0 2024-09-13T02:52:39.214 INFO:tasks.workunit.client.1.smithi142.stdout:7/436: creat d10/d13/d1d/d2b/d56/d5f/d73/f91 x:0 0 0 2024-09-13T02:52:39.215 INFO:tasks.workunit.client.1.smithi142.stdout:5/476: creat d8/d24/d26/d45/d8e/f94 x:0 0 0 2024-09-13T02:52:39.216 INFO:tasks.workunit.client.1.smithi142.stdout:2/331: mkdir d1/d2c/d6f 0 2024-09-13T02:52:39.217 INFO:tasks.workunit.client.1.smithi142.stdout:7/437: readlink d10/d13/d1d/d2b/d40/l48 0 2024-09-13T02:52:39.221 INFO:tasks.workunit.client.1.smithi142.stdout:2/332: dwrite d1/f2f [0,4194304] 0 2024-09-13T02:52:39.222 INFO:tasks.workunit.client.1.smithi142.stdout:7/438: mkdir d10/d13/d1d/d25/d45/d92 0 2024-09-13T02:52:39.223 INFO:tasks.workunit.client.1.smithi142.stdout:1/553: truncate fd 1065919 0 2024-09-13T02:52:39.225 INFO:tasks.workunit.client.0.smithi098.stdout:9/73: dwrite d2/f10 [0,4194304] 0 2024-09-13T02:52:39.226 INFO:tasks.workunit.client.1.smithi142.stdout:2/333: mknod d1/de/d1f/d13/c70 0 2024-09-13T02:52:39.227 INFO:tasks.workunit.client.1.smithi142.stdout:7/439: dread d10/f42 [0,4194304] 0 2024-09-13T02:52:39.228 INFO:tasks.workunit.client.1.smithi142.stdout:0/459: dwrite d10/d6c/d88/d1a/d3a/f3b [0,4194304] 0 2024-09-13T02:52:39.233 INFO:tasks.workunit.client.1.smithi142.stdout:1/554: unlink d12/d13/d1d/d26/d4f/d72/f7e 0 2024-09-13T02:52:39.235 INFO:tasks.workunit.client.0.smithi098.stdout:9/74: symlink d2/l18 0 2024-09-13T02:52:39.236 INFO:tasks.workunit.client.1.smithi142.stdout:1/555: fsync d12/d13/d20/d27/d3c/fa2 0 2024-09-13T02:52:39.237 INFO:tasks.workunit.client.1.smithi142.stdout:3/458: dread d12/f28 [0,4194304] 0 2024-09-13T02:52:39.237 INFO:tasks.workunit.client.1.smithi142.stdout:7/440: unlink d10/d13/d1d/d2b/d56/f59 0 2024-09-13T02:52:39.238 INFO:tasks.workunit.client.0.smithi098.stdout:9/75: creat d2/d6/f19 x:0 0 0 2024-09-13T02:52:39.240 INFO:tasks.workunit.client.1.smithi142.stdout:0/460: dwrite d10/d6c/d88/d1a/d3a/f3b [4194304,4194304] 0 2024-09-13T02:52:39.242 INFO:tasks.workunit.client.1.smithi142.stdout:0/461: stat d10/d6c/d88/d1a/f6b 0 2024-09-13T02:52:39.243 INFO:tasks.workunit.client.1.smithi142.stdout:1/556: rmdir d12/d13/d1d 39 2024-09-13T02:52:39.243 INFO:tasks.workunit.client.0.smithi098.stdout:1/103: sync 2024-09-13T02:52:39.243 INFO:tasks.workunit.client.0.smithi098.stdout:5/67: sync 2024-09-13T02:52:39.243 INFO:tasks.workunit.client.0.smithi098.stdout:4/89: sync 2024-09-13T02:52:39.245 INFO:tasks.workunit.client.0.smithi098.stdout:4/90: write d6/f15 [54887,105740] 0 2024-09-13T02:52:39.247 INFO:tasks.workunit.client.0.smithi098.stdout:4/91: read d6/f8 [613668,85410] 0 2024-09-13T02:52:39.248 INFO:tasks.workunit.client.0.smithi098.stdout:5/68: creat d0/f1f x:0 0 0 2024-09-13T02:52:39.248 INFO:tasks.workunit.client.0.smithi098.stdout:4/92: stat d6/f8 0 2024-09-13T02:52:39.249 INFO:tasks.workunit.client.1.smithi142.stdout:3/459: mkdir d12/d16/d25/d2e/d48/d5c/d8c 0 2024-09-13T02:52:39.249 INFO:tasks.workunit.client.1.smithi142.stdout:5/477: dread d8/d24/f3c [0,4194304] 0 2024-09-13T02:52:39.249 INFO:tasks.workunit.client.0.smithi098.stdout:4/93: chown d6/c9 181780729 1 2024-09-13T02:52:39.249 INFO:tasks.workunit.client.0.smithi098.stdout:5/69: dread - d0/f1f zero size 2024-09-13T02:52:39.249 INFO:tasks.workunit.client.0.smithi098.stdout:4/94: readlink l4 0 2024-09-13T02:52:39.250 INFO:tasks.workunit.client.1.smithi142.stdout:2/334: rename d1/d29/l4c to d1/l71 0 2024-09-13T02:52:39.251 INFO:tasks.workunit.client.1.smithi142.stdout:2/335: write d1/de/d31/d6c/d6d/f5c [2824139,42101] 0 2024-09-13T02:52:39.252 INFO:tasks.workunit.client.0.smithi098.stdout:1/104: creat d9/d13/f22 x:0 0 0 2024-09-13T02:52:39.253 INFO:tasks.workunit.client.1.smithi142.stdout:1/557: rmdir d12/d13/d20/d27/d3c/d71/d81 39 2024-09-13T02:52:39.253 INFO:tasks.workunit.client.0.smithi098.stdout:5/70: dread d0/d1/f8 [4194304,4194304] 0 2024-09-13T02:52:39.254 INFO:tasks.workunit.client.0.smithi098.stdout:5/71: chown d0/d1/fc 214 1 2024-09-13T02:52:39.254 INFO:tasks.workunit.client.0.smithi098.stdout:9/76: link d2/dd/l13 d2/d6/l1a 0 2024-09-13T02:52:39.255 INFO:tasks.workunit.client.0.smithi098.stdout:5/72: write d0/d15/d17/f1e [330566,73843] 0 2024-09-13T02:52:39.256 INFO:tasks.workunit.client.0.smithi098.stdout:5/73: write d0/d1/f9 [1581428,81502] 0 2024-09-13T02:52:39.257 INFO:tasks.workunit.client.0.smithi098.stdout:5/74: stat d0/d15/d17/f1e 0 2024-09-13T02:52:39.260 INFO:tasks.workunit.client.0.smithi098.stdout:9/77: mkdir d2/dd/d1b 0 2024-09-13T02:52:39.262 INFO:tasks.workunit.client.1.smithi142.stdout:2/336: unlink d1/d2d/l32 0 2024-09-13T02:52:39.268 INFO:tasks.workunit.client.0.smithi098.stdout:9/78: dwrite d2/dd/f17 [0,4194304] 0 2024-09-13T02:52:39.269 INFO:tasks.workunit.client.0.smithi098.stdout:5/75: chown d0/ld 34 1 2024-09-13T02:52:39.273 INFO:tasks.workunit.client.0.smithi098.stdout:4/95: rename d6/c19 to d6/d10/c1a 0 2024-09-13T02:52:39.273 INFO:tasks.workunit.client.0.smithi098.stdout:4/96: dread - d6/db/fc zero size 2024-09-13T02:52:39.274 INFO:tasks.workunit.client.0.smithi098.stdout:4/97: chown d6/db/fc 173705394 1 2024-09-13T02:52:39.276 INFO:tasks.workunit.client.0.smithi098.stdout:1/105: mkdir d9/d13/d1f/d23 0 2024-09-13T02:52:39.277 INFO:tasks.workunit.client.0.smithi098.stdout:1/106: dread - d9/d13/d19/f21 zero size 2024-09-13T02:52:39.279 INFO:tasks.workunit.client.1.smithi142.stdout:7/441: rename d10/d34/d57/l86 to d10/d13/d22/l93 0 2024-09-13T02:52:39.279 INFO:tasks.workunit.client.1.smithi142.stdout:7/442: stat d10/d13/c15 0 2024-09-13T02:52:39.279 INFO:tasks.workunit.client.1.smithi142.stdout:2/337: dread d1/f5 [0,4194304] 0 2024-09-13T02:52:39.282 INFO:tasks.workunit.client.0.smithi098.stdout:4/98: dwrite d6/db/f12 [4194304,4194304] 0 2024-09-13T02:52:39.284 INFO:tasks.workunit.client.0.smithi098.stdout:4/99: truncate d6/db/fc 574229 0 2024-09-13T02:52:39.284 INFO:tasks.workunit.client.1.smithi142.stdout:5/478: creat d8/d24/d3f/f95 x:0 0 0 2024-09-13T02:52:39.285 INFO:tasks.workunit.client.0.smithi098.stdout:4/100: write d6/f15 [76732,54641] 0 2024-09-13T02:52:39.285 INFO:tasks.workunit.client.1.smithi142.stdout:5/479: dread - d8/d24/d3f/d4a/f7a zero size 2024-09-13T02:52:39.286 INFO:tasks.workunit.client.1.smithi142.stdout:5/480: chown d8/d24 18 1 2024-09-13T02:52:39.290 INFO:tasks.workunit.client.1.smithi142.stdout:4/448: sync 2024-09-13T02:52:39.293 INFO:tasks.workunit.client.0.smithi098.stdout:9/79: link d2/f10 d2/d6/f1c 0 2024-09-13T02:52:39.294 INFO:tasks.workunit.client.0.smithi098.stdout:5/76: dwrite d0/d1/f11 [4194304,4194304] 0 2024-09-13T02:52:39.297 INFO:tasks.workunit.client.1.smithi142.stdout:5/481: mknod d8/d24/d26/d45/d62/c96 0 2024-09-13T02:52:39.299 INFO:tasks.workunit.client.0.smithi098.stdout:4/101: symlink d6/db/l1b 0 2024-09-13T02:52:39.301 INFO:tasks.workunit.client.0.smithi098.stdout:1/107: creat d9/d13/d1f/d23/f24 x:0 0 0 2024-09-13T02:52:39.301 INFO:tasks.workunit.client.0.smithi098.stdout:4/102: dread d6/db/fc [0,4194304] 0 2024-09-13T02:52:39.301 INFO:tasks.workunit.client.0.smithi098.stdout:1/108: stat d9/c1e 0 2024-09-13T02:52:39.302 INFO:tasks.workunit.client.0.smithi098.stdout:1/109: fsync d9/f10 0 2024-09-13T02:52:39.302 INFO:tasks.workunit.client.1.smithi142.stdout:0/462: truncate d10/d6c/d88/d1a/f6b 1530276 0 2024-09-13T02:52:39.302 INFO:tasks.workunit.client.0.smithi098.stdout:1/110: fsync d9/f10 0 2024-09-13T02:52:39.304 INFO:tasks.workunit.client.1.smithi142.stdout:1/558: getdents d12/d13/d20/d66/d55 0 2024-09-13T02:52:39.309 INFO:tasks.workunit.client.0.smithi098.stdout:9/80: creat d2/d6/f1d x:0 0 0 2024-09-13T02:52:39.309 INFO:tasks.workunit.client.0.smithi098.stdout:4/103: dwrite d6/d10/f11 [0,4194304] 0 2024-09-13T02:52:39.309 INFO:tasks.workunit.client.0.smithi098.stdout:5/77: unlink d0/d10/l13 0 2024-09-13T02:52:39.310 INFO:tasks.workunit.client.0.smithi098.stdout:4/104: dread d6/db/fc [0,4194304] 0 2024-09-13T02:52:39.316 INFO:tasks.workunit.client.0.smithi098.stdout:1/111: creat d9/f25 x:0 0 0 2024-09-13T02:52:39.319 INFO:tasks.workunit.client.0.smithi098.stdout:9/81: rmdir d2 39 2024-09-13T02:52:39.321 INFO:tasks.workunit.client.0.smithi098.stdout:5/78: symlink d0/d15/d17/l20 0 2024-09-13T02:52:39.323 INFO:tasks.workunit.client.1.smithi142.stdout:7/443: creat d10/d13/d1d/f94 x:0 0 0 2024-09-13T02:52:39.324 INFO:tasks.workunit.client.1.smithi142.stdout:0/463: dwrite d10/d6c/d88/d21/d51/f92 [0,4194304] 0 2024-09-13T02:52:39.324 INFO:tasks.workunit.client.1.smithi142.stdout:5/482: read d8/d47/f4f [115479,121821] 0 2024-09-13T02:52:39.325 INFO:tasks.workunit.client.0.smithi098.stdout:5/79: write d0/d15/d17/d1c/f1d [473061,61179] 0 2024-09-13T02:52:39.325 INFO:tasks.workunit.client.1.smithi142.stdout:2/338: getdents d1/de/d1f/d13/d59 0 2024-09-13T02:52:39.327 INFO:tasks.workunit.client.1.smithi142.stdout:5/483: read d8/d24/d26/d61/f7e [3389362,22050] 0 2024-09-13T02:52:39.327 INFO:tasks.workunit.client.1.smithi142.stdout:1/559: rmdir d12/d13/d20/d27/d3c/d71/d81/d92 39 2024-09-13T02:52:39.330 INFO:tasks.workunit.client.0.smithi098.stdout:9/82: creat d2/dd/f1e x:0 0 0 2024-09-13T02:52:39.331 INFO:tasks.workunit.client.1.smithi142.stdout:2/339: mkdir d1/d29/d72 0 2024-09-13T02:52:39.331 INFO:tasks.workunit.client.1.smithi142.stdout:7/444: dwrite d10/d34/d65/f6e [0,4194304] 0 2024-09-13T02:52:39.333 INFO:tasks.workunit.client.0.smithi098.stdout:4/105: rename d6/d10/f11 to d6/f1c 0 2024-09-13T02:52:39.337 INFO:tasks.workunit.client.0.smithi098.stdout:5/80: unlink d0/d1/f8 0 2024-09-13T02:52:39.337 INFO:tasks.workunit.client.1.smithi142.stdout:2/340: dread d1/de/f26 [0,4194304] 0 2024-09-13T02:52:39.340 INFO:tasks.workunit.client.0.smithi098.stdout:9/83: chown d2/dd/l13 28864 1 2024-09-13T02:52:39.341 INFO:tasks.workunit.client.0.smithi098.stdout:5/81: dread d0/d1/fc [0,4194304] 0 2024-09-13T02:52:39.342 INFO:tasks.workunit.client.0.smithi098.stdout:5/82: stat d0/d15/d17/d1c 0 2024-09-13T02:52:39.345 INFO:tasks.workunit.client.1.smithi142.stdout:5/484: symlink d8/d24/d26/d45/d81/d82/l97 0 2024-09-13T02:52:39.347 INFO:tasks.workunit.client.0.smithi098.stdout:1/112: truncate f8 5280447 0 2024-09-13T02:52:39.349 INFO:tasks.workunit.client.0.smithi098.stdout:5/83: dwrite d0/d1/f9 [4194304,4194304] 0 2024-09-13T02:52:39.349 INFO:tasks.workunit.client.0.smithi098.stdout:1/113: fsync d9/d13/d1f/d23/f24 0 2024-09-13T02:52:39.351 INFO:tasks.workunit.client.0.smithi098.stdout:5/84: chown d0/d15/d17/l20 3 1 2024-09-13T02:52:39.353 INFO:tasks.workunit.client.1.smithi142.stdout:5/485: dread d8/d24/d26/d2d/f7d [0,4194304] 0 2024-09-13T02:52:39.353 INFO:tasks.workunit.client.0.smithi098.stdout:9/84: unlink d2/d6/l1a 0 2024-09-13T02:52:39.353 INFO:tasks.workunit.client.1.smithi142.stdout:5/486: chown d8/d24/l36 558119952 1 2024-09-13T02:52:39.354 INFO:tasks.workunit.client.1.smithi142.stdout:5/487: chown d8/d24/d26/d2d 12842489 1 2024-09-13T02:52:39.355 INFO:tasks.workunit.client.1.smithi142.stdout:8/373: sync 2024-09-13T02:52:39.355 INFO:tasks.workunit.client.1.smithi142.stdout:9/572: sync 2024-09-13T02:52:39.355 INFO:tasks.workunit.client.1.smithi142.stdout:7/445: creat d10/d13/d1d/d2b/d55/d32/f95 x:0 0 0 2024-09-13T02:52:39.360 INFO:tasks.workunit.client.0.smithi098.stdout:4/106: symlink d6/l1d 0 2024-09-13T02:52:39.361 INFO:tasks.workunit.client.1.smithi142.stdout:2/341: write d1/d2d/f64 [966397,89425] 0 2024-09-13T02:52:39.365 INFO:tasks.workunit.client.0.smithi098.stdout:5/85: dread d0/d1/f9 [0,4194304] 0 2024-09-13T02:52:39.365 INFO:tasks.workunit.client.1.smithi142.stdout:1/560: write d12/d13/d1d/d26/f2b [669542,45110] 0 2024-09-13T02:52:39.366 INFO:tasks.workunit.client.1.smithi142.stdout:1/561: write d12/d13/f6b [1009524,32558] 0 2024-09-13T02:52:39.367 INFO:tasks.workunit.client.0.smithi098.stdout:0/78: sync 2024-09-13T02:52:39.367 INFO:tasks.workunit.client.0.smithi098.stdout:2/93: sync 2024-09-13T02:52:39.369 INFO:tasks.workunit.client.0.smithi098.stdout:9/85: creat d2/dd/f1f x:0 0 0 2024-09-13T02:52:39.369 INFO:tasks.workunit.client.0.smithi098.stdout:9/86: dread - d2/d6/f1d zero size 2024-09-13T02:52:39.372 INFO:tasks.workunit.client.1.smithi142.stdout:9/573: rmdir dd/d17/d69 39 2024-09-13T02:52:39.374 INFO:tasks.workunit.client.1.smithi142.stdout:8/374: creat d0/d6/d23/d2b/f78 x:0 0 0 2024-09-13T02:52:39.375 INFO:tasks.workunit.client.1.smithi142.stdout:8/375: write d0/d6/dc/d45/d8/f29 [2044856,109690] 0 2024-09-13T02:52:39.376 INFO:tasks.workunit.client.1.smithi142.stdout:8/376: stat d0/d6/l25 0 2024-09-13T02:52:39.376 INFO:tasks.workunit.client.1.smithi142.stdout:7/446: symlink d10/d13/d21/l96 0 2024-09-13T02:52:39.378 INFO:tasks.workunit.client.1.smithi142.stdout:7/447: write d10/d13/d1d/d2b/d55/f3c [5104241,55543] 0 2024-09-13T02:52:39.378 INFO:tasks.workunit.client.1.smithi142.stdout:2/342: mknod d1/d2d/c73 0 2024-09-13T02:52:39.378 INFO:tasks.workunit.client.0.smithi098.stdout:5/86: dread d0/d1/fc [0,4194304] 0 2024-09-13T02:52:39.379 INFO:tasks.workunit.client.1.smithi142.stdout:2/343: dread - d1/de/f56 zero size 2024-09-13T02:52:39.379 INFO:tasks.workunit.client.0.smithi098.stdout:0/79: unlink dd/l13 0 2024-09-13T02:52:39.382 INFO:tasks.workunit.client.0.smithi098.stdout:2/94: mknod d1/d4/d9/c17 0 2024-09-13T02:52:39.382 INFO:tasks.workunit.client.1.smithi142.stdout:6/501: sync 2024-09-13T02:52:39.382 INFO:tasks.workunit.client.1.smithi142.stdout:4/449: sync 2024-09-13T02:52:39.382 INFO:tasks.workunit.client.1.smithi142.stdout:3/460: sync 2024-09-13T02:52:39.384 INFO:tasks.workunit.client.0.smithi098.stdout:4/107: symlink d6/l1e 0 2024-09-13T02:52:39.384 INFO:tasks.workunit.client.1.smithi142.stdout:4/450: read d0/df/d57/f11 [6250552,81304] 0 2024-09-13T02:52:39.384 INFO:tasks.workunit.client.0.smithi098.stdout:4/108: fsync d6/f15 0 2024-09-13T02:52:39.385 INFO:tasks.workunit.client.0.smithi098.stdout:0/80: dwrite fa [0,4194304] 0 2024-09-13T02:52:39.385 INFO:tasks.workunit.client.1.smithi142.stdout:4/451: stat d0/d2b/d2d/d31/d43/d48/c4b 0 2024-09-13T02:52:39.387 INFO:tasks.workunit.client.1.smithi142.stdout:4/452: truncate d0/d2b/d2d/d65/f5e 228654 0 2024-09-13T02:52:39.388 INFO:tasks.workunit.client.1.smithi142.stdout:9/574: rmdir dd/d17/d5f/d7b/db8 39 2024-09-13T02:52:39.389 INFO:tasks.workunit.client.1.smithi142.stdout:5/488: dwrite d8/d24/d3f/d4a/d4b/f56 [0,4194304] 0 2024-09-13T02:52:39.389 INFO:tasks.workunit.client.1.smithi142.stdout:5/489: fsync d8/d24/d26/f8a 0 2024-09-13T02:52:39.390 INFO:tasks.workunit.client.1.smithi142.stdout:5/490: dread - d8/d24/d26/d45/d62/f6c zero size 2024-09-13T02:52:39.391 INFO:tasks.workunit.client.0.smithi098.stdout:5/87: unlink d0/ld 0 2024-09-13T02:52:39.391 INFO:tasks.workunit.client.1.smithi142.stdout:5/491: chown d8/d24/d3f/d4a/d4b/l5a 6 1 2024-09-13T02:52:39.392 INFO:tasks.workunit.client.1.smithi142.stdout:8/377: mknod d0/d6/dc/d45/d8/df/d28/c79 0 2024-09-13T02:52:39.393 INFO:tasks.workunit.client.1.smithi142.stdout:8/378: fdatasync d0/d6/dc/d45/d8/df/d28/f2d 0 2024-09-13T02:52:39.397 INFO:tasks.workunit.client.1.smithi142.stdout:7/448: creat d10/d34/f97 x:0 0 0 2024-09-13T02:52:39.399 INFO:tasks.workunit.client.0.smithi098.stdout:7/268: sync 2024-09-13T02:52:39.399 INFO:tasks.workunit.client.0.smithi098.stdout:3/59: sync 2024-09-13T02:52:39.399 INFO:tasks.workunit.client.0.smithi098.stdout:6/76: sync 2024-09-13T02:52:39.399 INFO:tasks.workunit.client.0.smithi098.stdout:8/112: sync 2024-09-13T02:52:39.400 INFO:tasks.workunit.client.0.smithi098.stdout:6/77: fsync d5/f9 0 2024-09-13T02:52:39.400 INFO:tasks.workunit.client.1.smithi142.stdout:0/464: link d10/d6c/d88/l9e d10/la2 0 2024-09-13T02:52:39.401 INFO:tasks.workunit.client.1.smithi142.stdout:0/465: dread - d10/d6c/d88/d21/d51/d35/f76 zero size 2024-09-13T02:52:39.401 INFO:tasks.workunit.client.0.smithi098.stdout:8/113: chown d2/dd/d11/d1d/l1e 515890927 1 2024-09-13T02:52:39.402 INFO:tasks.workunit.client.1.smithi142.stdout:0/466: dread - d10/d6c/d88/d1a/d3a/f5c zero size 2024-09-13T02:52:39.404 INFO:tasks.workunit.client.0.smithi098.stdout:8/114: chown d2/dd/d11/d1d 7 1 2024-09-13T02:52:39.404 INFO:tasks.workunit.client.0.smithi098.stdout:4/109: creat d6/d10/f1f x:0 0 0 2024-09-13T02:52:39.404 INFO:tasks.workunit.client.0.smithi098.stdout:4/110: chown d6/d10/f13 440904713 1 2024-09-13T02:52:39.404 INFO:tasks.workunit.client.1.smithi142.stdout:0/467: write d10/d6c/d88/f6e [1059921,33829] 0 2024-09-13T02:52:39.405 INFO:tasks.workunit.client.0.smithi098.stdout:0/81: creat dd/df/f17 x:0 0 0 2024-09-13T02:52:39.405 INFO:tasks.workunit.client.0.smithi098.stdout:6/78: dread d5/fc [0,4194304] 0 2024-09-13T02:52:39.406 INFO:tasks.workunit.client.0.smithi098.stdout:6/79: write d5/f9 [705350,42374] 0 2024-09-13T02:52:39.407 INFO:tasks.workunit.client.1.smithi142.stdout:6/502: symlink d1/dd/d16/d4d/laa 0 2024-09-13T02:52:39.407 INFO:tasks.workunit.client.0.smithi098.stdout:6/80: write f4 [463917,29503] 0 2024-09-13T02:52:39.408 INFO:tasks.workunit.client.1.smithi142.stdout:6/503: chown d1/dd/d16/f3c 3 1 2024-09-13T02:52:39.408 INFO:tasks.workunit.client.1.smithi142.stdout:0/468: dwrite d10/d6c/d88/f46 [0,4194304] 0 2024-09-13T02:52:39.408 INFO:tasks.workunit.client.0.smithi098.stdout:9/87: link d2/d6/f1d d2/dd/f20 0 2024-09-13T02:52:39.409 INFO:tasks.workunit.client.0.smithi098.stdout:9/88: read - d2/d6/f19 zero size 2024-09-13T02:52:39.410 INFO:tasks.workunit.client.0.smithi098.stdout:1/114: link d9/cc d9/d13/d1f/d23/c26 0 2024-09-13T02:52:39.410 INFO:tasks.workunit.client.0.smithi098.stdout:1/115: dread - d9/d13/d19/f21 zero size 2024-09-13T02:52:39.411 INFO:tasks.workunit.client.1.smithi142.stdout:1/562: mknod d12/d13/d1d/cb3 0 2024-09-13T02:52:39.415 INFO:tasks.workunit.client.0.smithi098.stdout:7/269: readlink l2 0 2024-09-13T02:52:39.416 INFO:tasks.workunit.client.1.smithi142.stdout:9/575: write dd/d17/d69/f89 [776325,108434] 0 2024-09-13T02:52:39.417 INFO:tasks.workunit.client.0.smithi098.stdout:1/116: dread d9/f10 [4194304,4194304] 0 2024-09-13T02:52:39.417 INFO:tasks.workunit.client.1.smithi142.stdout:5/492: mknod d8/d24/d3f/d4a/d4b/c98 0 2024-09-13T02:52:39.419 INFO:tasks.workunit.client.0.smithi098.stdout:3/60: rename d7/fe to d7/f14 0 2024-09-13T02:52:39.422 INFO:tasks.workunit.client.1.smithi142.stdout:8/379: write d0/d6/f2a [142307,15702] 0 2024-09-13T02:52:39.422 INFO:tasks.workunit.client.0.smithi098.stdout:8/115: creat d2/dd/f21 x:0 0 0 2024-09-13T02:52:39.423 INFO:tasks.workunit.client.1.smithi142.stdout:7/449: truncate d10/d31/f4e 940787 0 2024-09-13T02:52:39.427 INFO:tasks.workunit.client.0.smithi098.stdout:3/61: dwrite d7/d9/fa [0,4194304] 0 2024-09-13T02:52:39.430 INFO:tasks.workunit.client.1.smithi142.stdout:6/504: dread d1/d7/d5f/d6a/f99 [0,4194304] 0 2024-09-13T02:52:39.434 INFO:tasks.workunit.client.0.smithi098.stdout:8/116: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:52:39.434 INFO:tasks.workunit.client.0.smithi098.stdout:4/111: dwrite d6/f1c [0,4194304] 0 2024-09-13T02:52:39.435 INFO:tasks.workunit.client.1.smithi142.stdout:4/453: dread d0/d2b/d21/f2a [0,4194304] 0 2024-09-13T02:52:39.437 INFO:tasks.workunit.client.0.smithi098.stdout:2/95: getdents d1 0 2024-09-13T02:52:39.440 INFO:tasks.workunit.client.0.smithi098.stdout:7/270: unlink d6/c1b 0 2024-09-13T02:52:39.441 INFO:tasks.workunit.client.0.smithi098.stdout:7/271: stat d6/d1e/f23 0 2024-09-13T02:52:39.442 INFO:tasks.workunit.client.0.smithi098.stdout:7/272: chown d6/d49 425617607 1 2024-09-13T02:52:39.442 INFO:tasks.workunit.client.1.smithi142.stdout:1/563: chown l9 1 1 2024-09-13T02:52:39.443 INFO:tasks.workunit.client.1.smithi142.stdout:2/344: sync 2024-09-13T02:52:39.444 INFO:tasks.workunit.client.1.smithi142.stdout:2/345: dread - d1/de/d1f/f63 zero size 2024-09-13T02:52:39.444 INFO:tasks.workunit.client.1.smithi142.stdout:6/505: dread d1/dd/f35 [0,4194304] 0 2024-09-13T02:52:39.445 INFO:tasks.workunit.client.1.smithi142.stdout:9/576: rename dd/d17/d68/c71 to dd/d87/cdc 0 2024-09-13T02:52:39.449 INFO:tasks.workunit.client.1.smithi142.stdout:8/380: symlink d0/d6/d23/d2b/l7a 0 2024-09-13T02:52:39.451 INFO:tasks.workunit.client.1.smithi142.stdout:7/450: fdatasync d10/d13/d1d/f36 0 2024-09-13T02:52:39.452 INFO:tasks.workunit.client.1.smithi142.stdout:7/451: chown d10/d31/l61 9 1 2024-09-13T02:52:39.454 INFO:tasks.workunit.client.1.smithi142.stdout:3/461: truncate d12/d16/f29 4071493 0 2024-09-13T02:52:39.458 INFO:tasks.workunit.client.1.smithi142.stdout:4/454: creat d0/d2b/d75/f91 x:0 0 0 2024-09-13T02:52:39.458 INFO:tasks.workunit.client.0.smithi098.stdout:6/81: symlink d5/de/d14/l19 0 2024-09-13T02:52:39.461 INFO:tasks.workunit.client.1.smithi142.stdout:0/469: rename d10/d6c/d88/d1a/d1e/d42/l8b to d10/d6c/d88/d1a/d1e/d42/la3 0 2024-09-13T02:52:39.462 INFO:tasks.workunit.client.1.smithi142.stdout:3/462: dwrite d12/d16/d25/d2e/f4c [0,4194304] 0 2024-09-13T02:52:39.465 INFO:tasks.workunit.client.0.smithi098.stdout:9/89: dwrite d2/f10 [0,4194304] 0 2024-09-13T02:52:39.468 INFO:tasks.workunit.client.0.smithi098.stdout:6/82: dwrite f3 [0,4194304] 0 2024-09-13T02:52:39.473 INFO:tasks.workunit.client.0.smithi098.stdout:5/88: link d0/cb d0/d1/c21 0 2024-09-13T02:52:39.474 INFO:tasks.workunit.client.0.smithi098.stdout:4/112: mkdir d6/d10/d20 0 2024-09-13T02:52:39.475 INFO:tasks.workunit.client.1.smithi142.stdout:9/577: fdatasync dd/d17/f26 0 2024-09-13T02:52:39.479 INFO:tasks.workunit.client.0.smithi098.stdout:8/117: mknod d2/dd/d11/c22 0 2024-09-13T02:52:39.480 INFO:tasks.workunit.client.0.smithi098.stdout:7/273: rmdir d6/d24 39 2024-09-13T02:52:39.484 INFO:tasks.workunit.client.1.smithi142.stdout:7/452: mkdir d10/d34/d57/d98 0 2024-09-13T02:52:39.487 INFO:tasks.workunit.client.0.smithi098.stdout:3/62: write f6 [1061743,9223] 0 2024-09-13T02:52:39.488 INFO:tasks.workunit.client.0.smithi098.stdout:0/82: dwrite f8 [0,4194304] 0 2024-09-13T02:52:39.489 INFO:tasks.workunit.client.1.smithi142.stdout:7/453: read d10/d13/d1d/d2b/d55/f3c [2719587,118648] 0 2024-09-13T02:52:39.491 INFO:tasks.workunit.client.1.smithi142.stdout:7/454: write d10/d13/d1d/d2b/d55/f67 [2333288,26381] 0 2024-09-13T02:52:39.494 INFO:tasks.workunit.client.1.smithi142.stdout:0/470: creat d10/d6c/d88/d21/d51/fa4 x:0 0 0 2024-09-13T02:52:39.496 INFO:tasks.workunit.client.1.smithi142.stdout:3/463: creat d12/d16/d3c/f8d x:0 0 0 2024-09-13T02:52:39.498 INFO:tasks.workunit.client.1.smithi142.stdout:1/564: fsync d12/d13/d20/d27/f4b 0 2024-09-13T02:52:39.499 INFO:tasks.workunit.client.1.smithi142.stdout:2/346: mknod d1/d42/c74 0 2024-09-13T02:52:39.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/118: write d2/f9 [2387857,105047] 0 2024-09-13T02:52:39.502 INFO:tasks.workunit.client.0.smithi098.stdout:7/274: readlink d6/d1e/l33 0 2024-09-13T02:52:39.504 INFO:tasks.workunit.client.0.smithi098.stdout:1/117: truncate d9/d12/f18 1211672 0 2024-09-13T02:52:39.505 INFO:tasks.workunit.client.1.smithi142.stdout:0/471: dwrite d10/d6c/d88/d21/d51/d35/f76 [0,4194304] 0 2024-09-13T02:52:39.506 INFO:tasks.workunit.client.1.smithi142.stdout:5/493: link d8/d24/d26/d61/f71 d8/d24/d64/d68/f99 0 2024-09-13T02:52:39.514 INFO:tasks.workunit.client.0.smithi098.stdout:3/63: mkdir d7/d9/d15 0 2024-09-13T02:52:39.515 INFO:tasks.workunit.client.0.smithi098.stdout:3/64: chown f1 1 1 2024-09-13T02:52:39.516 INFO:tasks.workunit.client.1.smithi142.stdout:3/464: dread d12/f13 [0,4194304] 0 2024-09-13T02:52:39.516 INFO:tasks.workunit.client.0.smithi098.stdout:3/65: dread - d7/fc zero size 2024-09-13T02:52:39.517 INFO:tasks.workunit.client.0.smithi098.stdout:3/66: stat d7/d9/lb 0 2024-09-13T02:52:39.518 INFO:tasks.workunit.client.0.smithi098.stdout:9/90: write d2/d6/f1d [285069,84420] 0 2024-09-13T02:52:39.521 INFO:tasks.workunit.client.0.smithi098.stdout:3/67: dread f6 [0,4194304] 0 2024-09-13T02:52:39.522 INFO:tasks.workunit.client.1.smithi142.stdout:4/455: dwrite d0/d2b/f74 [0,4194304] 0 2024-09-13T02:52:39.523 INFO:tasks.workunit.client.1.smithi142.stdout:4/456: write d0/d2b/d2d/d31/d43/f5a [3751909,19409] 0 2024-09-13T02:52:39.523 INFO:tasks.workunit.client.1.smithi142.stdout:7/455: mkdir d10/d13/d1d/d25/d45/d99 0 2024-09-13T02:52:39.524 INFO:tasks.workunit.client.0.smithi098.stdout:2/96: truncate d1/d4/f7 1102231 0 2024-09-13T02:52:39.525 INFO:tasks.workunit.client.1.smithi142.stdout:7/456: chown d10/d13/d1d/f5d 238514 1 2024-09-13T02:52:39.531 INFO:tasks.workunit.client.0.smithi098.stdout:7/275: truncate d6/d14/f2b 4909407 0 2024-09-13T02:52:39.533 INFO:tasks.workunit.client.1.smithi142.stdout:6/506: dwrite d1/dd/f22 [0,4194304] 0 2024-09-13T02:52:39.533 INFO:tasks.workunit.client.0.smithi098.stdout:1/118: creat d9/d13/d19/f27 x:0 0 0 2024-09-13T02:52:39.534 INFO:tasks.workunit.client.1.smithi142.stdout:7/457: dread d10/d13/d1d/d25/f75 [0,4194304] 0 2024-09-13T02:52:39.537 INFO:tasks.workunit.client.0.smithi098.stdout:0/83: write fc [4078031,81724] 0 2024-09-13T02:52:39.537 INFO:tasks.workunit.client.1.smithi142.stdout:8/381: dwrite d0/d6/dc/d45/f65 [0,4194304] 0 2024-09-13T02:52:39.542 INFO:tasks.workunit.client.1.smithi142.stdout:2/347: symlink d1/de/d31/d6c/d6d/l75 0 2024-09-13T02:52:39.544 INFO:tasks.workunit.client.1.smithi142.stdout:2/348: write d1/de/d1f/d13/f4a [1011335,103649] 0 2024-09-13T02:52:39.547 INFO:tasks.workunit.client.1.smithi142.stdout:9/578: rmdir dd/d17/d5f/d7b/db8 39 2024-09-13T02:52:39.549 INFO:tasks.workunit.client.1.smithi142.stdout:9/579: write dd/d17/d25/fac [238105,37921] 0 2024-09-13T02:52:39.554 INFO:tasks.workunit.client.0.smithi098.stdout:5/89: rmdir d0/d10 0 2024-09-13T02:52:39.562 INFO:tasks.workunit.client.1.smithi142.stdout:5/494: rename d8/lf to d8/d24/d26/d63/l9a 0 2024-09-13T02:52:39.563 INFO:tasks.workunit.client.1.smithi142.stdout:5/495: chown d8/d24/d26/l3b 0 1 2024-09-13T02:52:39.567 INFO:tasks.workunit.client.1.smithi142.stdout:5/496: dwrite d8/d24/d3f/d4a/f86 [0,4194304] 0 2024-09-13T02:52:39.574 INFO:tasks.workunit.client.0.smithi098.stdout:6/83: link d5/d13/c17 d5/d13/c1a 0 2024-09-13T02:52:39.577 INFO:tasks.workunit.client.0.smithi098.stdout:9/91: mkdir d2/dd/d1b/d21 0 2024-09-13T02:52:39.578 INFO:tasks.workunit.client.0.smithi098.stdout:9/92: read d2/d6/f1c [1501283,57666] 0 2024-09-13T02:52:39.579 INFO:tasks.workunit.client.0.smithi098.stdout:3/68: symlink d7/d9/d15/l16 0 2024-09-13T02:52:39.581 INFO:tasks.workunit.client.0.smithi098.stdout:5/90: creat d0/d15/f22 x:0 0 0 2024-09-13T02:52:39.585 INFO:tasks.workunit.client.0.smithi098.stdout:4/113: getdents d6 0 2024-09-13T02:52:39.586 INFO:tasks.workunit.client.0.smithi098.stdout:4/114: fdatasync d6/f15 0 2024-09-13T02:52:39.587 INFO:tasks.workunit.client.0.smithi098.stdout:2/97: creat d1/d4/d9/d15/f18 x:0 0 0 2024-09-13T02:52:39.595 INFO:tasks.workunit.client.0.smithi098.stdout:1/119: truncate f8 5428087 0 2024-09-13T02:52:39.596 INFO:tasks.workunit.client.0.smithi098.stdout:1/120: dread - d9/d13/d19/f27 zero size 2024-09-13T02:52:39.596 INFO:tasks.workunit.client.0.smithi098.stdout:1/121: readlink d9/l1b 0 2024-09-13T02:52:39.597 INFO:tasks.workunit.client.1.smithi142.stdout:1/565: unlink d12/d13/d20/d27/d3c/d71/d81/d92/lb0 0 2024-09-13T02:52:39.599 INFO:tasks.workunit.client.1.smithi142.stdout:0/472: mkdir d10/d6c/d88/d21/d51/d35/d9b/da5 0 2024-09-13T02:52:39.603 INFO:tasks.workunit.client.1.smithi142.stdout:3/465: link d12/d16/f6f d12/d16/d25/d2e/d38/d6b/f8e 0 2024-09-13T02:52:39.603 INFO:tasks.workunit.client.0.smithi098.stdout:7/276: truncate d6/f15 734433 0 2024-09-13T02:52:39.604 INFO:tasks.workunit.client.1.smithi142.stdout:2/349: dwrite d1/de/f23 [0,4194304] 0 2024-09-13T02:52:39.608 INFO:tasks.workunit.client.0.smithi098.stdout:5/91: symlink d0/d15/d17/l23 0 2024-09-13T02:52:39.610 INFO:tasks.workunit.client.0.smithi098.stdout:4/115: mkdir d6/d10/d21 0 2024-09-13T02:52:39.611 INFO:tasks.workunit.client.1.smithi142.stdout:6/507: sync 2024-09-13T02:52:39.612 INFO:tasks.workunit.client.0.smithi098.stdout:6/84: dwrite d5/fc [0,4194304] 0 2024-09-13T02:52:39.614 INFO:tasks.workunit.client.0.smithi098.stdout:2/98: rename d1/d4/d9/c17 to d1/d4/c19 0 2024-09-13T02:52:39.615 INFO:tasks.workunit.client.0.smithi098.stdout:8/119: getdents d2/dd/d11 0 2024-09-13T02:52:39.620 INFO:tasks.workunit.client.1.smithi142.stdout:1/566: mkdir d12/d13/d20/d66/d55/db4 0 2024-09-13T02:52:39.621 INFO:tasks.workunit.client.1.smithi142.stdout:0/473: fsync d10/d6c/d88/d21/d51/f54 0 2024-09-13T02:52:39.622 INFO:tasks.workunit.client.1.smithi142.stdout:0/474: stat d10/d6c/d88/d21/f91 0 2024-09-13T02:52:39.624 INFO:tasks.workunit.client.1.smithi142.stdout:7/458: rename f8 to d10/d13/d1d/d44/f9a 0 2024-09-13T02:52:39.624 INFO:tasks.workunit.client.1.smithi142.stdout:0/475: dread - d10/d6c/f9f zero size 2024-09-13T02:52:39.626 INFO:tasks.workunit.client.1.smithi142.stdout:5/497: symlink d8/d24/d26/d45/d81/d8c/d8d/l9b 0 2024-09-13T02:52:39.627 INFO:tasks.workunit.client.1.smithi142.stdout:8/382: dwrite d0/d6/dc/d45/d8/f12 [0,4194304] 0 2024-09-13T02:52:39.628 INFO:tasks.workunit.client.1.smithi142.stdout:9/580: write dd/f1b [4570850,122163] 0 2024-09-13T02:52:39.629 INFO:tasks.workunit.client.1.smithi142.stdout:5/498: read d8/d24/f59 [3708583,22020] 0 2024-09-13T02:52:39.630 INFO:tasks.workunit.client.1.smithi142.stdout:4/457: link d0/d2b/d21/d35/f83 d0/d2b/d2d/d31/d32/d82/f92 0 2024-09-13T02:52:39.633 INFO:tasks.workunit.client.1.smithi142.stdout:0/476: dwrite d10/d6c/d88/d1a/d1e/d42/f48 [0,4194304] 0 2024-09-13T02:52:39.634 INFO:tasks.workunit.client.1.smithi142.stdout:1/567: creat d12/d13/d20/d27/d3c/d71/d96/fb5 x:0 0 0 2024-09-13T02:52:39.638 INFO:tasks.workunit.client.1.smithi142.stdout:3/466: mkdir d12/d16/d25/d2e/d48/d5c/d73/d8f 0 2024-09-13T02:52:39.639 INFO:tasks.workunit.client.1.smithi142.stdout:5/499: dwrite d8/d24/f3e [0,4194304] 0 2024-09-13T02:52:39.639 INFO:tasks.workunit.client.1.smithi142.stdout:8/383: creat d0/d6/dc/d40/d46/f7b x:0 0 0 2024-09-13T02:52:39.641 INFO:tasks.workunit.client.1.smithi142.stdout:9/581: creat dd/d17/d69/d84/fdd x:0 0 0 2024-09-13T02:52:39.645 INFO:tasks.workunit.client.1.smithi142.stdout:8/384: dread d0/d6/dc/d45/d8/f12 [0,4194304] 0 2024-09-13T02:52:39.648 INFO:tasks.workunit.client.1.smithi142.stdout:1/568: creat d12/d13/d20/d66/d7d/fb6 x:0 0 0 2024-09-13T02:52:39.649 INFO:tasks.workunit.client.1.smithi142.stdout:1/569: chown d12/d13/d20/d66/d55/f47 5 1 2024-09-13T02:52:39.650 INFO:tasks.workunit.client.1.smithi142.stdout:1/570: rename d12 to d12/d13/d20/d66/db7 22 2024-09-13T02:52:39.651 INFO:tasks.workunit.client.1.smithi142.stdout:6/508: write d1/d7/d19/f45 [1071290,34555] 0 2024-09-13T02:52:39.651 INFO:tasks.workunit.client.1.smithi142.stdout:1/571: fdatasync d12/d13/d20/d66/d55/da0/f56 0 2024-09-13T02:52:39.652 INFO:tasks.workunit.client.1.smithi142.stdout:5/500: creat d8/d24/d3f/d4a/f9c x:0 0 0 2024-09-13T02:52:39.654 INFO:tasks.workunit.client.1.smithi142.stdout:4/458: symlink d0/d2b/d2d/d65/d87/l93 0 2024-09-13T02:52:39.655 INFO:tasks.workunit.client.0.smithi098.stdout:1/122: creat d9/d13/d19/f28 x:0 0 0 2024-09-13T02:52:39.655 INFO:tasks.workunit.client.0.smithi098.stdout:9/93: mknod d2/c22 0 2024-09-13T02:52:39.657 INFO:tasks.workunit.client.0.smithi098.stdout:4/116: mkdir d6/d22 0 2024-09-13T02:52:39.657 INFO:tasks.workunit.client.1.smithi142.stdout:9/582: chown dd/d17/d69/d84/d41/f90 0 1 2024-09-13T02:52:39.657 INFO:tasks.workunit.client.0.smithi098.stdout:2/99: dread d1/d4/d9/fe [0,4194304] 0 2024-09-13T02:52:39.658 INFO:tasks.workunit.client.0.smithi098.stdout:1/123: write d9/d13/f22 [578416,81854] 0 2024-09-13T02:52:39.659 INFO:tasks.workunit.client.0.smithi098.stdout:2/100: read - d1/d4/d9/d15/f18 zero size 2024-09-13T02:52:39.659 INFO:tasks.workunit.client.0.smithi098.stdout:8/120: rename d2/dd/d11/d1d/f20 to d2/f23 0 2024-09-13T02:52:39.661 INFO:tasks.workunit.client.0.smithi098.stdout:0/84: getdents dd 0 2024-09-13T02:52:39.661 INFO:tasks.workunit.client.0.smithi098.stdout:8/121: truncate d2/f1b 805104 0 2024-09-13T02:52:39.661 INFO:tasks.workunit.client.1.smithi142.stdout:1/572: dwrite fe [0,4194304] 0 2024-09-13T02:52:39.662 INFO:tasks.workunit.client.1.smithi142.stdout:5/501: dwrite d8/d47/d65/f80 [0,4194304] 0 2024-09-13T02:52:39.666 INFO:tasks.workunit.client.1.smithi142.stdout:2/350: truncate d1/f1e 225919 0 2024-09-13T02:52:39.667 INFO:tasks.workunit.client.1.smithi142.stdout:6/509: mknod d1/d7/d19/d48/cab 0 2024-09-13T02:52:39.672 INFO:tasks.workunit.client.1.smithi142.stdout:7/459: getdents d10/d13/d1d/d2b/d55/d32 0 2024-09-13T02:52:39.672 INFO:tasks.workunit.client.1.smithi142.stdout:7/460: stat d10/f42 0 2024-09-13T02:52:39.674 INFO:tasks.workunit.client.0.smithi098.stdout:1/124: mkdir d9/d13/d29 0 2024-09-13T02:52:39.676 INFO:tasks.workunit.client.0.smithi098.stdout:2/101: read d1/d4/f7 [588334,29937] 0 2024-09-13T02:52:39.677 INFO:tasks.workunit.client.1.smithi142.stdout:0/477: truncate d10/d6c/d88/d45/f57 484508 0 2024-09-13T02:52:39.677 INFO:tasks.workunit.client.1.smithi142.stdout:1/573: rmdir d12/d13/d20 39 2024-09-13T02:52:39.677 INFO:tasks.workunit.client.1.smithi142.stdout:3/467: dwrite d12/d16/d25/d2e/d38/f6d [0,4194304] 0 2024-09-13T02:52:39.679 INFO:tasks.workunit.client.0.smithi098.stdout:3/69: getdents d7/d9 0 2024-09-13T02:52:39.679 INFO:tasks.workunit.client.0.smithi098.stdout:3/70: write d7/fc [817105,52181] 0 2024-09-13T02:52:39.680 INFO:tasks.workunit.client.0.smithi098.stdout:3/71: chown d7/d9 471 1 2024-09-13T02:52:39.680 INFO:tasks.workunit.client.1.smithi142.stdout:5/502: mknod d8/d24/d26/d45/c9d 0 2024-09-13T02:52:39.681 INFO:tasks.workunit.client.0.smithi098.stdout:3/72: chown d7/d9/d15 377 1 2024-09-13T02:52:39.681 INFO:tasks.workunit.client.1.smithi142.stdout:7/461: dwrite d10/d13/d1d/f5d [0,4194304] 0 2024-09-13T02:52:39.682 INFO:tasks.workunit.client.0.smithi098.stdout:5/92: truncate d0/d1/f11 3587820 0 2024-09-13T02:52:39.683 INFO:tasks.workunit.client.1.smithi142.stdout:7/462: write d10/d13/f1e [589767,68538] 0 2024-09-13T02:52:39.684 INFO:tasks.workunit.client.1.smithi142.stdout:6/510: symlink d1/d7/d19/d30/lac 0 2024-09-13T02:52:39.686 INFO:tasks.workunit.client.0.smithi098.stdout:8/122: creat d2/dd/d11/d1d/f24 x:0 0 0 2024-09-13T02:52:39.688 INFO:tasks.workunit.client.1.smithi142.stdout:4/459: mknod d0/d7e/c94 0 2024-09-13T02:52:39.689 INFO:tasks.workunit.client.0.smithi098.stdout:3/73: dread f1 [0,4194304] 0 2024-09-13T02:52:39.689 INFO:tasks.workunit.client.1.smithi142.stdout:4/460: readlink d0/d2b/la 0 2024-09-13T02:52:39.691 INFO:tasks.workunit.client.0.smithi098.stdout:4/117: truncate d6/f18 678649 0 2024-09-13T02:52:39.692 INFO:tasks.workunit.client.0.smithi098.stdout:6/85: creat d5/f1b x:0 0 0 2024-09-13T02:52:39.693 INFO:tasks.workunit.client.0.smithi098.stdout:5/93: dwrite d0/d15/d17/d1c/f1d [0,4194304] 0 2024-09-13T02:52:39.693 INFO:tasks.workunit.client.0.smithi098.stdout:6/86: readlink d5/d13/l16 0 2024-09-13T02:52:39.694 INFO:tasks.workunit.client.0.smithi098.stdout:6/87: fdatasync d5/f1b 0 2024-09-13T02:52:39.697 INFO:tasks.workunit.client.1.smithi142.stdout:4/461: dwrite d0/df/f5d [0,4194304] 0 2024-09-13T02:52:39.697 INFO:tasks.workunit.client.0.smithi098.stdout:1/125: mknod d9/d13/d1f/d23/c2a 0 2024-09-13T02:52:39.700 INFO:tasks.workunit.client.0.smithi098.stdout:2/102: rmdir d1 39 2024-09-13T02:52:39.710 INFO:tasks.workunit.client.1.smithi142.stdout:6/511: mkdir d1/dd/d16/d47/dad 0 2024-09-13T02:52:39.711 INFO:tasks.workunit.client.1.smithi142.stdout:9/583: truncate dd/d17/d4f/d91/f93 3990217 0 2024-09-13T02:52:39.711 INFO:tasks.workunit.client.0.smithi098.stdout:8/123: creat d2/dd/f25 x:0 0 0 2024-09-13T02:52:39.712 INFO:tasks.workunit.client.0.smithi098.stdout:3/74: fdatasync d7/f14 0 2024-09-13T02:52:39.717 INFO:tasks.workunit.client.1.smithi142.stdout:1/574: creat d12/d13/d20/d66/d7d/fb8 x:0 0 0 2024-09-13T02:52:39.717 INFO:tasks.workunit.client.0.smithi098.stdout:0/85: truncate f8 77523 0 2024-09-13T02:52:39.717 INFO:tasks.workunit.client.0.smithi098.stdout:0/86: chown dd/l12 116 1 2024-09-13T02:52:39.718 INFO:tasks.workunit.client.0.smithi098.stdout:9/94: rmdir d2/dd/d1b/d21 0 2024-09-13T02:52:39.718 INFO:tasks.workunit.client.0.smithi098.stdout:9/95: fsync d2/d6/f1d 0 2024-09-13T02:52:39.718 INFO:tasks.workunit.client.0.smithi098.stdout:6/88: creat d5/d13/f1c x:0 0 0 2024-09-13T02:52:39.719 INFO:tasks.workunit.client.1.smithi142.stdout:5/503: symlink d8/d24/d3f/l9e 0 2024-09-13T02:52:39.719 INFO:tasks.workunit.client.0.smithi098.stdout:1/126: creat d9/d13/f2b x:0 0 0 2024-09-13T02:52:39.720 INFO:tasks.workunit.client.1.smithi142.stdout:7/463: creat d10/d13/d1d/d25/d5c/f9b x:0 0 0 2024-09-13T02:52:39.721 INFO:tasks.workunit.client.1.smithi142.stdout:7/464: write d10/f42 [2379209,37960] 0 2024-09-13T02:52:39.726 INFO:tasks.workunit.client.1.smithi142.stdout:6/512: dwrite d1/d7/d5f/d6a/f95 [0,4194304] 0 2024-09-13T02:52:39.727 INFO:tasks.workunit.client.1.smithi142.stdout:1/575: creat d12/d13/d20/d27/d3c/fb9 x:0 0 0 2024-09-13T02:52:39.728 INFO:tasks.workunit.client.0.smithi098.stdout:8/124: mknod d2/dd/d11/d1d/c26 0 2024-09-13T02:52:39.729 INFO:tasks.workunit.client.0.smithi098.stdout:3/75: mkdir d7/d9/d15/d17 0 2024-09-13T02:52:39.730 INFO:tasks.workunit.client.0.smithi098.stdout:5/94: creat d0/d1/d1a/f24 x:0 0 0 2024-09-13T02:52:39.731 INFO:tasks.workunit.client.0.smithi098.stdout:5/95: chown d0/ce 3 1 2024-09-13T02:52:39.732 INFO:tasks.workunit.client.0.smithi098.stdout:0/87: creat dd/df/f18 x:0 0 0 2024-09-13T02:52:39.732 INFO:tasks.workunit.client.0.smithi098.stdout:6/89: dwrite d5/f1b [0,4194304] 0 2024-09-13T02:52:39.732 INFO:tasks.workunit.client.0.smithi098.stdout:8/125: dread d2/f1b [0,4194304] 0 2024-09-13T02:52:39.733 INFO:tasks.workunit.client.1.smithi142.stdout:7/465: mkdir d10/d13/d1d/d2b/d55/d32/d7e/d9c 0 2024-09-13T02:52:39.733 INFO:tasks.workunit.client.0.smithi098.stdout:6/90: truncate f4 4810118 0 2024-09-13T02:52:39.735 INFO:tasks.workunit.client.0.smithi098.stdout:9/96: symlink d2/d6/l23 0 2024-09-13T02:52:39.735 INFO:tasks.workunit.client.1.smithi142.stdout:4/462: link d0/d2b/d21/d30/l51 d0/d2b/d2d/l95 0 2024-09-13T02:52:39.736 INFO:tasks.workunit.client.1.smithi142.stdout:3/468: dwrite d12/f22 [0,4194304] 0 2024-09-13T02:52:39.736 INFO:tasks.workunit.client.0.smithi098.stdout:1/127: mkdir d9/d13/d19/d2c 0 2024-09-13T02:52:39.738 INFO:tasks.workunit.client.1.smithi142.stdout:6/513: creat d1/dd/d16/d47/fae x:0 0 0 2024-09-13T02:52:39.739 INFO:tasks.workunit.client.1.smithi142.stdout:1/576: dwrite d12/d13/f6b [0,4194304] 0 2024-09-13T02:52:39.741 INFO:tasks.workunit.client.0.smithi098.stdout:9/97: dread d2/d6/f1d [0,4194304] 0 2024-09-13T02:52:39.741 INFO:tasks.workunit.client.0.smithi098.stdout:4/118: creat d6/f23 x:0 0 0 2024-09-13T02:52:39.742 INFO:tasks.workunit.client.0.smithi098.stdout:4/119: readlink l2 0 2024-09-13T02:52:39.742 INFO:tasks.workunit.client.0.smithi098.stdout:9/98: chown d2/c22 578 1 2024-09-13T02:52:39.742 INFO:tasks.workunit.client.1.smithi142.stdout:5/504: write f0 [2612530,75140] 0 2024-09-13T02:52:39.744 INFO:tasks.workunit.client.1.smithi142.stdout:8/385: sync 2024-09-13T02:52:39.745 INFO:tasks.workunit.client.0.smithi098.stdout:3/76: mknod d7/c18 0 2024-09-13T02:52:39.748 INFO:tasks.workunit.client.1.smithi142.stdout:7/466: rename d10/d13/d21/l96 to d10/d13/d1d/d2b/d55/d32/d7e/d9c/l9d 0 2024-09-13T02:52:39.752 INFO:tasks.workunit.client.1.smithi142.stdout:4/463: mknod d0/d2b/d2d/d65/d87/c96 0 2024-09-13T02:52:39.753 INFO:tasks.workunit.client.1.smithi142.stdout:4/464: dread - d0/f8e zero size 2024-09-13T02:52:39.754 INFO:tasks.workunit.client.1.smithi142.stdout:4/465: chown d0/d2b/d2d/l7f 0 1 2024-09-13T02:52:39.754 INFO:tasks.workunit.client.0.smithi098.stdout:0/88: mkdir dd/df/d19 0 2024-09-13T02:52:39.755 INFO:tasks.workunit.client.1.smithi142.stdout:6/514: creat d1/dd/d53/faf x:0 0 0 2024-09-13T02:52:39.759 INFO:tasks.workunit.client.1.smithi142.stdout:9/584: getdents dd/d17/d44/d82/d99/daf 0 2024-09-13T02:52:39.761 INFO:tasks.workunit.client.0.smithi098.stdout:5/96: read d0/d1/f11 [883536,75489] 0 2024-09-13T02:52:39.761 INFO:tasks.workunit.client.0.smithi098.stdout:1/128: symlink d9/d13/d1f/l2d 0 2024-09-13T02:52:39.762 INFO:tasks.workunit.client.0.smithi098.stdout:1/129: dread - d9/d13/f2b zero size 2024-09-13T02:52:39.762 INFO:tasks.workunit.client.1.smithi142.stdout:3/469: mknod d12/c90 0 2024-09-13T02:52:39.763 INFO:tasks.workunit.client.0.smithi098.stdout:1/130: dread - d9/f1c zero size 2024-09-13T02:52:39.763 INFO:tasks.workunit.client.1.smithi142.stdout:4/466: dwrite d0/df/d57/f88 [0,4194304] 0 2024-09-13T02:52:39.764 INFO:tasks.workunit.client.0.smithi098.stdout:1/131: write d9/d13/d19/f21 [256243,29554] 0 2024-09-13T02:52:39.764 INFO:tasks.workunit.client.0.smithi098.stdout:1/132: readlink d9/l1b 0 2024-09-13T02:52:39.764 INFO:tasks.workunit.client.1.smithi142.stdout:8/386: symlink d0/d6/dc/d45/l7c 0 2024-09-13T02:52:39.766 INFO:tasks.workunit.client.1.smithi142.stdout:8/387: fdatasync d0/d6/dc/d45/f65 0 2024-09-13T02:52:39.768 INFO:tasks.workunit.client.1.smithi142.stdout:5/505: dwrite d8/f15 [0,4194304] 0 2024-09-13T02:52:39.770 INFO:tasks.workunit.client.1.smithi142.stdout:2/351: sync 2024-09-13T02:52:39.770 INFO:tasks.workunit.client.1.smithi142.stdout:7/467: symlink d10/d13/d1d/d2b/d56/d5f/l9e 0 2024-09-13T02:52:39.771 INFO:tasks.workunit.client.1.smithi142.stdout:7/468: readlink d10/d13/d1d/d2b/l2f 0 2024-09-13T02:52:39.772 INFO:tasks.workunit.client.1.smithi142.stdout:6/515: rename d1/dd/le to d1/d7/d5f/d60/d76/lb0 0 2024-09-13T02:52:39.773 INFO:tasks.workunit.client.0.smithi098.stdout:2/103: write d1/d4/f7 [607004,71267] 0 2024-09-13T02:52:39.773 INFO:tasks.workunit.client.0.smithi098.stdout:3/77: mknod d7/d9/d15/c19 0 2024-09-13T02:52:39.773 INFO:tasks.workunit.client.1.smithi142.stdout:6/516: write d1/d7/d19/f93 [508454,40456] 0 2024-09-13T02:52:39.774 INFO:tasks.workunit.client.0.smithi098.stdout:3/78: write d7/fc [795117,109648] 0 2024-09-13T02:52:39.775 INFO:tasks.workunit.client.1.smithi142.stdout:6/517: read d1/dd/f29 [444279,17464] 0 2024-09-13T02:52:39.777 INFO:tasks.workunit.client.0.smithi098.stdout:3/79: chown d7/l11 3382 1 2024-09-13T02:52:39.780 INFO:tasks.workunit.client.0.smithi098.stdout:6/91: symlink d5/l1d 0 2024-09-13T02:52:39.781 INFO:tasks.workunit.client.1.smithi142.stdout:3/470: write d12/d16/d25/f40 [8534781,120242] 0 2024-09-13T02:52:39.782 INFO:tasks.workunit.client.0.smithi098.stdout:2/104: dwrite d1/d4/f12 [0,4194304] 0 2024-09-13T02:52:39.784 INFO:tasks.workunit.client.0.smithi098.stdout:5/97: mknod d0/d1/c25 0 2024-09-13T02:52:39.786 INFO:tasks.workunit.client.1.smithi142.stdout:4/467: symlink d0/d2b/d2d/d31/d32/l97 0 2024-09-13T02:52:39.786 INFO:tasks.workunit.client.0.smithi098.stdout:6/92: dread f3 [0,4194304] 0 2024-09-13T02:52:39.787 INFO:tasks.workunit.client.0.smithi098.stdout:1/133: creat d9/d13/d19/f2e x:0 0 0 2024-09-13T02:52:39.788 INFO:tasks.workunit.client.0.smithi098.stdout:1/134: chown d9/d13/f17 1511 1 2024-09-13T02:52:39.790 INFO:tasks.workunit.client.0.smithi098.stdout:8/126: write d2/dd/f17 [4672522,67282] 0 2024-09-13T02:52:39.791 INFO:tasks.workunit.client.0.smithi098.stdout:4/120: mknod d6/d10/c24 0 2024-09-13T02:52:39.792 INFO:tasks.workunit.client.1.smithi142.stdout:8/388: symlink d0/d6/dc/d40/d4d/d62/l7d 0 2024-09-13T02:52:39.796 INFO:tasks.workunit.client.0.smithi098.stdout:1/135: dwrite d9/d13/f22 [0,4194304] 0 2024-09-13T02:52:39.798 INFO:tasks.workunit.client.0.smithi098.stdout:0/89: creat dd/df/d19/f1a x:0 0 0 2024-09-13T02:52:39.799 INFO:tasks.workunit.client.0.smithi098.stdout:0/90: dread - dd/df/f17 zero size 2024-09-13T02:52:39.800 INFO:tasks.workunit.client.0.smithi098.stdout:3/80: write f1 [3893885,53448] 0 2024-09-13T02:52:39.800 INFO:tasks.workunit.client.0.smithi098.stdout:0/91: truncate dd/f16 988 0 2024-09-13T02:52:39.805 INFO:tasks.workunit.client.0.smithi098.stdout:2/105: fdatasync d1/f8 0 2024-09-13T02:52:39.808 INFO:tasks.workunit.client.0.smithi098.stdout:5/98: creat d0/d15/d17/f26 x:0 0 0 2024-09-13T02:52:39.810 INFO:tasks.workunit.client.0.smithi098.stdout:6/93: rmdir d5/de/d14 39 2024-09-13T02:52:39.810 INFO:tasks.workunit.client.0.smithi098.stdout:6/94: fdatasync d5/f15 0 2024-09-13T02:52:39.814 INFO:tasks.workunit.client.0.smithi098.stdout:4/121: rmdir d6 39 2024-09-13T02:52:39.816 INFO:tasks.workunit.client.0.smithi098.stdout:9/99: rename d2/c22 to d2/c24 0 2024-09-13T02:52:39.818 INFO:tasks.workunit.client.0.smithi098.stdout:1/136: mkdir d9/d12/d2f 0 2024-09-13T02:52:39.819 INFO:tasks.workunit.client.0.smithi098.stdout:3/81: symlink d7/d9/d15/l1a 0 2024-09-13T02:52:39.822 INFO:tasks.workunit.client.0.smithi098.stdout:2/106: fdatasync d1/f8 0 2024-09-13T02:52:39.823 INFO:tasks.workunit.client.0.smithi098.stdout:2/107: chown d1/d4/d9 11 1 2024-09-13T02:52:39.824 INFO:tasks.workunit.client.0.smithi098.stdout:5/99: mkdir d0/d1/d1a/d27 0 2024-09-13T02:52:39.827 INFO:tasks.workunit.client.0.smithi098.stdout:9/100: chown d2/d6/cb 50730600 1 2024-09-13T02:52:39.828 INFO:tasks.workunit.client.0.smithi098.stdout:9/101: truncate d2/dd/f20 392075 0 2024-09-13T02:52:39.829 INFO:tasks.workunit.client.0.smithi098.stdout:1/137: mkdir d9/d13/d1f/d23/d30 0 2024-09-13T02:52:39.831 INFO:tasks.workunit.client.1.smithi142.stdout:5/506: creat d8/d24/d26/d61/f9f x:0 0 0 2024-09-13T02:52:39.832 INFO:tasks.workunit.client.1.smithi142.stdout:2/352: mknod d1/de/d31/d6c/d6d/c76 0 2024-09-13T02:52:39.832 INFO:tasks.workunit.client.1.smithi142.stdout:6/518: symlink d1/d4a/lb1 0 2024-09-13T02:52:39.832 INFO:tasks.workunit.client.1.smithi142.stdout:1/577: write d12/d13/d1d/f61 [2386854,31231] 0 2024-09-13T02:52:39.833 INFO:tasks.workunit.client.1.smithi142.stdout:9/585: mknod dd/d17/d25/d3e/cde 0 2024-09-13T02:52:39.833 INFO:tasks.workunit.client.1.smithi142.stdout:5/507: stat d8/d24 0 2024-09-13T02:52:39.834 INFO:tasks.workunit.client.1.smithi142.stdout:4/468: mknod d0/d2b/d2d/d65/d87/c98 0 2024-09-13T02:52:39.834 INFO:tasks.workunit.client.0.smithi098.stdout:2/108: rename d1/d4 to d1/d1a 0 2024-09-13T02:52:39.835 INFO:tasks.workunit.client.1.smithi142.stdout:5/508: dread - d8/d24/d26/f8a zero size 2024-09-13T02:52:39.835 INFO:tasks.workunit.client.1.smithi142.stdout:8/389: mkdir d0/d6/dc/d45/d35/d7e 0 2024-09-13T02:52:39.835 INFO:tasks.workunit.client.0.smithi098.stdout:2/109: fsync d1/d1a/f12 0 2024-09-13T02:52:39.836 INFO:tasks.workunit.client.1.smithi142.stdout:4/469: truncate d0/f8e 433536 0 2024-09-13T02:52:39.837 INFO:tasks.workunit.client.1.smithi142.stdout:8/390: write d0/d6/dc/d45/f6a [694539,123866] 0 2024-09-13T02:52:39.838 INFO:tasks.workunit.client.0.smithi098.stdout:5/100: rename d0/d1/d1a/f24 to d0/d15/d17/f28 0 2024-09-13T02:52:39.839 INFO:tasks.workunit.client.1.smithi142.stdout:8/391: write d0/d6/dc/f18 [1733129,70877] 0 2024-09-13T02:52:39.840 INFO:tasks.workunit.client.1.smithi142.stdout:2/353: truncate d1/f35 931604 0 2024-09-13T02:52:39.841 INFO:tasks.workunit.client.0.smithi098.stdout:8/127: truncate d2/fe 3717325 0 2024-09-13T02:52:39.841 INFO:tasks.workunit.client.1.smithi142.stdout:8/392: truncate d0/f69 736285 0 2024-09-13T02:52:39.843 INFO:tasks.workunit.client.1.smithi142.stdout:5/509: dwrite d8/d24/d26/d45/f54 [0,4194304] 0 2024-09-13T02:52:39.843 INFO:tasks.workunit.client.0.smithi098.stdout:5/101: dread d0/d1/fc [0,4194304] 0 2024-09-13T02:52:39.843 INFO:tasks.workunit.client.0.smithi098.stdout:3/82: symlink d7/d9/d15/d17/l1b 0 2024-09-13T02:52:39.844 INFO:tasks.workunit.client.0.smithi098.stdout:3/83: stat d7/d9/d15/l16 0 2024-09-13T02:52:39.845 INFO:tasks.workunit.client.0.smithi098.stdout:3/84: write d7/d9/fa [2303134,115308] 0 2024-09-13T02:52:39.847 INFO:tasks.workunit.client.1.smithi142.stdout:1/578: unlink d12/d13/d20/d27/fa5 0 2024-09-13T02:52:39.849 INFO:tasks.workunit.client.1.smithi142.stdout:9/586: mkdir dd/d17/d44/d95/dd1/ddf 0 2024-09-13T02:52:39.851 INFO:tasks.workunit.client.0.smithi098.stdout:0/92: link dd/ce dd/c1b 0 2024-09-13T02:52:39.851 INFO:tasks.workunit.client.0.smithi098.stdout:0/93: readlink l9 0 2024-09-13T02:52:39.856 INFO:tasks.workunit.client.0.smithi098.stdout:6/95: creat d5/f1e x:0 0 0 2024-09-13T02:52:39.856 INFO:tasks.workunit.client.1.smithi142.stdout:9/587: dwrite dd/d17/d4f/f7a [0,4194304] 0 2024-09-13T02:52:39.860 INFO:tasks.workunit.client.1.smithi142.stdout:6/519: dwrite d1/d7/f24 [0,4194304] 0 2024-09-13T02:52:39.864 INFO:tasks.workunit.client.1.smithi142.stdout:3/471: dread d12/d16/f29 [0,4194304] 0 2024-09-13T02:52:39.865 INFO:tasks.workunit.client.1.smithi142.stdout:3/472: stat d12/d16/d25/l27 0 2024-09-13T02:52:39.866 INFO:tasks.workunit.client.1.smithi142.stdout:3/473: truncate d12/d16/d3c/f8d 819426 0 2024-09-13T02:52:39.866 INFO:tasks.workunit.client.1.smithi142.stdout:3/474: chown d12/d16/d25/d2e/d48 1040078776 1 2024-09-13T02:52:39.870 INFO:tasks.workunit.client.1.smithi142.stdout:3/475: dread d12/f22 [0,4194304] 0 2024-09-13T02:52:39.880 INFO:tasks.workunit.client.1.smithi142.stdout:0/478: sync 2024-09-13T02:52:39.881 INFO:tasks.workunit.client.1.smithi142.stdout:0/479: readlink d10/d6c/d88/d1a/d1e/l4e 0 2024-09-13T02:52:39.881 INFO:tasks.workunit.client.1.smithi142.stdout:0/480: read d10/d6c/d88/d1a/f66 [302838,71267] 0 2024-09-13T02:52:39.882 INFO:tasks.workunit.client.1.smithi142.stdout:0/481: dread - d10/d6c/d88/d21/d51/fa4 zero size 2024-09-13T02:52:39.913 INFO:tasks.workunit.client.1.smithi142.stdout:7/469: sync 2024-09-13T02:52:39.914 INFO:tasks.workunit.client.1.smithi142.stdout:7/470: write d10/d13/d1d/f5d [507496,5487] 0 2024-09-13T02:52:39.914 INFO:tasks.workunit.client.1.smithi142.stdout:7/471: write d10/f42 [783590,48161] 0 2024-09-13T02:52:39.915 INFO:tasks.workunit.client.1.smithi142.stdout:7/472: readlink d10/d13/d1d/d2b/d56/l7f 0 2024-09-13T02:52:39.940 INFO:tasks.workunit.client.0.smithi098.stdout:2/110: mknod d1/d1a/d9/d15/c1b 0 2024-09-13T02:52:39.944 INFO:tasks.workunit.client.1.smithi142.stdout:5/510: mkdir d8/d47/d65/da0 0 2024-09-13T02:52:39.945 INFO:tasks.workunit.client.1.smithi142.stdout:5/511: truncate d8/d24/d3f/d4a/f7a 307199 0 2024-09-13T02:52:39.945 INFO:tasks.workunit.client.0.smithi098.stdout:2/111: dwrite d1/d1a/f12 [0,4194304] 0 2024-09-13T02:52:39.949 INFO:tasks.workunit.client.0.smithi098.stdout:8/128: rmdir d2/dd/d11/d1d 39 2024-09-13T02:52:39.952 INFO:tasks.workunit.client.0.smithi098.stdout:5/102: mkdir d0/d29 0 2024-09-13T02:52:39.956 INFO:tasks.workunit.client.0.smithi098.stdout:9/102: truncate d2/dd/f20 243802 0 2024-09-13T02:52:39.957 INFO:tasks.workunit.client.1.smithi142.stdout:8/393: dwrite d0/d6/dc/d2e/f57 [0,4194304] 0 2024-09-13T02:52:39.958 INFO:tasks.workunit.client.0.smithi098.stdout:3/85: creat d7/d9/d15/f1c x:0 0 0 2024-09-13T02:52:39.958 INFO:tasks.workunit.client.1.smithi142.stdout:2/354: mknod d1/de/d1f/d13/d60/c77 0 2024-09-13T02:52:39.960 INFO:tasks.workunit.client.0.smithi098.stdout:5/103: dwrite d0/ff [0,4194304] 0 2024-09-13T02:52:39.961 INFO:tasks.workunit.client.1.smithi142.stdout:9/588: symlink dd/d17/d5f/le0 0 2024-09-13T02:52:39.966 INFO:tasks.workunit.client.0.smithi098.stdout:3/86: dread d7/fc [0,4194304] 0 2024-09-13T02:52:39.974 INFO:tasks.workunit.client.0.smithi098.stdout:4/122: rename d6/f15 to d6/d10/d21/f25 0 2024-09-13T02:52:39.975 INFO:tasks.workunit.client.1.smithi142.stdout:8/394: dread d0/d6/dc/d45/d35/d37/f54 [0,4194304] 0 2024-09-13T02:52:39.976 INFO:tasks.workunit.client.0.smithi098.stdout:2/112: mkdir d1/d1c 0 2024-09-13T02:52:39.978 INFO:tasks.workunit.client.0.smithi098.stdout:8/129: creat d2/f27 x:0 0 0 2024-09-13T02:52:39.979 INFO:tasks.workunit.client.1.smithi142.stdout:0/482: write d10/d6c/d88/d1a/d3a/f3b [1967390,75009] 0 2024-09-13T02:52:39.980 INFO:tasks.workunit.client.1.smithi142.stdout:0/483: write d10/d6c/d88/d1a/d1e/d42/fa1 [643811,6029] 0 2024-09-13T02:52:39.984 INFO:tasks.workunit.client.1.smithi142.stdout:0/484: dread d10/d6c/d88/f46 [0,4194304] 0 2024-09-13T02:52:39.988 INFO:tasks.workunit.client.1.smithi142.stdout:4/470: creat d0/f99 x:0 0 0 2024-09-13T02:52:39.990 INFO:tasks.workunit.client.0.smithi098.stdout:3/87: creat d7/f1d x:0 0 0 2024-09-13T02:52:39.990 INFO:tasks.workunit.client.0.smithi098.stdout:0/94: write dd/f16 [985392,103405] 0 2024-09-13T02:52:39.993 INFO:tasks.workunit.client.0.smithi098.stdout:3/88: chown d7/d9/fa 3 1 2024-09-13T02:52:39.994 INFO:tasks.workunit.client.0.smithi098.stdout:6/96: link d5/de/f11 d5/d18/f1f 0 2024-09-13T02:52:39.995 INFO:tasks.workunit.client.0.smithi098.stdout:6/97: dread - d5/f1e zero size 2024-09-13T02:52:39.995 INFO:tasks.workunit.client.1.smithi142.stdout:2/355: dread d1/de/d1f/d13/f4a [0,4194304] 0 2024-09-13T02:52:39.996 INFO:tasks.workunit.client.1.smithi142.stdout:2/356: fdatasync d1/de/d31/d6c/d6d/d47/f68 0 2024-09-13T02:52:39.997 INFO:tasks.workunit.client.0.smithi098.stdout:6/98: dread - d5/d13/f1c zero size 2024-09-13T02:52:39.997 INFO:tasks.workunit.client.0.smithi098.stdout:5/104: dwrite d0/d1/f9 [4194304,4194304] 0 2024-09-13T02:52:39.997 INFO:tasks.workunit.client.1.smithi142.stdout:2/357: write d1/f2f [4769821,111707] 0 2024-09-13T02:52:39.998 INFO:tasks.workunit.client.0.smithi098.stdout:6/99: chown d5/f1e 5058957 1 2024-09-13T02:52:39.999 INFO:tasks.workunit.client.0.smithi098.stdout:6/100: chown d5/fc 182501816 1 2024-09-13T02:52:40.000 INFO:tasks.workunit.client.1.smithi142.stdout:9/589: symlink dd/d17/d69/le1 0 2024-09-13T02:52:40.001 INFO:tasks.workunit.client.1.smithi142.stdout:9/590: chown dd/d17/d69/f89 991 1 2024-09-13T02:52:40.001 INFO:tasks.workunit.client.0.smithi098.stdout:3/89: dwrite f4 [0,4194304] 0 2024-09-13T02:52:40.004 INFO:tasks.workunit.client.0.smithi098.stdout:2/113: fdatasync d1/f8 0 2024-09-13T02:52:40.005 INFO:tasks.workunit.client.0.smithi098.stdout:2/114: read - d1/d1a/d9/d15/f18 zero size 2024-09-13T02:52:40.006 INFO:tasks.workunit.client.0.smithi098.stdout:8/130: mkdir d2/d28 0 2024-09-13T02:52:40.007 INFO:tasks.workunit.client.0.smithi098.stdout:8/131: dread - d2/f23 zero size 2024-09-13T02:52:40.008 INFO:tasks.workunit.client.1.smithi142.stdout:3/476: mkdir d12/d16/d3c/d7d/d91 0 2024-09-13T02:52:40.009 INFO:tasks.workunit.client.1.smithi142.stdout:7/473: dwrite d10/d13/d1d/d2b/d55/f3c [0,4194304] 0 2024-09-13T02:52:40.011 INFO:tasks.workunit.client.0.smithi098.stdout:9/103: link d2/dd/f17 d2/dd/d1b/f25 0 2024-09-13T02:52:40.012 INFO:tasks.workunit.client.0.smithi098.stdout:2/115: dwrite d1/d1a/d9/d15/f18 [0,4194304] 0 2024-09-13T02:52:40.013 INFO:tasks.workunit.client.1.smithi142.stdout:8/395: chown d0/d6/dc/d45/d8/df/c31 122 1 2024-09-13T02:52:40.015 INFO:tasks.workunit.client.0.smithi098.stdout:1/138: getdents d9/d13/d19 0 2024-09-13T02:52:40.020 INFO:tasks.workunit.client.0.smithi098.stdout:4/123: write d6/d10/f13 [564494,112982] 0 2024-09-13T02:52:40.020 INFO:tasks.workunit.client.1.smithi142.stdout:0/485: symlink d10/d6c/d88/d30/la6 0 2024-09-13T02:52:40.022 INFO:tasks.workunit.client.0.smithi098.stdout:5/105: mknod d0/c2a 0 2024-09-13T02:52:40.024 INFO:tasks.workunit.client.1.smithi142.stdout:1/579: creat d12/d13/fba x:0 0 0 2024-09-13T02:52:40.025 INFO:tasks.workunit.client.0.smithi098.stdout:3/90: fdatasync d7/fc 0 2024-09-13T02:52:40.025 INFO:tasks.workunit.client.1.smithi142.stdout:4/471: write d0/df/f1f [4231126,63040] 0 2024-09-13T02:52:40.030 INFO:tasks.workunit.client.0.smithi098.stdout:9/104: symlink d2/d6/l26 0 2024-09-13T02:52:40.031 INFO:tasks.workunit.client.1.smithi142.stdout:9/591: fsync dd/d17/d69/d84/d41/f59 0 2024-09-13T02:52:40.032 INFO:tasks.workunit.client.0.smithi098.stdout:9/105: write d2/d6/f19 [44971,10655] 0 2024-09-13T02:52:40.032 INFO:tasks.workunit.client.0.smithi098.stdout:3/91: dwrite f1 [4194304,4194304] 0 2024-09-13T02:52:40.033 INFO:tasks.workunit.client.0.smithi098.stdout:2/116: rename d1/d1a/d9/fe to d1/f1d 0 2024-09-13T02:52:40.034 INFO:tasks.workunit.client.0.smithi098.stdout:3/92: write d7/d9/d15/f1c [351322,111717] 0 2024-09-13T02:52:40.035 INFO:tasks.workunit.client.1.smithi142.stdout:6/520: rmdir d1/da6 0 2024-09-13T02:52:40.035 INFO:tasks.workunit.client.0.smithi098.stdout:3/93: chown d7/fc 128856883 1 2024-09-13T02:52:40.036 INFO:tasks.workunit.client.0.smithi098.stdout:3/94: truncate d7/f1d 159041 0 2024-09-13T02:52:40.037 INFO:tasks.workunit.client.0.smithi098.stdout:0/95: symlink dd/l1c 0 2024-09-13T02:52:40.037 INFO:tasks.workunit.client.0.smithi098.stdout:3/95: dread d7/f14 [0,4194304] 0 2024-09-13T02:52:40.038 INFO:tasks.workunit.client.1.smithi142.stdout:8/396: creat d0/d6/d23/f7f x:0 0 0 2024-09-13T02:52:40.038 INFO:tasks.workunit.client.0.smithi098.stdout:4/124: chown d6/c16 1676357 1 2024-09-13T02:52:40.039 INFO:tasks.workunit.client.0.smithi098.stdout:4/125: write d6/f18 [194665,69574] 0 2024-09-13T02:52:40.040 INFO:tasks.workunit.client.0.smithi098.stdout:6/101: symlink d5/d18/l20 0 2024-09-13T02:52:40.042 INFO:tasks.workunit.client.0.smithi098.stdout:5/106: truncate d0/d1/f11 362227 0 2024-09-13T02:52:40.042 INFO:tasks.workunit.client.0.smithi098.stdout:9/106: fdatasync d2/d6/f19 0 2024-09-13T02:52:40.044 INFO:tasks.workunit.client.0.smithi098.stdout:9/107: read d2/d6/f14 [3513553,20271] 0 2024-09-13T02:52:40.046 INFO:tasks.workunit.client.0.smithi098.stdout:9/108: dread d2/d6/f19 [0,4194304] 0 2024-09-13T02:52:40.046 INFO:tasks.workunit.client.0.smithi098.stdout:8/132: creat d2/d28/f29 x:0 0 0 2024-09-13T02:52:40.047 INFO:tasks.workunit.client.0.smithi098.stdout:8/133: chown d2/dd/f25 638 1 2024-09-13T02:52:40.047 INFO:tasks.workunit.client.1.smithi142.stdout:4/472: mknod d0/d2b/d75/c9a 0 2024-09-13T02:52:40.048 INFO:tasks.workunit.client.0.smithi098.stdout:8/134: dread - d2/f23 zero size 2024-09-13T02:52:40.049 INFO:tasks.workunit.client.1.smithi142.stdout:2/358: symlink d1/d29/d72/l78 0 2024-09-13T02:52:40.050 INFO:tasks.workunit.client.1.smithi142.stdout:2/359: chown d1/de/d31/d6c/d6d/l75 341974 1 2024-09-13T02:52:40.050 INFO:tasks.workunit.client.0.smithi098.stdout:2/117: mkdir d1/d1a/d9/d1e 0 2024-09-13T02:52:40.051 INFO:tasks.workunit.client.0.smithi098.stdout:2/118: write d1/d1a/f12 [2157111,59247] 0 2024-09-13T02:52:40.052 INFO:tasks.workunit.client.0.smithi098.stdout:1/139: mknod d9/d13/d29/c31 0 2024-09-13T02:52:40.055 INFO:tasks.workunit.client.0.smithi098.stdout:0/96: write dd/df/f17 [568766,121674] 0 2024-09-13T02:52:40.055 INFO:tasks.workunit.client.1.smithi142.stdout:6/521: symlink d1/d7/d19/d48/d90/lb2 0 2024-09-13T02:52:40.056 INFO:tasks.workunit.client.0.smithi098.stdout:0/97: write dd/df/f18 [779135,123008] 0 2024-09-13T02:52:40.056 INFO:tasks.workunit.client.1.smithi142.stdout:2/360: dwrite d1/d2d/f40 [0,4194304] 0 2024-09-13T02:52:40.057 INFO:tasks.workunit.client.0.smithi098.stdout:3/96: symlink d7/d9/l1e 0 2024-09-13T02:52:40.057 INFO:tasks.workunit.client.0.smithi098.stdout:7/277: sync 2024-09-13T02:52:40.057 INFO:tasks.workunit.client.1.smithi142.stdout:6/522: rename d1/dd/d53 to d1/dd/d53/d78/d8f/db3 22 2024-09-13T02:52:40.061 INFO:tasks.workunit.client.0.smithi098.stdout:4/126: symlink d6/d10/l26 0 2024-09-13T02:52:40.063 INFO:tasks.workunit.client.0.smithi098.stdout:3/97: dwrite d7/d9/fa [0,4194304] 0 2024-09-13T02:52:40.063 INFO:tasks.workunit.client.1.smithi142.stdout:5/512: getdents d8/d24/d64/d68 0 2024-09-13T02:52:40.064 INFO:tasks.workunit.client.0.smithi098.stdout:3/98: truncate d7/d9/d15/f1c 685681 0 2024-09-13T02:52:40.065 INFO:tasks.workunit.client.0.smithi098.stdout:6/102: mknod d5/d13/c21 0 2024-09-13T02:52:40.066 INFO:tasks.workunit.client.1.smithi142.stdout:8/397: dread d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:40.068 INFO:tasks.workunit.client.1.smithi142.stdout:0/486: link d10/d6c/d88/d21/d51/d35/f76 d10/d6c/d88/d21/d51/fa7 0 2024-09-13T02:52:40.071 INFO:tasks.workunit.client.1.smithi142.stdout:1/580: link d12/d13/d1d/f90 d12/d13/d20/d66/d55/da0/fbb 0 2024-09-13T02:52:40.074 INFO:tasks.workunit.client.1.smithi142.stdout:4/473: rmdir d0/d7e 39 2024-09-13T02:52:40.075 INFO:tasks.workunit.client.0.smithi098.stdout:9/109: symlink d2/dd/d1b/l27 0 2024-09-13T02:52:40.076 INFO:tasks.workunit.client.0.smithi098.stdout:8/135: creat d2/d28/f2a x:0 0 0 2024-09-13T02:52:40.082 INFO:tasks.workunit.client.0.smithi098.stdout:1/140: mknod d9/d13/d19/c32 0 2024-09-13T02:52:40.084 INFO:tasks.workunit.client.1.smithi142.stdout:9/592: dwrite dd/d17/fb3 [0,4194304] 0 2024-09-13T02:52:40.085 INFO:tasks.workunit.client.0.smithi098.stdout:2/119: dwrite d1/f1d [0,4194304] 0 2024-09-13T02:52:40.086 INFO:tasks.workunit.client.0.smithi098.stdout:0/98: rename dd/df/d19 to dd/df/d1d 0 2024-09-13T02:52:40.087 INFO:tasks.workunit.client.0.smithi098.stdout:0/99: write fb [776057,60223] 0 2024-09-13T02:52:40.090 INFO:tasks.workunit.client.1.smithi142.stdout:5/513: unlink d8/f15 0 2024-09-13T02:52:40.091 INFO:tasks.workunit.client.1.smithi142.stdout:8/398: fdatasync d0/d6/dc/d45/d8/f12 0 2024-09-13T02:52:40.093 INFO:tasks.workunit.client.0.smithi098.stdout:4/127: symlink d6/d10/l27 0 2024-09-13T02:52:40.094 INFO:tasks.workunit.client.1.smithi142.stdout:0/487: fdatasync d10/d6c/d88/d30/f86 0 2024-09-13T02:52:40.095 INFO:tasks.workunit.client.1.smithi142.stdout:0/488: fsync d10/d6c/d88/d1a/d3a/f99 0 2024-09-13T02:52:40.096 INFO:tasks.workunit.client.0.smithi098.stdout:3/99: unlink d7/d9/d15/l16 0 2024-09-13T02:52:40.098 INFO:tasks.workunit.client.0.smithi098.stdout:4/128: read d6/d10/f13 [463566,58881] 0 2024-09-13T02:52:40.099 INFO:tasks.workunit.client.1.smithi142.stdout:1/581: rename d12/d1b/f46 to d12/d13/d20/d66/d55/db4/fbc 0 2024-09-13T02:52:40.099 INFO:tasks.workunit.client.1.smithi142.stdout:7/474: sync 2024-09-13T02:52:40.101 INFO:tasks.workunit.client.0.smithi098.stdout:5/107: fsync d0/d1/f11 0 2024-09-13T02:52:40.103 INFO:tasks.workunit.client.0.smithi098.stdout:5/108: read d0/d15/d17/f1e [269963,20894] 0 2024-09-13T02:52:40.103 INFO:tasks.workunit.client.1.smithi142.stdout:2/361: mkdir d1/d2c/d6f/d79 0 2024-09-13T02:52:40.105 INFO:tasks.workunit.client.1.smithi142.stdout:3/477: getdents d12/d16/d25/d2e/d38/d6b 0 2024-09-13T02:52:40.105 INFO:tasks.workunit.client.1.smithi142.stdout:2/362: chown d1/de/d31/d6c/d6d/f52 1687291 1 2024-09-13T02:52:40.106 INFO:tasks.workunit.client.1.smithi142.stdout:7/475: dwrite d10/d13/d1d/d44/f89 [0,4194304] 0 2024-09-13T02:52:40.106 INFO:tasks.workunit.client.0.smithi098.stdout:9/110: read d2/dd/f20 [52919,67121] 0 2024-09-13T02:52:40.106 INFO:tasks.workunit.client.0.smithi098.stdout:9/111: dread - d2/dd/f1f zero size 2024-09-13T02:52:40.109 INFO:tasks.workunit.client.0.smithi098.stdout:8/136: truncate d2/dd/d11/d1d/f24 441143 0 2024-09-13T02:52:40.111 INFO:tasks.workunit.client.0.smithi098.stdout:8/137: write d2/dd/d11/d1d/f24 [907696,88809] 0 2024-09-13T02:52:40.111 INFO:tasks.workunit.client.0.smithi098.stdout:8/138: dread - d2/f1a zero size 2024-09-13T02:52:40.113 INFO:tasks.workunit.client.0.smithi098.stdout:1/141: rename d9/d13 to d9/d33 0 2024-09-13T02:52:40.115 INFO:tasks.workunit.client.1.smithi142.stdout:9/593: mknod dd/d17/d44/d82/d99/da8/db7/ce2 0 2024-09-13T02:52:40.116 INFO:tasks.workunit.client.1.smithi142.stdout:9/594: chown dd/d17/d68/l73 1576 1 2024-09-13T02:52:40.120 INFO:tasks.workunit.client.0.smithi098.stdout:1/142: dwrite d9/d33/f17 [0,4194304] 0 2024-09-13T02:52:40.121 INFO:tasks.workunit.client.1.smithi142.stdout:5/514: dread d8/d24/d3f/f40 [0,4194304] 0 2024-09-13T02:52:40.121 INFO:tasks.workunit.client.1.smithi142.stdout:0/489: symlink d10/d6c/d88/d1a/d1e/d42/d4b/la8 0 2024-09-13T02:52:40.121 INFO:tasks.workunit.client.0.smithi098.stdout:1/143: fdatasync d9/d33/f22 0 2024-09-13T02:52:40.122 INFO:tasks.workunit.client.0.smithi098.stdout:0/100: mknod dd/df/c1e 0 2024-09-13T02:52:40.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/474: dwrite d0/df/d57/f11 [4194304,4194304] 0 2024-09-13T02:52:40.124 INFO:tasks.workunit.client.1.smithi142.stdout:4/475: stat d0/d2b/d21/c71 0 2024-09-13T02:52:40.125 INFO:tasks.workunit.client.1.smithi142.stdout:4/476: chown d0/d2b/d21/d35/f5f 3233 1 2024-09-13T02:52:40.130 INFO:tasks.workunit.client.1.smithi142.stdout:1/582: rename d12/d13/d20/d27/f4b to d12/d13/d20/d66/fbd 0 2024-09-13T02:52:40.373 INFO:tasks.workunit.client.1.smithi142.stdout:6/523: truncate d1/dd/f22 257591 0 2024-09-13T02:52:40.374 INFO:tasks.workunit.client.1.smithi142.stdout:4/477: truncate d0/d2b/d2d/d65/f5e 507053 0 2024-09-13T02:52:40.374 INFO:tasks.workunit.client.1.smithi142.stdout:5/515: dwrite f0 [0,4194304] 0 2024-09-13T02:52:40.388 INFO:tasks.workunit.client.0.smithi098.stdout:0/101: dwrite fb [0,4194304] 0 2024-09-13T02:52:40.388 INFO:tasks.workunit.client.0.smithi098.stdout:3/100: mknod d7/c1f 0 2024-09-13T02:52:40.388 INFO:tasks.workunit.client.0.smithi098.stdout:3/101: chown d7/d9/d15/f1c 72845 1 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:3/102: write f1 [8123885,21850] 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:7/278: truncate d6/f19 1851341 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:7/279: fsync d6/d14/f44 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:5/109: creat d0/d1/d1a/f2b x:0 0 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:4/129: creat d6/d22/f28 x:0 0 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:6/103: creat d5/f22 x:0 0 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:5/110: unlink d0/f1f 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:0/102: mkdir dd/d1f 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:7/280: symlink d6/d24/l59 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:9/112: creat d2/f28 x:0 0 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:3/103: dwrite f6 [0,4194304] 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:3/104: dwrite f6 [0,4194304] 0 2024-09-13T02:52:40.389 INFO:tasks.workunit.client.0.smithi098.stdout:1/144: dwrite f1 [0,4194304] 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:7/281: rename d6/d14 to d6/d24/d2a/d5a 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:5/111: creat d0/d29/f2c x:0 0 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:7/282: write d6/d24/f3d [392781,26666] 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:6/104: write d5/de/f11 [735941,27253] 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:8/139: link d2/lf d2/d28/l2b 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:3/105: rename f1 to d7/d9/d15/d17/f20 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:0/103: write fb [4920215,94178] 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:6/105: mknod d5/d13/c23 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:3/106: symlink d7/d9/d15/d17/l21 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:7/283: symlink d6/d24/d2a/d57/l5b 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:6/106: rmdir d5/d18 39 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:1/145: dread d9/f10 [0,4194304] 0 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:1/146: dread - d9/d33/d1f/d23/f24 zero size 2024-09-13T02:52:40.390 INFO:tasks.workunit.client.0.smithi098.stdout:4/130: write d6/db/fc [1000543,56387] 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:7/284: unlink d6/d24/d2a/f51 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:0/104: fsync f8 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:0/105: dread f8 [0,4194304] 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:9/113: write d2/dd/f17 [726239,50613] 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:0/106: read dd/df/f17 [354631,122836] 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:3/107: link d7/d9/fa d7/f22 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:1/147: creat d9/d33/d1f/d23/f34 x:0 0 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:5/112: getdents d0/d15 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:5/113: dread - d0/d15/f18 zero size 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:4/131: creat d6/db/f29 x:0 0 0 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:7/285: rmdir d6/d1e 39 2024-09-13T02:52:40.391 INFO:tasks.workunit.client.0.smithi098.stdout:0/107: rmdir dd/df 39 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:3/108: creat d7/d9/d15/f23 x:0 0 0 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:3/109: write d7/d9/d15/f1c [138993,90748] 0 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:1/148: mkdir d9/d33/d19/d35 0 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:1/149: read - d9/d33/d19/f28 zero size 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:1/150: stat d9/f25 0 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:5/114: creat d0/d15/d17/d1c/f2d x:0 0 0 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:8/140: dwrite d2/fe [0,4194304] 0 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:1/151: dread - d9/d33/d1f/d23/f34 zero size 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:5/115: readlink d0/d15/d17/l23 0 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:4/132: creat d6/db/f2a x:0 0 0 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:5/116: dread - d0/d15/d17/f26 zero size 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:8/141: dread d2/dd/d11/f18 [0,4194304] 0 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:8/142: chown d2/dd/d11/d1d 2111 1 2024-09-13T02:52:40.392 INFO:tasks.workunit.client.0.smithi098.stdout:8/143: truncate d2/d28/f29 677416 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:7/286: creat d6/d24/d46/f5c x:0 0 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:8/144: write d2/dd/d11/d1d/f24 [1733895,51821] 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:7/287: dwrite d6/ff [4194304,4194304] 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:9/114: write d2/d6/f1c [5190173,66996] 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:1/152: rename d9/d33/d19/c1a to d9/d12/d2f/c36 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:1/153: chown d9/d33/d1f/d23/f34 62 1 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:5/117: rmdir d0 39 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:3/110: truncate d7/f22 3941592 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:1/154: symlink d9/d33/d29/l37 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:5/118: truncate d0/d15/f22 971825 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:9/115: dwrite d2/d6/f14 [4194304,4194304] 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:9/116: dread d2/d6/f19 [0,4194304] 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:1/155: creat d9/f38 x:0 0 0 2024-09-13T02:52:40.393 INFO:tasks.workunit.client.0.smithi098.stdout:0/108: dwrite dd/df/f17 [0,4194304] 0 2024-09-13T02:52:40.394 INFO:tasks.workunit.client.0.smithi098.stdout:0/109: chown dd/l1c 3 1 2024-09-13T02:52:40.394 INFO:tasks.workunit.client.0.smithi098.stdout:5/119: creat d0/d15/d17/f2e x:0 0 0 2024-09-13T02:52:40.394 INFO:tasks.workunit.client.0.smithi098.stdout:7/288: creat d6/f5d x:0 0 0 2024-09-13T02:52:40.394 INFO:tasks.workunit.client.0.smithi098.stdout:9/117: creat d2/d6/f29 x:0 0 0 2024-09-13T02:52:40.394 INFO:tasks.workunit.client.0.smithi098.stdout:1/156: symlink d9/d33/d19/l39 0 2024-09-13T02:52:40.394 INFO:tasks.workunit.client.0.smithi098.stdout:1/157: fsync d9/d33/d1f/d23/f34 0 2024-09-13T02:52:40.394 INFO:tasks.workunit.client.0.smithi098.stdout:8/145: getdents d2/d28 0 2024-09-13T02:52:40.394 INFO:tasks.workunit.client.0.smithi098.stdout:1/158: dread - d9/f38 zero size 2024-09-13T02:52:40.395 INFO:tasks.workunit.client.1.smithi142.stdout:1/583: dread d12/fa1 [0,4194304] 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:7/476: dread d10/d34/f5b [0,4194304] 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:2/363: unlink d1/f48 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:6/524: dwrite d1/dd/f49 [8388608,4194304] 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:3/478: write d12/d16/d25/d2e/d38/d6b/f89 [953858,51099] 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:9/595: mkdir dd/d17/d44/d82/d99/de3 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:4/478: unlink d0/df/d57/c39 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:4/479: dread - d0/d2b/d21/d30/f8a zero size 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:4/480: fdatasync d0/df/d57/f88 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:2/364: creat d1/d2c/d6f/f7a x:0 0 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:6/525: unlink d1/dd/d53/d78/d8f/l97 0 2024-09-13T02:52:40.396 INFO:tasks.workunit.client.1.smithi142.stdout:0/490: creat d10/d6c/d88/d21/d8f/fa9 x:0 0 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:8/399: sync 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:8/400: write d0/d6/f24 [2973852,14341] 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:1/584: rename d12/d13/d45/f76 to d12/d13/d20/d27/d3c/d71/d81/d92/daa/fbe 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:7/477: rename d10/d13/d1d to d10/d13/d1d/d25/d45/d92/d9f 22 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:7/478: write d10/d13/d22/f69 [4059496,57157] 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:3/479: symlink d12/d16/d25/d2e/d38/d4d/l92 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:7/479: dwrite d10/d13/f1e [0,4194304] 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:9/596: creat dd/d17/d5f/d7b/db8/dc0/fe4 x:0 0 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:7/480: chown d10/d34/f5a 2442 1 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:4/481: dread d0/df/f1f [0,4194304] 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:5/516: creat d8/d24/d26/d2d/d90/fa1 x:0 0 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:0/491: dread d10/d6c/d88/d36/f59 [0,4194304] 0 2024-09-13T02:52:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:0/492: dread - d10/d6c/f9f zero size 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:7/481: dwrite d10/d13/d1d/f23 [8388608,4194304] 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:0/493: fdatasync d10/d6c/d88/d21/d51/d35/f55 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:0/494: chown d10/d6c/d88/d1a/d1e/l4e 139115598 1 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:1/585: symlink d12/d13/d1d/d26/d4f/lbf 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:0/495: dwrite d10/f7c [0,4194304] 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:6/526: creat d1/dd/d53/d78/d8f/da8/fb4 x:0 0 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:9/597: mknod dd/d87/ce5 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:9/598: fdatasync dd/d17/fb3 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:9/599: fdatasync dd/f11 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:2/365: dwrite d1/d29/f30 [0,4194304] 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:5/517: symlink d8/d24/d26/d45/d81/d82/la2 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:8/401: mkdir d0/d80 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:8/402: read d0/f4c [413960,14531] 0 2024-09-13T02:52:40.398 INFO:tasks.workunit.client.1.smithi142.stdout:1/586: rmdir d12/d13/d45 39 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:0/496: mknod d10/d6c/d88/d1a/d1e/d42/d4b/d85/caa 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:6/527: dread d1/d7/d19/f4b [0,4194304] 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:3/480: dwrite fe [0,4194304] 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:9/600: symlink dd/d17/d44/d82/d99/da8/le6 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:2/366: mknod d1/d2c/d6f/c7b 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:5/518: creat d8/d24/d26/d45/d81/d82/fa3 x:0 0 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:5/519: stat d8/d24/d64 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:5/520: truncate d8/d24/d26/d45/d8e/f94 65947 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:8/403: creat d0/d6/dc/d45/d35/f81 x:0 0 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:1/587: unlink d12/f7a 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:9/601: rmdir dd/d98 39 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:4/482: creat d0/f9b x:0 0 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:5/521: unlink c1 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:1/588: mkdir d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0 0 2024-09-13T02:52:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:3/481: mknod d12/d16/c93 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:0/497: write d10/d23/f25 [730282,12410] 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:5/522: creat d8/d24/d26/d45/d81/d8c/fa4 x:0 0 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:5/523: fsync d8/d24/d3f/f8f 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:5/524: truncate d8/d24/d3f/f87 277666 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:7/482: getdents d10/d13/d1d/d2b/d56 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:5/525: rename d8/d24 to d8/d24/d26/d45/d81/d8c/da5 22 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:5/526: write d8/d24/d26/d45/d81/d82/f93 [678448,87910] 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:8/404: mkdir d0/d82 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:5/527: dread - d8/d24/d3f/d4a/f9c zero size 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:1/589: symlink d12/d13/d20/d27/d3c/d71/d81/d92/lc1 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:8/405: dwrite d0/d6/dc/f59 [0,4194304] 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:8/406: write d0/d6/dc/d45/f73 [431484,55478] 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:9/602: creat dd/d87/d8e/da3/ddb/fe7 x:0 0 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:9/603: dread - dd/dcb/fcd zero size 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:9/604: write dd/d17/fb3 [2203913,112166] 0 2024-09-13T02:52:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:0/498: creat d10/d6c/d88/d1a/d7a/fab x:0 0 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:7/483: write d10/d13/d1d/d2b/d40/f5e [7349578,120997] 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:6/528: getdents d1/dd/d16/d4e/d32 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:0/499: symlink d10/d6c/d88/d21/d51/d35/lac 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:2/367: sync 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:5/528: link d8/f19 d8/d24/d26/d45/d81/d8c/fa6 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:5/529: readlink d8/d24/d26/l55 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:5/530: dread - d8/d24/d26/d45/d62/f6c zero size 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:0/500: dwrite d10/d23/f87 [0,4194304] 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:6/529: unlink d1/d7/d19/d30/lac 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:1/590: unlink d12/l1f 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:3/482: creat d12/d16/d25/d2e/d38/f94 x:0 0 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:8/407: mkdir d0/d6/d83 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:2/368: creat d1/de/d1f/d13/d60/f7c x:0 0 0 2024-09-13T02:52:40.401 INFO:tasks.workunit.client.1.smithi142.stdout:0/501: rename c7 to d10/d6c/d88/d21/d51/d35/cad 0 2024-09-13T02:52:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:0/502: chown d10/d6c/d88/d36/f59 3114 1 2024-09-13T02:52:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:1/591: rmdir d12/d13/d20/d27/d3c 39 2024-09-13T02:52:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:3/483: mknod d12/d16/d25/d2e/c95 0 2024-09-13T02:52:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:8/408: symlink d0/d6/d23/d2b/l84 0 2024-09-13T02:52:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:6/530: dread d1/d7/d5f/d6a/f7a [0,4194304] 0 2024-09-13T02:52:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:8/409: fsync d0/d6/dc/d45/d8/df/d28/f53 0 2024-09-13T02:52:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:2/369: symlink d1/de/d31/l7d 0 2024-09-13T02:52:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:0/503: mknod d10/d6c/d88/d21/d51/d35/d9b/cae 0 2024-09-13T02:52:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:1/592: truncate d12/d1b/f80 48217 0 2024-09-13T02:52:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:7/484: getdents d10/d13/d1d/d2b/d55 0 2024-09-13T02:52:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:7/485: fsync d10/d13/d1d/d2b/d40/f5e 0 2024-09-13T02:52:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:6/531: creat d1/dd/d16/d4e/fb5 x:0 0 0 2024-09-13T02:52:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:0/504: stat d10/l12 0 2024-09-13T02:52:40.404 INFO:tasks.workunit.client.0.smithi098.stdout:7/289: write d6/d1e/f1f [576143,63989] 0 2024-09-13T02:52:40.404 INFO:tasks.workunit.client.0.smithi098.stdout:7/290: read d6/ff [7732209,48669] 0 2024-09-13T02:52:40.404 INFO:tasks.workunit.client.0.smithi098.stdout:7/291: readlink d6/d24/d2a/l58 0 2024-09-13T02:52:40.404 INFO:tasks.workunit.client.0.smithi098.stdout:9/118: creat d2/d6/f2a x:0 0 0 2024-09-13T02:52:40.404 INFO:tasks.workunit.client.0.smithi098.stdout:1/159: mknod d9/d12/d2f/c3a 0 2024-09-13T02:52:40.404 INFO:tasks.workunit.client.0.smithi098.stdout:5/120: mknod d0/d1/d1a/d27/c2f 0 2024-09-13T02:52:40.405 INFO:tasks.workunit.client.1.smithi142.stdout:1/593: symlink d12/d13/d1d/d26/d4f/lc2 0 2024-09-13T02:52:40.406 INFO:tasks.workunit.client.1.smithi142.stdout:1/594: write d12/d13/d1d/f9e [4477541,97694] 0 2024-09-13T02:52:40.409 INFO:tasks.workunit.client.0.smithi098.stdout:9/119: mkdir d2/d6/d2b 0 2024-09-13T02:52:40.413 INFO:tasks.workunit.client.0.smithi098.stdout:0/110: creat dd/f20 x:0 0 0 2024-09-13T02:52:40.413 INFO:tasks.workunit.client.1.smithi142.stdout:5/531: truncate d8/d24/d3f/d4a/f7a 243793 0 2024-09-13T02:52:40.414 INFO:tasks.workunit.client.1.smithi142.stdout:5/532: truncate d8/d24/d26/d45/f79 1519329 0 2024-09-13T02:52:40.416 INFO:tasks.workunit.client.0.smithi098.stdout:8/146: mkdir d2/dd/d11/d2c 0 2024-09-13T02:52:40.418 INFO:tasks.workunit.client.1.smithi142.stdout:7/486: write d10/f17 [1082496,100591] 0 2024-09-13T02:52:40.418 INFO:tasks.workunit.client.0.smithi098.stdout:3/111: dwrite d7/f22 [4194304,4194304] 0 2024-09-13T02:52:40.419 INFO:tasks.workunit.client.1.smithi142.stdout:4/483: sync 2024-09-13T02:52:40.422 INFO:tasks.workunit.client.1.smithi142.stdout:6/532: rename d1/d7/d19/d30/d87 to d1/d7/d5f/d60/db6 0 2024-09-13T02:52:40.424 INFO:tasks.workunit.client.1.smithi142.stdout:8/410: symlink d0/d82/l85 0 2024-09-13T02:52:40.425 INFO:tasks.workunit.client.0.smithi098.stdout:0/111: dwrite dd/df/d1d/f1a [0,4194304] 0 2024-09-13T02:52:40.427 INFO:tasks.workunit.client.0.smithi098.stdout:8/147: dread d2/dd/d11/f16 [0,4194304] 0 2024-09-13T02:52:40.429 INFO:tasks.workunit.client.0.smithi098.stdout:3/112: dwrite f4 [4194304,4194304] 0 2024-09-13T02:52:40.431 INFO:tasks.workunit.client.1.smithi142.stdout:0/505: unlink d10/d6c/d88/d1a/d7a/fab 0 2024-09-13T02:52:40.432 INFO:tasks.workunit.client.1.smithi142.stdout:8/411: dwrite d0/d6/dc/d2e/f57 [4194304,4194304] 0 2024-09-13T02:52:40.433 INFO:tasks.workunit.client.1.smithi142.stdout:8/412: stat d0/d6/d23/d2b/c58 0 2024-09-13T02:52:40.434 INFO:tasks.workunit.client.0.smithi098.stdout:9/120: unlink d2/dd/l11 0 2024-09-13T02:52:40.435 INFO:tasks.workunit.client.0.smithi098.stdout:7/292: dwrite d6/d24/d2a/d5a/f34 [0,4194304] 0 2024-09-13T02:52:40.437 INFO:tasks.workunit.client.1.smithi142.stdout:8/413: dread d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:40.448 INFO:tasks.workunit.client.1.smithi142.stdout:2/370: write d1/f1e [550203,27891] 0 2024-09-13T02:52:40.454 INFO:tasks.workunit.client.1.smithi142.stdout:9/605: sync 2024-09-13T02:52:40.456 INFO:tasks.workunit.client.0.smithi098.stdout:0/112: symlink dd/df/l21 0 2024-09-13T02:52:40.459 INFO:tasks.workunit.client.1.smithi142.stdout:4/484: symlink d0/d2b/d2d/d65/d87/l9c 0 2024-09-13T02:52:40.459 INFO:tasks.workunit.client.0.smithi098.stdout:3/113: symlink d7/d9/d15/d17/l24 0 2024-09-13T02:52:40.460 INFO:tasks.workunit.client.1.smithi142.stdout:7/487: rename d10/d13/c2a to d10/d13/d1d/d25/d45/d92/ca0 0 2024-09-13T02:52:40.461 INFO:tasks.workunit.client.1.smithi142.stdout:4/485: read d0/d2b/d2d/d31/d32/f3d [1065432,81741] 0 2024-09-13T02:52:40.462 INFO:tasks.workunit.client.1.smithi142.stdout:4/486: chown d0/d2b/d2d/d31/d43/d48/f68 58178542 1 2024-09-13T02:52:40.463 INFO:tasks.workunit.client.1.smithi142.stdout:1/595: write d12/fa1 [1147767,83945] 0 2024-09-13T02:52:40.463 INFO:tasks.workunit.client.1.smithi142.stdout:6/533: dread d1/d7/d19/d30/fa2 [0,4194304] 0 2024-09-13T02:52:40.464 INFO:tasks.workunit.client.0.smithi098.stdout:3/114: dread d7/d9/fa [0,4194304] 0 2024-09-13T02:52:40.464 INFO:tasks.workunit.client.0.smithi098.stdout:1/160: link d9/d33/c14 d9/d33/d29/c3b 0 2024-09-13T02:52:40.465 INFO:tasks.workunit.client.0.smithi098.stdout:3/115: truncate d7/d9/fa 8770927 0 2024-09-13T02:52:40.467 INFO:tasks.workunit.client.1.smithi142.stdout:0/506: fdatasync d10/d6c/d88/d21/d51/d35/f53 0 2024-09-13T02:52:40.467 INFO:tasks.workunit.client.0.smithi098.stdout:0/113: symlink dd/df/d1d/l22 0 2024-09-13T02:52:40.471 INFO:tasks.workunit.client.1.smithi142.stdout:0/507: read d10/f19 [914397,104751] 0 2024-09-13T02:52:40.472 INFO:tasks.workunit.client.1.smithi142.stdout:6/534: dwrite d1/f25 [0,4194304] 0 2024-09-13T02:52:40.472 INFO:tasks.workunit.client.1.smithi142.stdout:1/596: dwrite d12/d13/d20/f5c [0,4194304] 0 2024-09-13T02:52:40.473 INFO:tasks.workunit.client.0.smithi098.stdout:0/114: dread f4 [0,4194304] 0 2024-09-13T02:52:40.473 INFO:tasks.workunit.client.0.smithi098.stdout:0/115: write f4 [5024201,125009] 0 2024-09-13T02:52:40.475 INFO:tasks.workunit.client.1.smithi142.stdout:5/533: write d8/d24/d26/d63/f73 [6095932,55335] 0 2024-09-13T02:52:40.475 INFO:tasks.workunit.client.1.smithi142.stdout:3/484: getdents d12/d16/d25/d2e/d38/d4d/d53/d78 0 2024-09-13T02:52:40.475 INFO:tasks.workunit.client.0.smithi098.stdout:5/121: getdents d0/d1/d1a 0 2024-09-13T02:52:40.477 INFO:tasks.workunit.client.1.smithi142.stdout:0/508: write d10/d6c/d88/d21/d51/d35/f8c [922133,77372] 0 2024-09-13T02:52:40.479 INFO:tasks.workunit.client.0.smithi098.stdout:1/161: symlink d9/d12/l3c 0 2024-09-13T02:52:40.479 INFO:tasks.workunit.client.1.smithi142.stdout:6/535: dread d1/d7/d42/f44 [4194304,4194304] 0 2024-09-13T02:52:40.479 INFO:tasks.workunit.client.1.smithi142.stdout:2/371: chown d1/l2e 3519 1 2024-09-13T02:52:40.480 INFO:tasks.workunit.client.1.smithi142.stdout:6/536: stat d1/dd/d16/f2c 0 2024-09-13T02:52:40.483 INFO:tasks.workunit.client.1.smithi142.stdout:2/372: read d1/de/f17 [2103557,85790] 0 2024-09-13T02:52:40.483 INFO:tasks.workunit.client.0.smithi098.stdout:1/162: dread d9/d33/f17 [0,4194304] 0 2024-09-13T02:52:40.484 INFO:tasks.workunit.client.1.smithi142.stdout:2/373: fsync d1/d2d/f64 0 2024-09-13T02:52:40.484 INFO:tasks.workunit.client.1.smithi142.stdout:9/606: symlink dd/d17/d68/le8 0 2024-09-13T02:52:40.485 INFO:tasks.workunit.client.1.smithi142.stdout:2/374: dread - d1/d2c/d6f/f7a zero size 2024-09-13T02:52:40.486 INFO:tasks.workunit.client.0.smithi098.stdout:7/293: dread d6/d24/d2a/f3a [0,4194304] 0 2024-09-13T02:52:40.487 INFO:tasks.workunit.client.0.smithi098.stdout:7/294: chown d6/c12 36453 1 2024-09-13T02:52:40.489 INFO:tasks.workunit.client.0.smithi098.stdout:3/116: mkdir d7/d9/d25 0 2024-09-13T02:52:40.494 INFO:tasks.workunit.client.1.smithi142.stdout:8/414: write d0/d6/dc/d45/f3 [1537831,15123] 0 2024-09-13T02:52:40.496 INFO:tasks.workunit.client.1.smithi142.stdout:8/415: read - d0/d6/dc/d45/d35/f63 zero size 2024-09-13T02:52:40.497 INFO:tasks.workunit.client.0.smithi098.stdout:3/117: dwrite f6 [0,4194304] 0 2024-09-13T02:52:40.497 INFO:tasks.workunit.client.1.smithi142.stdout:8/416: write d0/d6/dc/f49 [1970182,18041] 0 2024-09-13T02:52:40.499 INFO:tasks.workunit.client.0.smithi098.stdout:3/118: dread d7/fc [0,4194304] 0 2024-09-13T02:52:40.500 INFO:tasks.workunit.client.1.smithi142.stdout:4/487: rename d0/df/d57/f70 to d0/d2b/d2d/f9d 0 2024-09-13T02:52:40.501 INFO:tasks.workunit.client.0.smithi098.stdout:5/122: creat d0/d15/f30 x:0 0 0 2024-09-13T02:52:40.504 INFO:tasks.workunit.client.0.smithi098.stdout:3/119: dread f6 [0,4194304] 0 2024-09-13T02:52:40.505 INFO:tasks.workunit.client.0.smithi098.stdout:8/148: getdents d2/dd 0 2024-09-13T02:52:40.506 INFO:tasks.workunit.client.0.smithi098.stdout:1/163: creat d9/f3d x:0 0 0 2024-09-13T02:52:40.507 INFO:tasks.workunit.client.0.smithi098.stdout:7/295: symlink d6/d24/d2a/d48/l5e 0 2024-09-13T02:52:40.511 INFO:tasks.workunit.client.0.smithi098.stdout:9/121: getdents d2/d6 0 2024-09-13T02:52:40.512 INFO:tasks.workunit.client.0.smithi098.stdout:9/122: fdatasync d2/dd/d1b/f25 0 2024-09-13T02:52:40.513 INFO:tasks.workunit.client.0.smithi098.stdout:0/116: mknod dd/c23 0 2024-09-13T02:52:40.516 INFO:tasks.workunit.client.1.smithi142.stdout:2/375: creat d1/de/f7e x:0 0 0 2024-09-13T02:52:40.516 INFO:tasks.workunit.client.1.smithi142.stdout:5/534: dwrite d8/d24/d26/d61/f83 [0,4194304] 0 2024-09-13T02:52:40.517 INFO:tasks.workunit.client.1.smithi142.stdout:0/509: dread d10/d6c/d88/d21/d51/f3e [0,4194304] 0 2024-09-13T02:52:40.519 INFO:tasks.workunit.client.0.smithi098.stdout:5/123: read d0/d15/d17/f1e [260095,102505] 0 2024-09-13T02:52:40.520 INFO:tasks.workunit.client.0.smithi098.stdout:9/123: dwrite d2/dd/f1e [0,4194304] 0 2024-09-13T02:52:40.521 INFO:tasks.workunit.client.1.smithi142.stdout:3/485: dread d12/d16/d25/f47 [0,4194304] 0 2024-09-13T02:52:40.523 INFO:tasks.workunit.client.0.smithi098.stdout:9/124: dread d2/d6/f19 [0,4194304] 0 2024-09-13T02:52:40.529 INFO:tasks.workunit.client.1.smithi142.stdout:3/486: read d12/d16/d25/d2e/f4c [1083396,49121] 0 2024-09-13T02:52:40.530 INFO:tasks.workunit.client.0.smithi098.stdout:1/164: creat d9/d12/d2f/f3e x:0 0 0 2024-09-13T02:52:40.532 INFO:tasks.workunit.client.0.smithi098.stdout:8/149: dread d2/f1b [0,4194304] 0 2024-09-13T02:52:40.533 INFO:tasks.workunit.client.0.smithi098.stdout:9/125: dwrite d2/d6/f14 [0,4194304] 0 2024-09-13T02:52:40.534 INFO:tasks.workunit.client.0.smithi098.stdout:9/126: write d2/dd/f17 [2064455,113463] 0 2024-09-13T02:52:40.537 INFO:tasks.workunit.client.0.smithi098.stdout:0/117: truncate dd/f10 1047684 0 2024-09-13T02:52:40.541 INFO:tasks.workunit.client.0.smithi098.stdout:7/296: read d6/d24/d2a/d5a/f1d [1319497,88235] 0 2024-09-13T02:52:40.543 INFO:tasks.workunit.client.1.smithi142.stdout:2/376: creat d1/de/d31/f7f x:0 0 0 2024-09-13T02:52:40.544 INFO:tasks.workunit.client.1.smithi142.stdout:2/377: chown d1/de/d31/d6c/d6d 64149 1 2024-09-13T02:52:40.545 INFO:tasks.workunit.client.1.smithi142.stdout:9/607: mkdir dd/d17/d44/d82/d99/daf/dc9/de9 0 2024-09-13T02:52:40.545 INFO:tasks.workunit.client.1.smithi142.stdout:2/378: fdatasync d1/d2d/f53 0 2024-09-13T02:52:40.545 INFO:tasks.workunit.client.0.smithi098.stdout:5/124: rename d0/d15/d17/l20 to d0/d15/d17/l31 0 2024-09-13T02:52:40.546 INFO:tasks.workunit.client.1.smithi142.stdout:5/535: mknod d8/d24/d26/d45/d8e/ca7 0 2024-09-13T02:52:40.547 INFO:tasks.workunit.client.1.smithi142.stdout:9/608: read dd/d17/d25/d3e/f56 [1952447,90688] 0 2024-09-13T02:52:40.548 INFO:tasks.workunit.client.1.smithi142.stdout:5/536: dread d8/d24/d3f/f87 [0,4194304] 0 2024-09-13T02:52:40.549 INFO:tasks.workunit.client.0.smithi098.stdout:3/120: dwrite d7/d9/fa [4194304,4194304] 0 2024-09-13T02:52:40.551 INFO:tasks.workunit.client.0.smithi098.stdout:1/165: creat d9/d12/f3f x:0 0 0 2024-09-13T02:52:40.553 INFO:tasks.workunit.client.0.smithi098.stdout:8/150: rmdir d2 39 2024-09-13T02:52:40.555 INFO:tasks.workunit.client.1.smithi142.stdout:4/488: symlink d0/l9e 0 2024-09-13T02:52:40.556 INFO:tasks.workunit.client.1.smithi142.stdout:1/597: write d12/d13/d20/d66/d55/da0/fb2 [1411336,12329] 0 2024-09-13T02:52:40.559 INFO:tasks.workunit.client.1.smithi142.stdout:1/598: write d12/d13/d20/d66/d55/f44 [3067981,124186] 0 2024-09-13T02:52:40.562 INFO:tasks.workunit.client.0.smithi098.stdout:5/125: mkdir d0/d1/d1a/d32 0 2024-09-13T02:52:40.567 INFO:tasks.workunit.client.1.smithi142.stdout:2/379: rename d1/de/d31/l7d to d1/de/d31/d6c/d6d/l80 0 2024-09-13T02:52:40.571 INFO:tasks.workunit.client.1.smithi142.stdout:9/609: rmdir dd/d17/d69/d84/d41 39 2024-09-13T02:52:40.572 INFO:tasks.workunit.client.1.smithi142.stdout:7/488: link d10/d13/l18 d10/d13/la1 0 2024-09-13T02:52:40.575 INFO:tasks.workunit.client.1.smithi142.stdout:2/380: dread d1/de/d1f/d13/f2a [0,4194304] 0 2024-09-13T02:52:40.576 INFO:tasks.workunit.client.0.smithi098.stdout:9/127: rename d2/d6/l23 to d2/l2c 0 2024-09-13T02:52:40.578 INFO:tasks.workunit.client.0.smithi098.stdout:0/118: creat dd/f24 x:0 0 0 2024-09-13T02:52:40.579 INFO:tasks.workunit.client.1.smithi142.stdout:4/489: rmdir d0/d2b/d2d/d31 39 2024-09-13T02:52:40.579 INFO:tasks.workunit.client.0.smithi098.stdout:0/119: dread dd/f10 [0,4194304] 0 2024-09-13T02:52:40.582 INFO:tasks.workunit.client.1.smithi142.stdout:1/599: unlink d12/d13/d20/d66/c3b 0 2024-09-13T02:52:40.583 INFO:tasks.workunit.client.0.smithi098.stdout:0/120: dread dd/df/d1d/f1a [0,4194304] 0 2024-09-13T02:52:40.584 INFO:tasks.workunit.client.0.smithi098.stdout:7/297: rename d6/d24/d2a/d5a/f2e to d6/d24/f5f 0 2024-09-13T02:52:40.586 INFO:tasks.workunit.client.0.smithi098.stdout:9/128: creat d2/d6/f2d x:0 0 0 2024-09-13T02:52:40.590 INFO:tasks.workunit.client.0.smithi098.stdout:0/121: dwrite dd/df/f17 [0,4194304] 0 2024-09-13T02:52:40.590 INFO:tasks.workunit.client.0.smithi098.stdout:1/166: write d9/d12/f18 [1284119,10085] 0 2024-09-13T02:52:40.591 INFO:tasks.workunit.client.1.smithi142.stdout:9/610: mknod dd/d17/d44/d82/d99/cea 0 2024-09-13T02:52:40.591 INFO:tasks.workunit.client.0.smithi098.stdout:0/122: write fa [2287405,80191] 0 2024-09-13T02:52:40.596 INFO:tasks.workunit.client.1.smithi142.stdout:7/489: mkdir d10/d13/d1d/d2b/d56/d5f/da2 0 2024-09-13T02:52:40.597 INFO:tasks.workunit.client.0.smithi098.stdout:0/123: dread fa [0,4194304] 0 2024-09-13T02:52:40.597 INFO:tasks.workunit.client.1.smithi142.stdout:9/611: dwrite dd/d17/d4f/f7a [0,4194304] 0 2024-09-13T02:52:40.598 INFO:tasks.workunit.client.0.smithi098.stdout:5/126: rename d0/d1/d1a/f2b to d0/d1/d1a/d32/f33 0 2024-09-13T02:52:40.599 INFO:tasks.workunit.client.1.smithi142.stdout:9/612: truncate dd/d17/d69/f89 1796843 0 2024-09-13T02:52:40.599 INFO:tasks.workunit.client.0.smithi098.stdout:5/127: dread - d0/d15/d17/f26 zero size 2024-09-13T02:52:40.600 INFO:tasks.workunit.client.0.smithi098.stdout:5/128: dread - d0/d15/f18 zero size 2024-09-13T02:52:40.603 INFO:tasks.workunit.client.0.smithi098.stdout:8/151: truncate d2/dd/f17 2427369 0 2024-09-13T02:52:40.604 INFO:tasks.workunit.client.0.smithi098.stdout:2/120: sync 2024-09-13T02:52:40.606 INFO:tasks.workunit.client.0.smithi098.stdout:8/152: chown d2/la 3394701 1 2024-09-13T02:52:40.609 INFO:tasks.workunit.client.0.smithi098.stdout:2/121: dread d1/d1a/f7 [0,4194304] 0 2024-09-13T02:52:40.610 INFO:tasks.workunit.client.0.smithi098.stdout:5/129: dwrite d0/d1/f11 [0,4194304] 0 2024-09-13T02:52:40.614 INFO:tasks.workunit.client.1.smithi142.stdout:3/487: truncate d12/d16/d3c/f8d 464545 0 2024-09-13T02:52:40.615 INFO:tasks.workunit.client.0.smithi098.stdout:2/122: dread d1/d1a/f12 [0,4194304] 0 2024-09-13T02:52:40.615 INFO:tasks.workunit.client.1.smithi142.stdout:9/613: truncate dd/d17/d69/d84/f76 591271 0 2024-09-13T02:52:40.616 INFO:tasks.workunit.client.1.smithi142.stdout:6/537: sync 2024-09-13T02:52:40.616 INFO:tasks.workunit.client.1.smithi142.stdout:7/490: mkdir d10/d13/d1d/d25/d5c/da3 0 2024-09-13T02:52:40.619 INFO:tasks.workunit.client.0.smithi098.stdout:2/123: dread d1/f1d [0,4194304] 0 2024-09-13T02:52:40.620 INFO:tasks.workunit.client.1.smithi142.stdout:3/488: dread d12/d16/d25/d2e/d48/d5c/d66/f63 [0,4194304] 0 2024-09-13T02:52:40.620 INFO:tasks.workunit.client.1.smithi142.stdout:5/537: creat d8/d24/d26/fa8 x:0 0 0 2024-09-13T02:52:40.621 INFO:tasks.workunit.client.1.smithi142.stdout:5/538: fdatasync d8/d24/d3f/f95 0 2024-09-13T02:52:40.624 INFO:tasks.workunit.client.0.smithi098.stdout:2/124: dwrite d1/f1d [0,4194304] 0 2024-09-13T02:52:40.626 INFO:tasks.workunit.client.0.smithi098.stdout:0/124: unlink dd/l1c 0 2024-09-13T02:52:40.627 INFO:tasks.workunit.client.1.smithi142.stdout:4/490: truncate d0/d2b/d2d/d65/f1e 1743926 0 2024-09-13T02:52:40.628 INFO:tasks.workunit.client.0.smithi098.stdout:2/125: dread d1/f1d [0,4194304] 0 2024-09-13T02:52:40.628 INFO:tasks.workunit.client.0.smithi098.stdout:7/298: creat d6/d24/d2a/d5a/d4c/f60 x:0 0 0 2024-09-13T02:52:40.629 INFO:tasks.workunit.client.1.smithi142.stdout:3/489: fsync d12/d16/d25/d2e/d48/f52 0 2024-09-13T02:52:40.632 INFO:tasks.workunit.client.1.smithi142.stdout:5/539: symlink d8/d24/d26/d45/d62/la9 0 2024-09-13T02:52:40.634 INFO:tasks.workunit.client.1.smithi142.stdout:5/540: stat d8/d24/d26/d61/f71 0 2024-09-13T02:52:40.634 INFO:tasks.workunit.client.1.smithi142.stdout:1/600: rename d12/d1b to d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3 0 2024-09-13T02:52:40.634 INFO:tasks.workunit.client.1.smithi142.stdout:5/541: readlink d8/d24/l4e 0 2024-09-13T02:52:40.635 INFO:tasks.workunit.client.1.smithi142.stdout:1/601: chown d12/d13/d1d/f61 36114218 1 2024-09-13T02:52:40.635 INFO:tasks.workunit.client.1.smithi142.stdout:6/538: dread d1/dd/d16/d4e/d32/f40 [0,4194304] 0 2024-09-13T02:52:40.636 INFO:tasks.workunit.client.1.smithi142.stdout:6/539: chown d1/dd/d16/d4e 33743 1 2024-09-13T02:52:40.637 INFO:tasks.workunit.client.0.smithi098.stdout:8/153: mknod d2/d28/c2d 0 2024-09-13T02:52:40.640 INFO:tasks.workunit.client.1.smithi142.stdout:4/491: rmdir d0/d2b/d2d 39 2024-09-13T02:52:40.641 INFO:tasks.workunit.client.1.smithi142.stdout:1/602: dwrite d12/d13/d1d/f9c [0,4194304] 0 2024-09-13T02:52:40.644 INFO:tasks.workunit.client.1.smithi142.stdout:3/490: creat d12/d16/d3c/d7d/f96 x:0 0 0 2024-09-13T02:52:40.649 INFO:tasks.workunit.client.0.smithi098.stdout:1/167: dwrite d9/d33/f17 [0,4194304] 0 2024-09-13T02:52:40.651 INFO:tasks.workunit.client.0.smithi098.stdout:0/125: unlink fb 0 2024-09-13T02:52:40.654 INFO:tasks.workunit.client.1.smithi142.stdout:6/540: mkdir d1/dd/d53/d78/db7 0 2024-09-13T02:52:40.656 INFO:tasks.workunit.client.1.smithi142.stdout:7/491: creat d10/fa4 x:0 0 0 2024-09-13T02:52:40.658 INFO:tasks.workunit.client.1.smithi142.stdout:7/492: truncate d10/d13/d1d/d2b/d40/f8b 849451 0 2024-09-13T02:52:40.658 INFO:tasks.workunit.client.0.smithi098.stdout:7/299: creat d6/d24/d2a/d57/f61 x:0 0 0 2024-09-13T02:52:40.659 INFO:tasks.workunit.client.0.smithi098.stdout:7/300: readlink d6/d24/l59 0 2024-09-13T02:52:40.664 INFO:tasks.workunit.client.1.smithi142.stdout:5/542: dread d8/d24/f3d [0,4194304] 0 2024-09-13T02:52:40.664 INFO:tasks.workunit.client.1.smithi142.stdout:1/603: mknod d12/d13/d1d/d26/d4f/d72/cc4 0 2024-09-13T02:52:40.665 INFO:tasks.workunit.client.1.smithi142.stdout:1/604: dread - d12/d13/d20/d27/d3c/fb9 zero size 2024-09-13T02:52:40.665 INFO:tasks.workunit.client.0.smithi098.stdout:8/154: mkdir d2/dd/d2e 0 2024-09-13T02:52:40.666 INFO:tasks.workunit.client.1.smithi142.stdout:3/491: symlink d12/d16/d25/d2e/d38/d5a/l97 0 2024-09-13T02:52:40.668 INFO:tasks.workunit.client.1.smithi142.stdout:6/541: mkdir d1/dd/d53/d78/db8 0 2024-09-13T02:52:40.669 INFO:tasks.workunit.client.1.smithi142.stdout:6/542: write d1/f41 [2289404,120652] 0 2024-09-13T02:52:40.672 INFO:tasks.workunit.client.1.smithi142.stdout:3/492: dwrite d12/d16/d25/d2e/d48/f5f [0,4194304] 0 2024-09-13T02:52:40.678 INFO:tasks.workunit.client.1.smithi142.stdout:3/493: dread d12/f22 [0,4194304] 0 2024-09-13T02:52:40.680 INFO:tasks.workunit.client.0.smithi098.stdout:9/129: link d2/d6/cb d2/c2e 0 2024-09-13T02:52:40.684 INFO:tasks.workunit.client.0.smithi098.stdout:9/130: dread d2/d6/f1c [0,4194304] 0 2024-09-13T02:52:40.688 INFO:tasks.workunit.client.1.smithi142.stdout:5/543: mknod d8/d24/d3f/caa 0 2024-09-13T02:52:40.691 INFO:tasks.workunit.client.0.smithi098.stdout:2/126: getdents d1 0 2024-09-13T02:52:40.692 INFO:tasks.workunit.client.0.smithi098.stdout:0/126: write fa [1753598,28964] 0 2024-09-13T02:52:40.696 INFO:tasks.workunit.client.1.smithi142.stdout:4/492: rename d0/d2b/d21/d30/f4e to d0/d2b/d2d/f9f 0 2024-09-13T02:52:40.697 INFO:tasks.workunit.client.1.smithi142.stdout:7/493: truncate d10/d13/f20 3260187 0 2024-09-13T02:52:40.698 INFO:tasks.workunit.client.1.smithi142.stdout:1/605: dread d12/d13/d1d/d26/f6a [0,4194304] 0 2024-09-13T02:52:40.698 INFO:tasks.workunit.client.1.smithi142.stdout:3/494: unlink d12/l18 0 2024-09-13T02:52:40.698 INFO:tasks.workunit.client.1.smithi142.stdout:7/494: truncate d10/d13/d1d/d2b/d55/d32/f95 70882 0 2024-09-13T02:52:40.699 INFO:tasks.workunit.client.0.smithi098.stdout:9/131: getdents d2/d6/d2b 0 2024-09-13T02:52:40.701 INFO:tasks.workunit.client.0.smithi098.stdout:0/127: fdatasync dd/df/d1d/f1a 0 2024-09-13T02:52:40.701 INFO:tasks.workunit.client.0.smithi098.stdout:2/127: dread d1/f8 [0,4194304] 0 2024-09-13T02:52:40.701 INFO:tasks.workunit.client.1.smithi142.stdout:7/495: truncate d10/d13/d1d/d2b/d56/f85 107529 0 2024-09-13T02:52:40.702 INFO:tasks.workunit.client.0.smithi098.stdout:7/301: dwrite d6/fc [0,4194304] 0 2024-09-13T02:52:40.702 INFO:tasks.workunit.client.0.smithi098.stdout:9/132: creat d2/d6/f2f x:0 0 0 2024-09-13T02:52:40.704 INFO:tasks.workunit.client.1.smithi142.stdout:1/606: dwrite d12/d13/d20/d66/d55/da0/fb2 [4194304,4194304] 0 2024-09-13T02:52:40.707 INFO:tasks.workunit.client.1.smithi142.stdout:6/543: link d1/d7/d19/d52/f6f d1/dd/d53/d78/db8/fb9 0 2024-09-13T02:52:40.711 INFO:tasks.workunit.client.0.smithi098.stdout:7/302: dwrite d6/d24/d2a/d5a/f44 [0,4194304] 0 2024-09-13T02:52:40.712 INFO:tasks.workunit.client.1.smithi142.stdout:6/544: write d1/d59/fa3 [581780,74797] 0 2024-09-13T02:52:40.713 INFO:tasks.workunit.client.0.smithi098.stdout:2/128: unlink d1/d1a/d9/d15/f18 0 2024-09-13T02:52:40.714 INFO:tasks.workunit.client.0.smithi098.stdout:2/129: truncate d1/f8 2563001 0 2024-09-13T02:52:40.716 INFO:tasks.workunit.client.1.smithi142.stdout:5/544: rename d8/d24/d26/d2d/d90/l57 to d8/d24/lab 0 2024-09-13T02:52:40.718 INFO:tasks.workunit.client.0.smithi098.stdout:9/133: unlink d2/dd/fe 0 2024-09-13T02:52:40.720 INFO:tasks.workunit.client.1.smithi142.stdout:6/545: dwrite d1/d7/d42/fa4 [0,4194304] 0 2024-09-13T02:52:40.721 INFO:tasks.workunit.client.0.smithi098.stdout:0/128: creat dd/d1f/f25 x:0 0 0 2024-09-13T02:52:40.723 INFO:tasks.workunit.client.0.smithi098.stdout:7/303: creat d6/d1e/f62 x:0 0 0 2024-09-13T02:52:40.723 INFO:tasks.workunit.client.1.smithi142.stdout:1/607: fsync d12/d13/d20/d66/d55/f47 0 2024-09-13T02:52:40.724 INFO:tasks.workunit.client.0.smithi098.stdout:7/304: truncate d6/f10 4385002 0 2024-09-13T02:52:40.724 INFO:tasks.workunit.client.0.smithi098.stdout:2/130: mkdir d1/d1f 0 2024-09-13T02:52:40.727 INFO:tasks.workunit.client.1.smithi142.stdout:3/495: link d12/d16/d3c/d79/f83 d12/d16/d25/d2e/d48/d5c/d8c/f98 0 2024-09-13T02:52:40.732 INFO:tasks.workunit.client.0.smithi098.stdout:0/129: chown dd/ce 9 1 2024-09-13T02:52:40.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:40 smithi098 ceph-mon[27886]: pgmap v19: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 37 MiB/s rd, 185 MiB/s wr, 401 op/s 2024-09-13T02:52:40.733 INFO:tasks.workunit.client.1.smithi142.stdout:7/496: creat d10/d34/d57/d98/fa5 x:0 0 0 2024-09-13T02:52:40.734 INFO:tasks.workunit.client.0.smithi098.stdout:7/305: mkdir d6/d24/d63 0 2024-09-13T02:52:40.734 INFO:tasks.workunit.client.1.smithi142.stdout:3/496: dwrite d12/d16/f43 [0,4194304] 0 2024-09-13T02:52:40.734 INFO:tasks.workunit.client.0.smithi098.stdout:7/306: chown d6/d24/d2a/l4a 87 1 2024-09-13T02:52:40.737 INFO:tasks.workunit.client.0.smithi098.stdout:0/130: mkdir dd/df/d1d/d26 0 2024-09-13T02:52:40.737 INFO:tasks.workunit.client.1.smithi142.stdout:1/608: read - d12/d13/d45/f7c zero size 2024-09-13T02:52:40.737 INFO:tasks.workunit.client.0.smithi098.stdout:2/131: symlink d1/d1a/d9/d1e/l20 0 2024-09-13T02:52:40.739 INFO:tasks.workunit.client.1.smithi142.stdout:2/381: sync 2024-09-13T02:52:40.739 INFO:tasks.workunit.client.1.smithi142.stdout:0/510: sync 2024-09-13T02:52:40.739 INFO:tasks.workunit.client.0.smithi098.stdout:7/307: creat d6/d24/d46/f64 x:0 0 0 2024-09-13T02:52:40.740 INFO:tasks.workunit.client.0.smithi098.stdout:7/308: chown f5 1061461 1 2024-09-13T02:52:40.741 INFO:tasks.workunit.client.1.smithi142.stdout:8/417: sync 2024-09-13T02:52:40.741 INFO:tasks.workunit.client.1.smithi142.stdout:9/614: sync 2024-09-13T02:52:40.741 INFO:tasks.workunit.client.1.smithi142.stdout:2/382: stat d1/de/d1f/f63 0 2024-09-13T02:52:40.741 INFO:tasks.workunit.client.0.smithi098.stdout:7/309: chown d6/ff 33555217 1 2024-09-13T02:52:40.743 INFO:tasks.workunit.client.0.smithi098.stdout:2/132: creat d1/d1a/d9/d15/f21 x:0 0 0 2024-09-13T02:52:40.744 INFO:tasks.workunit.client.1.smithi142.stdout:7/497: dwrite d10/d13/d1d/d25/d5c/f9b [0,4194304] 0 2024-09-13T02:52:40.745 INFO:tasks.workunit.client.0.smithi098.stdout:0/131: dwrite fa [0,4194304] 0 2024-09-13T02:52:40.747 INFO:tasks.workunit.client.0.smithi098.stdout:0/132: write dd/f16 [1093933,40094] 0 2024-09-13T02:52:40.749 INFO:tasks.workunit.client.1.smithi142.stdout:9/615: dwrite dd/d17/d25/f62 [0,4194304] 0 2024-09-13T02:52:40.750 INFO:tasks.workunit.client.1.smithi142.stdout:9/616: dread - dd/d17/d68/f9b zero size 2024-09-13T02:52:40.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:40 smithi142 ceph-mon[33443]: pgmap v19: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 37 MiB/s rd, 185 MiB/s wr, 401 op/s 2024-09-13T02:52:40.752 INFO:tasks.workunit.client.0.smithi098.stdout:7/310: dwrite d6/fc [0,4194304] 0 2024-09-13T02:52:40.753 INFO:tasks.workunit.client.0.smithi098.stdout:2/133: symlink d1/d1a/d9/l22 0 2024-09-13T02:52:40.755 INFO:tasks.workunit.client.0.smithi098.stdout:2/134: chown d1/d1a/d9/d15/c1b 21 1 2024-09-13T02:52:40.756 INFO:tasks.workunit.client.1.smithi142.stdout:9/617: dwrite dd/d17/d25/f62 [0,4194304] 0 2024-09-13T02:52:40.757 INFO:tasks.workunit.client.1.smithi142.stdout:3/497: creat d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/f99 x:0 0 0 2024-09-13T02:52:40.758 INFO:tasks.workunit.client.1.smithi142.stdout:6/546: dread d1/d7/d19/f2f [4194304,4194304] 0 2024-09-13T02:52:40.759 INFO:tasks.workunit.client.1.smithi142.stdout:6/547: stat d1/d59 0 2024-09-13T02:52:40.762 INFO:tasks.workunit.client.0.smithi098.stdout:0/133: unlink dd/ce 0 2024-09-13T02:52:40.764 INFO:tasks.workunit.client.1.smithi142.stdout:2/383: symlink d1/d42/l81 0 2024-09-13T02:52:40.766 INFO:tasks.workunit.client.0.smithi098.stdout:7/311: mkdir d6/d24/d2a/d48/d65 0 2024-09-13T02:52:40.769 INFO:tasks.workunit.client.0.smithi098.stdout:0/134: dread dd/df/d1d/f1a [0,4194304] 0 2024-09-13T02:52:40.773 INFO:tasks.workunit.client.0.smithi098.stdout:2/135: mkdir d1/d1a/dc/d23 0 2024-09-13T02:52:40.776 INFO:tasks.workunit.client.1.smithi142.stdout:5/545: write d8/d24/d26/d2d/d90/f6f [104338,52901] 0 2024-09-13T02:52:40.776 INFO:tasks.workunit.client.0.smithi098.stdout:7/312: dwrite d6/d24/d2a/d57/f61 [0,4194304] 0 2024-09-13T02:52:40.779 INFO:tasks.workunit.client.1.smithi142.stdout:4/493: getdents d0/d7e 0 2024-09-13T02:52:40.780 INFO:tasks.workunit.client.0.smithi098.stdout:2/136: mkdir d1/d1a/d9/d24 0 2024-09-13T02:52:40.781 INFO:tasks.workunit.client.0.smithi098.stdout:9/134: dwrite d2/f10 [4194304,4194304] 0 2024-09-13T02:52:40.782 INFO:tasks.workunit.client.0.smithi098.stdout:0/135: mknod dd/df/d1d/d26/c27 0 2024-09-13T02:52:40.784 INFO:tasks.workunit.client.1.smithi142.stdout:5/546: dwrite d8/d24/d26/d2d/d90/fa1 [0,4194304] 0 2024-09-13T02:52:40.785 INFO:tasks.workunit.client.0.smithi098.stdout:7/313: mknod d6/d49/c66 0 2024-09-13T02:52:40.787 INFO:tasks.workunit.client.0.smithi098.stdout:0/136: dread fa [0,4194304] 0 2024-09-13T02:52:40.788 INFO:tasks.workunit.client.0.smithi098.stdout:2/137: write d1/f1d [1121664,20237] 0 2024-09-13T02:52:40.789 INFO:tasks.workunit.client.1.smithi142.stdout:4/494: dwrite d0/d2b/d2d/d65/f5e [0,4194304] 0 2024-09-13T02:52:40.791 INFO:tasks.workunit.client.1.smithi142.stdout:4/495: dread - d0/d2b/d21/d30/f7a zero size 2024-09-13T02:52:40.791 INFO:tasks.workunit.client.1.smithi142.stdout:4/496: stat d0/df/l1c 0 2024-09-13T02:52:40.792 INFO:tasks.workunit.client.1.smithi142.stdout:4/497: chown d0/d7e/c94 9 1 2024-09-13T02:52:40.794 INFO:tasks.workunit.client.1.smithi142.stdout:2/384: rename d1/de/d31/d46/l65 to d1/d2d/l82 0 2024-09-13T02:52:40.794 INFO:tasks.workunit.client.0.smithi098.stdout:0/137: dread dd/df/f18 [0,4194304] 0 2024-09-13T02:52:40.795 INFO:tasks.workunit.client.1.smithi142.stdout:2/385: stat d1/de/d1f/d13/f6b 0 2024-09-13T02:52:40.796 INFO:tasks.workunit.client.0.smithi098.stdout:7/314: mknod d6/d49/c67 0 2024-09-13T02:52:40.800 INFO:tasks.workunit.client.0.smithi098.stdout:9/135: getdents d2/d6/d2b 0 2024-09-13T02:52:40.800 INFO:tasks.workunit.client.0.smithi098.stdout:9/136: stat d2/d6 0 2024-09-13T02:52:40.801 INFO:tasks.workunit.client.1.smithi142.stdout:5/547: dread d8/d24/d3f/d4a/f50 [4194304,4194304] 0 2024-09-13T02:52:40.801 INFO:tasks.workunit.client.1.smithi142.stdout:7/498: symlink d10/d13/d1d/d2b/la6 0 2024-09-13T02:52:40.802 INFO:tasks.workunit.client.0.smithi098.stdout:7/315: dread d6/d1e/f23 [0,4194304] 0 2024-09-13T02:52:40.803 INFO:tasks.workunit.client.0.smithi098.stdout:0/138: unlink dd/df/d1d/l22 0 2024-09-13T02:52:40.809 INFO:tasks.workunit.client.1.smithi142.stdout:3/498: link d12/d16/d25/d2e/d38/d6b/f89 d12/d16/d25/d2e/d48/d5c/d8c/f9a 0 2024-09-13T02:52:40.809 INFO:tasks.workunit.client.1.smithi142.stdout:0/511: dwrite d10/d6c/d88/d45/f60 [4194304,4194304] 0 2024-09-13T02:52:40.810 INFO:tasks.workunit.client.1.smithi142.stdout:1/609: write d12/d13/d20/d66/d55/da0/fbb [927242,46948] 0 2024-09-13T02:52:40.810 INFO:tasks.workunit.client.0.smithi098.stdout:2/138: mknod d1/d1a/dc/d23/c25 0 2024-09-13T02:52:40.811 INFO:tasks.workunit.client.1.smithi142.stdout:3/499: write d12/d16/d25/d2e/d38/f45 [1791661,19539] 0 2024-09-13T02:52:40.812 INFO:tasks.workunit.client.0.smithi098.stdout:2/139: stat d1/d1a/d9/d15/f21 0 2024-09-13T02:52:40.812 INFO:tasks.workunit.client.0.smithi098.stdout:2/140: fsync d1/f8 0 2024-09-13T02:52:40.814 INFO:tasks.workunit.client.0.smithi098.stdout:9/137: creat d2/dd/f30 x:0 0 0 2024-09-13T02:52:40.817 INFO:tasks.workunit.client.0.smithi098.stdout:0/139: mkdir dd/df/d1d/d26/d28 0 2024-09-13T02:52:40.818 INFO:tasks.workunit.client.1.smithi142.stdout:5/548: mkdir d8/dac 0 2024-09-13T02:52:40.825 INFO:tasks.workunit.client.1.smithi142.stdout:1/610: rmdir d12/d13/d20/d27/d3c 39 2024-09-13T02:52:40.826 INFO:tasks.workunit.client.1.smithi142.stdout:0/512: dread d10/d6c/d88/f46 [0,4194304] 0 2024-09-13T02:52:40.826 INFO:tasks.workunit.client.1.smithi142.stdout:9/618: dread dd/d17/d25/d3e/f5d [0,4194304] 0 2024-09-13T02:52:40.827 INFO:tasks.workunit.client.1.smithi142.stdout:1/611: fsync d12/d13/d20/d66/d55/da0/f63 0 2024-09-13T02:52:40.828 INFO:tasks.workunit.client.1.smithi142.stdout:9/619: truncate dd/d17/d44/d95/fd3 189545 0 2024-09-13T02:52:40.829 INFO:tasks.workunit.client.1.smithi142.stdout:8/418: getdents d0/d6/dc/d40/d46 0 2024-09-13T02:52:40.830 INFO:tasks.workunit.client.0.smithi098.stdout:7/316: dread d6/d24/d2a/d48/f4e [0,4194304] 0 2024-09-13T02:52:40.831 INFO:tasks.workunit.client.1.smithi142.stdout:8/419: write d0/d6/dc/d45/d8/df/d28/f2d [325137,9752] 0 2024-09-13T02:52:40.833 INFO:tasks.workunit.client.0.smithi098.stdout:9/138: creat d2/d6/d2b/f31 x:0 0 0 2024-09-13T02:52:40.835 INFO:tasks.workunit.client.1.smithi142.stdout:7/499: rename d10/d13/f20 to d10/d13/d1d/d2b/d40/fa7 0 2024-09-13T02:52:40.835 INFO:tasks.workunit.client.0.smithi098.stdout:2/141: link d1/d1a/c5 d1/d1a/d9/d15/c26 0 2024-09-13T02:52:40.837 INFO:tasks.workunit.client.0.smithi098.stdout:7/317: symlink d6/d24/d2a/d57/l68 0 2024-09-13T02:52:40.842 INFO:tasks.workunit.client.0.smithi098.stdout:7/318: mkdir d6/d24/d2a/d57/d69 0 2024-09-13T02:52:40.845 INFO:tasks.workunit.client.1.smithi142.stdout:4/498: rename d0/d2b/d75/c7c to d0/d2b/d2d/d31/d43/ca0 0 2024-09-13T02:52:40.845 INFO:tasks.workunit.client.0.smithi098.stdout:2/142: mkdir d1/d1f/d27 0 2024-09-13T02:52:40.847 INFO:tasks.workunit.client.1.smithi142.stdout:3/500: rmdir d12/d16/d25/d2e/d38 39 2024-09-13T02:52:40.848 INFO:tasks.workunit.client.0.smithi098.stdout:7/319: fsync d6/d24/d2a/d5a/f1d 0 2024-09-13T02:52:40.849 INFO:tasks.workunit.client.1.smithi142.stdout:0/513: mkdir d10/d6c/d88/d21/daf 0 2024-09-13T02:52:40.850 INFO:tasks.workunit.client.0.smithi098.stdout:9/139: creat d2/f32 x:0 0 0 2024-09-13T02:52:40.851 INFO:tasks.workunit.client.1.smithi142.stdout:2/386: getdents d1/de/d31 0 2024-09-13T02:52:40.851 INFO:tasks.workunit.client.1.smithi142.stdout:2/387: chown d1/d42/d44 1318208597 1 2024-09-13T02:52:40.854 INFO:tasks.workunit.client.1.smithi142.stdout:1/612: unlink d12/d13/d20/d27/l3a 0 2024-09-13T02:52:40.856 INFO:tasks.workunit.client.1.smithi142.stdout:8/420: creat d0/d75/f86 x:0 0 0 2024-09-13T02:52:40.857 INFO:tasks.workunit.client.1.smithi142.stdout:8/421: write d0/d6/dc/f59 [4420411,106557] 0 2024-09-13T02:52:40.857 INFO:tasks.workunit.client.0.smithi098.stdout:7/320: write d6/d24/d2a/f3a [281397,113917] 0 2024-09-13T02:52:40.858 INFO:tasks.workunit.client.0.smithi098.stdout:7/321: readlink d6/d24/d2a/d48/l5e 0 2024-09-13T02:52:40.863 INFO:tasks.workunit.client.1.smithi142.stdout:4/499: rename d0/d2b/d2d/d65/d87/l93 to d0/d7e/la1 0 2024-09-13T02:52:40.864 INFO:tasks.workunit.client.1.smithi142.stdout:7/500: mkdir d10/d13/d1d/d25/d5c/da3/da8 0 2024-09-13T02:52:40.867 INFO:tasks.workunit.client.0.smithi098.stdout:7/322: creat d6/d24/d2a/d5a/d4c/f6a x:0 0 0 2024-09-13T02:52:40.867 INFO:tasks.workunit.client.1.smithi142.stdout:3/501: truncate d12/d16/d25/d2e/d38/d4d/d53/d78/f8a 619307 0 2024-09-13T02:52:40.867 INFO:tasks.workunit.client.1.smithi142.stdout:3/502: chown d12/d16/d25/d2e/d38/d5a 1 1 2024-09-13T02:52:40.868 INFO:tasks.workunit.client.1.smithi142.stdout:0/514: mknod d10/d6c/d88/d1a/d1e/cb0 0 2024-09-13T02:52:40.869 INFO:tasks.workunit.client.0.smithi098.stdout:6/107: sync 2024-09-13T02:52:40.871 INFO:tasks.workunit.client.0.smithi098.stdout:9/140: rename d2/c24 to d2/dd/d1b/c33 0 2024-09-13T02:52:40.872 INFO:tasks.workunit.client.0.smithi098.stdout:9/141: write d2/dd/f1e [3623426,105358] 0 2024-09-13T02:52:40.873 INFO:tasks.workunit.client.0.smithi098.stdout:0/140: mknod dd/c29 0 2024-09-13T02:52:40.874 INFO:tasks.workunit.client.0.smithi098.stdout:2/143: dwrite d1/d1a/f12 [4194304,4194304] 0 2024-09-13T02:52:40.875 INFO:tasks.workunit.client.0.smithi098.stdout:2/144: stat d1/d1f/d27 0 2024-09-13T02:52:40.875 INFO:tasks.workunit.client.0.smithi098.stdout:7/323: mknod d6/d24/d46/c6b 0 2024-09-13T02:52:40.876 INFO:tasks.workunit.client.1.smithi142.stdout:5/549: getdents d8/d24/d26/d2d 0 2024-09-13T02:52:40.876 INFO:tasks.workunit.client.0.smithi098.stdout:2/145: stat d1/d1a/d9/d24 0 2024-09-13T02:52:40.877 INFO:tasks.workunit.client.1.smithi142.stdout:6/548: sync 2024-09-13T02:52:40.879 INFO:tasks.workunit.client.1.smithi142.stdout:8/422: rename d0/d6/d23/d2b/l84 to d0/d6/dc/d45/d35/d61/l87 0 2024-09-13T02:52:40.882 INFO:tasks.workunit.client.1.smithi142.stdout:5/550: dread d8/d24/d26/f31 [0,4194304] 0 2024-09-13T02:52:40.884 INFO:tasks.workunit.client.0.smithi098.stdout:6/108: dread d5/d18/f1f [0,4194304] 0 2024-09-13T02:52:40.884 INFO:tasks.workunit.client.1.smithi142.stdout:7/501: fsync d10/d13/f1c 0 2024-09-13T02:52:40.888 INFO:tasks.workunit.client.1.smithi142.stdout:3/503: fsync d12/d16/f21 0 2024-09-13T02:52:40.888 INFO:tasks.workunit.client.1.smithi142.stdout:5/551: dwrite d8/d47/d65/f80 [4194304,4194304] 0 2024-09-13T02:52:40.890 INFO:tasks.workunit.client.1.smithi142.stdout:0/515: mknod d10/d6c/d88/d30/cb1 0 2024-09-13T02:52:40.891 INFO:tasks.workunit.client.1.smithi142.stdout:3/504: truncate d12/d16/d25/d2e/f7b 830328 0 2024-09-13T02:52:40.892 INFO:tasks.workunit.client.1.smithi142.stdout:3/505: read d12/d16/d25/d2e/d38/d6b/f8e [188716,15003] 0 2024-09-13T02:52:40.893 INFO:tasks.workunit.client.1.smithi142.stdout:0/516: dread d10/d6c/d88/d1a/d1e/d42/d4b/f74 [0,4194304] 0 2024-09-13T02:52:40.897 INFO:tasks.workunit.client.0.smithi098.stdout:2/146: rename d1/f1d to d1/d1a/dc/d23/f28 0 2024-09-13T02:52:40.898 INFO:tasks.workunit.client.1.smithi142.stdout:1/613: creat d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/fc5 x:0 0 0 2024-09-13T02:52:40.899 INFO:tasks.workunit.client.0.smithi098.stdout:6/109: creat d5/d13/f24 x:0 0 0 2024-09-13T02:52:40.899 INFO:tasks.workunit.client.1.smithi142.stdout:1/614: chown d12/d13/d1d/f61 993439 1 2024-09-13T02:52:40.900 INFO:tasks.workunit.client.1.smithi142.stdout:9/620: sync 2024-09-13T02:52:40.901 INFO:tasks.workunit.client.1.smithi142.stdout:1/615: write d12/d13/d1d/d26/f6a [582465,63664] 0 2024-09-13T02:52:40.901 INFO:tasks.workunit.client.1.smithi142.stdout:2/388: truncate d1/de/d1f/d13/d59/f6a 2394492 0 2024-09-13T02:52:40.902 INFO:tasks.workunit.client.0.smithi098.stdout:0/141: write dd/f20 [930975,84606] 0 2024-09-13T02:52:40.903 INFO:tasks.workunit.client.0.smithi098.stdout:9/142: dwrite d2/d6/f1d [0,4194304] 0 2024-09-13T02:52:40.904 INFO:tasks.workunit.client.1.smithi142.stdout:6/549: mknod d1/d7/d19/d48/cba 0 2024-09-13T02:52:40.904 INFO:tasks.workunit.client.0.smithi098.stdout:9/143: read d2/dd/f1e [3698874,114803] 0 2024-09-13T02:52:40.905 INFO:tasks.workunit.client.1.smithi142.stdout:8/423: readlink d0/d6/dc/d45/d8/l1c 0 2024-09-13T02:52:40.906 INFO:tasks.workunit.client.1.smithi142.stdout:4/500: mkdir d0/d2b/d2d/da2 0 2024-09-13T02:52:40.907 INFO:tasks.workunit.client.0.smithi098.stdout:2/147: creat d1/d1a/d9/d15/f29 x:0 0 0 2024-09-13T02:52:40.909 INFO:tasks.workunit.client.1.smithi142.stdout:7/502: rename d10/d13/d1d/d2b/d40/f80 to d10/d13/d1d/d25/d45/d6d/fa9 0 2024-09-13T02:52:40.911 INFO:tasks.workunit.client.0.smithi098.stdout:6/110: creat d5/d18/f25 x:0 0 0 2024-09-13T02:52:40.913 INFO:tasks.workunit.client.1.smithi142.stdout:3/506: dread d12/d16/f29 [0,4194304] 0 2024-09-13T02:52:40.913 INFO:tasks.workunit.client.1.smithi142.stdout:6/550: dwrite d1/dd/d16/f3c [0,4194304] 0 2024-09-13T02:52:40.915 INFO:tasks.workunit.client.0.smithi098.stdout:9/144: rmdir d2/d6/d2b 39 2024-09-13T02:52:40.920 INFO:tasks.workunit.client.1.smithi142.stdout:4/501: dwrite d0/df/d57/f22 [0,4194304] 0 2024-09-13T02:52:40.925 INFO:tasks.workunit.client.1.smithi142.stdout:3/507: dwrite d12/d16/f21 [0,4194304] 0 2024-09-13T02:52:40.933 INFO:tasks.workunit.client.0.smithi098.stdout:6/111: mknod d5/de/c26 0 2024-09-13T02:52:40.937 INFO:tasks.workunit.client.1.smithi142.stdout:5/552: link d8/d24/d26/f5c d8/d47/d65/fad 0 2024-09-13T02:52:40.939 INFO:tasks.workunit.client.0.smithi098.stdout:2/148: link d1/d1a/d9/d1e/l20 d1/d1a/d9/d1e/l2a 0 2024-09-13T02:52:40.941 INFO:tasks.workunit.client.1.smithi142.stdout:9/621: mkdir dd/d17/d25/deb 0 2024-09-13T02:52:40.942 INFO:tasks.workunit.client.1.smithi142.stdout:2/389: getdents d1/de/d1f/d13/d59 0 2024-09-13T02:52:40.943 INFO:tasks.workunit.client.0.smithi098.stdout:6/112: symlink d5/l27 0 2024-09-13T02:52:40.944 INFO:tasks.workunit.client.1.smithi142.stdout:2/390: write d1/de/f20 [2725976,86820] 0 2024-09-13T02:52:40.945 INFO:tasks.workunit.client.1.smithi142.stdout:4/502: symlink d0/d2b/d21/d35/la3 0 2024-09-13T02:52:40.945 INFO:tasks.workunit.client.1.smithi142.stdout:5/553: dwrite d8/d24/d26/f6a [0,4194304] 0 2024-09-13T02:52:40.946 INFO:tasks.workunit.client.0.smithi098.stdout:2/149: dwrite d1/d1a/d9/d15/f29 [0,4194304] 0 2024-09-13T02:52:40.947 INFO:tasks.workunit.client.1.smithi142.stdout:3/508: mkdir d12/d16/d3c/d79/d9b 0 2024-09-13T02:52:40.948 INFO:tasks.workunit.client.1.smithi142.stdout:4/503: dread - d0/d2b/d21/d30/f7a zero size 2024-09-13T02:52:40.948 INFO:tasks.workunit.client.0.smithi098.stdout:6/113: creat d5/d13/f28 x:0 0 0 2024-09-13T02:52:40.948 INFO:tasks.workunit.client.1.smithi142.stdout:8/424: rename d0/d6/dc/d2e/c52 to d0/d6/d23/d64/c88 0 2024-09-13T02:52:40.952 INFO:tasks.workunit.client.0.smithi098.stdout:2/150: rename d1/d1a/d9/d24 to d1/d1a/d9/d2b 0 2024-09-13T02:52:40.953 INFO:tasks.workunit.client.1.smithi142.stdout:9/622: dwrite dd/d17/d25/fbc [0,4194304] 0 2024-09-13T02:52:40.953 INFO:tasks.workunit.client.1.smithi142.stdout:0/517: sync 2024-09-13T02:52:40.954 INFO:tasks.workunit.client.1.smithi142.stdout:0/518: fdatasync d10/f7b 0 2024-09-13T02:52:40.957 INFO:tasks.workunit.client.0.smithi098.stdout:0/142: dwrite dd/f10 [0,4194304] 0 2024-09-13T02:52:40.961 INFO:tasks.workunit.client.0.smithi098.stdout:9/145: truncate d2/f10 427671 0 2024-09-13T02:52:40.964 INFO:tasks.workunit.client.0.smithi098.stdout:2/151: dwrite d1/d1a/f12 [4194304,4194304] 0 2024-09-13T02:52:40.966 INFO:tasks.workunit.client.1.smithi142.stdout:2/391: creat d1/d29/f83 x:0 0 0 2024-09-13T02:52:40.971 INFO:tasks.workunit.client.0.smithi098.stdout:2/152: dread d1/d1a/f12 [4194304,4194304] 0 2024-09-13T02:52:40.972 INFO:tasks.workunit.client.0.smithi098.stdout:9/146: mknod d2/dd/d1b/c34 0 2024-09-13T02:52:40.974 INFO:tasks.workunit.client.0.smithi098.stdout:0/143: dread dd/df/f17 [0,4194304] 0 2024-09-13T02:52:40.975 INFO:tasks.workunit.client.0.smithi098.stdout:6/114: link d5/d13/f28 d5/de/d14/f29 0 2024-09-13T02:52:40.978 INFO:tasks.workunit.client.1.smithi142.stdout:1/616: getdents d12/d13/d20/d27/d3c/d71/d81/d92 0 2024-09-13T02:52:40.979 INFO:tasks.workunit.client.0.smithi098.stdout:0/144: mknod dd/df/c2a 0 2024-09-13T02:52:40.982 INFO:tasks.workunit.client.0.smithi098.stdout:6/115: dwrite d5/d18/f25 [0,4194304] 0 2024-09-13T02:52:40.984 INFO:tasks.workunit.client.1.smithi142.stdout:6/551: rename d1/dd/d53/d78/c89 to d1/d7/d5f/d60/d76/d7e/cbb 0 2024-09-13T02:52:40.987 INFO:tasks.workunit.client.1.smithi142.stdout:7/503: getdents d10/d64 0 2024-09-13T02:52:40.988 INFO:tasks.workunit.client.0.smithi098.stdout:9/147: creat d2/d6/f35 x:0 0 0 2024-09-13T02:52:40.989 INFO:tasks.workunit.client.0.smithi098.stdout:6/116: rmdir d5/de/d14 39 2024-09-13T02:52:40.991 INFO:tasks.workunit.client.1.smithi142.stdout:5/554: creat d8/d24/d26/fae x:0 0 0 2024-09-13T02:52:40.992 INFO:tasks.workunit.client.0.smithi098.stdout:6/117: creat d5/d18/f2a x:0 0 0 2024-09-13T02:52:40.993 INFO:tasks.workunit.client.0.smithi098.stdout:9/148: mkdir d2/d6/d36 0 2024-09-13T02:52:40.993 INFO:tasks.workunit.client.0.smithi098.stdout:6/118: write d5/d13/f1c [477232,47257] 0 2024-09-13T02:52:40.994 INFO:tasks.workunit.client.0.smithi098.stdout:9/149: fdatasync d2/dd/f1f 0 2024-09-13T02:52:40.994 INFO:tasks.workunit.client.0.smithi098.stdout:6/119: chown f3 1097442 1 2024-09-13T02:52:40.995 INFO:tasks.workunit.client.1.smithi142.stdout:4/504: rename d0/df/d57/f2f to d0/d2b/d2d/d31/d43/fa4 0 2024-09-13T02:52:40.997 INFO:tasks.workunit.client.1.smithi142.stdout:7/504: chown d10/d13/d1d/d44/f9a 1059852 1 2024-09-13T02:52:40.997 INFO:tasks.workunit.client.1.smithi142.stdout:4/505: readlink d0/d2b/d2d/d31/d32/l44 0 2024-09-13T02:52:40.998 INFO:tasks.workunit.client.1.smithi142.stdout:5/555: dwrite d8/d24/d3f/f8f [0,4194304] 0 2024-09-13T02:52:40.998 INFO:tasks.workunit.client.0.smithi098.stdout:6/120: unlink d5/f9 0 2024-09-13T02:52:40.999 INFO:tasks.workunit.client.1.smithi142.stdout:4/506: chown d0/d2b/c80 2544 1 2024-09-13T02:52:41.001 INFO:tasks.workunit.client.0.smithi098.stdout:6/121: mkdir d5/d13/d2b 0 2024-09-13T02:52:41.004 INFO:tasks.workunit.client.0.smithi098.stdout:9/150: creat d2/d6/d2b/f37 x:0 0 0 2024-09-13T02:52:41.005 INFO:tasks.workunit.client.1.smithi142.stdout:3/509: sync 2024-09-13T02:52:41.005 INFO:tasks.workunit.client.1.smithi142.stdout:6/552: mknod d1/d7/d42/d88/cbc 0 2024-09-13T02:52:41.006 INFO:tasks.workunit.client.1.smithi142.stdout:4/507: dwrite d0/f8e [0,4194304] 0 2024-09-13T02:52:41.011 INFO:tasks.workunit.client.1.smithi142.stdout:9/623: rename dd/d17/d5f/le0 to dd/d17/d44/d82/d99/da8/db7/lec 0 2024-09-13T02:52:41.011 INFO:tasks.workunit.client.0.smithi098.stdout:6/122: rmdir d5/de/d14 39 2024-09-13T02:52:41.012 INFO:tasks.workunit.client.0.smithi098.stdout:6/123: dread - d5/d13/f24 zero size 2024-09-13T02:52:41.012 INFO:tasks.workunit.client.1.smithi142.stdout:9/624: chown dd/d17/d69/d84 3260 1 2024-09-13T02:52:41.013 INFO:tasks.workunit.client.1.smithi142.stdout:7/505: symlink d10/d13/d1d/d2b/d56/laa 0 2024-09-13T02:52:41.015 INFO:tasks.workunit.client.1.smithi142.stdout:7/506: write d10/d13/d1d/d2b/d56/d5f/d73/f91 [936857,67986] 0 2024-09-13T02:52:41.017 INFO:tasks.workunit.client.0.smithi098.stdout:9/151: creat d2/d6/d36/f38 x:0 0 0 2024-09-13T02:52:41.018 INFO:tasks.workunit.client.1.smithi142.stdout:1/617: creat d12/d13/d1d/fc6 x:0 0 0 2024-09-13T02:52:41.021 INFO:tasks.workunit.client.0.smithi098.stdout:6/124: dwrite d5/d18/f2a [0,4194304] 0 2024-09-13T02:52:41.023 INFO:tasks.workunit.client.1.smithi142.stdout:5/556: rename d8/d24/d26/d2d/l48 to d8/d24/d26/d2d/laf 0 2024-09-13T02:52:41.027 INFO:tasks.workunit.client.0.smithi098.stdout:9/152: rename d2/dd/d1b to d2/dd/d39 0 2024-09-13T02:52:41.027 INFO:tasks.workunit.client.0.smithi098.stdout:9/153: chown d2/d6/d36 7078 1 2024-09-13T02:52:41.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/154: write d2/d6/f19 [116572,121929] 0 2024-09-13T02:52:41.029 INFO:tasks.workunit.client.1.smithi142.stdout:8/425: write d0/d6/dc/d45/f3c [863434,64591] 0 2024-09-13T02:52:41.032 INFO:tasks.workunit.client.1.smithi142.stdout:6/553: unlink d1/d7/f3a 0 2024-09-13T02:52:41.034 INFO:tasks.workunit.client.0.smithi098.stdout:9/155: mknod d2/d6/d36/c3a 0 2024-09-13T02:52:41.037 INFO:tasks.workunit.client.1.smithi142.stdout:3/510: creat d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/f9c x:0 0 0 2024-09-13T02:52:41.038 INFO:tasks.workunit.client.1.smithi142.stdout:2/392: dwrite d1/de/f22 [0,4194304] 0 2024-09-13T02:52:41.039 INFO:tasks.workunit.client.0.smithi098.stdout:0/145: write fc [1531767,65957] 0 2024-09-13T02:52:41.039 INFO:tasks.workunit.client.1.smithi142.stdout:3/511: chown d12/d16/d25/d2e/d48/d5c/d8c/f98 4 1 2024-09-13T02:52:41.041 INFO:tasks.workunit.client.1.smithi142.stdout:9/625: mkdir dd/d17/d68/ded 0 2024-09-13T02:52:41.041 INFO:tasks.workunit.client.0.smithi098.stdout:0/146: truncate fa 4875660 0 2024-09-13T02:52:41.041 INFO:tasks.workunit.client.0.smithi098.stdout:9/156: dwrite d2/d6/f1d [4194304,4194304] 0 2024-09-13T02:52:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:9/157: chown d2/d6/d36 506144 1 2024-09-13T02:52:41.044 INFO:tasks.workunit.client.1.smithi142.stdout:2/393: dread d1/d2d/f64 [0,4194304] 0 2024-09-13T02:52:41.045 INFO:tasks.workunit.client.1.smithi142.stdout:1/618: unlink d12/fa4 0 2024-09-13T02:52:41.050 INFO:tasks.workunit.client.0.smithi098.stdout:0/147: write fa [71765,52741] 0 2024-09-13T02:52:41.050 INFO:tasks.workunit.client.1.smithi142.stdout:0/519: dwrite fd [0,4194304] 0 2024-09-13T02:52:41.051 INFO:tasks.workunit.client.0.smithi098.stdout:9/158: dwrite d2/d6/f2a [0,4194304] 0 2024-09-13T02:52:41.054 INFO:tasks.workunit.client.1.smithi142.stdout:5/557: dread d8/d24/d3f/d4a/d4b/f56 [0,4194304] 0 2024-09-13T02:52:41.056 INFO:tasks.workunit.client.1.smithi142.stdout:4/508: mkdir d0/df/da5 0 2024-09-13T02:52:41.056 INFO:tasks.workunit.client.1.smithi142.stdout:1/619: dwrite d12/d13/d45/f7c [0,4194304] 0 2024-09-13T02:52:41.057 INFO:tasks.workunit.client.1.smithi142.stdout:5/558: dread - d8/d24/d26/fa8 zero size 2024-09-13T02:52:41.060 INFO:tasks.workunit.client.0.smithi098.stdout:9/159: creat d2/dd/f3b x:0 0 0 2024-09-13T02:52:41.063 INFO:tasks.workunit.client.0.smithi098.stdout:0/148: rename dd/c1b to dd/df/c2b 0 2024-09-13T02:52:41.074 INFO:tasks.workunit.client.1.smithi142.stdout:2/394: creat d1/d42/d44/f84 x:0 0 0 2024-09-13T02:52:41.077 INFO:tasks.workunit.client.0.smithi098.stdout:6/125: write d5/d18/f1f [632443,23773] 0 2024-09-13T02:52:41.079 INFO:tasks.workunit.client.0.smithi098.stdout:9/160: symlink d2/d6/l3c 0 2024-09-13T02:52:41.082 INFO:tasks.workunit.client.1.smithi142.stdout:8/426: symlink d0/d6/dc/d45/d35/d7e/l89 0 2024-09-13T02:52:41.084 INFO:tasks.workunit.client.0.smithi098.stdout:9/161: symlink d2/d6/d2b/l3d 0 2024-09-13T02:52:41.085 INFO:tasks.workunit.client.0.smithi098.stdout:6/126: dread d5/d18/f25 [0,4194304] 0 2024-09-13T02:52:41.086 INFO:tasks.workunit.client.0.smithi098.stdout:6/127: truncate d5/d18/f25 5101649 0 2024-09-13T02:52:41.087 INFO:tasks.workunit.client.0.smithi098.stdout:6/128: write d5/f22 [50466,67021] 0 2024-09-13T02:52:41.088 INFO:tasks.workunit.client.1.smithi142.stdout:0/520: rmdir d10/d6c/d88/d21/d8f 39 2024-09-13T02:52:41.090 INFO:tasks.workunit.client.0.smithi098.stdout:9/162: rmdir d2/dd/d39 39 2024-09-13T02:52:41.091 INFO:tasks.workunit.client.0.smithi098.stdout:9/163: fdatasync d2/f28 0 2024-09-13T02:52:41.092 INFO:tasks.workunit.client.1.smithi142.stdout:6/554: rename d1/dd/f22 to d1/dd/d16/d4e/d32/fbd 0 2024-09-13T02:52:41.092 INFO:tasks.workunit.client.1.smithi142.stdout:6/555: chown d1/dd/d16/f1c 10918380 1 2024-09-13T02:52:41.095 INFO:tasks.workunit.client.1.smithi142.stdout:7/507: truncate d10/d64/f82 2604112 0 2024-09-13T02:52:41.098 INFO:tasks.workunit.client.1.smithi142.stdout:5/559: fdatasync d8/d47/f4f 0 2024-09-13T02:52:41.101 INFO:tasks.workunit.client.1.smithi142.stdout:3/512: symlink d12/l9d 0 2024-09-13T02:52:41.102 INFO:tasks.workunit.client.0.smithi098.stdout:6/129: symlink d5/de/l2c 0 2024-09-13T02:52:41.104 INFO:tasks.workunit.client.0.smithi098.stdout:9/164: creat d2/dd/d39/f3e x:0 0 0 2024-09-13T02:52:41.105 INFO:tasks.workunit.client.0.smithi098.stdout:9/165: write d2/d6/d2b/f37 [219280,81235] 0 2024-09-13T02:52:41.109 INFO:tasks.workunit.client.1.smithi142.stdout:0/521: write d10/d6c/d88/d21/d51/f3e [1307348,107561] 0 2024-09-13T02:52:41.110 INFO:tasks.workunit.client.1.smithi142.stdout:1/620: write d12/d13/d20/d66/d7d/f85 [993122,44312] 0 2024-09-13T02:52:41.111 INFO:tasks.workunit.client.1.smithi142.stdout:8/427: rename d0/d6/l25 to d0/d6/dc/d40/d46/d6c/l8a 0 2024-09-13T02:52:41.113 INFO:tasks.workunit.client.1.smithi142.stdout:4/509: creat d0/df/da5/fa6 x:0 0 0 2024-09-13T02:52:41.114 INFO:tasks.workunit.client.0.smithi098.stdout:6/130: creat d5/d13/d2b/f2d x:0 0 0 2024-09-13T02:52:41.114 INFO:tasks.workunit.client.0.smithi098.stdout:0/149: write dd/df/f18 [235017,71181] 0 2024-09-13T02:52:41.115 INFO:tasks.workunit.client.0.smithi098.stdout:0/150: write f4 [224111,21590] 0 2024-09-13T02:52:41.115 INFO:tasks.workunit.client.1.smithi142.stdout:6/556: creat d1/dd/fbe x:0 0 0 2024-09-13T02:52:41.117 INFO:tasks.workunit.client.0.smithi098.stdout:6/131: mknod d5/d13/d2b/c2e 0 2024-09-13T02:52:41.118 INFO:tasks.workunit.client.1.smithi142.stdout:8/428: dwrite d0/d6/f2a [0,4194304] 0 2024-09-13T02:52:41.120 INFO:tasks.workunit.client.1.smithi142.stdout:9/626: getdents dd/d17/d4f 0 2024-09-13T02:52:41.122 INFO:tasks.workunit.client.1.smithi142.stdout:7/508: dwrite d10/d13/d1d/d25/d45/d6d/fa9 [0,4194304] 0 2024-09-13T02:52:41.123 INFO:tasks.workunit.client.1.smithi142.stdout:2/395: truncate d1/de/d1f/d13/d59/f6a 1908856 0 2024-09-13T02:52:41.124 INFO:tasks.workunit.client.1.smithi142.stdout:9/627: truncate dd/d17/d44/d82/d99/daf/fb6 968401 0 2024-09-13T02:52:41.125 INFO:tasks.workunit.client.0.smithi098.stdout:6/132: rename d5/de/d14/l19 to d5/de/d14/l2f 0 2024-09-13T02:52:41.128 INFO:tasks.workunit.client.0.smithi098.stdout:6/133: read d5/f1b [2074576,67368] 0 2024-09-13T02:52:41.129 INFO:tasks.workunit.client.0.smithi098.stdout:0/151: creat dd/f2c x:0 0 0 2024-09-13T02:52:41.133 INFO:tasks.workunit.client.1.smithi142.stdout:1/621: creat d12/d13/d1d/d26/d4f/fc7 x:0 0 0 2024-09-13T02:52:41.135 INFO:tasks.workunit.client.1.smithi142.stdout:1/622: fsync d12/d13/d20/d66/d55/da0/f6f 0 2024-09-13T02:52:41.136 INFO:tasks.workunit.client.1.smithi142.stdout:4/510: mknod d0/d2b/d2d/d31/d32/ca7 0 2024-09-13T02:52:41.137 INFO:tasks.workunit.client.1.smithi142.stdout:6/557: symlink d1/d7/d42/lbf 0 2024-09-13T02:52:41.138 INFO:tasks.workunit.client.1.smithi142.stdout:5/560: dwrite d8/d24/f3e [4194304,4194304] 0 2024-09-13T02:52:41.138 INFO:tasks.workunit.client.0.smithi098.stdout:0/152: creat dd/f2d x:0 0 0 2024-09-13T02:52:41.140 INFO:tasks.workunit.client.1.smithi142.stdout:5/561: chown d8/d24/d26/d2d/f2f 137 1 2024-09-13T02:52:41.143 INFO:tasks.workunit.client.1.smithi142.stdout:7/509: truncate d10/d64/f7c 895563 0 2024-09-13T02:52:41.145 INFO:tasks.workunit.client.1.smithi142.stdout:5/562: read - d8/d24/d26/d45/d81/d8c/fa4 zero size 2024-09-13T02:52:41.146 INFO:tasks.workunit.client.1.smithi142.stdout:9/628: dread - dd/f7e zero size 2024-09-13T02:52:41.148 INFO:tasks.workunit.client.0.smithi098.stdout:0/153: link dd/f20 dd/df/d1d/d26/d28/f2e 0 2024-09-13T02:52:41.149 INFO:tasks.workunit.client.1.smithi142.stdout:5/563: chown d8/d24/d26/d45/d81/d8c/d8d 64778806 1 2024-09-13T02:52:41.151 INFO:tasks.workunit.client.1.smithi142.stdout:6/558: dwrite d1/dd/d16/d4e/d32/f64 [0,4194304] 0 2024-09-13T02:52:41.151 INFO:tasks.workunit.client.1.smithi142.stdout:8/429: dwrite d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:41.157 INFO:tasks.workunit.client.0.smithi098.stdout:0/154: dwrite fa [0,4194304] 0 2024-09-13T02:52:41.160 INFO:tasks.workunit.client.1.smithi142.stdout:5/564: dwrite d8/d24/f3e [0,4194304] 0 2024-09-13T02:52:41.163 INFO:tasks.workunit.client.0.smithi098.stdout:6/134: dread f4 [0,4194304] 0 2024-09-13T02:52:41.164 INFO:tasks.workunit.client.1.smithi142.stdout:7/510: rename d10/d13/d1d/d2b/d55/d32/c71 to d10/d13/d1d/d2b/d56/d5f/da2/cab 0 2024-09-13T02:52:41.164 INFO:tasks.workunit.client.1.smithi142.stdout:9/629: dwrite dd/f36 [0,4194304] 0 2024-09-13T02:52:41.165 INFO:tasks.workunit.client.1.smithi142.stdout:6/559: creat d1/d7/d19/d52/fc0 x:0 0 0 2024-09-13T02:52:41.167 INFO:tasks.workunit.client.0.smithi098.stdout:0/155: creat dd/df/d1d/f2f x:0 0 0 2024-09-13T02:52:41.169 INFO:tasks.workunit.client.0.smithi098.stdout:6/135: rmdir d5/de/d14 39 2024-09-13T02:52:41.173 INFO:tasks.workunit.client.1.smithi142.stdout:9/630: dwrite dd/d17/d25/f42 [4194304,4194304] 0 2024-09-13T02:52:41.174 INFO:tasks.workunit.client.0.smithi098.stdout:0/156: rename dd/df/f17 to dd/df/d1d/d26/d28/f30 0 2024-09-13T02:52:41.174 INFO:tasks.workunit.client.0.smithi098.stdout:0/157: readlink l9 0 2024-09-13T02:52:41.179 INFO:tasks.workunit.client.0.smithi098.stdout:6/136: creat d5/d18/f30 x:0 0 0 2024-09-13T02:52:41.180 INFO:tasks.workunit.client.1.smithi142.stdout:7/511: rmdir d10/d13/d1d/d2b/d55/d32/d7e/d9c 39 2024-09-13T02:52:41.180 INFO:tasks.workunit.client.0.smithi098.stdout:6/137: chown d5/ca 433780 1 2024-09-13T02:52:41.182 INFO:tasks.workunit.client.1.smithi142.stdout:7/512: write d10/d13/d1d/d2b/d56/d41/f68 [2954289,5991] 0 2024-09-13T02:52:41.187 INFO:tasks.workunit.client.0.smithi098.stdout:6/138: dwrite d5/fc [0,4194304] 0 2024-09-13T02:52:41.191 INFO:tasks.workunit.client.1.smithi142.stdout:0/522: truncate d10/f7c 2723060 0 2024-09-13T02:52:41.193 INFO:tasks.workunit.client.0.smithi098.stdout:6/139: unlink d5/d13/f24 0 2024-09-13T02:52:41.193 INFO:tasks.workunit.client.1.smithi142.stdout:1/623: write d12/d13/f3f [4851,82300] 0 2024-09-13T02:52:41.194 INFO:tasks.workunit.client.1.smithi142.stdout:3/513: dwrite d12/d16/d3c/f8d [0,4194304] 0 2024-09-13T02:52:41.198 INFO:tasks.workunit.client.1.smithi142.stdout:2/396: truncate d1/f35 8048 0 2024-09-13T02:52:41.202 INFO:tasks.workunit.client.0.smithi098.stdout:6/140: creat d5/f31 x:0 0 0 2024-09-13T02:52:41.203 INFO:tasks.workunit.client.0.smithi098.stdout:6/141: write d5/d13/f1c [645927,51139] 0 2024-09-13T02:52:41.205 INFO:tasks.workunit.client.1.smithi142.stdout:0/523: mkdir d10/d6c/d88/d45/db2 0 2024-09-13T02:52:41.208 INFO:tasks.workunit.client.0.smithi098.stdout:6/142: rename d5/d18/l20 to d5/d18/l32 0 2024-09-13T02:52:41.211 INFO:tasks.workunit.client.1.smithi142.stdout:3/514: mkdir d12/d16/d3c/d79/d9e 0 2024-09-13T02:52:41.211 INFO:tasks.workunit.client.1.smithi142.stdout:2/397: fsync d1/de/f10 0 2024-09-13T02:52:41.213 INFO:tasks.workunit.client.1.smithi142.stdout:0/524: mkdir d10/d6c/d88/d45/db3 0 2024-09-13T02:52:41.213 INFO:tasks.workunit.client.1.smithi142.stdout:4/511: sync 2024-09-13T02:52:41.213 INFO:tasks.workunit.client.1.smithi142.stdout:8/430: sync 2024-09-13T02:52:41.214 INFO:tasks.workunit.client.1.smithi142.stdout:2/398: truncate d1/de/d1f/d13/f5e 37778 0 2024-09-13T02:52:41.214 INFO:tasks.workunit.client.0.smithi098.stdout:6/143: creat d5/f33 x:0 0 0 2024-09-13T02:52:41.214 INFO:tasks.workunit.client.0.smithi098.stdout:6/144: dread - d5/f33 zero size 2024-09-13T02:52:41.215 INFO:tasks.workunit.client.1.smithi142.stdout:4/512: write d0/d2b/d2d/d31/d43/d48/f68 [571126,109175] 0 2024-09-13T02:52:41.219 INFO:tasks.workunit.client.1.smithi142.stdout:4/513: write d0/d2b/d2d/d31/d32/d82/f86 [1460534,88386] 0 2024-09-13T02:52:41.221 INFO:tasks.workunit.client.1.smithi142.stdout:8/431: dwrite d0/d6/dc/d45/d35/f63 [0,4194304] 0 2024-09-13T02:52:41.222 INFO:tasks.workunit.client.0.smithi098.stdout:6/145: dwrite f4 [0,4194304] 0 2024-09-13T02:52:41.223 INFO:tasks.workunit.client.1.smithi142.stdout:8/432: write d0/d6/dc/d45/f3 [1346530,129731] 0 2024-09-13T02:52:41.230 INFO:tasks.workunit.client.1.smithi142.stdout:7/513: dread d10/d13/f1e [0,4194304] 0 2024-09-13T02:52:41.231 INFO:tasks.workunit.client.0.smithi098.stdout:6/146: dread d5/fb [0,4194304] 0 2024-09-13T02:52:41.236 INFO:tasks.workunit.client.1.smithi142.stdout:3/515: rename d12/d16/d3c/l3d to d12/d16/d3c/d7d/d91/l9f 0 2024-09-13T02:52:41.237 INFO:tasks.workunit.client.1.smithi142.stdout:6/560: dwrite d1/dd/d57/f91 [0,4194304] 0 2024-09-13T02:52:41.239 INFO:tasks.workunit.client.1.smithi142.stdout:2/399: unlink d1/de/d31/d6c/d6d/l38 0 2024-09-13T02:52:41.240 INFO:tasks.workunit.client.0.smithi098.stdout:6/147: creat d5/de/d14/f34 x:0 0 0 2024-09-13T02:52:41.241 INFO:tasks.workunit.client.1.smithi142.stdout:5/565: dwrite d8/d24/d3f/f75 [0,4194304] 0 2024-09-13T02:52:41.241 INFO:tasks.workunit.client.0.smithi098.stdout:6/148: dread - d5/f15 zero size 2024-09-13T02:52:41.241 INFO:tasks.workunit.client.1.smithi142.stdout:9/631: write dd/d17/d5f/d7b/f7f [2422717,10197] 0 2024-09-13T02:52:41.242 INFO:tasks.workunit.client.0.smithi098.stdout:6/149: write d5/d18/f1f [389020,48475] 0 2024-09-13T02:52:41.243 INFO:tasks.workunit.client.0.smithi098.stdout:6/150: chown d5/c7 39212662 1 2024-09-13T02:52:41.245 INFO:tasks.workunit.client.1.smithi142.stdout:9/632: chown dd/d17/d44/l50 236640314 1 2024-09-13T02:52:41.246 INFO:tasks.workunit.client.1.smithi142.stdout:1/624: dread fe [0,4194304] 0 2024-09-13T02:52:41.247 INFO:tasks.workunit.client.1.smithi142.stdout:3/516: dwrite d12/d16/d25/f40 [4194304,4194304] 0 2024-09-13T02:52:41.248 INFO:tasks.workunit.client.1.smithi142.stdout:1/625: chown d12/d13/d1d/fc6 17856 1 2024-09-13T02:52:41.248 INFO:tasks.workunit.client.1.smithi142.stdout:3/517: readlink d12/d16/d25/l4e 0 2024-09-13T02:52:41.248 INFO:tasks.workunit.client.1.smithi142.stdout:9/633: dread - dd/d17/d44/d82/d99/daf/fbe zero size 2024-09-13T02:52:41.251 INFO:tasks.workunit.client.0.smithi098.stdout:6/151: creat d5/de/d14/f35 x:0 0 0 2024-09-13T02:52:41.251 INFO:tasks.workunit.client.1.smithi142.stdout:8/433: symlink d0/d6/dc/d40/d41/l8b 0 2024-09-13T02:52:41.252 INFO:tasks.workunit.client.0.smithi098.stdout:6/152: chown f4 80132663 1 2024-09-13T02:52:41.253 INFO:tasks.workunit.client.0.smithi098.stdout:6/153: write d5/fc [4622416,100951] 0 2024-09-13T02:52:41.257 INFO:tasks.workunit.client.1.smithi142.stdout:4/514: rename d0/d2b/f74 to d0/d2b/d21/d30/fa8 0 2024-09-13T02:52:41.261 INFO:tasks.workunit.client.0.smithi098.stdout:6/154: mkdir d5/d36 0 2024-09-13T02:52:41.262 INFO:tasks.workunit.client.1.smithi142.stdout:6/561: mkdir d1/dd/d53/d78/d8f/da8/dc1 0 2024-09-13T02:52:41.266 INFO:tasks.workunit.client.1.smithi142.stdout:2/400: dread d1/de/d31/f3d [4194304,4194304] 0 2024-09-13T02:52:41.266 INFO:tasks.workunit.client.1.smithi142.stdout:2/401: chown d1/d29/f30 2 1 2024-09-13T02:52:41.267 INFO:tasks.workunit.client.1.smithi142.stdout:2/402: dread - d1/d29/f83 zero size 2024-09-13T02:52:41.268 INFO:tasks.workunit.client.1.smithi142.stdout:7/514: rename d10/d13/d1d/l3e to d10/d13/d1d/d2b/d40/lac 0 2024-09-13T02:52:41.269 INFO:tasks.workunit.client.0.smithi098.stdout:6/155: creat d5/de/f37 x:0 0 0 2024-09-13T02:52:41.270 INFO:tasks.workunit.client.1.smithi142.stdout:0/525: creat d10/d6c/d88/d21/fb4 x:0 0 0 2024-09-13T02:52:41.271 INFO:tasks.workunit.client.1.smithi142.stdout:0/526: fdatasync d10/d6c/d88/d21/d51/f3e 0 2024-09-13T02:52:41.271 INFO:tasks.workunit.client.1.smithi142.stdout:6/562: fsync d1/dd/d16/f9f 0 2024-09-13T02:52:41.274 INFO:tasks.workunit.client.1.smithi142.stdout:2/403: mkdir d1/d42/d85 0 2024-09-13T02:52:41.276 INFO:tasks.workunit.client.1.smithi142.stdout:7/515: mkdir d10/d13/d1d/d25/d45/dad 0 2024-09-13T02:52:41.280 INFO:tasks.workunit.client.1.smithi142.stdout:2/404: dwrite d1/de/d31/d6c/d6d/f5c [0,4194304] 0 2024-09-13T02:52:41.281 INFO:tasks.workunit.client.1.smithi142.stdout:2/405: readlink d1/de/d31/d6c/d6d/l69 0 2024-09-13T02:52:41.282 INFO:tasks.workunit.client.1.smithi142.stdout:5/566: getdents d8/d47/d65 0 2024-09-13T02:52:41.284 INFO:tasks.workunit.client.1.smithi142.stdout:0/527: symlink d10/d6c/d88/d21/d51/d35/d9b/da5/lb5 0 2024-09-13T02:52:41.286 INFO:tasks.workunit.client.1.smithi142.stdout:6/563: creat d1/dd/d53/d78/db8/fc2 x:0 0 0 2024-09-13T02:52:41.287 INFO:tasks.workunit.client.1.smithi142.stdout:5/567: write d8/d24/d26/fa8 [774335,109962] 0 2024-09-13T02:52:41.289 INFO:tasks.workunit.client.1.smithi142.stdout:3/518: write d12/d16/d25/d2e/d48/f52 [5077460,2070] 0 2024-09-13T02:52:41.289 INFO:tasks.workunit.client.1.smithi142.stdout:7/516: rename d10/d13/d1d/d2b/d55/d32/d7e to d10/d13/d1d/d2b/dae 0 2024-09-13T02:52:41.291 INFO:tasks.workunit.client.1.smithi142.stdout:1/626: dread d12/d13/d20/f48 [0,4194304] 0 2024-09-13T02:52:41.294 INFO:tasks.workunit.client.1.smithi142.stdout:8/434: dread d0/d6/dc/d45/f65 [0,4194304] 0 2024-09-13T02:52:41.294 INFO:tasks.workunit.client.1.smithi142.stdout:2/406: rename d1/de/d1f/d13/f1d to d1/d29/f86 0 2024-09-13T02:52:41.295 INFO:tasks.workunit.client.1.smithi142.stdout:9/634: write dd/d17/d69/d84/d41/f59 [113684,75889] 0 2024-09-13T02:52:41.296 INFO:tasks.workunit.client.1.smithi142.stdout:5/568: mknod d8/d24/d26/d45/d81/d8c/d8d/cb0 0 2024-09-13T02:52:41.297 INFO:tasks.workunit.client.1.smithi142.stdout:2/407: chown d1/de/d31/d46 181059 1 2024-09-13T02:52:41.300 INFO:tasks.workunit.client.1.smithi142.stdout:7/517: write d10/d34/f38 [2060488,124401] 0 2024-09-13T02:52:41.301 INFO:tasks.workunit.client.1.smithi142.stdout:0/528: dwrite d10/d6c/d88/d21/d8f/fa9 [0,4194304] 0 2024-09-13T02:52:41.302 INFO:tasks.workunit.client.1.smithi142.stdout:6/564: write d1/d7/d5f/f68 [1175059,72476] 0 2024-09-13T02:52:41.303 INFO:tasks.workunit.client.1.smithi142.stdout:7/518: chown d10/d13/d1d/d2b/d56/f85 59 1 2024-09-13T02:52:41.305 INFO:tasks.workunit.client.1.smithi142.stdout:3/519: mkdir d12/d16/d25/d2e/d38/d4d/d53/da0 0 2024-09-13T02:52:41.305 INFO:tasks.workunit.client.1.smithi142.stdout:7/519: dread - d10/d13/f76 zero size 2024-09-13T02:52:41.306 INFO:tasks.workunit.client.1.smithi142.stdout:3/520: write d12/d16/d25/f26 [1645645,31873] 0 2024-09-13T02:52:41.306 INFO:tasks.workunit.client.1.smithi142.stdout:1/627: mknod d12/d13/d20/d27/d3c/d71/d81/cc8 0 2024-09-13T02:52:41.307 INFO:tasks.workunit.client.1.smithi142.stdout:8/435: fsync d0/d6/dc/d45/d35/f56 0 2024-09-13T02:52:41.329 INFO:tasks.workunit.client.1.smithi142.stdout:9/635: rename dd/d17/d25/f62 to dd/d17/d44/d82/d99/daf/dc9/de9/fee 0 2024-09-13T02:52:41.329 INFO:tasks.workunit.client.1.smithi142.stdout:5/569: write d8/d24/d3f/f87 [997603,63140] 0 2024-09-13T02:52:41.330 INFO:tasks.workunit.client.1.smithi142.stdout:1/628: truncate d12/d13/d20/d66/d7d/f98 299404 0 2024-09-13T02:52:41.330 INFO:tasks.workunit.client.1.smithi142.stdout:6/565: rmdir d1/dd/d53/d78/db8 39 2024-09-13T02:52:41.334 INFO:tasks.workunit.client.1.smithi142.stdout:8/436: rename d0/d6/dc/d40/d46/d6c to d0/d80/d8c 0 2024-09-13T02:52:41.335 INFO:tasks.workunit.client.1.smithi142.stdout:1/629: read d12/d13/d20/d66/d55/da0/f56 [3445000,21861] 0 2024-09-13T02:52:41.335 INFO:tasks.workunit.client.1.smithi142.stdout:6/566: creat d1/d7/d5f/d60/d76/d7e/fc3 x:0 0 0 2024-09-13T02:52:41.336 INFO:tasks.workunit.client.1.smithi142.stdout:7/520: creat d10/d13/d1d/d2b/faf x:0 0 0 2024-09-13T02:52:41.336 INFO:tasks.workunit.client.1.smithi142.stdout:2/408: dread d1/d2d/f40 [0,4194304] 0 2024-09-13T02:52:41.336 INFO:tasks.workunit.client.1.smithi142.stdout:9/636: truncate dd/d17/d25/f53 965787 0 2024-09-13T02:52:41.337 INFO:tasks.workunit.client.1.smithi142.stdout:5/570: creat d8/d24/d26/d45/d81/d8c/d8d/fb1 x:0 0 0 2024-09-13T02:52:41.339 INFO:tasks.workunit.client.1.smithi142.stdout:9/637: mkdir dd/d87/def 0 2024-09-13T02:52:41.340 INFO:tasks.workunit.client.1.smithi142.stdout:7/521: readlink d10/d13/d1d/d2b/d55/l33 0 2024-09-13T02:52:41.340 INFO:tasks.workunit.client.1.smithi142.stdout:8/437: read d0/d6/dc/d45/d35/f56 [52723,21900] 0 2024-09-13T02:52:41.341 INFO:tasks.workunit.client.1.smithi142.stdout:3/521: dwrite d12/d16/d25/d2e/d38/f57 [0,4194304] 0 2024-09-13T02:52:41.342 INFO:tasks.workunit.client.1.smithi142.stdout:1/630: mknod d12/d13/d20/d66/d55/db4/cc9 0 2024-09-13T02:52:41.344 INFO:tasks.workunit.client.1.smithi142.stdout:3/522: chown d12/d16/d3c/d7d/d91 1024021531 1 2024-09-13T02:52:41.344 INFO:tasks.workunit.client.1.smithi142.stdout:8/438: readlink d0/d6/dc/d45/d8/df/l34 0 2024-09-13T02:52:41.345 INFO:tasks.workunit.client.0.smithi098.stdout:4/133: sync 2024-09-13T02:52:41.351 INFO:tasks.workunit.client.1.smithi142.stdout:2/409: dwrite d1/de/d1f/d13/f6b [0,4194304] 0 2024-09-13T02:52:41.351 INFO:tasks.workunit.client.1.smithi142.stdout:8/439: read d0/d6/dc/d45/f73 [353682,90148] 0 2024-09-13T02:52:41.351 INFO:tasks.workunit.client.0.smithi098.stdout:4/134: rename d6/f23 to d6/d10/d21/f2b 0 2024-09-13T02:52:41.352 INFO:tasks.workunit.client.1.smithi142.stdout:3/523: truncate d12/d16/d25/d2e/d38/d4d/d53/d78/f85 1034539 0 2024-09-13T02:52:41.356 INFO:tasks.workunit.client.1.smithi142.stdout:6/567: link d1/d59/l98 d1/d7/lc4 0 2024-09-13T02:52:41.357 INFO:tasks.workunit.client.0.smithi098.stdout:4/135: symlink d6/d10/l2c 0 2024-09-13T02:52:41.360 INFO:tasks.workunit.client.1.smithi142.stdout:1/631: unlink d12/lab 0 2024-09-13T02:52:41.360 INFO:tasks.workunit.client.1.smithi142.stdout:6/568: stat d1/d7/d19/l5a 0 2024-09-13T02:52:41.361 INFO:tasks.workunit.client.1.smithi142.stdout:5/571: dread d8/f1b [0,4194304] 0 2024-09-13T02:52:41.363 INFO:tasks.workunit.client.1.smithi142.stdout:8/440: dwrite d0/d6/dc/d45/d8/f71 [0,4194304] 0 2024-09-13T02:52:41.365 INFO:tasks.workunit.client.0.smithi098.stdout:4/136: rename d6/fd to d6/d22/f2d 0 2024-09-13T02:52:41.371 INFO:tasks.workunit.client.1.smithi142.stdout:7/522: getdents d10/d13/d1d/d25 0 2024-09-13T02:52:41.371 INFO:tasks.workunit.client.1.smithi142.stdout:1/632: read d12/d13/d20/f38 [3181839,72468] 0 2024-09-13T02:52:41.374 INFO:tasks.workunit.client.1.smithi142.stdout:4/515: sync 2024-09-13T02:52:41.374 INFO:tasks.workunit.client.1.smithi142.stdout:5/572: mknod d8/d24/d64/cb2 0 2024-09-13T02:52:41.375 INFO:tasks.workunit.client.1.smithi142.stdout:6/569: dwrite d1/dd/d53/d78/f80 [0,4194304] 0 2024-09-13T02:52:41.375 INFO:tasks.workunit.client.1.smithi142.stdout:3/524: link d12/d16/d25/d2e/d48/d5c/d66/l70 d12/d16/d3c/d79/d9e/la1 0 2024-09-13T02:52:41.375 INFO:tasks.workunit.client.1.smithi142.stdout:2/410: getdents d1/d2c 0 2024-09-13T02:52:41.377 INFO:tasks.workunit.client.1.smithi142.stdout:4/516: chown d0/l42 55579 1 2024-09-13T02:52:41.377 INFO:tasks.workunit.client.1.smithi142.stdout:8/441: dwrite d0/d6/dc/d45/f6a [0,4194304] 0 2024-09-13T02:52:41.379 INFO:tasks.workunit.client.1.smithi142.stdout:1/633: write d12/d13/d20/d66/d7d/fb8 [774560,72104] 0 2024-09-13T02:52:41.379 INFO:tasks.workunit.client.1.smithi142.stdout:2/411: readlink d1/de/d1f/d13/l49 0 2024-09-13T02:52:41.382 INFO:tasks.workunit.client.0.smithi098.stdout:4/137: getdents d6/d10/d21 0 2024-09-13T02:52:41.384 INFO:tasks.workunit.client.1.smithi142.stdout:7/523: creat d10/d13/d1d/d25/d5c/da3/da8/fb0 x:0 0 0 2024-09-13T02:52:41.386 INFO:tasks.workunit.client.1.smithi142.stdout:1/634: fsync d12/d13/d20/d66/d55/da0/f63 0 2024-09-13T02:52:41.386 INFO:tasks.workunit.client.0.smithi098.stdout:4/138: chown d6/f8 2360 1 2024-09-13T02:52:41.387 INFO:tasks.workunit.client.1.smithi142.stdout:1/635: chown d12/d13/d20/d27/d3c/d71/d81/d92 833488 1 2024-09-13T02:52:41.391 INFO:tasks.workunit.client.1.smithi142.stdout:1/636: dread d12/f4d [0,4194304] 0 2024-09-13T02:52:41.391 INFO:tasks.workunit.client.1.smithi142.stdout:3/525: creat d12/d16/d3c/d79/d9b/fa2 x:0 0 0 2024-09-13T02:52:41.392 INFO:tasks.workunit.client.1.smithi142.stdout:1/637: chown d12/d13/d20/d66/d7d/f85 497842 1 2024-09-13T02:52:41.392 INFO:tasks.workunit.client.1.smithi142.stdout:2/412: creat d1/d29/d72/f87 x:0 0 0 2024-09-13T02:52:41.393 INFO:tasks.workunit.client.0.smithi098.stdout:4/139: getdents d6/d10/d20 0 2024-09-13T02:52:41.394 INFO:tasks.workunit.client.0.smithi098.stdout:4/140: mknod d6/d22/c2e 0 2024-09-13T02:52:41.396 INFO:tasks.workunit.client.0.smithi098.stdout:4/141: chown d6/d10/d21/f25 1 1 2024-09-13T02:52:41.396 INFO:tasks.workunit.client.1.smithi142.stdout:1/638: dread d12/d13/d20/d66/d7d/f85 [0,4194304] 0 2024-09-13T02:52:41.396 INFO:tasks.workunit.client.1.smithi142.stdout:5/573: creat d8/d24/d26/fb3 x:0 0 0 2024-09-13T02:52:41.397 INFO:tasks.workunit.client.1.smithi142.stdout:1/639: write d12/d13/d20/d66/d7d/f98 [457482,87895] 0 2024-09-13T02:52:41.399 INFO:tasks.workunit.client.1.smithi142.stdout:1/640: dread - d12/d13/d1d/fc6 zero size 2024-09-13T02:52:41.400 INFO:tasks.workunit.client.0.smithi098.stdout:4/142: rename d6/db/f12 to d6/db/f2f 0 2024-09-13T02:52:41.401 INFO:tasks.workunit.client.1.smithi142.stdout:7/524: symlink d10/d13/d1d/d2b/lb1 0 2024-09-13T02:52:41.403 INFO:tasks.workunit.client.1.smithi142.stdout:5/574: dwrite d8/d24/d26/f6a [0,4194304] 0 2024-09-13T02:52:41.404 INFO:tasks.workunit.client.0.smithi098.stdout:4/143: fsync d6/f1c 0 2024-09-13T02:52:41.405 INFO:tasks.workunit.client.1.smithi142.stdout:6/570: truncate d1/d7/d19/f2f 2460604 0 2024-09-13T02:52:41.406 INFO:tasks.workunit.client.1.smithi142.stdout:6/571: chown d1/d7/d5f/d60/d76/d7e/fc3 12 1 2024-09-13T02:52:41.411 INFO:tasks.workunit.client.1.smithi142.stdout:2/413: write d1/fb [4035734,104912] 0 2024-09-13T02:52:41.412 INFO:tasks.workunit.client.1.smithi142.stdout:4/517: dread d0/d2b/d2d/d31/d32/f58 [0,4194304] 0 2024-09-13T02:52:41.416 INFO:tasks.workunit.client.0.smithi098.stdout:4/144: dwrite d6/d10/d21/f25 [0,4194304] 0 2024-09-13T02:52:41.417 INFO:tasks.workunit.client.1.smithi142.stdout:5/575: chown d8/d24/d26/c43 2 1 2024-09-13T02:52:41.417 INFO:tasks.workunit.client.1.smithi142.stdout:4/518: read d0/d2b/d21/d30/f54 [2386963,96027] 0 2024-09-13T02:52:41.418 INFO:tasks.workunit.client.1.smithi142.stdout:2/414: dwrite d1/d42/d44/f5b [0,4194304] 0 2024-09-13T02:52:41.420 INFO:tasks.workunit.client.1.smithi142.stdout:3/526: dread d12/d16/d3c/f62 [0,4194304] 0 2024-09-13T02:52:41.420 INFO:tasks.workunit.client.1.smithi142.stdout:4/519: read d0/d2b/d21/d30/fa8 [4126067,7134] 0 2024-09-13T02:52:41.421 INFO:tasks.workunit.client.1.smithi142.stdout:3/527: chown lf 16505719 1 2024-09-13T02:52:41.425 INFO:tasks.workunit.client.0.smithi098.stdout:4/145: dwrite d6/f18 [0,4194304] 0 2024-09-13T02:52:41.427 INFO:tasks.workunit.client.1.smithi142.stdout:6/572: unlink d1/dd/d16/d4e/d32/f64 0 2024-09-13T02:52:41.429 INFO:tasks.workunit.client.1.smithi142.stdout:8/442: link d0/d6/dc/d45/d8/c19 d0/d75/c8d 0 2024-09-13T02:52:41.429 INFO:tasks.workunit.client.1.smithi142.stdout:5/576: creat d8/d24/d3f/d4a/fb4 x:0 0 0 2024-09-13T02:52:41.429 INFO:tasks.workunit.client.0.smithi098.stdout:4/146: symlink d6/d10/d21/l30 0 2024-09-13T02:52:41.431 INFO:tasks.workunit.client.1.smithi142.stdout:6/573: write d1/d7/f8d [925542,38834] 0 2024-09-13T02:52:41.433 INFO:tasks.workunit.client.1.smithi142.stdout:2/415: creat d1/de/d31/d6c/f88 x:0 0 0 2024-09-13T02:52:41.433 INFO:tasks.workunit.client.1.smithi142.stdout:6/574: chown d1/d7/f50 33130 1 2024-09-13T02:52:41.433 INFO:tasks.workunit.client.0.smithi098.stdout:4/147: chown d6/d10/c1a 27710489 1 2024-09-13T02:52:41.433 INFO:tasks.workunit.client.1.smithi142.stdout:3/528: dwrite d12/d16/d25/d2e/d38/d4d/d53/d78/f8a [0,4194304] 0 2024-09-13T02:52:41.434 INFO:tasks.workunit.client.0.smithi098.stdout:4/148: truncate d6/d10/d21/f2b 781077 0 2024-09-13T02:52:41.437 INFO:tasks.workunit.client.0.smithi098.stdout:4/149: write d6/db/f2f [3409992,20378] 0 2024-09-13T02:52:41.439 INFO:tasks.workunit.client.1.smithi142.stdout:8/443: symlink d0/d80/l8e 0 2024-09-13T02:52:41.440 INFO:tasks.workunit.client.1.smithi142.stdout:5/577: mkdir d8/d24/d64/d68/db5 0 2024-09-13T02:52:41.441 INFO:tasks.workunit.client.1.smithi142.stdout:2/416: rmdir d1/d2c 39 2024-09-13T02:52:41.442 INFO:tasks.workunit.client.1.smithi142.stdout:2/417: dread d1/d2d/f64 [0,4194304] 0 2024-09-13T02:52:41.446 INFO:tasks.workunit.client.1.smithi142.stdout:6/575: symlink d1/d7/d19/d30/lc5 0 2024-09-13T02:52:41.446 INFO:tasks.workunit.client.1.smithi142.stdout:6/576: fdatasync d1/d7/d5f/d6a/f95 0 2024-09-13T02:52:41.448 INFO:tasks.workunit.client.1.smithi142.stdout:6/577: dread d1/d7/d5f/d6a/f84 [0,4194304] 0 2024-09-13T02:52:41.448 INFO:tasks.workunit.client.1.smithi142.stdout:5/578: truncate d8/d24/d26/d2d/d90/f88 512072 0 2024-09-13T02:52:41.449 INFO:tasks.workunit.client.1.smithi142.stdout:3/529: mkdir d12/d16/da3 0 2024-09-13T02:52:41.453 INFO:tasks.workunit.client.1.smithi142.stdout:2/418: link d1/de/d31/f50 d1/de/d1f/d13/f89 0 2024-09-13T02:52:41.454 INFO:tasks.workunit.client.1.smithi142.stdout:7/525: dwrite d10/d31/f4e [0,4194304] 0 2024-09-13T02:52:41.456 INFO:tasks.workunit.client.1.smithi142.stdout:6/578: mknod d1/dd/d53/d78/d8f/da8/cc6 0 2024-09-13T02:52:41.456 INFO:tasks.workunit.client.1.smithi142.stdout:8/444: creat d0/f8f x:0 0 0 2024-09-13T02:52:41.457 INFO:tasks.workunit.client.1.smithi142.stdout:3/530: rmdir d12/d16/d25/d2e/d38/d4d/d53/d78 39 2024-09-13T02:52:41.458 INFO:tasks.workunit.client.1.smithi142.stdout:6/579: stat d1/dd/d53/d78/d8f/da8 0 2024-09-13T02:52:41.460 INFO:tasks.workunit.client.1.smithi142.stdout:8/445: chown d0/d6/dc/d40/d4d/d62/f74 1748869589 1 2024-09-13T02:52:41.461 INFO:tasks.workunit.client.1.smithi142.stdout:8/446: fdatasync d0/d6/f2a 0 2024-09-13T02:52:41.462 INFO:tasks.workunit.client.1.smithi142.stdout:8/447: readlink d0/d6/dc/d45/d8/df/l34 0 2024-09-13T02:52:41.463 INFO:tasks.workunit.client.1.smithi142.stdout:6/580: unlink d1/d7/d42/c46 0 2024-09-13T02:52:41.465 INFO:tasks.workunit.client.1.smithi142.stdout:3/531: rename d12/d16/d25/c80 to d12/d16/d3c/d79/d9b/ca4 0 2024-09-13T02:52:41.465 INFO:tasks.workunit.client.1.smithi142.stdout:8/448: dread d0/d6/f24 [0,4194304] 0 2024-09-13T02:52:41.467 INFO:tasks.workunit.client.1.smithi142.stdout:7/526: readlink d10/d13/d1d/d2b/dae/d9c/l9d 0 2024-09-13T02:52:41.467 INFO:tasks.workunit.client.1.smithi142.stdout:3/532: truncate d12/d16/d25/d2e/f7b 1513759 0 2024-09-13T02:52:41.467 INFO:tasks.workunit.client.1.smithi142.stdout:0/529: sync 2024-09-13T02:52:41.467 INFO:tasks.workunit.client.1.smithi142.stdout:4/520: truncate d0/d2b/d2d/d31/d43/d48/f68 161348 0 2024-09-13T02:52:41.468 INFO:tasks.workunit.client.1.smithi142.stdout:6/581: rmdir d1/d7/d19 39 2024-09-13T02:52:41.470 INFO:tasks.workunit.client.1.smithi142.stdout:3/533: write d12/d16/f21 [684090,55832] 0 2024-09-13T02:52:41.470 INFO:tasks.workunit.client.1.smithi142.stdout:7/527: readlink d10/d13/d1d/d2b/d40/l48 0 2024-09-13T02:52:41.473 INFO:tasks.workunit.client.1.smithi142.stdout:2/419: getdents d1/d2c/d6f 0 2024-09-13T02:52:41.473 INFO:tasks.workunit.client.1.smithi142.stdout:4/521: write d0/d2b/d2d/f9f [948159,118878] 0 2024-09-13T02:52:41.474 INFO:tasks.workunit.client.1.smithi142.stdout:0/530: symlink d10/d6c/d88/lb6 0 2024-09-13T02:52:41.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/449: dwrite d0/d6/dc/d40/d46/f5a [0,4194304] 0 2024-09-13T02:52:41.476 INFO:tasks.workunit.client.1.smithi142.stdout:2/420: fdatasync d1/de/d31/f62 0 2024-09-13T02:52:41.476 INFO:tasks.workunit.client.1.smithi142.stdout:0/531: truncate fd 5097922 0 2024-09-13T02:52:41.476 INFO:tasks.workunit.client.1.smithi142.stdout:4/522: chown d0/d2b/d75/f8f 9489095 1 2024-09-13T02:52:41.477 INFO:tasks.workunit.client.1.smithi142.stdout:6/582: chown d1/dd/d53/d78/db8/fc2 29039249 1 2024-09-13T02:52:41.478 INFO:tasks.workunit.client.1.smithi142.stdout:6/583: stat d1/dd/d16/f2c 0 2024-09-13T02:52:41.480 INFO:tasks.workunit.client.1.smithi142.stdout:4/523: dread - d0/d2b/f67 zero size 2024-09-13T02:52:41.480 INFO:tasks.workunit.client.1.smithi142.stdout:5/579: write d8/d24/d3f/d4a/f7a [1006728,6441] 0 2024-09-13T02:52:41.481 INFO:tasks.workunit.client.0.smithi098.stdout:4/150: dread d6/db/f2f [0,4194304] 0 2024-09-13T02:52:41.481 INFO:tasks.workunit.client.1.smithi142.stdout:6/584: write d1/d7/f2a [1975261,89343] 0 2024-09-13T02:52:41.482 INFO:tasks.workunit.client.0.smithi098.stdout:4/151: write d6/d10/d21/f25 [2664038,25885] 0 2024-09-13T02:52:41.483 INFO:tasks.workunit.client.1.smithi142.stdout:3/534: symlink d12/d16/d25/d2e/d38/d4d/d53/d78/la5 0 2024-09-13T02:52:41.483 INFO:tasks.workunit.client.1.smithi142.stdout:8/450: truncate d0/d6/dc/d45/f73 1365548 0 2024-09-13T02:52:41.484 INFO:tasks.workunit.client.1.smithi142.stdout:0/532: symlink d10/d6c/d88/d1a/d1e/lb7 0 2024-09-13T02:52:41.484 INFO:tasks.workunit.client.1.smithi142.stdout:3/535: read d12/d16/d25/d2e/f7b [579925,55361] 0 2024-09-13T02:52:41.486 INFO:tasks.workunit.client.1.smithi142.stdout:3/536: write d12/d16/d25/d2e/f6c [411648,112450] 0 2024-09-13T02:52:41.487 INFO:tasks.workunit.client.1.smithi142.stdout:3/537: fsync d12/d16/f24 0 2024-09-13T02:52:41.487 INFO:tasks.workunit.client.1.smithi142.stdout:5/580: dread d8/f19 [0,4194304] 0 2024-09-13T02:52:41.487 INFO:tasks.workunit.client.1.smithi142.stdout:2/421: mknod d1/de/d1f/c8a 0 2024-09-13T02:52:41.489 INFO:tasks.workunit.client.0.smithi098.stdout:4/152: truncate d6/f8 1670482 0 2024-09-13T02:52:41.491 INFO:tasks.workunit.client.1.smithi142.stdout:4/524: unlink d0/l24 0 2024-09-13T02:52:41.491 INFO:tasks.workunit.client.1.smithi142.stdout:4/525: chown d0/d2b/f67 52669671 1 2024-09-13T02:52:41.494 INFO:tasks.workunit.client.1.smithi142.stdout:7/528: write d10/d64/f82 [2961761,45861] 0 2024-09-13T02:52:41.494 INFO:tasks.workunit.client.0.smithi098.stdout:4/153: mkdir d6/d31 0 2024-09-13T02:52:41.495 INFO:tasks.workunit.client.0.smithi098.stdout:4/154: chown d6/d10/l27 2565021 1 2024-09-13T02:52:41.495 INFO:tasks.workunit.client.1.smithi142.stdout:6/585: mknod d1/d7/d5f/d60/db6/cc7 0 2024-09-13T02:52:41.496 INFO:tasks.workunit.client.0.smithi098.stdout:4/155: write d6/d10/d21/f25 [3003012,87484] 0 2024-09-13T02:52:41.496 INFO:tasks.workunit.client.1.smithi142.stdout:6/586: truncate d1/dd/fbe 278942 0 2024-09-13T02:52:41.497 INFO:tasks.workunit.client.1.smithi142.stdout:8/451: symlink d0/d6/d23/l90 0 2024-09-13T02:52:41.499 INFO:tasks.workunit.client.1.smithi142.stdout:9/638: sync 2024-09-13T02:52:41.500 INFO:tasks.workunit.client.1.smithi142.stdout:3/538: fdatasync d12/d16/d3c/d79/f83 0 2024-09-13T02:52:41.501 INFO:tasks.workunit.client.1.smithi142.stdout:3/539: dread - d12/d16/d25/d2e/d38/f94 zero size 2024-09-13T02:52:41.506 INFO:tasks.workunit.client.1.smithi142.stdout:4/526: creat d0/d2b/d2d/d31/d43/fa9 x:0 0 0 2024-09-13T02:52:41.507 INFO:tasks.workunit.client.0.smithi098.stdout:4/156: getdents d6/d10/d21 0 2024-09-13T02:52:41.509 INFO:tasks.workunit.client.1.smithi142.stdout:6/587: dread - d1/d7/d19/d48/f9c zero size 2024-09-13T02:52:41.509 INFO:tasks.workunit.client.1.smithi142.stdout:6/588: chown d1/dd/d16/d4d 26906205 1 2024-09-13T02:52:41.510 INFO:tasks.workunit.client.1.smithi142.stdout:2/422: write d1/de/f18 [300452,66963] 0 2024-09-13T02:52:41.510 INFO:tasks.workunit.client.1.smithi142.stdout:6/589: stat d1/d7/d19/d30 0 2024-09-13T02:52:41.510 INFO:tasks.workunit.client.1.smithi142.stdout:0/533: symlink d10/d6c/d88/d21/daf/lb8 0 2024-09-13T02:52:41.511 INFO:tasks.workunit.client.1.smithi142.stdout:5/581: mkdir d8/d24/d26/db6 0 2024-09-13T02:52:41.512 INFO:tasks.workunit.client.1.smithi142.stdout:0/534: write d10/d6c/d88/d21/d51/d35/f55 [323991,98736] 0 2024-09-13T02:52:41.513 INFO:tasks.workunit.client.0.smithi098.stdout:4/157: rename d6/d10/f13 to d6/d10/d21/f32 0 2024-09-13T02:52:41.514 INFO:tasks.workunit.client.1.smithi142.stdout:0/535: chown d10/d23/f4f 0 1 2024-09-13T02:52:41.514 INFO:tasks.workunit.client.1.smithi142.stdout:3/540: symlink d12/d16/d3c/la6 0 2024-09-13T02:52:41.515 INFO:tasks.workunit.client.0.smithi098.stdout:4/158: mknod d6/d22/c33 0 2024-09-13T02:52:41.516 INFO:tasks.workunit.client.1.smithi142.stdout:4/527: mkdir d0/d2b/d2d/d31/d32/daa 0 2024-09-13T02:52:41.517 INFO:tasks.workunit.client.1.smithi142.stdout:8/452: symlink d0/d6/d83/l91 0 2024-09-13T02:52:41.517 INFO:tasks.workunit.client.1.smithi142.stdout:3/541: read d12/d16/f43 [3013895,92983] 0 2024-09-13T02:52:41.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/423: symlink d1/d2d/l8b 0 2024-09-13T02:52:41.518 INFO:tasks.workunit.client.1.smithi142.stdout:6/590: dwrite d1/d59/fa3 [0,4194304] 0 2024-09-13T02:52:41.518 INFO:tasks.workunit.client.1.smithi142.stdout:9/639: mknod dd/d17/d5f/d7b/cf0 0 2024-09-13T02:52:41.519 INFO:tasks.workunit.client.1.smithi142.stdout:8/453: fsync d0/d6/dc/d45/f3c 0 2024-09-13T02:52:41.519 INFO:tasks.workunit.client.1.smithi142.stdout:5/582: write d8/f2e [7440140,98047] 0 2024-09-13T02:52:41.522 INFO:tasks.workunit.client.0.smithi098.stdout:4/159: dwrite d6/db/f2a [0,4194304] 0 2024-09-13T02:52:41.523 INFO:tasks.workunit.client.0.smithi098.stdout:4/160: read d6/db/fc [1051718,112064] 0 2024-09-13T02:52:41.525 INFO:tasks.workunit.client.1.smithi142.stdout:7/529: creat d10/fb2 x:0 0 0 2024-09-13T02:52:41.526 INFO:tasks.workunit.client.1.smithi142.stdout:7/530: write d10/d13/d1d/d2b/f8e [975018,44680] 0 2024-09-13T02:52:41.535 INFO:tasks.workunit.client.0.smithi098.stdout:4/161: symlink d6/d10/d20/l34 0 2024-09-13T02:52:41.537 INFO:tasks.workunit.client.1.smithi142.stdout:5/583: symlink d8/d24/d64/d68/lb7 0 2024-09-13T02:52:41.538 INFO:tasks.workunit.client.1.smithi142.stdout:9/640: dread dd/d17/d25/fac [0,4194304] 0 2024-09-13T02:52:41.538 INFO:tasks.workunit.client.1.smithi142.stdout:8/454: rmdir d0/d6/dc/d45 39 2024-09-13T02:52:41.538 INFO:tasks.workunit.client.1.smithi142.stdout:5/584: stat d8/d24/d26/d61/f9f 0 2024-09-13T02:52:41.539 INFO:tasks.workunit.client.0.smithi098.stdout:4/162: dread d6/f18 [0,4194304] 0 2024-09-13T02:52:41.540 INFO:tasks.workunit.client.1.smithi142.stdout:9/641: write dd/d17/d4f/f7a [34468,27018] 0 2024-09-13T02:52:41.540 INFO:tasks.workunit.client.1.smithi142.stdout:8/455: chown d0/d6/dc/d40/d4d/d62/l7d 241415 1 2024-09-13T02:52:41.541 INFO:tasks.workunit.client.1.smithi142.stdout:9/642: write dd/d17/d69/f89 [2690379,22215] 0 2024-09-13T02:52:41.542 INFO:tasks.workunit.client.1.smithi142.stdout:8/456: write d0/d6/d23/f7f [357183,114527] 0 2024-09-13T02:52:41.542 INFO:tasks.workunit.client.1.smithi142.stdout:9/643: fsync dd/d17/f2b 0 2024-09-13T02:52:41.545 INFO:tasks.workunit.client.0.smithi098.stdout:4/163: rename d6/d10/c24 to d6/db/c35 0 2024-09-13T02:52:41.547 INFO:tasks.workunit.client.1.smithi142.stdout:0/536: creat d10/d6c/d88/fb9 x:0 0 0 2024-09-13T02:52:41.549 INFO:tasks.workunit.client.1.smithi142.stdout:7/531: unlink d10/d13/d1d/d2b/d55/f3c 0 2024-09-13T02:52:41.555 INFO:tasks.workunit.client.1.smithi142.stdout:6/591: creat d1/dd/d57/d7b/fc8 x:0 0 0 2024-09-13T02:52:41.556 INFO:tasks.workunit.client.1.smithi142.stdout:6/592: write d1/d7/d42/f8b [803457,127386] 0 2024-09-13T02:52:41.560 INFO:tasks.workunit.client.0.smithi098.stdout:4/164: rmdir d6/d31 0 2024-09-13T02:52:41.560 INFO:tasks.workunit.client.0.smithi098.stdout:4/165: chown d6/c16 2022 1 2024-09-13T02:52:41.562 INFO:tasks.workunit.client.1.smithi142.stdout:5/585: mknod d8/d24/d26/d45/d81/cb8 0 2024-09-13T02:52:41.562 INFO:tasks.workunit.client.1.smithi142.stdout:3/542: dwrite d12/d16/d25/d2e/d48/d5c/d66/f63 [0,4194304] 0 2024-09-13T02:52:41.563 INFO:tasks.workunit.client.1.smithi142.stdout:1/641: sync 2024-09-13T02:52:41.566 INFO:tasks.workunit.client.1.smithi142.stdout:2/424: creat d1/f8c x:0 0 0 2024-09-13T02:52:41.567 INFO:tasks.workunit.client.0.smithi098.stdout:4/166: unlink d6/f8 0 2024-09-13T02:52:41.569 INFO:tasks.workunit.client.1.smithi142.stdout:9/644: symlink dd/dcb/lf1 0 2024-09-13T02:52:41.569 INFO:tasks.workunit.client.1.smithi142.stdout:1/642: dwrite d12/d13/d20/d66/d55/f44 [4194304,4194304] 0 2024-09-13T02:52:41.571 INFO:tasks.workunit.client.0.smithi098.stdout:4/167: write d6/f18 [378842,28175] 0 2024-09-13T02:52:41.573 INFO:tasks.workunit.client.1.smithi142.stdout:0/537: creat d10/d6c/d88/d1a/d3a/fba x:0 0 0 2024-09-13T02:52:41.574 INFO:tasks.workunit.client.1.smithi142.stdout:0/538: stat d10/d6c/f6d 0 2024-09-13T02:52:41.575 INFO:tasks.workunit.client.0.smithi098.stdout:4/168: write d6/db/f2f [9179274,31886] 0 2024-09-13T02:52:41.576 INFO:tasks.workunit.client.0.smithi098.stdout:4/169: write d6/d22/f28 [558776,69573] 0 2024-09-13T02:52:41.578 INFO:tasks.workunit.client.1.smithi142.stdout:3/543: creat d12/d16/d25/d2e/d48/d5c/d66/fa7 x:0 0 0 2024-09-13T02:52:41.579 INFO:tasks.workunit.client.1.smithi142.stdout:9/645: dwrite dd/d17/d44/d82/d99/da8/fda [0,4194304] 0 2024-09-13T02:52:41.580 INFO:tasks.workunit.client.1.smithi142.stdout:9/646: fsync dd/d17/fa1 0 2024-09-13T02:52:41.581 INFO:tasks.workunit.client.1.smithi142.stdout:8/457: mknod d0/d6/dc/d45/d35/d61/c92 0 2024-09-13T02:52:41.584 INFO:tasks.workunit.client.1.smithi142.stdout:7/532: creat d10/d13/d1d/d25/d45/d99/fb3 x:0 0 0 2024-09-13T02:52:41.585 INFO:tasks.workunit.client.1.smithi142.stdout:4/528: write d0/d2b/d2d/d31/d43/d48/f68 [976448,76704] 0 2024-09-13T02:52:41.587 INFO:tasks.workunit.client.1.smithi142.stdout:0/539: symlink d10/d6c/d88/d30/lbb 0 2024-09-13T02:52:41.587 INFO:tasks.workunit.client.1.smithi142.stdout:0/540: dread - d10/f7b zero size 2024-09-13T02:52:41.592 INFO:tasks.workunit.client.1.smithi142.stdout:7/533: mknod d10/d13/d21/cb4 0 2024-09-13T02:52:41.593 INFO:tasks.workunit.client.1.smithi142.stdout:8/458: dwrite d0/d6/dc/d45/fa [4194304,4194304] 0 2024-09-13T02:52:41.594 INFO:tasks.workunit.client.1.smithi142.stdout:2/425: rename d1/de/d1f/d13/f4a to d1/de/d1f/f8d 0 2024-09-13T02:52:41.597 INFO:tasks.workunit.client.1.smithi142.stdout:0/541: rmdir d10/d6c/d88/d21 39 2024-09-13T02:52:41.599 INFO:tasks.workunit.client.1.smithi142.stdout:6/593: getdents d1/d7/d19/d52 0 2024-09-13T02:52:41.600 INFO:tasks.workunit.client.0.smithi098.stdout:4/170: write d6/f18 [993103,51884] 0 2024-09-13T02:52:41.601 INFO:tasks.workunit.client.1.smithi142.stdout:7/534: stat d10/l12 0 2024-09-13T02:52:41.606 INFO:tasks.workunit.client.1.smithi142.stdout:8/459: mkdir d0/d6/dc/d45/d35/d93 0 2024-09-13T02:52:41.607 INFO:tasks.workunit.client.0.smithi098.stdout:4/171: dwrite d6/d22/f28 [0,4194304] 0 2024-09-13T02:52:41.610 INFO:tasks.workunit.client.1.smithi142.stdout:9/647: rename dd/d17/d44/c5a to dd/d17/d25/deb/cf2 0 2024-09-13T02:52:41.613 INFO:tasks.workunit.client.0.smithi098.stdout:4/172: dwrite d6/f1c [0,4194304] 0 2024-09-13T02:52:41.614 INFO:tasks.workunit.client.1.smithi142.stdout:6/594: mknod d1/dd/d53/d78/d8f/cc9 0 2024-09-13T02:52:41.614 INFO:tasks.workunit.client.1.smithi142.stdout:7/535: mkdir d10/d13/d1d/d25/d5c/db5 0 2024-09-13T02:52:41.615 INFO:tasks.workunit.client.1.smithi142.stdout:5/586: truncate d8/d24/d3f/f75 4378285 0 2024-09-13T02:52:41.616 INFO:tasks.workunit.client.1.smithi142.stdout:1/643: link d12/d13/d45/f60 d12/d13/d1d/d26/d4f/fca 0 2024-09-13T02:52:41.617 INFO:tasks.workunit.client.0.smithi098.stdout:4/173: creat d6/d10/d20/f36 x:0 0 0 2024-09-13T02:52:41.621 INFO:tasks.workunit.client.1.smithi142.stdout:2/426: symlink d1/d2c/d6f/d79/l8e 0 2024-09-13T02:52:41.622 INFO:tasks.workunit.client.1.smithi142.stdout:3/544: truncate d12/d16/d25/f60 2973413 0 2024-09-13T02:52:41.624 INFO:tasks.workunit.client.1.smithi142.stdout:1/644: fdatasync d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/fc5 0 2024-09-13T02:52:41.629 INFO:tasks.workunit.client.1.smithi142.stdout:2/427: creat d1/d42/f8f x:0 0 0 2024-09-13T02:52:41.630 INFO:tasks.workunit.client.1.smithi142.stdout:6/595: dwrite d1/d7/d42/f8c [0,4194304] 0 2024-09-13T02:52:41.631 INFO:tasks.workunit.client.1.smithi142.stdout:9/648: rename dd/d17/d69/d84/la6 to dd/d87/d8e/da3/lf3 0 2024-09-13T02:52:41.631 INFO:tasks.workunit.client.1.smithi142.stdout:7/536: dwrite d10/fa4 [0,4194304] 0 2024-09-13T02:52:41.634 INFO:tasks.workunit.client.1.smithi142.stdout:1/645: creat d12/d13/d20/d66/d55/da0/fcb x:0 0 0 2024-09-13T02:52:41.636 INFO:tasks.workunit.client.1.smithi142.stdout:8/460: dwrite d0/f4c [0,4194304] 0 2024-09-13T02:52:41.636 INFO:tasks.workunit.client.1.smithi142.stdout:2/428: dread - d1/de/d1f/f63 zero size 2024-09-13T02:52:41.640 INFO:tasks.workunit.client.1.smithi142.stdout:3/545: truncate d12/d16/d25/d2e/d38/d4d/f50 707215 0 2024-09-13T02:52:41.640 INFO:tasks.workunit.client.1.smithi142.stdout:6/596: symlink d1/dd/d53/d78/db8/lca 0 2024-09-13T02:52:41.641 INFO:tasks.workunit.client.1.smithi142.stdout:7/537: chown d10/c77 104116 1 2024-09-13T02:52:41.643 INFO:tasks.workunit.client.1.smithi142.stdout:6/597: chown d1/d7/d5f/d60/d65 0 1 2024-09-13T02:52:41.643 INFO:tasks.workunit.client.1.smithi142.stdout:2/429: readlink d1/de/d1f/d13/l49 0 2024-09-13T02:52:41.643 INFO:tasks.workunit.client.1.smithi142.stdout:7/538: readlink d10/d13/la1 0 2024-09-13T02:52:41.643 INFO:tasks.workunit.client.1.smithi142.stdout:2/430: fsync d1/de/f7e 0 2024-09-13T02:52:41.646 INFO:tasks.workunit.client.1.smithi142.stdout:8/461: unlink d0/d6/dc/d45/d35/l4f 0 2024-09-13T02:52:41.647 INFO:tasks.workunit.client.1.smithi142.stdout:8/462: write d0/f69 [282148,41470] 0 2024-09-13T02:52:41.647 INFO:tasks.workunit.client.1.smithi142.stdout:0/542: link d10/d6c/d88/d21/d51/d35/cad d10/d6c/d88/d1a/d1e/d42/cbc 0 2024-09-13T02:52:41.647 INFO:tasks.workunit.client.0.smithi098.stdout:3/121: sync 2024-09-13T02:52:41.649 INFO:tasks.workunit.client.1.smithi142.stdout:1/646: dread d12/d13/d20/d66/d7d/fb8 [0,4194304] 0 2024-09-13T02:52:41.649 INFO:tasks.workunit.client.1.smithi142.stdout:0/543: write d10/d6c/d88/d21/d51/f54 [2501126,40319] 0 2024-09-13T02:52:41.654 INFO:tasks.workunit.client.1.smithi142.stdout:2/431: dread d1/de/d1f/f37 [0,4194304] 0 2024-09-13T02:52:41.655 INFO:tasks.workunit.client.0.smithi098.stdout:3/122: dwrite d7/d9/d15/d17/f20 [4194304,4194304] 0 2024-09-13T02:52:41.655 INFO:tasks.workunit.client.1.smithi142.stdout:8/463: symlink d0/d6/d76/l94 0 2024-09-13T02:52:41.656 INFO:tasks.workunit.client.0.smithi098.stdout:3/123: chown d7/d9/d15/d17 60 1 2024-09-13T02:52:41.656 INFO:tasks.workunit.client.1.smithi142.stdout:6/598: getdents d1/d7/d5f/d6a 0 2024-09-13T02:52:41.657 INFO:tasks.workunit.client.1.smithi142.stdout:1/647: mknod d12/ccc 0 2024-09-13T02:52:41.660 INFO:tasks.workunit.client.0.smithi098.stdout:3/124: mkdir d7/d9/d15/d26 0 2024-09-13T02:52:41.660 INFO:tasks.workunit.client.0.smithi098.stdout:3/125: write f4 [2208931,51566] 0 2024-09-13T02:52:41.662 INFO:tasks.workunit.client.1.smithi142.stdout:8/464: write d0/d6/dc/f72 [578886,90688] 0 2024-09-13T02:52:41.664 INFO:tasks.workunit.client.0.smithi098.stdout:4/174: rmdir d6 39 2024-09-13T02:52:41.668 INFO:tasks.workunit.client.0.smithi098.stdout:3/126: unlink d7/d9/d15/d17/f20 0 2024-09-13T02:52:41.672 INFO:tasks.workunit.client.1.smithi142.stdout:5/587: write d8/d24/f3d [4355351,130013] 0 2024-09-13T02:52:41.673 INFO:tasks.workunit.client.1.smithi142.stdout:5/588: write d8/d24/d26/f5c [7800100,61011] 0 2024-09-13T02:52:41.675 INFO:tasks.workunit.client.0.smithi098.stdout:3/127: dwrite d7/f1d [0,4194304] 0 2024-09-13T02:52:41.676 INFO:tasks.workunit.client.0.smithi098.stdout:3/128: readlink d7/d9/d15/d17/l21 0 2024-09-13T02:52:41.680 INFO:tasks.workunit.client.0.smithi098.stdout:3/129: mknod d7/c27 0 2024-09-13T02:52:41.681 INFO:tasks.workunit.client.1.smithi142.stdout:0/544: rmdir d10/d6c 39 2024-09-13T02:52:41.685 INFO:tasks.workunit.client.0.smithi098.stdout:3/130: creat d7/d9/d15/d17/f28 x:0 0 0 2024-09-13T02:52:41.686 INFO:tasks.workunit.client.1.smithi142.stdout:9/649: dwrite dd/d87/f96 [0,4194304] 0 2024-09-13T02:52:41.686 INFO:tasks.workunit.client.1.smithi142.stdout:8/465: dwrite d0/d6/dc/d45/d35/f56 [0,4194304] 0 2024-09-13T02:52:41.687 INFO:tasks.workunit.client.1.smithi142.stdout:7/539: truncate d10/d34/f5a 3375156 0 2024-09-13T02:52:41.688 INFO:tasks.workunit.client.1.smithi142.stdout:5/589: mkdir d8/d24/d3f/d4a/d4b/db9 0 2024-09-13T02:52:41.689 INFO:tasks.workunit.client.1.smithi142.stdout:6/599: link d1/d7/d19/l5a d1/d7/d5f/d60/d65/lcb 0 2024-09-13T02:52:41.693 INFO:tasks.workunit.client.1.smithi142.stdout:1/648: truncate d12/d13/d20/d66/d55/da0/f6f 2476782 0 2024-09-13T02:52:41.694 INFO:tasks.workunit.client.0.smithi098.stdout:3/131: getdents d7/d9/d15/d26 0 2024-09-13T02:52:41.698 INFO:tasks.workunit.client.1.smithi142.stdout:2/432: getdents d1 0 2024-09-13T02:52:41.699 INFO:tasks.workunit.client.1.smithi142.stdout:2/433: readlink d1/d29/d72/l78 0 2024-09-13T02:52:41.701 INFO:tasks.workunit.client.1.smithi142.stdout:2/434: dread - d1/de/d1f/d13/d60/f7c zero size 2024-09-13T02:52:41.702 INFO:tasks.workunit.client.1.smithi142.stdout:7/540: symlink d10/d13/d1d/d25/d5c/lb6 0 2024-09-13T02:52:41.702 INFO:tasks.workunit.client.1.smithi142.stdout:1/649: dwrite d12/d13/d20/d66/d55/da0/fb2 [4194304,4194304] 0 2024-09-13T02:52:41.704 INFO:tasks.workunit.client.1.smithi142.stdout:5/590: mknod d8/d24/d26/d45/d81/cba 0 2024-09-13T02:52:41.706 INFO:tasks.workunit.client.1.smithi142.stdout:0/545: symlink d10/d6c/d88/d21/daf/lbd 0 2024-09-13T02:52:41.708 INFO:tasks.workunit.client.1.smithi142.stdout:9/650: creat dd/d17/d5f/d7b/db9/ff4 x:0 0 0 2024-09-13T02:52:41.709 INFO:tasks.workunit.client.1.smithi142.stdout:2/435: rename d1/f2f to d1/d2c/f90 0 2024-09-13T02:52:41.710 INFO:tasks.workunit.client.1.smithi142.stdout:7/541: rmdir d10/d13/d1d/d2b/d55/d32 39 2024-09-13T02:52:41.710 INFO:tasks.workunit.client.1.smithi142.stdout:9/651: write dd/d17/d25/fb1 [229874,113207] 0 2024-09-13T02:52:41.712 INFO:tasks.workunit.client.1.smithi142.stdout:8/466: creat d0/f95 x:0 0 0 2024-09-13T02:52:41.714 INFO:tasks.workunit.client.1.smithi142.stdout:1/650: mknod d12/d13/ccd 0 2024-09-13T02:52:41.715 INFO:tasks.workunit.client.1.smithi142.stdout:5/591: mknod d8/d47/d65/da0/cbb 0 2024-09-13T02:52:41.716 INFO:tasks.workunit.client.1.smithi142.stdout:0/546: dwrite d10/d6c/d88/d21/d51/fa4 [0,4194304] 0 2024-09-13T02:52:41.718 INFO:tasks.workunit.client.1.smithi142.stdout:5/592: write d8/d24/d26/d45/d81/d82/f93 [1738391,95752] 0 2024-09-13T02:52:41.720 INFO:tasks.workunit.client.1.smithi142.stdout:0/547: write d10/d6c/d88/d30/f86 [947557,64790] 0 2024-09-13T02:52:41.720 INFO:tasks.workunit.client.1.smithi142.stdout:4/529: sync 2024-09-13T02:52:41.722 INFO:tasks.workunit.client.1.smithi142.stdout:9/652: mkdir dd/d17/d44/d82/d99/daf/dc9/de9/df5 0 2024-09-13T02:52:41.723 INFO:tasks.workunit.client.1.smithi142.stdout:4/530: chown d0/df/f1f 2 1 2024-09-13T02:52:41.725 INFO:tasks.workunit.client.0.smithi098.stdout:3/132: truncate d7/d9/fa 8434634 0 2024-09-13T02:52:41.728 INFO:tasks.workunit.client.1.smithi142.stdout:6/600: dread d1/d7/f50 [0,4194304] 0 2024-09-13T02:52:41.730 INFO:tasks.workunit.client.1.smithi142.stdout:7/542: getdents d10/d13/d1d/d2b/dae 0 2024-09-13T02:52:41.731 INFO:tasks.workunit.client.1.smithi142.stdout:8/467: dwrite d0/d6/dc/d45/f73 [0,4194304] 0 2024-09-13T02:52:41.731 INFO:tasks.workunit.client.1.smithi142.stdout:0/548: mknod d10/d6c/d88/cbe 0 2024-09-13T02:52:41.734 INFO:tasks.workunit.client.1.smithi142.stdout:7/543: write d10/d13/d22/f69 [2334953,114682] 0 2024-09-13T02:52:41.734 INFO:tasks.workunit.client.1.smithi142.stdout:6/601: write d1/dd/d53/d78/d8f/f92 [512856,100859] 0 2024-09-13T02:52:41.734 INFO:tasks.workunit.client.1.smithi142.stdout:9/653: symlink dd/d17/d44/d82/d99/daf/dc9/de9/lf6 0 2024-09-13T02:52:41.734 INFO:tasks.workunit.client.1.smithi142.stdout:0/549: chown d10/d23/c38 9458 1 2024-09-13T02:52:41.737 INFO:tasks.workunit.client.1.smithi142.stdout:4/531: dwrite d0/f9b [0,4194304] 0 2024-09-13T02:52:41.738 INFO:tasks.workunit.client.1.smithi142.stdout:9/654: stat dd/d17/d4f/l75 0 2024-09-13T02:52:41.739 INFO:tasks.workunit.client.1.smithi142.stdout:0/550: fdatasync d10/d6c/d88/d1a/f6b 0 2024-09-13T02:52:41.739 INFO:tasks.workunit.client.1.smithi142.stdout:4/532: stat d0/f8e 0 2024-09-13T02:52:41.740 INFO:tasks.workunit.client.1.smithi142.stdout:9/655: write dd/d17/fb3 [2478885,103589] 0 2024-09-13T02:52:41.741 INFO:tasks.workunit.client.1.smithi142.stdout:4/533: chown d0/d7e/c94 2158068 1 2024-09-13T02:52:41.741 INFO:tasks.workunit.client.1.smithi142.stdout:8/468: unlink d0/fb 0 2024-09-13T02:52:41.745 INFO:tasks.workunit.client.1.smithi142.stdout:5/593: rename d8/d24/d64/d68/lb7 to d8/d24/d26/d2d/d90/lbc 0 2024-09-13T02:52:41.747 INFO:tasks.workunit.client.1.smithi142.stdout:8/469: dread - d0/d6/dc/d40/d4d/d62/f74 zero size 2024-09-13T02:52:41.748 INFO:tasks.workunit.client.1.smithi142.stdout:6/602: creat d1/dd/fcc x:0 0 0 2024-09-13T02:52:41.749 INFO:tasks.workunit.client.1.smithi142.stdout:3/546: sync 2024-09-13T02:52:41.750 INFO:tasks.workunit.client.1.smithi142.stdout:7/544: dwrite d10/f47 [0,4194304] 0 2024-09-13T02:52:41.750 INFO:tasks.workunit.client.1.smithi142.stdout:1/651: truncate d12/d13/d20/f5c 123611 0 2024-09-13T02:52:41.751 INFO:tasks.workunit.client.0.smithi098.stdout:3/133: dread d7/f22 [4194304,4194304] 0 2024-09-13T02:52:41.754 INFO:tasks.workunit.client.1.smithi142.stdout:2/436: creat d1/de/d31/d6c/d6d/d47/f91 x:0 0 0 2024-09-13T02:52:41.756 INFO:tasks.workunit.client.1.smithi142.stdout:2/437: readlink d1/de/d31/d6c/d6d/d47/l4b 0 2024-09-13T02:52:41.758 INFO:tasks.workunit.client.0.smithi098.stdout:3/134: rename d7/d9/lb to d7/d9/d15/l29 0 2024-09-13T02:52:41.758 INFO:tasks.workunit.client.1.smithi142.stdout:4/534: dwrite d0/d2b/d2d/f9d [4194304,4194304] 0 2024-09-13T02:52:41.760 INFO:tasks.workunit.client.1.smithi142.stdout:0/551: mkdir d10/dbf 0 2024-09-13T02:52:41.761 INFO:tasks.workunit.client.1.smithi142.stdout:6/603: creat d1/d7/d5f/d60/db6/fcd x:0 0 0 2024-09-13T02:52:41.762 INFO:tasks.workunit.client.1.smithi142.stdout:9/656: symlink dd/d87/def/lf7 0 2024-09-13T02:52:41.763 INFO:tasks.workunit.client.0.smithi098.stdout:3/135: creat d7/d9/d15/d26/f2a x:0 0 0 2024-09-13T02:52:41.764 INFO:tasks.workunit.client.1.smithi142.stdout:7/545: creat d10/d34/d57/d98/fb7 x:0 0 0 2024-09-13T02:52:41.765 INFO:tasks.workunit.client.1.smithi142.stdout:2/438: dwrite d1/de/f7e [0,4194304] 0 2024-09-13T02:52:41.765 INFO:tasks.workunit.client.1.smithi142.stdout:8/470: rename d0/d6/dc/d45/f3 to d0/d6/dc/d45/d35/f96 0 2024-09-13T02:52:41.766 INFO:tasks.workunit.client.0.smithi098.stdout:3/136: write f6 [2141211,14378] 0 2024-09-13T02:52:41.766 INFO:tasks.workunit.client.1.smithi142.stdout:8/471: chown d0/d6/dc/d45/l3a 8 1 2024-09-13T02:52:41.767 INFO:tasks.workunit.client.1.smithi142.stdout:3/547: creat d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/fa8 x:0 0 0 2024-09-13T02:52:41.770 INFO:tasks.workunit.client.1.smithi142.stdout:0/552: mknod d10/d6c/d88/d1a/d7a/cc0 0 2024-09-13T02:52:41.770 INFO:tasks.workunit.client.1.smithi142.stdout:4/535: write d0/f4c [4994178,6229] 0 2024-09-13T02:52:41.774 INFO:tasks.workunit.client.1.smithi142.stdout:7/546: dwrite d10/fb2 [0,4194304] 0 2024-09-13T02:52:41.774 INFO:tasks.workunit.client.1.smithi142.stdout:3/548: truncate d12/d16/d25/d2e/d38/f45 4940122 0 2024-09-13T02:52:41.775 INFO:tasks.workunit.client.1.smithi142.stdout:7/547: fdatasync d10/d13/d1d/d2b/faf 0 2024-09-13T02:52:41.775 INFO:tasks.workunit.client.1.smithi142.stdout:6/604: mknod d1/dd/d53/d78/d8f/da8/cce 0 2024-09-13T02:52:41.777 INFO:tasks.workunit.client.0.smithi098.stdout:3/137: mkdir d7/d9/d25/d2b 0 2024-09-13T02:52:41.777 INFO:tasks.workunit.client.1.smithi142.stdout:3/549: chown d12/d16/d25/d2e/d38/d4d/d53/c54 21219310 1 2024-09-13T02:52:41.778 INFO:tasks.workunit.client.0.smithi098.stdout:3/138: truncate d7/f14 1139136 0 2024-09-13T02:52:41.780 INFO:tasks.workunit.client.1.smithi142.stdout:9/657: rmdir dd/d17/d44/d82/d99/da8 39 2024-09-13T02:52:41.782 INFO:tasks.workunit.client.1.smithi142.stdout:9/658: write dd/d17/d44/d95/fd3 [814455,38884] 0 2024-09-13T02:52:41.782 INFO:tasks.workunit.client.1.smithi142.stdout:0/553: dwrite d10/d6c/f9f [0,4194304] 0 2024-09-13T02:52:41.784 INFO:tasks.workunit.client.1.smithi142.stdout:0/554: stat d10/d6c/d88/d1a/d7a/f81 0 2024-09-13T02:52:41.787 INFO:tasks.workunit.client.1.smithi142.stdout:0/555: read d10/d6c/d88/d21/d51/f92 [713142,33894] 0 2024-09-13T02:52:41.789 INFO:tasks.workunit.client.1.smithi142.stdout:9/659: dwrite dd/f4c [4194304,4194304] 0 2024-09-13T02:52:41.797 INFO:tasks.workunit.client.1.smithi142.stdout:9/660: dwrite dd/d17/d69/d84/fb4 [0,4194304] 0 2024-09-13T02:52:41.798 INFO:tasks.workunit.client.1.smithi142.stdout:9/661: chown dd/d87/d8e/da3/ddb/fe7 12 1 2024-09-13T02:52:41.841 INFO:tasks.workunit.client.1.smithi142.stdout:5/594: write d8/d24/d26/d2d/f7d [2092560,16399] 0 2024-09-13T02:52:41.842 INFO:tasks.workunit.client.1.smithi142.stdout:8/472: mknod d0/d82/c97 0 2024-09-13T02:52:41.844 INFO:tasks.workunit.client.0.smithi098.stdout:3/139: creat d7/d9/d25/d2b/f2c x:0 0 0 2024-09-13T02:52:41.845 INFO:tasks.workunit.client.1.smithi142.stdout:4/536: symlink d0/d2b/d2d/d31/d43/lab 0 2024-09-13T02:52:41.849 INFO:tasks.workunit.client.0.smithi098.stdout:3/140: mkdir d7/d9/d15/d2d 0 2024-09-13T02:52:41.849 INFO:tasks.workunit.client.0.smithi098.stdout:1/168: sync 2024-09-13T02:52:41.849 INFO:tasks.workunit.client.0.smithi098.stdout:5/130: sync 2024-09-13T02:52:41.851 INFO:tasks.workunit.client.1.smithi142.stdout:3/550: write d12/d16/d3c/f62 [4881401,93269] 0 2024-09-13T02:52:41.855 INFO:tasks.workunit.client.0.smithi098.stdout:1/169: mknod d9/d33/c40 0 2024-09-13T02:52:41.857 INFO:tasks.workunit.client.1.smithi142.stdout:3/551: dwrite d12/d16/d25/f26 [4194304,4194304] 0 2024-09-13T02:52:41.858 INFO:tasks.workunit.client.0.smithi098.stdout:5/131: creat d0/d1/d1a/f34 x:0 0 0 2024-09-13T02:52:41.859 INFO:tasks.workunit.client.0.smithi098.stdout:5/132: fsync d0/ff 0 2024-09-13T02:52:41.859 INFO:tasks.workunit.client.0.smithi098.stdout:1/170: dread f1 [0,4194304] 0 2024-09-13T02:52:41.876 INFO:tasks.workunit.client.1.smithi142.stdout:1/652: truncate d12/d13/f19 611079 0 2024-09-13T02:52:41.877 INFO:tasks.workunit.client.1.smithi142.stdout:5/595: mknod d8/d24/d3f/d4a/cbd 0 2024-09-13T02:52:41.880 INFO:tasks.workunit.client.1.smithi142.stdout:9/662: write dd/d17/d25/d3e/f5d [3763526,1461] 0 2024-09-13T02:52:41.886 INFO:tasks.workunit.client.1.smithi142.stdout:1/653: fdatasync d12/f22 0 2024-09-13T02:52:41.886 INFO:tasks.workunit.client.1.smithi142.stdout:6/605: write d1/dd/d16/f1c [1078166,50471] 0 2024-09-13T02:52:41.887 INFO:tasks.workunit.client.1.smithi142.stdout:5/596: creat d8/d47/d65/da0/fbe x:0 0 0 2024-09-13T02:52:41.891 INFO:tasks.workunit.client.1.smithi142.stdout:6/606: dread d1/d7/d42/f8c [0,4194304] 0 2024-09-13T02:52:41.891 INFO:tasks.workunit.client.1.smithi142.stdout:7/548: link d10/d13/d1d/d44/c4a d10/d13/d1d/d2b/d56/d5f/d73/cb8 0 2024-09-13T02:52:41.892 INFO:tasks.workunit.client.1.smithi142.stdout:7/549: chown d10/d64 6 1 2024-09-13T02:52:41.892 INFO:tasks.workunit.client.1.smithi142.stdout:6/607: readlink d1/d4a/lb1 0 2024-09-13T02:52:41.892 INFO:tasks.workunit.client.1.smithi142.stdout:3/552: creat d12/d16/da3/fa9 x:0 0 0 2024-09-13T02:52:41.894 INFO:tasks.workunit.client.1.smithi142.stdout:7/550: write d10/f47 [268408,57851] 0 2024-09-13T02:52:41.894 INFO:tasks.workunit.client.1.smithi142.stdout:6/608: write d1/d7/f8d [1224860,39008] 0 2024-09-13T02:52:41.896 INFO:tasks.workunit.client.1.smithi142.stdout:4/537: truncate d0/d2b/d21/d30/fa8 800023 0 2024-09-13T02:52:41.897 INFO:tasks.workunit.client.1.smithi142.stdout:9/663: dread dd/d17/d25/f29 [0,4194304] 0 2024-09-13T02:52:41.898 INFO:tasks.workunit.client.1.smithi142.stdout:5/597: fsync d8/d24/d64/d68/f77 0 2024-09-13T02:52:41.898 INFO:tasks.workunit.client.1.smithi142.stdout:7/551: write d10/d13/d1d/d2b/d56/d41/f68 [3124785,55310] 0 2024-09-13T02:52:41.902 INFO:tasks.workunit.client.1.smithi142.stdout:8/473: dread d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:41.903 INFO:tasks.workunit.client.1.smithi142.stdout:0/556: getdents d10/d6c/d88/d1a 0 2024-09-13T02:52:41.904 INFO:tasks.workunit.client.1.smithi142.stdout:2/439: getdents d1/d29 0 2024-09-13T02:52:41.905 INFO:tasks.workunit.client.1.smithi142.stdout:6/609: symlink d1/d4a/lcf 0 2024-09-13T02:52:41.914 INFO:tasks.workunit.client.1.smithi142.stdout:6/610: rmdir d1/dd 39 2024-09-13T02:52:41.914 INFO:tasks.workunit.client.1.smithi142.stdout:2/440: dread d1/de/f26 [0,4194304] 0 2024-09-13T02:52:41.915 INFO:tasks.workunit.client.1.smithi142.stdout:1/654: creat d12/d13/fce x:0 0 0 2024-09-13T02:52:41.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/611: dread - d1/d7/d19/d48/d90/f9e zero size 2024-09-13T02:52:41.917 INFO:tasks.workunit.client.1.smithi142.stdout:9/664: write dd/d87/d8e/da3/da5/fb5 [932147,95911] 0 2024-09-13T02:52:41.919 INFO:tasks.workunit.client.1.smithi142.stdout:3/553: creat d12/d16/d25/d2e/d38/d4d/d53/faa x:0 0 0 2024-09-13T02:52:41.920 INFO:tasks.workunit.client.1.smithi142.stdout:4/538: creat d0/d2b/d2d/fac x:0 0 0 2024-09-13T02:52:41.923 INFO:tasks.workunit.client.1.smithi142.stdout:0/557: dread d10/d6c/d88/d21/d51/f92 [0,4194304] 0 2024-09-13T02:52:41.924 INFO:tasks.workunit.client.1.smithi142.stdout:1/655: symlink d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/lcf 0 2024-09-13T02:52:41.924 INFO:tasks.workunit.client.1.smithi142.stdout:5/598: dwrite d8/f66 [0,4194304] 0 2024-09-13T02:52:41.926 INFO:tasks.workunit.client.1.smithi142.stdout:9/665: mkdir dd/d17/d69/d84/df8 0 2024-09-13T02:52:41.928 INFO:tasks.workunit.client.1.smithi142.stdout:4/539: dread d0/d2b/d21/d30/fa8 [0,4194304] 0 2024-09-13T02:52:41.928 INFO:tasks.workunit.client.1.smithi142.stdout:3/554: rename d12/d16/d25/f41 to d12/d16/d3c/d79/fab 0 2024-09-13T02:52:41.929 INFO:tasks.workunit.client.1.smithi142.stdout:3/555: write d12/d16/d3c/d7d/f96 [974147,16401] 0 2024-09-13T02:52:41.931 INFO:tasks.workunit.client.1.smithi142.stdout:5/599: creat d8/d24/d26/d63/fbf x:0 0 0 2024-09-13T02:52:41.931 INFO:tasks.workunit.client.1.smithi142.stdout:9/666: dread dd/d17/d69/d84/d41/f59 [0,4194304] 0 2024-09-13T02:52:41.932 INFO:tasks.workunit.client.1.smithi142.stdout:5/600: readlink d8/l69 0 2024-09-13T02:52:41.933 INFO:tasks.workunit.client.1.smithi142.stdout:3/556: chown d12/d16/d25/d2e/d38/d6b/f7f 1041542 1 2024-09-13T02:52:41.933 INFO:tasks.workunit.client.1.smithi142.stdout:0/558: dread d10/d6c/d88/d21/d51/f54 [0,4194304] 0 2024-09-13T02:52:41.934 INFO:tasks.workunit.client.1.smithi142.stdout:4/540: mkdir d0/df/da5/dad 0 2024-09-13T02:52:41.935 INFO:tasks.workunit.client.1.smithi142.stdout:2/441: getdents d1/d2d 0 2024-09-13T02:52:41.936 INFO:tasks.workunit.client.1.smithi142.stdout:6/612: getdents d1/dd/d53/d78/d8f 0 2024-09-13T02:52:41.937 INFO:tasks.workunit.client.1.smithi142.stdout:5/601: creat d8/dac/fc0 x:0 0 0 2024-09-13T02:52:41.938 INFO:tasks.workunit.client.1.smithi142.stdout:6/613: write d1/d7/fa7 [960771,42961] 0 2024-09-13T02:52:41.939 INFO:tasks.workunit.client.1.smithi142.stdout:5/602: readlink d8/d24/d26/l3b 0 2024-09-13T02:52:41.941 INFO:tasks.workunit.client.1.smithi142.stdout:3/557: rename d12/d16/d25/d2e/d38/d4d/d53/d78/f8a to d12/d16/d3c/d7d/d91/fac 0 2024-09-13T02:52:41.941 INFO:tasks.workunit.client.0.smithi098.stdout:5/133: mknod d0/d1/c35 0 2024-09-13T02:52:41.942 INFO:tasks.workunit.client.0.smithi098.stdout:1/171: dwrite d9/f1c [0,4194304] 0 2024-09-13T02:52:41.942 INFO:tasks.workunit.client.0.smithi098.stdout:3/141: truncate f4 5109419 0 2024-09-13T02:52:41.944 INFO:tasks.workunit.client.1.smithi142.stdout:9/667: dread dd/f58 [0,4194304] 0 2024-09-13T02:52:41.944 INFO:tasks.workunit.client.0.smithi098.stdout:5/134: write d0/d15/d17/d1c/f2d [321044,6133] 0 2024-09-13T02:52:41.946 INFO:tasks.workunit.client.1.smithi142.stdout:2/442: truncate d1/de/d1f/d13/d59/f6a 1409908 0 2024-09-13T02:52:41.947 INFO:tasks.workunit.client.0.smithi098.stdout:1/172: symlink d9/d33/l41 0 2024-09-13T02:52:41.949 INFO:tasks.workunit.client.1.smithi142.stdout:6/614: write d1/d7/d19/d48/f96 [566009,1919] 0 2024-09-13T02:52:41.950 INFO:tasks.workunit.client.1.smithi142.stdout:6/615: stat d1/d7/d19/d48/cba 0 2024-09-13T02:52:41.951 INFO:tasks.workunit.client.0.smithi098.stdout:5/135: dwrite d0/ff [4194304,4194304] 0 2024-09-13T02:52:41.951 INFO:tasks.workunit.client.1.smithi142.stdout:2/443: dread d1/d2d/f40 [0,4194304] 0 2024-09-13T02:52:41.952 INFO:tasks.workunit.client.0.smithi098.stdout:3/142: symlink d7/d9/l2e 0 2024-09-13T02:52:41.954 INFO:tasks.workunit.client.0.smithi098.stdout:3/143: dread d7/fc [0,4194304] 0 2024-09-13T02:52:41.958 INFO:tasks.workunit.client.1.smithi142.stdout:0/559: dwrite d10/d6c/d88/d1a/d1e/d42/d4b/f61 [0,4194304] 0 2024-09-13T02:52:41.960 INFO:tasks.workunit.client.1.smithi142.stdout:9/668: creat dd/d17/d44/d95/dd1/ff9 x:0 0 0 2024-09-13T02:52:41.964 INFO:tasks.workunit.client.0.smithi098.stdout:1/173: write f8 [4034844,38823] 0 2024-09-13T02:52:41.965 INFO:tasks.workunit.client.0.smithi098.stdout:1/174: fsync d9/d33/d19/f21 0 2024-09-13T02:52:41.965 INFO:tasks.workunit.client.1.smithi142.stdout:6/616: creat d1/dd/d16/d4d/fd0 x:0 0 0 2024-09-13T02:52:41.966 INFO:tasks.workunit.client.1.smithi142.stdout:6/617: fdatasync d1/f3d 0 2024-09-13T02:52:41.966 INFO:tasks.workunit.client.0.smithi098.stdout:3/144: mknod d7/d9/d15/d26/c2f 0 2024-09-13T02:52:41.968 INFO:tasks.workunit.client.1.smithi142.stdout:3/558: mkdir d12/d16/d25/d2e/d38/d4d/dad 0 2024-09-13T02:52:41.970 INFO:tasks.workunit.client.1.smithi142.stdout:5/603: truncate d8/d24/d26/f60 291804 0 2024-09-13T02:52:41.971 INFO:tasks.workunit.client.1.smithi142.stdout:6/618: dread d1/d7/d5f/f68 [0,4194304] 0 2024-09-13T02:52:41.972 INFO:tasks.workunit.client.1.smithi142.stdout:6/619: chown d1/d7/d19/d30/f67 118812 1 2024-09-13T02:52:41.975 INFO:tasks.workunit.client.1.smithi142.stdout:0/560: rename d10/d6c/d88/d30/l63 to d10/d6c/d88/d45/lc1 0 2024-09-13T02:52:41.976 INFO:tasks.workunit.client.0.smithi098.stdout:1/175: unlink d9/ce 0 2024-09-13T02:52:41.977 INFO:tasks.workunit.client.0.smithi098.stdout:3/145: mknod d7/d9/d15/d2d/c30 0 2024-09-13T02:52:41.982 INFO:tasks.workunit.client.0.smithi098.stdout:1/176: mknod d9/d33/d19/d35/c42 0 2024-09-13T02:52:41.984 INFO:tasks.workunit.client.1.smithi142.stdout:3/559: mkdir d12/d16/d25/d2e/d48/d5c/d73/dae 0 2024-09-13T02:52:41.984 INFO:tasks.workunit.client.0.smithi098.stdout:1/177: truncate d9/f38 788556 0 2024-09-13T02:52:41.986 INFO:tasks.workunit.client.0.smithi098.stdout:3/146: dwrite d7/d9/d15/d17/f28 [0,4194304] 0 2024-09-13T02:52:41.986 INFO:tasks.workunit.client.1.smithi142.stdout:5/604: creat d8/fc1 x:0 0 0 2024-09-13T02:52:41.987 INFO:tasks.workunit.client.0.smithi098.stdout:5/136: dread d0/d15/d17/d1c/f1d [0,4194304] 0 2024-09-13T02:52:41.987 INFO:tasks.workunit.client.1.smithi142.stdout:5/605: chown d8/d24/d26/d45/d8e 233765879 1 2024-09-13T02:52:41.987 INFO:tasks.workunit.client.0.smithi098.stdout:3/147: truncate d7/d9/d15/d26/f2a 688975 0 2024-09-13T02:52:41.990 INFO:tasks.workunit.client.1.smithi142.stdout:3/560: dwrite d12/d16/d3c/f8d [0,4194304] 0 2024-09-13T02:52:41.992 INFO:tasks.workunit.client.1.smithi142.stdout:6/620: unlink d1/dd/d57/d7b/fc8 0 2024-09-13T02:52:41.994 INFO:tasks.workunit.client.1.smithi142.stdout:9/669: dread dd/d17/d25/f42 [0,4194304] 0 2024-09-13T02:52:41.994 INFO:tasks.workunit.client.1.smithi142.stdout:2/444: rename d1/d2c/d6f/d79 to d1/d2c/d92 0 2024-09-13T02:52:41.995 INFO:tasks.workunit.client.1.smithi142.stdout:3/561: fdatasync d12/d16/d25/d2e/d48/d5c/f6e 0 2024-09-13T02:52:41.996 INFO:tasks.workunit.client.0.smithi098.stdout:3/148: creat d7/d9/f31 x:0 0 0 2024-09-13T02:52:41.996 INFO:tasks.workunit.client.1.smithi142.stdout:6/621: dread - d1/d7/d19/d48/f9c zero size 2024-09-13T02:52:41.997 INFO:tasks.workunit.client.1.smithi142.stdout:3/562: chown cb 321822 1 2024-09-13T02:52:41.997 INFO:tasks.workunit.client.1.smithi142.stdout:9/670: write dd/d17/d44/f5c [1270859,80136] 0 2024-09-13T02:52:41.998 INFO:tasks.workunit.client.1.smithi142.stdout:0/561: unlink d10/d6c/d88/d1a/d3a/fba 0 2024-09-13T02:52:41.999 INFO:tasks.workunit.client.1.smithi142.stdout:5/606: dwrite d8/d24/d26/d61/f83 [4194304,4194304] 0 2024-09-13T02:52:42.001 INFO:tasks.workunit.client.1.smithi142.stdout:0/562: fsync d10/d6c/d88/d21/d51/fa4 0 2024-09-13T02:52:42.004 INFO:tasks.workunit.client.0.smithi098.stdout:3/149: dwrite d7/d9/d15/f1c [0,4194304] 0 2024-09-13T02:52:42.006 INFO:tasks.workunit.client.1.smithi142.stdout:2/445: fsync d1/d42/f8f 0 2024-09-13T02:52:42.006 INFO:tasks.workunit.client.1.smithi142.stdout:7/552: sync 2024-09-13T02:52:42.007 INFO:tasks.workunit.client.1.smithi142.stdout:7/553: read - d10/d31/f63 zero size 2024-09-13T02:52:42.007 INFO:tasks.workunit.client.1.smithi142.stdout:2/446: readlink d1/de/d31/d6c/d6d/d47/l4b 0 2024-09-13T02:52:42.007 INFO:tasks.workunit.client.0.smithi098.stdout:3/150: dread d7/f14 [0,4194304] 0 2024-09-13T02:52:42.008 INFO:tasks.workunit.client.1.smithi142.stdout:2/447: read - d1/de/d31/d6c/f88 zero size 2024-09-13T02:52:42.008 INFO:tasks.workunit.client.0.smithi098.stdout:3/151: chown d7/d9 1868251978 1 2024-09-13T02:52:42.010 INFO:tasks.workunit.client.0.smithi098.stdout:8/155: sync 2024-09-13T02:52:42.010 INFO:tasks.workunit.client.1.smithi142.stdout:6/622: creat d1/d7/d42/d88/fd1 x:0 0 0 2024-09-13T02:52:42.011 INFO:tasks.workunit.client.0.smithi098.stdout:8/156: read d2/f15 [438375,2682] 0 2024-09-13T02:52:42.012 INFO:tasks.workunit.client.0.smithi098.stdout:8/157: chown d2 689855 1 2024-09-13T02:52:42.013 INFO:tasks.workunit.client.1.smithi142.stdout:2/448: dwrite d1/de/d1f/d13/f6b [0,4194304] 0 2024-09-13T02:52:42.019 INFO:tasks.workunit.client.0.smithi098.stdout:8/158: mkdir d2/d2f 0 2024-09-13T02:52:42.019 INFO:tasks.workunit.client.0.smithi098.stdout:8/159: dread - d2/f1a zero size 2024-09-13T02:52:42.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/607: mknod d8/d24/d26/d61/cc2 0 2024-09-13T02:52:42.021 INFO:tasks.workunit.client.1.smithi142.stdout:5/608: dread d8/f1b [4194304,4194304] 0 2024-09-13T02:52:42.025 INFO:tasks.workunit.client.0.smithi098.stdout:8/160: fsync d2/f1b 0 2024-09-13T02:52:42.026 INFO:tasks.workunit.client.0.smithi098.stdout:8/161: fdatasync f1 0 2024-09-13T02:52:42.032 INFO:tasks.workunit.client.0.smithi098.stdout:8/162: rename d2/d28/c2d to d2/dd/d11/d1d/c30 0 2024-09-13T02:52:42.033 INFO:tasks.workunit.client.0.smithi098.stdout:3/152: getdents d7 0 2024-09-13T02:52:42.033 INFO:tasks.workunit.client.0.smithi098.stdout:8/163: dread - d2/f27 zero size 2024-09-13T02:52:42.037 INFO:tasks.workunit.client.0.smithi098.stdout:3/153: rename d7/f22 to d7/d9/f32 0 2024-09-13T02:52:42.039 INFO:tasks.workunit.client.0.smithi098.stdout:3/154: rmdir d7/d9/d15/d17 39 2024-09-13T02:52:42.040 INFO:tasks.workunit.client.0.smithi098.stdout:3/155: write d7/f1d [471589,70681] 0 2024-09-13T02:52:42.042 INFO:tasks.workunit.client.0.smithi098.stdout:3/156: chown l3 366439 1 2024-09-13T02:52:42.047 INFO:tasks.workunit.client.0.smithi098.stdout:8/164: dwrite d2/f15 [0,4194304] 0 2024-09-13T02:52:42.050 INFO:tasks.workunit.client.0.smithi098.stdout:8/165: rename d2/d28/f29 to d2/d2f/f31 0 2024-09-13T02:52:42.057 INFO:tasks.workunit.client.0.smithi098.stdout:8/166: dwrite d2/f1a [0,4194304] 0 2024-09-13T02:52:42.061 INFO:tasks.workunit.client.0.smithi098.stdout:8/167: rename d2/l7 to d2/d28/l32 0 2024-09-13T02:52:42.062 INFO:tasks.workunit.client.0.smithi098.stdout:8/168: chown d2/c8 105 1 2024-09-13T02:52:42.063 INFO:tasks.workunit.client.1.smithi142.stdout:3/563: mkdir d12/d16/d25/d2e/d48/d5c/d8c/daf 0 2024-09-13T02:52:42.064 INFO:tasks.workunit.client.1.smithi142.stdout:2/449: mknod d1/d29/d72/c93 0 2024-09-13T02:52:42.064 INFO:tasks.workunit.client.0.smithi098.stdout:8/169: mknod d2/d28/c33 0 2024-09-13T02:52:42.065 INFO:tasks.workunit.client.1.smithi142.stdout:9/671: getdents dd/d17/d44/d95/dd1/ddf 0 2024-09-13T02:52:42.065 INFO:tasks.workunit.client.0.smithi098.stdout:8/170: chown d2/dd/f25 7 1 2024-09-13T02:52:42.066 INFO:tasks.workunit.client.0.smithi098.stdout:3/157: dread f4 [0,4194304] 0 2024-09-13T02:52:42.067 INFO:tasks.workunit.client.1.smithi142.stdout:9/672: chown dd/d17/d25/c77 7044 1 2024-09-13T02:52:42.069 INFO:tasks.workunit.client.1.smithi142.stdout:5/609: rename d8/d24 to d8/dc3 0 2024-09-13T02:52:42.070 INFO:tasks.workunit.client.1.smithi142.stdout:9/673: fdatasync dd/d17/d44/d95/fb0 0 2024-09-13T02:52:42.072 INFO:tasks.workunit.client.0.smithi098.stdout:8/171: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:52:42.072 INFO:tasks.workunit.client.0.smithi098.stdout:3/158: creat d7/d9/d25/d2b/f33 x:0 0 0 2024-09-13T02:52:42.072 INFO:tasks.workunit.client.1.smithi142.stdout:0/563: dwrite d10/d6c/d88/d36/f59 [0,4194304] 0 2024-09-13T02:52:42.072 INFO:tasks.workunit.client.1.smithi142.stdout:0/564: fsync d10/f13 0 2024-09-13T02:52:42.072 INFO:tasks.workunit.client.1.smithi142.stdout:6/623: dwrite d1/d7/d42/f44 [4194304,4194304] 0 2024-09-13T02:52:42.076 INFO:tasks.workunit.client.0.smithi098.stdout:8/172: fsync d2/dd/d11/f18 0 2024-09-13T02:52:42.076 INFO:tasks.workunit.client.1.smithi142.stdout:3/564: symlink d12/d16/d3c/d7d/d91/lb0 0 2024-09-13T02:52:42.077 INFO:tasks.workunit.client.1.smithi142.stdout:3/565: fsync d12/f22 0 2024-09-13T02:52:42.081 INFO:tasks.workunit.client.1.smithi142.stdout:5/610: dwrite d8/dc3/d3f/d4a/fb4 [0,4194304] 0 2024-09-13T02:52:42.084 INFO:tasks.workunit.client.1.smithi142.stdout:5/611: write d8/d47/d65/da0/fbe [475491,24813] 0 2024-09-13T02:52:42.085 INFO:tasks.workunit.client.0.smithi098.stdout:8/173: write d2/dd/d11/f18 [923526,13735] 0 2024-09-13T02:52:42.087 INFO:tasks.workunit.client.1.smithi142.stdout:6/624: mkdir d1/dd/d16/d47/dad/dd2 0 2024-09-13T02:52:42.088 INFO:tasks.workunit.client.1.smithi142.stdout:2/450: getdents d1/d42/d44 0 2024-09-13T02:52:42.091 INFO:tasks.workunit.client.1.smithi142.stdout:5/612: rename d8/dc3/f3e to d8/d47/fc4 0 2024-09-13T02:52:42.094 INFO:tasks.workunit.client.1.smithi142.stdout:2/451: write d1/f8c [402698,127570] 0 2024-09-13T02:52:42.095 INFO:tasks.workunit.client.1.smithi142.stdout:5/613: mkdir d8/dc3/d26/d45/dc5 0 2024-09-13T02:52:42.096 INFO:tasks.workunit.client.1.smithi142.stdout:6/625: dread d1/d7/f6d [0,4194304] 0 2024-09-13T02:52:42.096 INFO:tasks.workunit.client.1.smithi142.stdout:2/452: chown d1/de/d31/d6c/d6d/d47 2029 1 2024-09-13T02:52:42.096 INFO:tasks.workunit.client.0.smithi098.stdout:8/174: link d2/dd/d11/d1d/c26 d2/dd/d2e/c34 0 2024-09-13T02:52:42.097 INFO:tasks.workunit.client.0.smithi098.stdout:8/175: fsync d2/f23 0 2024-09-13T02:52:42.100 INFO:tasks.workunit.client.1.smithi142.stdout:5/614: mkdir d8/dc3/d26/d45/d8e/dc6 0 2024-09-13T02:52:42.101 INFO:tasks.workunit.client.1.smithi142.stdout:1/656: sync 2024-09-13T02:52:42.101 INFO:tasks.workunit.client.1.smithi142.stdout:8/474: sync 2024-09-13T02:52:42.103 INFO:tasks.workunit.client.1.smithi142.stdout:6/626: symlink d1/dd/d53/d78/ld3 0 2024-09-13T02:52:42.104 INFO:tasks.workunit.client.1.smithi142.stdout:3/566: dwrite d12/d16/f43 [4194304,4194304] 0 2024-09-13T02:52:42.111 INFO:tasks.workunit.client.1.smithi142.stdout:0/565: dread d10/f7c [0,4194304] 0 2024-09-13T02:52:42.111 INFO:tasks.workunit.client.1.smithi142.stdout:8/475: creat d0/d6/dc/d40/d4d/d62/f98 x:0 0 0 2024-09-13T02:52:42.112 INFO:tasks.workunit.client.0.smithi098.stdout:8/176: getdents d2/dd/d2e 0 2024-09-13T02:52:42.113 INFO:tasks.workunit.client.1.smithi142.stdout:6/627: dread d1/d7/f8d [0,4194304] 0 2024-09-13T02:52:42.113 INFO:tasks.workunit.client.0.smithi098.stdout:8/177: chown d2/d28/f2a 186 1 2024-09-13T02:52:42.114 INFO:tasks.workunit.client.1.smithi142.stdout:5/615: dwrite d8/dc3/f5f [4194304,4194304] 0 2024-09-13T02:52:42.114 INFO:tasks.workunit.client.1.smithi142.stdout:8/476: chown d0/d6/dc/d40/d41/l8b 5844944 1 2024-09-13T02:52:42.115 INFO:tasks.workunit.client.1.smithi142.stdout:5/616: chown d8/dc3/d26/d45/c9d 1407 1 2024-09-13T02:52:42.116 INFO:tasks.workunit.client.1.smithi142.stdout:3/567: rmdir d12/d16/d3c/d79/d9b 39 2024-09-13T02:52:42.118 INFO:tasks.workunit.client.1.smithi142.stdout:2/453: truncate d1/f54 2986031 0 2024-09-13T02:52:42.119 INFO:tasks.workunit.client.1.smithi142.stdout:2/454: chown d1/de/d31/d6c/d6d/f52 1195853 1 2024-09-13T02:52:42.120 INFO:tasks.workunit.client.1.smithi142.stdout:6/628: dwrite d1/d7/d19/f45 [0,4194304] 0 2024-09-13T02:52:42.126 INFO:tasks.workunit.client.1.smithi142.stdout:8/477: rmdir d0/d6/dc/d40/d41 39 2024-09-13T02:52:42.129 INFO:tasks.workunit.client.1.smithi142.stdout:2/455: creat d1/d2c/d92/f94 x:0 0 0 2024-09-13T02:52:42.130 INFO:tasks.workunit.client.1.smithi142.stdout:2/456: dread - d1/de/d31/f62 zero size 2024-09-13T02:52:42.131 INFO:tasks.workunit.client.1.smithi142.stdout:1/657: dwrite d12/d13/d20/d66/fbd [0,4194304] 0 2024-09-13T02:52:42.132 INFO:tasks.workunit.client.1.smithi142.stdout:2/457: fdatasync d1/de/d31/d6c/d6d/f5c 0 2024-09-13T02:52:42.134 INFO:tasks.workunit.client.1.smithi142.stdout:2/458: chown d1/d2d/c36 3 1 2024-09-13T02:52:42.136 INFO:tasks.workunit.client.0.smithi098.stdout:8/178: dwrite d2/f1b [0,4194304] 0 2024-09-13T02:52:42.137 INFO:tasks.workunit.client.0.smithi098.stdout:8/179: dread - d2/d28/f2a zero size 2024-09-13T02:52:42.139 INFO:tasks.workunit.client.0.smithi098.stdout:8/180: write d2/dd/d11/f18 [701448,23280] 0 2024-09-13T02:52:42.140 INFO:tasks.workunit.client.0.smithi098.stdout:8/181: chown d2/d2f/f31 136 1 2024-09-13T02:52:42.142 INFO:tasks.workunit.client.1.smithi142.stdout:0/566: rmdir d10/d6c/d88/d45/db2 0 2024-09-13T02:52:42.145 INFO:tasks.workunit.client.0.smithi098.stdout:8/182: creat d2/dd/f35 x:0 0 0 2024-09-13T02:52:42.145 INFO:tasks.workunit.client.0.smithi098.stdout:8/183: chown d2/d2f/f31 24065 1 2024-09-13T02:52:42.146 INFO:tasks.workunit.client.1.smithi142.stdout:1/658: mknod d12/d13/d20/d27/d3c/d71/d81/d92/daa/cd0 0 2024-09-13T02:52:42.147 INFO:tasks.workunit.client.1.smithi142.stdout:2/459: mknod d1/d2c/d6f/c95 0 2024-09-13T02:52:42.147 INFO:tasks.workunit.client.1.smithi142.stdout:1/659: chown d12/d13/d20/d66/la6 2569611 1 2024-09-13T02:52:42.148 INFO:tasks.workunit.client.0.smithi098.stdout:8/184: mknod d2/dd/d11/d1d/c36 0 2024-09-13T02:52:42.149 INFO:tasks.workunit.client.1.smithi142.stdout:1/660: write d12/d13/d20/d66/d55/da0/fb2 [8818502,60120] 0 2024-09-13T02:52:42.149 INFO:tasks.workunit.client.1.smithi142.stdout:5/617: truncate d8/f66 3475576 0 2024-09-13T02:52:42.151 INFO:tasks.workunit.client.1.smithi142.stdout:6/629: creat d1/dd/d53/d78/fd4 x:0 0 0 2024-09-13T02:52:42.152 INFO:tasks.workunit.client.1.smithi142.stdout:6/630: chown d1/d7/d19/d48/d90/c9d 61 1 2024-09-13T02:52:42.152 INFO:tasks.workunit.client.1.smithi142.stdout:6/631: fdatasync d1/d7/fa7 0 2024-09-13T02:52:42.153 INFO:tasks.workunit.client.1.smithi142.stdout:2/460: mknod d1/de/d1f/d13/d59/c96 0 2024-09-13T02:52:42.154 INFO:tasks.workunit.client.1.smithi142.stdout:2/461: dread - d1/d2c/d6f/f7a zero size 2024-09-13T02:52:42.155 INFO:tasks.workunit.client.1.smithi142.stdout:0/567: symlink d10/d6c/d88/lc2 0 2024-09-13T02:52:42.156 INFO:tasks.workunit.client.1.smithi142.stdout:0/568: read d10/d6c/d88/d1a/f66 [395593,128600] 0 2024-09-13T02:52:42.156 INFO:tasks.workunit.client.1.smithi142.stdout:8/478: creat d0/d6/dc/d45/d8/df/f99 x:0 0 0 2024-09-13T02:52:42.156 INFO:tasks.workunit.client.1.smithi142.stdout:0/569: stat d10/d6c/d88/d45/l6a 0 2024-09-13T02:52:42.157 INFO:tasks.workunit.client.1.smithi142.stdout:6/632: mknod d1/dd/d57/cd5 0 2024-09-13T02:52:42.157 INFO:tasks.workunit.client.1.smithi142.stdout:5/618: mknod d8/dc3/d64/cc7 0 2024-09-13T02:52:42.158 INFO:tasks.workunit.client.1.smithi142.stdout:1/661: mkdir d12/d13/d20/d27/d3c/d71/dd1 0 2024-09-13T02:52:42.159 INFO:tasks.workunit.client.1.smithi142.stdout:2/462: creat d1/d42/d44/f97 x:0 0 0 2024-09-13T02:52:42.160 INFO:tasks.workunit.client.1.smithi142.stdout:6/633: truncate d1/dd/d53/d78/d8f/da8/fb4 739748 0 2024-09-13T02:52:42.160 INFO:tasks.workunit.client.1.smithi142.stdout:0/570: creat d10/d6c/d88/d21/d51/d35/d9b/da5/fc3 x:0 0 0 2024-09-13T02:52:42.161 INFO:tasks.workunit.client.0.smithi098.stdout:8/185: dread d2/dd/d11/d1d/f24 [0,4194304] 0 2024-09-13T02:52:42.163 INFO:tasks.workunit.client.0.smithi098.stdout:8/186: mknod d2/dd/d11/c37 0 2024-09-13T02:52:42.167 INFO:tasks.workunit.client.0.smithi098.stdout:8/187: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:52:42.169 INFO:tasks.workunit.client.0.smithi098.stdout:8/188: creat d2/d2f/f38 x:0 0 0 2024-09-13T02:52:42.171 INFO:tasks.workunit.client.1.smithi142.stdout:4/541: sync 2024-09-13T02:52:42.171 INFO:tasks.workunit.client.0.smithi098.stdout:8/189: symlink d2/dd/d11/l39 0 2024-09-13T02:52:42.176 INFO:tasks.workunit.client.1.smithi142.stdout:2/463: symlink d1/d42/d44/l98 0 2024-09-13T02:52:42.176 INFO:tasks.workunit.client.1.smithi142.stdout:5/619: creat d8/dc3/d3f/d4a/fc8 x:0 0 0 2024-09-13T02:52:42.178 INFO:tasks.workunit.client.1.smithi142.stdout:2/464: chown d1/de/d1f/d13/d59 8786678 1 2024-09-13T02:52:42.179 INFO:tasks.workunit.client.1.smithi142.stdout:6/634: symlink d1/dd/d53/d78/ld6 0 2024-09-13T02:52:42.181 INFO:tasks.workunit.client.1.smithi142.stdout:1/662: dwrite d12/d13/d20/d66/d7d/f98 [0,4194304] 0 2024-09-13T02:52:42.182 INFO:tasks.workunit.client.1.smithi142.stdout:4/542: mkdir d0/df/da5/dad/dae 0 2024-09-13T02:52:42.184 INFO:tasks.workunit.client.1.smithi142.stdout:4/543: write d0/d2b/d21/d35/f5f [906397,22420] 0 2024-09-13T02:52:42.187 INFO:tasks.workunit.client.1.smithi142.stdout:4/544: write d0/d2b/d2d/d31/d43/f5a [3994930,67113] 0 2024-09-13T02:52:42.187 INFO:tasks.workunit.client.1.smithi142.stdout:6/635: dwrite d1/dd/d53/f73 [0,4194304] 0 2024-09-13T02:52:42.188 INFO:tasks.workunit.client.1.smithi142.stdout:1/663: dread d12/d13/d20/d66/d55/da0/fbb [0,4194304] 0 2024-09-13T02:52:42.189 INFO:tasks.workunit.client.1.smithi142.stdout:4/545: chown d0/df/f5d 3 1 2024-09-13T02:52:42.198 INFO:tasks.workunit.client.1.smithi142.stdout:1/664: symlink d12/d13/d1d/d26/ld2 0 2024-09-13T02:52:42.200 INFO:tasks.workunit.client.1.smithi142.stdout:6/636: getdents d1/dd/d53/d78/d8f/da8 0 2024-09-13T02:52:42.201 INFO:tasks.workunit.client.1.smithi142.stdout:4/546: getdents d0/d7e 0 2024-09-13T02:52:42.201 INFO:tasks.workunit.client.1.smithi142.stdout:4/547: dread - d0/df/d57/f89 zero size 2024-09-13T02:52:42.203 INFO:tasks.workunit.client.1.smithi142.stdout:6/637: creat d1/fd7 x:0 0 0 2024-09-13T02:52:42.204 INFO:tasks.workunit.client.1.smithi142.stdout:0/571: write d10/d6c/d88/d21/d51/fa7 [2470496,13090] 0 2024-09-13T02:52:42.206 INFO:tasks.workunit.client.1.smithi142.stdout:0/572: fdatasync d10/d6c/d88/d21/d8f/fa9 0 2024-09-13T02:52:42.230 INFO:tasks.workunit.client.1.smithi142.stdout:9/674: sync 2024-09-13T02:52:42.230 INFO:tasks.workunit.client.1.smithi142.stdout:7/554: sync 2024-09-13T02:52:42.230 INFO:tasks.workunit.client.1.smithi142.stdout:3/568: sync 2024-09-13T02:52:42.239 INFO:tasks.workunit.client.1.smithi142.stdout:0/573: chown d10/d6c/d88/d21/d8f 3 1 2024-09-13T02:52:42.240 INFO:tasks.workunit.client.1.smithi142.stdout:4/548: dwrite d0/d2b/d21/d30/f8a [0,4194304] 0 2024-09-13T02:52:42.243 INFO:tasks.workunit.client.1.smithi142.stdout:5/620: dwrite d8/f19 [4194304,4194304] 0 2024-09-13T02:52:42.245 INFO:tasks.workunit.client.1.smithi142.stdout:7/555: symlink d10/d13/d1d/d25/d45/d92/lb9 0 2024-09-13T02:52:42.249 INFO:tasks.workunit.client.1.smithi142.stdout:5/621: creat d8/dc3/d26/d63/fc9 x:0 0 0 2024-09-13T02:52:42.250 INFO:tasks.workunit.client.1.smithi142.stdout:6/638: dread d1/d7/d19/f2f [0,4194304] 0 2024-09-13T02:52:42.251 INFO:tasks.workunit.client.1.smithi142.stdout:0/574: dread d10/d6c/d88/d21/d51/fa4 [0,4194304] 0 2024-09-13T02:52:42.251 INFO:tasks.workunit.client.1.smithi142.stdout:9/675: rename dd/d87/d8e/da3/da5 to dd/d17/d44/dfa 0 2024-09-13T02:52:42.253 INFO:tasks.workunit.client.1.smithi142.stdout:5/622: write d8/dc3/d3f/f95 [577635,115322] 0 2024-09-13T02:52:42.253 INFO:tasks.workunit.client.1.smithi142.stdout:7/556: creat d10/d13/d1d/d25/d45/d92/fba x:0 0 0 2024-09-13T02:52:42.254 INFO:tasks.workunit.client.1.smithi142.stdout:0/575: chown d10/d6c/d88/d21/d51/d35/d9b 1447857 1 2024-09-13T02:52:42.256 INFO:tasks.workunit.client.1.smithi142.stdout:5/623: write d8/dc3/d26/d45/d81/d8c/fa4 [495384,1897] 0 2024-09-13T02:52:42.256 INFO:tasks.workunit.client.1.smithi142.stdout:0/576: write d10/d23/f25 [2132661,109633] 0 2024-09-13T02:52:42.257 INFO:tasks.workunit.client.1.smithi142.stdout:6/639: symlink d1/dd/d53/d78/ld8 0 2024-09-13T02:52:42.257 INFO:tasks.workunit.client.1.smithi142.stdout:0/577: fsync d10/d6c/d88/f6e 0 2024-09-13T02:52:42.259 INFO:tasks.workunit.client.1.smithi142.stdout:9/676: rename dd/d17/d69/d84/c3c to dd/d17/d69/cfb 0 2024-09-13T02:52:42.261 INFO:tasks.workunit.client.1.smithi142.stdout:7/557: unlink d10/d13/d1d/d25/c3b 0 2024-09-13T02:52:42.262 INFO:tasks.workunit.client.1.smithi142.stdout:7/558: readlink d10/d13/d1d/d2b/dae/d9c/l9d 0 2024-09-13T02:52:42.263 INFO:tasks.workunit.client.1.smithi142.stdout:6/640: creat d1/d7/d5f/d60/d76/d7e/fd9 x:0 0 0 2024-09-13T02:52:42.265 INFO:tasks.workunit.client.1.smithi142.stdout:0/578: dwrite d10/d6c/d88/d1a/d1e/d42/f48 [0,4194304] 0 2024-09-13T02:52:42.265 INFO:tasks.workunit.client.1.smithi142.stdout:9/677: symlink dd/d87/d8e/da3/lfc 0 2024-09-13T02:52:42.266 INFO:tasks.workunit.client.1.smithi142.stdout:5/624: symlink d8/dc3/d3f/d4a/d4b/db9/lca 0 2024-09-13T02:52:42.267 INFO:tasks.workunit.client.1.smithi142.stdout:3/569: dread d12/d16/d25/d2e/d48/f52 [0,4194304] 0 2024-09-13T02:52:42.268 INFO:tasks.workunit.client.1.smithi142.stdout:0/579: readlink d10/d6c/d88/d1a/d3a/l3d 0 2024-09-13T02:52:42.269 INFO:tasks.workunit.client.1.smithi142.stdout:3/570: chown d12/d16/c74 6708 1 2024-09-13T02:52:42.270 INFO:tasks.workunit.client.1.smithi142.stdout:0/580: dread - d10/d6c/d88/d21/d51/d35/d9b/da5/fc3 zero size 2024-09-13T02:52:42.271 INFO:tasks.workunit.client.1.smithi142.stdout:7/559: link d10/d13/d22/f69 d10/d13/d1d/d2b/dae/d9c/fbb 0 2024-09-13T02:52:42.273 INFO:tasks.workunit.client.1.smithi142.stdout:9/678: rename dd/d17/fb3 to dd/d17/d69/ffd 0 2024-09-13T02:52:42.277 INFO:tasks.workunit.client.1.smithi142.stdout:5/625: read d8/dc3/d64/d68/f77 [175165,44531] 0 2024-09-13T02:52:42.277 INFO:tasks.workunit.client.1.smithi142.stdout:0/581: mkdir d10/d6c/d88/d21/daf/dc4 0 2024-09-13T02:52:42.278 INFO:tasks.workunit.client.1.smithi142.stdout:4/549: truncate d0/d2b/d2d/d31/d43/d48/f4d 2958330 0 2024-09-13T02:52:42.278 INFO:tasks.workunit.client.1.smithi142.stdout:0/582: dread - d10/d6c/d88/fb9 zero size 2024-09-13T02:52:42.281 INFO:tasks.workunit.client.1.smithi142.stdout:8/479: sync 2024-09-13T02:52:42.284 INFO:tasks.workunit.client.1.smithi142.stdout:5/626: mkdir d8/dc3/d26/d61/dcb 0 2024-09-13T02:52:42.284 INFO:tasks.workunit.client.1.smithi142.stdout:8/480: dread d0/f69 [0,4194304] 0 2024-09-13T02:52:42.287 INFO:tasks.workunit.client.1.smithi142.stdout:4/550: mkdir d0/d2b/d2d/d31/d43/daf 0 2024-09-13T02:52:42.289 INFO:tasks.workunit.client.1.smithi142.stdout:8/481: creat d0/d80/d8c/f9a x:0 0 0 2024-09-13T02:52:42.290 INFO:tasks.workunit.client.1.smithi142.stdout:5/627: dwrite d8/dc3/d26/d45/d81/d82/fa3 [0,4194304] 0 2024-09-13T02:52:42.290 INFO:tasks.workunit.client.1.smithi142.stdout:8/482: write d0/f6b [743505,2193] 0 2024-09-13T02:52:42.292 INFO:tasks.workunit.client.1.smithi142.stdout:4/551: stat d0/d2b/d2d/l95 0 2024-09-13T02:52:42.297 INFO:tasks.workunit.client.1.smithi142.stdout:6/641: dread d1/d7/d19/d48/fa1 [0,4194304] 0 2024-09-13T02:52:42.298 INFO:tasks.workunit.client.1.smithi142.stdout:9/679: write dd/f7e [1028783,14046] 0 2024-09-13T02:52:42.301 INFO:tasks.workunit.client.1.smithi142.stdout:3/571: truncate d12/d16/d25/d2e/d48/d5c/d66/f63 3401975 0 2024-09-13T02:52:42.302 INFO:tasks.workunit.client.1.smithi142.stdout:9/680: stat dd/d17/d4f/d91/dab 0 2024-09-13T02:52:42.304 INFO:tasks.workunit.client.1.smithi142.stdout:8/483: dwrite d0/d6/dc/d45/f73 [0,4194304] 0 2024-09-13T02:52:42.307 INFO:tasks.workunit.client.1.smithi142.stdout:7/560: dwrite d10/d13/d1d/f2c [0,4194304] 0 2024-09-13T02:52:42.308 INFO:tasks.workunit.client.1.smithi142.stdout:4/552: dwrite d0/d2b/d21/d35/f5f [0,4194304] 0 2024-09-13T02:52:42.309 INFO:tasks.workunit.client.1.smithi142.stdout:9/681: fdatasync dd/d17/d25/f6a 0 2024-09-13T02:52:42.312 INFO:tasks.workunit.client.1.smithi142.stdout:8/484: creat d0/d6/d83/f9b x:0 0 0 2024-09-13T02:52:42.312 INFO:tasks.workunit.client.1.smithi142.stdout:5/628: truncate d8/dc3/d26/d45/d81/d82/fa3 1637322 0 2024-09-13T02:52:42.315 INFO:tasks.workunit.client.1.smithi142.stdout:9/682: truncate dd/d17/d69/d84/fdd 498295 0 2024-09-13T02:52:42.317 INFO:tasks.workunit.client.1.smithi142.stdout:3/572: rename d12/d16/d25/d2e/d38/d5a/c7a to d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/cb1 0 2024-09-13T02:52:42.317 INFO:tasks.workunit.client.0.smithi098.stdout:7/324: sync 2024-09-13T02:52:42.320 INFO:tasks.workunit.client.0.smithi098.stdout:2/153: sync 2024-09-13T02:52:42.322 INFO:tasks.workunit.client.1.smithi142.stdout:4/553: chown d0/d2b/d2d/d31/d43/ca0 25224890 1 2024-09-13T02:52:42.322 INFO:tasks.workunit.client.1.smithi142.stdout:7/561: dwrite d10/fa4 [0,4194304] 0 2024-09-13T02:52:42.328 INFO:tasks.workunit.client.1.smithi142.stdout:3/573: rmdir d12/d16/d3c/d7d/d91 39 2024-09-13T02:52:42.328 INFO:tasks.workunit.client.0.smithi098.stdout:2/154: dwrite d1/d1a/d9/d15/f29 [4194304,4194304] 0 2024-09-13T02:52:42.331 INFO:tasks.workunit.client.1.smithi142.stdout:7/562: fsync d10/d31/f43 0 2024-09-13T02:52:42.331 INFO:tasks.workunit.client.1.smithi142.stdout:5/629: dwrite d8/dc3/d3f/d4a/f86 [4194304,4194304] 0 2024-09-13T02:52:42.333 INFO:tasks.workunit.client.0.smithi098.stdout:2/155: creat d1/d1a/d9/d1e/f2c x:0 0 0 2024-09-13T02:52:42.336 INFO:tasks.workunit.client.1.smithi142.stdout:7/563: write d10/d13/d1d/d2b/d56/d5f/d73/f91 [643491,98069] 0 2024-09-13T02:52:42.337 INFO:tasks.workunit.client.0.smithi098.stdout:2/156: write d1/d1a/dc/d23/f28 [1211990,63999] 0 2024-09-13T02:52:42.339 INFO:tasks.workunit.client.0.smithi098.stdout:2/157: write d1/d1a/d9/d1e/f2c [557113,49848] 0 2024-09-13T02:52:42.340 INFO:tasks.workunit.client.1.smithi142.stdout:4/554: dwrite d0/d2b/d2d/f9d [0,4194304] 0 2024-09-13T02:52:42.341 INFO:tasks.workunit.client.1.smithi142.stdout:2/465: sync 2024-09-13T02:52:42.342 INFO:tasks.workunit.client.0.smithi098.stdout:2/158: write d1/d1a/f12 [8631282,105630] 0 2024-09-13T02:52:42.343 INFO:tasks.workunit.client.1.smithi142.stdout:1/665: sync 2024-09-13T02:52:42.347 INFO:tasks.workunit.client.0.smithi098.stdout:2/159: truncate d1/f8 1772199 0 2024-09-13T02:52:42.348 INFO:tasks.workunit.client.1.smithi142.stdout:5/630: dwrite d8/dc3/d3f/d4a/f7a [0,4194304] 0 2024-09-13T02:52:42.349 INFO:tasks.workunit.client.1.smithi142.stdout:6/642: dread d1/dd/d16/f4c [0,4194304] 0 2024-09-13T02:52:42.355 INFO:tasks.workunit.client.1.smithi142.stdout:6/643: readlink d1/dd/d16/d4d/laa 0 2024-09-13T02:52:42.355 INFO:tasks.workunit.client.1.smithi142.stdout:2/466: dwrite d1/de/f22 [0,4194304] 0 2024-09-13T02:52:42.357 INFO:tasks.workunit.client.1.smithi142.stdout:1/666: mkdir d12/d13/dd3 0 2024-09-13T02:52:42.359 INFO:tasks.workunit.client.1.smithi142.stdout:2/467: fdatasync d1/f8c 0 2024-09-13T02:52:42.360 INFO:tasks.workunit.client.1.smithi142.stdout:9/683: truncate dd/d17/d44/d82/d99/daf/dc9/de9/fee 2090216 0 2024-09-13T02:52:42.360 INFO:tasks.workunit.client.1.smithi142.stdout:3/574: write d12/d16/f29 [3000517,55839] 0 2024-09-13T02:52:42.361 INFO:tasks.workunit.client.1.smithi142.stdout:6/644: fdatasync d1/dd/d16/f2c 0 2024-09-13T02:52:42.362 INFO:tasks.workunit.client.1.smithi142.stdout:8/485: dread d0/f5c [0,4194304] 0 2024-09-13T02:52:42.362 INFO:tasks.workunit.client.1.smithi142.stdout:7/564: truncate d10/d13/d1d/d2b/d56/f6a 1169658 0 2024-09-13T02:52:42.366 INFO:tasks.workunit.client.1.smithi142.stdout:1/667: write d12/d13/d1d/d26/f2b [5588833,71085] 0 2024-09-13T02:52:42.367 INFO:tasks.workunit.client.1.smithi142.stdout:4/555: dwrite d0/d2b/d2d/d65/f2e [0,4194304] 0 2024-09-13T02:52:42.368 INFO:tasks.workunit.client.1.smithi142.stdout:6/645: chown d1/dd/d53/d78/d8f 1 1 2024-09-13T02:52:42.368 INFO:tasks.workunit.client.0.smithi098.stdout:7/325: dread d6/d24/d2a/d5a/f34 [0,4194304] 0 2024-09-13T02:52:42.369 INFO:tasks.workunit.client.1.smithi142.stdout:1/668: fsync d12/d13/d20/d66/fbd 0 2024-09-13T02:52:42.369 INFO:tasks.workunit.client.1.smithi142.stdout:2/468: rmdir d1/d42 39 2024-09-13T02:52:42.370 INFO:tasks.workunit.client.0.smithi098.stdout:7/326: truncate d6/d24/d46/f5c 707449 0 2024-09-13T02:52:42.371 INFO:tasks.workunit.client.1.smithi142.stdout:6/646: write d1/d59/fa3 [2716754,80870] 0 2024-09-13T02:52:42.371 INFO:tasks.workunit.client.1.smithi142.stdout:3/575: write d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/f9c [883394,22646] 0 2024-09-13T02:52:42.372 INFO:tasks.workunit.client.1.smithi142.stdout:6/647: chown d1/d7 163191554 1 2024-09-13T02:52:42.373 INFO:tasks.workunit.client.1.smithi142.stdout:9/684: dwrite dd/d17/d5f/fba [0,4194304] 0 2024-09-13T02:52:42.376 INFO:tasks.workunit.client.0.smithi098.stdout:7/327: mknod d6/d49/c6c 0 2024-09-13T02:52:42.380 INFO:tasks.workunit.client.1.smithi142.stdout:4/556: chown d0/d2b/d21/d35/l6f 34371734 1 2024-09-13T02:52:42.380 INFO:tasks.workunit.client.0.smithi098.stdout:7/328: dread d6/d24/d2a/d48/f4e [0,4194304] 0 2024-09-13T02:52:42.381 INFO:tasks.workunit.client.1.smithi142.stdout:4/557: write d0/f9b [2282024,28488] 0 2024-09-13T02:52:42.382 INFO:tasks.workunit.client.1.smithi142.stdout:4/558: dread - d0/df/da5/fa6 zero size 2024-09-13T02:52:42.384 INFO:tasks.workunit.client.1.smithi142.stdout:6/648: mkdir d1/dd/dda 0 2024-09-13T02:52:42.385 INFO:tasks.workunit.client.0.smithi098.stdout:7/329: fsync d6/d1e/f23 0 2024-09-13T02:52:42.387 INFO:tasks.workunit.client.1.smithi142.stdout:9/685: creat dd/d87/d8e/da3/ffe x:0 0 0 2024-09-13T02:52:42.395 INFO:tasks.workunit.client.0.smithi098.stdout:2/160: dwrite d1/f8 [0,4194304] 0 2024-09-13T02:52:42.397 INFO:tasks.workunit.client.0.smithi098.stdout:7/330: symlink d6/l6d 0 2024-09-13T02:52:42.400 INFO:tasks.workunit.client.0.smithi098.stdout:9/166: sync 2024-09-13T02:52:42.401 INFO:tasks.workunit.client.0.smithi098.stdout:2/161: dread d1/d1a/d9/d15/f29 [0,4194304] 0 2024-09-13T02:52:42.403 INFO:tasks.workunit.client.0.smithi098.stdout:7/331: unlink d6/d49/c4b 0 2024-09-13T02:52:42.406 INFO:tasks.workunit.client.0.smithi098.stdout:9/167: mknod d2/dd/d39/c3f 0 2024-09-13T02:52:42.407 INFO:tasks.workunit.client.0.smithi098.stdout:9/168: chown d2/d6/f2f 18 1 2024-09-13T02:52:42.408 INFO:tasks.workunit.client.0.smithi098.stdout:2/162: mknod d1/d1a/d9/c2d 0 2024-09-13T02:52:42.408 INFO:tasks.workunit.client.0.smithi098.stdout:9/169: read - d2/f28 zero size 2024-09-13T02:52:42.410 INFO:tasks.workunit.client.0.smithi098.stdout:7/332: dwrite d6/fc [0,4194304] 0 2024-09-13T02:52:42.410 INFO:tasks.workunit.client.0.smithi098.stdout:2/163: dread - d1/d1a/d9/d15/f21 zero size 2024-09-13T02:52:42.413 INFO:tasks.workunit.client.0.smithi098.stdout:9/170: rename d2/d6/d2b/l3d to d2/d6/d2b/l40 0 2024-09-13T02:52:42.417 INFO:tasks.workunit.client.0.smithi098.stdout:9/171: symlink d2/dd/d39/l41 0 2024-09-13T02:52:42.420 INFO:tasks.workunit.client.0.smithi098.stdout:2/164: link d1/d1a/f12 d1/d1a/d9/d1e/f2e 0 2024-09-13T02:52:42.422 INFO:tasks.workunit.client.0.smithi098.stdout:6/156: sync 2024-09-13T02:52:42.422 INFO:tasks.workunit.client.0.smithi098.stdout:1/178: sync 2024-09-13T02:52:42.422 INFO:tasks.workunit.client.0.smithi098.stdout:0/158: sync 2024-09-13T02:52:42.422 INFO:tasks.workunit.client.0.smithi098.stdout:4/175: sync 2024-09-13T02:52:42.422 INFO:tasks.workunit.client.0.smithi098.stdout:3/159: sync 2024-09-13T02:52:42.422 INFO:tasks.workunit.client.0.smithi098.stdout:5/137: sync 2024-09-13T02:52:42.422 INFO:tasks.workunit.client.0.smithi098.stdout:8/190: sync 2024-09-13T02:52:42.423 INFO:tasks.workunit.client.0.smithi098.stdout:0/159: chown l9 91430 1 2024-09-13T02:52:42.426 INFO:tasks.workunit.client.0.smithi098.stdout:1/179: truncate d9/d33/f17 4747359 0 2024-09-13T02:52:42.426 INFO:tasks.workunit.client.0.smithi098.stdout:3/160: dread - d7/d9/d15/f23 zero size 2024-09-13T02:52:42.426 INFO:tasks.workunit.client.0.smithi098.stdout:0/160: read fc [2909388,64334] 0 2024-09-13T02:52:42.426 INFO:tasks.workunit.client.0.smithi098.stdout:9/172: dread d2/d6/f2a [0,4194304] 0 2024-09-13T02:52:42.427 INFO:tasks.workunit.client.1.smithi142.stdout:0/583: sync 2024-09-13T02:52:42.427 INFO:tasks.workunit.client.1.smithi142.stdout:4/559: mkdir d0/d2b/d2d/d31/d32/d82/db0 0 2024-09-13T02:52:42.428 INFO:tasks.workunit.client.0.smithi098.stdout:5/138: creat d0/d1/f36 x:0 0 0 2024-09-13T02:52:42.428 INFO:tasks.workunit.client.1.smithi142.stdout:7/565: write d10/d31/f43 [137393,35365] 0 2024-09-13T02:52:42.429 INFO:tasks.workunit.client.1.smithi142.stdout:6/649: rename d1/d59/fa3 to d1/d7/d5f/d60/d76/d7e/fdb 0 2024-09-13T02:52:42.429 INFO:tasks.workunit.client.0.smithi098.stdout:0/161: fsync dd/f2d 0 2024-09-13T02:52:42.430 INFO:tasks.workunit.client.1.smithi142.stdout:5/631: truncate d8/dc3/d26/d45/d81/d8c/fa6 1853527 0 2024-09-13T02:52:42.431 INFO:tasks.workunit.client.0.smithi098.stdout:9/173: readlink d2/d6/l26 0 2024-09-13T02:52:42.431 INFO:tasks.workunit.client.0.smithi098.stdout:8/191: truncate d2/dd/d11/f18 1356673 0 2024-09-13T02:52:42.431 INFO:tasks.workunit.client.0.smithi098.stdout:1/180: truncate d9/d12/f3f 975293 0 2024-09-13T02:52:42.431 INFO:tasks.workunit.client.0.smithi098.stdout:0/162: fsync dd/f2c 0 2024-09-13T02:52:42.432 INFO:tasks.workunit.client.0.smithi098.stdout:1/181: read d9/f1c [3106168,128946] 0 2024-09-13T02:52:42.434 INFO:tasks.workunit.client.1.smithi142.stdout:2/469: rmdir d1/de/d31/d6c 39 2024-09-13T02:52:42.434 INFO:tasks.workunit.client.0.smithi098.stdout:2/165: creat d1/d1c/f2f x:0 0 0 2024-09-13T02:52:42.435 INFO:tasks.workunit.client.0.smithi098.stdout:9/174: write d2/d6/f35 [365834,34221] 0 2024-09-13T02:52:42.437 INFO:tasks.workunit.client.1.smithi142.stdout:1/669: dread d12/d13/d20/f48 [0,4194304] 0 2024-09-13T02:52:42.438 INFO:tasks.workunit.client.1.smithi142.stdout:1/670: readlink d12/d13/d1d/l23 0 2024-09-13T02:52:42.438 INFO:tasks.workunit.client.0.smithi098.stdout:7/333: dread d6/d24/d2a/d5a/f22 [0,4194304] 0 2024-09-13T02:52:42.438 INFO:tasks.workunit.client.0.smithi098.stdout:8/192: truncate d2/d2f/f31 693370 0 2024-09-13T02:52:42.438 INFO:tasks.workunit.client.0.smithi098.stdout:8/193: dread - d2/dd/f35 zero size 2024-09-13T02:52:42.442 INFO:tasks.workunit.client.1.smithi142.stdout:9/686: truncate dd/d17/d69/d84/d41/f59 1621746 0 2024-09-13T02:52:42.444 INFO:tasks.workunit.client.0.smithi098.stdout:6/157: write d5/d13/f28 [212298,65033] 0 2024-09-13T02:52:42.446 INFO:tasks.workunit.client.0.smithi098.stdout:6/158: fsync d5/d18/f30 0 2024-09-13T02:52:42.447 INFO:tasks.workunit.client.1.smithi142.stdout:0/584: dread fd [0,4194304] 0 2024-09-13T02:52:42.447 INFO:tasks.workunit.client.0.smithi098.stdout:3/161: mkdir d7/d9/d15/d2d/d34 0 2024-09-13T02:52:42.447 INFO:tasks.workunit.client.0.smithi098.stdout:7/334: dwrite d6/d24/d46/f64 [0,4194304] 0 2024-09-13T02:52:42.448 INFO:tasks.workunit.client.1.smithi142.stdout:4/560: creat d0/d2b/d2d/d31/d32/fb1 x:0 0 0 2024-09-13T02:52:42.450 INFO:tasks.workunit.client.1.smithi142.stdout:0/585: dread d10/d6c/f9f [0,4194304] 0 2024-09-13T02:52:42.451 INFO:tasks.workunit.client.1.smithi142.stdout:7/566: mknod d10/d34/d65/cbc 0 2024-09-13T02:52:42.451 INFO:tasks.workunit.client.1.smithi142.stdout:0/586: chown d10/d6c/d88/d1a/d3a/f99 2166 1 2024-09-13T02:52:42.451 INFO:tasks.workunit.client.1.smithi142.stdout:7/567: dread - d10/d31/f63 zero size 2024-09-13T02:52:42.452 INFO:tasks.workunit.client.1.smithi142.stdout:0/587: chown d10/d6c/d88/d21/d51/d35/d9b 5 1 2024-09-13T02:52:42.455 INFO:tasks.workunit.client.0.smithi098.stdout:0/163: fsync dd/df/d1d/f1a 0 2024-09-13T02:52:42.456 INFO:tasks.workunit.client.0.smithi098.stdout:7/335: dread d6/d24/d2a/d5a/f34 [0,4194304] 0 2024-09-13T02:52:42.457 INFO:tasks.workunit.client.0.smithi098.stdout:1/182: creat d9/d33/d19/d35/f43 x:0 0 0 2024-09-13T02:52:42.459 INFO:tasks.workunit.client.0.smithi098.stdout:1/183: chown d9/d33/d19/f28 182 1 2024-09-13T02:52:42.460 INFO:tasks.workunit.client.1.smithi142.stdout:9/687: dread dd/d17/d5f/d7b/f7f [0,4194304] 0 2024-09-13T02:52:42.461 INFO:tasks.workunit.client.1.smithi142.stdout:6/650: unlink d1/d7/d19/d48/f96 0 2024-09-13T02:52:42.462 INFO:tasks.workunit.client.0.smithi098.stdout:4/176: mkdir d6/d37 0 2024-09-13T02:52:42.463 INFO:tasks.workunit.client.0.smithi098.stdout:4/177: dread - d6/d10/f1f zero size 2024-09-13T02:52:42.465 INFO:tasks.workunit.client.0.smithi098.stdout:2/166: dread d1/d1a/f7 [0,4194304] 0 2024-09-13T02:52:42.467 INFO:tasks.workunit.client.0.smithi098.stdout:8/194: rename d2/f15 to d2/dd/d11/d1d/f3a 0 2024-09-13T02:52:42.469 INFO:tasks.workunit.client.1.smithi142.stdout:1/671: dread d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/f80 [0,4194304] 0 2024-09-13T02:52:42.471 INFO:tasks.workunit.client.0.smithi098.stdout:3/162: unlink f6 0 2024-09-13T02:52:42.473 INFO:tasks.workunit.client.0.smithi098.stdout:8/195: dwrite d2/f1a [0,4194304] 0 2024-09-13T02:52:42.475 INFO:tasks.workunit.client.0.smithi098.stdout:8/196: fsync d2/f23 0 2024-09-13T02:52:42.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/486: sync 2024-09-13T02:52:42.476 INFO:tasks.workunit.client.0.smithi098.stdout:8/197: dread - d2/d28/f2a zero size 2024-09-13T02:52:42.481 INFO:tasks.workunit.client.1.smithi142.stdout:7/568: chown d10/c11 905889 1 2024-09-13T02:52:42.485 INFO:tasks.workunit.client.0.smithi098.stdout:7/336: rmdir d6/d24/d2a/d48 39 2024-09-13T02:52:42.487 INFO:tasks.workunit.client.0.smithi098.stdout:7/337: write d6/d24/d46/f64 [3182578,104747] 0 2024-09-13T02:52:42.488 INFO:tasks.workunit.client.0.smithi098.stdout:0/164: dwrite dd/df/d1d/f1a [0,4194304] 0 2024-09-13T02:52:42.489 INFO:tasks.workunit.client.1.smithi142.stdout:4/561: dwrite d0/d2b/d2d/d31/d32/d82/f8c [0,4194304] 0 2024-09-13T02:52:42.490 INFO:tasks.workunit.client.0.smithi098.stdout:7/338: chown d6/d47 0 1 2024-09-13T02:52:42.491 INFO:tasks.workunit.client.1.smithi142.stdout:4/562: write d0/df/f29 [2500251,6605] 0 2024-09-13T02:52:42.494 INFO:tasks.workunit.client.1.smithi142.stdout:5/632: creat d8/dc3/d26/d45/dc5/fcc x:0 0 0 2024-09-13T02:52:42.496 INFO:tasks.workunit.client.1.smithi142.stdout:2/470: mkdir d1/d42/d44/d99 0 2024-09-13T02:52:42.499 INFO:tasks.workunit.client.0.smithi098.stdout:3/163: read d7/d9/d15/d17/f28 [3833259,105209] 0 2024-09-13T02:52:42.500 INFO:tasks.workunit.client.0.smithi098.stdout:3/164: dread - d7/d9/f31 zero size 2024-09-13T02:52:42.503 INFO:tasks.workunit.client.1.smithi142.stdout:8/487: readlink d0/d6/dc/ld 0 2024-09-13T02:52:42.504 INFO:tasks.workunit.client.0.smithi098.stdout:9/175: rename d2/d6/f2f to d2/d6/f42 0 2024-09-13T02:52:42.507 INFO:tasks.workunit.client.1.smithi142.stdout:0/588: truncate d10/d6c/d88/d45/f57 484519 0 2024-09-13T02:52:42.509 INFO:tasks.workunit.client.0.smithi098.stdout:0/165: write dd/f24 [748555,61145] 0 2024-09-13T02:52:42.510 INFO:tasks.workunit.client.0.smithi098.stdout:7/339: stat d6/d24/d2a/d48/l5e 0 2024-09-13T02:52:42.512 INFO:tasks.workunit.client.0.smithi098.stdout:0/166: dread dd/df/f18 [0,4194304] 0 2024-09-13T02:52:42.513 INFO:tasks.workunit.client.1.smithi142.stdout:3/576: sync 2024-09-13T02:52:42.514 INFO:tasks.workunit.client.0.smithi098.stdout:1/184: rename d9/c16 to d9/d12/d2f/c44 0 2024-09-13T02:52:42.515 INFO:tasks.workunit.client.0.smithi098.stdout:1/185: write f1 [5681651,70486] 0 2024-09-13T02:52:42.515 INFO:tasks.workunit.client.0.smithi098.stdout:1/186: stat f1 0 2024-09-13T02:52:42.520 INFO:tasks.workunit.client.1.smithi142.stdout:7/569: dwrite d10/d13/d1d/d2b/dae/d9c/fbb [0,4194304] 0 2024-09-13T02:52:42.522 INFO:tasks.workunit.client.1.smithi142.stdout:4/563: creat d0/df/da5/dad/fb2 x:0 0 0 2024-09-13T02:52:42.523 INFO:tasks.workunit.client.0.smithi098.stdout:6/159: link d5/de/cf d5/d13/c38 0 2024-09-13T02:52:42.524 INFO:tasks.workunit.client.0.smithi098.stdout:2/167: truncate d1/d1a/d9/d15/f29 5098041 0 2024-09-13T02:52:42.525 INFO:tasks.workunit.client.0.smithi098.stdout:6/160: dread d5/de/f11 [0,4194304] 0 2024-09-13T02:52:42.526 INFO:tasks.workunit.client.1.smithi142.stdout:5/633: mkdir d8/dc3/d3f/d4a/d4b/dcd 0 2024-09-13T02:52:42.526 INFO:tasks.workunit.client.0.smithi098.stdout:6/161: dread - d5/de/d14/f35 zero size 2024-09-13T02:52:42.528 INFO:tasks.workunit.client.0.smithi098.stdout:3/165: mknod d7/d9/d15/d2d/c35 0 2024-09-13T02:52:42.529 INFO:tasks.workunit.client.0.smithi098.stdout:3/166: read d7/d9/d15/d17/f28 [472494,45862] 0 2024-09-13T02:52:42.530 INFO:tasks.workunit.client.0.smithi098.stdout:5/139: getdents d0/d1/d1a 0 2024-09-13T02:52:42.530 INFO:tasks.workunit.client.1.smithi142.stdout:3/577: dread d12/d16/f6f [0,4194304] 0 2024-09-13T02:52:42.532 INFO:tasks.workunit.client.1.smithi142.stdout:3/578: truncate d12/d16/d25/d2e/d38/d6b/f89 1492963 0 2024-09-13T02:52:42.533 INFO:tasks.workunit.client.1.smithi142.stdout:1/672: link d12/d13/d20/d27/d3c/d71/d96/fb5 d12/d13/d20/d66/d55/db4/fd4 0 2024-09-13T02:52:42.534 INFO:tasks.workunit.client.1.smithi142.stdout:8/488: fdatasync d0/d6/dc/f59 0 2024-09-13T02:52:42.535 INFO:tasks.workunit.client.0.smithi098.stdout:9/176: mkdir d2/dd/d39/d43 0 2024-09-13T02:52:42.537 INFO:tasks.workunit.client.1.smithi142.stdout:0/589: creat d10/d6c/d88/d21/d8f/fc5 x:0 0 0 2024-09-13T02:52:42.538 INFO:tasks.workunit.client.0.smithi098.stdout:7/340: creat d6/d24/d2a/d5a/d4c/f6e x:0 0 0 2024-09-13T02:52:42.539 INFO:tasks.workunit.client.1.smithi142.stdout:9/688: mknod dd/d98/dca/cff 0 2024-09-13T02:52:42.539 INFO:tasks.workunit.client.1.smithi142.stdout:0/590: stat d10/d6c/d88/d1a/d1e/d42/c78 0 2024-09-13T02:52:42.540 INFO:tasks.workunit.client.1.smithi142.stdout:8/489: dwrite d0/d6/d83/f9b [0,4194304] 0 2024-09-13T02:52:42.540 INFO:tasks.workunit.client.0.smithi098.stdout:9/177: write d2/dd/f3b [236422,14610] 0 2024-09-13T02:52:42.541 INFO:tasks.workunit.client.0.smithi098.stdout:5/140: dwrite d0/d15/d17/f26 [0,4194304] 0 2024-09-13T02:52:42.541 INFO:tasks.workunit.client.1.smithi142.stdout:8/490: chown d0/d6/dc/d45/l3a 2663054 1 2024-09-13T02:52:42.542 INFO:tasks.workunit.client.1.smithi142.stdout:0/591: fsync d10/d6c/d88/d1a/d1e/d42/f77 0 2024-09-13T02:52:42.543 INFO:tasks.workunit.client.0.smithi098.stdout:3/167: dwrite d7/d9/d25/d2b/f2c [0,4194304] 0 2024-09-13T02:52:42.543 INFO:tasks.workunit.client.0.smithi098.stdout:4/178: rename d6/d22/f2d to d6/d10/d20/f38 0 2024-09-13T02:52:42.545 INFO:tasks.workunit.client.1.smithi142.stdout:8/491: read d0/d6/dc/d45/f10 [4491468,530] 0 2024-09-13T02:52:42.548 INFO:tasks.workunit.client.0.smithi098.stdout:1/187: rmdir d9 39 2024-09-13T02:52:42.551 INFO:tasks.workunit.client.1.smithi142.stdout:7/570: mkdir d10/d13/d1d/d25/d5c/dbd 0 2024-09-13T02:52:42.551 INFO:tasks.workunit.client.1.smithi142.stdout:7/571: write fd [2084459,2314] 0 2024-09-13T02:52:42.555 INFO:tasks.workunit.client.0.smithi098.stdout:3/168: dread d7/d9/fa [4194304,4194304] 0 2024-09-13T02:52:42.556 INFO:tasks.workunit.client.0.smithi098.stdout:3/169: readlink d7/l8 0 2024-09-13T02:52:42.556 INFO:tasks.workunit.client.0.smithi098.stdout:5/141: dwrite d0/d1/f11 [0,4194304] 0 2024-09-13T02:52:42.559 INFO:tasks.workunit.client.0.smithi098.stdout:7/341: dwrite d6/d24/d2a/d5a/d4c/f6e [0,4194304] 0 2024-09-13T02:52:42.560 INFO:tasks.workunit.client.1.smithi142.stdout:5/634: symlink d8/dc3/d26/d45/d81/lce 0 2024-09-13T02:52:42.560 INFO:tasks.workunit.client.1.smithi142.stdout:5/635: chown d8 837 1 2024-09-13T02:52:42.561 INFO:tasks.workunit.client.0.smithi098.stdout:3/170: dread d7/f14 [0,4194304] 0 2024-09-13T02:52:42.561 INFO:tasks.workunit.client.1.smithi142.stdout:9/689: dread dd/d17/d44/f5c [0,4194304] 0 2024-09-13T02:52:42.567 INFO:tasks.workunit.client.1.smithi142.stdout:2/471: unlink d1/l71 0 2024-09-13T02:52:42.567 INFO:tasks.workunit.client.0.smithi098.stdout:6/162: creat d5/d13/f39 x:0 0 0 2024-09-13T02:52:42.578 INFO:tasks.workunit.client.0.smithi098.stdout:6/163: dwrite d5/de/d14/f29 [0,4194304] 0 2024-09-13T02:52:42.585 INFO:tasks.workunit.client.1.smithi142.stdout:6/651: getdents d1/dd/d16/d47/dad 0 2024-09-13T02:52:42.586 INFO:tasks.workunit.client.0.smithi098.stdout:6/164: dwrite d5/f33 [0,4194304] 0 2024-09-13T02:52:42.588 INFO:tasks.workunit.client.0.smithi098.stdout:6/165: fsync d5/f31 0 2024-09-13T02:52:42.591 INFO:tasks.workunit.client.0.smithi098.stdout:1/188: write d9/d33/f2b [421835,74795] 0 2024-09-13T02:52:42.593 INFO:tasks.workunit.client.1.smithi142.stdout:6/652: dwrite d1/dd/d53/d78/d8f/da8/fb4 [0,4194304] 0 2024-09-13T02:52:42.594 INFO:tasks.workunit.client.1.smithi142.stdout:0/592: mkdir d10/d6c/d88/d1a/d1e/dc6 0 2024-09-13T02:52:42.595 INFO:tasks.workunit.client.0.smithi098.stdout:5/142: creat d0/f37 x:0 0 0 2024-09-13T02:52:42.599 INFO:tasks.workunit.client.0.smithi098.stdout:3/171: unlink d7/c18 0 2024-09-13T02:52:42.600 INFO:tasks.workunit.client.0.smithi098.stdout:3/172: readlink d7/d9/d15/l1a 0 2024-09-13T02:52:42.602 INFO:tasks.workunit.client.1.smithi142.stdout:4/564: symlink d0/d2b/d2d/lb3 0 2024-09-13T02:52:42.606 INFO:tasks.workunit.client.1.smithi142.stdout:9/690: unlink dd/d17/d44/d95/cc2 0 2024-09-13T02:52:42.607 INFO:tasks.workunit.client.1.smithi142.stdout:9/691: chown dd/d17/d69/d84/d41/l72 123 1 2024-09-13T02:52:42.610 INFO:tasks.workunit.client.0.smithi098.stdout:0/167: rename dd/df/c2b to dd/df/d1d/d26/c31 0 2024-09-13T02:52:42.611 INFO:tasks.workunit.client.1.smithi142.stdout:3/579: symlink d12/d16/d25/d2e/d38/d4d/d53/da0/lb2 0 2024-09-13T02:52:42.612 INFO:tasks.workunit.client.0.smithi098.stdout:4/179: fdatasync d6/d10/d21/f25 0 2024-09-13T02:52:42.614 INFO:tasks.workunit.client.1.smithi142.stdout:1/673: unlink d12/d13/d20/d27/d3c/d71/d96/fb5 0 2024-09-13T02:52:42.614 INFO:tasks.workunit.client.1.smithi142.stdout:1/674: chown d12/d13/d20/d66/d55/da0/fcb 153 1 2024-09-13T02:52:42.615 INFO:tasks.workunit.client.1.smithi142.stdout:1/675: fdatasync d12/fa1 0 2024-09-13T02:52:42.615 INFO:tasks.workunit.client.0.smithi098.stdout:1/189: creat d9/d33/d29/f45 x:0 0 0 2024-09-13T02:52:42.617 INFO:tasks.workunit.client.1.smithi142.stdout:1/676: dread d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/f80 [0,4194304] 0 2024-09-13T02:52:42.617 INFO:tasks.workunit.client.0.smithi098.stdout:4/180: dread d6/f18 [0,4194304] 0 2024-09-13T02:52:42.617 INFO:tasks.workunit.client.0.smithi098.stdout:1/190: truncate d9/d12/d2f/f3e 271900 0 2024-09-13T02:52:42.618 INFO:tasks.workunit.client.0.smithi098.stdout:5/143: mkdir d0/d38 0 2024-09-13T02:52:42.619 INFO:tasks.workunit.client.0.smithi098.stdout:7/342: creat d6/d24/d2a/d48/d65/f6f x:0 0 0 2024-09-13T02:52:42.628 INFO:tasks.workunit.client.0.smithi098.stdout:6/166: rename d5/de to d5/d13/d2b/d3a 0 2024-09-13T02:52:42.629 INFO:tasks.workunit.client.0.smithi098.stdout:0/168: mkdir dd/df/d1d/d26/d28/d32 0 2024-09-13T02:52:42.630 INFO:tasks.workunit.client.1.smithi142.stdout:7/572: dread d10/d13/d1d/f2d [0,4194304] 0 2024-09-13T02:52:42.631 INFO:tasks.workunit.client.1.smithi142.stdout:7/573: write d10/d13/f3d [1998623,45629] 0 2024-09-13T02:52:42.633 INFO:tasks.workunit.client.1.smithi142.stdout:4/565: mkdir d0/d2b/d21/db4 0 2024-09-13T02:52:42.634 INFO:tasks.workunit.client.1.smithi142.stdout:4/566: stat d0/d2b/d21/d30/f7a 0 2024-09-13T02:52:42.634 INFO:tasks.workunit.client.1.smithi142.stdout:5/636: dread d8/dc3/d3f/f75 [0,4194304] 0 2024-09-13T02:52:42.636 INFO:tasks.workunit.client.0.smithi098.stdout:1/191: mkdir d9/d33/d19/d46 0 2024-09-13T02:52:42.636 INFO:tasks.workunit.client.1.smithi142.stdout:4/567: truncate d0/d2b/d2d/d31/d32/f50 883042 0 2024-09-13T02:52:42.637 INFO:tasks.workunit.client.0.smithi098.stdout:1/192: truncate d9/d33/d19/f28 260571 0 2024-09-13T02:52:42.637 INFO:tasks.workunit.client.1.smithi142.stdout:2/472: mknod d1/de/d31/d6c/c9a 0 2024-09-13T02:52:42.639 INFO:tasks.workunit.client.0.smithi098.stdout:5/144: creat d0/d29/f39 x:0 0 0 2024-09-13T02:52:42.640 INFO:tasks.workunit.client.0.smithi098.stdout:5/145: write d0/d1/f9 [6364071,76916] 0 2024-09-13T02:52:42.641 INFO:tasks.workunit.client.0.smithi098.stdout:7/343: write d6/d49/f4f [1723844,31173] 0 2024-09-13T02:52:42.645 INFO:tasks.workunit.client.1.smithi142.stdout:1/677: fsync d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/f5d 0 2024-09-13T02:52:42.648 INFO:tasks.workunit.client.0.smithi098.stdout:3/173: rename d7/d9/d15/f1c to d7/d9/d25/f36 0 2024-09-13T02:52:42.651 INFO:tasks.workunit.client.0.smithi098.stdout:7/344: dwrite d6/d24/d2a/d5a/d4c/f6a [0,4194304] 0 2024-09-13T02:52:42.652 INFO:tasks.workunit.client.1.smithi142.stdout:6/653: link d1/d7/d42/f8b d1/dd/d53/fdc 0 2024-09-13T02:52:42.655 INFO:tasks.workunit.client.0.smithi098.stdout:5/146: dread d0/d1/f9 [0,4194304] 0 2024-09-13T02:52:42.655 INFO:tasks.workunit.client.0.smithi098.stdout:6/167: dread d5/d18/f1f [0,4194304] 0 2024-09-13T02:52:42.656 INFO:tasks.workunit.client.1.smithi142.stdout:0/593: creat d10/d6c/d88/d45/db3/fc7 x:0 0 0 2024-09-13T02:52:42.656 INFO:tasks.workunit.client.1.smithi142.stdout:0/594: readlink d10/d6c/d88/l2c 0 2024-09-13T02:52:42.656 INFO:tasks.workunit.client.1.smithi142.stdout:0/595: fsync d10/d23/f2f 0 2024-09-13T02:52:42.657 INFO:tasks.workunit.client.0.smithi098.stdout:5/147: write d0/d1/f9 [5799418,57532] 0 2024-09-13T02:52:42.657 INFO:tasks.workunit.client.0.smithi098.stdout:3/174: dread d7/d9/d25/d2b/f2c [0,4194304] 0 2024-09-13T02:52:42.658 INFO:tasks.workunit.client.0.smithi098.stdout:5/148: dread - d0/d15/d17/f28 zero size 2024-09-13T02:52:42.659 INFO:tasks.workunit.client.0.smithi098.stdout:3/175: write d7/d9/d25/d2b/f33 [964106,46216] 0 2024-09-13T02:52:42.659 INFO:tasks.workunit.client.0.smithi098.stdout:1/193: mknod d9/d33/d19/d35/c47 0 2024-09-13T02:52:42.659 INFO:tasks.workunit.client.1.smithi142.stdout:2/473: dread d1/de/d1f/d13/f33 [0,4194304] 0 2024-09-13T02:52:42.660 INFO:tasks.workunit.client.0.smithi098.stdout:1/194: stat d9/cc 0 2024-09-13T02:52:42.663 INFO:tasks.workunit.client.1.smithi142.stdout:7/574: creat d10/d13/d1d/d2b/d56/d5f/d73/fbe x:0 0 0 2024-09-13T02:52:42.664 INFO:tasks.workunit.client.1.smithi142.stdout:7/575: truncate d10/d13/f1e 4842604 0 2024-09-13T02:52:42.670 INFO:tasks.workunit.client.0.smithi098.stdout:2/168: write d1/d1a/d9/d15/f29 [2962031,49711] 0 2024-09-13T02:52:42.675 INFO:tasks.workunit.client.1.smithi142.stdout:3/580: symlink d12/d16/d3c/d79/d9e/lb3 0 2024-09-13T02:52:42.676 INFO:tasks.workunit.client.0.smithi098.stdout:4/181: rename d6/f18 to d6/d37/f39 0 2024-09-13T02:52:42.683 INFO:tasks.workunit.client.1.smithi142.stdout:9/692: write dd/d17/d69/d84/d41/f59 [1938293,100254] 0 2024-09-13T02:52:42.683 INFO:tasks.workunit.client.0.smithi098.stdout:6/168: rename d5/d13/d2b/d3a/d14/f35 to d5/d13/d2b/d3a/d14/f3b 0 2024-09-13T02:52:42.684 INFO:tasks.workunit.client.0.smithi098.stdout:4/182: dwrite d6/db/f2f [0,4194304] 0 2024-09-13T02:52:42.685 INFO:tasks.workunit.client.0.smithi098.stdout:1/195: creat d9/d12/d2f/f48 x:0 0 0 2024-09-13T02:52:42.686 INFO:tasks.workunit.client.0.smithi098.stdout:1/196: read - d9/d33/d1f/d23/f24 zero size 2024-09-13T02:52:42.686 INFO:tasks.workunit.client.1.smithi142.stdout:6/654: creat d1/d7/d5f/d60/fdd x:0 0 0 2024-09-13T02:52:42.688 INFO:tasks.workunit.client.1.smithi142.stdout:6/655: read d1/d7/d5f/d6a/f99 [218958,5558] 0 2024-09-13T02:52:42.696 INFO:tasks.workunit.client.1.smithi142.stdout:8/492: getdents d0/d80/d8c 0 2024-09-13T02:52:42.698 INFO:tasks.workunit.client.1.smithi142.stdout:0/596: write d10/d6c/f71 [592093,80320] 0 2024-09-13T02:52:42.698 INFO:tasks.workunit.client.1.smithi142.stdout:2/474: truncate d1/d2c/d6f/f7a 44701 0 2024-09-13T02:52:42.700 INFO:tasks.workunit.client.0.smithi098.stdout:0/169: rename dd/f20 to dd/df/d1d/f33 0 2024-09-13T02:52:42.701 INFO:tasks.workunit.client.0.smithi098.stdout:0/170: read fa [2235489,76710] 0 2024-09-13T02:52:42.702 INFO:tasks.workunit.client.1.smithi142.stdout:7/576: readlink d10/d13/d1d/d2b/d40/lac 0 2024-09-13T02:52:42.702 INFO:tasks.workunit.client.1.smithi142.stdout:7/577: chown d10/d13/d1d/d25/d5c/dbd 1057670 1 2024-09-13T02:52:42.703 INFO:tasks.workunit.client.0.smithi098.stdout:2/169: dwrite d1/d1a/d9/d1e/f2e [0,4194304] 0 2024-09-13T02:52:42.704 INFO:tasks.workunit.client.0.smithi098.stdout:2/170: dread - d1/d1c/f2f zero size 2024-09-13T02:52:42.706 INFO:tasks.workunit.client.1.smithi142.stdout:3/581: readlink d12/d16/d3c/d79/d9e/la1 0 2024-09-13T02:52:42.708 INFO:tasks.workunit.client.1.smithi142.stdout:0/597: dread d10/d6c/d88/d1a/f6b [0,4194304] 0 2024-09-13T02:52:42.712 INFO:tasks.workunit.client.1.smithi142.stdout:5/637: truncate d8/dc3/d3f/d4a/f86 4717881 0 2024-09-13T02:52:42.714 INFO:tasks.workunit.client.0.smithi098.stdout:5/149: rename d0/d15/d17/d1c/f1d to d0/d15/f3a 0 2024-09-13T02:52:42.715 INFO:tasks.workunit.client.1.smithi142.stdout:4/568: truncate d0/df/f29 867155 0 2024-09-13T02:52:42.716 INFO:tasks.workunit.client.1.smithi142.stdout:1/678: truncate d12/d13/d1d/d26/f2b 5520354 0 2024-09-13T02:52:42.717 INFO:tasks.workunit.client.1.smithi142.stdout:6/656: fsync d1/d7/d19/d30/f67 0 2024-09-13T02:52:42.718 INFO:tasks.workunit.client.1.smithi142.stdout:6/657: readlink d1/dd/l69 0 2024-09-13T02:52:42.719 INFO:tasks.workunit.client.0.smithi098.stdout:7/345: rmdir d6/d24/d2a/d57/d69 0 2024-09-13T02:52:42.720 INFO:tasks.workunit.client.0.smithi098.stdout:2/171: mkdir d1/d1f/d30 0 2024-09-13T02:52:42.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:42 smithi098 ceph-mon[27886]: pgmap v20: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 36 MiB/s rd, 179 MiB/s wr, 286 op/s 2024-09-13T02:52:42.737 INFO:tasks.workunit.client.0.smithi098.stdout:0/171: dread fc [0,4194304] 0 2024-09-13T02:52:42.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:42 smithi142 ceph-mon[33443]: pgmap v20: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 36 MiB/s rd, 179 MiB/s wr, 286 op/s 2024-09-13T02:52:42.796 INFO:tasks.workunit.client.1.smithi142.stdout:7/578: creat d10/d13/d1d/d2b/d56/d39/fbf x:0 0 0 2024-09-13T02:52:42.798 INFO:tasks.workunit.client.0.smithi098.stdout:5/150: stat d0/d15/d17/l31 0 2024-09-13T02:52:42.799 INFO:tasks.workunit.client.1.smithi142.stdout:9/693: mkdir dd/d17/d68/ded/d100 0 2024-09-13T02:52:42.801 INFO:tasks.workunit.client.0.smithi098.stdout:7/346: rmdir d6/d24/d2a/d48/d65 39 2024-09-13T02:52:42.801 INFO:tasks.workunit.client.1.smithi142.stdout:3/582: dwrite d12/d16/d25/d2e/d48/f52 [0,4194304] 0 2024-09-13T02:52:42.802 INFO:tasks.workunit.client.0.smithi098.stdout:7/347: write d6/fc [1583965,75587] 0 2024-09-13T02:52:42.803 INFO:tasks.workunit.client.0.smithi098.stdout:7/348: chown d6/d24/d2a/d57/l68 8 1 2024-09-13T02:52:42.806 INFO:tasks.workunit.client.0.smithi098.stdout:1/197: truncate d9/d33/f22 1761471 0 2024-09-13T02:52:42.809 INFO:tasks.workunit.client.1.smithi142.stdout:2/475: write d1/de/f61 [515920,42779] 0 2024-09-13T02:52:42.812 INFO:tasks.workunit.client.0.smithi098.stdout:0/172: unlink dd/df/c15 0 2024-09-13T02:52:42.815 INFO:tasks.workunit.client.0.smithi098.stdout:5/151: mknod d0/d1/d1a/c3b 0 2024-09-13T02:52:42.816 INFO:tasks.workunit.client.1.smithi142.stdout:2/476: dwrite d1/de/d1f/d13/f5e [0,4194304] 0 2024-09-13T02:52:42.818 INFO:tasks.workunit.client.1.smithi142.stdout:6/658: creat d1/d7/d19/d52/fde x:0 0 0 2024-09-13T02:52:42.820 INFO:tasks.workunit.client.0.smithi098.stdout:1/198: creat d9/d12/d2f/f49 x:0 0 0 2024-09-13T02:52:42.820 INFO:tasks.workunit.client.1.smithi142.stdout:6/659: chown d1/dd/d53/d78/db8/fc2 85905401 1 2024-09-13T02:52:42.822 INFO:tasks.workunit.client.0.smithi098.stdout:0/173: creat dd/df/d1d/f34 x:0 0 0 2024-09-13T02:52:42.822 INFO:tasks.workunit.client.0.smithi098.stdout:0/174: stat dd/df/c2a 0 2024-09-13T02:52:42.823 INFO:tasks.workunit.client.1.smithi142.stdout:5/638: dwrite d8/f1f [4194304,4194304] 0 2024-09-13T02:52:42.823 INFO:tasks.workunit.client.0.smithi098.stdout:0/175: readlink dd/df/l21 0 2024-09-13T02:52:42.824 INFO:tasks.workunit.client.1.smithi142.stdout:5/639: chown d8/dc3/d26/d2d/d90/f6f 908089 1 2024-09-13T02:52:42.826 INFO:tasks.workunit.client.0.smithi098.stdout:3/176: rename d7/d9/d15/d17/l24 to d7/d9/d15/l37 0 2024-09-13T02:52:42.826 INFO:tasks.workunit.client.1.smithi142.stdout:7/579: symlink d10/d64/lc0 0 2024-09-13T02:52:42.830 INFO:tasks.workunit.client.1.smithi142.stdout:9/694: creat dd/d17/d44/dfa/f101 x:0 0 0 2024-09-13T02:52:42.834 INFO:tasks.workunit.client.0.smithi098.stdout:6/169: rename d5/d13/f39 to d5/d18/f3c 0 2024-09-13T02:52:42.835 INFO:tasks.workunit.client.0.smithi098.stdout:6/170: chown d5/fb 9 1 2024-09-13T02:52:42.835 INFO:tasks.workunit.client.0.smithi098.stdout:6/171: read - d5/f31 zero size 2024-09-13T02:52:42.836 INFO:tasks.workunit.client.0.smithi098.stdout:3/177: creat d7/d9/d25/f38 x:0 0 0 2024-09-13T02:52:42.837 INFO:tasks.workunit.client.0.smithi098.stdout:5/152: link d0/d1/d1a/d32/f33 d0/d15/f3c 0 2024-09-13T02:52:42.839 INFO:tasks.workunit.client.0.smithi098.stdout:5/153: write d0/d15/d17/d1c/f2d [126295,74449] 0 2024-09-13T02:52:42.839 INFO:tasks.workunit.client.0.smithi098.stdout:2/172: getdents d1/d1a/dc 0 2024-09-13T02:52:42.840 INFO:tasks.workunit.client.0.smithi098.stdout:0/176: symlink dd/l35 0 2024-09-13T02:52:42.841 INFO:tasks.workunit.client.1.smithi142.stdout:0/598: sync 2024-09-13T02:52:42.845 INFO:tasks.workunit.client.0.smithi098.stdout:1/199: rename d9/d33/d1f/d23/f24 to d9/d33/d19/d46/f4a 0 2024-09-13T02:52:42.845 INFO:tasks.workunit.client.0.smithi098.stdout:1/200: write f1 [1695190,21849] 0 2024-09-13T02:52:42.849 INFO:tasks.workunit.client.1.smithi142.stdout:6/660: symlink d1/d7/d5f/ldf 0 2024-09-13T02:52:42.854 INFO:tasks.workunit.client.1.smithi142.stdout:7/580: unlink d10/d13/d1d/d2b/d56/l7f 0 2024-09-13T02:52:42.854 INFO:tasks.workunit.client.1.smithi142.stdout:2/477: dread d1/de/d1f/f8d [0,4194304] 0 2024-09-13T02:52:42.855 INFO:tasks.workunit.client.0.smithi098.stdout:5/154: mkdir d0/d15/d17/d1c/d3d 0 2024-09-13T02:52:42.855 INFO:tasks.workunit.client.1.smithi142.stdout:2/478: write d1/de/f7e [4745895,84857] 0 2024-09-13T02:52:42.856 INFO:tasks.workunit.client.0.smithi098.stdout:3/178: dwrite d7/d9/d25/d2b/f2c [0,4194304] 0 2024-09-13T02:52:42.856 INFO:tasks.workunit.client.1.smithi142.stdout:5/640: dread d8/dc3/d26/f31 [0,4194304] 0 2024-09-13T02:52:42.857 INFO:tasks.workunit.client.1.smithi142.stdout:5/641: dread - d8/dc3/d26/d45/d62/f6c zero size 2024-09-13T02:52:42.858 INFO:tasks.workunit.client.1.smithi142.stdout:5/642: dread - d8/dc3/d26/d61/f9f zero size 2024-09-13T02:52:42.859 INFO:tasks.workunit.client.0.smithi098.stdout:0/177: creat dd/df/d1d/d26/f36 x:0 0 0 2024-09-13T02:52:42.859 INFO:tasks.workunit.client.1.smithi142.stdout:3/583: getdents d12/d16/d25/d2e/d48/d5c/d73/d8f 0 2024-09-13T02:52:42.861 INFO:tasks.workunit.client.1.smithi142.stdout:4/569: creat d0/fb5 x:0 0 0 2024-09-13T02:52:42.866 INFO:tasks.workunit.client.0.smithi098.stdout:5/155: dwrite d0/f37 [0,4194304] 0 2024-09-13T02:52:42.866 INFO:tasks.workunit.client.0.smithi098.stdout:3/179: dwrite d7/fc [0,4194304] 0 2024-09-13T02:52:42.867 INFO:tasks.workunit.client.1.smithi142.stdout:0/599: creat d10/d6c/d88/d45/fc8 x:0 0 0 2024-09-13T02:52:42.868 INFO:tasks.workunit.client.1.smithi142.stdout:0/600: stat d10/d23/l6f 0 2024-09-13T02:52:42.868 INFO:tasks.workunit.client.1.smithi142.stdout:0/601: truncate d10/d6c/d88/d21/d8f/fa9 5028862 0 2024-09-13T02:52:42.869 INFO:tasks.workunit.client.0.smithi098.stdout:2/173: rename d1/d1a/d9/d15 to d1/d1a/d9/d1e/d31 0 2024-09-13T02:52:42.871 INFO:tasks.workunit.client.0.smithi098.stdout:6/172: rmdir d5/d13 39 2024-09-13T02:52:42.872 INFO:tasks.workunit.client.0.smithi098.stdout:6/173: read - d5/f15 zero size 2024-09-13T02:52:42.873 INFO:tasks.workunit.client.1.smithi142.stdout:8/493: getdents d0/d6/d23/d2b 0 2024-09-13T02:52:42.874 INFO:tasks.workunit.client.0.smithi098.stdout:1/201: mknod d9/c4b 0 2024-09-13T02:52:42.875 INFO:tasks.workunit.client.1.smithi142.stdout:8/494: write d0/d6/dc/d40/d46/f5a [398786,58670] 0 2024-09-13T02:52:42.876 INFO:tasks.workunit.client.0.smithi098.stdout:1/202: dread - d9/d33/d1f/d23/f34 zero size 2024-09-13T02:52:42.877 INFO:tasks.workunit.client.1.smithi142.stdout:6/661: mknod d1/d7/d5f/d6a/ce0 0 2024-09-13T02:52:42.877 INFO:tasks.workunit.client.1.smithi142.stdout:8/495: chown d0/d6/dc/d45/fa 224 1 2024-09-13T02:52:42.878 INFO:tasks.workunit.client.0.smithi098.stdout:2/174: dwrite d1/d1a/d9/d1e/f2c [0,4194304] 0 2024-09-13T02:52:42.881 INFO:tasks.workunit.client.0.smithi098.stdout:2/175: truncate d1/d1a/d9/d1e/d31/f21 712167 0 2024-09-13T02:52:42.885 INFO:tasks.workunit.client.0.smithi098.stdout:8/198: sync 2024-09-13T02:52:42.890 INFO:tasks.workunit.client.1.smithi142.stdout:9/695: symlink dd/d17/d44/d82/d99/da8/db7/l102 0 2024-09-13T02:52:43.002 INFO:tasks.workunit.client.0.smithi098.stdout:5/156: creat d0/d29/f3e x:0 0 0 2024-09-13T02:52:43.003 INFO:tasks.workunit.client.1.smithi142.stdout:5/643: fsync d8/dc3/d64/d68/f77 0 2024-09-13T02:52:43.005 INFO:tasks.workunit.client.0.smithi098.stdout:3/180: creat d7/d9/d25/f39 x:0 0 0 2024-09-13T02:52:43.006 INFO:tasks.workunit.client.0.smithi098.stdout:3/181: chown d7/d9/d15/d26 163 1 2024-09-13T02:52:43.007 INFO:tasks.workunit.client.1.smithi142.stdout:3/584: unlink d12/d16/d25/l27 0 2024-09-13T02:52:43.008 INFO:tasks.workunit.client.1.smithi142.stdout:0/602: fsync d10/d6c/d88/d45/fc8 0 2024-09-13T02:52:43.009 INFO:tasks.workunit.client.1.smithi142.stdout:0/603: chown d10/d6c/d88/d45/fc8 23184792 1 2024-09-13T02:52:43.011 INFO:tasks.workunit.client.1.smithi142.stdout:1/679: creat d12/d13/d20/d66/d55/db4/fd5 x:0 0 0 2024-09-13T02:52:43.015 INFO:tasks.workunit.client.1.smithi142.stdout:8/496: fsync d0/d6/dc/d2e/f57 0 2024-09-13T02:52:43.018 INFO:tasks.workunit.client.1.smithi142.stdout:2/479: write d1/de/d1f/f37 [969309,2134] 0 2024-09-13T02:52:43.019 INFO:tasks.workunit.client.0.smithi098.stdout:0/178: dwrite fc [4194304,4194304] 0 2024-09-13T02:52:43.020 INFO:tasks.workunit.client.1.smithi142.stdout:2/480: write d1/de/d1f/f63 [250652,129387] 0 2024-09-13T02:52:43.023 INFO:tasks.workunit.client.1.smithi142.stdout:9/696: mkdir dd/d17/d44/d82/d99/daf/dc9/d103 0 2024-09-13T02:52:43.027 INFO:tasks.workunit.client.0.smithi098.stdout:5/157: rename d0/d1 to d0/d38/d3f 0 2024-09-13T02:52:43.029 INFO:tasks.workunit.client.0.smithi098.stdout:3/182: write d7/d9/f32 [721728,52431] 0 2024-09-13T02:52:43.030 INFO:tasks.workunit.client.0.smithi098.stdout:2/176: write d1/d1a/d9/d1e/f2c [4959438,103298] 0 2024-09-13T02:52:43.031 INFO:tasks.workunit.client.1.smithi142.stdout:7/581: truncate d10/d13/d1d/d25/d45/d6d/fa9 2623345 0 2024-09-13T02:52:43.033 INFO:tasks.workunit.client.1.smithi142.stdout:5/644: mknod d8/dc3/d26/d45/ccf 0 2024-09-13T02:52:43.037 INFO:tasks.workunit.client.0.smithi098.stdout:8/199: mkdir d2/dd/d11/d3b 0 2024-09-13T02:52:43.038 INFO:tasks.workunit.client.1.smithi142.stdout:0/604: creat d10/d6c/d88/d1a/d3a/fc9 x:0 0 0 2024-09-13T02:52:43.042 INFO:tasks.workunit.client.0.smithi098.stdout:3/183: unlink d7/l8 0 2024-09-13T02:52:43.044 INFO:tasks.workunit.client.0.smithi098.stdout:0/179: dwrite dd/d1f/f25 [0,4194304] 0 2024-09-13T02:52:43.045 INFO:tasks.workunit.client.1.smithi142.stdout:9/697: dread dd/f1f [0,4194304] 0 2024-09-13T02:52:43.045 INFO:tasks.workunit.client.0.smithi098.stdout:3/184: readlink d7/d9/d15/l1a 0 2024-09-13T02:52:43.045 INFO:tasks.workunit.client.0.smithi098.stdout:6/174: symlink d5/d13/d2b/d3a/l3d 0 2024-09-13T02:52:43.046 INFO:tasks.workunit.client.0.smithi098.stdout:0/180: write fc [6246849,80631] 0 2024-09-13T02:52:43.048 INFO:tasks.workunit.client.0.smithi098.stdout:2/177: rename d1/d1a/d9/d2b to d1/d1f/d32 0 2024-09-13T02:52:43.050 INFO:tasks.workunit.client.0.smithi098.stdout:0/181: write dd/f2c [642852,130677] 0 2024-09-13T02:52:43.050 INFO:tasks.workunit.client.0.smithi098.stdout:2/178: chown d1/d1a/d9/l22 2130198936 1 2024-09-13T02:52:43.050 INFO:tasks.workunit.client.1.smithi142.stdout:2/481: unlink d1/d42/d44/f97 0 2024-09-13T02:52:43.052 INFO:tasks.workunit.client.0.smithi098.stdout:2/179: write d1/d1c/f2f [347348,7037] 0 2024-09-13T02:52:43.052 INFO:tasks.workunit.client.0.smithi098.stdout:1/203: link d9/d33/d29/c31 d9/d33/d19/d46/c4c 0 2024-09-13T02:52:43.053 INFO:tasks.workunit.client.0.smithi098.stdout:1/204: readlink d9/lb 0 2024-09-13T02:52:43.054 INFO:tasks.workunit.client.1.smithi142.stdout:9/698: dread dd/d17/d69/d84/d41/f59 [0,4194304] 0 2024-09-13T02:52:43.055 INFO:tasks.workunit.client.1.smithi142.stdout:9/699: write dd/f7e [853944,56357] 0 2024-09-13T02:52:43.056 INFO:tasks.workunit.client.1.smithi142.stdout:9/700: write dd/d17/d5f/d7b/db8/dc0/fce [980276,32329] 0 2024-09-13T02:52:43.058 INFO:tasks.workunit.client.1.smithi142.stdout:9/701: write dd/d17/d5f/d7b/db8/dc0/fce [275513,22581] 0 2024-09-13T02:52:43.058 INFO:tasks.workunit.client.1.smithi142.stdout:9/702: stat dd/d17/d44/d82/d99/daf/fb6 0 2024-09-13T02:52:43.059 INFO:tasks.workunit.client.1.smithi142.stdout:9/703: write dd/d17/d44/d95/fd3 [1421343,115336] 0 2024-09-13T02:52:43.067 INFO:tasks.workunit.client.1.smithi142.stdout:3/585: creat d12/d16/d3c/d7d/d91/fb4 x:0 0 0 2024-09-13T02:52:43.068 INFO:tasks.workunit.client.1.smithi142.stdout:8/497: dwrite d0/f69 [0,4194304] 0 2024-09-13T02:52:43.068 INFO:tasks.workunit.client.0.smithi098.stdout:3/185: mkdir d7/d9/d25/d3a 0 2024-09-13T02:52:43.070 INFO:tasks.workunit.client.0.smithi098.stdout:3/186: write d7/d9/f31 [295819,90555] 0 2024-09-13T02:52:43.070 INFO:tasks.workunit.client.1.smithi142.stdout:8/498: truncate d0/f8f 222925 0 2024-09-13T02:52:43.070 INFO:tasks.workunit.client.1.smithi142.stdout:4/570: creat d0/fb6 x:0 0 0 2024-09-13T02:52:43.072 INFO:tasks.workunit.client.0.smithi098.stdout:3/187: write d7/d9/d15/f23 [26442,24112] 0 2024-09-13T02:52:43.072 INFO:tasks.workunit.client.0.smithi098.stdout:6/175: unlink d5/d13/c23 0 2024-09-13T02:52:43.073 INFO:tasks.workunit.client.0.smithi098.stdout:3/188: readlink d7/d9/l1e 0 2024-09-13T02:52:43.074 INFO:tasks.workunit.client.1.smithi142.stdout:6/662: dwrite d1/dd/d53/d78/db8/fb9 [0,4194304] 0 2024-09-13T02:52:43.074 INFO:tasks.workunit.client.0.smithi098.stdout:6/176: chown d5/d13/d2b/d3a/d14/f34 71 1 2024-09-13T02:52:43.078 INFO:tasks.workunit.client.0.smithi098.stdout:0/182: fsync dd/f10 0 2024-09-13T02:52:43.078 INFO:tasks.workunit.client.0.smithi098.stdout:0/183: readlink dd/df/l21 0 2024-09-13T02:52:43.081 INFO:tasks.workunit.client.0.smithi098.stdout:9/178: sync 2024-09-13T02:52:43.082 INFO:tasks.workunit.client.0.smithi098.stdout:2/180: creat d1/d1a/dc/f33 x:0 0 0 2024-09-13T02:52:43.082 INFO:tasks.workunit.client.0.smithi098.stdout:9/179: chown d2/d6/d36/c3a 235268070 1 2024-09-13T02:52:43.084 INFO:tasks.workunit.client.0.smithi098.stdout:1/205: mkdir d9/d12/d4d 0 2024-09-13T02:52:43.086 INFO:tasks.workunit.client.1.smithi142.stdout:7/582: dwrite d10/d13/d1d/d44/f9a [0,4194304] 0 2024-09-13T02:52:43.089 INFO:tasks.workunit.client.0.smithi098.stdout:5/158: link d0/d38/d3f/c25 d0/c40 0 2024-09-13T02:52:43.092 INFO:tasks.workunit.client.0.smithi098.stdout:3/189: creat d7/d9/d15/d17/f3b x:0 0 0 2024-09-13T02:52:43.094 INFO:tasks.workunit.client.1.smithi142.stdout:2/482: creat d1/de/d1f/d13/f9b x:0 0 0 2024-09-13T02:52:43.095 INFO:tasks.workunit.client.0.smithi098.stdout:6/177: rename d5/c6 to d5/d13/d2b/d3a/d14/c3e 0 2024-09-13T02:52:43.096 INFO:tasks.workunit.client.1.smithi142.stdout:2/483: chown d1/de/d1f/d13/f33 21899 1 2024-09-13T02:52:43.097 INFO:tasks.workunit.client.1.smithi142.stdout:1/680: dwrite fd [0,4194304] 0 2024-09-13T02:52:43.098 INFO:tasks.workunit.client.0.smithi098.stdout:8/200: truncate d2/f6 2495941 0 2024-09-13T02:52:43.102 INFO:tasks.workunit.client.0.smithi098.stdout:2/181: rmdir d1/d1a 39 2024-09-13T02:52:43.107 INFO:tasks.workunit.client.0.smithi098.stdout:1/206: mknod d9/c4e 0 2024-09-13T02:52:43.108 INFO:tasks.workunit.client.0.smithi098.stdout:1/207: rename d9/d33/d19 to d9/d33/d19/d35/d4f 22 2024-09-13T02:52:43.108 INFO:tasks.workunit.client.0.smithi098.stdout:5/159: rmdir d0/d38/d3f/d1a/d27 39 2024-09-13T02:52:43.110 INFO:tasks.workunit.client.1.smithi142.stdout:9/704: creat dd/d17/d44/d82/d99/daf/dc9/f104 x:0 0 0 2024-09-13T02:52:43.111 INFO:tasks.workunit.client.1.smithi142.stdout:9/705: write dd/f18 [2928833,107754] 0 2024-09-13T02:52:43.112 INFO:tasks.workunit.client.1.smithi142.stdout:9/706: chown dd/d17/d25/deb 109012338 1 2024-09-13T02:52:43.112 INFO:tasks.workunit.client.1.smithi142.stdout:9/707: chown dd/d17/d44/dfa/fb5 23222241 1 2024-09-13T02:52:43.112 INFO:tasks.workunit.client.1.smithi142.stdout:9/708: chown f8 23182 1 2024-09-13T02:52:43.113 INFO:tasks.workunit.client.0.smithi098.stdout:3/190: unlink d7/f14 0 2024-09-13T02:52:43.114 INFO:tasks.workunit.client.0.smithi098.stdout:1/208: dread d9/d33/d19/f21 [0,4194304] 0 2024-09-13T02:52:43.115 INFO:tasks.workunit.client.0.smithi098.stdout:6/178: creat d5/d13/f3f x:0 0 0 2024-09-13T02:52:43.116 INFO:tasks.workunit.client.0.smithi098.stdout:3/191: write d7/d9/d25/d2b/f33 [1797244,40947] 0 2024-09-13T02:52:43.116 INFO:tasks.workunit.client.1.smithi142.stdout:5/645: symlink d8/dc3/d64/d68/db5/ld0 0 2024-09-13T02:52:43.117 INFO:tasks.workunit.client.1.smithi142.stdout:5/646: dread - d8/dc3/d26/d63/fc9 zero size 2024-09-13T02:52:43.118 INFO:tasks.workunit.client.0.smithi098.stdout:8/201: symlink d2/dd/l3c 0 2024-09-13T02:52:43.118 INFO:tasks.workunit.client.0.smithi098.stdout:0/184: write f8 [603180,88980] 0 2024-09-13T02:52:43.118 INFO:tasks.workunit.client.0.smithi098.stdout:1/209: readlink d9/d33/d1f/l2d 0 2024-09-13T02:52:43.119 INFO:tasks.workunit.client.0.smithi098.stdout:5/160: dwrite d0/d15/d17/d1c/f2d [0,4194304] 0 2024-09-13T02:52:43.121 INFO:tasks.workunit.client.0.smithi098.stdout:1/210: dread - d9/d12/d2f/f49 zero size 2024-09-13T02:52:43.123 INFO:tasks.workunit.client.0.smithi098.stdout:2/182: read d1/d1a/d9/d1e/d31/f21 [53809,118257] 0 2024-09-13T02:52:43.126 INFO:tasks.workunit.client.0.smithi098.stdout:2/183: fsync d1/d1a/d9/d1e/d31/f29 0 2024-09-13T02:52:43.128 INFO:tasks.workunit.client.0.smithi098.stdout:5/161: dread d0/d15/d17/d1c/f2d [0,4194304] 0 2024-09-13T02:52:43.128 INFO:tasks.workunit.client.0.smithi098.stdout:5/162: read - d0/d29/f3e zero size 2024-09-13T02:52:43.130 INFO:tasks.workunit.client.1.smithi142.stdout:4/571: creat d0/d2b/d2d/d31/fb7 x:0 0 0 2024-09-13T02:52:43.133 INFO:tasks.workunit.client.1.smithi142.stdout:6/663: unlink d1/d7/d19/d48/c7f 0 2024-09-13T02:52:43.133 INFO:tasks.workunit.client.1.smithi142.stdout:6/664: write d1/fd7 [837394,5326] 0 2024-09-13T02:52:43.135 INFO:tasks.workunit.client.0.smithi098.stdout:6/179: creat d5/d18/f40 x:0 0 0 2024-09-13T02:52:43.136 INFO:tasks.workunit.client.0.smithi098.stdout:9/180: write d2/f10 [1045606,45179] 0 2024-09-13T02:52:43.137 INFO:tasks.workunit.client.0.smithi098.stdout:3/192: readlink d7/d9/d15/l37 0 2024-09-13T02:52:43.138 INFO:tasks.workunit.client.0.smithi098.stdout:8/202: rmdir d2/dd/d2e 39 2024-09-13T02:52:43.139 INFO:tasks.workunit.client.0.smithi098.stdout:3/193: write d7/d9/d15/d26/f2a [39801,96619] 0 2024-09-13T02:52:43.139 INFO:tasks.workunit.client.0.smithi098.stdout:8/203: dread - d2/f27 zero size 2024-09-13T02:52:43.140 INFO:tasks.workunit.client.0.smithi098.stdout:0/185: mkdir dd/df/d1d/d26/d37 0 2024-09-13T02:52:43.145 INFO:tasks.workunit.client.1.smithi142.stdout:0/605: truncate d10/d6c/d88/d1a/d1e/d42/d4b/f61 4008449 0 2024-09-13T02:52:43.146 INFO:tasks.workunit.client.1.smithi142.stdout:1/681: mknod d12/d13/d45/cd6 0 2024-09-13T02:52:43.147 INFO:tasks.workunit.client.1.smithi142.stdout:2/484: dread d1/d2d/f64 [0,4194304] 0 2024-09-13T02:52:43.147 INFO:tasks.workunit.client.0.smithi098.stdout:1/211: rename d9/d33/d1f/d23/f34 to d9/d33/d19/f50 0 2024-09-13T02:52:43.151 INFO:tasks.workunit.client.1.smithi142.stdout:5/647: rmdir d8/dc3/d26/d61 39 2024-09-13T02:52:43.157 INFO:tasks.workunit.client.1.smithi142.stdout:7/583: symlink d10/d13/d1d/d25/d45/dad/lc1 0 2024-09-13T02:52:43.157 INFO:tasks.workunit.client.1.smithi142.stdout:5/648: dwrite d8/dc3/d26/f6a [4194304,4194304] 0 2024-09-13T02:52:43.159 INFO:tasks.workunit.client.1.smithi142.stdout:7/584: truncate d10/d34/d57/d98/fa5 959578 0 2024-09-13T02:52:43.159 INFO:tasks.workunit.client.1.smithi142.stdout:0/606: unlink d10/d6c/c83 0 2024-09-13T02:52:43.160 INFO:tasks.workunit.client.1.smithi142.stdout:7/585: fsync d10/d34/f97 0 2024-09-13T02:52:43.161 INFO:tasks.workunit.client.1.smithi142.stdout:9/709: mknod dd/d17/d44/d82/d99/daf/dc9/d103/c105 0 2024-09-13T02:52:43.164 INFO:tasks.workunit.client.1.smithi142.stdout:5/649: dwrite d8/dc3/d26/d2d/d90/fa1 [0,4194304] 0 2024-09-13T02:52:43.166 INFO:tasks.workunit.client.1.smithi142.stdout:5/650: write d8/dc3/d26/d45/d8e/f94 [360797,1648] 0 2024-09-13T02:52:43.168 INFO:tasks.workunit.client.0.smithi098.stdout:0/186: write dd/f16 [2143362,38172] 0 2024-09-13T02:52:43.168 INFO:tasks.workunit.client.1.smithi142.stdout:1/682: dread d12/f22 [0,4194304] 0 2024-09-13T02:52:43.169 INFO:tasks.workunit.client.0.smithi098.stdout:0/187: read dd/f2c [769524,34038] 0 2024-09-13T02:52:43.170 INFO:tasks.workunit.client.1.smithi142.stdout:6/665: symlink d1/dd/d16/d47/dad/dd2/le1 0 2024-09-13T02:52:43.172 INFO:tasks.workunit.client.1.smithi142.stdout:1/683: dread d12/d13/d20/f48 [0,4194304] 0 2024-09-13T02:52:43.175 INFO:tasks.workunit.client.0.smithi098.stdout:0/188: dread dd/f2c [0,4194304] 0 2024-09-13T02:52:43.176 INFO:tasks.workunit.client.1.smithi142.stdout:2/485: mkdir d1/de/d1f/d9c 0 2024-09-13T02:52:43.176 INFO:tasks.workunit.client.0.smithi098.stdout:0/189: chown dd/df/f18 394651668 1 2024-09-13T02:52:43.176 INFO:tasks.workunit.client.1.smithi142.stdout:2/486: stat d1/d42/f55 0 2024-09-13T02:52:43.179 INFO:tasks.workunit.client.0.smithi098.stdout:2/184: creat d1/d1f/d30/f34 x:0 0 0 2024-09-13T02:52:43.179 INFO:tasks.workunit.client.0.smithi098.stdout:3/194: write f4 [5022468,3303] 0 2024-09-13T02:52:43.183 INFO:tasks.workunit.client.0.smithi098.stdout:9/181: creat d2/dd/d39/d43/f44 x:0 0 0 2024-09-13T02:52:43.184 INFO:tasks.workunit.client.1.smithi142.stdout:3/586: getdents d12/d16/d25/d2e/d38/d4d 0 2024-09-13T02:52:43.184 INFO:tasks.workunit.client.0.smithi098.stdout:9/182: fdatasync d2/d6/d2b/f37 0 2024-09-13T02:52:43.185 INFO:tasks.workunit.client.1.smithi142.stdout:3/587: chown d12/d16/d25/d2e/d38/d6b/f89 8513 1 2024-09-13T02:52:43.186 INFO:tasks.workunit.client.1.smithi142.stdout:3/588: truncate d12/d16/d25/d2e/f49 1079083 0 2024-09-13T02:52:43.186 INFO:tasks.workunit.client.1.smithi142.stdout:8/499: getdents d0/d6/d23/d64 0 2024-09-13T02:52:43.186 INFO:tasks.workunit.client.1.smithi142.stdout:8/500: fdatasync d0/d6/dc/d40/d46/f5a 0 2024-09-13T02:52:43.188 INFO:tasks.workunit.client.1.smithi142.stdout:6/666: creat d1/dd/d16/d4e/d32/fe2 x:0 0 0 2024-09-13T02:52:43.192 INFO:tasks.workunit.client.0.smithi098.stdout:0/190: unlink dd/c29 0 2024-09-13T02:52:43.193 INFO:tasks.workunit.client.1.smithi142.stdout:0/607: write d10/d6c/d88/d21/f3c [1778110,1418] 0 2024-09-13T02:52:43.193 INFO:tasks.workunit.client.1.smithi142.stdout:2/487: rmdir d1/de/d31/d6c/d6d 39 2024-09-13T02:52:43.194 INFO:tasks.workunit.client.1.smithi142.stdout:0/608: chown d10/d6c/d88/d1a/d7a/f81 124 1 2024-09-13T02:52:43.194 INFO:tasks.workunit.client.0.smithi098.stdout:6/180: truncate d5/fc 4363890 0 2024-09-13T02:52:43.195 INFO:tasks.workunit.client.0.smithi098.stdout:1/212: mkdir d9/d33/d19/d2c/d51 0 2024-09-13T02:52:43.196 INFO:tasks.workunit.client.0.smithi098.stdout:1/213: write d9/d33/d19/f21 [904841,76879] 0 2024-09-13T02:52:43.197 INFO:tasks.workunit.client.1.smithi142.stdout:7/586: mkdir d10/d13/dc2 0 2024-09-13T02:52:43.198 INFO:tasks.workunit.client.0.smithi098.stdout:1/214: fdatasync d9/d12/f18 0 2024-09-13T02:52:43.198 INFO:tasks.workunit.client.0.smithi098.stdout:3/195: mkdir d7/d3c 0 2024-09-13T02:52:43.200 INFO:tasks.workunit.client.0.smithi098.stdout:2/185: mkdir d1/d1f/d35 0 2024-09-13T02:52:43.201 INFO:tasks.workunit.client.0.smithi098.stdout:6/181: dwrite d5/d18/f2a [0,4194304] 0 2024-09-13T02:52:43.202 INFO:tasks.workunit.client.1.smithi142.stdout:9/710: creat dd/d17/d4f/d91/dab/f106 x:0 0 0 2024-09-13T02:52:43.202 INFO:tasks.workunit.client.1.smithi142.stdout:1/684: write d12/f57 [1345033,92868] 0 2024-09-13T02:52:43.203 INFO:tasks.workunit.client.1.smithi142.stdout:9/711: stat dd/d17/d69/d84/c3a 0 2024-09-13T02:52:43.204 INFO:tasks.workunit.client.0.smithi098.stdout:5/163: creat d0/d38/d3f/d1a/f41 x:0 0 0 2024-09-13T02:52:43.206 INFO:tasks.workunit.client.0.smithi098.stdout:6/182: truncate d5/d13/d2b/f2d 982416 0 2024-09-13T02:52:43.206 INFO:tasks.workunit.client.0.smithi098.stdout:3/196: dread d7/d9/d15/d26/f2a [0,4194304] 0 2024-09-13T02:52:43.207 INFO:tasks.workunit.client.0.smithi098.stdout:6/183: stat d5/l10 0 2024-09-13T02:52:43.209 INFO:tasks.workunit.client.0.smithi098.stdout:9/183: creat d2/dd/d39/f45 x:0 0 0 2024-09-13T02:52:43.209 INFO:tasks.workunit.client.0.smithi098.stdout:6/184: chown d5/l10 313 1 2024-09-13T02:52:43.210 INFO:tasks.workunit.client.0.smithi098.stdout:2/186: dwrite d1/d1c/f2f [0,4194304] 0 2024-09-13T02:52:43.211 INFO:tasks.workunit.client.0.smithi098.stdout:6/185: dread - d5/d13/d2b/d3a/d14/f34 zero size 2024-09-13T02:52:43.212 INFO:tasks.workunit.client.0.smithi098.stdout:2/187: write d1/f8 [1291720,116775] 0 2024-09-13T02:52:43.212 INFO:tasks.workunit.client.0.smithi098.stdout:8/204: link d2/f9 d2/dd/d2e/f3d 0 2024-09-13T02:52:43.212 INFO:tasks.workunit.client.0.smithi098.stdout:6/186: chown d5/d13/c21 458 1 2024-09-13T02:52:43.218 INFO:tasks.workunit.client.1.smithi142.stdout:2/488: stat d1/d29/d72 0 2024-09-13T02:52:43.218 INFO:tasks.workunit.client.1.smithi142.stdout:2/489: chown d1/d42/d44 52491 1 2024-09-13T02:52:43.219 INFO:tasks.workunit.client.1.smithi142.stdout:2/490: read - d1/d42/f8f zero size 2024-09-13T02:52:43.221 INFO:tasks.workunit.client.1.smithi142.stdout:0/609: rmdir d10/d6c/d88/d1a/d7a 39 2024-09-13T02:52:43.221 INFO:tasks.workunit.client.1.smithi142.stdout:5/651: write d8/f13 [1565787,16784] 0 2024-09-13T02:52:43.222 INFO:tasks.workunit.client.1.smithi142.stdout:5/652: read d8/f1f [7944321,70805] 0 2024-09-13T02:52:43.227 INFO:tasks.workunit.client.0.smithi098.stdout:5/164: mknod d0/d38/d3f/c42 0 2024-09-13T02:52:43.228 INFO:tasks.workunit.client.0.smithi098.stdout:5/165: write d0/d29/f2c [668515,89587] 0 2024-09-13T02:52:43.230 INFO:tasks.workunit.client.0.smithi098.stdout:3/197: creat d7/f3d x:0 0 0 2024-09-13T02:52:43.231 INFO:tasks.workunit.client.1.smithi142.stdout:3/589: truncate d12/d16/d25/f60 3162037 0 2024-09-13T02:52:43.233 INFO:tasks.workunit.client.1.smithi142.stdout:8/501: unlink d0/d80/d8c/l8a 0 2024-09-13T02:52:43.235 INFO:tasks.workunit.client.0.smithi098.stdout:5/166: dwrite d0/d15/f22 [0,4194304] 0 2024-09-13T02:52:43.237 INFO:tasks.workunit.client.0.smithi098.stdout:2/188: mkdir d1/d1f/d36 0 2024-09-13T02:52:43.238 INFO:tasks.workunit.client.0.smithi098.stdout:8/205: creat d2/dd/d11/d1d/f3e x:0 0 0 2024-09-13T02:52:43.238 INFO:tasks.workunit.client.1.smithi142.stdout:4/572: sync 2024-09-13T02:52:43.238 INFO:tasks.workunit.client.0.smithi098.stdout:8/206: fsync d2/f1b 0 2024-09-13T02:52:43.240 INFO:tasks.workunit.client.1.smithi142.stdout:2/491: rename d1/de/d1f/f19 to d1/de/f9d 0 2024-09-13T02:52:43.247 INFO:tasks.workunit.client.0.smithi098.stdout:1/215: unlink c2 0 2024-09-13T02:52:43.251 INFO:tasks.workunit.client.0.smithi098.stdout:9/184: mkdir d2/d6/d46 0 2024-09-13T02:52:43.254 INFO:tasks.workunit.client.1.smithi142.stdout:8/502: creat d0/d6/dc/d45/d8/f9c x:0 0 0 2024-09-13T02:52:43.254 INFO:tasks.workunit.client.1.smithi142.stdout:8/503: chown d0/d6/dc/d45/d35/d37 7 1 2024-09-13T02:52:43.255 INFO:tasks.workunit.client.1.smithi142.stdout:8/504: write d0/f95 [976969,10904] 0 2024-09-13T02:52:43.256 INFO:tasks.workunit.client.1.smithi142.stdout:6/667: rmdir d1/dd/d53/d78/db7 0 2024-09-13T02:52:43.256 INFO:tasks.workunit.client.1.smithi142.stdout:6/668: stat d1/d7/d5f/d60/d76/d7e/fd9 0 2024-09-13T02:52:43.257 INFO:tasks.workunit.client.0.smithi098.stdout:2/189: rmdir d1/d1f/d30 39 2024-09-13T02:52:43.265 INFO:tasks.workunit.client.1.smithi142.stdout:3/590: write d12/d16/d25/d2e/d38/d4d/f69 [318194,66412] 0 2024-09-13T02:52:43.265 INFO:tasks.workunit.client.0.smithi098.stdout:6/187: mkdir d5/d13/d2b/d3a/d41 0 2024-09-13T02:52:43.266 INFO:tasks.workunit.client.1.smithi142.stdout:3/591: dread - d12/d16/d3c/d7d/d91/fb4 zero size 2024-09-13T02:52:43.270 INFO:tasks.workunit.client.0.smithi098.stdout:1/216: symlink d9/l52 0 2024-09-13T02:52:43.270 INFO:tasks.workunit.client.0.smithi098.stdout:5/167: dwrite d0/d15/f22 [4194304,4194304] 0 2024-09-13T02:52:43.271 INFO:tasks.workunit.client.0.smithi098.stdout:1/217: chown d9/d33/d1f/l2d 40705284 1 2024-09-13T02:52:43.274 INFO:tasks.workunit.client.0.smithi098.stdout:9/185: rmdir d2/d6/d36 39 2024-09-13T02:52:43.277 INFO:tasks.workunit.client.0.smithi098.stdout:2/190: readlink d1/d1a/d9/d1e/l2a 0 2024-09-13T02:52:43.278 INFO:tasks.workunit.client.0.smithi098.stdout:8/207: symlink d2/dd/d11/d2c/l3f 0 2024-09-13T02:52:43.279 INFO:tasks.workunit.client.0.smithi098.stdout:8/208: truncate d2/f1a 4525997 0 2024-09-13T02:52:43.280 INFO:tasks.workunit.client.0.smithi098.stdout:2/191: dread d1/d1c/f2f [0,4194304] 0 2024-09-13T02:52:43.281 INFO:tasks.workunit.client.0.smithi098.stdout:2/192: write d1/d1a/d9/d1e/f2c [5125398,116446] 0 2024-09-13T02:52:43.300 INFO:tasks.workunit.client.0.smithi098.stdout:4/183: sync 2024-09-13T02:52:43.300 INFO:tasks.workunit.client.0.smithi098.stdout:7/349: sync 2024-09-13T02:52:43.304 INFO:tasks.workunit.client.0.smithi098.stdout:0/191: getdents dd 0 2024-09-13T02:52:43.305 INFO:tasks.workunit.client.0.smithi098.stdout:0/192: write f4 [5952873,27682] 0 2024-09-13T02:52:43.306 INFO:tasks.workunit.client.0.smithi098.stdout:0/193: chown dd/df/c11 3154602 1 2024-09-13T02:52:43.309 INFO:tasks.workunit.client.1.smithi142.stdout:5/653: rename d8/dc3/d26 to d8/d47/d65/da0/dd1 0 2024-09-13T02:52:43.312 INFO:tasks.workunit.client.0.smithi098.stdout:5/168: fsync d0/d15/d17/f28 0 2024-09-13T02:52:43.319 INFO:tasks.workunit.client.1.smithi142.stdout:7/587: rmdir d10/d13/d1d/d25/d5c/db5 0 2024-09-13T02:52:43.320 INFO:tasks.workunit.client.0.smithi098.stdout:7/350: unlink d6/f13 0 2024-09-13T02:52:43.323 INFO:tasks.workunit.client.1.smithi142.stdout:1/685: rmdir d12/d13/d20/d27/d3c/d71/dd1 0 2024-09-13T02:52:43.324 INFO:tasks.workunit.client.0.smithi098.stdout:7/351: dread d6/d24/d2a/d48/f4e [0,4194304] 0 2024-09-13T02:52:43.324 INFO:tasks.workunit.client.0.smithi098.stdout:6/188: mknod d5/d36/c42 0 2024-09-13T02:52:43.325 INFO:tasks.workunit.client.1.smithi142.stdout:9/712: creat dd/d17/d44/d82/d99/f107 x:0 0 0 2024-09-13T02:52:43.325 INFO:tasks.workunit.client.0.smithi098.stdout:6/189: dread - d5/d13/d2b/d3a/d14/f34 zero size 2024-09-13T02:52:43.326 INFO:tasks.workunit.client.0.smithi098.stdout:3/198: getdents d7/d9/d25 0 2024-09-13T02:52:43.327 INFO:tasks.workunit.client.1.smithi142.stdout:8/505: mkdir d0/d6/dc/d45/d9d 0 2024-09-13T02:52:43.327 INFO:tasks.workunit.client.0.smithi098.stdout:5/169: symlink d0/d15/d17/d1c/l43 0 2024-09-13T02:52:43.328 INFO:tasks.workunit.client.1.smithi142.stdout:6/669: mkdir d1/d7/d42/d88/de3 0 2024-09-13T02:52:43.329 INFO:tasks.workunit.client.0.smithi098.stdout:5/170: write d0/d29/f2c [606079,112605] 0 2024-09-13T02:52:43.332 INFO:tasks.workunit.client.0.smithi098.stdout:2/193: link d1/d1a/f12 d1/d1a/dc/f37 0 2024-09-13T02:52:43.333 INFO:tasks.workunit.client.1.smithi142.stdout:4/573: getdents d0/d2b/d2d/d31/d32/daa 0 2024-09-13T02:52:43.334 INFO:tasks.workunit.client.0.smithi098.stdout:3/199: dwrite d7/d9/d25/d2b/f33 [0,4194304] 0 2024-09-13T02:52:43.334 INFO:tasks.workunit.client.0.smithi098.stdout:7/352: creat d6/d1e/f70 x:0 0 0 2024-09-13T02:52:43.334 INFO:tasks.workunit.client.1.smithi142.stdout:4/574: fsync d0/d2b/f41 0 2024-09-13T02:52:43.334 INFO:tasks.workunit.client.1.smithi142.stdout:4/575: readlink d0/d2b/le 0 2024-09-13T02:52:43.335 INFO:tasks.workunit.client.0.smithi098.stdout:6/190: truncate d5/d18/f25 5239212 0 2024-09-13T02:52:43.337 INFO:tasks.workunit.client.0.smithi098.stdout:6/191: write d5/d13/d2b/d3a/f37 [742863,39808] 0 2024-09-13T02:52:43.337 INFO:tasks.workunit.client.1.smithi142.stdout:7/588: rename d10/d31 to d10/d13/d1d/d25/d45/d6d/dc3 0 2024-09-13T02:52:43.338 INFO:tasks.workunit.client.1.smithi142.stdout:7/589: chown d10/d13/l18 515338684 1 2024-09-13T02:52:43.339 INFO:tasks.workunit.client.1.smithi142.stdout:7/590: read d10/d13/d22/f69 [1692084,8015] 0 2024-09-13T02:52:43.340 INFO:tasks.workunit.client.1.smithi142.stdout:8/506: symlink d0/d6/dc/d45/d8/df/d28/l9e 0 2024-09-13T02:52:43.342 INFO:tasks.workunit.client.0.smithi098.stdout:5/171: creat d0/d15/d17/f44 x:0 0 0 2024-09-13T02:52:43.343 INFO:tasks.workunit.client.1.smithi142.stdout:3/592: symlink d12/d16/d3c/d79/d9b/lb5 0 2024-09-13T02:52:43.344 INFO:tasks.workunit.client.0.smithi098.stdout:5/172: readlink d0/d15/d17/l31 0 2024-09-13T02:52:43.344 INFO:tasks.workunit.client.0.smithi098.stdout:6/192: dwrite d5/d13/f3f [0,4194304] 0 2024-09-13T02:52:43.348 INFO:tasks.workunit.client.0.smithi098.stdout:3/200: creat d7/d9/d25/d2b/f3e x:0 0 0 2024-09-13T02:52:43.350 INFO:tasks.workunit.client.0.smithi098.stdout:7/353: creat d6/d24/d2a/d5a/d42/f71 x:0 0 0 2024-09-13T02:52:43.351 INFO:tasks.workunit.client.0.smithi098.stdout:1/218: symlink d9/d12/d4d/l53 0 2024-09-13T02:52:43.351 INFO:tasks.workunit.client.0.smithi098.stdout:6/193: dwrite d5/d18/f30 [0,4194304] 0 2024-09-13T02:52:43.352 INFO:tasks.workunit.client.0.smithi098.stdout:6/194: read d5/d18/f30 [2889469,85637] 0 2024-09-13T02:52:43.356 INFO:tasks.workunit.client.1.smithi142.stdout:1/686: rename d12/d13/d1d/f5b to d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/fd7 0 2024-09-13T02:52:43.357 INFO:tasks.workunit.client.0.smithi098.stdout:4/184: rename d6/l1e to d6/d10/d21/l3a 0 2024-09-13T02:52:43.359 INFO:tasks.workunit.client.0.smithi098.stdout:3/201: symlink d7/l3f 0 2024-09-13T02:52:43.360 INFO:tasks.workunit.client.1.smithi142.stdout:7/591: fsync d10/d13/d1d/f36 0 2024-09-13T02:52:43.361 INFO:tasks.workunit.client.0.smithi098.stdout:6/195: dwrite d5/d13/d2b/d3a/d14/f34 [0,4194304] 0 2024-09-13T02:52:43.362 INFO:tasks.workunit.client.0.smithi098.stdout:3/202: fdatasync d7/d9/d25/d2b/f3e 0 2024-09-13T02:52:43.363 INFO:tasks.workunit.client.1.smithi142.stdout:7/592: write d10/d34/f97 [530951,4612] 0 2024-09-13T02:52:43.363 INFO:tasks.workunit.client.1.smithi142.stdout:1/687: dwrite d12/d13/d20/d27/d3c/d71/f9d [0,4194304] 0 2024-09-13T02:52:43.365 INFO:tasks.workunit.client.1.smithi142.stdout:2/492: getdents d1/de/d31/d6c 0 2024-09-13T02:52:43.365 INFO:tasks.workunit.client.0.smithi098.stdout:1/219: dread d9/d12/d2f/f3e [0,4194304] 0 2024-09-13T02:52:43.366 INFO:tasks.workunit.client.1.smithi142.stdout:0/610: link d10/d6c/d88/d1a/d1e/cb0 d10/d6c/d88/d21/d51/d35/d9b/cca 0 2024-09-13T02:52:43.367 INFO:tasks.workunit.client.0.smithi098.stdout:1/220: dread d9/d33/d19/f28 [0,4194304] 0 2024-09-13T02:52:43.369 INFO:tasks.workunit.client.0.smithi098.stdout:1/221: dread d9/f38 [0,4194304] 0 2024-09-13T02:52:43.370 INFO:tasks.workunit.client.0.smithi098.stdout:0/194: rename dd/df/d1d/d26/c27 to dd/d1f/c38 0 2024-09-13T02:52:43.372 INFO:tasks.workunit.client.0.smithi098.stdout:3/203: dwrite d7/d9/d25/d2b/f33 [0,4194304] 0 2024-09-13T02:52:43.373 INFO:tasks.workunit.client.0.smithi098.stdout:5/173: symlink d0/d38/d3f/d1a/l45 0 2024-09-13T02:52:43.375 INFO:tasks.workunit.client.1.smithi142.stdout:0/611: dwrite d10/d6c/d88/d45/fc8 [0,4194304] 0 2024-09-13T02:52:43.375 INFO:tasks.workunit.client.1.smithi142.stdout:0/612: dread - d10/d6c/d88/d45/db3/fc7 zero size 2024-09-13T02:52:43.378 INFO:tasks.workunit.client.0.smithi098.stdout:7/354: creat d6/d24/d63/f72 x:0 0 0 2024-09-13T02:52:43.382 INFO:tasks.workunit.client.0.smithi098.stdout:7/355: read d6/d24/d2a/d48/f4e [2305620,56820] 0 2024-09-13T02:52:43.384 INFO:tasks.workunit.client.0.smithi098.stdout:6/196: mknod d5/d13/c43 0 2024-09-13T02:52:43.384 INFO:tasks.workunit.client.1.smithi142.stdout:3/593: fsync d12/d16/d25/d2e/f2f 0 2024-09-13T02:52:43.386 INFO:tasks.workunit.client.0.smithi098.stdout:5/174: dwrite d0/d15/f30 [0,4194304] 0 2024-09-13T02:52:43.387 INFO:tasks.workunit.client.1.smithi142.stdout:7/593: mkdir d10/d13/d1d/d25/dc4 0 2024-09-13T02:52:43.391 INFO:tasks.workunit.client.1.smithi142.stdout:9/713: getdents dd/d17/d44/d82 0 2024-09-13T02:52:43.392 INFO:tasks.workunit.client.0.smithi098.stdout:0/195: symlink dd/d1f/l39 0 2024-09-13T02:52:43.401 INFO:tasks.workunit.client.0.smithi098.stdout:0/196: dwrite dd/df/d1d/f1a [4194304,4194304] 0 2024-09-13T02:52:43.402 INFO:tasks.workunit.client.0.smithi098.stdout:3/204: rename d7/d9/d25/d2b/f33 to d7/d9/d25/d2b/f40 0 2024-09-13T02:52:43.402 INFO:tasks.workunit.client.1.smithi142.stdout:8/507: sync 2024-09-13T02:52:43.403 INFO:tasks.workunit.client.0.smithi098.stdout:3/205: truncate d7/f3d 293272 0 2024-09-13T02:52:43.403 INFO:tasks.workunit.client.1.smithi142.stdout:8/508: dread d0/f8f [0,4194304] 0 2024-09-13T02:52:43.404 INFO:tasks.workunit.client.0.smithi098.stdout:0/197: truncate dd/df/d1d/d26/f36 627523 0 2024-09-13T02:52:43.405 INFO:tasks.workunit.client.1.smithi142.stdout:3/594: mkdir d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/db6 0 2024-09-13T02:52:43.405 INFO:tasks.workunit.client.1.smithi142.stdout:3/595: fdatasync d12/f22 0 2024-09-13T02:52:43.412 INFO:tasks.workunit.client.1.smithi142.stdout:2/493: creat d1/de/d1f/d9c/f9e x:0 0 0 2024-09-13T02:52:43.412 INFO:tasks.workunit.client.0.smithi098.stdout:2/194: rmdir d1/d1a/dc 39 2024-09-13T02:52:43.413 INFO:tasks.workunit.client.1.smithi142.stdout:9/714: dread dd/d17/d25/f29 [0,4194304] 0 2024-09-13T02:52:43.413 INFO:tasks.workunit.client.1.smithi142.stdout:7/594: creat d10/d64/fc5 x:0 0 0 2024-09-13T02:52:43.417 INFO:tasks.workunit.client.1.smithi142.stdout:2/494: dwrite d1/de/f23 [0,4194304] 0 2024-09-13T02:52:43.418 INFO:tasks.workunit.client.1.smithi142.stdout:6/670: write d1/dd/d53/fdc [1570086,130116] 0 2024-09-13T02:52:43.419 INFO:tasks.workunit.client.1.smithi142.stdout:6/671: fdatasync d1/dd/d16/d47/fae 0 2024-09-13T02:52:43.421 INFO:tasks.workunit.client.0.smithi098.stdout:1/222: mknod d9/d12/c54 0 2024-09-13T02:52:43.422 INFO:tasks.workunit.client.1.smithi142.stdout:5/654: write d8/d47/d65/da0/dd1/f60 [1249655,31223] 0 2024-09-13T02:52:43.423 INFO:tasks.workunit.client.1.smithi142.stdout:5/655: chown d8/d47/d65/da0/dd1/d45/f79 0 1 2024-09-13T02:52:43.427 INFO:tasks.workunit.client.1.smithi142.stdout:9/715: rename dd/d17/d25/d3e/f56 to dd/dcb/f108 0 2024-09-13T02:52:43.429 INFO:tasks.workunit.client.0.smithi098.stdout:4/185: creat d6/d10/d21/f3b x:0 0 0 2024-09-13T02:52:43.430 INFO:tasks.workunit.client.1.smithi142.stdout:7/595: rmdir d10/d13/d1d/d2b/d56/d5f/da2 39 2024-09-13T02:52:43.434 INFO:tasks.workunit.client.0.smithi098.stdout:4/186: dwrite d6/f1c [0,4194304] 0 2024-09-13T02:52:43.435 INFO:tasks.workunit.client.0.smithi098.stdout:4/187: dread - d6/d10/d21/f3b zero size 2024-09-13T02:52:43.437 INFO:tasks.workunit.client.0.smithi098.stdout:0/198: symlink dd/df/d1d/l3a 0 2024-09-13T02:52:43.438 INFO:tasks.workunit.client.1.smithi142.stdout:2/495: mknod d1/d2c/d6f/c9f 0 2024-09-13T02:52:43.438 INFO:tasks.workunit.client.1.smithi142.stdout:2/496: stat d1/d2d/c36 0 2024-09-13T02:52:43.439 INFO:tasks.workunit.client.0.smithi098.stdout:7/356: mkdir d6/d24/d2a/d5a/d42/d45/d73 0 2024-09-13T02:52:43.441 INFO:tasks.workunit.client.1.smithi142.stdout:3/596: mknod d12/d16/d25/d2e/d38/d4d/d53/cb7 0 2024-09-13T02:52:43.445 INFO:tasks.workunit.client.1.smithi142.stdout:4/576: truncate d0/df/d57/f22 3060605 0 2024-09-13T02:52:43.446 INFO:tasks.workunit.client.1.smithi142.stdout:5/656: unlink d8/d47/d65/da0/dd1/d45/d81/d82/la2 0 2024-09-13T02:52:43.447 INFO:tasks.workunit.client.1.smithi142.stdout:5/657: write d8/d47/d65/da0/dd1/d63/fc9 [728949,46967] 0 2024-09-13T02:52:43.447 INFO:tasks.workunit.client.1.smithi142.stdout:5/658: stat d8/d47/c6d 0 2024-09-13T02:52:43.448 INFO:tasks.workunit.client.1.smithi142.stdout:9/716: creat dd/d87/f109 x:0 0 0 2024-09-13T02:52:43.450 INFO:tasks.workunit.client.1.smithi142.stdout:7/596: symlink d10/d13/d22/lc6 0 2024-09-13T02:52:43.452 INFO:tasks.workunit.client.1.smithi142.stdout:8/509: creat d0/d6/dc/d45/d8/df/f9f x:0 0 0 2024-09-13T02:52:43.452 INFO:tasks.workunit.client.1.smithi142.stdout:7/597: dread d10/d34/d57/d98/fa5 [0,4194304] 0 2024-09-13T02:52:43.454 INFO:tasks.workunit.client.0.smithi098.stdout:1/223: rename d9/d33/d19/d35/f43 to d9/f55 0 2024-09-13T02:52:43.456 INFO:tasks.workunit.client.1.smithi142.stdout:2/497: rename d1/de/d1f/f37 to d1/d2d/fa0 0 2024-09-13T02:52:43.458 INFO:tasks.workunit.client.0.smithi098.stdout:3/206: mknod d7/d3c/c41 0 2024-09-13T02:52:43.461 INFO:tasks.workunit.client.1.smithi142.stdout:4/577: mkdir d0/d7e/db8 0 2024-09-13T02:52:43.462 INFO:tasks.workunit.client.1.smithi142.stdout:2/498: dwrite d1/de/d1f/f63 [0,4194304] 0 2024-09-13T02:52:43.462 INFO:tasks.workunit.client.0.smithi098.stdout:2/195: dread d1/d1a/dc/d23/f28 [0,4194304] 0 2024-09-13T02:52:43.463 INFO:tasks.workunit.client.1.smithi142.stdout:4/578: read d0/d2b/d21/d35/f83 [2236800,12638] 0 2024-09-13T02:52:43.463 INFO:tasks.workunit.client.0.smithi098.stdout:0/199: rename dd/df/l21 to dd/df/l3b 0 2024-09-13T02:52:43.467 INFO:tasks.workunit.client.1.smithi142.stdout:0/613: dwrite d10/f7c [0,4194304] 0 2024-09-13T02:52:43.469 INFO:tasks.workunit.client.1.smithi142.stdout:9/717: rmdir dd/d17/d44/d82/d99/daf 39 2024-09-13T02:52:43.469 INFO:tasks.workunit.client.1.smithi142.stdout:9/718: readlink dd/d17/d4f/l9d 0 2024-09-13T02:52:43.471 INFO:tasks.workunit.client.1.smithi142.stdout:1/688: truncate d12/d13/d1d/d26/f6a 1676152 0 2024-09-13T02:52:43.475 INFO:tasks.workunit.client.0.smithi098.stdout:1/224: fdatasync d9/f38 0 2024-09-13T02:52:43.480 INFO:tasks.workunit.client.0.smithi098.stdout:3/207: creat d7/d9/d15/d2d/f42 x:0 0 0 2024-09-13T02:52:43.483 INFO:tasks.workunit.client.0.smithi098.stdout:4/188: symlink d6/l3c 0 2024-09-13T02:52:43.484 INFO:tasks.workunit.client.0.smithi098.stdout:1/225: dwrite d9/f10 [0,4194304] 0 2024-09-13T02:52:43.485 INFO:tasks.workunit.client.1.smithi142.stdout:3/597: mkdir d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/db6/db8 0 2024-09-13T02:52:43.488 INFO:tasks.workunit.client.0.smithi098.stdout:0/200: creat dd/df/f3c x:0 0 0 2024-09-13T02:52:43.488 INFO:tasks.workunit.client.0.smithi098.stdout:0/201: stat dd/f24 0 2024-09-13T02:52:43.493 INFO:tasks.workunit.client.1.smithi142.stdout:2/499: fdatasync d1/de/d1f/f63 0 2024-09-13T02:52:43.494 INFO:tasks.workunit.client.0.smithi098.stdout:6/197: getdents d5/d13/d2b/d3a/d14 0 2024-09-13T02:52:43.494 INFO:tasks.workunit.client.1.smithi142.stdout:6/672: write d1/dd/d16/f9f [68916,26219] 0 2024-09-13T02:52:43.495 INFO:tasks.workunit.client.1.smithi142.stdout:2/500: write d1/d2d/f64 [1232394,52069] 0 2024-09-13T02:52:43.497 INFO:tasks.workunit.client.1.smithi142.stdout:6/673: write d1/dd/f49 [3667388,2924] 0 2024-09-13T02:52:43.497 INFO:tasks.workunit.client.1.smithi142.stdout:6/674: fdatasync d1/f25 0 2024-09-13T02:52:43.499 INFO:tasks.workunit.client.0.smithi098.stdout:5/175: truncate d0/d15/f30 3543961 0 2024-09-13T02:52:43.501 INFO:tasks.workunit.client.0.smithi098.stdout:4/189: chown d6/d10/d21/l30 97 1 2024-09-13T02:52:43.503 INFO:tasks.workunit.client.0.smithi098.stdout:1/226: mkdir d9/d33/d19/d2c/d56 0 2024-09-13T02:52:43.504 INFO:tasks.workunit.client.0.smithi098.stdout:1/227: fsync d9/f3d 0 2024-09-13T02:52:43.505 INFO:tasks.workunit.client.0.smithi098.stdout:3/208: dread d7/d9/d25/f36 [0,4194304] 0 2024-09-13T02:52:43.510 INFO:tasks.workunit.client.0.smithi098.stdout:2/196: truncate d1/d1a/d9/d1e/f2e 4966945 0 2024-09-13T02:52:43.512 INFO:tasks.workunit.client.0.smithi098.stdout:6/198: symlink d5/d18/l44 0 2024-09-13T02:52:43.513 INFO:tasks.workunit.client.1.smithi142.stdout:3/598: dread - d12/d16/d25/d2e/d48/d5c/d8c/f98 zero size 2024-09-13T02:52:43.514 INFO:tasks.workunit.client.0.smithi098.stdout:5/176: fdatasync d0/d38/d3f/fc 0 2024-09-13T02:52:43.517 INFO:tasks.workunit.client.0.smithi098.stdout:7/357: dwrite d6/f11 [0,4194304] 0 2024-09-13T02:52:43.517 INFO:tasks.workunit.client.1.smithi142.stdout:4/579: symlink d0/df/lb9 0 2024-09-13T02:52:43.528 INFO:tasks.workunit.client.1.smithi142.stdout:2/501: rmdir d1/de/d1f/d13 39 2024-09-13T02:52:43.529 INFO:tasks.workunit.client.1.smithi142.stdout:2/502: truncate d1/de/d31/d6c/d6d/f34 1963453 0 2024-09-13T02:52:43.531 INFO:tasks.workunit.client.1.smithi142.stdout:6/675: creat d1/dd/d53/d78/d8f/fe4 x:0 0 0 2024-09-13T02:52:43.537 INFO:tasks.workunit.client.1.smithi142.stdout:6/676: dread d1/d7/f8d [0,4194304] 0 2024-09-13T02:52:43.538 INFO:tasks.workunit.client.1.smithi142.stdout:7/598: write d10/d13/d1d/d25/d45/d6d/fa9 [702478,15429] 0 2024-09-13T02:52:43.545 INFO:tasks.workunit.client.1.smithi142.stdout:2/503: creat d1/d2c/fa1 x:0 0 0 2024-09-13T02:52:43.546 INFO:tasks.workunit.client.1.smithi142.stdout:5/659: truncate d8/d47/d65/da0/dd1/d61/f7e 1030455 0 2024-09-13T02:52:43.547 INFO:tasks.workunit.client.1.smithi142.stdout:8/510: getdents d0/d6/dc/d40/d46 0 2024-09-13T02:52:43.548 INFO:tasks.workunit.client.1.smithi142.stdout:8/511: write d0/d6/dc/d45/d8/f29 [2065152,110057] 0 2024-09-13T02:52:43.548 INFO:tasks.workunit.client.1.smithi142.stdout:6/677: rmdir d1/dd/d16/d47/dad/dd2 39 2024-09-13T02:52:43.549 INFO:tasks.workunit.client.1.smithi142.stdout:6/678: chown d1/d7/d19/d48 885 1 2024-09-13T02:52:43.550 INFO:tasks.workunit.client.1.smithi142.stdout:6/679: fdatasync d1/d7/f24 0 2024-09-13T02:52:43.553 INFO:tasks.workunit.client.1.smithi142.stdout:7/599: creat d10/d13/d21/fc7 x:0 0 0 2024-09-13T02:52:43.556 INFO:tasks.workunit.client.1.smithi142.stdout:0/614: getdents d10 0 2024-09-13T02:52:43.557 INFO:tasks.workunit.client.1.smithi142.stdout:0/615: fdatasync d10/d23/f25 0 2024-09-13T02:52:43.558 INFO:tasks.workunit.client.1.smithi142.stdout:5/660: dwrite d8/d47/d65/da0/dd1/d45/f79 [0,4194304] 0 2024-09-13T02:52:43.560 INFO:tasks.workunit.client.1.smithi142.stdout:2/504: creat d1/d2c/fa2 x:0 0 0 2024-09-13T02:52:43.562 INFO:tasks.workunit.client.1.smithi142.stdout:9/719: write dd/d17/d25/f53 [709506,93685] 0 2024-09-13T02:52:43.563 INFO:tasks.workunit.client.1.smithi142.stdout:9/720: dread - dd/d17/d44/d95/fd2 zero size 2024-09-13T02:52:43.567 INFO:tasks.workunit.client.1.smithi142.stdout:6/680: fsync d1/dd/d57/f91 0 2024-09-13T02:52:43.567 INFO:tasks.workunit.client.1.smithi142.stdout:1/689: dwrite d12/d13/d1d/d26/f2b [0,4194304] 0 2024-09-13T02:52:43.570 INFO:tasks.workunit.client.1.smithi142.stdout:5/661: creat d8/d47/d65/da0/fd2 x:0 0 0 2024-09-13T02:52:43.572 INFO:tasks.workunit.client.1.smithi142.stdout:3/599: link lf d12/d16/d25/d2e/lb9 0 2024-09-13T02:52:43.573 INFO:tasks.workunit.client.1.smithi142.stdout:9/721: chown dd/d17/l74 925854 1 2024-09-13T02:52:43.577 INFO:tasks.workunit.client.1.smithi142.stdout:9/722: write dd/f16 [989109,39178] 0 2024-09-13T02:52:43.579 INFO:tasks.workunit.client.1.smithi142.stdout:8/512: dread d0/d6/dc/f59 [0,4194304] 0 2024-09-13T02:52:43.580 INFO:tasks.workunit.client.1.smithi142.stdout:1/690: rename d12/d13/d20/d27/d3c/d71/d81/c88 to d12/d13/d20/d27/d3c/d71/d96/cd8 0 2024-09-13T02:52:43.580 INFO:tasks.workunit.client.1.smithi142.stdout:6/681: mknod d1/ce5 0 2024-09-13T02:52:43.580 INFO:tasks.workunit.client.1.smithi142.stdout:1/691: readlink l11 0 2024-09-13T02:52:43.581 INFO:tasks.workunit.client.1.smithi142.stdout:7/600: dread d10/d13/d1d/d2b/dae/d9c/fbb [0,4194304] 0 2024-09-13T02:52:43.581 INFO:tasks.workunit.client.1.smithi142.stdout:2/505: rmdir d1/d42/d85 0 2024-09-13T02:52:43.582 INFO:tasks.workunit.client.1.smithi142.stdout:9/723: dread - dd/d17/d69/d84/d41/fcc zero size 2024-09-13T02:52:43.584 INFO:tasks.workunit.client.1.smithi142.stdout:4/580: dwrite d0/d2b/d21/d30/f54 [0,4194304] 0 2024-09-13T02:52:43.584 INFO:tasks.workunit.client.1.smithi142.stdout:3/600: mkdir d12/d16/d25/d2e/d48/d5c/d66/dba 0 2024-09-13T02:52:43.586 INFO:tasks.workunit.client.1.smithi142.stdout:7/601: write d10/d13/d1d/d25/d45/d92/fba [426864,7079] 0 2024-09-13T02:52:43.586 INFO:tasks.workunit.client.1.smithi142.stdout:8/513: rmdir d0/d6/dc/d40 39 2024-09-13T02:52:43.587 INFO:tasks.workunit.client.0.smithi098.stdout:5/177: symlink d0/l46 0 2024-09-13T02:52:43.587 INFO:tasks.workunit.client.0.smithi098.stdout:1/228: unlink d9/d12/c15 0 2024-09-13T02:52:43.588 INFO:tasks.workunit.client.1.smithi142.stdout:4/581: write d0/df/da5/fa6 [1048161,41802] 0 2024-09-13T02:52:43.589 INFO:tasks.workunit.client.1.smithi142.stdout:4/582: write d0/d2b/d75/f91 [672856,22301] 0 2024-09-13T02:52:43.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/724: creat dd/d87/f10a x:0 0 0 2024-09-13T02:52:43.590 INFO:tasks.workunit.client.1.smithi142.stdout:4/583: write d0/f8e [2521709,44531] 0 2024-09-13T02:52:43.590 INFO:tasks.workunit.client.0.smithi098.stdout:5/178: dread - d0/d38/d3f/f36 zero size 2024-09-13T02:52:43.591 INFO:tasks.workunit.client.1.smithi142.stdout:9/725: read - dd/d87/d8e/fc8 zero size 2024-09-13T02:52:43.592 INFO:tasks.workunit.client.1.smithi142.stdout:4/584: fdatasync d0/d2b/d75/f91 0 2024-09-13T02:52:43.593 INFO:tasks.workunit.client.0.smithi098.stdout:2/197: getdents d1/d1f/d36 0 2024-09-13T02:52:43.594 INFO:tasks.workunit.client.1.smithi142.stdout:4/585: read d0/d2b/d2d/d31/d43/d48/f68 [6659,70725] 0 2024-09-13T02:52:43.597 INFO:tasks.workunit.client.0.smithi098.stdout:0/202: dwrite fa [0,4194304] 0 2024-09-13T02:52:43.597 INFO:tasks.workunit.client.0.smithi098.stdout:0/203: chown c5 1584842 1 2024-09-13T02:52:43.598 INFO:tasks.workunit.client.0.smithi098.stdout:0/204: fdatasync dd/df/d1d/f34 0 2024-09-13T02:52:43.602 INFO:tasks.workunit.client.0.smithi098.stdout:5/179: dread d0/d29/f2c [0,4194304] 0 2024-09-13T02:52:43.603 INFO:tasks.workunit.client.1.smithi142.stdout:4/586: dwrite d0/d2b/d2d/d31/fb7 [0,4194304] 0 2024-09-13T02:52:43.604 INFO:tasks.workunit.client.1.smithi142.stdout:4/587: dread - d0/d2b/f67 zero size 2024-09-13T02:52:43.607 INFO:tasks.workunit.client.1.smithi142.stdout:6/682: rename d1/d7/d19/d52 to d1/dd/d53/d78/d8f/da8/de6 0 2024-09-13T02:52:43.607 INFO:tasks.workunit.client.0.smithi098.stdout:1/229: symlink d9/l57 0 2024-09-13T02:52:43.608 INFO:tasks.workunit.client.1.smithi142.stdout:1/692: dread d12/d13/d20/d27/d3c/d71/d81/d92/daa/fbe [0,4194304] 0 2024-09-13T02:52:43.610 INFO:tasks.workunit.client.1.smithi142.stdout:1/693: chown d12/d13/fce 11 1 2024-09-13T02:52:43.613 INFO:tasks.workunit.client.0.smithi098.stdout:0/205: dread dd/f16 [0,4194304] 0 2024-09-13T02:52:43.613 INFO:tasks.workunit.client.1.smithi142.stdout:5/662: getdents d8/dc3/d3f/d4a/d4b 0 2024-09-13T02:52:43.614 INFO:tasks.workunit.client.0.smithi098.stdout:7/358: dread d6/f41 [0,4194304] 0 2024-09-13T02:52:43.616 INFO:tasks.workunit.client.0.smithi098.stdout:7/359: dread d6/d24/d46/f5c [0,4194304] 0 2024-09-13T02:52:43.617 INFO:tasks.workunit.client.0.smithi098.stdout:7/360: dread - d6/d1e/f70 zero size 2024-09-13T02:52:43.618 INFO:tasks.workunit.client.1.smithi142.stdout:5/663: dwrite d8/dc3/d3f/d4a/d4b/f56 [4194304,4194304] 0 2024-09-13T02:52:43.619 INFO:tasks.workunit.client.0.smithi098.stdout:5/180: fdatasync d0/d38/d3f/f9 0 2024-09-13T02:52:43.621 INFO:tasks.workunit.client.1.smithi142.stdout:2/506: write d1/de/d31/f3d [5376724,128706] 0 2024-09-13T02:52:43.624 INFO:tasks.workunit.client.1.smithi142.stdout:2/507: dread d1/d2d/f64 [0,4194304] 0 2024-09-13T02:52:43.630 INFO:tasks.workunit.client.0.smithi098.stdout:0/206: creat dd/df/f3d x:0 0 0 2024-09-13T02:52:43.638 INFO:tasks.workunit.client.1.smithi142.stdout:8/514: rename d0/d6/dc/d45/d8/df/d28/f53 to d0/d80/fa0 0 2024-09-13T02:52:43.640 INFO:tasks.workunit.client.0.smithi098.stdout:7/361: dwrite d6/d24/d2a/d5a/f34 [0,4194304] 0 2024-09-13T02:52:43.646 INFO:tasks.workunit.client.0.smithi098.stdout:0/207: rmdir dd/df/d1d 39 2024-09-13T02:52:43.650 INFO:tasks.workunit.client.0.smithi098.stdout:5/181: creat d0/d15/d17/d1c/d3d/f47 x:0 0 0 2024-09-13T02:52:43.653 INFO:tasks.workunit.client.0.smithi098.stdout:7/362: symlink d6/d24/d2a/d5a/d42/d45/l74 0 2024-09-13T02:52:43.654 INFO:tasks.workunit.client.0.smithi098.stdout:2/198: dwrite d1/d1a/dc/f37 [4194304,4194304] 0 2024-09-13T02:52:43.655 INFO:tasks.workunit.client.1.smithi142.stdout:4/588: mknod d0/cba 0 2024-09-13T02:52:43.656 INFO:tasks.workunit.client.0.smithi098.stdout:2/199: read d1/d1a/d9/d1e/f2e [2154373,118011] 0 2024-09-13T02:52:43.659 INFO:tasks.workunit.client.0.smithi098.stdout:1/230: write d9/d12/d2f/f3e [302276,30120] 0 2024-09-13T02:52:43.660 INFO:tasks.workunit.client.1.smithi142.stdout:9/726: rename dd/d17/d4f/f80 to dd/d87/d8e/da3/f10b 0 2024-09-13T02:52:43.661 INFO:tasks.workunit.client.0.smithi098.stdout:7/363: mkdir d6/d24/d46/d75 0 2024-09-13T02:52:43.663 INFO:tasks.workunit.client.1.smithi142.stdout:8/515: unlink d0/d6/dc/f59 0 2024-09-13T02:52:43.664 INFO:tasks.workunit.client.1.smithi142.stdout:8/516: read d0/d6/dc/d45/f73 [217685,123458] 0 2024-09-13T02:52:43.664 INFO:tasks.workunit.client.1.smithi142.stdout:6/683: creat d1/d7/d5f/d60/d65/fe7 x:0 0 0 2024-09-13T02:52:43.669 INFO:tasks.workunit.client.0.smithi098.stdout:7/364: rmdir d6/d49 39 2024-09-13T02:52:43.672 INFO:tasks.workunit.client.0.smithi098.stdout:7/365: truncate d6/d24/d2a/d5a/d4c/f6a 4242110 0 2024-09-13T02:52:43.672 INFO:tasks.workunit.client.1.smithi142.stdout:6/684: dwrite d1/d7/d19/d48/f9c [0,4194304] 0 2024-09-13T02:52:43.673 INFO:tasks.workunit.client.0.smithi098.stdout:2/200: getdents d1/d1f/d35 0 2024-09-13T02:52:43.674 INFO:tasks.workunit.client.0.smithi098.stdout:2/201: chown d1/d1a/dc/f37 5 1 2024-09-13T02:52:43.676 INFO:tasks.workunit.client.1.smithi142.stdout:5/664: rename d8/d47/d65/da0/dd1/d2d/f2f to d8/dc3/d3f/d4a/fd3 0 2024-09-13T02:52:43.677 INFO:tasks.workunit.client.1.smithi142.stdout:0/616: sync 2024-09-13T02:52:43.677 INFO:tasks.workunit.client.1.smithi142.stdout:5/665: fdatasync d8/d47/d65/da0/dd1/d45/d81/d82/f93 0 2024-09-13T02:52:43.678 INFO:tasks.workunit.client.1.smithi142.stdout:5/666: write d8/f2e [8164003,126568] 0 2024-09-13T02:52:43.678 INFO:tasks.workunit.client.1.smithi142.stdout:0/617: write d10/d6c/d88/d36/f59 [359838,103812] 0 2024-09-13T02:52:43.679 INFO:tasks.workunit.client.1.smithi142.stdout:5/667: chown d8/d47/d65/da0/dd1/d2d 11 1 2024-09-13T02:52:43.683 INFO:tasks.workunit.client.1.smithi142.stdout:1/694: write d12/d13/f19 [1062799,106028] 0 2024-09-13T02:52:43.686 INFO:tasks.workunit.client.0.smithi098.stdout:2/202: unlink d1/d1a/d9/d1e/l2a 0 2024-09-13T02:52:43.686 INFO:tasks.workunit.client.1.smithi142.stdout:4/589: write d0/d2b/d2d/d31/d32/d82/f92 [1032230,4939] 0 2024-09-13T02:52:43.687 INFO:tasks.workunit.client.0.smithi098.stdout:2/203: write d1/f8 [5021661,108037] 0 2024-09-13T02:52:43.687 INFO:tasks.workunit.client.1.smithi142.stdout:4/590: write d0/df/f23 [4694508,112511] 0 2024-09-13T02:52:43.688 INFO:tasks.workunit.client.0.smithi098.stdout:1/231: rmdir d9/d33/d19/d2c/d56 0 2024-09-13T02:52:43.690 INFO:tasks.workunit.client.0.smithi098.stdout:0/208: link dd/d1f/c38 dd/df/d1d/d26/c3e 0 2024-09-13T02:52:43.691 INFO:tasks.workunit.client.1.smithi142.stdout:3/601: link d12/d16/d25/d2e/lb9 d12/d16/d3c/d7d/d91/lbb 0 2024-09-13T02:52:43.691 INFO:tasks.workunit.client.0.smithi098.stdout:0/209: write dd/f24 [635720,41898] 0 2024-09-13T02:52:43.692 INFO:tasks.workunit.client.0.smithi098.stdout:2/204: read d1/f8 [2004684,84558] 0 2024-09-13T02:52:43.692 INFO:tasks.workunit.client.1.smithi142.stdout:4/591: dread d0/d2b/d21/d35/f83 [0,4194304] 0 2024-09-13T02:52:43.693 INFO:tasks.workunit.client.1.smithi142.stdout:2/508: creat d1/fa3 x:0 0 0 2024-09-13T02:52:43.694 INFO:tasks.workunit.client.0.smithi098.stdout:0/210: dread dd/f16 [0,4194304] 0 2024-09-13T02:52:43.695 INFO:tasks.workunit.client.1.smithi142.stdout:6/685: mknod d1/dd/d53/d78/d8f/da8/ce8 0 2024-09-13T02:52:43.698 INFO:tasks.workunit.client.0.smithi098.stdout:1/232: unlink d9/l57 0 2024-09-13T02:52:43.704 INFO:tasks.workunit.client.0.smithi098.stdout:2/205: mknod d1/d1a/dc/c38 0 2024-09-13T02:52:43.706 INFO:tasks.workunit.client.0.smithi098.stdout:7/366: truncate d6/d24/d2a/d5a/f38 4669839 0 2024-09-13T02:52:43.707 INFO:tasks.workunit.client.0.smithi098.stdout:7/367: chown d6/d1e/c53 28 1 2024-09-13T02:52:43.707 INFO:tasks.workunit.client.0.smithi098.stdout:0/211: readlink dd/df/l3b 0 2024-09-13T02:52:43.708 INFO:tasks.workunit.client.1.smithi142.stdout:0/618: read d10/d6c/d88/d1a/f66 [376304,76336] 0 2024-09-13T02:52:43.709 INFO:tasks.workunit.client.1.smithi142.stdout:0/619: write d10/d6c/d88/d45/f56 [3717623,88437] 0 2024-09-13T02:52:43.710 INFO:tasks.workunit.client.1.smithi142.stdout:0/620: dread - d10/d6c/d88/d45/db3/fc7 zero size 2024-09-13T02:52:43.711 INFO:tasks.workunit.client.1.smithi142.stdout:5/668: mknod d8/d47/d65/da0/dd1/d45/cd4 0 2024-09-13T02:52:43.711 INFO:tasks.workunit.client.1.smithi142.stdout:0/621: write d10/d6c/d88/f6e [2022110,87287] 0 2024-09-13T02:52:43.714 INFO:tasks.workunit.client.1.smithi142.stdout:8/517: unlink d0/d6/dc/c22 0 2024-09-13T02:52:43.716 INFO:tasks.workunit.client.0.smithi098.stdout:0/212: mknod dd/df/d1d/d26/d28/c3f 0 2024-09-13T02:52:43.717 INFO:tasks.workunit.client.0.smithi098.stdout:1/233: getdents d9/d33/d1f/d23/d30 0 2024-09-13T02:52:43.718 INFO:tasks.workunit.client.1.smithi142.stdout:7/602: link d10/c4d d10/d13/d1d/d2b/d56/d5f/da2/cc8 0 2024-09-13T02:52:43.719 INFO:tasks.workunit.client.0.smithi098.stdout:1/234: chown d9/d33/d29/f45 0 1 2024-09-13T02:52:43.720 INFO:tasks.workunit.client.0.smithi098.stdout:2/206: rename d1/d1a/d9/d1e/d31 to d1/d1f/d39 0 2024-09-13T02:52:43.722 INFO:tasks.workunit.client.1.smithi142.stdout:2/509: creat d1/d2c/d92/fa4 x:0 0 0 2024-09-13T02:52:43.726 INFO:tasks.workunit.client.1.smithi142.stdout:6/686: creat d1/dd/d16/d4d/fe9 x:0 0 0 2024-09-13T02:52:43.726 INFO:tasks.workunit.client.1.smithi142.stdout:6/687: dread - d1/dd/d53/d78/d8f/fe4 zero size 2024-09-13T02:52:43.727 INFO:tasks.workunit.client.1.smithi142.stdout:6/688: stat d1/dd/d16/d4e/d32/fbd 0 2024-09-13T02:52:43.728 INFO:tasks.workunit.client.0.smithi098.stdout:1/235: mkdir d9/d33/d29/d58 0 2024-09-13T02:52:43.728 INFO:tasks.workunit.client.0.smithi098.stdout:2/207: dwrite d1/d1a/d9/d1e/f2c [0,4194304] 0 2024-09-13T02:52:43.728 INFO:tasks.workunit.client.0.smithi098.stdout:1/236: readlink d9/d33/d29/l37 0 2024-09-13T02:52:43.730 INFO:tasks.workunit.client.0.smithi098.stdout:2/208: dread d1/d1f/d39/f21 [0,4194304] 0 2024-09-13T02:52:43.733 INFO:tasks.workunit.client.0.smithi098.stdout:0/213: truncate dd/df/d1d/d26/d28/f2e 748804 0 2024-09-13T02:52:43.738 INFO:tasks.workunit.client.0.smithi098.stdout:2/209: readlink d1/d1a/d9/d1e/l20 0 2024-09-13T02:52:43.740 INFO:tasks.workunit.client.0.smithi098.stdout:7/368: truncate d6/d49/f54 333923 0 2024-09-13T02:52:43.741 INFO:tasks.workunit.client.1.smithi142.stdout:4/592: dwrite d0/d2b/d2d/d31/f55 [0,4194304] 0 2024-09-13T02:52:43.742 INFO:tasks.workunit.client.0.smithi098.stdout:0/214: mkdir dd/df/d1d/d40 0 2024-09-13T02:52:43.743 INFO:tasks.workunit.client.0.smithi098.stdout:1/237: symlink d9/d33/d1f/d23/d30/l59 0 2024-09-13T02:52:43.744 INFO:tasks.workunit.client.0.smithi098.stdout:1/238: chown d9/c4e 237566 1 2024-09-13T02:52:43.746 INFO:tasks.workunit.client.0.smithi098.stdout:2/210: unlink d1/d1a/d9/l22 0 2024-09-13T02:52:43.747 INFO:tasks.workunit.client.0.smithi098.stdout:2/211: chown d1/d1a/dc/d23/c25 13 1 2024-09-13T02:52:43.748 INFO:tasks.workunit.client.1.smithi142.stdout:5/669: write d8/dc3/f59 [848673,58791] 0 2024-09-13T02:52:43.748 INFO:tasks.workunit.client.0.smithi098.stdout:7/369: rename d6/d24/d2a/l4a to d6/d24/d46/l76 0 2024-09-13T02:52:43.750 INFO:tasks.workunit.client.1.smithi142.stdout:2/510: creat d1/de/d31/d6c/d6d/fa5 x:0 0 0 2024-09-13T02:52:43.751 INFO:tasks.workunit.client.0.smithi098.stdout:1/239: mkdir d9/d33/d19/d35/d5a 0 2024-09-13T02:52:43.757 INFO:tasks.workunit.client.0.smithi098.stdout:0/215: rename dd/df/c11 to dd/df/d1d/d26/d37/c41 0 2024-09-13T02:52:43.758 INFO:tasks.workunit.client.1.smithi142.stdout:1/695: link d12/d13/d20/d27/d3c/d71/d96/c99 d12/d13/dd3/cd9 0 2024-09-13T02:52:43.764 INFO:tasks.workunit.client.1.smithi142.stdout:1/696: dwrite fd [4194304,4194304] 0 2024-09-13T02:52:43.766 INFO:tasks.workunit.client.1.smithi142.stdout:3/602: rename d12/d16/d25/d2e/lb9 to d12/d16/d3c/d79/lbc 0 2024-09-13T02:52:43.769 INFO:tasks.workunit.client.0.smithi098.stdout:2/212: creat d1/d1a/f3a x:0 0 0 2024-09-13T02:52:43.772 INFO:tasks.workunit.client.0.smithi098.stdout:1/240: mkdir d9/d33/d29/d58/d5b 0 2024-09-13T02:52:43.774 INFO:tasks.workunit.client.1.smithi142.stdout:5/670: dwrite d8/dc3/d3f/d4a/fd3 [0,4194304] 0 2024-09-13T02:52:43.776 INFO:tasks.workunit.client.1.smithi142.stdout:5/671: readlink d8/dc3/d64/d68/db5/ld0 0 2024-09-13T02:52:43.776 INFO:tasks.workunit.client.0.smithi098.stdout:7/370: write d6/ff [8317443,28924] 0 2024-09-13T02:52:43.778 INFO:tasks.workunit.client.1.smithi142.stdout:9/727: sync 2024-09-13T02:52:43.778 INFO:tasks.workunit.client.1.smithi142.stdout:2/511: dwrite d1/f8c [0,4194304] 0 2024-09-13T02:52:43.780 INFO:tasks.workunit.client.0.smithi098.stdout:1/241: creat d9/d33/d29/d58/f5c x:0 0 0 2024-09-13T02:52:43.781 INFO:tasks.workunit.client.0.smithi098.stdout:1/242: dread - d9/f55 zero size 2024-09-13T02:52:43.787 INFO:tasks.workunit.client.0.smithi098.stdout:7/371: rmdir d6/d1e 39 2024-09-13T02:52:43.789 INFO:tasks.workunit.client.1.smithi142.stdout:9/728: dwrite dd/d17/d4f/d91/dab/f106 [0,4194304] 0 2024-09-13T02:52:43.792 INFO:tasks.workunit.client.0.smithi098.stdout:1/243: mknod d9/d33/d1f/d23/d30/c5d 0 2024-09-13T02:52:43.793 INFO:tasks.workunit.client.1.smithi142.stdout:5/672: dread d8/f1b [0,4194304] 0 2024-09-13T02:52:43.798 INFO:tasks.workunit.client.0.smithi098.stdout:0/216: dwrite dd/f2c [0,4194304] 0 2024-09-13T02:52:43.799 INFO:tasks.workunit.client.1.smithi142.stdout:6/689: truncate d1/dd/d16/f9f 1975256 0 2024-09-13T02:52:43.799 INFO:tasks.workunit.client.1.smithi142.stdout:0/622: getdents d10/d6c/d88/d36 0 2024-09-13T02:52:43.800 INFO:tasks.workunit.client.0.smithi098.stdout:0/217: read f8 [611472,80557] 0 2024-09-13T02:52:43.800 INFO:tasks.workunit.client.1.smithi142.stdout:7/603: sync 2024-09-13T02:52:43.801 INFO:tasks.workunit.client.0.smithi098.stdout:2/213: write d1/d1a/f7 [1170649,111239] 0 2024-09-13T02:52:43.803 INFO:tasks.workunit.client.0.smithi098.stdout:2/214: read d1/d1a/dc/f37 [2021262,97332] 0 2024-09-13T02:52:43.805 INFO:tasks.workunit.client.0.smithi098.stdout:1/244: dwrite d9/f38 [0,4194304] 0 2024-09-13T02:52:43.806 INFO:tasks.workunit.client.1.smithi142.stdout:2/512: rmdir d1 39 2024-09-13T02:52:43.815 INFO:tasks.workunit.client.1.smithi142.stdout:9/729: truncate dd/d17/d44/fa0 850715 0 2024-09-13T02:52:43.816 INFO:tasks.workunit.client.0.smithi098.stdout:1/245: truncate d9/d33/d19/f28 505273 0 2024-09-13T02:52:43.818 INFO:tasks.workunit.client.0.smithi098.stdout:7/372: write f5 [4845527,52121] 0 2024-09-13T02:52:43.820 INFO:tasks.workunit.client.1.smithi142.stdout:4/593: dwrite d0/df/d57/f22 [0,4194304] 0 2024-09-13T02:52:43.821 INFO:tasks.workunit.client.1.smithi142.stdout:4/594: read d0/d2b/d2d/d31/f55 [1331486,105776] 0 2024-09-13T02:52:43.823 INFO:tasks.workunit.client.1.smithi142.stdout:4/595: truncate d0/d2b/d21/d30/f7a 721649 0 2024-09-13T02:52:43.823 INFO:tasks.workunit.client.1.smithi142.stdout:4/596: write d0/f4c [1285915,36892] 0 2024-09-13T02:52:43.824 INFO:tasks.workunit.client.1.smithi142.stdout:0/623: fsync d10/d6c/d88/d1a/d3a/f5c 0 2024-09-13T02:52:43.826 INFO:tasks.workunit.client.0.smithi098.stdout:1/246: creat d9/d33/d19/d2c/f5e x:0 0 0 2024-09-13T02:52:43.829 INFO:tasks.workunit.client.0.smithi098.stdout:7/373: chown d6/d1e/c3f 5359255 1 2024-09-13T02:52:43.830 INFO:tasks.workunit.client.1.smithi142.stdout:4/597: dwrite d0/df/d57/f22 [0,4194304] 0 2024-09-13T02:52:43.833 INFO:tasks.workunit.client.0.smithi098.stdout:1/247: write d9/d33/d19/d46/f4a [72649,75718] 0 2024-09-13T02:52:43.833 INFO:tasks.workunit.client.1.smithi142.stdout:1/697: creat d12/fda x:0 0 0 2024-09-13T02:52:43.835 INFO:tasks.workunit.client.1.smithi142.stdout:9/730: fsync dd/f13 0 2024-09-13T02:52:43.836 INFO:tasks.workunit.client.0.smithi098.stdout:0/218: truncate dd/f2c 3074708 0 2024-09-13T02:52:43.838 INFO:tasks.workunit.client.1.smithi142.stdout:3/603: creat d12/d16/d3c/d7d/fbd x:0 0 0 2024-09-13T02:52:43.839 INFO:tasks.workunit.client.1.smithi142.stdout:5/673: dwrite d8/dc3/f41 [0,4194304] 0 2024-09-13T02:52:43.839 INFO:tasks.workunit.client.1.smithi142.stdout:3/604: chown d12/d16/f43 122 1 2024-09-13T02:52:43.842 INFO:tasks.workunit.client.0.smithi098.stdout:0/219: dread dd/df/d1d/f1a [4194304,4194304] 0 2024-09-13T02:52:43.843 INFO:tasks.workunit.client.1.smithi142.stdout:5/674: chown d8/d47/d65/da0/dd1/d45/d81 25972558 1 2024-09-13T02:52:43.845 INFO:tasks.workunit.client.1.smithi142.stdout:9/731: dwrite dd/d17/d25/fb1 [0,4194304] 0 2024-09-13T02:52:43.846 INFO:tasks.workunit.client.1.smithi142.stdout:9/732: write dd/f4c [1253889,97500] 0 2024-09-13T02:52:43.849 INFO:tasks.workunit.client.1.smithi142.stdout:2/513: mkdir d1/de/da6 0 2024-09-13T02:52:43.849 INFO:tasks.workunit.client.1.smithi142.stdout:2/514: fsync d1/fa3 0 2024-09-13T02:52:43.850 INFO:tasks.workunit.client.0.smithi098.stdout:1/248: rmdir d9/d33/d29/d58/d5b 0 2024-09-13T02:52:43.852 INFO:tasks.workunit.client.1.smithi142.stdout:8/518: rename d0/d6/d76 to d0/d6/dc/d40/d46/da1 0 2024-09-13T02:52:43.854 INFO:tasks.workunit.client.0.smithi098.stdout:0/220: mknod dd/df/d1d/d26/d28/d32/c42 0 2024-09-13T02:52:43.855 INFO:tasks.workunit.client.1.smithi142.stdout:4/598: creat d0/df/da5/dad/fbb x:0 0 0 2024-09-13T02:52:43.855 INFO:tasks.workunit.client.0.smithi098.stdout:0/221: chown dd/df/d1d/d26/f36 2058987331 1 2024-09-13T02:52:43.855 INFO:tasks.workunit.client.1.smithi142.stdout:4/599: readlink d0/d2b/d21/l85 0 2024-09-13T02:52:43.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/698: fdatasync d12/d13/d20/d27/d3c/d71/d81/d92/daa/fbe 0 2024-09-13T02:52:43.860 INFO:tasks.workunit.client.0.smithi098.stdout:1/249: truncate d9/d33/f22 1843933 0 2024-09-13T02:52:43.862 INFO:tasks.workunit.client.1.smithi142.stdout:4/600: dread d0/d2b/f41 [0,4194304] 0 2024-09-13T02:52:43.863 INFO:tasks.workunit.client.1.smithi142.stdout:4/601: chown d0/df 16054 1 2024-09-13T02:52:43.864 INFO:tasks.workunit.client.1.smithi142.stdout:6/690: creat d1/dd/d16/d47/dad/fea x:0 0 0 2024-09-13T02:52:43.865 INFO:tasks.workunit.client.0.smithi098.stdout:1/250: mkdir d9/d33/d19/d35/d5a/d5f 0 2024-09-13T02:52:43.865 INFO:tasks.workunit.client.1.smithi142.stdout:6/691: readlink d1/dd/d16/d4e/l1b 0 2024-09-13T02:52:43.866 INFO:tasks.workunit.client.1.smithi142.stdout:5/675: creat d8/d47/d65/da0/dd1/d45/d81/fd5 x:0 0 0 2024-09-13T02:52:43.866 INFO:tasks.workunit.client.1.smithi142.stdout:0/624: dread d10/d6c/d88/d21/f3c [0,4194304] 0 2024-09-13T02:52:43.868 INFO:tasks.workunit.client.0.smithi098.stdout:1/251: mkdir d9/d12/d60 0 2024-09-13T02:52:43.869 INFO:tasks.workunit.client.0.smithi098.stdout:1/252: dread - d9/d33/d19/f2e zero size 2024-09-13T02:52:43.872 INFO:tasks.workunit.client.1.smithi142.stdout:3/605: creat d12/d16/d25/d2e/d48/d5c/d8c/daf/fbe x:0 0 0 2024-09-13T02:52:43.872 INFO:tasks.workunit.client.0.smithi098.stdout:1/253: dread d9/d33/d19/f21 [0,4194304] 0 2024-09-13T02:52:43.874 INFO:tasks.workunit.client.1.smithi142.stdout:1/699: dread d12/d13/d20/d66/d55/f7f [0,4194304] 0 2024-09-13T02:52:43.874 INFO:tasks.workunit.client.1.smithi142.stdout:4/602: mknod d0/d2b/d2d/d31/cbc 0 2024-09-13T02:52:43.877 INFO:tasks.workunit.client.1.smithi142.stdout:6/692: mknod d1/dd/d57/d7b/ceb 0 2024-09-13T02:52:43.879 INFO:tasks.workunit.client.1.smithi142.stdout:0/625: write d10/d6c/d88/d21/f3c [2248131,107305] 0 2024-09-13T02:52:43.880 INFO:tasks.workunit.client.0.smithi098.stdout:1/254: mkdir d9/d12/d60/d61 0 2024-09-13T02:52:43.881 INFO:tasks.workunit.client.0.smithi098.stdout:1/255: chown d9/d33/d19/d35/d5a/d5f 208 1 2024-09-13T02:52:43.883 INFO:tasks.workunit.client.0.smithi098.stdout:7/374: dwrite d6/d1e/f36 [0,4194304] 0 2024-09-13T02:52:43.884 INFO:tasks.workunit.client.0.smithi098.stdout:7/375: read - d6/f5d zero size 2024-09-13T02:52:43.885 INFO:tasks.workunit.client.1.smithi142.stdout:8/519: mkdir d0/da2 0 2024-09-13T02:52:43.888 INFO:tasks.workunit.client.0.smithi098.stdout:1/256: symlink d9/d33/d1f/d23/d30/l62 0 2024-09-13T02:52:43.888 INFO:tasks.workunit.client.0.smithi098.stdout:1/257: stat d9/d33/d19/f27 0 2024-09-13T02:52:43.891 INFO:tasks.workunit.client.0.smithi098.stdout:7/376: rename d6/d24/d2a/d5a/c20 to d6/d24/d2a/d5a/d4c/c77 0 2024-09-13T02:52:43.893 INFO:tasks.workunit.client.1.smithi142.stdout:0/626: dread d10/d6c/d88/f46 [0,4194304] 0 2024-09-13T02:52:43.893 INFO:tasks.workunit.client.1.smithi142.stdout:4/603: rmdir d0/d2b 39 2024-09-13T02:52:43.893 INFO:tasks.workunit.client.1.smithi142.stdout:0/627: chown d10/d6c/d88/f46 45825422 1 2024-09-13T02:52:43.899 INFO:tasks.workunit.client.1.smithi142.stdout:6/693: unlink d1/d7/d19/d48/d90/f9e 0 2024-09-13T02:52:43.901 INFO:tasks.workunit.client.0.smithi098.stdout:7/377: dwrite d6/f5d [0,4194304] 0 2024-09-13T02:52:43.905 INFO:tasks.workunit.client.0.smithi098.stdout:7/378: chown d6/l18 6959888 1 2024-09-13T02:52:43.905 INFO:tasks.workunit.client.0.smithi098.stdout:1/258: dwrite d9/d33/d19/f50 [0,4194304] 0 2024-09-13T02:52:43.907 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:43 smithi142 ceph-mon[33443]: Upgrade: Updating mgr.smithi098.ukgenf 2024-09-13T02:52:43.907 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:43 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:43.907 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:43 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.ukgenf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:52:43.907 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:43 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.ukgenf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:52:43.907 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:43 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:52:43.908 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:43 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:43.908 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:43 smithi142 ceph-mon[33443]: Deploying daemon mgr.smithi098.ukgenf on smithi098 2024-09-13T02:52:43.908 INFO:tasks.workunit.client.1.smithi142.stdout:7/604: rename d10/d34/d65/cbc to d10/d13/d1d/d2b/d55/cc9 0 2024-09-13T02:52:43.908 INFO:tasks.workunit.client.1.smithi142.stdout:1/700: fdatasync d12/f65 0 2024-09-13T02:52:43.910 INFO:tasks.workunit.client.1.smithi142.stdout:1/701: dread - d12/d13/d20/d27/d3c/fa2 zero size 2024-09-13T02:52:43.910 INFO:tasks.workunit.client.0.smithi098.stdout:7/379: truncate d6/d24/d2a/d5a/d42/f71 435427 0 2024-09-13T02:52:43.910 INFO:tasks.workunit.client.0.smithi098.stdout:0/222: dwrite dd/df/d1d/d26/d28/f30 [0,4194304] 0 2024-09-13T02:52:43.912 INFO:tasks.workunit.client.0.smithi098.stdout:1/259: mkdir d9/d33/d19/d35/d63 0 2024-09-13T02:52:43.912 INFO:tasks.workunit.client.0.smithi098.stdout:0/223: write dd/df/d1d/d26/d28/f30 [2711879,130120] 0 2024-09-13T02:52:43.913 INFO:tasks.workunit.client.1.smithi142.stdout:1/702: write d12/d13/d20/d27/d3c/fb9 [454985,57931] 0 2024-09-13T02:52:43.920 INFO:tasks.workunit.client.0.smithi098.stdout:0/224: dread fc [4194304,4194304] 0 2024-09-13T02:52:43.920 INFO:tasks.workunit.client.0.smithi098.stdout:0/225: dread - dd/df/f3d zero size 2024-09-13T02:52:43.922 INFO:tasks.workunit.client.1.smithi142.stdout:9/733: write dd/d17/d44/fa0 [520702,104567] 0 2024-09-13T02:52:43.923 INFO:tasks.workunit.client.1.smithi142.stdout:8/520: symlink d0/d6/la3 0 2024-09-13T02:52:43.925 INFO:tasks.workunit.client.0.smithi098.stdout:7/380: unlink c1 0 2024-09-13T02:52:43.927 INFO:tasks.workunit.client.1.smithi142.stdout:3/606: rename d12/d16/f3e to d12/d16/d3c/d79/d9e/fbf 0 2024-09-13T02:52:43.928 INFO:tasks.workunit.client.1.smithi142.stdout:2/515: dwrite d1/de/d1f/d13/f2a [0,4194304] 0 2024-09-13T02:52:43.931 INFO:tasks.workunit.client.1.smithi142.stdout:7/605: dread d10/d64/f7c [0,4194304] 0 2024-09-13T02:52:43.935 INFO:tasks.workunit.client.1.smithi142.stdout:5/676: dwrite d8/f19 [0,4194304] 0 2024-09-13T02:52:43.937 INFO:tasks.workunit.client.1.smithi142.stdout:0/628: symlink d10/d6c/d88/d1a/d62/lcb 0 2024-09-13T02:52:43.939 INFO:tasks.workunit.client.0.smithi098.stdout:0/226: unlink c5 0 2024-09-13T02:52:43.946 INFO:tasks.workunit.client.0.smithi098.stdout:7/381: creat d6/f78 x:0 0 0 2024-09-13T02:52:43.949 INFO:tasks.workunit.client.0.smithi098.stdout:1/260: truncate f1 1597221 0 2024-09-13T02:52:43.950 INFO:tasks.workunit.client.1.smithi142.stdout:8/521: dwrite d0/d6/dc/f18 [4194304,4194304] 0 2024-09-13T02:52:43.956 INFO:tasks.workunit.client.1.smithi142.stdout:3/607: rename d12/d16/d25/d2e/d38/d4d/f69 to d12/d16/d25/d2e/d38/d4d/fc0 0 2024-09-13T02:52:43.958 INFO:tasks.workunit.client.1.smithi142.stdout:6/694: truncate d1/fd7 139445 0 2024-09-13T02:52:43.958 INFO:tasks.workunit.client.0.smithi098.stdout:7/382: fdatasync d6/f15 0 2024-09-13T02:52:43.963 INFO:tasks.workunit.client.0.smithi098.stdout:1/261: truncate d9/d33/d19/f21 153786 0 2024-09-13T02:52:43.964 INFO:tasks.workunit.client.1.smithi142.stdout:3/608: dread d12/d16/d25/d2e/f49 [0,4194304] 0 2024-09-13T02:52:43.965 INFO:tasks.workunit.client.1.smithi142.stdout:3/609: stat d12/d16/d3c/d79/d9b 0 2024-09-13T02:52:43.967 INFO:tasks.workunit.client.1.smithi142.stdout:7/606: unlink d10/d13/d1d/d25/d45/d6d/dc3/l61 0 2024-09-13T02:52:43.967 INFO:tasks.workunit.client.0.smithi098.stdout:0/227: getdents dd/df/d1d/d26/d28/d32 0 2024-09-13T02:52:43.969 INFO:tasks.workunit.client.1.smithi142.stdout:5/677: creat d8/d47/d65/fd6 x:0 0 0 2024-09-13T02:52:43.970 INFO:tasks.workunit.client.1.smithi142.stdout:7/607: dread - d10/d13/d1d/d2b/dae/f8f zero size 2024-09-13T02:52:43.971 INFO:tasks.workunit.client.1.smithi142.stdout:0/629: symlink d10/d6c/d88/d21/d51/d35/lcc 0 2024-09-13T02:52:43.972 INFO:tasks.workunit.client.1.smithi142.stdout:8/522: dread d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:43.973 INFO:tasks.workunit.client.1.smithi142.stdout:7/608: readlink d10/d13/d1d/d25/d5c/lb6 0 2024-09-13T02:52:43.974 INFO:tasks.workunit.client.1.smithi142.stdout:8/523: chown d0 0 1 2024-09-13T02:52:43.974 INFO:tasks.workunit.client.1.smithi142.stdout:3/610: dwrite d12/d16/d25/d2e/d48/d5c/f44 [0,4194304] 0 2024-09-13T02:52:43.974 INFO:tasks.workunit.client.1.smithi142.stdout:5/678: write d8/d47/d65/da0/dd1/f60 [1583765,87631] 0 2024-09-13T02:52:43.975 INFO:tasks.workunit.client.1.smithi142.stdout:9/734: truncate dd/d17/d4f/d91/f93 3323064 0 2024-09-13T02:52:43.977 INFO:tasks.workunit.client.1.smithi142.stdout:5/679: read f0 [1101375,52330] 0 2024-09-13T02:52:43.977 INFO:tasks.workunit.client.1.smithi142.stdout:8/524: chown d0/d6/dc/d45/d8/df/c31 250 1 2024-09-13T02:52:43.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:43 smithi098 ceph-mon[27886]: Upgrade: Updating mgr.smithi098.ukgenf 2024-09-13T02:52:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:43 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:52:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:43 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.ukgenf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:52:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:43 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.ukgenf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:52:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:43 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:52:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:43 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:43 smithi098 ceph-mon[27886]: Deploying daemon mgr.smithi098.ukgenf on smithi098 2024-09-13T02:52:43.984 INFO:tasks.workunit.client.0.smithi098.stdout:0/228: write dd/f24 [1780200,127954] 0 2024-09-13T02:52:43.985 INFO:tasks.workunit.client.1.smithi142.stdout:2/516: creat d1/de/da6/fa7 x:0 0 0 2024-09-13T02:52:43.993 INFO:tasks.workunit.client.0.smithi098.stdout:7/383: truncate d6/d24/d2a/d5a/d4c/f6a 3800186 0 2024-09-13T02:52:43.999 INFO:tasks.workunit.client.0.smithi098.stdout:7/384: dread d6/d49/f54 [0,4194304] 0 2024-09-13T02:52:44.001 INFO:tasks.workunit.client.1.smithi142.stdout:0/630: symlink d10/d6c/d88/d1a/d62/lcd 0 2024-09-13T02:52:44.001 INFO:tasks.workunit.client.1.smithi142.stdout:0/631: stat d10/d6c/d88/d30 0 2024-09-13T02:52:44.002 INFO:tasks.workunit.client.0.smithi098.stdout:1/262: getdents d9/d33/d1f/d23/d30 0 2024-09-13T02:52:44.004 INFO:tasks.workunit.client.0.smithi098.stdout:0/229: write f8 [954933,95345] 0 2024-09-13T02:52:44.007 INFO:tasks.workunit.client.0.smithi098.stdout:0/230: creat dd/df/d1d/f43 x:0 0 0 2024-09-13T02:52:44.009 INFO:tasks.workunit.client.1.smithi142.stdout:5/680: creat d8/d47/d65/da0/dd1/d45/dc5/fd7 x:0 0 0 2024-09-13T02:52:44.009 INFO:tasks.workunit.client.1.smithi142.stdout:5/681: fdatasync d8/d47/d65/da0/dd1/d45/d81/d82/f93 0 2024-09-13T02:52:44.010 INFO:tasks.workunit.client.1.smithi142.stdout:1/703: rename d12/d13/d20/d66/d55/f47 to d12/fdb 0 2024-09-13T02:52:44.011 INFO:tasks.workunit.client.0.smithi098.stdout:0/231: creat dd/df/d1d/d26/f44 x:0 0 0 2024-09-13T02:52:44.012 INFO:tasks.workunit.client.0.smithi098.stdout:7/385: rmdir d6/d24/d46/d75 0 2024-09-13T02:52:44.013 INFO:tasks.workunit.client.0.smithi098.stdout:0/232: readlink l6 0 2024-09-13T02:52:44.013 INFO:tasks.workunit.client.0.smithi098.stdout:0/233: readlink dd/l35 0 2024-09-13T02:52:44.014 INFO:tasks.workunit.client.1.smithi142.stdout:6/695: fdatasync d1/fd7 0 2024-09-13T02:52:44.015 INFO:tasks.workunit.client.1.smithi142.stdout:4/604: getdents d0/d2b/d75 0 2024-09-13T02:52:44.017 INFO:tasks.workunit.client.1.smithi142.stdout:3/611: fdatasync d12/d16/d25/d2e/d38/f6d 0 2024-09-13T02:52:44.018 INFO:tasks.workunit.client.1.smithi142.stdout:3/612: write d12/f22 [4100324,34897] 0 2024-09-13T02:52:44.019 INFO:tasks.workunit.client.0.smithi098.stdout:7/386: rename d6/c12 to d6/d24/d2a/d48/c79 0 2024-09-13T02:52:44.053 INFO:tasks.workunit.client.1.smithi142.stdout:7/609: link d10/fb2 d10/d13/d1d/d2b/d40/fca 0 2024-09-13T02:52:44.063 INFO:tasks.workunit.client.1.smithi142.stdout:7/610: dread d10/d13/d1d/d25/d45/d6d/dc3/f4e [0,4194304] 0 2024-09-13T02:52:44.064 INFO:tasks.workunit.client.1.smithi142.stdout:7/611: write d10/d13/d1d/d25/d45/d6d/dc3/f43 [1128536,105926] 0 2024-09-13T02:52:44.070 INFO:tasks.workunit.client.1.smithi142.stdout:7/612: dwrite d10/d13/d1d/d2b/d56/d5f/d73/f91 [0,4194304] 0 2024-09-13T02:52:44.096 INFO:tasks.workunit.client.1.smithi142.stdout:9/735: creat dd/d17/d44/d82/d99/daf/dc9/d103/f10c x:0 0 0 2024-09-13T02:52:44.097 INFO:tasks.workunit.client.1.smithi142.stdout:9/736: write dd/d17/d69/d84/d41/f83 [3701720,116687] 0 2024-09-13T02:52:44.098 INFO:tasks.workunit.client.1.smithi142.stdout:7/613: dread d10/f42 [0,4194304] 0 2024-09-13T02:52:44.098 INFO:tasks.workunit.client.1.smithi142.stdout:9/737: chown dd/d87/ce5 29278953 1 2024-09-13T02:52:44.103 INFO:tasks.workunit.client.1.smithi142.stdout:7/614: dwrite d10/d13/d1d/d44/f89 [0,4194304] 0 2024-09-13T02:52:44.108 INFO:tasks.workunit.client.1.smithi142.stdout:5/682: mknod d8/d47/d65/da0/dd1/d63/cd8 0 2024-09-13T02:52:44.109 INFO:tasks.workunit.client.1.smithi142.stdout:5/683: dread - d8/d47/d65/da0/dd1/d45/dc5/fcc zero size 2024-09-13T02:52:44.113 INFO:tasks.workunit.client.1.smithi142.stdout:0/632: rename d10/d6c/d88/d21/d51/d35/d9b/da5/fc3 to d10/d6c/d88/d1a/d3a/fce 0 2024-09-13T02:52:44.115 INFO:tasks.workunit.client.0.smithi098.stdout:7/387: symlink d6/d1e/l7a 0 2024-09-13T02:52:44.116 INFO:tasks.workunit.client.1.smithi142.stdout:0/633: read d10/d6c/d88/d1a/d1e/d42/f77 [3438440,111648] 0 2024-09-13T02:52:44.117 INFO:tasks.workunit.client.1.smithi142.stdout:0/634: dread d10/d6c/d88/d1a/f66 [0,4194304] 0 2024-09-13T02:52:44.123 INFO:tasks.workunit.client.1.smithi142.stdout:2/517: unlink d1/f1e 0 2024-09-13T02:52:44.123 INFO:tasks.workunit.client.1.smithi142.stdout:2/518: stat d1/d2d/fa0 0 2024-09-13T02:52:44.125 INFO:tasks.workunit.client.0.smithi098.stdout:7/388: symlink d6/d24/d2a/d5a/d4c/l7b 0 2024-09-13T02:52:44.134 INFO:tasks.workunit.client.0.smithi098.stdout:7/389: mknod d6/d24/d2a/d5a/d42/d45/d73/c7c 0 2024-09-13T02:52:44.138 INFO:tasks.workunit.client.1.smithi142.stdout:3/613: mkdir d12/d16/d3c/d79/d9b/dc1 0 2024-09-13T02:52:44.155 INFO:tasks.workunit.client.1.smithi142.stdout:8/525: unlink d0/d6/dc/d40/d46/f5a 0 2024-09-13T02:52:44.161 INFO:tasks.workunit.client.1.smithi142.stdout:0/635: chown d10/d6c/d88/d1a/f22 955956503 1 2024-09-13T02:52:44.165 INFO:tasks.workunit.client.1.smithi142.stdout:2/519: mkdir d1/de/d31/d6c/d6d/d47/da8 0 2024-09-13T02:52:44.167 INFO:tasks.workunit.client.1.smithi142.stdout:9/738: dread dd/fe [0,4194304] 0 2024-09-13T02:52:44.173 INFO:tasks.workunit.client.0.smithi098.stdout:0/234: rename dd/df/d1d/d26/f36 to dd/f45 0 2024-09-13T02:52:44.174 INFO:tasks.workunit.client.1.smithi142.stdout:8/526: dread d0/d6/dc/d45/d8/f36 [0,4194304] 0 2024-09-13T02:52:44.178 INFO:tasks.workunit.client.1.smithi142.stdout:0/636: rmdir d10/d6c/d88/d21/d51 39 2024-09-13T02:52:44.180 INFO:tasks.workunit.client.1.smithi142.stdout:1/704: fsync d12/d13/d20/d66/d55/db4/fbc 0 2024-09-13T02:52:44.181 INFO:tasks.workunit.client.1.smithi142.stdout:2/520: mkdir d1/de/d1f/d13/d60/da9 0 2024-09-13T02:52:44.188 INFO:tasks.workunit.client.1.smithi142.stdout:1/705: chown d12/d13/d20/d27/d3c/d71/d96/cd8 216592 1 2024-09-13T02:52:44.189 INFO:tasks.workunit.client.1.smithi142.stdout:2/521: mkdir d1/d29/d72/daa 0 2024-09-13T02:52:44.191 INFO:tasks.workunit.client.1.smithi142.stdout:0/637: mkdir d10/d95/dcf 0 2024-09-13T02:52:44.191 INFO:tasks.workunit.client.1.smithi142.stdout:0/638: chown cc 67 1 2024-09-13T02:52:44.191 INFO:tasks.workunit.client.1.smithi142.stdout:0/639: chown d10/d6c/d88/d1a/d1e/d42/d4b/d85/caa 218778754 1 2024-09-13T02:52:44.196 INFO:tasks.workunit.client.1.smithi142.stdout:0/640: creat d10/d6c/d88/d1a/d62/fd0 x:0 0 0 2024-09-13T02:52:44.201 INFO:tasks.workunit.client.1.smithi142.stdout:0/641: symlink d10/dbf/ld1 0 2024-09-13T02:52:44.202 INFO:tasks.workunit.client.1.smithi142.stdout:8/527: creat d0/d6/dc/d45/d35/fa4 x:0 0 0 2024-09-13T02:52:44.206 INFO:tasks.workunit.client.1.smithi142.stdout:0/642: dwrite d10/d23/f2f [0,4194304] 0 2024-09-13T02:52:44.210 INFO:tasks.workunit.client.1.smithi142.stdout:8/528: link d0/d6/la3 d0/d6/dc/d40/la5 0 2024-09-13T02:52:44.219 INFO:tasks.workunit.client.1.smithi142.stdout:8/529: link d0/l3f d0/d6/dc/d40/la6 0 2024-09-13T02:52:44.219 INFO:tasks.workunit.client.1.smithi142.stdout:8/530: chown d0/d6/d23/f3d 18 1 2024-09-13T02:52:44.221 INFO:tasks.workunit.client.1.smithi142.stdout:8/531: fdatasync d0/d6/d23/f3d 0 2024-09-13T02:52:44.224 INFO:tasks.workunit.client.1.smithi142.stdout:8/532: stat d0/d6/dc/d40/d41 0 2024-09-13T02:52:44.225 INFO:tasks.workunit.client.1.smithi142.stdout:4/605: unlink d0/d2b/d21/d35/f6a 0 2024-09-13T02:52:44.227 INFO:tasks.workunit.client.1.smithi142.stdout:8/533: mknod d0/d6/dc/d45/d35/d93/ca7 0 2024-09-13T02:52:44.229 INFO:tasks.workunit.client.1.smithi142.stdout:4/606: rename d0/d2b/d21/f7d to d0/d2b/d2d/d31/d43/fbd 0 2024-09-13T02:52:44.257 INFO:tasks.workunit.client.0.smithi098.stdout:9/186: sync 2024-09-13T02:52:44.259 INFO:tasks.workunit.client.0.smithi098.stdout:9/187: truncate d2/d6/f19 261917 0 2024-09-13T02:52:44.260 INFO:tasks.workunit.client.0.smithi098.stdout:9/188: chown d2/dd/f20 47599739 1 2024-09-13T02:52:44.263 INFO:tasks.workunit.client.0.smithi098.stdout:9/189: creat d2/d6/d2b/f47 x:0 0 0 2024-09-13T02:52:44.265 INFO:tasks.workunit.client.0.smithi098.stdout:9/190: chown d2/d6/d36 445809498 1 2024-09-13T02:52:44.266 INFO:tasks.workunit.client.0.smithi098.stdout:9/191: stat d2/dd/d39/c3f 0 2024-09-13T02:52:44.267 INFO:tasks.workunit.client.0.smithi098.stdout:9/192: write d2/f10 [1786572,97389] 0 2024-09-13T02:52:44.268 INFO:tasks.workunit.client.1.smithi142.stdout:5/684: creat d8/dc3/d3f/fd9 x:0 0 0 2024-09-13T02:52:44.272 INFO:tasks.workunit.client.0.smithi098.stdout:7/390: truncate d6/d24/d2a/d57/f61 82514 0 2024-09-13T02:52:44.273 INFO:tasks.workunit.client.0.smithi098.stdout:9/193: dwrite d2/d6/f19 [0,4194304] 0 2024-09-13T02:52:44.275 INFO:tasks.workunit.client.1.smithi142.stdout:6/696: mkdir d1/d7/d5f/dec 0 2024-09-13T02:52:44.283 INFO:tasks.workunit.client.0.smithi098.stdout:9/194: rename d2/d6/d2b/l40 to d2/dd/d39/d43/l48 0 2024-09-13T02:52:44.288 INFO:tasks.workunit.client.1.smithi142.stdout:2/522: symlink d1/de/d31/d6c/d6d/lab 0 2024-09-13T02:52:44.294 INFO:tasks.workunit.client.1.smithi142.stdout:5/685: creat d8/dc3/d3f/d4a/fda x:0 0 0 2024-09-13T02:52:44.298 INFO:tasks.workunit.client.1.smithi142.stdout:2/523: creat d1/d2c/d92/fac x:0 0 0 2024-09-13T02:52:44.299 INFO:tasks.workunit.client.1.smithi142.stdout:5/686: mknod d8/d47/d65/da0/dd1/d45/d8e/cdb 0 2024-09-13T02:52:44.300 INFO:tasks.workunit.client.1.smithi142.stdout:7/615: truncate d10/d34/f38 2193060 0 2024-09-13T02:52:44.300 INFO:tasks.workunit.client.1.smithi142.stdout:7/616: dread - d10/d34/d57/d98/fb7 zero size 2024-09-13T02:52:44.300 INFO:tasks.workunit.client.1.smithi142.stdout:7/617: dread - d10/d64/fc5 zero size 2024-09-13T02:52:44.303 INFO:tasks.workunit.client.1.smithi142.stdout:9/739: write dd/d17/d44/f5c [549069,113787] 0 2024-09-13T02:52:44.304 INFO:tasks.workunit.client.0.smithi098.stdout:0/235: truncate dd/f10 2637045 0 2024-09-13T02:52:44.305 INFO:tasks.workunit.client.1.smithi142.stdout:6/697: creat d1/dd/d16/d47/dad/fed x:0 0 0 2024-09-13T02:52:44.308 INFO:tasks.workunit.client.0.smithi098.stdout:0/236: write dd/df/d1d/f34 [1016464,83959] 0 2024-09-13T02:52:44.308 INFO:tasks.workunit.client.1.smithi142.stdout:2/524: symlink d1/d42/d44/d99/lad 0 2024-09-13T02:52:44.310 INFO:tasks.workunit.client.1.smithi142.stdout:9/740: symlink dd/d17/d44/d82/d99/daf/dc9/d103/l10d 0 2024-09-13T02:52:44.311 INFO:tasks.workunit.client.1.smithi142.stdout:2/525: dread d1/de/f23 [0,4194304] 0 2024-09-13T02:52:44.312 INFO:tasks.workunit.client.0.smithi098.stdout:0/237: truncate dd/f24 2859619 0 2024-09-13T02:52:44.313 INFO:tasks.workunit.client.1.smithi142.stdout:6/698: mkdir d1/dd/d16/d4e/dee 0 2024-09-13T02:52:44.315 INFO:tasks.workunit.client.1.smithi142.stdout:1/706: truncate d12/d13/d20/d66/d55/da0/fb2 4271101 0 2024-09-13T02:52:44.317 INFO:tasks.workunit.client.0.smithi098.stdout:0/238: mkdir dd/df/d1d/d40/d46 0 2024-09-13T02:52:44.320 INFO:tasks.workunit.client.0.smithi098.stdout:0/239: readlink dd/l12 0 2024-09-13T02:52:44.321 INFO:tasks.workunit.client.1.smithi142.stdout:6/699: symlink d1/d7/d5f/d6a/lef 0 2024-09-13T02:52:44.322 INFO:tasks.workunit.client.1.smithi142.stdout:7/618: rename d10/d34/f5a to d10/d64/fcb 0 2024-09-13T02:52:44.324 INFO:tasks.workunit.client.0.smithi098.stdout:0/240: rename dd/df/f3c to dd/df/d1d/d40/d46/f47 0 2024-09-13T02:52:44.326 INFO:tasks.workunit.client.1.smithi142.stdout:2/526: creat d1/d29/d72/daa/fae x:0 0 0 2024-09-13T02:52:44.327 INFO:tasks.workunit.client.1.smithi142.stdout:6/700: symlink d1/d7/d42/lf0 0 2024-09-13T02:52:44.327 INFO:tasks.workunit.client.1.smithi142.stdout:7/619: dwrite d10/d13/d1d/d44/f89 [4194304,4194304] 0 2024-09-13T02:52:44.328 INFO:tasks.workunit.client.0.smithi098.stdout:0/241: mknod dd/df/d1d/d26/d37/c48 0 2024-09-13T02:52:44.328 INFO:tasks.workunit.client.1.smithi142.stdout:6/701: dread - d1/dd/d16/d4d/fe9 zero size 2024-09-13T02:52:44.329 INFO:tasks.workunit.client.1.smithi142.stdout:6/702: stat d1/d7/d5f/ldf 0 2024-09-13T02:52:44.330 INFO:tasks.workunit.client.0.smithi098.stdout:0/242: dread - dd/f2d zero size 2024-09-13T02:52:44.333 INFO:tasks.workunit.client.1.smithi142.stdout:7/620: symlink d10/d13/d1d/d25/d45/d92/lcc 0 2024-09-13T02:52:44.335 INFO:tasks.workunit.client.0.smithi098.stdout:0/243: creat dd/df/d1d/d26/d28/d32/f49 x:0 0 0 2024-09-13T02:52:44.337 INFO:tasks.workunit.client.1.smithi142.stdout:7/621: creat d10/d64/fcd x:0 0 0 2024-09-13T02:52:44.338 INFO:tasks.workunit.client.1.smithi142.stdout:8/534: truncate d0/f4c 796908 0 2024-09-13T02:52:44.340 INFO:tasks.workunit.client.1.smithi142.stdout:4/607: write d0/d2b/d2d/d31/d43/d48/f4d [3384752,54065] 0 2024-09-13T02:52:44.341 INFO:tasks.workunit.client.1.smithi142.stdout:0/643: sync 2024-09-13T02:52:44.341 INFO:tasks.workunit.client.1.smithi142.stdout:4/608: chown d0/d2b/d2d/f9d 46871803 1 2024-09-13T02:52:44.342 INFO:tasks.workunit.client.1.smithi142.stdout:6/703: creat d1/d7/d19/ff1 x:0 0 0 2024-09-13T02:52:44.343 INFO:tasks.workunit.client.0.smithi098.stdout:0/244: symlink dd/l4a 0 2024-09-13T02:52:44.343 INFO:tasks.workunit.client.1.smithi142.stdout:8/535: mknod d0/d82/ca8 0 2024-09-13T02:52:44.345 INFO:tasks.workunit.client.1.smithi142.stdout:6/704: read d1/d7/f2a [991220,123110] 0 2024-09-13T02:52:44.346 INFO:tasks.workunit.client.1.smithi142.stdout:6/705: readlink d1/d7/d42/lbf 0 2024-09-13T02:52:44.346 INFO:tasks.workunit.client.1.smithi142.stdout:4/609: symlink d0/df/da5/dad/lbe 0 2024-09-13T02:52:44.347 INFO:tasks.workunit.client.1.smithi142.stdout:0/644: truncate d10/d6c/f6d 677888 0 2024-09-13T02:52:44.347 INFO:tasks.workunit.client.1.smithi142.stdout:4/610: fdatasync d0/d2b/d2d/d31/d43/fa9 0 2024-09-13T02:52:44.348 INFO:tasks.workunit.client.0.smithi098.stdout:0/245: mknod dd/d1f/c4b 0 2024-09-13T02:52:44.353 INFO:tasks.workunit.client.1.smithi142.stdout:6/706: creat d1/d7/d5f/ff2 x:0 0 0 2024-09-13T02:52:44.356 INFO:tasks.workunit.client.1.smithi142.stdout:0/645: mknod d10/d6c/d88/d1a/d1e/d42/d4b/d85/cd2 0 2024-09-13T02:52:44.357 INFO:tasks.workunit.client.0.smithi098.stdout:0/246: dread dd/df/d1d/f33 [0,4194304] 0 2024-09-13T02:52:44.357 INFO:tasks.workunit.client.1.smithi142.stdout:3/614: unlink d12/f19 0 2024-09-13T02:52:44.360 INFO:tasks.workunit.client.0.smithi098.stdout:0/247: symlink dd/df/d1d/d26/d28/l4c 0 2024-09-13T02:52:44.361 INFO:tasks.workunit.client.1.smithi142.stdout:6/707: rmdir d1/d7/d19/d48/d90 39 2024-09-13T02:52:44.362 INFO:tasks.workunit.client.1.smithi142.stdout:6/708: chown d1/d7/d5f/f68 305 1 2024-09-13T02:52:44.363 INFO:tasks.workunit.client.1.smithi142.stdout:4/611: mkdir d0/df/d57/dbf 0 2024-09-13T02:52:44.364 INFO:tasks.workunit.client.1.smithi142.stdout:4/612: read d0/d2b/f41 [708594,94615] 0 2024-09-13T02:52:44.364 INFO:tasks.workunit.client.0.smithi098.stdout:0/248: creat dd/df/d1d/d26/d28/d32/f4d x:0 0 0 2024-09-13T02:52:44.365 INFO:tasks.workunit.client.0.smithi098.stdout:0/249: chown dd/df/d1d/d26/d28/d32 224513 1 2024-09-13T02:52:44.365 INFO:tasks.workunit.client.1.smithi142.stdout:0/646: creat d10/d6c/d88/d21/daf/fd3 x:0 0 0 2024-09-13T02:52:44.366 INFO:tasks.workunit.client.1.smithi142.stdout:3/615: chown d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/db6 256266 1 2024-09-13T02:52:44.367 INFO:tasks.workunit.client.0.smithi098.stdout:0/250: mknod dd/df/d1d/d40/d46/c4e 0 2024-09-13T02:52:44.368 INFO:tasks.workunit.client.1.smithi142.stdout:6/709: symlink d1/d7/d19/d30/lf3 0 2024-09-13T02:52:44.369 INFO:tasks.workunit.client.1.smithi142.stdout:3/616: read d12/d16/d25/d2e/d38/f45 [310356,68986] 0 2024-09-13T02:52:44.369 INFO:tasks.workunit.client.1.smithi142.stdout:0/647: dread d10/d6c/d88/d21/f3c [0,4194304] 0 2024-09-13T02:52:44.370 INFO:tasks.workunit.client.1.smithi142.stdout:4/613: rename d0/d2b/d2d/d31/d43/fa4 to d0/df/da5/dad/fc0 0 2024-09-13T02:52:44.370 INFO:tasks.workunit.client.1.smithi142.stdout:3/617: chown d12/d16/d3c/d79/f83 11673 1 2024-09-13T02:52:44.371 INFO:tasks.workunit.client.0.smithi098.stdout:0/251: dread dd/d1f/f25 [0,4194304] 0 2024-09-13T02:52:44.373 INFO:tasks.workunit.client.1.smithi142.stdout:8/536: creat d0/d6/dc/d2e/fa9 x:0 0 0 2024-09-13T02:52:44.374 INFO:tasks.workunit.client.1.smithi142.stdout:8/537: chown d0/d80/d8c/f9a 1 1 2024-09-13T02:52:44.375 INFO:tasks.workunit.client.1.smithi142.stdout:8/538: stat d0/d6/dc/d45/d8/df/f99 0 2024-09-13T02:52:44.378 INFO:tasks.workunit.client.1.smithi142.stdout:0/648: creat d10/dbf/fd4 x:0 0 0 2024-09-13T02:52:44.379 INFO:tasks.workunit.client.1.smithi142.stdout:4/614: truncate d0/d2b/f38 2260402 0 2024-09-13T02:52:44.381 INFO:tasks.workunit.client.0.smithi098.stdout:0/252: creat dd/f4f x:0 0 0 2024-09-13T02:52:44.381 INFO:tasks.workunit.client.0.smithi098.stdout:0/253: read dd/df/d1d/f1a [4434802,63892] 0 2024-09-13T02:52:44.384 INFO:tasks.workunit.client.1.smithi142.stdout:8/539: mkdir d0/d6/d83/daa 0 2024-09-13T02:52:44.385 INFO:tasks.workunit.client.1.smithi142.stdout:6/710: dread d1/d7/d5f/d6a/f99 [0,4194304] 0 2024-09-13T02:52:44.386 INFO:tasks.workunit.client.1.smithi142.stdout:6/711: read d1/dd/d16/f2c [3341073,29653] 0 2024-09-13T02:52:44.386 INFO:tasks.workunit.client.1.smithi142.stdout:0/649: chown d10/d6c/d88/d1a/d1e/d42/d4b/f61 1836023 1 2024-09-13T02:52:44.390 INFO:tasks.workunit.client.1.smithi142.stdout:3/618: link d12/d16/d25/l84 d12/d16/d25/d2e/d48/d5c/d66/lc2 0 2024-09-13T02:52:44.391 INFO:tasks.workunit.client.1.smithi142.stdout:4/615: getdents d0/d2b/d2d/d31/d43/daf 0 2024-09-13T02:52:44.392 INFO:tasks.workunit.client.1.smithi142.stdout:6/712: truncate d1/dd/f29 788772 0 2024-09-13T02:52:44.392 INFO:tasks.workunit.client.1.smithi142.stdout:4/616: truncate d0/df/d57/f89 115849 0 2024-09-13T02:52:44.393 INFO:tasks.workunit.client.1.smithi142.stdout:0/650: fsync d10/d6c/d88/d1a/d7a/f81 0 2024-09-13T02:52:44.394 INFO:tasks.workunit.client.1.smithi142.stdout:3/619: mknod d12/d16/d25/d2e/d48/d5c/cc3 0 2024-09-13T02:52:44.395 INFO:tasks.workunit.client.0.smithi098.stdout:7/391: dwrite d6/d24/d2a/d5a/f1d [0,4194304] 0 2024-09-13T02:52:44.395 INFO:tasks.workunit.client.0.smithi098.stdout:9/195: getdents d2/dd/d39/d43 0 2024-09-13T02:52:44.397 INFO:tasks.workunit.client.0.smithi098.stdout:7/392: write d6/d24/d2a/d5a/f44 [1797484,45097] 0 2024-09-13T02:52:44.398 INFO:tasks.workunit.client.0.smithi098.stdout:7/393: read d6/d24/d2a/d5a/f38 [1952570,120383] 0 2024-09-13T02:52:44.399 INFO:tasks.workunit.client.1.smithi142.stdout:0/651: readlink d10/d6c/d88/d21/d51/d35/d9b/da5/lb5 0 2024-09-13T02:52:44.399 INFO:tasks.workunit.client.0.smithi098.stdout:9/196: readlink d2/dd/l13 0 2024-09-13T02:52:44.401 INFO:tasks.workunit.client.1.smithi142.stdout:3/620: dwrite d12/d16/d25/d2e/d48/d5c/f6e [0,4194304] 0 2024-09-13T02:52:44.408 INFO:tasks.workunit.client.1.smithi142.stdout:4/617: creat d0/df/d57/fc1 x:0 0 0 2024-09-13T02:52:44.409 INFO:tasks.workunit.client.0.smithi098.stdout:9/197: unlink d2/dd/d39/l27 0 2024-09-13T02:52:44.410 INFO:tasks.workunit.client.0.smithi098.stdout:9/198: write d2/dd/f20 [168850,9042] 0 2024-09-13T02:52:44.410 INFO:tasks.workunit.client.1.smithi142.stdout:4/618: dread - d0/d2b/d2d/d31/d32/fb1 zero size 2024-09-13T02:52:44.410 INFO:tasks.workunit.client.1.smithi142.stdout:0/652: dwrite d10/d6c/d88/d21/d8f/fa9 [0,4194304] 0 2024-09-13T02:52:44.418 INFO:tasks.workunit.client.1.smithi142.stdout:5/687: write d8/d47/d65/da0/dd1/d2d/d90/f6f [1506869,63434] 0 2024-09-13T02:52:44.422 INFO:tasks.workunit.client.0.smithi098.stdout:7/394: creat d6/d24/d2a/d48/f7d x:0 0 0 2024-09-13T02:52:44.426 INFO:tasks.workunit.client.1.smithi142.stdout:3/621: creat d12/d16/d25/d2e/d38/d4d/fc4 x:0 0 0 2024-09-13T02:52:44.426 INFO:tasks.workunit.client.1.smithi142.stdout:9/741: write dd/d17/d25/f33 [1123429,42194] 0 2024-09-13T02:52:44.430 INFO:tasks.workunit.client.1.smithi142.stdout:5/688: rename d8/d47/d65/da0/dd1/d63/cd8 to d8/d47/d65/da0/dd1/d2d/cdc 0 2024-09-13T02:52:44.431 INFO:tasks.workunit.client.1.smithi142.stdout:5/689: dread - d8/d47/d65/da0/dd1/f8a zero size 2024-09-13T02:52:44.435 INFO:tasks.workunit.client.0.smithi098.stdout:9/199: rename d2/d6/lf to d2/l49 0 2024-09-13T02:52:44.435 INFO:tasks.workunit.client.1.smithi142.stdout:1/707: truncate d12/d13/d45/fa8 3862139 0 2024-09-13T02:52:44.436 INFO:tasks.workunit.client.1.smithi142.stdout:2/527: write d1/d42/f55 [1004824,15845] 0 2024-09-13T02:52:44.436 INFO:tasks.workunit.client.0.smithi098.stdout:7/395: creat d6/d47/f7e x:0 0 0 2024-09-13T02:52:44.438 INFO:tasks.workunit.client.0.smithi098.stdout:7/396: write d6/d24/f3d [4755393,54869] 0 2024-09-13T02:52:44.438 INFO:tasks.workunit.client.1.smithi142.stdout:9/742: creat dd/d17/d69/f10e x:0 0 0 2024-09-13T02:52:44.444 INFO:tasks.workunit.client.1.smithi142.stdout:0/653: creat d10/d6c/d88/d1a/fd5 x:0 0 0 2024-09-13T02:52:44.449 INFO:tasks.workunit.client.1.smithi142.stdout:4/619: getdents d0/df 0 2024-09-13T02:52:44.449 INFO:tasks.workunit.client.1.smithi142.stdout:0/654: dread d10/d6c/d88/d21/d8f/fa9 [0,4194304] 0 2024-09-13T02:52:44.449 INFO:tasks.workunit.client.0.smithi098.stdout:9/200: symlink d2/d6/l4a 0 2024-09-13T02:52:44.450 INFO:tasks.workunit.client.1.smithi142.stdout:1/708: rmdir d12/d13/dd3 39 2024-09-13T02:52:44.453 INFO:tasks.workunit.client.1.smithi142.stdout:5/690: dread d8/d47/d65/da0/dd1/d61/f83 [0,4194304] 0 2024-09-13T02:52:44.454 INFO:tasks.workunit.client.1.smithi142.stdout:1/709: write d12/d13/d1d/f9c [3577673,126843] 0 2024-09-13T02:52:44.457 INFO:tasks.workunit.client.1.smithi142.stdout:7/622: dwrite d10/d13/d1d/d2b/d40/fa7 [0,4194304] 0 2024-09-13T02:52:44.459 INFO:tasks.workunit.client.1.smithi142.stdout:7/623: write d10/d13/d1d/d2b/d40/fa7 [4059924,122291] 0 2024-09-13T02:52:44.463 INFO:tasks.workunit.client.1.smithi142.stdout:9/743: dread dd/f36 [4194304,4194304] 0 2024-09-13T02:52:44.465 INFO:tasks.workunit.client.1.smithi142.stdout:2/528: dread d1/de/f22 [0,4194304] 0 2024-09-13T02:52:44.489 INFO:tasks.workunit.client.1.smithi142.stdout:2/529: dread d1/d29/f30 [0,4194304] 0 2024-09-13T02:52:44.489 INFO:tasks.workunit.client.1.smithi142.stdout:2/530: readlink d1/de/d31/d6c/d6d/l69 0 2024-09-13T02:52:44.530 INFO:tasks.workunit.client.1.smithi142.stdout:6/713: sync 2024-09-13T02:52:44.574 INFO:tasks.workunit.client.1.smithi142.stdout:7/624: mkdir d10/d13/d1d/d2b/d40/dce 0 2024-09-13T02:52:44.575 INFO:tasks.workunit.client.1.smithi142.stdout:9/744: unlink dd/d17/f26 0 2024-09-13T02:52:44.579 INFO:tasks.workunit.client.1.smithi142.stdout:6/714: mknod d1/d7/d42/d88/cf4 0 2024-09-13T02:52:44.580 INFO:tasks.workunit.client.1.smithi142.stdout:4/620: sync 2024-09-13T02:52:44.580 INFO:tasks.workunit.client.1.smithi142.stdout:5/691: mkdir d8/dc3/d3f/ddd 0 2024-09-13T02:52:44.587 INFO:tasks.workunit.client.1.smithi142.stdout:9/745: creat dd/d17/d4f/f10f x:0 0 0 2024-09-13T02:52:44.593 INFO:tasks.workunit.client.1.smithi142.stdout:6/715: mkdir d1/dd/d57/df5 0 2024-09-13T02:52:44.594 INFO:tasks.workunit.client.1.smithi142.stdout:6/716: dread - d1/dd/d16/d4e/d32/fe2 zero size 2024-09-13T02:52:44.594 INFO:tasks.workunit.client.1.smithi142.stdout:5/692: creat d8/fde x:0 0 0 2024-09-13T02:52:44.595 INFO:tasks.workunit.client.1.smithi142.stdout:1/710: creat d12/d13/d20/d27/d3c/d71/fdc x:0 0 0 2024-09-13T02:52:44.596 INFO:tasks.workunit.client.1.smithi142.stdout:1/711: read - d12/d13/d1d/fc6 zero size 2024-09-13T02:52:44.597 INFO:tasks.workunit.client.1.smithi142.stdout:1/712: dread - d12/d13/d20/d66/d55/da0/fcb zero size 2024-09-13T02:52:44.599 INFO:tasks.workunit.client.1.smithi142.stdout:6/717: write d1/d7/d19/d48/fa1 [711487,16262] 0 2024-09-13T02:52:44.599 INFO:tasks.workunit.client.1.smithi142.stdout:5/693: symlink d8/d47/d65/da0/ldf 0 2024-09-13T02:52:44.600 INFO:tasks.workunit.client.1.smithi142.stdout:9/746: dread dd/f1b [0,4194304] 0 2024-09-13T02:52:44.600 INFO:tasks.workunit.client.1.smithi142.stdout:6/718: fdatasync d1/d7/d42/d88/fd1 0 2024-09-13T02:52:44.601 INFO:tasks.workunit.client.1.smithi142.stdout:9/747: write dd/d17/d44/fa0 [1008554,52504] 0 2024-09-13T02:52:44.604 INFO:tasks.workunit.client.1.smithi142.stdout:4/621: link d0/d2b/d2d/d31/d32/d82/f92 d0/d2b/d2d/d31/d32/daa/fc2 0 2024-09-13T02:52:44.606 INFO:tasks.workunit.client.1.smithi142.stdout:8/540: rename d0/d6/dc/d40/d46/c47 to d0/d6/dc/d2e/cab 0 2024-09-13T02:52:44.606 INFO:tasks.workunit.client.1.smithi142.stdout:4/622: write d0/df/d57/f22 [4051988,127165] 0 2024-09-13T02:52:44.607 INFO:tasks.workunit.client.0.smithi098.stdout:0/254: dwrite dd/f10 [0,4194304] 0 2024-09-13T02:52:44.608 INFO:tasks.workunit.client.1.smithi142.stdout:6/719: dwrite d1/d7/d5f/d60/d76/d7e/fc3 [0,4194304] 0 2024-09-13T02:52:44.611 INFO:tasks.workunit.client.1.smithi142.stdout:1/713: mknod d12/cdd 0 2024-09-13T02:52:44.614 INFO:tasks.workunit.client.1.smithi142.stdout:5/694: creat d8/dc3/d3f/ddd/fe0 x:0 0 0 2024-09-13T02:52:44.619 INFO:tasks.workunit.client.1.smithi142.stdout:3/622: write d12/d16/d3c/d79/f83 [106467,49762] 0 2024-09-13T02:52:44.626 INFO:tasks.workunit.client.1.smithi142.stdout:1/714: symlink d12/d13/d1d/d26/d4f/da9/lde 0 2024-09-13T02:52:44.628 INFO:tasks.workunit.client.1.smithi142.stdout:5/695: rename d8/dc3/d3f/d4a/f7a to d8/d47/d65/da0/dd1/d45/d8e/dc6/fe1 0 2024-09-13T02:52:44.629 INFO:tasks.workunit.client.1.smithi142.stdout:3/623: rmdir d12/d16/d3c/d7d 39 2024-09-13T02:52:44.630 INFO:tasks.workunit.client.1.smithi142.stdout:6/720: dread d1/dd/d16/f4c [0,4194304] 0 2024-09-13T02:52:44.631 INFO:tasks.workunit.client.1.smithi142.stdout:0/655: write d10/d6c/d88/d1a/f22 [2140517,55635] 0 2024-09-13T02:52:44.632 INFO:tasks.workunit.client.1.smithi142.stdout:6/721: chown d1/dd/d16/d4d/c5e 26412073 1 2024-09-13T02:52:44.634 INFO:tasks.workunit.client.1.smithi142.stdout:1/715: dread d12/d13/d20/d66/d7d/f85 [0,4194304] 0 2024-09-13T02:52:44.635 INFO:tasks.workunit.client.1.smithi142.stdout:0/656: stat d10/d6c/d88/d1a/c20 0 2024-09-13T02:52:44.637 INFO:tasks.workunit.client.1.smithi142.stdout:4/623: dread d0/d2b/d21/d35/f5f [0,4194304] 0 2024-09-13T02:52:44.638 INFO:tasks.workunit.client.1.smithi142.stdout:3/624: fsync d12/d16/d3c/d79/fab 0 2024-09-13T02:52:44.639 INFO:tasks.workunit.client.1.smithi142.stdout:3/625: write d12/d16/d25/d2e/d38/d4d/d53/faa [29440,92358] 0 2024-09-13T02:52:44.640 INFO:tasks.workunit.client.1.smithi142.stdout:1/716: readlink d12/d13/d1d/l4a 0 2024-09-13T02:52:44.642 INFO:tasks.workunit.client.1.smithi142.stdout:1/717: dread d12/d13/d20/d66/d55/db4/fbc [0,4194304] 0 2024-09-13T02:52:44.644 INFO:tasks.workunit.client.1.smithi142.stdout:0/657: unlink d10/d6c/d88/d21/d51/d35/f55 0 2024-09-13T02:52:44.645 INFO:tasks.workunit.client.1.smithi142.stdout:0/658: write d10/d6c/d88/d1a/f22 [8185286,48877] 0 2024-09-13T02:52:44.645 INFO:tasks.workunit.client.1.smithi142.stdout:0/659: readlink d10/d6c/d88/d30/lbb 0 2024-09-13T02:52:44.647 INFO:tasks.workunit.client.1.smithi142.stdout:4/624: creat d0/d2b/d2d/d31/d43/d48/fc3 x:0 0 0 2024-09-13T02:52:44.651 INFO:tasks.workunit.client.1.smithi142.stdout:3/626: creat d12/d16/d25/d2e/d38/d4d/d53/d78/fc5 x:0 0 0 2024-09-13T02:52:44.651 INFO:tasks.workunit.client.0.smithi098.stdout:8/209: sync 2024-09-13T02:52:44.652 INFO:tasks.workunit.client.1.smithi142.stdout:2/531: dwrite d1/d2c/f51 [0,4194304] 0 2024-09-13T02:52:44.654 INFO:tasks.workunit.client.1.smithi142.stdout:7/625: write d10/d13/d1d/f36 [113707,119976] 0 2024-09-13T02:52:44.659 INFO:tasks.workunit.client.0.smithi098.stdout:8/210: symlink d2/dd/l40 0 2024-09-13T02:52:44.662 INFO:tasks.workunit.client.1.smithi142.stdout:0/660: rename d10/d6c/d88/d1a/d7a/f81 to d10/dbf/fd6 0 2024-09-13T02:52:44.663 INFO:tasks.workunit.client.1.smithi142.stdout:4/625: dread d0/df/d57/f88 [0,4194304] 0 2024-09-13T02:52:44.664 INFO:tasks.workunit.client.1.smithi142.stdout:5/696: getdents d8/d47/d65/da0/dd1/d45/d62 0 2024-09-13T02:52:44.666 INFO:tasks.workunit.client.0.smithi098.stdout:8/211: creat d2/f41 x:0 0 0 2024-09-13T02:52:44.666 INFO:tasks.workunit.client.0.smithi098.stdout:7/397: dwrite d6/d24/d2a/d57/f61 [0,4194304] 0 2024-09-13T02:52:44.667 INFO:tasks.workunit.client.0.smithi098.stdout:8/212: dread - d2/dd/f21 zero size 2024-09-13T02:52:44.668 INFO:tasks.workunit.client.0.smithi098.stdout:8/213: chown d2/f1a 28061 1 2024-09-13T02:52:44.671 INFO:tasks.workunit.client.1.smithi142.stdout:4/626: dwrite d0/df/d57/f11 [4194304,4194304] 0 2024-09-13T02:52:44.678 INFO:tasks.workunit.client.0.smithi098.stdout:8/214: rename d2/l4 to d2/dd/d11/d1d/l42 0 2024-09-13T02:52:44.678 INFO:tasks.workunit.client.0.smithi098.stdout:8/215: fsync d2/dd/f25 0 2024-09-13T02:52:44.679 INFO:tasks.workunit.client.1.smithi142.stdout:1/718: dread d12/d13/d20/d66/d55/da0/f6f [0,4194304] 0 2024-09-13T02:52:44.682 INFO:tasks.workunit.client.1.smithi142.stdout:3/627: rename d12/d16/d3c/f8d to d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/db6/fc6 0 2024-09-13T02:52:44.683 INFO:tasks.workunit.client.1.smithi142.stdout:0/661: rmdir d10/d6c 39 2024-09-13T02:52:44.687 INFO:tasks.workunit.client.1.smithi142.stdout:9/748: write dd/d17/d4f/f6b [706658,11127] 0 2024-09-13T02:52:44.691 INFO:tasks.workunit.client.0.smithi098.stdout:0/255: truncate dd/f24 2772716 0 2024-09-13T02:52:44.691 INFO:tasks.workunit.client.1.smithi142.stdout:2/532: truncate d1/f5 4841642 0 2024-09-13T02:52:44.691 INFO:tasks.workunit.client.0.smithi098.stdout:0/256: write dd/f10 [2216388,42673] 0 2024-09-13T02:52:44.693 INFO:tasks.workunit.client.1.smithi142.stdout:7/626: mknod d10/d13/ccf 0 2024-09-13T02:52:44.696 INFO:tasks.workunit.client.1.smithi142.stdout:1/719: mknod d12/d13/d20/d66/d7d/cdf 0 2024-09-13T02:52:44.697 INFO:tasks.workunit.client.1.smithi142.stdout:1/720: chown d12/d13/d1d/f8d 428 1 2024-09-13T02:52:44.700 INFO:tasks.workunit.client.0.smithi098.stdout:0/257: dread dd/f16 [0,4194304] 0 2024-09-13T02:52:44.700 INFO:tasks.workunit.client.1.smithi142.stdout:8/541: dwrite d0/d6/dc/fe [0,4194304] 0 2024-09-13T02:52:44.711 INFO:tasks.workunit.client.0.smithi098.stdout:4/190: sync 2024-09-13T02:52:44.715 INFO:tasks.workunit.client.0.smithi098.stdout:0/258: getdents dd 0 2024-09-13T02:52:44.716 INFO:tasks.workunit.client.0.smithi098.stdout:0/259: dread - dd/df/d1d/d26/f44 zero size 2024-09-13T02:52:44.716 INFO:tasks.workunit.client.1.smithi142.stdout:3/628: unlink d12/d16/d25/d2e/d38/d4d/fc0 0 2024-09-13T02:52:44.717 INFO:tasks.workunit.client.0.smithi098.stdout:4/191: mkdir d6/d22/d3d 0 2024-09-13T02:52:44.717 INFO:tasks.workunit.client.1.smithi142.stdout:9/749: creat dd/d17/d5f/d7b/db8/dc0/f110 x:0 0 0 2024-09-13T02:52:44.718 INFO:tasks.workunit.client.0.smithi098.stdout:7/398: write d6/d24/f28 [1409650,30264] 0 2024-09-13T02:52:44.718 INFO:tasks.workunit.client.1.smithi142.stdout:6/722: dwrite d1/d7/f3e [0,4194304] 0 2024-09-13T02:52:44.719 INFO:tasks.workunit.client.0.smithi098.stdout:4/192: write d6/f1c [2791841,42585] 0 2024-09-13T02:52:44.719 INFO:tasks.workunit.client.1.smithi142.stdout:8/542: rmdir d0/d6/dc/d45 39 2024-09-13T02:52:44.720 INFO:tasks.workunit.client.1.smithi142.stdout:6/723: readlink d1/dd/d53/l5c 0 2024-09-13T02:52:44.721 INFO:tasks.workunit.client.1.smithi142.stdout:3/629: write d12/d16/d25/d2e/d38/d4d/d53/faa [825934,73432] 0 2024-09-13T02:52:44.723 INFO:tasks.workunit.client.1.smithi142.stdout:6/724: fdatasync d1/dd/d16/f3c 0 2024-09-13T02:52:44.723 INFO:tasks.workunit.client.1.smithi142.stdout:5/697: dread d8/f66 [0,4194304] 0 2024-09-13T02:52:44.727 INFO:tasks.workunit.client.0.smithi098.stdout:8/216: dwrite d2/dd/d2e/f3d [0,4194304] 0 2024-09-13T02:52:44.730 INFO:tasks.workunit.client.1.smithi142.stdout:4/627: dwrite d0/d2b/d75/f8f [0,4194304] 0 2024-09-13T02:52:44.730 INFO:tasks.workunit.client.1.smithi142.stdout:1/721: creat d12/d13/fe0 x:0 0 0 2024-09-13T02:52:44.731 INFO:tasks.workunit.client.1.smithi142.stdout:4/628: chown d0 1 1 2024-09-13T02:52:44.733 INFO:tasks.workunit.client.0.smithi098.stdout:4/193: mkdir d6/d3e 0 2024-09-13T02:52:44.734 INFO:tasks.workunit.client.0.smithi098.stdout:4/194: chown d6/d10/d21/l30 25464280 1 2024-09-13T02:52:44.735 INFO:tasks.workunit.client.1.smithi142.stdout:0/662: mknod d10/d23/cd7 0 2024-09-13T02:52:44.735 INFO:tasks.workunit.client.0.smithi098.stdout:4/195: write d6/db/f29 [671988,83672] 0 2024-09-13T02:52:44.738 INFO:tasks.workunit.client.0.smithi098.stdout:7/399: truncate d6/d1e/f23 280769 0 2024-09-13T02:52:44.741 INFO:tasks.workunit.client.0.smithi098.stdout:4/196: chown d6/l14 29444 1 2024-09-13T02:52:44.743 INFO:tasks.workunit.client.1.smithi142.stdout:7/627: dwrite d10/d13/d1d/d2b/dae/d9c/fbb [0,4194304] 0 2024-09-13T02:52:44.743 INFO:tasks.workunit.client.0.smithi098.stdout:7/400: creat d6/d24/d2a/d5a/d42/f7f x:0 0 0 2024-09-13T02:52:44.743 INFO:tasks.workunit.client.0.smithi098.stdout:8/217: dwrite d2/dd/d11/d1d/f3a [0,4194304] 0 2024-09-13T02:52:44.746 INFO:tasks.workunit.client.0.smithi098.stdout:4/197: rmdir d6 39 2024-09-13T02:52:44.746 INFO:tasks.workunit.client.1.smithi142.stdout:8/543: symlink d0/d6/dc/lac 0 2024-09-13T02:52:44.747 INFO:tasks.workunit.client.1.smithi142.stdout:5/698: mkdir d8/d47/d65/da0/dd1/d45/d8e/dc6/de2 0 2024-09-13T02:52:44.748 INFO:tasks.workunit.client.0.smithi098.stdout:8/218: mkdir d2/d28/d43 0 2024-09-13T02:52:44.755 INFO:tasks.workunit.client.1.smithi142.stdout:0/663: write d10/d6c/d88/d1a/fd5 [369600,96003] 0 2024-09-13T02:52:44.756 INFO:tasks.workunit.client.0.smithi098.stdout:8/219: rmdir d2/d2f 39 2024-09-13T02:52:44.757 INFO:tasks.workunit.client.1.smithi142.stdout:3/630: mkdir d12/d16/dc7 0 2024-09-13T02:52:44.764 INFO:tasks.workunit.client.1.smithi142.stdout:9/750: rename dd/d17/d4f/l55 to dd/d17/d69/d84/l111 0 2024-09-13T02:52:44.765 INFO:tasks.workunit.client.0.smithi098.stdout:8/220: mkdir d2/dd/d11/d44 0 2024-09-13T02:52:44.767 INFO:tasks.workunit.client.1.smithi142.stdout:5/699: creat d8/d47/d65/da0/dd1/d45/d81/d8c/fe3 x:0 0 0 2024-09-13T02:52:44.768 INFO:tasks.workunit.client.1.smithi142.stdout:5/700: stat d8/d47/d65/da0/dd1/d63/fbf 0 2024-09-13T02:52:44.768 INFO:tasks.workunit.client.0.smithi098.stdout:4/198: link d6/l14 d6/d10/d20/l3f 0 2024-09-13T02:52:44.769 INFO:tasks.workunit.client.1.smithi142.stdout:5/701: truncate d8/d47/d65/da0/dd1/fae 1014686 0 2024-09-13T02:52:44.769 INFO:tasks.workunit.client.1.smithi142.stdout:4/629: symlink d0/d7e/db8/lc4 0 2024-09-13T02:52:44.770 INFO:tasks.workunit.client.1.smithi142.stdout:4/630: readlink d0/d2b/d2d/d65/l3c 0 2024-09-13T02:52:44.771 INFO:tasks.workunit.client.1.smithi142.stdout:0/664: symlink d10/d6c/d88/d21/d8f/ld8 0 2024-09-13T02:52:44.773 INFO:tasks.workunit.client.0.smithi098.stdout:4/199: creat d6/db/f40 x:0 0 0 2024-09-13T02:52:44.774 INFO:tasks.workunit.client.0.smithi098.stdout:7/401: dwrite d6/d24/d2a/d5a/f22 [0,4194304] 0 2024-09-13T02:52:44.775 INFO:tasks.workunit.client.0.smithi098.stdout:4/200: truncate d6/db/f2f 9435271 0 2024-09-13T02:52:44.775 INFO:tasks.workunit.client.0.smithi098.stdout:7/402: stat d6/d24/d2a/d5a/d42/d45 0 2024-09-13T02:52:44.775 INFO:tasks.workunit.client.0.smithi098.stdout:8/221: unlink d2/dd/f17 0 2024-09-13T02:52:44.782 INFO:tasks.workunit.client.1.smithi142.stdout:7/628: link d10/d13/d1d/d25/d5c/l79 d10/d13/d1d/d25/d45/d92/ld0 0 2024-09-13T02:52:44.789 INFO:tasks.workunit.client.0.smithi098.stdout:8/222: dwrite d2/dd/d11/d1d/f24 [0,4194304] 0 2024-09-13T02:52:44.790 INFO:tasks.workunit.client.0.smithi098.stdout:8/223: write d2/f41 [678456,52305] 0 2024-09-13T02:52:44.791 INFO:tasks.workunit.client.1.smithi142.stdout:7/629: symlink d10/d13/d1d/d2b/dae/d9c/ld1 0 2024-09-13T02:52:44.794 INFO:tasks.workunit.client.1.smithi142.stdout:0/665: link d10/d6c/d88/d1a/d1e/l34 d10/d6c/d88/d1a/d7a/ld9 0 2024-09-13T02:52:44.795 INFO:tasks.workunit.client.0.smithi098.stdout:8/224: creat d2/dd/d11/d1d/f45 x:0 0 0 2024-09-13T02:52:44.797 INFO:tasks.workunit.client.1.smithi142.stdout:7/630: readlink d10/d13/d22/l93 0 2024-09-13T02:52:44.798 INFO:tasks.workunit.client.1.smithi142.stdout:0/666: creat d10/d6c/d88/d45/db3/fda x:0 0 0 2024-09-13T02:52:44.800 INFO:tasks.workunit.client.1.smithi142.stdout:0/667: fdatasync d10/d6c/d88/d1a/d1e/d42/fa1 0 2024-09-13T02:52:44.801 INFO:tasks.workunit.client.1.smithi142.stdout:0/668: chown d10/d6c/d88/d45/fc8 118145 1 2024-09-13T02:52:44.803 INFO:tasks.workunit.client.0.smithi098.stdout:8/225: dwrite d2/fe [0,4194304] 0 2024-09-13T02:52:44.804 INFO:tasks.workunit.client.0.smithi098.stdout:7/403: dread d6/d24/d2a/d5a/f27 [0,4194304] 0 2024-09-13T02:52:44.805 INFO:tasks.workunit.client.0.smithi098.stdout:8/226: truncate d2/dd/d11/f18 2200880 0 2024-09-13T02:52:44.806 INFO:tasks.workunit.client.0.smithi098.stdout:8/227: dread - d2/f23 zero size 2024-09-13T02:52:44.807 INFO:tasks.workunit.client.1.smithi142.stdout:7/631: symlink d10/d13/d1d/d2b/d55/d32/ld2 0 2024-09-13T02:52:44.810 INFO:tasks.workunit.client.1.smithi142.stdout:8/544: dwrite d0/d6/dc/d45/f10 [0,4194304] 0 2024-09-13T02:52:44.810 INFO:tasks.workunit.client.0.smithi098.stdout:7/404: rmdir d6/d24/d63 39 2024-09-13T02:52:44.811 INFO:tasks.workunit.client.0.smithi098.stdout:4/201: dread d6/d22/f28 [0,4194304] 0 2024-09-13T02:52:44.813 INFO:tasks.workunit.client.1.smithi142.stdout:3/631: truncate d12/d16/d25/d2e/d48/f52 3872203 0 2024-09-13T02:52:44.813 INFO:tasks.workunit.client.0.smithi098.stdout:4/202: readlink d6/d10/d21/l30 0 2024-09-13T02:52:44.813 INFO:tasks.workunit.client.0.smithi098.stdout:8/228: dread d2/f41 [0,4194304] 0 2024-09-13T02:52:44.817 INFO:tasks.workunit.client.0.smithi098.stdout:7/405: write d6/d1e/f70 [312415,32544] 0 2024-09-13T02:52:44.817 INFO:tasks.workunit.client.1.smithi142.stdout:7/632: dread d10/d13/d1d/d2b/f8e [0,4194304] 0 2024-09-13T02:52:44.819 INFO:tasks.workunit.client.1.smithi142.stdout:4/631: dwrite d0/d2b/d2d/d31/f8b [0,4194304] 0 2024-09-13T02:52:44.823 INFO:tasks.workunit.client.1.smithi142.stdout:8/545: rmdir d0/d6/dc/d40/d46/da1 39 2024-09-13T02:52:44.825 INFO:tasks.workunit.client.0.smithi098.stdout:7/406: mkdir d6/d24/d2a/d5a/d42/d80 0 2024-09-13T02:52:44.827 INFO:tasks.workunit.client.1.smithi142.stdout:7/633: dwrite d10/d13/d1d/f36 [0,4194304] 0 2024-09-13T02:52:44.829 INFO:tasks.workunit.client.1.smithi142.stdout:0/669: dwrite d10/d23/f8d [0,4194304] 0 2024-09-13T02:52:44.830 INFO:tasks.workunit.client.0.smithi098.stdout:4/203: mkdir d6/d22/d3d/d41 0 2024-09-13T02:52:44.830 INFO:tasks.workunit.client.1.smithi142.stdout:4/632: mknod d0/d2b/d2d/d31/cc5 0 2024-09-13T02:52:44.832 INFO:tasks.workunit.client.0.smithi098.stdout:7/407: mknod d6/d24/d2a/d5a/d42/d45/d73/c81 0 2024-09-13T02:52:44.834 INFO:tasks.workunit.client.1.smithi142.stdout:8/546: symlink d0/d6/dc/d45/lad 0 2024-09-13T02:52:44.836 INFO:tasks.workunit.client.0.smithi098.stdout:4/204: creat d6/d22/d3d/d41/f42 x:0 0 0 2024-09-13T02:52:44.838 INFO:tasks.workunit.client.1.smithi142.stdout:4/633: creat d0/d2b/d2d/d31/fc6 x:0 0 0 2024-09-13T02:52:44.841 INFO:tasks.workunit.client.1.smithi142.stdout:2/533: sync 2024-09-13T02:52:44.841 INFO:tasks.workunit.client.1.smithi142.stdout:7/634: unlink d10/d64/fcb 0 2024-09-13T02:52:44.842 INFO:tasks.workunit.client.0.smithi098.stdout:7/408: rename d6/d1e/c3f to d6/d24/d2a/d5a/d42/c82 0 2024-09-13T02:52:44.843 INFO:tasks.workunit.client.1.smithi142.stdout:8/547: mkdir d0/d6/dc/d45/d35/dae 0 2024-09-13T02:52:44.844 INFO:tasks.workunit.client.1.smithi142.stdout:8/548: chown d0/d6/f24 34671861 1 2024-09-13T02:52:44.844 INFO:tasks.workunit.client.0.smithi098.stdout:8/229: dread d2/f1a [0,4194304] 0 2024-09-13T02:52:44.845 INFO:tasks.workunit.client.0.smithi098.stdout:8/230: write d2/dd/f21 [702049,96820] 0 2024-09-13T02:52:44.846 INFO:tasks.workunit.client.1.smithi142.stdout:4/634: unlink d0/d2b/d2d/d31/d32/fb1 0 2024-09-13T02:52:44.848 INFO:tasks.workunit.client.1.smithi142.stdout:2/534: creat d1/de/d31/d6c/d6d/d47/faf x:0 0 0 2024-09-13T02:52:44.848 INFO:tasks.workunit.client.0.smithi098.stdout:7/409: fdatasync d6/f19 0 2024-09-13T02:52:44.850 INFO:tasks.workunit.client.1.smithi142.stdout:7/635: symlink d10/d13/d1d/d25/d45/ld3 0 2024-09-13T02:52:44.851 INFO:tasks.workunit.client.0.smithi098.stdout:8/231: chown d2/f6 643 1 2024-09-13T02:52:44.852 INFO:tasks.workunit.client.0.smithi098.stdout:4/205: link d6/d10/c1a d6/d10/d21/c43 0 2024-09-13T02:52:44.856 INFO:tasks.workunit.client.1.smithi142.stdout:4/635: creat d0/d2b/d2d/d31/d32/d82/fc7 x:0 0 0 2024-09-13T02:52:44.856 INFO:tasks.workunit.client.1.smithi142.stdout:4/636: write d0/f8e [5058273,72568] 0 2024-09-13T02:52:44.859 INFO:tasks.workunit.client.1.smithi142.stdout:0/670: dread d10/d6c/d88/d21/d51/fa7 [0,4194304] 0 2024-09-13T02:52:44.860 INFO:tasks.workunit.client.1.smithi142.stdout:7/636: symlink d10/d34/d65/ld4 0 2024-09-13T02:52:44.862 INFO:tasks.workunit.client.1.smithi142.stdout:8/549: creat d0/d6/dc/d45/d9d/faf x:0 0 0 2024-09-13T02:52:44.864 INFO:tasks.workunit.client.0.smithi098.stdout:8/232: mkdir d2/dd/d11/d3b/d46 0 2024-09-13T02:52:44.865 INFO:tasks.workunit.client.0.smithi098.stdout:8/233: chown d2/dd/d11/l1c 0 1 2024-09-13T02:52:44.867 INFO:tasks.workunit.client.1.smithi142.stdout:2/535: mkdir d1/de/d31/db0 0 2024-09-13T02:52:44.868 INFO:tasks.workunit.client.1.smithi142.stdout:2/536: write d1/de/d1f/d9c/f9e [761199,21420] 0 2024-09-13T02:52:44.871 INFO:tasks.workunit.client.1.smithi142.stdout:0/671: symlink d10/d6c/d88/d21/d51/d35/d9b/da5/ldb 0 2024-09-13T02:52:44.873 INFO:tasks.workunit.client.1.smithi142.stdout:8/550: rmdir d0/d80/d8c 39 2024-09-13T02:52:44.874 INFO:tasks.workunit.client.0.smithi098.stdout:8/234: dwrite d2/f1a [4194304,4194304] 0 2024-09-13T02:52:44.875 INFO:tasks.workunit.client.0.smithi098.stdout:8/235: chown d2/dd 13692878 1 2024-09-13T02:52:44.876 INFO:tasks.workunit.client.1.smithi142.stdout:0/672: creat d10/d6c/d88/d21/d51/d35/d9b/da5/fdc x:0 0 0 2024-09-13T02:52:44.877 INFO:tasks.workunit.client.1.smithi142.stdout:7/637: mkdir d10/d13/d1d/d2b/d56/d5f/dd5 0 2024-09-13T02:52:44.877 INFO:tasks.workunit.client.1.smithi142.stdout:0/673: write d10/d23/f8d [2657789,42209] 0 2024-09-13T02:52:44.879 INFO:tasks.workunit.client.0.smithi098.stdout:8/236: mkdir d2/dd/d11/d3b/d46/d47 0 2024-09-13T02:52:44.880 INFO:tasks.workunit.client.1.smithi142.stdout:7/638: readlink d10/d13/d1d/d2b/d40/l48 0 2024-09-13T02:52:44.880 INFO:tasks.workunit.client.1.smithi142.stdout:8/551: dwrite d0/d6/dc/d45/d8/f9c [0,4194304] 0 2024-09-13T02:52:44.881 INFO:tasks.workunit.client.0.smithi098.stdout:8/237: write d2/d28/f2a [546969,91066] 0 2024-09-13T02:52:44.882 INFO:tasks.workunit.client.1.smithi142.stdout:8/552: chown d0/d6/dc/d45/l7c 916055296 1 2024-09-13T02:52:44.884 INFO:tasks.workunit.client.0.smithi098.stdout:7/410: dwrite d6/d24/d2a/f31 [0,4194304] 0 2024-09-13T02:52:44.884 INFO:tasks.workunit.client.0.smithi098.stdout:8/238: symlink d2/dd/d11/d2c/l48 0 2024-09-13T02:52:44.887 INFO:tasks.workunit.client.1.smithi142.stdout:4/637: write d0/df/f29 [514770,31656] 0 2024-09-13T02:52:44.888 INFO:tasks.workunit.client.1.smithi142.stdout:0/674: read d10/d6c/d88/d1a/f90 [488875,122470] 0 2024-09-13T02:52:44.888 INFO:tasks.workunit.client.0.smithi098.stdout:7/411: mknod d6/d24/c83 0 2024-09-13T02:52:44.891 INFO:tasks.workunit.client.0.smithi098.stdout:7/412: symlink d6/d1e/l84 0 2024-09-13T02:52:44.892 INFO:tasks.workunit.client.0.smithi098.stdout:8/239: dwrite d2/f1b [4194304,4194304] 0 2024-09-13T02:52:44.892 INFO:tasks.workunit.client.1.smithi142.stdout:4/638: rmdir d0/d2b/d2d/d31/d43/d48 39 2024-09-13T02:52:44.893 INFO:tasks.workunit.client.0.smithi098.stdout:2/215: sync 2024-09-13T02:52:44.893 INFO:tasks.workunit.client.0.smithi098.stdout:9/201: sync 2024-09-13T02:52:44.893 INFO:tasks.workunit.client.0.smithi098.stdout:5/182: sync 2024-09-13T02:52:44.893 INFO:tasks.workunit.client.0.smithi098.stdout:1/263: sync 2024-09-13T02:52:44.893 INFO:tasks.workunit.client.0.smithi098.stdout:6/199: sync 2024-09-13T02:52:44.893 INFO:tasks.workunit.client.0.smithi098.stdout:3/209: sync 2024-09-13T02:52:44.894 INFO:tasks.workunit.client.0.smithi098.stdout:9/202: chown d2/dd/d39/d43 1885422 1 2024-09-13T02:52:44.896 INFO:tasks.workunit.client.1.smithi142.stdout:0/675: symlink d10/d6c/d88/d1a/d1e/d42/ldd 0 2024-09-13T02:52:44.897 INFO:tasks.workunit.client.0.smithi098.stdout:3/210: write d7/d9/d15/d17/f3b [210275,111588] 0 2024-09-13T02:52:44.898 INFO:tasks.workunit.client.1.smithi142.stdout:8/553: dwrite d0/d6/dc/d45/d8/df/f9f [0,4194304] 0 2024-09-13T02:52:44.899 INFO:tasks.workunit.client.0.smithi098.stdout:1/264: mkdir d9/d33/d19/d64 0 2024-09-13T02:52:44.899 INFO:tasks.workunit.client.0.smithi098.stdout:7/413: write d6/d1e/f3c [886208,18483] 0 2024-09-13T02:52:44.900 INFO:tasks.workunit.client.0.smithi098.stdout:9/203: truncate d2/dd/f30 768446 0 2024-09-13T02:52:44.902 INFO:tasks.workunit.client.0.smithi098.stdout:8/240: mkdir d2/dd/d11/d49 0 2024-09-13T02:52:44.903 INFO:tasks.workunit.client.0.smithi098.stdout:9/204: stat d2/d6/f29 0 2024-09-13T02:52:44.907 INFO:tasks.workunit.client.1.smithi142.stdout:0/676: dwrite d10/dbf/fd4 [0,4194304] 0 2024-09-13T02:52:44.908 INFO:tasks.workunit.client.0.smithi098.stdout:5/183: dwrite d0/d38/d3f/f9 [0,4194304] 0 2024-09-13T02:52:44.909 INFO:tasks.workunit.client.0.smithi098.stdout:3/211: dread d7/d9/d15/f23 [0,4194304] 0 2024-09-13T02:52:44.911 INFO:tasks.workunit.client.0.smithi098.stdout:2/216: dread d1/d1a/dc/f37 [4194304,4194304] 0 2024-09-13T02:52:44.916 INFO:tasks.workunit.client.1.smithi142.stdout:7/639: dread d10/d13/d1d/d2b/d40/f5e [0,4194304] 0 2024-09-13T02:52:44.917 INFO:tasks.workunit.client.1.smithi142.stdout:0/677: fsync d10/d6c/d88/f46 0 2024-09-13T02:52:44.917 INFO:tasks.workunit.client.0.smithi098.stdout:9/205: symlink d2/d6/d2b/l4b 0 2024-09-13T02:52:44.918 INFO:tasks.workunit.client.0.smithi098.stdout:5/184: symlink d0/d15/l48 0 2024-09-13T02:52:44.919 INFO:tasks.workunit.client.0.smithi098.stdout:9/206: write d2/d6/f35 [313870,42625] 0 2024-09-13T02:52:44.920 INFO:tasks.workunit.client.0.smithi098.stdout:5/185: write d0/d38/d3f/f36 [148140,40050] 0 2024-09-13T02:52:44.921 INFO:tasks.workunit.client.0.smithi098.stdout:5/186: read - d0/d38/d3f/d1a/f34 zero size 2024-09-13T02:52:44.923 INFO:tasks.workunit.client.0.smithi098.stdout:3/212: rmdir d7/d9/d25/d2b 39 2024-09-13T02:52:44.924 INFO:tasks.workunit.client.0.smithi098.stdout:9/207: truncate d2/d6/d2b/f31 535955 0 2024-09-13T02:52:44.924 INFO:tasks.workunit.client.1.smithi142.stdout:6/725: sync 2024-09-13T02:52:44.925 INFO:tasks.workunit.client.0.smithi098.stdout:7/414: mknod d6/d24/d63/c85 0 2024-09-13T02:52:44.926 INFO:tasks.workunit.client.0.smithi098.stdout:9/208: read d2/d6/d2b/f37 [268023,94610] 0 2024-09-13T02:52:44.926 INFO:tasks.workunit.client.0.smithi098.stdout:2/217: mknod d1/d1a/d9/d1e/c3b 0 2024-09-13T02:52:44.927 INFO:tasks.workunit.client.0.smithi098.stdout:3/213: dread d7/d9/f31 [0,4194304] 0 2024-09-13T02:52:44.928 INFO:tasks.workunit.client.1.smithi142.stdout:0/678: mknod d10/d6c/d88/d21/d51/d35/cde 0 2024-09-13T02:52:44.928 INFO:tasks.workunit.client.0.smithi098.stdout:1/265: creat d9/d33/d19/d64/f65 x:0 0 0 2024-09-13T02:52:44.929 INFO:tasks.workunit.client.0.smithi098.stdout:1/266: stat d9/d33/d1f/d23/c2a 0 2024-09-13T02:52:44.930 INFO:tasks.workunit.client.0.smithi098.stdout:1/267: fdatasync d9/f3d 0 2024-09-13T02:52:44.931 INFO:tasks.workunit.client.1.smithi142.stdout:6/726: symlink d1/dd/d53/d78/d8f/da8/de6/lf6 0 2024-09-13T02:52:44.933 INFO:tasks.workunit.client.1.smithi142.stdout:0/679: mkdir d10/d6c/d88/d21/d51/d35/d9b/da5/ddf 0 2024-09-13T02:52:44.934 INFO:tasks.workunit.client.0.smithi098.stdout:3/214: dwrite d7/d9/f32 [4194304,4194304] 0 2024-09-13T02:52:44.937 INFO:tasks.workunit.client.1.smithi142.stdout:4/639: truncate d0/d2b/d2d/d31/d43/d48/f4d 1284734 0 2024-09-13T02:52:44.937 INFO:tasks.workunit.client.0.smithi098.stdout:7/415: dread - d6/d24/f5f zero size 2024-09-13T02:52:44.939 INFO:tasks.workunit.client.0.smithi098.stdout:2/218: stat d1/d1f/d30 0 2024-09-13T02:52:44.940 INFO:tasks.workunit.client.1.smithi142.stdout:7/640: getdents d10/d13/d1d/d2b 0 2024-09-13T02:52:44.942 INFO:tasks.workunit.client.0.smithi098.stdout:9/209: creat d2/dd/d39/d43/f4c x:0 0 0 2024-09-13T02:52:44.942 INFO:tasks.workunit.client.1.smithi142.stdout:7/641: write d10/d64/fc5 [537978,1960] 0 2024-09-13T02:52:44.946 INFO:tasks.workunit.client.0.smithi098.stdout:8/241: rename d2/d28/f2a to d2/f4a 0 2024-09-13T02:52:44.948 INFO:tasks.workunit.client.0.smithi098.stdout:1/268: creat d9/d33/f66 x:0 0 0 2024-09-13T02:52:44.949 INFO:tasks.workunit.client.0.smithi098.stdout:8/242: write d2/f1b [8146540,106426] 0 2024-09-13T02:52:44.950 INFO:tasks.workunit.client.0.smithi098.stdout:3/215: creat d7/f43 x:0 0 0 2024-09-13T02:52:44.950 INFO:tasks.workunit.client.0.smithi098.stdout:1/269: write d9/d33/f2b [543700,40309] 0 2024-09-13T02:52:44.952 INFO:tasks.workunit.client.1.smithi142.stdout:0/680: dread d10/d6c/d88/d21/d51/f92 [0,4194304] 0 2024-09-13T02:52:44.953 INFO:tasks.workunit.client.1.smithi142.stdout:7/642: creat d10/d64/d88/fd6 x:0 0 0 2024-09-13T02:52:44.956 INFO:tasks.workunit.client.0.smithi098.stdout:1/270: dwrite d9/d33/f17 [0,4194304] 0 2024-09-13T02:52:44.957 INFO:tasks.workunit.client.1.smithi142.stdout:7/643: creat d10/d13/d1d/d2b/d40/fd7 x:0 0 0 2024-09-13T02:52:44.957 INFO:tasks.workunit.client.1.smithi142.stdout:7/644: write d10/d13/f3d [4016680,75769] 0 2024-09-13T02:52:44.959 INFO:tasks.workunit.client.0.smithi098.stdout:9/210: mkdir d2/d6/d2b/d4d 0 2024-09-13T02:52:44.962 INFO:tasks.workunit.client.1.smithi142.stdout:0/681: rename d10/d6c/l7f to d10/d6c/d88/d1a/d1e/d42/d4b/le0 0 2024-09-13T02:52:44.963 INFO:tasks.workunit.client.1.smithi142.stdout:0/682: fsync d10/d6c/d88/d21/d51/d35/f8c 0 2024-09-13T02:52:44.967 INFO:tasks.workunit.client.1.smithi142.stdout:7/645: rename d10/d13/d1d/d25/dc4 to d10/d13/d1d/d2b/dae/dd8 0 2024-09-13T02:52:44.969 INFO:tasks.workunit.client.1.smithi142.stdout:0/683: mkdir d10/d6c/d88/d21/d8f/de1 0 2024-09-13T02:52:44.969 INFO:tasks.workunit.client.0.smithi098.stdout:5/187: link d0/d15/d17/l23 d0/d15/d17/d1c/d3d/l49 0 2024-09-13T02:52:44.970 INFO:tasks.workunit.client.0.smithi098.stdout:5/188: fdatasync d0/d29/f3e 0 2024-09-13T02:52:44.972 INFO:tasks.workunit.client.1.smithi142.stdout:7/646: fsync d10/d34/f5b 0 2024-09-13T02:52:44.973 INFO:tasks.workunit.client.1.smithi142.stdout:7/647: stat d10/d13/d22/l93 0 2024-09-13T02:52:44.973 INFO:tasks.workunit.client.1.smithi142.stdout:7/648: write d10/d64/fc5 [1057174,96472] 0 2024-09-13T02:52:44.975 INFO:tasks.workunit.client.0.smithi098.stdout:2/219: link d1/d1a/d9/d1e/f2c d1/d1f/d35/f3c 0 2024-09-13T02:52:44.977 INFO:tasks.workunit.client.0.smithi098.stdout:1/271: creat d9/d33/f67 x:0 0 0 2024-09-13T02:52:44.977 INFO:tasks.workunit.client.1.smithi142.stdout:0/684: mknod d10/d6c/d88/d1a/ce2 0 2024-09-13T02:52:44.979 INFO:tasks.workunit.client.0.smithi098.stdout:9/211: creat d2/d6/d36/f4e x:0 0 0 2024-09-13T02:52:44.984 INFO:tasks.workunit.client.0.smithi098.stdout:5/189: chown d0/d38/d3f/d1a/d27/c2f 47 1 2024-09-13T02:52:44.985 INFO:tasks.workunit.client.1.smithi142.stdout:7/649: creat d10/d13/d1d/d25/d5c/dbd/fd9 x:0 0 0 2024-09-13T02:52:44.985 INFO:tasks.workunit.client.0.smithi098.stdout:9/212: dwrite d2/dd/f20 [0,4194304] 0 2024-09-13T02:52:44.989 INFO:tasks.workunit.client.1.smithi142.stdout:7/650: dread d10/d13/d1d/d2b/d40/fa7 [0,4194304] 0 2024-09-13T02:52:44.990 INFO:tasks.workunit.client.1.smithi142.stdout:7/651: dread - d10/d13/d1d/d2b/dae/f8f zero size 2024-09-13T02:52:44.990 INFO:tasks.workunit.client.1.smithi142.stdout:0/685: link d10/d6c/d88/d21/d51/l41 d10/d6c/d88/d21/daf/le3 0 2024-09-13T02:52:44.990 INFO:tasks.workunit.client.1.smithi142.stdout:7/652: chown d10/d13/d21 115 1 2024-09-13T02:52:44.992 INFO:tasks.workunit.client.1.smithi142.stdout:0/686: write d10/d6c/d88/d45/f60 [3097538,45520] 0 2024-09-13T02:52:44.993 INFO:tasks.workunit.client.0.smithi098.stdout:1/272: rename d9/d12 to d9/d33/d19/d35/d68 0 2024-09-13T02:52:44.994 INFO:tasks.workunit.client.0.smithi098.stdout:1/273: dread - d9/d33/d19/d2c/f5e zero size 2024-09-13T02:52:44.996 INFO:tasks.workunit.client.0.smithi098.stdout:3/216: write d7/d9/d15/f23 [651292,35576] 0 2024-09-13T02:52:45.000 INFO:tasks.workunit.client.1.smithi142.stdout:0/687: symlink d10/d6c/d88/d21/daf/le4 0 2024-09-13T02:52:45.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:44 smithi142 ceph-mon[33443]: pgmap v21: 65 pgs: 65 active+clean; 1.5 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 209 MiB/s wr, 316 op/s 2024-09-13T02:52:45.004 INFO:tasks.workunit.client.1.smithi142.stdout:0/688: write d10/d6c/d88/d21/d51/d35/f76 [4226999,76159] 0 2024-09-13T02:52:45.005 INFO:tasks.workunit.client.0.smithi098.stdout:7/416: dwrite d6/d1e/f23 [0,4194304] 0 2024-09-13T02:52:45.006 INFO:tasks.workunit.client.0.smithi098.stdout:1/274: dread d9/d33/d19/d35/d68/d2f/f3e [0,4194304] 0 2024-09-13T02:52:45.007 INFO:tasks.workunit.client.0.smithi098.stdout:9/213: mkdir d2/d6/d2b/d4d/d4f 0 2024-09-13T02:52:45.008 INFO:tasks.workunit.client.0.smithi098.stdout:8/243: truncate d2/fe 3874006 0 2024-09-13T02:52:45.008 INFO:tasks.workunit.client.0.smithi098.stdout:8/244: dread - d2/f23 zero size 2024-09-13T02:52:45.011 INFO:tasks.workunit.client.1.smithi142.stdout:0/689: readlink d10/d6c/d88/d1a/d1e/l34 0 2024-09-13T02:52:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:3/217: creat d7/d9/d25/d3a/f44 x:0 0 0 2024-09-13T02:52:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:9/214: dwrite d2/d6/f35 [0,4194304] 0 2024-09-13T02:52:45.015 INFO:tasks.workunit.client.1.smithi142.stdout:1/722: sync 2024-09-13T02:52:45.015 INFO:tasks.workunit.client.1.smithi142.stdout:9/751: sync 2024-09-13T02:52:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:7/417: unlink d6/d24/d2a/d5a/f43 0 2024-09-13T02:52:45.017 INFO:tasks.workunit.client.0.smithi098.stdout:7/418: dread - d6/d24/f5f zero size 2024-09-13T02:52:45.017 INFO:tasks.workunit.client.0.smithi098.stdout:9/215: dread d2/dd/f30 [0,4194304] 0 2024-09-13T02:52:45.017 INFO:tasks.workunit.client.1.smithi142.stdout:0/690: mknod d10/d6c/d88/d1a/d1e/d42/ce5 0 2024-09-13T02:52:45.021 INFO:tasks.workunit.client.1.smithi142.stdout:1/723: dwrite d12/d13/d20/d66/fbd [0,4194304] 0 2024-09-13T02:52:45.021 INFO:tasks.workunit.client.0.smithi098.stdout:9/216: write d2/dd/d39/f45 [58933,61408] 0 2024-09-13T02:52:45.022 INFO:tasks.workunit.client.0.smithi098.stdout:9/217: readlink d2/l18 0 2024-09-13T02:52:45.023 INFO:tasks.workunit.client.0.smithi098.stdout:2/220: dwrite d1/f8 [0,4194304] 0 2024-09-13T02:52:45.024 INFO:tasks.workunit.client.1.smithi142.stdout:0/691: rmdir d10/d6c/d88/d21/d8f 39 2024-09-13T02:52:45.027 INFO:tasks.workunit.client.0.smithi098.stdout:8/245: creat d2/dd/d11/d3b/f4b x:0 0 0 2024-09-13T02:52:45.028 INFO:tasks.workunit.client.0.smithi098.stdout:5/190: truncate d0/d15/f3a 27961 0 2024-09-13T02:52:45.029 INFO:tasks.workunit.client.1.smithi142.stdout:7/653: dwrite d10/d34/d57/d98/fa5 [0,4194304] 0 2024-09-13T02:52:45.035 INFO:tasks.workunit.client.0.smithi098.stdout:8/246: dread d2/dd/f21 [0,4194304] 0 2024-09-13T02:52:45.036 INFO:tasks.workunit.client.1.smithi142.stdout:1/724: rename d12/d13/d1d/f8d to d12/d13/d20/d66/d55/fe1 0 2024-09-13T02:52:45.039 INFO:tasks.workunit.client.1.smithi142.stdout:0/692: mkdir d10/d6c/d88/d21/d51/d79/de6 0 2024-09-13T02:52:45.039 INFO:tasks.workunit.client.0.smithi098.stdout:9/218: dread d2/f10 [0,4194304] 0 2024-09-13T02:52:45.040 INFO:tasks.workunit.client.0.smithi098.stdout:3/218: rmdir d7/d9/d15/d2d 39 2024-09-13T02:52:45.040 INFO:tasks.workunit.client.0.smithi098.stdout:3/219: readlink d7/l3f 0 2024-09-13T02:52:45.040 INFO:tasks.workunit.client.0.smithi098.stdout:9/219: chown d2/dd/f30 492345500 1 2024-09-13T02:52:45.041 INFO:tasks.workunit.client.0.smithi098.stdout:9/220: chown d2/d6/d36/f38 690 1 2024-09-13T02:52:45.043 INFO:tasks.workunit.client.0.smithi098.stdout:9/221: dread d2/d6/d2b/f31 [0,4194304] 0 2024-09-13T02:52:45.044 INFO:tasks.workunit.client.0.smithi098.stdout:1/275: creat d9/d33/d19/d35/d63/f69 x:0 0 0 2024-09-13T02:52:45.045 INFO:tasks.workunit.client.0.smithi098.stdout:9/222: dread - d2/d6/d36/f38 zero size 2024-09-13T02:52:45.045 INFO:tasks.workunit.client.0.smithi098.stdout:1/276: dread - d9/d33/f66 zero size 2024-09-13T02:52:45.048 INFO:tasks.workunit.client.1.smithi142.stdout:1/725: unlink d12/f22 0 2024-09-13T02:52:45.050 INFO:tasks.workunit.client.1.smithi142.stdout:0/693: rmdir d10/d6c/d88/d21/daf 39 2024-09-13T02:52:45.057 INFO:tasks.workunit.client.1.smithi142.stdout:3/632: sync 2024-09-13T02:52:45.057 INFO:tasks.workunit.client.1.smithi142.stdout:5/702: sync 2024-09-13T02:52:45.057 INFO:tasks.workunit.client.1.smithi142.stdout:8/554: sync 2024-09-13T02:52:45.057 INFO:tasks.workunit.client.1.smithi142.stdout:2/537: sync 2024-09-13T02:52:45.059 INFO:tasks.workunit.client.1.smithi142.stdout:0/694: symlink d10/d6c/d88/d21/d51/le7 0 2024-09-13T02:52:45.059 INFO:tasks.workunit.client.1.smithi142.stdout:2/538: readlink d1/de/d31/d6c/d6d/d47/l4b 0 2024-09-13T02:52:45.060 INFO:tasks.workunit.client.1.smithi142.stdout:9/752: truncate dd/d17/d69/f89 1642378 0 2024-09-13T02:52:45.060 INFO:tasks.workunit.client.1.smithi142.stdout:5/703: write d8/d47/d65/da0/dd1/d45/f79 [1324299,6503] 0 2024-09-13T02:52:45.061 INFO:tasks.workunit.client.1.smithi142.stdout:0/695: chown d10/d23/c82 52173287 1 2024-09-13T02:52:45.062 INFO:tasks.workunit.client.0.smithi098.stdout:5/191: dread d0/f37 [0,4194304] 0 2024-09-13T02:52:45.063 INFO:tasks.workunit.client.0.smithi098.stdout:5/192: stat d0/d15/d17/d1c/l43 0 2024-09-13T02:52:45.063 INFO:tasks.workunit.client.1.smithi142.stdout:9/753: write dd/d17/d44/d82/d99/daf/fb6 [429941,121477] 0 2024-09-13T02:52:45.064 INFO:tasks.workunit.client.0.smithi098.stdout:8/247: read d2/d2f/f31 [19968,30736] 0 2024-09-13T02:52:45.065 INFO:tasks.workunit.client.1.smithi142.stdout:9/754: chown dd/d87 219 1 2024-09-13T02:52:45.065 INFO:tasks.workunit.client.1.smithi142.stdout:0/696: chown d10/d6c/d88/d1a/f90 4 1 2024-09-13T02:52:45.065 INFO:tasks.workunit.client.0.smithi098.stdout:8/248: write d2/dd/f25 [767130,39318] 0 2024-09-13T02:52:45.066 INFO:tasks.workunit.client.0.smithi098.stdout:8/249: write d2/f27 [740647,73774] 0 2024-09-13T02:52:45.067 INFO:tasks.workunit.client.1.smithi142.stdout:8/555: dwrite d0/f95 [0,4194304] 0 2024-09-13T02:52:45.067 INFO:tasks.workunit.client.1.smithi142.stdout:3/633: unlink d12/d16/d3c/d79/f83 0 2024-09-13T02:52:45.069 INFO:tasks.workunit.client.0.smithi098.stdout:3/220: rmdir d7/d9/d15/d26 39 2024-09-13T02:52:45.070 INFO:tasks.workunit.client.1.smithi142.stdout:8/556: stat d0/d6/dc/d45/d8/l1c 0 2024-09-13T02:52:45.070 INFO:tasks.workunit.client.1.smithi142.stdout:7/654: write d10/d13/d1d/f83 [1610124,35657] 0 2024-09-13T02:52:45.073 INFO:tasks.workunit.client.1.smithi142.stdout:7/655: chown d10/d34/d65/ld4 3063 1 2024-09-13T02:52:45.073 INFO:tasks.workunit.client.0.smithi098.stdout:7/419: dwrite d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:45.074 INFO:tasks.workunit.client.1.smithi142.stdout:5/704: dwrite d8/d47/d65/da0/dd1/d45/d81/d8c/fe3 [0,4194304] 0 2024-09-13T02:52:45.074 INFO:tasks.workunit.client.1.smithi142.stdout:5/705: chown d8/c34 1 1 2024-09-13T02:52:45.076 INFO:tasks.workunit.client.1.smithi142.stdout:2/539: rmdir d1 39 2024-09-13T02:52:45.079 INFO:tasks.workunit.client.0.smithi098.stdout:1/277: unlink d9/d33/d19/c32 0 2024-09-13T02:52:45.082 INFO:tasks.workunit.client.1.smithi142.stdout:7/656: dwrite d10/d13/d1d/d25/d45/d99/fb3 [0,4194304] 0 2024-09-13T02:52:45.083 INFO:tasks.workunit.client.0.smithi098.stdout:5/193: dread d0/d15/d17/f26 [0,4194304] 0 2024-09-13T02:52:45.083 INFO:tasks.workunit.client.0.smithi098.stdout:2/221: dwrite d1/d1f/d35/f3c [0,4194304] 0 2024-09-13T02:52:45.084 INFO:tasks.workunit.client.0.smithi098.stdout:9/223: rename d2/d6/d2b/f37 to d2/dd/d39/d43/f50 0 2024-09-13T02:52:45.098 INFO:tasks.workunit.client.1.smithi142.stdout:1/726: dwrite d12/d13/d45/fa8 [4194304,4194304] 0 2024-09-13T02:52:45.099 INFO:tasks.workunit.client.1.smithi142.stdout:3/634: fdatasync d12/d16/d25/d2e/d48/d5c/d66/f63 0 2024-09-13T02:52:45.100 INFO:tasks.workunit.client.1.smithi142.stdout:1/727: readlink d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/l1c 0 2024-09-13T02:52:45.103 INFO:tasks.workunit.client.1.smithi142.stdout:2/540: write d1/de/d31/d6c/d6d/f5c [4946134,53505] 0 2024-09-13T02:52:45.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/640: sync 2024-09-13T02:52:45.104 INFO:tasks.workunit.client.1.smithi142.stdout:6/727: sync 2024-09-13T02:52:45.105 INFO:tasks.workunit.client.1.smithi142.stdout:4/641: readlink d0/d2b/d2d/l62 0 2024-09-13T02:52:45.107 INFO:tasks.workunit.client.1.smithi142.stdout:7/657: fdatasync d10/d13/d1d/d2b/d40/fca 0 2024-09-13T02:52:45.109 INFO:tasks.workunit.client.1.smithi142.stdout:9/755: mkdir dd/d17/d5f/d7b/d112 0 2024-09-13T02:52:45.109 INFO:tasks.workunit.client.1.smithi142.stdout:7/658: write d10/d13/d1d/d25/d45/d6d/fa9 [3143522,26659] 0 2024-09-13T02:52:45.110 INFO:tasks.workunit.client.1.smithi142.stdout:0/697: creat d10/d6c/d88/d1a/d1e/dc6/fe8 x:0 0 0 2024-09-13T02:52:45.111 INFO:tasks.workunit.client.1.smithi142.stdout:0/698: write d10/d6c/f71 [1010525,129778] 0 2024-09-13T02:52:45.113 INFO:tasks.workunit.client.1.smithi142.stdout:3/635: read - d12/d16/d25/f4f zero size 2024-09-13T02:52:45.114 INFO:tasks.workunit.client.1.smithi142.stdout:8/557: creat d0/d6/d83/daa/fb0 x:0 0 0 2024-09-13T02:52:45.115 INFO:tasks.workunit.client.1.smithi142.stdout:3/636: readlink d12/d16/d25/d2e/d38/d5a/l97 0 2024-09-13T02:52:45.115 INFO:tasks.workunit.client.1.smithi142.stdout:5/706: getdents d8/d47/d65/da0/dd1/d61/dcb 0 2024-09-13T02:52:45.119 INFO:tasks.workunit.client.1.smithi142.stdout:2/541: rename d1/d42/d44/d99/lad to d1/de/d31/d6c/d6d/d47/lb1 0 2024-09-13T02:52:45.122 INFO:tasks.workunit.client.1.smithi142.stdout:1/728: dread d12/d13/d1d/d26/f6a [0,4194304] 0 2024-09-13T02:52:45.123 INFO:tasks.workunit.client.1.smithi142.stdout:4/642: mkdir d0/dc8 0 2024-09-13T02:52:45.123 INFO:tasks.workunit.client.1.smithi142.stdout:5/707: dwrite d8/d47/d65/da0/dd1/f60 [0,4194304] 0 2024-09-13T02:52:45.125 INFO:tasks.workunit.client.1.smithi142.stdout:9/756: mkdir dd/d17/d44/d95/dd1/ddf/d113 0 2024-09-13T02:52:45.126 INFO:tasks.workunit.client.1.smithi142.stdout:1/729: write d12/d13/d1d/d26/f2b [2922039,19077] 0 2024-09-13T02:52:45.126 INFO:tasks.workunit.client.1.smithi142.stdout:4/643: write d0/d2b/d21/d30/f54 [952149,75602] 0 2024-09-13T02:52:45.126 INFO:tasks.workunit.client.1.smithi142.stdout:7/659: rename d10/d13/d22/f69 to d10/d34/d57/fda 0 2024-09-13T02:52:45.129 INFO:tasks.workunit.client.1.smithi142.stdout:2/542: mkdir d1/d2d/db2 0 2024-09-13T02:52:45.129 INFO:tasks.workunit.client.0.smithi098.stdout:1/278: symlink d9/d33/l6a 0 2024-09-13T02:52:45.129 INFO:tasks.workunit.client.0.smithi098.stdout:5/194: dread - d0/d15/d17/f44 zero size 2024-09-13T02:52:45.130 INFO:tasks.workunit.client.0.smithi098.stdout:1/279: fsync d9/d33/d19/f27 0 2024-09-13T02:52:45.130 INFO:tasks.workunit.client.1.smithi142.stdout:4/644: dread - d0/d2b/d2d/fac zero size 2024-09-13T02:52:45.131 INFO:tasks.workunit.client.0.smithi098.stdout:5/195: read d0/d15/f30 [2147071,40753] 0 2024-09-13T02:52:45.135 INFO:tasks.workunit.client.1.smithi142.stdout:3/637: dwrite d12/d16/d3c/d7d/d91/fb4 [0,4194304] 0 2024-09-13T02:52:45.136 INFO:tasks.workunit.client.0.smithi098.stdout:7/420: rename d6/d24/d2a/d48 to d6/d24/d2a/d5a/d86 0 2024-09-13T02:52:45.141 INFO:tasks.workunit.client.1.smithi142.stdout:2/543: dread d1/de/f10 [0,4194304] 0 2024-09-13T02:52:45.141 INFO:tasks.workunit.client.0.smithi098.stdout:1/280: dwrite d9/d33/f67 [0,4194304] 0 2024-09-13T02:52:45.141 INFO:tasks.workunit.client.1.smithi142.stdout:7/660: dwrite d10/d13/f76 [0,4194304] 0 2024-09-13T02:52:45.143 INFO:tasks.workunit.client.1.smithi142.stdout:8/558: rename d0/d6/dc/d45/d35/d93/ca7 to d0/d6/dc/d45/d35/d61/cb1 0 2024-09-13T02:52:45.145 INFO:tasks.workunit.client.0.smithi098.stdout:9/224: mknod d2/d6/d2b/d4d/c51 0 2024-09-13T02:52:45.145 INFO:tasks.workunit.client.0.smithi098.stdout:2/222: dread d1/d1a/dc/d23/f28 [0,4194304] 0 2024-09-13T02:52:45.146 INFO:tasks.workunit.client.1.smithi142.stdout:9/757: write dd/d17/d25/fac [4292052,76491] 0 2024-09-13T02:52:45.147 INFO:tasks.workunit.client.1.smithi142.stdout:0/699: mknod d10/d6c/d88/d21/d8f/de1/ce9 0 2024-09-13T02:52:45.150 INFO:tasks.workunit.client.1.smithi142.stdout:5/708: mknod d8/d47/d65/da0/dd1/d45/d81/d8c/ce4 0 2024-09-13T02:52:45.151 INFO:tasks.workunit.client.1.smithi142.stdout:9/758: read dd/d17/d5f/fba [2423871,37090] 0 2024-09-13T02:52:45.151 INFO:tasks.workunit.client.0.smithi098.stdout:8/250: write d2/f6 [2735959,99190] 0 2024-09-13T02:52:45.153 INFO:tasks.workunit.client.1.smithi142.stdout:8/559: dwrite d0/d6/dc/d45/d8/df/f9f [0,4194304] 0 2024-09-13T02:52:45.154 INFO:tasks.workunit.client.0.smithi098.stdout:8/251: dread - d2/dd/d11/d1d/f45 zero size 2024-09-13T02:52:45.156 INFO:tasks.workunit.client.0.smithi098.stdout:1/281: dwrite d9/d33/d19/d2c/f5e [0,4194304] 0 2024-09-13T02:52:45.160 INFO:tasks.workunit.client.1.smithi142.stdout:0/700: dread d10/d6c/d88/d21/d51/f54 [0,4194304] 0 2024-09-13T02:52:45.161 INFO:tasks.workunit.client.1.smithi142.stdout:4/645: mkdir d0/df/dc9 0 2024-09-13T02:52:45.161 INFO:tasks.workunit.client.1.smithi142.stdout:0/701: write d10/d6c/d88/fb9 [598058,69255] 0 2024-09-13T02:52:45.163 INFO:tasks.workunit.client.0.smithi098.stdout:8/252: dread d2/dd/d11/d1d/f3a [0,4194304] 0 2024-09-13T02:52:45.163 INFO:tasks.workunit.client.1.smithi142.stdout:4/646: write d0/d2b/d2d/f9f [1224287,96134] 0 2024-09-13T02:52:45.163 INFO:tasks.workunit.client.1.smithi142.stdout:0/702: dread - d10/d6c/d88/d45/db3/fc7 zero size 2024-09-13T02:52:45.171 INFO:tasks.workunit.client.0.smithi098.stdout:7/421: dread d6/d49/f4f [0,4194304] 0 2024-09-13T02:52:45.173 INFO:tasks.workunit.client.1.smithi142.stdout:3/638: fdatasync d12/d16/d3c/d7d/d91/fac 0 2024-09-13T02:52:45.176 INFO:tasks.workunit.client.1.smithi142.stdout:6/728: dwrite d1/fd7 [0,4194304] 0 2024-09-13T02:52:45.182 INFO:tasks.workunit.client.0.smithi098.stdout:1/282: mkdir d9/d33/d1f/d6b 0 2024-09-13T02:52:45.184 INFO:tasks.workunit.client.0.smithi098.stdout:1/283: write d9/d33/d19/f50 [1269384,59858] 0 2024-09-13T02:52:45.185 INFO:tasks.workunit.client.0.smithi098.stdout:1/284: readlink d9/d33/l41 0 2024-09-13T02:52:45.190 INFO:tasks.workunit.client.1.smithi142.stdout:5/709: mknod d8/dc3/d64/d68/db5/ce5 0 2024-09-13T02:52:45.192 INFO:tasks.workunit.client.1.smithi142.stdout:8/560: symlink d0/d75/lb2 0 2024-09-13T02:52:45.194 INFO:tasks.workunit.client.0.smithi098.stdout:5/196: write d0/d29/f2c [62545,45834] 0 2024-09-13T02:52:45.194 INFO:tasks.workunit.client.1.smithi142.stdout:5/710: dread d8/dc3/d3f/f40 [0,4194304] 0 2024-09-13T02:52:45.194 INFO:tasks.workunit.client.0.smithi098.stdout:5/197: stat d0/d38/d3f/fc 0 2024-09-13T02:52:45.203 INFO:tasks.workunit.client.0.smithi098.stdout:2/223: creat d1/d1f/f3d x:0 0 0 2024-09-13T02:52:45.205 INFO:tasks.workunit.client.0.smithi098.stdout:7/422: symlink d6/d24/d2a/d5a/d86/l87 0 2024-09-13T02:52:45.205 INFO:tasks.workunit.client.1.smithi142.stdout:7/661: write d10/fb2 [3303496,53334] 0 2024-09-13T02:52:45.207 INFO:tasks.workunit.client.1.smithi142.stdout:7/662: chown d10/d13/d1d/d2b/faf 1871158 1 2024-09-13T02:52:45.208 INFO:tasks.workunit.client.0.smithi098.stdout:5/198: mknod d0/d38/d3f/c4a 0 2024-09-13T02:52:45.208 INFO:tasks.workunit.client.1.smithi142.stdout:2/544: dwrite d1/d2d/f6e [0,4194304] 0 2024-09-13T02:52:45.213 INFO:tasks.workunit.client.0.smithi098.stdout:9/225: getdents d2/dd 0 2024-09-13T02:52:45.214 INFO:tasks.workunit.client.0.smithi098.stdout:9/226: dread - d2/dd/d39/d43/f44 zero size 2024-09-13T02:52:45.218 INFO:tasks.workunit.client.0.smithi098.stdout:7/423: rename d6/d49 to d6/d24/d2a/d57/d88 0 2024-09-13T02:52:45.218 INFO:tasks.workunit.client.1.smithi142.stdout:0/703: write d10/d6c/d88/d1a/d1e/d42/d4b/f61 [2060652,37727] 0 2024-09-13T02:52:45.220 INFO:tasks.workunit.client.0.smithi098.stdout:9/227: dwrite d2/dd/f3b [0,4194304] 0 2024-09-13T02:52:45.220 INFO:tasks.workunit.client.0.smithi098.stdout:5/199: unlink d0/d38/d3f/ca 0 2024-09-13T02:52:45.221 INFO:tasks.workunit.client.1.smithi142.stdout:1/730: link d12/d13/d20/d66/d55/db4/fbc d12/d13/dd3/fe2 0 2024-09-13T02:52:45.222 INFO:tasks.workunit.client.0.smithi098.stdout:5/200: dread - d0/d38/d3f/d1a/d32/f33 zero size 2024-09-13T02:52:45.222 INFO:tasks.workunit.client.0.smithi098.stdout:1/285: link d9/d33/l6a d9/d33/d19/d35/d5a/l6c 0 2024-09-13T02:52:45.225 INFO:tasks.workunit.client.1.smithi142.stdout:3/639: dwrite d12/d16/d25/f4f [0,4194304] 0 2024-09-13T02:52:45.226 INFO:tasks.workunit.client.1.smithi142.stdout:3/640: chown d12/d16/d25/f26 21971 1 2024-09-13T02:52:45.228 INFO:tasks.workunit.client.0.smithi098.stdout:7/424: mknod d6/d24/d2a/d57/d88/c89 0 2024-09-13T02:52:45.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:44 smithi098 ceph-mon[27886]: pgmap v21: 65 pgs: 65 active+clean; 1.5 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 209 MiB/s wr, 316 op/s 2024-09-13T02:52:45.233 INFO:tasks.workunit.client.1.smithi142.stdout:9/759: creat dd/f114 x:0 0 0 2024-09-13T02:52:45.237 INFO:tasks.workunit.client.0.smithi098.stdout:5/201: dread d0/ff [0,4194304] 0 2024-09-13T02:52:45.237 INFO:tasks.workunit.client.1.smithi142.stdout:8/561: symlink d0/d6/dc/d40/d46/da1/lb3 0 2024-09-13T02:52:45.238 INFO:tasks.workunit.client.0.smithi098.stdout:5/202: stat d0/d38/d3f/c4a 0 2024-09-13T02:52:45.239 INFO:tasks.workunit.client.0.smithi098.stdout:5/203: write d0/d38/d3f/f11 [3048124,49325] 0 2024-09-13T02:52:45.239 INFO:tasks.workunit.client.0.smithi098.stdout:1/286: rename d9/f10 to d9/d33/d19/d35/d68/d60/f6d 0 2024-09-13T02:52:45.240 INFO:tasks.workunit.client.1.smithi142.stdout:5/711: symlink d8/dc3/d64/le6 0 2024-09-13T02:52:45.244 INFO:tasks.workunit.client.0.smithi098.stdout:1/287: dread d9/d33/f17 [0,4194304] 0 2024-09-13T02:52:45.245 INFO:tasks.workunit.client.0.smithi098.stdout:7/425: mknod d6/d47/c8a 0 2024-09-13T02:52:45.247 INFO:tasks.workunit.client.0.smithi098.stdout:7/426: read d6/d24/d2a/d5a/d42/f71 [267908,10608] 0 2024-09-13T02:52:45.247 INFO:tasks.workunit.client.1.smithi142.stdout:3/641: mknod d12/d16/d3c/d79/d9e/cc8 0 2024-09-13T02:52:45.248 INFO:tasks.workunit.client.1.smithi142.stdout:1/731: creat d12/d13/d1d/d26/d4f/fe3 x:0 0 0 2024-09-13T02:52:45.249 INFO:tasks.workunit.client.1.smithi142.stdout:7/663: mknod d10/d13/d1d/d2b/d56/d5f/cdb 0 2024-09-13T02:52:45.250 INFO:tasks.workunit.client.1.smithi142.stdout:7/664: stat d10/d13/d22/lc6 0 2024-09-13T02:52:45.250 INFO:tasks.workunit.client.1.smithi142.stdout:3/642: write d12/d16/d25/d2e/d38/d4d/d53/d78/f85 [1954566,36882] 0 2024-09-13T02:52:45.250 INFO:tasks.workunit.client.0.smithi098.stdout:5/204: creat d0/f4b x:0 0 0 2024-09-13T02:52:45.252 INFO:tasks.workunit.client.1.smithi142.stdout:8/562: mknod d0/d6/dc/d40/d46/da1/cb4 0 2024-09-13T02:52:45.253 INFO:tasks.workunit.client.1.smithi142.stdout:5/712: symlink d8/dc3/le7 0 2024-09-13T02:52:45.255 INFO:tasks.workunit.client.0.smithi098.stdout:2/224: getdents d1/d1f 0 2024-09-13T02:52:45.256 INFO:tasks.workunit.client.1.smithi142.stdout:0/704: rename d10/d6c/f6d to d10/d6c/d88/d21/d51/d35/fea 0 2024-09-13T02:52:45.256 INFO:tasks.workunit.client.0.smithi098.stdout:2/225: write d1/d1f/d39/f29 [5395395,84782] 0 2024-09-13T02:52:45.258 INFO:tasks.workunit.client.0.smithi098.stdout:5/205: dwrite d0/d38/d3f/f36 [0,4194304] 0 2024-09-13T02:52:45.259 INFO:tasks.workunit.client.1.smithi142.stdout:2/545: dread d1/f5 [0,4194304] 0 2024-09-13T02:52:45.260 INFO:tasks.workunit.client.1.smithi142.stdout:2/546: fsync d1/d2d/f53 0 2024-09-13T02:52:45.260 INFO:tasks.workunit.client.1.smithi142.stdout:1/732: dread d12/d13/d20/d66/d55/f7f [0,4194304] 0 2024-09-13T02:52:45.264 INFO:tasks.workunit.client.0.smithi098.stdout:7/427: rename d6/f5d to d6/d24/d2a/d5a/d42/f8b 0 2024-09-13T02:52:45.265 INFO:tasks.workunit.client.0.smithi098.stdout:9/228: truncate d2/d6/f19 1889583 0 2024-09-13T02:52:45.267 INFO:tasks.workunit.client.0.smithi098.stdout:5/206: dwrite d0/d38/d3f/fc [0,4194304] 0 2024-09-13T02:52:45.273 INFO:tasks.workunit.client.0.smithi098.stdout:1/288: dread f4 [4194304,4194304] 0 2024-09-13T02:52:45.274 INFO:tasks.workunit.client.0.smithi098.stdout:1/289: chown d9/d33/d19/d35/d68/d2f 200590 1 2024-09-13T02:52:45.278 INFO:tasks.workunit.client.1.smithi142.stdout:4/647: sync 2024-09-13T02:52:45.279 INFO:tasks.workunit.client.0.smithi098.stdout:9/229: rename d2/dd/d39/c34 to d2/d6/d36/c52 0 2024-09-13T02:52:45.283 INFO:tasks.workunit.client.0.smithi098.stdout:7/428: symlink d6/d24/d2a/l8c 0 2024-09-13T02:52:45.285 INFO:tasks.workunit.client.0.smithi098.stdout:9/230: dwrite d2/f32 [0,4194304] 0 2024-09-13T02:52:45.290 INFO:tasks.workunit.client.0.smithi098.stdout:9/231: dread d2/dd/d39/d43/f50 [0,4194304] 0 2024-09-13T02:52:45.294 INFO:tasks.workunit.client.0.smithi098.stdout:5/207: link d0/d38/d3f/c3 d0/d15/c4c 0 2024-09-13T02:52:45.297 INFO:tasks.workunit.client.0.smithi098.stdout:1/290: creat d9/d33/d19/d35/d68/f6e x:0 0 0 2024-09-13T02:52:45.303 INFO:tasks.workunit.client.0.smithi098.stdout:1/291: creat d9/d33/f6f x:0 0 0 2024-09-13T02:52:45.304 INFO:tasks.workunit.client.0.smithi098.stdout:1/292: dread - d9/d33/f6f zero size 2024-09-13T02:52:45.307 INFO:tasks.workunit.client.0.smithi098.stdout:5/208: dwrite d0/d15/d17/d1c/f2d [0,4194304] 0 2024-09-13T02:52:45.308 INFO:tasks.workunit.client.0.smithi098.stdout:7/429: creat d6/d24/d2a/d5a/d86/f8d x:0 0 0 2024-09-13T02:52:45.309 INFO:tasks.workunit.client.0.smithi098.stdout:9/232: dread d2/dd/f1e [0,4194304] 0 2024-09-13T02:52:45.312 INFO:tasks.workunit.client.0.smithi098.stdout:2/226: dwrite d1/d1a/dc/d23/f28 [0,4194304] 0 2024-09-13T02:52:45.314 INFO:tasks.workunit.client.0.smithi098.stdout:2/227: read d1/d1a/dc/f37 [3000677,29421] 0 2024-09-13T02:52:45.316 INFO:tasks.workunit.client.0.smithi098.stdout:9/233: creat d2/dd/d39/d43/f53 x:0 0 0 2024-09-13T02:52:45.317 INFO:tasks.workunit.client.0.smithi098.stdout:2/228: write d1/d1f/d30/f34 [713265,95161] 0 2024-09-13T02:52:45.318 INFO:tasks.workunit.client.0.smithi098.stdout:5/209: dwrite d0/d15/f22 [8388608,4194304] 0 2024-09-13T02:52:45.318 INFO:tasks.workunit.client.0.smithi098.stdout:2/229: chown d1/d1c 12 1 2024-09-13T02:52:45.319 INFO:tasks.workunit.client.0.smithi098.stdout:1/293: truncate f8 1423446 0 2024-09-13T02:52:45.322 INFO:tasks.workunit.client.1.smithi142.stdout:3/643: symlink d12/d16/d25/d2e/d38/d4d/d53/da0/lc9 0 2024-09-13T02:52:45.325 INFO:tasks.workunit.client.0.smithi098.stdout:9/234: mknod d2/dd/c54 0 2024-09-13T02:52:45.329 INFO:tasks.workunit.client.1.smithi142.stdout:5/713: symlink d8/d47/d65/da0/dd1/d45/le8 0 2024-09-13T02:52:45.330 INFO:tasks.workunit.client.1.smithi142.stdout:5/714: chown d8/dc3/d3f/ddd/fe0 1 1 2024-09-13T02:52:45.330 INFO:tasks.workunit.client.0.smithi098.stdout:7/430: dread d6/f41 [0,4194304] 0 2024-09-13T02:52:45.331 INFO:tasks.workunit.client.1.smithi142.stdout:5/715: dread - d8/d47/d65/da0/dd1/fb3 zero size 2024-09-13T02:52:45.331 INFO:tasks.workunit.client.0.smithi098.stdout:2/230: creat d1/d1f/d30/f3e x:0 0 0 2024-09-13T02:52:45.332 INFO:tasks.workunit.client.0.smithi098.stdout:5/210: mkdir d0/d38/d3f/d1a/d32/d4d 0 2024-09-13T02:52:45.334 INFO:tasks.workunit.client.0.smithi098.stdout:5/211: write d0/d29/f3e [1044621,74532] 0 2024-09-13T02:52:45.337 INFO:tasks.workunit.client.1.smithi142.stdout:9/760: getdents dd/d17/d44/d82/d99/daf 0 2024-09-13T02:52:45.339 INFO:tasks.workunit.client.0.smithi098.stdout:2/231: chown d1/d1a/c5 12884 1 2024-09-13T02:52:45.340 INFO:tasks.workunit.client.1.smithi142.stdout:7/665: symlink d10/d13/d1d/d2b/d56/d5f/ldc 0 2024-09-13T02:52:45.340 INFO:tasks.workunit.client.1.smithi142.stdout:6/729: sync 2024-09-13T02:52:45.342 INFO:tasks.workunit.client.0.smithi098.stdout:5/212: dwrite d0/d29/f39 [0,4194304] 0 2024-09-13T02:52:45.342 INFO:tasks.workunit.client.1.smithi142.stdout:3/644: creat d12/d16/d25/d2e/d38/d4d/d53/da0/fca x:0 0 0 2024-09-13T02:52:45.342 INFO:tasks.workunit.client.0.smithi098.stdout:5/213: dread - d0/d15/f18 zero size 2024-09-13T02:52:45.345 INFO:tasks.workunit.client.1.smithi142.stdout:8/563: symlink d0/da2/lb5 0 2024-09-13T02:52:45.347 INFO:tasks.workunit.client.1.smithi142.stdout:5/716: fsync d8/d47/f4f 0 2024-09-13T02:52:45.348 INFO:tasks.workunit.client.1.smithi142.stdout:0/705: getdents d10/d6c/d88/d21/d51/d79/de6 0 2024-09-13T02:52:45.348 INFO:tasks.workunit.client.1.smithi142.stdout:5/717: write d8/d47/d65/da0/dd1/d45/d81/d8c/fa4 [1074403,124520] 0 2024-09-13T02:52:45.349 INFO:tasks.workunit.client.0.smithi098.stdout:2/232: creat d1/d1a/dc/f3f x:0 0 0 2024-09-13T02:52:45.350 INFO:tasks.workunit.client.0.smithi098.stdout:0/260: sync 2024-09-13T02:52:45.350 INFO:tasks.workunit.client.0.smithi098.stdout:6/200: sync 2024-09-13T02:52:45.350 INFO:tasks.workunit.client.0.smithi098.stdout:4/206: sync 2024-09-13T02:52:45.351 INFO:tasks.workunit.client.1.smithi142.stdout:2/547: creat d1/de/d31/d6c/d6d/d47/da8/fb3 x:0 0 0 2024-09-13T02:52:45.352 INFO:tasks.workunit.client.0.smithi098.stdout:5/214: rmdir d0/d38/d3f 39 2024-09-13T02:52:45.355 INFO:tasks.workunit.client.0.smithi098.stdout:2/233: dread d1/d1a/f12 [4194304,4194304] 0 2024-09-13T02:52:45.356 INFO:tasks.workunit.client.0.smithi098.stdout:9/235: getdents d2/d6/d2b/d4d 0 2024-09-13T02:52:45.357 INFO:tasks.workunit.client.1.smithi142.stdout:9/761: creat dd/d17/d44/d82/d99/da8/f115 x:0 0 0 2024-09-13T02:52:45.357 INFO:tasks.workunit.client.0.smithi098.stdout:9/236: write d2/d6/f2d [936288,61936] 0 2024-09-13T02:52:45.357 INFO:tasks.workunit.client.1.smithi142.stdout:9/762: chown dd/d17/d44/d82 3 1 2024-09-13T02:52:45.358 INFO:tasks.workunit.client.0.smithi098.stdout:6/201: fsync d5/d18/f1f 0 2024-09-13T02:52:45.360 INFO:tasks.workunit.client.1.smithi142.stdout:7/666: unlink d10/d34/d65/c8a 0 2024-09-13T02:52:45.363 INFO:tasks.workunit.client.0.smithi098.stdout:4/207: creat d6/db/f44 x:0 0 0 2024-09-13T02:52:45.363 INFO:tasks.workunit.client.0.smithi098.stdout:2/234: dwrite d1/d1a/dc/f33 [0,4194304] 0 2024-09-13T02:52:45.366 INFO:tasks.workunit.client.0.smithi098.stdout:5/215: creat d0/f4e x:0 0 0 2024-09-13T02:52:45.368 INFO:tasks.workunit.client.1.smithi142.stdout:3/645: mknod d12/d16/d25/d2e/d38/d4d/d53/da0/ccb 0 2024-09-13T02:52:45.368 INFO:tasks.workunit.client.1.smithi142.stdout:3/646: write d12/f22 [4437187,125167] 0 2024-09-13T02:52:45.370 INFO:tasks.workunit.client.0.smithi098.stdout:0/261: mkdir dd/df/d1d/d40/d46/d50 0 2024-09-13T02:52:45.371 INFO:tasks.workunit.client.0.smithi098.stdout:1/294: dread f1 [0,4194304] 0 2024-09-13T02:52:45.371 INFO:tasks.workunit.client.1.smithi142.stdout:0/706: dread d10/d6c/d88/d36/f59 [0,4194304] 0 2024-09-13T02:52:45.372 INFO:tasks.workunit.client.1.smithi142.stdout:1/733: write d12/d13/d20/d27/d3c/d71/d81/d92/daa/fbe [909256,34129] 0 2024-09-13T02:52:45.373 INFO:tasks.workunit.client.0.smithi098.stdout:0/262: write dd/df/d1d/d26/f44 [358969,52431] 0 2024-09-13T02:52:45.376 INFO:tasks.workunit.client.0.smithi098.stdout:7/431: write d6/d24/d2a/d5a/d4c/f6a [1294768,61622] 0 2024-09-13T02:52:45.377 INFO:tasks.workunit.client.0.smithi098.stdout:7/432: chown d6/d1e/l7a 46101 1 2024-09-13T02:52:45.379 INFO:tasks.workunit.client.1.smithi142.stdout:2/548: mkdir d1/de/d1f/d9c/db4 0 2024-09-13T02:52:45.382 INFO:tasks.workunit.client.0.smithi098.stdout:4/208: rename d6/db/f2a to d6/d22/d3d/d41/f45 0 2024-09-13T02:52:45.383 INFO:tasks.workunit.client.1.smithi142.stdout:4/648: write d0/d2b/d2d/d31/d43/d48/f4d [1095152,59155] 0 2024-09-13T02:52:45.383 INFO:tasks.workunit.client.0.smithi098.stdout:7/433: dwrite d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:45.387 INFO:tasks.workunit.client.0.smithi098.stdout:4/209: dread d6/db/f29 [0,4194304] 0 2024-09-13T02:52:45.388 INFO:tasks.workunit.client.0.smithi098.stdout:4/210: stat d6/d22/f28 0 2024-09-13T02:52:45.390 INFO:tasks.workunit.client.1.smithi142.stdout:7/667: symlink d10/d13/d1d/d2b/dae/dd8/ldd 0 2024-09-13T02:52:45.392 INFO:tasks.workunit.client.0.smithi098.stdout:9/237: truncate d2/dd/d39/f3e 998970 0 2024-09-13T02:52:45.393 INFO:tasks.workunit.client.1.smithi142.stdout:7/668: write d10/d13/d1d/d2b/d56/d39/fbf [86391,71637] 0 2024-09-13T02:52:45.395 INFO:tasks.workunit.client.0.smithi098.stdout:0/263: chown dd/df/d1d/d26/c31 0 1 2024-09-13T02:52:45.395 INFO:tasks.workunit.client.1.smithi142.stdout:6/730: dwrite d1/d7/d5f/d6a/f84 [0,4194304] 0 2024-09-13T02:52:45.396 INFO:tasks.workunit.client.0.smithi098.stdout:9/238: dread - d2/dd/d39/d43/f44 zero size 2024-09-13T02:52:45.396 INFO:tasks.workunit.client.0.smithi098.stdout:1/295: dwrite d9/d33/d19/d35/d68/f3f [0,4194304] 0 2024-09-13T02:52:45.397 INFO:tasks.workunit.client.0.smithi098.stdout:9/239: dread - d2/dd/d39/d43/f53 zero size 2024-09-13T02:52:45.398 INFO:tasks.workunit.client.0.smithi098.stdout:6/202: truncate f3 3591923 0 2024-09-13T02:52:45.401 INFO:tasks.workunit.client.1.smithi142.stdout:8/564: rename d0/d6/dc/d2e/cab to d0/d6/dc/d45/d35/d61/d77/cb6 0 2024-09-13T02:52:45.403 INFO:tasks.workunit.client.1.smithi142.stdout:0/707: creat d10/d6c/d88/d1a/d1e/dc6/feb x:0 0 0 2024-09-13T02:52:45.409 INFO:tasks.workunit.client.0.smithi098.stdout:1/296: dwrite d9/d33/d19/d64/f65 [0,4194304] 0 2024-09-13T02:52:45.409 INFO:tasks.workunit.client.0.smithi098.stdout:1/297: chown d9/d33/d19/d35/d68/c54 95844906 1 2024-09-13T02:52:45.409 INFO:tasks.workunit.client.1.smithi142.stdout:1/734: symlink d12/d13/d20/d66/d55/le4 0 2024-09-13T02:52:45.409 INFO:tasks.workunit.client.1.smithi142.stdout:9/763: write dd/d17/d69/d84/fa9 [714230,101859] 0 2024-09-13T02:52:45.409 INFO:tasks.workunit.client.1.smithi142.stdout:9/764: write dd/f18 [1231975,121765] 0 2024-09-13T02:52:45.419 INFO:tasks.workunit.client.1.smithi142.stdout:4/649: creat d0/d2b/d2d/d31/d32/fca x:0 0 0 2024-09-13T02:52:45.420 INFO:tasks.workunit.client.0.smithi098.stdout:0/264: rename dd/f4f to dd/df/d1d/d26/f51 0 2024-09-13T02:52:45.421 INFO:tasks.workunit.client.0.smithi098.stdout:0/265: write f8 [431519,24731] 0 2024-09-13T02:52:45.422 INFO:tasks.workunit.client.0.smithi098.stdout:6/203: creat d5/d18/f45 x:0 0 0 2024-09-13T02:52:45.425 INFO:tasks.workunit.client.1.smithi142.stdout:7/669: symlink d10/d64/lde 0 2024-09-13T02:52:45.427 INFO:tasks.workunit.client.1.smithi142.stdout:7/670: chown d10/d13/d1d/d25/d5c/da3/da8 7 1 2024-09-13T02:52:45.428 INFO:tasks.workunit.client.1.smithi142.stdout:2/549: dwrite d1/de/f57 [0,4194304] 0 2024-09-13T02:52:45.429 INFO:tasks.workunit.client.1.smithi142.stdout:5/718: truncate d8/d47/d65/da0/dd1/d2d/d90/f88 83465 0 2024-09-13T02:52:45.430 INFO:tasks.workunit.client.0.smithi098.stdout:9/240: dwrite d2/dd/d39/d43/f50 [0,4194304] 0 2024-09-13T02:52:45.431 INFO:tasks.workunit.client.0.smithi098.stdout:5/216: mknod d0/d38/d3f/d1a/c4f 0 2024-09-13T02:52:45.433 INFO:tasks.workunit.client.1.smithi142.stdout:6/731: rename d1/d7/d5f/d6a/ce0 to d1/d59/cf7 0 2024-09-13T02:52:45.434 INFO:tasks.workunit.client.0.smithi098.stdout:4/211: mkdir d6/d3e/d46 0 2024-09-13T02:52:45.434 INFO:tasks.workunit.client.1.smithi142.stdout:6/732: chown d1/dd/d16/d4d/c5e 303246 1 2024-09-13T02:52:45.435 INFO:tasks.workunit.client.1.smithi142.stdout:8/565: write d0/d80/fa0 [469751,56137] 0 2024-09-13T02:52:45.436 INFO:tasks.workunit.client.0.smithi098.stdout:1/298: mknod d9/d33/d1f/d23/d30/c70 0 2024-09-13T02:52:45.436 INFO:tasks.workunit.client.1.smithi142.stdout:0/708: rmdir d10/d6c/d88/d21/d51/d79 39 2024-09-13T02:52:45.437 INFO:tasks.workunit.client.1.smithi142.stdout:8/566: write d0/d6/d23/f7f [790748,118144] 0 2024-09-13T02:52:45.439 INFO:tasks.workunit.client.1.smithi142.stdout:0/709: dread - d10/d6c/d88/d21/d8f/fc5 zero size 2024-09-13T02:52:45.445 INFO:tasks.workunit.client.1.smithi142.stdout:3/647: link d12/d16/d3c/la6 d12/d16/d25/d2e/d48/d5c/d66/lcc 0 2024-09-13T02:52:45.446 INFO:tasks.workunit.client.0.smithi098.stdout:5/217: mkdir d0/d15/d50 0 2024-09-13T02:52:45.448 INFO:tasks.workunit.client.0.smithi098.stdout:1/299: rmdir d9/d33/d29/d58 39 2024-09-13T02:52:45.449 INFO:tasks.workunit.client.0.smithi098.stdout:1/300: dread - d9/d33/d19/d35/d63/f69 zero size 2024-09-13T02:52:45.450 INFO:tasks.workunit.client.1.smithi142.stdout:6/733: mknod d1/d4a/cf8 0 2024-09-13T02:52:45.451 INFO:tasks.workunit.client.1.smithi142.stdout:6/734: write d1/dd/d16/d47/fae [588170,9118] 0 2024-09-13T02:52:45.452 INFO:tasks.workunit.client.1.smithi142.stdout:1/735: symlink d12/d13/d1d/le5 0 2024-09-13T02:52:45.455 INFO:tasks.workunit.client.0.smithi098.stdout:4/212: unlink d6/c9 0 2024-09-13T02:52:45.456 INFO:tasks.workunit.client.0.smithi098.stdout:4/213: chown d6/d22/d3d/d41 951648 1 2024-09-13T02:52:45.456 INFO:tasks.workunit.client.0.smithi098.stdout:4/214: readlink d6/d10/l2c 0 2024-09-13T02:52:45.457 INFO:tasks.workunit.client.1.smithi142.stdout:6/735: dwrite d1/dd/d16/d4e/d32/fbd [0,4194304] 0 2024-09-13T02:52:45.457 INFO:tasks.workunit.client.1.smithi142.stdout:4/650: symlink d0/d2b/d2d/d31/d32/daa/lcb 0 2024-09-13T02:52:45.457 INFO:tasks.workunit.client.0.smithi098.stdout:5/218: truncate d0/d15/f3c 426696 0 2024-09-13T02:52:45.462 INFO:tasks.workunit.client.0.smithi098.stdout:1/301: unlink d9/d33/d29/f45 0 2024-09-13T02:52:45.467 INFO:tasks.workunit.client.0.smithi098.stdout:4/215: symlink d6/d10/l47 0 2024-09-13T02:52:45.467 INFO:tasks.workunit.client.0.smithi098.stdout:6/204: write d5/d13/d2b/d3a/f11 [1622909,62529] 0 2024-09-13T02:52:45.469 INFO:tasks.workunit.client.1.smithi142.stdout:9/765: rename dd/d17/d44/d82/d99/da8/db7/lec to dd/dcb/l116 0 2024-09-13T02:52:45.475 INFO:tasks.workunit.client.0.smithi098.stdout:0/266: creat dd/df/d1d/d40/d46/d50/f52 x:0 0 0 2024-09-13T02:52:45.480 INFO:tasks.workunit.client.0.smithi098.stdout:9/241: truncate d2/dd/d39/d43/f50 1886804 0 2024-09-13T02:52:45.481 INFO:tasks.workunit.client.0.smithi098.stdout:6/205: mknod d5/d18/c46 0 2024-09-13T02:52:45.481 INFO:tasks.workunit.client.0.smithi098.stdout:6/206: dread - d5/f15 zero size 2024-09-13T02:52:45.483 INFO:tasks.workunit.client.0.smithi098.stdout:1/302: dread d9/f38 [0,4194304] 0 2024-09-13T02:52:45.483 INFO:tasks.workunit.client.0.smithi098.stdout:6/207: fdatasync d5/d13/d2b/d3a/f11 0 2024-09-13T02:52:45.484 INFO:tasks.workunit.client.0.smithi098.stdout:6/208: fsync d5/f22 0 2024-09-13T02:52:45.484 INFO:tasks.workunit.client.0.smithi098.stdout:4/216: dread d6/d10/d21/f32 [0,4194304] 0 2024-09-13T02:52:45.485 INFO:tasks.workunit.client.1.smithi142.stdout:4/651: mkdir d0/d2b/d2d/d31/d43/d48/dcc 0 2024-09-13T02:52:45.486 INFO:tasks.workunit.client.0.smithi098.stdout:0/267: read - dd/f2d zero size 2024-09-13T02:52:45.486 INFO:tasks.workunit.client.0.smithi098.stdout:0/268: dread - dd/df/f3d zero size 2024-09-13T02:52:45.487 INFO:tasks.workunit.client.1.smithi142.stdout:3/648: mkdir d12/d16/d3c/d79/d9b/dc1/dcd 0 2024-09-13T02:52:45.488 INFO:tasks.workunit.client.0.smithi098.stdout:9/242: mknod d2/d6/d2b/c55 0 2024-09-13T02:52:45.489 INFO:tasks.workunit.client.1.smithi142.stdout:2/550: creat d1/fb5 x:0 0 0 2024-09-13T02:52:45.492 INFO:tasks.workunit.client.1.smithi142.stdout:8/567: truncate d0/d6/dc/f18 3202979 0 2024-09-13T02:52:45.493 INFO:tasks.workunit.client.1.smithi142.stdout:7/671: rename d10/d34/f5b to d10/d13/d1d/d2b/d56/fdf 0 2024-09-13T02:52:45.494 INFO:tasks.workunit.client.1.smithi142.stdout:1/736: write d12/d13/d20/d66/d55/f8f [1538446,106731] 0 2024-09-13T02:52:45.495 INFO:tasks.workunit.client.1.smithi142.stdout:9/766: dread - dd/d17/f28 zero size 2024-09-13T02:52:45.495 INFO:tasks.workunit.client.1.smithi142.stdout:0/710: truncate d10/d6c/d88/fb9 436721 0 2024-09-13T02:52:45.496 INFO:tasks.workunit.client.0.smithi098.stdout:1/303: mknod d9/d33/d19/d35/d63/c71 0 2024-09-13T02:52:45.497 INFO:tasks.workunit.client.1.smithi142.stdout:8/568: dread d0/d6/d23/f3d [0,4194304] 0 2024-09-13T02:52:45.497 INFO:tasks.workunit.client.1.smithi142.stdout:9/767: write dd/d17/d44/dfa/fb5 [1221314,20269] 0 2024-09-13T02:52:45.498 INFO:tasks.workunit.client.0.smithi098.stdout:6/209: fsync d5/f1e 0 2024-09-13T02:52:45.498 INFO:tasks.workunit.client.0.smithi098.stdout:1/304: chown d9/d33/d19/d35/d63/c71 50375 1 2024-09-13T02:52:45.499 INFO:tasks.workunit.client.1.smithi142.stdout:4/652: fdatasync d0/d2b/d21/d30/f3a 0 2024-09-13T02:52:45.500 INFO:tasks.workunit.client.0.smithi098.stdout:4/217: stat d6/l7 0 2024-09-13T02:52:45.502 INFO:tasks.workunit.client.0.smithi098.stdout:0/269: mkdir dd/df/d1d/d26/d37/d53 0 2024-09-13T02:52:45.503 INFO:tasks.workunit.client.1.smithi142.stdout:0/711: dwrite d10/d6c/f71 [0,4194304] 0 2024-09-13T02:52:45.503 INFO:tasks.workunit.client.1.smithi142.stdout:5/719: link d8/c1a d8/dc3/d3f/ce9 0 2024-09-13T02:52:45.504 INFO:tasks.workunit.client.1.smithi142.stdout:5/720: write d8/d47/fc4 [1328519,20150] 0 2024-09-13T02:52:45.504 INFO:tasks.workunit.client.1.smithi142.stdout:5/721: stat d8/fc1 0 2024-09-13T02:52:45.507 INFO:tasks.workunit.client.0.smithi098.stdout:6/210: creat d5/d18/f47 x:0 0 0 2024-09-13T02:52:45.510 INFO:tasks.workunit.client.0.smithi098.stdout:1/305: dread - d9/d33/d19/d35/d68/d2f/f48 zero size 2024-09-13T02:52:45.513 INFO:tasks.workunit.client.1.smithi142.stdout:6/736: rename d1/d4a/lcf to d1/dd/d57/lf9 0 2024-09-13T02:52:45.519 INFO:tasks.workunit.client.0.smithi098.stdout:9/243: fsync d2/dd/f1e 0 2024-09-13T02:52:45.519 INFO:tasks.workunit.client.0.smithi098.stdout:9/244: readlink d2/d6/l16 0 2024-09-13T02:52:45.520 INFO:tasks.workunit.client.0.smithi098.stdout:9/245: write d2/dd/d39/f25 [1724988,80805] 0 2024-09-13T02:52:45.526 INFO:tasks.workunit.client.1.smithi142.stdout:9/768: rmdir dd/d17 39 2024-09-13T02:52:45.528 INFO:tasks.workunit.client.0.smithi098.stdout:4/218: mknod d6/d10/d21/c48 0 2024-09-13T02:52:45.531 INFO:tasks.workunit.client.0.smithi098.stdout:6/211: dread d5/d13/d2b/d3a/d14/f29 [0,4194304] 0 2024-09-13T02:52:45.532 INFO:tasks.workunit.client.1.smithi142.stdout:3/649: mknod d12/d16/cce 0 2024-09-13T02:52:45.535 INFO:tasks.workunit.client.1.smithi142.stdout:0/712: rmdir d10/d6c/d88/d1a/d1e 39 2024-09-13T02:52:45.537 INFO:tasks.workunit.client.1.smithi142.stdout:5/722: creat d8/d47/d65/da0/dd1/d2d/fea x:0 0 0 2024-09-13T02:52:45.541 INFO:tasks.workunit.client.0.smithi098.stdout:1/306: rename d9/d33/d19/d35/d5a/l6c to d9/l72 0 2024-09-13T02:52:45.542 INFO:tasks.workunit.client.1.smithi142.stdout:7/672: fdatasync d10/d34/f38 0 2024-09-13T02:52:45.544 INFO:tasks.workunit.client.0.smithi098.stdout:4/219: creat d6/d22/d3d/f49 x:0 0 0 2024-09-13T02:52:45.544 INFO:tasks.workunit.client.0.smithi098.stdout:0/270: dwrite dd/d1f/f25 [4194304,4194304] 0 2024-09-13T02:52:45.546 INFO:tasks.workunit.client.1.smithi142.stdout:2/551: rename d1/de/d31/d46 to d1/de/d31/d6c/d6d/db6 0 2024-09-13T02:52:45.550 INFO:tasks.workunit.client.1.smithi142.stdout:1/737: symlink d12/le6 0 2024-09-13T02:52:45.552 INFO:tasks.workunit.client.1.smithi142.stdout:1/738: write d12/d13/d20/d66/d55/f8f [5058954,72877] 0 2024-09-13T02:52:45.555 INFO:tasks.workunit.client.0.smithi098.stdout:1/307: dread - d9/d33/d29/d58/f5c zero size 2024-09-13T02:52:45.559 INFO:tasks.workunit.client.1.smithi142.stdout:6/737: write d1/d4a/f7d [765736,59593] 0 2024-09-13T02:52:45.561 INFO:tasks.workunit.client.0.smithi098.stdout:6/212: link d5/f22 d5/d13/d2b/f48 0 2024-09-13T02:52:45.562 INFO:tasks.workunit.client.1.smithi142.stdout:6/738: read d1/dd/d16/d47/fae [483951,109550] 0 2024-09-13T02:52:45.563 INFO:tasks.workunit.client.1.smithi142.stdout:3/650: mknod d12/d16/d25/d2e/d38/d5a/ccf 0 2024-09-13T02:52:45.563 INFO:tasks.workunit.client.0.smithi098.stdout:9/246: truncate d2/d6/f2a 4119036 0 2024-09-13T02:52:45.564 INFO:tasks.workunit.client.0.smithi098.stdout:9/247: readlink d2/d6/l3c 0 2024-09-13T02:52:45.564 INFO:tasks.workunit.client.1.smithi142.stdout:6/739: dread d1/d7/f3e [0,4194304] 0 2024-09-13T02:52:45.569 INFO:tasks.workunit.client.0.smithi098.stdout:6/213: dwrite d5/d18/f47 [0,4194304] 0 2024-09-13T02:52:45.574 INFO:tasks.workunit.client.1.smithi142.stdout:7/673: creat d10/d13/d1d/d25/d45/dad/fe0 x:0 0 0 2024-09-13T02:52:45.576 INFO:tasks.workunit.client.0.smithi098.stdout:1/308: truncate d9/d33/d19/f21 955199 0 2024-09-13T02:52:45.578 INFO:tasks.workunit.client.0.smithi098.stdout:9/248: truncate d2/dd/f1e 571534 0 2024-09-13T02:52:45.580 INFO:tasks.workunit.client.0.smithi098.stdout:9/249: dread - d2/dd/d39/d43/f4c zero size 2024-09-13T02:52:45.581 INFO:tasks.workunit.client.0.smithi098.stdout:9/250: read d2/dd/d39/f45 [74350,26274] 0 2024-09-13T02:52:45.583 INFO:tasks.workunit.client.0.smithi098.stdout:0/271: link dd/df/d1d/d26/c31 dd/df/d1d/d40/c54 0 2024-09-13T02:52:45.586 INFO:tasks.workunit.client.0.smithi098.stdout:4/220: dwrite d6/d37/f39 [0,4194304] 0 2024-09-13T02:52:45.590 INFO:tasks.workunit.client.1.smithi142.stdout:4/653: rename d0/d2b/d75/f8f to d0/df/da5/dad/dae/fcd 0 2024-09-13T02:52:45.591 INFO:tasks.workunit.client.1.smithi142.stdout:8/569: sync 2024-09-13T02:52:45.591 INFO:tasks.workunit.client.1.smithi142.stdout:4/654: chown d0/d2b/d2d/d31/d32/d82/c8d 211644442 1 2024-09-13T02:52:45.592 INFO:tasks.workunit.client.0.smithi098.stdout:6/214: mknod d5/d13/d2b/d3a/d41/c49 0 2024-09-13T02:52:45.594 INFO:tasks.workunit.client.0.smithi098.stdout:9/251: mkdir d2/d6/d2b/d4d/d56 0 2024-09-13T02:52:45.596 INFO:tasks.workunit.client.0.smithi098.stdout:1/309: mknod d9/d33/d19/d35/d68/d60/d61/c73 0 2024-09-13T02:52:45.597 INFO:tasks.workunit.client.0.smithi098.stdout:1/310: fsync d9/d33/f66 0 2024-09-13T02:52:45.598 INFO:tasks.workunit.client.0.smithi098.stdout:1/311: readlink d9/d33/d1f/d23/d30/l62 0 2024-09-13T02:52:45.599 INFO:tasks.workunit.client.0.smithi098.stdout:1/312: readlink d9/d33/l41 0 2024-09-13T02:52:45.600 INFO:tasks.workunit.client.1.smithi142.stdout:7/674: dread d10/d13/f1c [0,4194304] 0 2024-09-13T02:52:45.602 INFO:tasks.workunit.client.1.smithi142.stdout:5/723: mknod d8/dc3/d3f/ceb 0 2024-09-13T02:52:45.604 INFO:tasks.workunit.client.0.smithi098.stdout:6/215: symlink d5/d13/d2b/d3a/d14/l4a 0 2024-09-13T02:52:45.605 INFO:tasks.workunit.client.1.smithi142.stdout:2/552: mknod d1/de/d31/cb7 0 2024-09-13T02:52:45.607 INFO:tasks.workunit.client.0.smithi098.stdout:0/272: rename c3 to dd/df/d1d/d26/d28/d32/c55 0 2024-09-13T02:52:45.608 INFO:tasks.workunit.client.1.smithi142.stdout:9/769: mknod dd/d17/d69/d84/df8/c117 0 2024-09-13T02:52:45.609 INFO:tasks.workunit.client.0.smithi098.stdout:1/313: symlink d9/d33/d19/d2c/l74 0 2024-09-13T02:52:45.610 INFO:tasks.workunit.client.1.smithi142.stdout:2/553: dwrite d1/d2d/f6e [0,4194304] 0 2024-09-13T02:52:45.611 INFO:tasks.workunit.client.0.smithi098.stdout:4/221: mknod d6/d10/d21/c4a 0 2024-09-13T02:52:45.612 INFO:tasks.workunit.client.0.smithi098.stdout:4/222: fsync d6/d10/d21/f3b 0 2024-09-13T02:52:45.612 INFO:tasks.workunit.client.1.smithi142.stdout:2/554: truncate d1/de/d1f/d13/f9b 230545 0 2024-09-13T02:52:45.616 INFO:tasks.workunit.client.1.smithi142.stdout:8/570: unlink d0/d82/c97 0 2024-09-13T02:52:45.617 INFO:tasks.workunit.client.0.smithi098.stdout:0/273: rmdir dd/df/d1d/d26/d37 39 2024-09-13T02:52:45.617 INFO:tasks.workunit.client.1.smithi142.stdout:4/655: dread d0/d2b/d2d/d31/d32/f3d [0,4194304] 0 2024-09-13T02:52:45.621 INFO:tasks.workunit.client.0.smithi098.stdout:1/314: rename d9/c1e to d9/d33/d1f/d6b/c75 0 2024-09-13T02:52:45.625 INFO:tasks.workunit.client.1.smithi142.stdout:5/724: dread d8/dc3/d3f/f8f [0,4194304] 0 2024-09-13T02:52:45.625 INFO:tasks.workunit.client.1.smithi142.stdout:6/740: creat d1/dd/d16/d47/dad/dd2/ffa x:0 0 0 2024-09-13T02:52:45.625 INFO:tasks.workunit.client.0.smithi098.stdout:1/315: dread d9/d33/d19/d64/f65 [0,4194304] 0 2024-09-13T02:52:45.626 INFO:tasks.workunit.client.1.smithi142.stdout:6/741: readlink d1/d7/d5f/d60/l6b 0 2024-09-13T02:52:45.627 INFO:tasks.workunit.client.1.smithi142.stdout:0/713: link d10/d6c/d88/d45/l4d d10/d6c/d88/d1a/d7a/lec 0 2024-09-13T02:52:45.627 INFO:tasks.workunit.client.0.smithi098.stdout:0/274: symlink dd/df/d1d/d26/d28/d32/l56 0 2024-09-13T02:52:45.628 INFO:tasks.workunit.client.1.smithi142.stdout:7/675: symlink d10/d13/d1d/d2b/d56/d5f/da2/le1 0 2024-09-13T02:52:45.633 INFO:tasks.workunit.client.0.smithi098.stdout:4/223: getdents d6/d3e/d46 0 2024-09-13T02:52:45.636 INFO:tasks.workunit.client.1.smithi142.stdout:9/770: readlink dd/l15 0 2024-09-13T02:52:45.637 INFO:tasks.workunit.client.1.smithi142.stdout:4/656: dread d0/d2b/d2d/f9d [0,4194304] 0 2024-09-13T02:52:45.639 INFO:tasks.workunit.client.1.smithi142.stdout:3/651: truncate d12/d16/d25/f47 3463476 0 2024-09-13T02:52:45.640 INFO:tasks.workunit.client.0.smithi098.stdout:0/275: mknod dd/df/d1d/d26/d28/d32/c57 0 2024-09-13T02:52:45.643 INFO:tasks.workunit.client.1.smithi142.stdout:5/725: creat d8/d47/d65/da0/dd1/d45/fec x:0 0 0 2024-09-13T02:52:45.643 INFO:tasks.workunit.client.1.smithi142.stdout:5/726: write d8/dc3/f5f [5457061,116594] 0 2024-09-13T02:52:45.645 INFO:tasks.workunit.client.1.smithi142.stdout:6/742: mknod d1/d7/d5f/cfb 0 2024-09-13T02:52:45.645 INFO:tasks.workunit.client.0.smithi098.stdout:6/216: getdents d5/d36 0 2024-09-13T02:52:45.647 INFO:tasks.workunit.client.1.smithi142.stdout:0/714: fdatasync d10/f7b 0 2024-09-13T02:52:45.647 INFO:tasks.workunit.client.0.smithi098.stdout:6/217: read d5/f33 [8398,82704] 0 2024-09-13T02:52:45.647 INFO:tasks.workunit.client.0.smithi098.stdout:1/316: truncate d9/d33/f22 2723229 0 2024-09-13T02:52:45.648 INFO:tasks.workunit.client.1.smithi142.stdout:0/715: fdatasync d10/d6c/d88/f6e 0 2024-09-13T02:52:45.650 INFO:tasks.workunit.client.1.smithi142.stdout:6/743: dwrite d1/f41 [0,4194304] 0 2024-09-13T02:52:45.653 INFO:tasks.workunit.client.1.smithi142.stdout:1/739: getdents d12/d13/d20/d27/d3c/d71 0 2024-09-13T02:52:45.654 INFO:tasks.workunit.client.0.smithi098.stdout:6/218: write d5/d13/d2b/d3a/d14/f29 [1000808,55572] 0 2024-09-13T02:52:45.654 INFO:tasks.workunit.client.0.smithi098.stdout:1/317: dwrite d9/d33/f67 [0,4194304] 0 2024-09-13T02:52:45.656 INFO:tasks.workunit.client.1.smithi142.stdout:9/771: mkdir dd/d17/d44/dfa/d118 0 2024-09-13T02:52:45.656 INFO:tasks.workunit.client.0.smithi098.stdout:1/318: chown d9/d33/d29/d58 206823 1 2024-09-13T02:52:45.656 INFO:tasks.workunit.client.0.smithi098.stdout:6/219: write d5/d13/f3f [4141497,117720] 0 2024-09-13T02:52:45.663 INFO:tasks.workunit.client.1.smithi142.stdout:9/772: dwrite dd/d17/d44/d82/d99/f107 [0,4194304] 0 2024-09-13T02:52:45.665 INFO:tasks.workunit.client.0.smithi098.stdout:6/220: creat d5/d13/d2b/d3a/d41/f4b x:0 0 0 2024-09-13T02:52:45.752 INFO:tasks.workunit.client.1.smithi142.stdout:2/555: sync 2024-09-13T02:52:45.768 INFO:tasks.workunit.client.0.smithi098.stdout:3/221: sync 2024-09-13T02:52:45.769 INFO:tasks.workunit.client.0.smithi098.stdout:8/253: sync 2024-09-13T02:52:45.769 INFO:tasks.workunit.client.1.smithi142.stdout:5/727: mkdir d8/dc3/d64/d68/ded 0 2024-09-13T02:52:45.770 INFO:tasks.workunit.client.0.smithi098.stdout:1/319: symlink d9/d33/d19/d35/d5a/l76 0 2024-09-13T02:52:45.772 INFO:tasks.workunit.client.0.smithi098.stdout:0/276: creat dd/df/d1d/d26/d37/d53/f58 x:0 0 0 2024-09-13T02:52:45.773 INFO:tasks.workunit.client.0.smithi098.stdout:8/254: dread d2/dd/f25 [0,4194304] 0 2024-09-13T02:52:45.778 INFO:tasks.workunit.client.0.smithi098.stdout:8/255: dwrite d2/f23 [0,4194304] 0 2024-09-13T02:52:45.779 INFO:tasks.workunit.client.0.smithi098.stdout:8/256: write d2/dd/d11/d1d/f24 [388978,41946] 0 2024-09-13T02:52:45.790 INFO:tasks.workunit.client.0.smithi098.stdout:6/221: rename d5/d13/d2b/d3a/d14/f34 to d5/d18/f4c 0 2024-09-13T02:52:45.791 INFO:tasks.workunit.client.1.smithi142.stdout:0/716: mkdir d10/d6c/d88/d45/ded 0 2024-09-13T02:52:45.793 INFO:tasks.workunit.client.1.smithi142.stdout:6/744: mkdir d1/d7/d19/d30/dfc 0 2024-09-13T02:52:45.795 INFO:tasks.workunit.client.1.smithi142.stdout:1/740: mknod d12/d13/d1d/d26/d4f/da9/ce7 0 2024-09-13T02:52:45.797 INFO:tasks.workunit.client.0.smithi098.stdout:1/320: creat d9/d33/d19/d35/d63/f77 x:0 0 0 2024-09-13T02:52:45.798 INFO:tasks.workunit.client.1.smithi142.stdout:4/657: mknod d0/d2b/d2d/d31/d43/daf/cce 0 2024-09-13T02:52:45.799 INFO:tasks.workunit.client.1.smithi142.stdout:8/571: sync 2024-09-13T02:52:45.800 INFO:tasks.workunit.client.1.smithi142.stdout:8/572: readlink d0/d6/dc/d45/d8/l50 0 2024-09-13T02:52:45.802 INFO:tasks.workunit.client.1.smithi142.stdout:7/676: dwrite d10/d13/d1d/d2b/d56/f6a [0,4194304] 0 2024-09-13T02:52:45.802 INFO:tasks.workunit.client.1.smithi142.stdout:8/573: write d0/d6/dc/d45/d9d/faf [580898,38239] 0 2024-09-13T02:52:45.803 INFO:tasks.workunit.client.1.smithi142.stdout:3/652: fsync d12/d16/d25/d2e/d48/d5c/d8c/daf/fbe 0 2024-09-13T02:52:45.805 INFO:tasks.workunit.client.1.smithi142.stdout:9/773: dread - dd/d17/d5f/d7b/db8/dc0/fe4 zero size 2024-09-13T02:52:45.806 INFO:tasks.workunit.client.1.smithi142.stdout:9/774: chown dd/d17/d25/l3f 122 1 2024-09-13T02:52:45.806 INFO:tasks.workunit.client.1.smithi142.stdout:9/775: chown dd/d17/d4f/d91/dab 26 1 2024-09-13T02:52:45.807 INFO:tasks.workunit.client.0.smithi098.stdout:6/222: creat d5/d13/f4d x:0 0 0 2024-09-13T02:52:45.811 INFO:tasks.workunit.client.0.smithi098.stdout:3/222: truncate d7/d9/d15/d26/f2a 147220 0 2024-09-13T02:52:45.814 INFO:tasks.workunit.client.0.smithi098.stdout:1/321: unlink d9/d33/d19/d35/d68/f6e 0 2024-09-13T02:52:45.814 INFO:tasks.workunit.client.0.smithi098.stdout:1/322: readlink d9/l52 0 2024-09-13T02:52:45.816 INFO:tasks.workunit.client.1.smithi142.stdout:0/717: rename d10/d6c/d88/d21/d8f/de1/ce9 to d10/d6c/d88/d30/cee 0 2024-09-13T02:52:45.821 INFO:tasks.workunit.client.1.smithi142.stdout:1/741: unlink d12/d13/d20/d66/d7d/f85 0 2024-09-13T02:52:45.825 INFO:tasks.workunit.client.0.smithi098.stdout:0/277: creat dd/f59 x:0 0 0 2024-09-13T02:52:45.825 INFO:tasks.workunit.client.0.smithi098.stdout:0/278: fsync dd/d1f/f25 0 2024-09-13T02:52:45.830 INFO:tasks.workunit.client.0.smithi098.stdout:3/223: dread d7/d9/d15/d26/f2a [0,4194304] 0 2024-09-13T02:52:45.832 INFO:tasks.workunit.client.0.smithi098.stdout:6/223: dread d5/d18/f4c [0,4194304] 0 2024-09-13T02:52:45.838 INFO:tasks.workunit.client.1.smithi142.stdout:3/653: rmdir d12/d16/d25 39 2024-09-13T02:52:45.839 INFO:tasks.workunit.client.1.smithi142.stdout:4/658: write d0/d2b/d2d/d31/d32/f58 [1420147,3180] 0 2024-09-13T02:52:45.841 INFO:tasks.workunit.client.1.smithi142.stdout:4/659: write d0/df/da5/dad/fbb [593582,25888] 0 2024-09-13T02:52:45.841 INFO:tasks.workunit.client.0.smithi098.stdout:3/224: dread d7/d9/d25/f36 [0,4194304] 0 2024-09-13T02:52:45.845 INFO:tasks.workunit.client.0.smithi098.stdout:0/279: symlink dd/df/l5a 0 2024-09-13T02:52:45.846 INFO:tasks.workunit.client.0.smithi098.stdout:0/280: stat dd/df/d1d/d26/d28/f30 0 2024-09-13T02:52:45.846 INFO:tasks.workunit.client.1.smithi142.stdout:4/660: dwrite d0/d2b/d2d/d31/fb7 [0,4194304] 0 2024-09-13T02:52:45.847 INFO:tasks.workunit.client.0.smithi098.stdout:3/225: creat d7/d3c/f45 x:0 0 0 2024-09-13T02:52:45.848 INFO:tasks.workunit.client.0.smithi098.stdout:3/226: stat d7/c1f 0 2024-09-13T02:52:45.848 INFO:tasks.workunit.client.1.smithi142.stdout:4/661: chown d0/d2b/d21/d30/f8a 1 1 2024-09-13T02:52:45.849 INFO:tasks.workunit.client.1.smithi142.stdout:9/776: read dd/d17/d44/d82/d99/daf/dc9/fd6 [191210,127669] 0 2024-09-13T02:52:45.849 INFO:tasks.workunit.client.1.smithi142.stdout:2/556: truncate d1/de/d1f/d13/f2a 1137121 0 2024-09-13T02:52:45.850 INFO:tasks.workunit.client.1.smithi142.stdout:2/557: fsync d1/d2c/d92/fa4 0 2024-09-13T02:52:45.852 INFO:tasks.workunit.client.0.smithi098.stdout:3/227: creat d7/d3c/f46 x:0 0 0 2024-09-13T02:52:45.852 INFO:tasks.workunit.client.0.smithi098.stdout:3/228: dread - d7/f43 zero size 2024-09-13T02:52:45.854 INFO:tasks.workunit.client.0.smithi098.stdout:6/224: write d5/fc [3480318,14704] 0 2024-09-13T02:52:45.855 INFO:tasks.workunit.client.0.smithi098.stdout:6/225: truncate d5/d18/f4c 4894276 0 2024-09-13T02:52:45.856 INFO:tasks.workunit.client.1.smithi142.stdout:3/654: write d12/d16/d25/f26 [5035280,26459] 0 2024-09-13T02:52:45.856 INFO:tasks.workunit.client.1.smithi142.stdout:3/655: readlink l6 0 2024-09-13T02:52:45.856 INFO:tasks.workunit.client.0.smithi098.stdout:3/229: write d7/d9/d15/d2d/f42 [419121,101087] 0 2024-09-13T02:52:45.859 INFO:tasks.workunit.client.0.smithi098.stdout:0/281: link dd/f16 dd/df/d1d/d40/d46/f5b 0 2024-09-13T02:52:45.861 INFO:tasks.workunit.client.1.smithi142.stdout:5/728: creat d8/d47/d65/da0/dd1/d2d/d90/fee x:0 0 0 2024-09-13T02:52:45.862 INFO:tasks.workunit.client.0.smithi098.stdout:6/226: dwrite d5/d13/d2b/d3a/d14/f29 [0,4194304] 0 2024-09-13T02:52:45.863 INFO:tasks.workunit.client.0.smithi098.stdout:0/282: creat dd/df/d1d/d40/d46/f5c x:0 0 0 2024-09-13T02:52:45.865 INFO:tasks.workunit.client.1.smithi142.stdout:9/777: rename dd/d17/d44/d82/d99/cea to dd/d87/d8e/da3/ddb/c119 0 2024-09-13T02:52:45.867 INFO:tasks.workunit.client.0.smithi098.stdout:3/230: creat d7/d9/d15/d2d/d34/f47 x:0 0 0 2024-09-13T02:52:45.869 INFO:tasks.workunit.client.1.smithi142.stdout:0/718: creat d10/d6c/d88/d1a/d1e/dc6/fef x:0 0 0 2024-09-13T02:52:45.870 INFO:tasks.workunit.client.0.smithi098.stdout:6/227: mkdir d5/d18/d4e 0 2024-09-13T02:52:45.871 INFO:tasks.workunit.client.1.smithi142.stdout:9/778: dwrite dd/d17/d69/d84/d41/f83 [0,4194304] 0 2024-09-13T02:52:45.871 INFO:tasks.workunit.client.1.smithi142.stdout:0/719: write d10/d6c/d88/d1a/d3a/f3b [2153071,130108] 0 2024-09-13T02:52:45.873 INFO:tasks.workunit.client.0.smithi098.stdout:0/283: dwrite dd/df/d1d/d26/d28/d32/f4d [0,4194304] 0 2024-09-13T02:52:45.875 INFO:tasks.workunit.client.1.smithi142.stdout:2/558: unlink d1/d2c/d92/l8e 0 2024-09-13T02:52:45.878 INFO:tasks.workunit.client.0.smithi098.stdout:3/231: rename d7/d9/d15/c19 to d7/d9/d25/d3a/c48 0 2024-09-13T02:52:45.880 INFO:tasks.workunit.client.0.smithi098.stdout:6/228: creat d5/d36/f4f x:0 0 0 2024-09-13T02:52:45.881 INFO:tasks.workunit.client.0.smithi098.stdout:6/229: write d5/d18/f45 [578037,41692] 0 2024-09-13T02:52:45.883 INFO:tasks.workunit.client.1.smithi142.stdout:8/574: creat d0/d6/dc/d2e/fb7 x:0 0 0 2024-09-13T02:52:45.883 INFO:tasks.workunit.client.0.smithi098.stdout:0/284: mkdir dd/df/d1d/d26/d28/d5d 0 2024-09-13T02:52:45.888 INFO:tasks.workunit.client.0.smithi098.stdout:6/230: mkdir d5/d18/d50 0 2024-09-13T02:52:45.889 INFO:tasks.workunit.client.0.smithi098.stdout:6/231: truncate d5/f31 1005275 0 2024-09-13T02:52:45.890 INFO:tasks.workunit.client.0.smithi098.stdout:0/285: creat dd/df/d1d/d40/d46/d50/f5e x:0 0 0 2024-09-13T02:52:45.891 INFO:tasks.workunit.client.1.smithi142.stdout:4/662: mkdir d0/dc8/dcf 0 2024-09-13T02:52:45.892 INFO:tasks.workunit.client.0.smithi098.stdout:6/232: mkdir d5/d13/d51 0 2024-09-13T02:52:45.893 INFO:tasks.workunit.client.0.smithi098.stdout:6/233: readlink d5/d13/l16 0 2024-09-13T02:52:45.896 INFO:tasks.workunit.client.0.smithi098.stdout:3/232: rename d7/d9/d25/f38 to d7/d9/d15/f49 0 2024-09-13T02:52:45.897 INFO:tasks.workunit.client.1.smithi142.stdout:4/663: dwrite d0/d2b/d2d/d31/d43/fa9 [0,4194304] 0 2024-09-13T02:52:45.901 INFO:tasks.workunit.client.1.smithi142.stdout:6/745: getdents d1/d7/d5f/d60 0 2024-09-13T02:52:45.903 INFO:tasks.workunit.client.1.smithi142.stdout:2/559: symlink d1/d42/d44/d99/lb8 0 2024-09-13T02:52:45.905 INFO:tasks.workunit.client.0.smithi098.stdout:6/234: rename d5/d18/c46 to d5/d36/c52 0 2024-09-13T02:52:45.907 INFO:tasks.workunit.client.1.smithi142.stdout:8/575: creat d0/d6/dc/d45/d35/d93/fb8 x:0 0 0 2024-09-13T02:52:45.908 INFO:tasks.workunit.client.0.smithi098.stdout:3/233: mknod d7/d9/d15/d17/c4a 0 2024-09-13T02:52:45.908 INFO:tasks.workunit.client.1.smithi142.stdout:8/576: dread - d0/d6/dc/d45/d35/fa4 zero size 2024-09-13T02:52:45.909 INFO:tasks.workunit.client.1.smithi142.stdout:7/677: getdents d10/d13/d22 0 2024-09-13T02:52:45.909 INFO:tasks.workunit.client.1.smithi142.stdout:1/742: sync 2024-09-13T02:52:45.912 INFO:tasks.workunit.client.1.smithi142.stdout:8/577: dread d0/d6/dc/fe [0,4194304] 0 2024-09-13T02:52:45.914 INFO:tasks.workunit.client.0.smithi098.stdout:3/234: symlink d7/d9/d25/d2b/l4b 0 2024-09-13T02:52:45.916 INFO:tasks.workunit.client.1.smithi142.stdout:4/664: fsync d0/df/d57/fc1 0 2024-09-13T02:52:45.916 INFO:tasks.workunit.client.1.smithi142.stdout:7/678: dwrite d10/d13/d1d/d25/d45/d92/fba [0,4194304] 0 2024-09-13T02:52:45.917 INFO:tasks.workunit.client.1.smithi142.stdout:9/779: mknod dd/d17/d44/dfa/d118/c11a 0 2024-09-13T02:52:45.917 INFO:tasks.workunit.client.1.smithi142.stdout:0/720: dwrite d10/d6c/d88/d36/f59 [0,4194304] 0 2024-09-13T02:52:45.917 INFO:tasks.workunit.client.0.smithi098.stdout:0/286: dwrite fc [0,4194304] 0 2024-09-13T02:52:45.919 INFO:tasks.workunit.client.1.smithi142.stdout:0/721: stat d10/d6c/d88/d21/f3c 0 2024-09-13T02:52:45.920 INFO:tasks.workunit.client.0.smithi098.stdout:3/235: write d7/d9/d25/f36 [1689864,46897] 0 2024-09-13T02:52:45.926 INFO:tasks.workunit.client.0.smithi098.stdout:3/236: mkdir d7/d9/d4c 0 2024-09-13T02:52:45.927 INFO:tasks.workunit.client.1.smithi142.stdout:3/656: rmdir d12/d16/d25/d2e/d48/d5c/d66/dba 0 2024-09-13T02:52:45.931 INFO:tasks.workunit.client.1.smithi142.stdout:7/679: creat d10/d13/d1d/d2b/d56/fe2 x:0 0 0 2024-09-13T02:52:45.932 INFO:tasks.workunit.client.0.smithi098.stdout:3/237: mknod d7/d9/d15/c4d 0 2024-09-13T02:52:45.933 INFO:tasks.workunit.client.1.smithi142.stdout:6/746: mknod d1/d7/d5f/dec/cfd 0 2024-09-13T02:52:45.934 INFO:tasks.workunit.client.1.smithi142.stdout:0/722: creat d10/d6c/d88/d1a/d7a/ff0 x:0 0 0 2024-09-13T02:52:45.937 INFO:tasks.workunit.client.0.smithi098.stdout:3/238: mknod d7/d9/d15/d17/c4e 0 2024-09-13T02:52:45.937 INFO:tasks.workunit.client.0.smithi098.stdout:0/287: dread dd/f16 [0,4194304] 0 2024-09-13T02:52:45.938 INFO:tasks.workunit.client.1.smithi142.stdout:1/743: symlink d12/d13/d1d/le8 0 2024-09-13T02:52:45.939 INFO:tasks.workunit.client.1.smithi142.stdout:5/729: getdents d8/dc3/d3f/d4a 0 2024-09-13T02:52:45.941 INFO:tasks.workunit.client.0.smithi098.stdout:0/288: mknod dd/df/d1d/d40/d46/c5f 0 2024-09-13T02:52:45.943 INFO:tasks.workunit.client.1.smithi142.stdout:3/657: mknod d12/d16/d25/d2e/d38/d4d/d53/da0/cd0 0 2024-09-13T02:52:45.943 INFO:tasks.workunit.client.0.smithi098.stdout:6/235: dread f3 [0,4194304] 0 2024-09-13T02:52:45.944 INFO:tasks.workunit.client.1.smithi142.stdout:4/665: truncate d0/df/f5d 563984 0 2024-09-13T02:52:45.944 INFO:tasks.workunit.client.0.smithi098.stdout:6/236: stat d5/d36/f4f 0 2024-09-13T02:52:45.944 INFO:tasks.workunit.client.0.smithi098.stdout:3/239: dwrite d7/f43 [0,4194304] 0 2024-09-13T02:52:45.945 INFO:tasks.workunit.client.1.smithi142.stdout:4/666: readlink d0/d2b/d2d/l95 0 2024-09-13T02:52:45.945 INFO:tasks.workunit.client.1.smithi142.stdout:9/780: creat dd/d17/d44/d82/d99/de3/f11b x:0 0 0 2024-09-13T02:52:45.945 INFO:tasks.workunit.client.1.smithi142.stdout:4/667: write d0/d2b/f67 [114383,35325] 0 2024-09-13T02:52:45.947 INFO:tasks.workunit.client.1.smithi142.stdout:0/723: creat d10/d6c/d88/d36/ff1 x:0 0 0 2024-09-13T02:52:45.948 INFO:tasks.workunit.client.0.smithi098.stdout:6/237: mknod d5/d36/c53 0 2024-09-13T02:52:45.950 INFO:tasks.workunit.client.1.smithi142.stdout:1/744: creat d12/d13/d20/d66/d7d/fe9 x:0 0 0 2024-09-13T02:52:45.950 INFO:tasks.workunit.client.1.smithi142.stdout:0/724: read d10/d6c/d88/d30/f86 [489653,54901] 0 2024-09-13T02:52:45.951 INFO:tasks.workunit.client.1.smithi142.stdout:8/578: creat d0/d6/dc/d2e/fb9 x:0 0 0 2024-09-13T02:52:45.951 INFO:tasks.workunit.client.1.smithi142.stdout:0/725: readlink d10/d6c/d88/l9e 0 2024-09-13T02:52:45.953 INFO:tasks.workunit.client.1.smithi142.stdout:3/658: rename d12/d16/d25/d2e/d38/d4d/d53/d78/d7e/fa8 to d12/d16/da3/fd1 0 2024-09-13T02:52:45.953 INFO:tasks.workunit.client.1.smithi142.stdout:6/747: dread d1/d7/d19/f93 [0,4194304] 0 2024-09-13T02:52:45.954 INFO:tasks.workunit.client.1.smithi142.stdout:9/781: dwrite dd/d17/d68/f9b [0,4194304] 0 2024-09-13T02:52:45.955 INFO:tasks.workunit.client.1.smithi142.stdout:4/668: symlink d0/d2b/d2d/d31/d43/d48/ld0 0 2024-09-13T02:52:45.961 INFO:tasks.workunit.client.0.smithi098.stdout:6/238: creat d5/d13/d51/f54 x:0 0 0 2024-09-13T02:52:45.963 INFO:tasks.workunit.client.0.smithi098.stdout:0/289: getdents dd/df/d1d/d26/d37/d53 0 2024-09-13T02:52:45.965 INFO:tasks.workunit.client.1.smithi142.stdout:1/745: mknod d12/d13/d20/d27/d3c/d71/d96/cea 0 2024-09-13T02:52:45.966 INFO:tasks.workunit.client.0.smithi098.stdout:3/240: getdents d7/d9/d15 0 2024-09-13T02:52:45.969 INFO:tasks.workunit.client.0.smithi098.stdout:0/290: mknod dd/df/d1d/d26/d28/d32/c60 0 2024-09-13T02:52:45.972 INFO:tasks.workunit.client.1.smithi142.stdout:6/748: symlink d1/d7/d19/d30/lfe 0 2024-09-13T02:52:45.972 INFO:tasks.workunit.client.1.smithi142.stdout:2/560: dwrite d1/ff [0,4194304] 0 2024-09-13T02:52:45.973 INFO:tasks.workunit.client.1.smithi142.stdout:6/749: read - d1/d7/d19/ff1 zero size 2024-09-13T02:52:45.974 INFO:tasks.workunit.client.0.smithi098.stdout:0/291: unlink f8 0 2024-09-13T02:52:45.975 INFO:tasks.workunit.client.0.smithi098.stdout:3/241: creat d7/d9/d4c/f4f x:0 0 0 2024-09-13T02:52:45.978 INFO:tasks.workunit.client.1.smithi142.stdout:4/669: unlink d0/d2b/d2d/d31/d32/l44 0 2024-09-13T02:52:45.979 INFO:tasks.workunit.client.1.smithi142.stdout:4/670: dread - d0/df/d57/fc1 zero size 2024-09-13T02:52:45.983 INFO:tasks.workunit.client.1.smithi142.stdout:5/730: dread d8/d47/d65/da0/dd1/d61/f83 [4194304,4194304] 0 2024-09-13T02:52:45.984 INFO:tasks.workunit.client.1.smithi142.stdout:5/731: chown d8/d47/d65/da0/dd1/d45/d81/d82/l89 23 1 2024-09-13T02:52:45.984 INFO:tasks.workunit.client.1.smithi142.stdout:5/732: chown d8/dc3/c28 2796 1 2024-09-13T02:52:45.985 INFO:tasks.workunit.client.0.smithi098.stdout:3/242: dwrite d7/d9/d15/d2d/f42 [0,4194304] 0 2024-09-13T02:52:45.988 INFO:tasks.workunit.client.1.smithi142.stdout:0/726: creat d10/d6c/d88/d21/daf/ff2 x:0 0 0 2024-09-13T02:52:45.990 INFO:tasks.workunit.client.0.smithi098.stdout:3/243: mknod d7/d9/c50 0 2024-09-13T02:52:45.993 INFO:tasks.workunit.client.1.smithi142.stdout:5/733: dwrite d8/dc3/d3f/d4a/fb4 [4194304,4194304] 0 2024-09-13T02:52:45.994 INFO:tasks.workunit.client.0.smithi098.stdout:0/292: link fa dd/df/d1d/d40/f61 0 2024-09-13T02:52:45.999 INFO:tasks.workunit.client.1.smithi142.stdout:9/782: mkdir dd/d17/d25/d11c 0 2024-09-13T02:52:46.000 INFO:tasks.workunit.client.0.smithi098.stdout:6/239: dread d5/f1b [0,4194304] 0 2024-09-13T02:52:46.001 INFO:tasks.workunit.client.1.smithi142.stdout:9/783: write dd/d17/d44/d95/fb0 [655293,4902] 0 2024-09-13T02:52:46.002 INFO:tasks.workunit.client.0.smithi098.stdout:0/293: unlink dd/df/d1d/d40/d46/f5c 0 2024-09-13T02:52:46.003 INFO:tasks.workunit.client.0.smithi098.stdout:6/240: dread - d5/d13/d2b/d3a/d14/f3b zero size 2024-09-13T02:52:46.004 INFO:tasks.workunit.client.0.smithi098.stdout:3/244: dwrite d7/d9/d15/f49 [0,4194304] 0 2024-09-13T02:52:46.004 INFO:tasks.workunit.client.0.smithi098.stdout:0/294: truncate dd/f59 204376 0 2024-09-13T02:52:46.008 INFO:tasks.workunit.client.1.smithi142.stdout:1/746: rename d12/d13/d20/d66/d7d/fe9 to d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/feb 0 2024-09-13T02:52:46.010 INFO:tasks.workunit.client.1.smithi142.stdout:2/561: dread d1/d2c/f3f [0,4194304] 0 2024-09-13T02:52:46.011 INFO:tasks.workunit.client.0.smithi098.stdout:3/245: mkdir d7/d9/d25/d3a/d51 0 2024-09-13T02:52:46.012 INFO:tasks.workunit.client.0.smithi098.stdout:0/295: rmdir dd/df/d1d/d26 39 2024-09-13T02:52:46.012 INFO:tasks.workunit.client.0.smithi098.stdout:3/246: read - d7/d3c/f45 zero size 2024-09-13T02:52:46.013 INFO:tasks.workunit.client.0.smithi098.stdout:6/241: dwrite d5/d13/f4d [0,4194304] 0 2024-09-13T02:52:46.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/659: creat d12/d16/d3c/fd2 x:0 0 0 2024-09-13T02:52:46.016 INFO:tasks.workunit.client.1.smithi142.stdout:3/660: stat d12/d16/d25/d2e/d38/d4d/d53/da0/lb2 0 2024-09-13T02:52:46.017 INFO:tasks.workunit.client.0.smithi098.stdout:6/242: readlink d5/d13/d2b/d3a/d14/l2f 0 2024-09-13T02:52:46.017 INFO:tasks.workunit.client.1.smithi142.stdout:4/671: dread d0/d2b/d2d/d31/d32/d82/f8c [0,4194304] 0 2024-09-13T02:52:46.018 INFO:tasks.workunit.client.1.smithi142.stdout:0/727: rmdir d10/d6c/d88/d21/d51/d35 39 2024-09-13T02:52:46.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/734: mknod d8/d47/d65/da0/dd1/d45/dc5/cef 0 2024-09-13T02:52:46.022 INFO:tasks.workunit.client.1.smithi142.stdout:9/784: creat dd/dcb/f11d x:0 0 0 2024-09-13T02:52:46.023 INFO:tasks.workunit.client.0.smithi098.stdout:6/243: mkdir d5/d13/d2b/d3a/d41/d55 0 2024-09-13T02:52:46.024 INFO:tasks.workunit.client.0.smithi098.stdout:3/247: dwrite d7/d9/d4c/f4f [0,4194304] 0 2024-09-13T02:52:46.026 INFO:tasks.workunit.client.1.smithi142.stdout:2/562: readlink d1/de/d31/d6c/d6d/l80 0 2024-09-13T02:52:46.026 INFO:tasks.workunit.client.0.smithi098.stdout:3/248: readlink d7/d9/l2e 0 2024-09-13T02:52:46.027 INFO:tasks.workunit.client.0.smithi098.stdout:6/244: chown d5/d13/d51 7094423 1 2024-09-13T02:52:46.027 INFO:tasks.workunit.client.1.smithi142.stdout:4/672: creat d0/d2b/d2d/d31/d43/d48/fd1 x:0 0 0 2024-09-13T02:52:46.029 INFO:tasks.workunit.client.1.smithi142.stdout:0/728: chown d10/la2 31209 1 2024-09-13T02:52:46.029 INFO:tasks.workunit.client.1.smithi142.stdout:4/673: chown d0/l42 1363162 1 2024-09-13T02:52:46.031 INFO:tasks.workunit.client.0.smithi098.stdout:6/245: creat d5/d13/d51/f56 x:0 0 0 2024-09-13T02:52:46.032 INFO:tasks.workunit.client.1.smithi142.stdout:0/729: read d10/d6c/d88/f6e [500985,111318] 0 2024-09-13T02:52:46.033 INFO:tasks.workunit.client.0.smithi098.stdout:0/296: dwrite dd/f2c [0,4194304] 0 2024-09-13T02:52:46.033 INFO:tasks.workunit.client.1.smithi142.stdout:2/563: dwrite d1/de/da6/fa7 [0,4194304] 0 2024-09-13T02:52:46.034 INFO:tasks.workunit.client.0.smithi098.stdout:0/297: write dd/f59 [357049,76503] 0 2024-09-13T02:52:46.035 INFO:tasks.workunit.client.0.smithi098.stdout:3/249: truncate d7/d9/f31 455041 0 2024-09-13T02:52:46.037 INFO:tasks.workunit.client.1.smithi142.stdout:2/564: fdatasync d1/d2c/d92/fa4 0 2024-09-13T02:52:46.037 INFO:tasks.workunit.client.1.smithi142.stdout:5/735: unlink d8/d47/d65/da0/dd1/fb3 0 2024-09-13T02:52:46.040 INFO:tasks.workunit.client.0.smithi098.stdout:6/246: rename d5/d13/d2b/d3a/d41/c49 to d5/d36/c57 0 2024-09-13T02:52:46.041 INFO:tasks.workunit.client.1.smithi142.stdout:4/674: dwrite d0/fb5 [0,4194304] 0 2024-09-13T02:52:46.041 INFO:tasks.workunit.client.1.smithi142.stdout:9/785: rename dd/d17/d44/d82/d99/la2 to dd/d17/d25/deb/l11e 0 2024-09-13T02:52:46.042 INFO:tasks.workunit.client.1.smithi142.stdout:2/565: fsync d1/de/f57 0 2024-09-13T02:52:46.045 INFO:tasks.workunit.client.1.smithi142.stdout:6/750: getdents d1/dd/d57/d7b 0 2024-09-13T02:52:46.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/250: rmdir d7/d9/d15/d17 39 2024-09-13T02:52:46.050 INFO:tasks.workunit.client.0.smithi098.stdout:3/251: write d7/d9/d25/d2b/f3e [333542,1723] 0 2024-09-13T02:52:46.051 INFO:tasks.workunit.client.0.smithi098.stdout:6/247: fsync d5/f1b 0 2024-09-13T02:52:46.051 INFO:tasks.workunit.client.1.smithi142.stdout:6/751: dwrite d1/dd/d53/f73 [4194304,4194304] 0 2024-09-13T02:52:46.054 INFO:tasks.workunit.client.0.smithi098.stdout:0/298: symlink dd/df/d1d/l62 0 2024-09-13T02:52:46.057 INFO:tasks.workunit.client.1.smithi142.stdout:7/680: sync 2024-09-13T02:52:46.059 INFO:tasks.workunit.client.1.smithi142.stdout:7/681: truncate d10/d13/d1d/d25/d45/d6d/fa9 3441364 0 2024-09-13T02:52:46.060 INFO:tasks.workunit.client.1.smithi142.stdout:0/730: mkdir d10/d6c/d88/d1a/d1e/dc6/df3 0 2024-09-13T02:52:46.062 INFO:tasks.workunit.client.0.smithi098.stdout:6/248: symlink d5/d13/d2b/l58 0 2024-09-13T02:52:46.062 INFO:tasks.workunit.client.1.smithi142.stdout:0/731: write d10/d23/f8d [4330094,99308] 0 2024-09-13T02:52:46.062 INFO:tasks.workunit.client.0.smithi098.stdout:0/299: dwrite dd/f2d [0,4194304] 0 2024-09-13T02:52:46.064 INFO:tasks.workunit.client.1.smithi142.stdout:5/736: mknod d8/d47/cf0 0 2024-09-13T02:52:46.067 INFO:tasks.workunit.client.1.smithi142.stdout:1/747: rename d12/fda to d12/fec 0 2024-09-13T02:52:46.069 INFO:tasks.workunit.client.0.smithi098.stdout:6/249: creat d5/d13/d2b/d3a/d41/f59 x:0 0 0 2024-09-13T02:52:46.071 INFO:tasks.workunit.client.1.smithi142.stdout:2/566: creat d1/de/d1f/d13/fb9 x:0 0 0 2024-09-13T02:52:46.071 INFO:tasks.workunit.client.1.smithi142.stdout:5/737: dwrite d8/d47/d65/da0/dd1/f6a [0,4194304] 0 2024-09-13T02:52:46.072 INFO:tasks.workunit.client.0.smithi098.stdout:0/300: creat dd/df/d1d/f63 x:0 0 0 2024-09-13T02:52:46.073 INFO:tasks.workunit.client.1.smithi142.stdout:2/567: readlink d1/de/d1f/d13/l4e 0 2024-09-13T02:52:46.073 INFO:tasks.workunit.client.1.smithi142.stdout:6/752: rmdir d1/dd/d53 39 2024-09-13T02:52:46.078 INFO:tasks.workunit.client.1.smithi142.stdout:0/732: unlink d10/d6c/d88/d21/d51/le7 0 2024-09-13T02:52:46.079 INFO:tasks.workunit.client.1.smithi142.stdout:0/733: dread - d10/d6c/d88/d1a/d1e/dc6/fe8 zero size 2024-09-13T02:52:46.084 INFO:tasks.workunit.client.1.smithi142.stdout:3/661: truncate d12/d16/d25/d2e/d48/d5c/f44 3523837 0 2024-09-13T02:52:46.085 INFO:tasks.workunit.client.1.smithi142.stdout:4/675: mkdir d0/df/dc9/dd2 0 2024-09-13T02:52:46.089 INFO:tasks.workunit.client.1.smithi142.stdout:5/738: mkdir d8/d47/df1 0 2024-09-13T02:52:46.090 INFO:tasks.workunit.client.1.smithi142.stdout:8/579: sync 2024-09-13T02:52:46.090 INFO:tasks.workunit.client.1.smithi142.stdout:6/753: mknod d1/d7/d19/d30/cff 0 2024-09-13T02:52:46.091 INFO:tasks.workunit.client.1.smithi142.stdout:8/580: chown d0/d6/dc/d45/f10 25269985 1 2024-09-13T02:52:46.091 INFO:tasks.workunit.client.1.smithi142.stdout:0/734: truncate d10/d6c/d88/d1a/d3a/f99 868908 0 2024-09-13T02:52:46.092 INFO:tasks.workunit.client.1.smithi142.stdout:0/735: write d10/d23/f25 [3363606,63668] 0 2024-09-13T02:52:46.092 INFO:tasks.workunit.client.1.smithi142.stdout:7/682: dread d10/fa4 [0,4194304] 0 2024-09-13T02:52:46.093 INFO:tasks.workunit.client.1.smithi142.stdout:0/736: chown d10/d6c/d88/d30 105 1 2024-09-13T02:52:46.094 INFO:tasks.workunit.client.1.smithi142.stdout:9/786: rename dd/d17/d25/d3e/f5d to dd/d17/f11f 0 2024-09-13T02:52:46.094 INFO:tasks.workunit.client.1.smithi142.stdout:0/737: fdatasync d10/d6c/d88/d45/db3/fda 0 2024-09-13T02:52:46.095 INFO:tasks.workunit.client.1.smithi142.stdout:4/676: mknod d0/d2b/d2d/d31/cd3 0 2024-09-13T02:52:46.095 INFO:tasks.workunit.client.1.smithi142.stdout:9/787: dread - dd/d17/d5f/d7b/db8/dc0/fe4 zero size 2024-09-13T02:52:46.096 INFO:tasks.workunit.client.1.smithi142.stdout:2/568: symlink d1/d2d/db2/lba 0 2024-09-13T02:52:46.097 INFO:tasks.workunit.client.1.smithi142.stdout:2/569: dread - d1/de/d31/d6c/d6d/fa5 zero size 2024-09-13T02:52:46.098 INFO:tasks.workunit.client.1.smithi142.stdout:2/570: write d1/d2c/d92/fac [303361,68242] 0 2024-09-13T02:52:46.100 INFO:tasks.workunit.client.1.smithi142.stdout:7/683: mknod d10/d13/d1d/d25/d5c/da3/ce3 0 2024-09-13T02:52:46.102 INFO:tasks.workunit.client.1.smithi142.stdout:1/748: rename d12/d13/d20/d66/d55/f64 to d12/d13/d45/fed 0 2024-09-13T02:52:46.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/677: mkdir d0/d2b/d2d/d31/dd4 0 2024-09-13T02:52:46.106 INFO:tasks.workunit.client.1.smithi142.stdout:6/754: rmdir d1/dd/d53/d78/d8f 39 2024-09-13T02:52:46.108 INFO:tasks.workunit.client.0.smithi098.stdout:0/301: truncate dd/f2d 3473487 0 2024-09-13T02:52:46.109 INFO:tasks.workunit.client.1.smithi142.stdout:8/581: truncate d0/f4c 1104135 0 2024-09-13T02:52:46.110 INFO:tasks.workunit.client.1.smithi142.stdout:8/582: dread - d0/d6/dc/d45/d8/df/f99 zero size 2024-09-13T02:52:46.110 INFO:tasks.workunit.client.1.smithi142.stdout:7/684: unlink d10/d34/d57/d98/fa5 0 2024-09-13T02:52:46.111 INFO:tasks.workunit.client.1.smithi142.stdout:7/685: read - d10/d13/d1d/d25/d45/d6d/dc3/f63 zero size 2024-09-13T02:52:46.112 INFO:tasks.workunit.client.0.smithi098.stdout:0/302: fsync dd/df/d1d/d26/d37/d53/f58 0 2024-09-13T02:52:46.116 INFO:tasks.workunit.client.0.smithi098.stdout:0/303: readlink l9 0 2024-09-13T02:52:46.117 INFO:tasks.workunit.client.0.smithi098.stdout:0/304: fdatasync dd/df/d1d/d26/d28/d32/f4d 0 2024-09-13T02:52:46.119 INFO:tasks.workunit.client.1.smithi142.stdout:0/738: dread d10/d6c/d88/d21/d51/d35/f76 [0,4194304] 0 2024-09-13T02:52:46.120 INFO:tasks.workunit.client.1.smithi142.stdout:0/739: fsync d10/d6c/d88/d45/db3/fda 0 2024-09-13T02:52:46.121 INFO:tasks.workunit.client.1.smithi142.stdout:6/755: mkdir d1/d7/d42/d100 0 2024-09-13T02:52:46.125 INFO:tasks.workunit.client.1.smithi142.stdout:8/583: mkdir d0/d6/dc/d45/dba 0 2024-09-13T02:52:46.129 INFO:tasks.workunit.client.0.smithi098.stdout:0/305: creat dd/df/d1d/f64 x:0 0 0 2024-09-13T02:52:46.129 INFO:tasks.workunit.client.1.smithi142.stdout:1/749: write d12/d13/d1d/d26/fa3 [2557320,109243] 0 2024-09-13T02:52:46.130 INFO:tasks.workunit.client.1.smithi142.stdout:4/678: write d0/d2b/d21/f2a [2788935,31721] 0 2024-09-13T02:52:46.131 INFO:tasks.workunit.client.1.smithi142.stdout:4/679: chown d0/df/da5 6 1 2024-09-13T02:52:46.134 INFO:tasks.workunit.client.1.smithi142.stdout:6/756: mknod d1/d7/d5f/c101 0 2024-09-13T02:52:46.135 INFO:tasks.workunit.client.1.smithi142.stdout:4/680: dread d0/d2b/d2d/f9d [4194304,4194304] 0 2024-09-13T02:52:46.135 INFO:tasks.workunit.client.1.smithi142.stdout:0/740: unlink d10/d6c/d88/d1a/d1e/d42/c78 0 2024-09-13T02:52:46.139 INFO:tasks.workunit.client.1.smithi142.stdout:7/686: dwrite d10/d34/f38 [0,4194304] 0 2024-09-13T02:52:46.140 INFO:tasks.workunit.client.0.smithi098.stdout:0/306: rename dd/df/d1d/d26/d28/d32/l56 to dd/l65 0 2024-09-13T02:52:46.140 INFO:tasks.workunit.client.0.smithi098.stdout:0/307: dread - dd/df/d1d/f64 zero size 2024-09-13T02:52:46.141 INFO:tasks.workunit.client.1.smithi142.stdout:3/662: rename d12/d16/d25/d2e/d38/d4d/d53/d78/d7e to d12/dd3 0 2024-09-13T02:52:46.142 INFO:tasks.workunit.client.1.smithi142.stdout:9/788: getdents dd/d17/d44/d95/dd1 0 2024-09-13T02:52:46.144 INFO:tasks.workunit.client.1.smithi142.stdout:0/741: creat d10/d6c/d88/d1a/d1e/ff4 x:0 0 0 2024-09-13T02:52:46.145 INFO:tasks.workunit.client.1.smithi142.stdout:8/584: getdents d0/d6/d23/d2b 0 2024-09-13T02:52:46.145 INFO:tasks.workunit.client.1.smithi142.stdout:0/742: stat d10/d6c/d88/d1a/ce2 0 2024-09-13T02:52:46.146 INFO:tasks.workunit.client.1.smithi142.stdout:7/687: symlink d10/d13/d1d/d25/d45/d99/le4 0 2024-09-13T02:52:46.146 INFO:tasks.workunit.client.1.smithi142.stdout:8/585: write d0/d6/dc/d45/f65 [4510264,52942] 0 2024-09-13T02:52:46.148 INFO:tasks.workunit.client.1.smithi142.stdout:5/739: rename d8/d47/d65/da0/dd1/d63/fbf to d8/dac/ff2 0 2024-09-13T02:52:46.148 INFO:tasks.workunit.client.1.smithi142.stdout:0/743: dread - d10/d6c/d88/d1a/d62/fd0 zero size 2024-09-13T02:52:46.149 INFO:tasks.workunit.client.1.smithi142.stdout:3/663: mknod d12/d16/d3c/d79/d9e/cd4 0 2024-09-13T02:52:46.150 INFO:tasks.workunit.client.1.smithi142.stdout:8/586: write d0/d6/dc/d45/f65 [5505459,114338] 0 2024-09-13T02:52:46.152 INFO:tasks.workunit.client.1.smithi142.stdout:0/744: dread - d10/d6c/d88/d21/daf/fd3 zero size 2024-09-13T02:52:46.152 INFO:tasks.workunit.client.1.smithi142.stdout:8/587: chown d0/d75 17 1 2024-09-13T02:52:46.152 INFO:tasks.workunit.client.0.smithi098.stdout:0/308: creat dd/df/d1d/d26/d28/d5d/f66 x:0 0 0 2024-09-13T02:52:46.153 INFO:tasks.workunit.client.1.smithi142.stdout:3/664: read - d12/d16/d25/d2e/d48/d5c/d66/fa7 zero size 2024-09-13T02:52:46.153 INFO:tasks.workunit.client.0.smithi098.stdout:0/309: chown dd/df/d1d/d26/d28/c3f 372409847 1 2024-09-13T02:52:46.154 INFO:tasks.workunit.client.1.smithi142.stdout:8/588: write d0/d6/dc/d45/d35/f63 [753574,22749] 0 2024-09-13T02:52:46.155 INFO:tasks.workunit.client.1.smithi142.stdout:2/571: rename d1/d2c to d1/de/da6/dbb 0 2024-09-13T02:52:46.155 INFO:tasks.workunit.client.1.smithi142.stdout:7/688: dwrite d10/d64/fc5 [0,4194304] 0 2024-09-13T02:52:46.156 INFO:tasks.workunit.client.0.smithi098.stdout:0/310: mkdir dd/df/d1d/d26/d28/d32/d67 0 2024-09-13T02:52:46.158 INFO:tasks.workunit.client.1.smithi142.stdout:0/745: rmdir d10/d6c/d88/d21/d8f 39 2024-09-13T02:52:46.158 INFO:tasks.workunit.client.1.smithi142.stdout:7/689: write d10/d13/f76 [2459170,31578] 0 2024-09-13T02:52:46.165 INFO:tasks.workunit.client.1.smithi142.stdout:5/740: dread d8/dc3/f3c [0,4194304] 0 2024-09-13T02:52:46.166 INFO:tasks.workunit.client.1.smithi142.stdout:4/681: getdents d0/d2b/d75 0 2024-09-13T02:52:46.167 INFO:tasks.workunit.client.1.smithi142.stdout:5/741: readlink d8/d47/d65/da0/dd1/d45/d81/d82/l97 0 2024-09-13T02:52:46.168 INFO:tasks.workunit.client.1.smithi142.stdout:5/742: truncate d8/dac/ff2 866421 0 2024-09-13T02:52:46.169 INFO:tasks.workunit.client.1.smithi142.stdout:6/757: rename d1/d7/d5f/dec/cfd to d1/dd/d57/df5/c102 0 2024-09-13T02:52:46.170 INFO:tasks.workunit.client.1.smithi142.stdout:5/743: write d8/d47/d65/da0/dd1/d2d/f7d [1583412,14516] 0 2024-09-13T02:52:46.170 INFO:tasks.workunit.client.1.smithi142.stdout:2/572: symlink d1/d29/d72/daa/lbc 0 2024-09-13T02:52:46.172 INFO:tasks.workunit.client.1.smithi142.stdout:8/589: rmdir d0/d6/dc/d45/d8/df/d28 39 2024-09-13T02:52:46.172 INFO:tasks.workunit.client.1.smithi142.stdout:3/665: dread d12/d16/d25/d2e/d48/d5c/f6e [0,4194304] 0 2024-09-13T02:52:46.179 INFO:tasks.workunit.client.1.smithi142.stdout:8/590: dwrite d0/d6/d83/daa/fb0 [0,4194304] 0 2024-09-13T02:52:46.179 INFO:tasks.workunit.client.1.smithi142.stdout:2/573: dwrite d1/de/d31/d6c/d6d/d47/da8/fb3 [0,4194304] 0 2024-09-13T02:52:46.180 INFO:tasks.workunit.client.1.smithi142.stdout:5/744: rename d8/d47/d65/da0/dd1/d45/d8e to d8/dc3/df3 0 2024-09-13T02:52:46.180 INFO:tasks.workunit.client.1.smithi142.stdout:3/666: stat d12/d16/d3c/d79/d9b/ca4 0 2024-09-13T02:52:46.181 INFO:tasks.workunit.client.1.smithi142.stdout:9/789: write dd/d17/d44/f4a [621570,85091] 0 2024-09-13T02:52:46.182 INFO:tasks.workunit.client.1.smithi142.stdout:5/745: write d8/dc3/df3/f94 [477884,108125] 0 2024-09-13T02:52:46.182 INFO:tasks.workunit.client.1.smithi142.stdout:4/682: getdents d0/d2b/d75 0 2024-09-13T02:52:46.191 INFO:tasks.workunit.client.1.smithi142.stdout:3/667: rename c8 to d12/dd3/cd5 0 2024-09-13T02:52:46.192 INFO:tasks.workunit.client.1.smithi142.stdout:8/591: creat d0/d6/dc/d40/d46/da1/fbb x:0 0 0 2024-09-13T02:52:46.193 INFO:tasks.workunit.client.1.smithi142.stdout:4/683: fsync d0/d2b/d21/d35/f83 0 2024-09-13T02:52:46.196 INFO:tasks.workunit.client.0.smithi098.stdout:0/311: dwrite dd/f45 [0,4194304] 0 2024-09-13T02:52:46.197 INFO:tasks.workunit.client.0.smithi098.stdout:0/312: dread - dd/df/d1d/f63 zero size 2024-09-13T02:52:46.197 INFO:tasks.workunit.client.1.smithi142.stdout:9/790: dread dd/d17/d69/d84/f76 [0,4194304] 0 2024-09-13T02:52:46.198 INFO:tasks.workunit.client.1.smithi142.stdout:5/746: symlink d8/d47/d65/da0/dd1/d63/lf4 0 2024-09-13T02:52:46.198 INFO:tasks.workunit.client.1.smithi142.stdout:0/746: write d10/d23/f4f [1587824,92749] 0 2024-09-13T02:52:46.199 INFO:tasks.workunit.client.1.smithi142.stdout:5/747: chown d8/d47/d65/da0/dd1/d45/fec 15367 1 2024-09-13T02:52:46.201 INFO:tasks.workunit.client.1.smithi142.stdout:6/758: link d1/d7/d19/d30/cff d1/dd/d16/d4e/c103 0 2024-09-13T02:52:46.201 INFO:tasks.workunit.client.1.smithi142.stdout:0/747: readlink d10/d6c/d88/d30/la6 0 2024-09-13T02:52:46.204 INFO:tasks.workunit.client.1.smithi142.stdout:7/690: getdents d10/d13/d1d/d2b/d55 0 2024-09-13T02:52:46.204 INFO:tasks.workunit.client.1.smithi142.stdout:0/748: write d10/d6c/d88/d45/db3/fc7 [681705,38269] 0 2024-09-13T02:52:46.205 INFO:tasks.workunit.client.1.smithi142.stdout:9/791: dwrite dd/d17/d44/d82/d99/da8/f115 [0,4194304] 0 2024-09-13T02:52:46.206 INFO:tasks.workunit.client.0.smithi098.stdout:0/313: rename dd/l65 to dd/df/d1d/d40/l68 0 2024-09-13T02:52:46.208 INFO:tasks.workunit.client.0.smithi098.stdout:0/314: truncate dd/df/d1d/d26/d28/d5d/f66 205000 0 2024-09-13T02:52:46.212 INFO:tasks.workunit.client.0.smithi098.stdout:0/315: chown dd/l4a 334913220 1 2024-09-13T02:52:46.213 INFO:tasks.workunit.client.1.smithi142.stdout:5/748: creat d8/dc3/d3f/d4a/d4b/ff5 x:0 0 0 2024-09-13T02:52:46.215 INFO:tasks.workunit.client.1.smithi142.stdout:3/668: mkdir d12/d16/dc7/dd6 0 2024-09-13T02:52:46.218 INFO:tasks.workunit.client.1.smithi142.stdout:0/749: unlink d10/la2 0 2024-09-13T02:52:46.218 INFO:tasks.workunit.client.1.smithi142.stdout:5/749: dwrite d8/dc3/d3f/f87 [0,4194304] 0 2024-09-13T02:52:46.219 INFO:tasks.workunit.client.1.smithi142.stdout:9/792: creat dd/d87/def/f120 x:0 0 0 2024-09-13T02:52:46.221 INFO:tasks.workunit.client.1.smithi142.stdout:7/691: rename d10/d13/d1d/d2b/d56/d5f/dd5 to d10/d13/d22/de5 0 2024-09-13T02:52:46.221 INFO:tasks.workunit.client.1.smithi142.stdout:4/684: getdents d0/d2b/d2d/da2 0 2024-09-13T02:52:46.223 INFO:tasks.workunit.client.1.smithi142.stdout:4/685: write d0/d2b/f41 [68749,87789] 0 2024-09-13T02:52:46.224 INFO:tasks.workunit.client.1.smithi142.stdout:3/669: creat d12/d16/d3c/d79/d9b/fd7 x:0 0 0 2024-09-13T02:52:46.224 INFO:tasks.workunit.client.1.smithi142.stdout:0/750: dwrite d10/d6c/d88/d21/d51/f3e [0,4194304] 0 2024-09-13T02:52:46.226 INFO:tasks.workunit.client.1.smithi142.stdout:9/793: mknod dd/d87/d8e/da3/ddb/c121 0 2024-09-13T02:52:46.227 INFO:tasks.workunit.client.1.smithi142.stdout:5/750: rename d8/l70 to d8/d47/d65/da0/lf6 0 2024-09-13T02:52:46.229 INFO:tasks.workunit.client.1.smithi142.stdout:4/686: creat d0/d7e/fd5 x:0 0 0 2024-09-13T02:52:46.231 INFO:tasks.workunit.client.1.smithi142.stdout:7/692: symlink d10/d13/d1d/le6 0 2024-09-13T02:52:46.232 INFO:tasks.workunit.client.1.smithi142.stdout:1/750: sync 2024-09-13T02:52:46.232 INFO:tasks.workunit.client.1.smithi142.stdout:3/670: symlink d12/ld8 0 2024-09-13T02:52:46.233 INFO:tasks.workunit.client.1.smithi142.stdout:0/751: getdents d10/d6c/d88/d21/daf/dc4 0 2024-09-13T02:52:46.234 INFO:tasks.workunit.client.1.smithi142.stdout:1/751: chown d12/d13/d20/d66/d55 196 1 2024-09-13T02:52:46.234 INFO:tasks.workunit.client.1.smithi142.stdout:7/693: read d10/d13/d1d/d25/d45/d6d/dc3/f43 [842486,10992] 0 2024-09-13T02:52:46.235 INFO:tasks.workunit.client.1.smithi142.stdout:5/751: mknod d8/dc3/df3/dc6/de2/cf7 0 2024-09-13T02:52:46.237 INFO:tasks.workunit.client.1.smithi142.stdout:4/687: creat d0/dc8/dcf/fd6 x:0 0 0 2024-09-13T02:52:46.237 INFO:tasks.workunit.client.1.smithi142.stdout:9/794: creat dd/d17/d69/d84/f122 x:0 0 0 2024-09-13T02:52:46.238 INFO:tasks.workunit.client.1.smithi142.stdout:3/671: creat d12/d16/d25/d2e/d38/d6b/fd9 x:0 0 0 2024-09-13T02:52:46.239 INFO:tasks.workunit.client.1.smithi142.stdout:5/752: creat d8/dc3/d3f/ddd/ff8 x:0 0 0 2024-09-13T02:52:46.239 INFO:tasks.workunit.client.1.smithi142.stdout:1/752: dread d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/f80 [0,4194304] 0 2024-09-13T02:52:46.240 INFO:tasks.workunit.client.1.smithi142.stdout:9/795: unlink dd/dcb/fcd 0 2024-09-13T02:52:46.241 INFO:tasks.workunit.client.1.smithi142.stdout:1/753: chown d12/d13/d1d/f6c 60806891 1 2024-09-13T02:52:46.241 INFO:tasks.workunit.client.1.smithi142.stdout:5/753: dread - d8/d47/d65/da0/dd1/d45/d81/fd5 zero size 2024-09-13T02:52:46.246 INFO:tasks.workunit.client.1.smithi142.stdout:9/796: getdents dd/d17/d44/d82/d99/da8 0 2024-09-13T02:52:46.247 INFO:tasks.workunit.client.1.smithi142.stdout:5/754: creat d8/d47/d65/da0/dd1/d45/d81/d82/ff9 x:0 0 0 2024-09-13T02:52:46.251 INFO:tasks.workunit.client.0.smithi098.stdout:2/235: sync 2024-09-13T02:52:46.253 INFO:tasks.workunit.client.1.smithi142.stdout:9/797: write dd/d17/d4f/f6b [513947,110446] 0 2024-09-13T02:52:46.254 INFO:tasks.workunit.client.1.smithi142.stdout:3/672: dwrite d12/d16/d25/d2e/d38/d6b/fd9 [0,4194304] 0 2024-09-13T02:52:46.255 INFO:tasks.workunit.client.1.smithi142.stdout:4/688: dread d0/d2b/d2d/d31/d43/d48/f4d [0,4194304] 0 2024-09-13T02:52:46.255 INFO:tasks.workunit.client.1.smithi142.stdout:5/755: chown d8/d47/d65/da0/dd1/d61/dcb 0 1 2024-09-13T02:52:46.256 INFO:tasks.workunit.client.0.smithi098.stdout:2/236: unlink d1/d1c/f2f 0 2024-09-13T02:52:46.256 INFO:tasks.workunit.client.0.smithi098.stdout:2/237: fsync d1/d1a/dc/f3f 0 2024-09-13T02:52:46.258 INFO:tasks.workunit.client.1.smithi142.stdout:6/759: truncate d1/d7/f50 303629 0 2024-09-13T02:52:46.260 INFO:tasks.workunit.client.1.smithi142.stdout:9/798: readlink dd/d17/d4f/l9d 0 2024-09-13T02:52:46.261 INFO:tasks.workunit.client.0.smithi098.stdout:2/238: creat d1/d1a/dc/d23/f40 x:0 0 0 2024-09-13T02:52:46.263 INFO:tasks.workunit.client.1.smithi142.stdout:0/752: dread d10/d6c/d88/d1a/d1e/d42/f77 [0,4194304] 0 2024-09-13T02:52:46.266 INFO:tasks.workunit.client.0.smithi098.stdout:2/239: dread d1/d1a/dc/d23/f28 [0,4194304] 0 2024-09-13T02:52:46.267 INFO:tasks.workunit.client.0.smithi098.stdout:2/240: write d1/f8 [3389015,58712] 0 2024-09-13T02:52:46.268 INFO:tasks.workunit.client.1.smithi142.stdout:7/694: dread d10/d13/d1d/f2d [0,4194304] 0 2024-09-13T02:52:46.270 INFO:tasks.workunit.client.1.smithi142.stdout:9/799: dwrite dd/d17/d44/d82/d99/de3/f11b [0,4194304] 0 2024-09-13T02:52:46.273 INFO:tasks.workunit.client.0.smithi098.stdout:2/241: creat d1/d1f/d39/f41 x:0 0 0 2024-09-13T02:52:46.274 INFO:tasks.workunit.client.1.smithi142.stdout:2/574: sync 2024-09-13T02:52:46.278 INFO:tasks.workunit.client.1.smithi142.stdout:4/689: dread d0/f8e [0,4194304] 0 2024-09-13T02:52:46.279 INFO:tasks.workunit.client.1.smithi142.stdout:4/690: fdatasync d0/d2b/d2d/d31/f8b 0 2024-09-13T02:52:46.279 INFO:tasks.workunit.client.0.smithi098.stdout:2/242: unlink d1/d1a/dc/d23/f40 0 2024-09-13T02:52:46.288 INFO:tasks.workunit.client.1.smithi142.stdout:1/754: truncate d12/d13/d20/d66/d55/da0/f6f 364107 0 2024-09-13T02:52:46.289 INFO:tasks.workunit.client.1.smithi142.stdout:5/756: unlink d8/dc3/d3f/f87 0 2024-09-13T02:52:46.292 INFO:tasks.workunit.client.1.smithi142.stdout:7/695: creat d10/d64/fe7 x:0 0 0 2024-09-13T02:52:46.293 INFO:tasks.workunit.client.1.smithi142.stdout:8/592: sync 2024-09-13T02:52:46.294 INFO:tasks.workunit.client.1.smithi142.stdout:8/593: stat d0/d6/dc/d2e/fb9 0 2024-09-13T02:52:46.295 INFO:tasks.workunit.client.1.smithi142.stdout:4/691: unlink d0/l64 0 2024-09-13T02:52:46.296 INFO:tasks.workunit.client.1.smithi142.stdout:8/594: fdatasync d0/d6/dc/d45/d8/f71 0 2024-09-13T02:52:46.296 INFO:tasks.workunit.client.1.smithi142.stdout:5/757: dwrite d8/dc3/f59 [0,4194304] 0 2024-09-13T02:52:46.300 INFO:tasks.workunit.client.1.smithi142.stdout:3/673: link d12/d16/d25/d2e/d38/d4d/d53/faa d12/d16/dc7/fda 0 2024-09-13T02:52:46.300 INFO:tasks.workunit.client.1.smithi142.stdout:3/674: stat d12/d16/f43 0 2024-09-13T02:52:46.301 INFO:tasks.workunit.client.1.smithi142.stdout:2/575: creat d1/de/d1f/d9c/db4/fbd x:0 0 0 2024-09-13T02:52:46.302 INFO:tasks.workunit.client.1.smithi142.stdout:2/576: truncate d1/d2d/f53 1292423 0 2024-09-13T02:52:46.304 INFO:tasks.workunit.client.1.smithi142.stdout:7/696: unlink d10/d13/d1d/d25/d45/d92/lcc 0 2024-09-13T02:52:46.304 INFO:tasks.workunit.client.1.smithi142.stdout:7/697: fdatasync d10/d13/f76 0 2024-09-13T02:52:46.307 INFO:tasks.workunit.client.1.smithi142.stdout:1/755: mknod d12/d13/cee 0 2024-09-13T02:52:46.310 INFO:tasks.workunit.client.1.smithi142.stdout:6/760: rename d1/dd/d16/d47 to d1/dd/d53/d78/d104 0 2024-09-13T02:52:46.313 INFO:tasks.workunit.client.1.smithi142.stdout:1/756: dwrite d12/d13/d20/d27/d3c/d71/d81/d92/daa/fbe [0,4194304] 0 2024-09-13T02:52:46.315 INFO:tasks.workunit.client.1.smithi142.stdout:7/698: mknod d10/d13/d1d/d2b/d55/ce8 0 2024-09-13T02:52:46.317 INFO:tasks.workunit.client.1.smithi142.stdout:5/758: mkdir d8/dc3/d64/d68/ded/dfa 0 2024-09-13T02:52:46.325 INFO:tasks.workunit.client.1.smithi142.stdout:4/692: creat d0/d2b/d2d/d65/fd7 x:0 0 0 2024-09-13T02:52:46.325 INFO:tasks.workunit.client.1.smithi142.stdout:5/759: fsync d8/d47/d65/f80 0 2024-09-13T02:52:46.327 INFO:tasks.workunit.client.1.smithi142.stdout:0/753: rename d10/d6c/d88/d21/d51/c3f to d10/d6c/d88/d45/cf5 0 2024-09-13T02:52:46.328 INFO:tasks.workunit.client.1.smithi142.stdout:7/699: dread d10/d13/d1d/d2b/dae/d9c/fbb [0,4194304] 0 2024-09-13T02:52:46.332 INFO:tasks.workunit.client.1.smithi142.stdout:8/595: rename d0/d6/dc/d45/d8/df/c31 to d0/d6/dc/d45/d35/d61/d77/cbc 0 2024-09-13T02:52:46.333 INFO:tasks.workunit.client.1.smithi142.stdout:6/761: getdents d1/dd 0 2024-09-13T02:52:46.334 INFO:tasks.workunit.client.1.smithi142.stdout:5/760: dwrite d8/dc3/f3d [4194304,4194304] 0 2024-09-13T02:52:46.336 INFO:tasks.workunit.client.1.smithi142.stdout:7/700: rename d10/fa4 to d10/d13/d1d/d2b/d56/fe9 0 2024-09-13T02:52:46.337 INFO:tasks.workunit.client.1.smithi142.stdout:0/754: dwrite d10/d6c/d88/d1a/d3a/fc9 [0,4194304] 0 2024-09-13T02:52:46.338 INFO:tasks.workunit.client.1.smithi142.stdout:7/701: write d10/d64/d88/fd6 [395157,101206] 0 2024-09-13T02:52:46.338 INFO:tasks.workunit.client.1.smithi142.stdout:8/596: symlink d0/d6/dc/d40/d4d/lbd 0 2024-09-13T02:52:46.338 INFO:tasks.workunit.client.1.smithi142.stdout:0/755: fsync d10/d6c/d88/f6e 0 2024-09-13T02:52:46.342 INFO:tasks.workunit.client.1.smithi142.stdout:5/761: truncate d8/d47/d65/da0/dd1/d45/dc5/fcc 163415 0 2024-09-13T02:52:46.342 INFO:tasks.workunit.client.1.smithi142.stdout:0/756: write d10/d6c/d88/d1a/fd5 [1171719,93554] 0 2024-09-13T02:52:46.343 INFO:tasks.workunit.client.1.smithi142.stdout:9/800: write dd/d17/d25/f6a [3702701,18743] 0 2024-09-13T02:52:46.346 INFO:tasks.workunit.client.1.smithi142.stdout:5/762: write d8/f19 [3881299,4028] 0 2024-09-13T02:52:46.347 INFO:tasks.workunit.client.1.smithi142.stdout:8/597: fsync d0/d6/dc/d45/d35/d37/f54 0 2024-09-13T02:52:46.348 INFO:tasks.workunit.client.1.smithi142.stdout:0/757: fdatasync fd 0 2024-09-13T02:52:46.352 INFO:tasks.workunit.client.1.smithi142.stdout:7/702: dwrite d10/d13/d1d/d44/f89 [4194304,4194304] 0 2024-09-13T02:52:46.358 INFO:tasks.workunit.client.1.smithi142.stdout:2/577: write d1/de/d1f/f8d [2678126,58336] 0 2024-09-13T02:52:46.358 INFO:tasks.workunit.client.1.smithi142.stdout:8/598: rmdir d0/d6/dc/d40/d46/da1 39 2024-09-13T02:52:46.360 INFO:tasks.workunit.client.1.smithi142.stdout:7/703: mkdir d10/d13/d22/dea 0 2024-09-13T02:52:46.364 INFO:tasks.workunit.client.1.smithi142.stdout:3/675: truncate d12/f13 4799232 0 2024-09-13T02:52:46.364 INFO:tasks.workunit.client.1.smithi142.stdout:2/578: mknod d1/de/d1f/d13/d59/cbe 0 2024-09-13T02:52:46.366 INFO:tasks.workunit.client.1.smithi142.stdout:7/704: dwrite fd [0,4194304] 0 2024-09-13T02:52:46.367 INFO:tasks.workunit.client.1.smithi142.stdout:0/758: rename d10/d6c/d88/d45/f57 to d10/d6c/d88/ff6 0 2024-09-13T02:52:46.369 INFO:tasks.workunit.client.1.smithi142.stdout:4/693: write d0/d2b/d2d/d31/d32/d82/f92 [756697,12212] 0 2024-09-13T02:52:46.374 INFO:tasks.workunit.client.1.smithi142.stdout:7/705: creat d10/d13/d1d/d2b/d56/feb x:0 0 0 2024-09-13T02:52:46.375 INFO:tasks.workunit.client.1.smithi142.stdout:1/757: dwrite d12/d13/d1d/d26/d4f/fb1 [0,4194304] 0 2024-09-13T02:52:46.378 INFO:tasks.workunit.client.1.smithi142.stdout:0/759: rename d10/d23/f87 to d10/d6c/d88/d1a/d62/ff7 0 2024-09-13T02:52:46.378 INFO:tasks.workunit.client.1.smithi142.stdout:1/758: write d12/d13/d20/d66/d55/f44 [4443401,73346] 0 2024-09-13T02:52:46.379 INFO:tasks.workunit.client.1.smithi142.stdout:2/579: dwrite d1/de/da6/fa7 [0,4194304] 0 2024-09-13T02:52:46.381 INFO:tasks.workunit.client.1.smithi142.stdout:1/759: chown d12/d13/d1d/d26/fa3 1244006 1 2024-09-13T02:52:46.382 INFO:tasks.workunit.client.1.smithi142.stdout:4/694: mkdir d0/d2b/dd8 0 2024-09-13T02:52:46.386 INFO:tasks.workunit.client.1.smithi142.stdout:1/760: write d12/d13/d1d/fc6 [979635,27026] 0 2024-09-13T02:52:46.388 INFO:tasks.workunit.client.1.smithi142.stdout:0/760: symlink d10/d6c/d88/d21/d51/d35/d9b/lf8 0 2024-09-13T02:52:46.390 INFO:tasks.workunit.client.1.smithi142.stdout:5/763: write d8/d47/d65/da0/dd1/d45/f54 [5034210,67520] 0 2024-09-13T02:52:46.392 INFO:tasks.workunit.client.1.smithi142.stdout:9/801: dread dd/d17/f2b [0,4194304] 0 2024-09-13T02:52:46.394 INFO:tasks.workunit.client.1.smithi142.stdout:7/706: dwrite d10/d13/d1d/d2b/d56/fdf [0,4194304] 0 2024-09-13T02:52:46.394 INFO:tasks.workunit.client.1.smithi142.stdout:7/707: chown d10/f47 23 1 2024-09-13T02:52:46.396 INFO:tasks.workunit.client.1.smithi142.stdout:7/708: write d10/d13/d1d/d25/d45/d99/fb3 [864586,36672] 0 2024-09-13T02:52:46.398 INFO:tasks.workunit.client.1.smithi142.stdout:7/709: read d10/d64/f7c [478850,38092] 0 2024-09-13T02:52:46.403 INFO:tasks.workunit.client.1.smithi142.stdout:1/761: dread d12/d13/d1d/fc6 [0,4194304] 0 2024-09-13T02:52:46.403 INFO:tasks.workunit.client.1.smithi142.stdout:1/762: chown d12/d13/d20/f48 8 1 2024-09-13T02:52:46.430 INFO:tasks.workunit.client.0.smithi098.stdout:4/224: sync 2024-09-13T02:52:46.434 INFO:tasks.workunit.client.1.smithi142.stdout:8/599: sync 2024-09-13T02:52:46.444 INFO:tasks.workunit.client.0.smithi098.stdout:4/225: unlink d6/db/f44 0 2024-09-13T02:52:46.445 INFO:tasks.workunit.client.1.smithi142.stdout:3/676: write d12/d16/d25/f60 [881849,39888] 0 2024-09-13T02:52:46.445 INFO:tasks.workunit.client.1.smithi142.stdout:4/695: creat d0/d2b/dd8/fd9 x:0 0 0 2024-09-13T02:52:46.448 INFO:tasks.workunit.client.0.smithi098.stdout:4/226: symlink d6/d37/l4b 0 2024-09-13T02:52:46.449 INFO:tasks.workunit.client.0.smithi098.stdout:4/227: read - d6/db/f40 zero size 2024-09-13T02:52:46.453 INFO:tasks.workunit.client.1.smithi142.stdout:2/580: dwrite d1/f5 [0,4194304] 0 2024-09-13T02:52:46.454 INFO:tasks.workunit.client.1.smithi142.stdout:2/581: fdatasync d1/de/d31/f3d 0 2024-09-13T02:52:46.455 INFO:tasks.workunit.client.1.smithi142.stdout:8/600: mknod d0/d6/d83/daa/cbe 0 2024-09-13T02:52:46.457 INFO:tasks.workunit.client.1.smithi142.stdout:4/696: symlink d0/d2b/d2d/d31/d43/daf/lda 0 2024-09-13T02:52:46.458 INFO:tasks.workunit.client.0.smithi098.stdout:4/228: rmdir d6 39 2024-09-13T02:52:46.459 INFO:tasks.workunit.client.1.smithi142.stdout:0/761: symlink d10/d6c/d88/d21/d51/d79/lf9 0 2024-09-13T02:52:46.461 INFO:tasks.workunit.client.1.smithi142.stdout:6/762: dwrite d1/d7/f50 [0,4194304] 0 2024-09-13T02:52:46.463 INFO:tasks.workunit.client.1.smithi142.stdout:6/763: truncate d1/dd/d53/fdc 2730975 0 2024-09-13T02:52:46.465 INFO:tasks.workunit.client.0.smithi098.stdout:4/229: symlink d6/l4c 0 2024-09-13T02:52:46.467 INFO:tasks.workunit.client.1.smithi142.stdout:1/763: mknod d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/cef 0 2024-09-13T02:52:46.467 INFO:tasks.workunit.client.1.smithi142.stdout:2/582: creat d1/de/da6/dbb/d92/fbf x:0 0 0 2024-09-13T02:52:46.469 INFO:tasks.workunit.client.0.smithi098.stdout:4/230: mkdir d6/d22/d3d/d4d 0 2024-09-13T02:52:46.472 INFO:tasks.workunit.client.0.smithi098.stdout:4/231: rmdir d6/d37 39 2024-09-13T02:52:46.473 INFO:tasks.workunit.client.1.smithi142.stdout:9/802: write dd/d17/d4f/d91/f93 [924441,113533] 0 2024-09-13T02:52:46.474 INFO:tasks.workunit.client.1.smithi142.stdout:4/697: creat d0/d2b/d21/fdb x:0 0 0 2024-09-13T02:52:46.475 INFO:tasks.workunit.client.1.smithi142.stdout:5/764: truncate d8/d47/d65/fad 3547342 0 2024-09-13T02:52:46.475 INFO:tasks.workunit.client.1.smithi142.stdout:9/803: chown dd/d17/d44/d82/d99/da8/db7/ce2 1113274 1 2024-09-13T02:52:46.475 INFO:tasks.workunit.client.1.smithi142.stdout:9/804: fdatasync dd/f18 0 2024-09-13T02:52:46.476 INFO:tasks.workunit.client.1.smithi142.stdout:0/762: symlink d10/d6c/lfa 0 2024-09-13T02:52:46.477 INFO:tasks.workunit.client.1.smithi142.stdout:5/765: fdatasync d8/d47/d65/da0/dd1/d45/d81/d82/ff9 0 2024-09-13T02:52:46.477 INFO:tasks.workunit.client.0.smithi098.stdout:4/232: write d6/d22/d3d/d41/f45 [1127370,32694] 0 2024-09-13T02:52:46.478 INFO:tasks.workunit.client.0.smithi098.stdout:4/233: chown d6/d22/d3d/f49 448734610 1 2024-09-13T02:52:46.479 INFO:tasks.workunit.client.1.smithi142.stdout:7/710: symlink d10/d13/d1d/d2b/d55/d32/lec 0 2024-09-13T02:52:46.479 INFO:tasks.workunit.client.1.smithi142.stdout:6/764: creat d1/dd/d57/f105 x:0 0 0 2024-09-13T02:52:46.479 INFO:tasks.workunit.client.1.smithi142.stdout:5/766: dread - d8/d47/d65/da0/dd1/d2d/d90/fee zero size 2024-09-13T02:52:46.480 INFO:tasks.workunit.client.1.smithi142.stdout:1/764: creat d12/d13/d20/d66/ff0 x:0 0 0 2024-09-13T02:52:46.481 INFO:tasks.workunit.client.1.smithi142.stdout:2/583: creat d1/d29/d72/fc0 x:0 0 0 2024-09-13T02:52:46.481 INFO:tasks.workunit.client.0.smithi098.stdout:4/234: mknod d6/db/c4e 0 2024-09-13T02:52:46.483 INFO:tasks.workunit.client.1.smithi142.stdout:5/767: truncate d8/d47/d65/da0/dd1/fa8 1109757 0 2024-09-13T02:52:46.484 INFO:tasks.workunit.client.1.smithi142.stdout:3/677: dread d12/d16/d25/d2e/d38/d5a/f87 [0,4194304] 0 2024-09-13T02:52:46.485 INFO:tasks.workunit.client.1.smithi142.stdout:9/805: dread - dd/d17/d44/d82/d99/daf/dc9/f104 zero size 2024-09-13T02:52:46.485 INFO:tasks.workunit.client.0.smithi098.stdout:4/235: symlink d6/d37/l4f 0 2024-09-13T02:52:46.486 INFO:tasks.workunit.client.1.smithi142.stdout:7/711: dwrite d10/d64/fcd [0,4194304] 0 2024-09-13T02:52:46.486 INFO:tasks.workunit.client.0.smithi098.stdout:4/236: write d6/d10/f1f [361825,14411] 0 2024-09-13T02:52:46.487 INFO:tasks.workunit.client.1.smithi142.stdout:0/763: symlink d10/d6c/d88/d1a/d1e/d42/d4b/d85/lfb 0 2024-09-13T02:52:46.488 INFO:tasks.workunit.client.1.smithi142.stdout:6/765: creat d1/d7/d5f/d60/f106 x:0 0 0 2024-09-13T02:52:46.489 INFO:tasks.workunit.client.0.smithi098.stdout:4/237: rename d6/d37/l4f to d6/d37/l50 0 2024-09-13T02:52:46.489 INFO:tasks.workunit.client.0.smithi098.stdout:4/238: fdatasync d6/db/f40 0 2024-09-13T02:52:46.490 INFO:tasks.workunit.client.1.smithi142.stdout:4/698: symlink d0/d2b/ldc 0 2024-09-13T02:52:46.493 INFO:tasks.workunit.client.0.smithi098.stdout:4/239: rename d6/d22/c33 to d6/d37/c51 0 2024-09-13T02:52:46.495 INFO:tasks.workunit.client.1.smithi142.stdout:0/764: dwrite d10/d6c/d88/d21/d51/d35/f8c [0,4194304] 0 2024-09-13T02:52:46.496 INFO:tasks.workunit.client.1.smithi142.stdout:9/806: dread - dd/d87/d8e/da3/ddb/fe7 zero size 2024-09-13T02:52:46.497 INFO:tasks.workunit.client.1.smithi142.stdout:9/807: stat dd/d17/d44/d82/d99/da8 0 2024-09-13T02:52:46.498 INFO:tasks.workunit.client.0.smithi098.stdout:4/240: unlink d6/d10/l27 0 2024-09-13T02:52:46.500 INFO:tasks.workunit.client.1.smithi142.stdout:2/584: symlink d1/de/d1f/lc1 0 2024-09-13T02:52:46.503 INFO:tasks.workunit.client.1.smithi142.stdout:6/766: write d1/dd/d53/d78/d8f/da8/fb4 [298439,126830] 0 2024-09-13T02:52:46.505 INFO:tasks.workunit.client.0.smithi098.stdout:4/241: rename d6/db/l1b to d6/d22/d3d/l52 0 2024-09-13T02:52:46.507 INFO:tasks.workunit.client.1.smithi142.stdout:8/601: getdents d0 0 2024-09-13T02:52:46.507 INFO:tasks.workunit.client.1.smithi142.stdout:2/585: dwrite d1/de/d31/f3d [0,4194304] 0 2024-09-13T02:52:46.509 INFO:tasks.workunit.client.1.smithi142.stdout:2/586: read - d1/de/d31/d6c/d6d/fa5 zero size 2024-09-13T02:52:46.510 INFO:tasks.workunit.client.0.smithi098.stdout:7/434: sync 2024-09-13T02:52:46.510 INFO:tasks.workunit.client.1.smithi142.stdout:4/699: rmdir d0/d2b/d2d/d31 39 2024-09-13T02:52:46.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/768: rename d8/c14 to d8/dc3/d3f/d4a/d4b/cfb 0 2024-09-13T02:52:46.516 INFO:tasks.workunit.client.0.smithi098.stdout:7/435: unlink d6/d24/d2a/l58 0 2024-09-13T02:52:46.517 INFO:tasks.workunit.client.1.smithi142.stdout:8/602: dwrite d0/d6/dc/d40/d41/f4e [4194304,4194304] 0 2024-09-13T02:52:46.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/587: dwrite d1/fa3 [0,4194304] 0 2024-09-13T02:52:46.517 INFO:tasks.workunit.client.1.smithi142.stdout:7/712: dread d10/d13/f3d [0,4194304] 0 2024-09-13T02:52:46.520 INFO:tasks.workunit.client.0.smithi098.stdout:7/436: mkdir d6/d24/d2a/d5a/d8e 0 2024-09-13T02:52:46.521 INFO:tasks.workunit.client.0.smithi098.stdout:7/437: chown d6/d24/d2a/d57/l5b 3592 1 2024-09-13T02:52:46.522 INFO:tasks.workunit.client.0.smithi098.stdout:7/438: chown d6/d24/f26 394 1 2024-09-13T02:52:46.522 INFO:tasks.workunit.client.1.smithi142.stdout:3/678: write fe [2332410,19766] 0 2024-09-13T02:52:46.527 INFO:tasks.workunit.client.1.smithi142.stdout:6/767: fsync d1/d7/d5f/d6a/f99 0 2024-09-13T02:52:46.530 INFO:tasks.workunit.client.1.smithi142.stdout:4/700: mkdir d0/d7e/ddd 0 2024-09-13T02:52:46.531 INFO:tasks.workunit.client.1.smithi142.stdout:4/701: write d0/df/da5/dad/fb2 [144051,3354] 0 2024-09-13T02:52:46.535 INFO:tasks.workunit.client.0.smithi098.stdout:4/242: dwrite d6/db/fc [0,4194304] 0 2024-09-13T02:52:46.535 INFO:tasks.workunit.client.1.smithi142.stdout:8/603: creat d0/d6/d23/d64/fbf x:0 0 0 2024-09-13T02:52:46.536 INFO:tasks.workunit.client.1.smithi142.stdout:1/765: sync 2024-09-13T02:52:46.538 INFO:tasks.workunit.client.1.smithi142.stdout:1/766: write d12/d13/d20/d66/d55/db4/fd5 [805347,67960] 0 2024-09-13T02:52:46.539 INFO:tasks.workunit.client.0.smithi098.stdout:4/243: dread d6/d10/d21/f32 [0,4194304] 0 2024-09-13T02:52:46.540 INFO:tasks.workunit.client.1.smithi142.stdout:6/768: write d1/d7/d19/f2f [1278118,6720] 0 2024-09-13T02:52:46.543 INFO:tasks.workunit.client.1.smithi142.stdout:5/769: fdatasync d8/d47/d65/da0/dd1/d2d/d90/f88 0 2024-09-13T02:52:46.544 INFO:tasks.workunit.client.0.smithi098.stdout:4/244: chown d6/d37/c51 337 1 2024-09-13T02:52:46.544 INFO:tasks.workunit.client.0.smithi098.stdout:4/245: readlink l4 0 2024-09-13T02:52:46.545 INFO:tasks.workunit.client.1.smithi142.stdout:2/588: unlink d1/de/d1f/l21 0 2024-09-13T02:52:46.545 INFO:tasks.workunit.client.1.smithi142.stdout:8/604: dwrite d0/d6/f2a [0,4194304] 0 2024-09-13T02:52:46.548 INFO:tasks.workunit.client.0.smithi098.stdout:4/246: symlink d6/d10/l53 0 2024-09-13T02:52:46.549 INFO:tasks.workunit.client.1.smithi142.stdout:3/679: symlink d12/ldb 0 2024-09-13T02:52:46.551 INFO:tasks.workunit.client.1.smithi142.stdout:0/765: rename d10/d6c/d88/d1a/d62/lcd to d10/lfc 0 2024-09-13T02:52:46.554 INFO:tasks.workunit.client.0.smithi098.stdout:7/439: dwrite d6/d24/d2a/d5a/f4d [0,4194304] 0 2024-09-13T02:52:46.555 INFO:tasks.workunit.client.1.smithi142.stdout:4/702: creat d0/d2b/d2d/d31/d32/d82/fde x:0 0 0 2024-09-13T02:52:46.555 INFO:tasks.workunit.client.0.smithi098.stdout:7/440: chown d6/d1e/l7a 11 1 2024-09-13T02:52:46.559 INFO:tasks.workunit.client.0.smithi098.stdout:4/247: mkdir d6/d54 0 2024-09-13T02:52:46.562 INFO:tasks.workunit.client.1.smithi142.stdout:7/713: write d10/d13/d1d/d2b/d55/f67 [2757857,19596] 0 2024-09-13T02:52:46.563 INFO:tasks.workunit.client.0.smithi098.stdout:4/248: symlink d6/d22/d3d/d41/l55 0 2024-09-13T02:52:46.563 INFO:tasks.workunit.client.1.smithi142.stdout:7/714: read - d10/d13/d21/fc7 zero size 2024-09-13T02:52:46.568 INFO:tasks.workunit.client.1.smithi142.stdout:8/605: mkdir d0/d6/d23/d64/dc0 0 2024-09-13T02:52:46.570 INFO:tasks.workunit.client.1.smithi142.stdout:5/770: write d8/dc3/f3c [884401,73829] 0 2024-09-13T02:52:46.573 INFO:tasks.workunit.client.1.smithi142.stdout:9/808: rename dd/d17/l46 to dd/d87/d8e/da3/l123 0 2024-09-13T02:52:46.574 INFO:tasks.workunit.client.0.smithi098.stdout:7/441: getdents d6/d47 0 2024-09-13T02:52:46.575 INFO:tasks.workunit.client.0.smithi098.stdout:4/249: truncate d6/d10/d21/f25 3195713 0 2024-09-13T02:52:46.576 INFO:tasks.workunit.client.0.smithi098.stdout:7/442: chown d6/d24/d2a/d5a/d86/c79 10315876 1 2024-09-13T02:52:46.579 INFO:tasks.workunit.client.1.smithi142.stdout:7/715: symlink d10/d13/d1d/d25/d45/d6d/dc3/led 0 2024-09-13T02:52:46.580 INFO:tasks.workunit.client.1.smithi142.stdout:0/766: dwrite d10/d6c/d88/d1a/f90 [0,4194304] 0 2024-09-13T02:52:46.583 INFO:tasks.workunit.client.1.smithi142.stdout:8/606: mknod d0/d6/dc/d45/cc1 0 2024-09-13T02:52:46.584 INFO:tasks.workunit.client.1.smithi142.stdout:7/716: read - d10/d34/d57/d98/fb7 zero size 2024-09-13T02:52:46.585 INFO:tasks.workunit.client.1.smithi142.stdout:5/771: symlink d8/d47/d65/da0/dd1/d45/d81/lfc 0 2024-09-13T02:52:46.586 INFO:tasks.workunit.client.1.smithi142.stdout:5/772: stat d8/f1f 0 2024-09-13T02:52:46.587 INFO:tasks.workunit.client.1.smithi142.stdout:9/809: fsync dd/f36 0 2024-09-13T02:52:46.587 INFO:tasks.workunit.client.1.smithi142.stdout:7/717: dread - d10/d13/d1d/d2b/dae/f8f zero size 2024-09-13T02:52:46.589 INFO:tasks.workunit.client.1.smithi142.stdout:4/703: symlink d0/d2b/d2d/d31/d43/ldf 0 2024-09-13T02:52:46.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/810: read - dd/d87/f10a zero size 2024-09-13T02:52:46.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/811: chown dd/d87/ce5 486203 1 2024-09-13T02:52:46.591 INFO:tasks.workunit.client.1.smithi142.stdout:0/767: mknod d10/d6c/d88/d30/cfd 0 2024-09-13T02:52:46.593 INFO:tasks.workunit.client.1.smithi142.stdout:1/767: getdents d12/d13/d20/d27/d3c/d71/d81/d92/daa 0 2024-09-13T02:52:46.595 INFO:tasks.workunit.client.1.smithi142.stdout:2/589: write d1/d2d/f64 [2271397,47061] 0 2024-09-13T02:52:46.596 INFO:tasks.workunit.client.1.smithi142.stdout:2/590: fsync d1/de/d31/d6c/d6d/d47/faf 0 2024-09-13T02:52:46.598 INFO:tasks.workunit.client.1.smithi142.stdout:2/591: write d1/d42/f8f [256684,86362] 0 2024-09-13T02:52:46.598 INFO:tasks.workunit.client.1.smithi142.stdout:3/680: getdents d12/d16/d3c/d7d/d91 0 2024-09-13T02:52:46.599 INFO:tasks.workunit.client.1.smithi142.stdout:1/768: mkdir d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/df1 0 2024-09-13T02:52:46.600 INFO:tasks.workunit.client.1.smithi142.stdout:7/718: link d10/d13/d1d/d2b/f8e d10/d13/d1d/d2b/dae/fee 0 2024-09-13T02:52:46.601 INFO:tasks.workunit.client.1.smithi142.stdout:9/812: mknod dd/d17/d44/c124 0 2024-09-13T02:52:46.602 INFO:tasks.workunit.client.1.smithi142.stdout:8/607: rmdir d0/d6/dc/d45/dba 0 2024-09-13T02:52:46.602 INFO:tasks.workunit.client.1.smithi142.stdout:1/769: stat d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/df1 0 2024-09-13T02:52:46.603 INFO:tasks.workunit.client.1.smithi142.stdout:6/769: rename d1/d7/d19/d30/c31 to d1/dd/d53/d78/d104/dad/c107 0 2024-09-13T02:52:46.605 INFO:tasks.workunit.client.1.smithi142.stdout:6/770: chown d1/d7/d5f/d60/l6b 1850712 1 2024-09-13T02:52:46.606 INFO:tasks.workunit.client.1.smithi142.stdout:4/704: getdents d0/d7e/db8 0 2024-09-13T02:52:46.607 INFO:tasks.workunit.client.1.smithi142.stdout:2/592: dwrite d1/de/d31/d6c/f88 [0,4194304] 0 2024-09-13T02:52:46.608 INFO:tasks.workunit.client.1.smithi142.stdout:3/681: link d12/d16/da3/fd1 d12/d16/d25/d2e/d48/d5c/d8c/daf/fdc 0 2024-09-13T02:52:46.609 INFO:tasks.workunit.client.1.smithi142.stdout:8/608: fsync d0/d6/dc/d45/d35/d37/f5d 0 2024-09-13T02:52:46.609 INFO:tasks.workunit.client.1.smithi142.stdout:6/771: truncate d1/d7/f8d 1998793 0 2024-09-13T02:52:46.609 INFO:tasks.workunit.client.1.smithi142.stdout:2/593: chown d1/de/f61 310124 1 2024-09-13T02:52:46.612 INFO:tasks.workunit.client.1.smithi142.stdout:5/773: write d8/d47/d65/da0/dd1/d61/f71 [1269642,9505] 0 2024-09-13T02:52:46.615 INFO:tasks.workunit.client.1.smithi142.stdout:9/813: link dd/d17/d4f/f10f dd/d17/d69/d84/d41/f125 0 2024-09-13T02:52:46.615 INFO:tasks.workunit.client.1.smithi142.stdout:7/719: dwrite d10/d34/d57/fda [4194304,4194304] 0 2024-09-13T02:52:46.618 INFO:tasks.workunit.client.1.smithi142.stdout:1/770: mknod d12/d13/d20/d27/d3c/d71/d81/cf2 0 2024-09-13T02:52:46.618 INFO:tasks.workunit.client.1.smithi142.stdout:3/682: dread d12/d16/d25/d2e/f49 [0,4194304] 0 2024-09-13T02:52:46.619 INFO:tasks.workunit.client.1.smithi142.stdout:6/772: mkdir d1/dd/d53/d78/db8/d108 0 2024-09-13T02:52:46.623 INFO:tasks.workunit.client.0.smithi098.stdout:7/443: fsync d6/d24/d2a/d5a/d4c/f60 0 2024-09-13T02:52:46.624 INFO:tasks.workunit.client.1.smithi142.stdout:7/720: write d10/d13/d1d/d25/d5c/da3/da8/fb0 [921970,103284] 0 2024-09-13T02:52:46.624 INFO:tasks.workunit.client.1.smithi142.stdout:4/705: dwrite d0/df/da5/dad/fbb [0,4194304] 0 2024-09-13T02:52:46.627 INFO:tasks.workunit.client.0.smithi098.stdout:4/250: creat d6/d10/d21/f56 x:0 0 0 2024-09-13T02:52:46.627 INFO:tasks.workunit.client.1.smithi142.stdout:2/594: truncate d1/de/d1f/d13/f33 3958189 0 2024-09-13T02:52:46.629 INFO:tasks.workunit.client.0.smithi098.stdout:4/251: dread d6/d10/d21/f32 [0,4194304] 0 2024-09-13T02:52:46.635 INFO:tasks.workunit.client.1.smithi142.stdout:8/609: dwrite d0/d6/dc/d45/d35/d93/fb8 [0,4194304] 0 2024-09-13T02:52:46.635 INFO:tasks.workunit.client.1.smithi142.stdout:5/774: mknod d8/dc3/d3f/ddd/cfd 0 2024-09-13T02:52:46.635 INFO:tasks.workunit.client.1.smithi142.stdout:9/814: rename dd/d17/d5f/d7b to dd/d98/d126 0 2024-09-13T02:52:46.636 INFO:tasks.workunit.client.1.smithi142.stdout:3/683: mknod d12/d16/d25/d2e/d38/d4d/d53/d78/cdd 0 2024-09-13T02:52:46.637 INFO:tasks.workunit.client.0.smithi098.stdout:7/444: creat d6/d24/d2a/d5a/d86/d65/f8f x:0 0 0 2024-09-13T02:52:46.637 INFO:tasks.workunit.client.1.smithi142.stdout:6/773: dwrite d1/d7/d5f/d6a/f84 [0,4194304] 0 2024-09-13T02:52:46.638 INFO:tasks.workunit.client.0.smithi098.stdout:4/252: dwrite d6/d22/d3d/f49 [0,4194304] 0 2024-09-13T02:52:46.638 INFO:tasks.workunit.client.1.smithi142.stdout:1/771: creat d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/ff3 x:0 0 0 2024-09-13T02:52:46.639 INFO:tasks.workunit.client.1.smithi142.stdout:3/684: truncate d12/d16/d25/d2e/d38/d4d/d53/d78/fc5 112458 0 2024-09-13T02:52:46.641 INFO:tasks.workunit.client.1.smithi142.stdout:3/685: write d12/d16/d3c/f62 [922480,66749] 0 2024-09-13T02:52:46.642 INFO:tasks.workunit.client.1.smithi142.stdout:4/706: unlink d0/df/da5/dad/fc0 0 2024-09-13T02:52:46.645 INFO:tasks.workunit.client.1.smithi142.stdout:7/721: mknod d10/d13/d1d/d2b/d56/d39/cef 0 2024-09-13T02:52:46.647 INFO:tasks.workunit.client.0.smithi098.stdout:4/253: dwrite d6/d10/d21/f56 [0,4194304] 0 2024-09-13T02:52:46.647 INFO:tasks.workunit.client.1.smithi142.stdout:2/595: readlink d1/de/l5f 0 2024-09-13T02:52:46.647 INFO:tasks.workunit.client.1.smithi142.stdout:2/596: fdatasync d1/de/d1f/f63 0 2024-09-13T02:52:46.650 INFO:tasks.workunit.client.1.smithi142.stdout:8/610: creat d0/d6/dc/d45/d35/d93/fc2 x:0 0 0 2024-09-13T02:52:46.652 INFO:tasks.workunit.client.1.smithi142.stdout:5/775: creat d8/d47/d65/da0/dd1/d45/d81/d8c/ffe x:0 0 0 2024-09-13T02:52:46.657 INFO:tasks.workunit.client.0.smithi098.stdout:4/254: creat d6/d22/d3d/d4d/f57 x:0 0 0 2024-09-13T02:52:46.661 INFO:tasks.workunit.client.1.smithi142.stdout:4/707: mkdir d0/dc8/dcf/de0 0 2024-09-13T02:52:46.662 INFO:tasks.workunit.client.0.smithi098.stdout:4/255: mkdir d6/d22/d3d/d41/d58 0 2024-09-13T02:52:46.663 INFO:tasks.workunit.client.0.smithi098.stdout:4/256: readlink d6/d37/l4b 0 2024-09-13T02:52:46.665 INFO:tasks.workunit.client.1.smithi142.stdout:7/722: fdatasync d10/d34/d65/f6e 0 2024-09-13T02:52:46.666 INFO:tasks.workunit.client.1.smithi142.stdout:2/597: mkdir d1/de/da6/dbb/dc2 0 2024-09-13T02:52:46.666 INFO:tasks.workunit.client.1.smithi142.stdout:7/723: write d10/d13/d1d/d2b/d56/fdf [374054,89638] 0 2024-09-13T02:52:46.667 INFO:tasks.workunit.client.1.smithi142.stdout:7/724: chown d10/d34/d65 104050648 1 2024-09-13T02:52:46.668 INFO:tasks.workunit.client.1.smithi142.stdout:7/725: dread - d10/d64/fe7 zero size 2024-09-13T02:52:46.668 INFO:tasks.workunit.client.1.smithi142.stdout:2/598: read d1/de/d31/d6c/d6d/f34 [341415,129127] 0 2024-09-13T02:52:46.669 INFO:tasks.workunit.client.0.smithi098.stdout:4/257: rename d6/db/fc to d6/d3e/f59 0 2024-09-13T02:52:46.669 INFO:tasks.workunit.client.0.smithi098.stdout:4/258: stat d6/d37/c51 0 2024-09-13T02:52:46.669 INFO:tasks.workunit.client.1.smithi142.stdout:0/768: sync 2024-09-13T02:52:46.671 INFO:tasks.workunit.client.1.smithi142.stdout:5/776: unlink d8/d47/d65/da0/dd1/d45/d62/l6e 0 2024-09-13T02:52:46.674 INFO:tasks.workunit.client.1.smithi142.stdout:4/708: rename d0/d2b/d21/d35/l6b to d0/d2b/d2d/d65/d87/le1 0 2024-09-13T02:52:46.675 INFO:tasks.workunit.client.1.smithi142.stdout:4/709: fsync d0/d2b/dd8/fd9 0 2024-09-13T02:52:46.678 INFO:tasks.workunit.client.1.smithi142.stdout:9/815: rmdir dd/d98/d126/d112 0 2024-09-13T02:52:46.679 INFO:tasks.workunit.client.0.smithi098.stdout:7/445: dread d6/d24/d2a/d5a/f22 [0,4194304] 0 2024-09-13T02:52:46.684 INFO:tasks.workunit.client.0.smithi098.stdout:7/446: rename d6/d24/d2a/d5a/f27 to d6/d47/f90 0 2024-09-13T02:52:46.685 INFO:tasks.workunit.client.0.smithi098.stdout:7/447: stat d6/d24/d2a/d5a/c1a 0 2024-09-13T02:52:46.686 INFO:tasks.workunit.client.1.smithi142.stdout:5/777: rename d8/dc3/d3f/ceb to d8/d47/d65/da0/dd1/d45/d62/cff 0 2024-09-13T02:52:46.687 INFO:tasks.workunit.client.0.smithi098.stdout:4/259: dread d6/d22/d3d/d41/f45 [0,4194304] 0 2024-09-13T02:52:46.689 INFO:tasks.workunit.client.1.smithi142.stdout:4/710: creat d0/d2b/d2d/d31/d32/daa/fe2 x:0 0 0 2024-09-13T02:52:46.689 INFO:tasks.workunit.client.0.smithi098.stdout:7/448: symlink d6/d24/d63/l91 0 2024-09-13T02:52:46.690 INFO:tasks.workunit.client.1.smithi142.stdout:7/726: mkdir d10/d13/d1d/d2b/d55/d32/d8c/df0 0 2024-09-13T02:52:46.691 INFO:tasks.workunit.client.1.smithi142.stdout:7/727: fdatasync d10/d13/d1d/d2b/d56/d5f/d73/fbe 0 2024-09-13T02:52:46.692 INFO:tasks.workunit.client.1.smithi142.stdout:7/728: readlink d10/d64/lc0 0 2024-09-13T02:52:46.692 INFO:tasks.workunit.client.1.smithi142.stdout:7/729: chown d10/d13/d1d/d2b/dae 0 1 2024-09-13T02:52:46.692 INFO:tasks.workunit.client.1.smithi142.stdout:2/599: mkdir d1/dc3 0 2024-09-13T02:52:46.693 INFO:tasks.workunit.client.1.smithi142.stdout:2/600: dread - d1/de/d31/f50 zero size 2024-09-13T02:52:46.695 INFO:tasks.workunit.client.1.smithi142.stdout:9/816: write dd/d17/d5f/fc5 [4509088,130420] 0 2024-09-13T02:52:46.697 INFO:tasks.workunit.client.0.smithi098.stdout:4/260: dwrite d6/d22/d3d/d41/f45 [0,4194304] 0 2024-09-13T02:52:46.701 INFO:tasks.workunit.client.0.smithi098.stdout:7/449: creat d6/f92 x:0 0 0 2024-09-13T02:52:46.702 INFO:tasks.workunit.client.1.smithi142.stdout:6/774: link d1/d59/cf7 d1/dd/d53/d78/d104/dad/dd2/c109 0 2024-09-13T02:52:46.702 INFO:tasks.workunit.client.1.smithi142.stdout:6/775: write d1/dd/fbe [287202,100414] 0 2024-09-13T02:52:46.703 INFO:tasks.workunit.client.1.smithi142.stdout:1/772: getdents d12/d13/d45 0 2024-09-13T02:52:46.703 INFO:tasks.workunit.client.1.smithi142.stdout:3/686: getdents d12/d16/d25/d2e/d48/d5c/d66 0 2024-09-13T02:52:46.703 INFO:tasks.workunit.client.1.smithi142.stdout:8/611: write d0/d75/f86 [956938,25812] 0 2024-09-13T02:52:46.707 INFO:tasks.workunit.client.0.smithi098.stdout:4/261: symlink d6/d54/l5a 0 2024-09-13T02:52:46.710 INFO:tasks.workunit.client.0.smithi098.stdout:7/450: symlink d6/d24/l93 0 2024-09-13T02:52:46.712 INFO:tasks.workunit.client.1.smithi142.stdout:7/730: unlink d10/d13/d1d/d44/f9a 0 2024-09-13T02:52:46.714 INFO:tasks.workunit.client.0.smithi098.stdout:4/262: creat d6/d22/d3d/d41/f5b x:0 0 0 2024-09-13T02:52:46.717 INFO:tasks.workunit.client.0.smithi098.stdout:7/451: creat d6/d24/d2a/d5a/d42/d45/f94 x:0 0 0 2024-09-13T02:52:46.718 INFO:tasks.workunit.client.1.smithi142.stdout:1/773: dread fd [4194304,4194304] 0 2024-09-13T02:52:46.719 INFO:tasks.workunit.client.1.smithi142.stdout:1/774: write d12/d13/f19 [910021,50688] 0 2024-09-13T02:52:46.719 INFO:tasks.workunit.client.1.smithi142.stdout:1/775: stat d12/d13/d45/fa8 0 2024-09-13T02:52:46.720 INFO:tasks.workunit.client.0.smithi098.stdout:4/263: mknod d6/d54/c5c 0 2024-09-13T02:52:46.721 INFO:tasks.workunit.client.1.smithi142.stdout:1/776: truncate d12/d13/d20/d66/fbd 4630036 0 2024-09-13T02:52:46.721 INFO:tasks.workunit.client.1.smithi142.stdout:2/601: creat d1/de/d1f/d13/fc4 x:0 0 0 2024-09-13T02:52:46.724 INFO:tasks.workunit.client.1.smithi142.stdout:9/817: mkdir dd/d98/dca/d127 0 2024-09-13T02:52:46.724 INFO:tasks.workunit.client.1.smithi142.stdout:0/769: truncate d10/d6c/d88/d1a/f22 3569185 0 2024-09-13T02:52:46.725 INFO:tasks.workunit.client.1.smithi142.stdout:2/602: dread d1/de/d31/d6c/f88 [0,4194304] 0 2024-09-13T02:52:46.725 INFO:tasks.workunit.client.0.smithi098.stdout:4/264: mknod d6/db/c5d 0 2024-09-13T02:52:46.725 INFO:tasks.workunit.client.1.smithi142.stdout:2/603: readlink d1/de/l5f 0 2024-09-13T02:52:46.728 INFO:tasks.workunit.client.0.smithi098.stdout:7/452: write d6/d1e/f36 [985112,18736] 0 2024-09-13T02:52:46.730 INFO:tasks.workunit.client.1.smithi142.stdout:6/776: unlink d1/la0 0 2024-09-13T02:52:46.733 INFO:tasks.workunit.client.0.smithi098.stdout:4/265: rename d6/d10/l53 to d6/d22/d3d/d4d/l5e 0 2024-09-13T02:52:46.736 INFO:tasks.workunit.client.0.smithi098.stdout:7/453: rename d6/d24/d2a/d5a/d42/d45/d73/c7c to d6/d24/d2a/d5a/d86/d65/c95 0 2024-09-13T02:52:46.737 INFO:tasks.workunit.client.0.smithi098.stdout:7/454: write d6/d24/d2a/d5a/f22 [4643726,12759] 0 2024-09-13T02:52:46.737 INFO:tasks.workunit.client.1.smithi142.stdout:4/711: mknod d0/d2b/ce3 0 2024-09-13T02:52:46.738 INFO:tasks.workunit.client.0.smithi098.stdout:4/266: creat d6/d22/d3d/d4d/f5f x:0 0 0 2024-09-13T02:52:46.742 INFO:tasks.workunit.client.1.smithi142.stdout:8/612: mknod d0/d6/dc/d45/d9d/cc3 0 2024-09-13T02:52:46.747 INFO:tasks.workunit.client.1.smithi142.stdout:7/731: mkdir d10/d13/d1d/d2b/d55/d32/d8c/df1 0 2024-09-13T02:52:46.750 INFO:tasks.workunit.client.0.smithi098.stdout:4/267: mknod d6/d22/d3d/d41/d58/c60 0 2024-09-13T02:52:46.751 INFO:tasks.workunit.client.1.smithi142.stdout:5/778: sync 2024-09-13T02:52:46.752 INFO:tasks.workunit.client.0.smithi098.stdout:7/455: link d6/d47/c8a d6/d24/d2a/d5a/d42/d45/d73/c96 0 2024-09-13T02:52:46.752 INFO:tasks.workunit.client.1.smithi142.stdout:5/779: chown d8/d47/d65/da0/cbb 106066866 1 2024-09-13T02:52:46.752 INFO:tasks.workunit.client.1.smithi142.stdout:3/687: write d12/d16/d25/d2e/f2f [1836352,70452] 0 2024-09-13T02:52:46.757 INFO:tasks.workunit.client.0.smithi098.stdout:4/268: dwrite d6/d10/d20/f36 [0,4194304] 0 2024-09-13T02:52:46.757 INFO:tasks.workunit.client.0.smithi098.stdout:4/269: readlink l2 0 2024-09-13T02:52:46.760 INFO:tasks.workunit.client.1.smithi142.stdout:6/777: rename d1/d7/d19/f2f to d1/dd/d16/f10a 0 2024-09-13T02:52:46.760 INFO:tasks.workunit.client.1.smithi142.stdout:6/778: chown d1/d7/d5f/f68 2765 1 2024-09-13T02:52:46.764 INFO:tasks.workunit.client.0.smithi098.stdout:4/270: dwrite d6/d22/d3d/d41/f42 [0,4194304] 0 2024-09-13T02:52:46.768 INFO:tasks.workunit.client.1.smithi142.stdout:3/688: dread fe [0,4194304] 0 2024-09-13T02:52:46.770 INFO:tasks.workunit.client.1.smithi142.stdout:0/770: dwrite d10/d6c/d88/f46 [0,4194304] 0 2024-09-13T02:52:46.771 INFO:tasks.workunit.client.0.smithi098.stdout:7/456: truncate d6/d24/d2a/d57/d88/f4f 3262733 0 2024-09-13T02:52:46.772 INFO:tasks.workunit.client.1.smithi142.stdout:7/732: mknod d10/d13/d1d/d25/d45/d99/cf2 0 2024-09-13T02:52:46.773 INFO:tasks.workunit.client.0.smithi098.stdout:4/271: write d6/d10/d21/f2b [785012,60621] 0 2024-09-13T02:52:46.781 INFO:tasks.workunit.client.1.smithi142.stdout:6/779: mknod d1/dd/d57/c10b 0 2024-09-13T02:52:46.782 INFO:tasks.workunit.client.1.smithi142.stdout:8/613: symlink d0/d6/dc/d45/d8/df/d28/lc4 0 2024-09-13T02:52:46.784 INFO:tasks.workunit.client.1.smithi142.stdout:8/614: write d0/d6/dc/d45/d8/f29 [721819,46054] 0 2024-09-13T02:52:46.785 INFO:tasks.workunit.client.1.smithi142.stdout:0/771: dread d10/d6c/d88/d21/d51/d35/fea [0,4194304] 0 2024-09-13T02:52:46.786 INFO:tasks.workunit.client.1.smithi142.stdout:1/777: creat d12/d13/d20/d66/d55/db4/ff4 x:0 0 0 2024-09-13T02:52:46.786 INFO:tasks.workunit.client.1.smithi142.stdout:7/733: fdatasync d10/f81 0 2024-09-13T02:52:46.787 INFO:tasks.workunit.client.1.smithi142.stdout:7/734: chown d10/d13/d1d/d2b/d56/f85 19980 1 2024-09-13T02:52:46.787 INFO:tasks.workunit.client.1.smithi142.stdout:9/818: link dd/d17/d5f/ld8 dd/d87/def/l128 0 2024-09-13T02:52:46.790 INFO:tasks.workunit.client.1.smithi142.stdout:6/780: creat d1/d7/d5f/d60/d76/f10c x:0 0 0 2024-09-13T02:52:46.791 INFO:tasks.workunit.client.1.smithi142.stdout:6/781: chown d1/dd/f29 315953784 1 2024-09-13T02:52:46.792 INFO:tasks.workunit.client.1.smithi142.stdout:5/780: dread d8/d47/d65/fad [0,4194304] 0 2024-09-13T02:52:46.793 INFO:tasks.workunit.client.1.smithi142.stdout:6/782: write d1/dd/d53/d78/d8f/da8/de6/fde [603683,20550] 0 2024-09-13T02:52:46.795 INFO:tasks.workunit.client.1.smithi142.stdout:6/783: write d1/fd7 [5153540,92357] 0 2024-09-13T02:52:46.796 INFO:tasks.workunit.client.1.smithi142.stdout:7/735: symlink d10/d34/d57/d98/lf3 0 2024-09-13T02:52:46.796 INFO:tasks.workunit.client.0.smithi098.stdout:7/457: dread d6/d24/f3d [0,4194304] 0 2024-09-13T02:52:46.797 INFO:tasks.workunit.client.0.smithi098.stdout:7/458: dread - d6/f78 zero size 2024-09-13T02:52:46.801 INFO:tasks.workunit.client.0.smithi098.stdout:7/459: dread d6/d24/d2a/d5a/f38 [0,4194304] 0 2024-09-13T02:52:46.803 INFO:tasks.workunit.client.1.smithi142.stdout:2/604: write d1/f9 [3711385,66398] 0 2024-09-13T02:52:46.803 INFO:tasks.workunit.client.1.smithi142.stdout:2/605: chown d1/d42/d44/d99 0 1 2024-09-13T02:52:46.805 INFO:tasks.workunit.client.1.smithi142.stdout:2/606: write d1/de/da6/dbb/d92/fac [380801,19002] 0 2024-09-13T02:52:46.805 INFO:tasks.workunit.client.0.smithi098.stdout:7/460: dread d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:46.806 INFO:tasks.workunit.client.1.smithi142.stdout:2/607: dread - d1/de/d31/d6c/d6d/d47/faf zero size 2024-09-13T02:52:46.807 INFO:tasks.workunit.client.1.smithi142.stdout:2/608: write d1/f5 [2243945,126293] 0 2024-09-13T02:52:46.808 INFO:tasks.workunit.client.1.smithi142.stdout:2/609: stat d1/de/d31/db0 0 2024-09-13T02:52:46.809 INFO:tasks.workunit.client.1.smithi142.stdout:3/689: write d12/d16/d25/d2e/d48/f5f [487960,130144] 0 2024-09-13T02:52:46.811 INFO:tasks.workunit.client.1.smithi142.stdout:7/736: mkdir d10/d13/d21/df4 0 2024-09-13T02:52:46.813 INFO:tasks.workunit.client.1.smithi142.stdout:5/781: dread d8/dc3/d3f/d4a/fb4 [4194304,4194304] 0 2024-09-13T02:52:46.814 INFO:tasks.workunit.client.1.smithi142.stdout:8/615: write d0/d6/dc/d45/d35/f81 [932027,90671] 0 2024-09-13T02:52:46.818 INFO:tasks.workunit.client.1.smithi142.stdout:7/737: unlink d10/d13/d1d/d2b/d56/fe9 0 2024-09-13T02:52:46.819 INFO:tasks.workunit.client.1.smithi142.stdout:1/778: dwrite d12/d13/d1d/d26/d4f/fc7 [0,4194304] 0 2024-09-13T02:52:46.820 INFO:tasks.workunit.client.1.smithi142.stdout:5/782: chown d8/d47/d65/da0/lf6 370475 1 2024-09-13T02:52:46.823 INFO:tasks.workunit.client.1.smithi142.stdout:9/819: truncate dd/d17/d44/d82/d99/f107 3972575 0 2024-09-13T02:52:46.825 INFO:tasks.workunit.client.1.smithi142.stdout:8/616: creat d0/d6/d23/d64/fc5 x:0 0 0 2024-09-13T02:52:46.826 INFO:tasks.workunit.client.1.smithi142.stdout:3/690: fsync d12/d16/d25/f47 0 2024-09-13T02:52:46.827 INFO:tasks.workunit.client.1.smithi142.stdout:3/691: fsync d12/d16/d25/d2e/f2f 0 2024-09-13T02:52:46.827 INFO:tasks.workunit.client.1.smithi142.stdout:7/738: creat d10/d13/d21/ff5 x:0 0 0 2024-09-13T02:52:46.828 INFO:tasks.workunit.client.1.smithi142.stdout:7/739: chown d10/d13/d1d/d2b/d55/d32 993 1 2024-09-13T02:52:46.829 INFO:tasks.workunit.client.1.smithi142.stdout:5/783: creat d8/dc3/d64/d68/f100 x:0 0 0 2024-09-13T02:52:46.829 INFO:tasks.workunit.client.1.smithi142.stdout:4/712: link d0/df/l1c d0/d2b/le4 0 2024-09-13T02:52:46.831 INFO:tasks.workunit.client.1.smithi142.stdout:2/610: creat d1/de/d31/fc5 x:0 0 0 2024-09-13T02:52:46.831 INFO:tasks.workunit.client.1.smithi142.stdout:7/740: truncate d10/d13/d1d/d25/d5c/dbd/fd9 868401 0 2024-09-13T02:52:46.832 INFO:tasks.workunit.client.1.smithi142.stdout:2/611: stat d1/d29/d72/fc0 0 2024-09-13T02:52:46.833 INFO:tasks.workunit.client.1.smithi142.stdout:1/779: getdents d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/df1 0 2024-09-13T02:52:46.834 INFO:tasks.workunit.client.1.smithi142.stdout:7/741: dread d10/d13/f1e [4194304,4194304] 0 2024-09-13T02:52:46.835 INFO:tasks.workunit.client.1.smithi142.stdout:4/713: write d0/dc8/dcf/fd6 [493283,70849] 0 2024-09-13T02:52:46.837 INFO:tasks.workunit.client.1.smithi142.stdout:8/617: dread d0/d6/dc/d45/d8/f29 [0,4194304] 0 2024-09-13T02:52:46.838 INFO:tasks.workunit.client.1.smithi142.stdout:2/612: mknod d1/d42/d44/d99/cc6 0 2024-09-13T02:52:46.838 INFO:tasks.workunit.client.1.smithi142.stdout:5/784: symlink d8/d47/d65/da0/dd1/d2d/d90/l101 0 2024-09-13T02:52:46.839 INFO:tasks.workunit.client.1.smithi142.stdout:6/784: getdents d1/dd 0 2024-09-13T02:52:46.840 INFO:tasks.workunit.client.1.smithi142.stdout:5/785: fsync d8/d47/d65/da0/dd1/d61/f7e 0 2024-09-13T02:52:46.842 INFO:tasks.workunit.client.1.smithi142.stdout:6/785: write d1/d7/d5f/d60/fdd [946564,128923] 0 2024-09-13T02:52:46.842 INFO:tasks.workunit.client.1.smithi142.stdout:7/742: unlink d10/d13/d1d/d2b/d40/l48 0 2024-09-13T02:52:46.842 INFO:tasks.workunit.client.1.smithi142.stdout:8/618: dread d0/d6/d83/daa/fb0 [0,4194304] 0 2024-09-13T02:52:46.846 INFO:tasks.workunit.client.1.smithi142.stdout:6/786: dread - d1/dd/d53/faf zero size 2024-09-13T02:52:46.847 INFO:tasks.workunit.client.1.smithi142.stdout:3/692: getdents d12/d16/d25/d2e/d48/d5c/d8c/daf 0 2024-09-13T02:52:46.848 INFO:tasks.workunit.client.1.smithi142.stdout:2/613: getdents d1/de/d31/db0 0 2024-09-13T02:52:46.850 INFO:tasks.workunit.client.1.smithi142.stdout:7/743: dread d10/d13/d1d/d2b/d55/d32/f95 [0,4194304] 0 2024-09-13T02:52:46.850 INFO:tasks.workunit.client.1.smithi142.stdout:6/787: creat d1/dd/f10d x:0 0 0 2024-09-13T02:52:46.851 INFO:tasks.workunit.client.1.smithi142.stdout:3/693: chown d12/d16/d25/f40 1 1 2024-09-13T02:52:46.851 INFO:tasks.workunit.client.1.smithi142.stdout:4/714: dwrite d0/d2b/d2d/f9d [0,4194304] 0 2024-09-13T02:52:46.852 INFO:tasks.workunit.client.1.smithi142.stdout:2/614: fsync d1/de/d1f/d13/d60/f7c 0 2024-09-13T02:52:46.853 INFO:tasks.workunit.client.1.smithi142.stdout:9/820: dread dd/d17/d69/ffd [0,4194304] 0 2024-09-13T02:52:46.854 INFO:tasks.workunit.client.1.smithi142.stdout:5/786: getdents d8/dc3/df3/dc6 0 2024-09-13T02:52:46.856 INFO:tasks.workunit.client.1.smithi142.stdout:6/788: write d1/d7/d19/f45 [2464829,50901] 0 2024-09-13T02:52:46.856 INFO:tasks.workunit.client.1.smithi142.stdout:2/615: fdatasync d1/de/f57 0 2024-09-13T02:52:46.857 INFO:tasks.workunit.client.1.smithi142.stdout:3/694: creat d12/d16/da3/fde x:0 0 0 2024-09-13T02:52:46.859 INFO:tasks.workunit.client.1.smithi142.stdout:8/619: dwrite d0/d6/d23/d64/fc5 [0,4194304] 0 2024-09-13T02:52:46.860 INFO:tasks.workunit.client.1.smithi142.stdout:5/787: fdatasync d8/d47/d65/da0/dd1/d45/f79 0 2024-09-13T02:52:46.864 INFO:tasks.workunit.client.1.smithi142.stdout:3/695: rmdir d12/d16/d3c/d7d 39 2024-09-13T02:52:46.867 INFO:tasks.workunit.client.1.smithi142.stdout:5/788: readlink d8/d47/d65/da0/dd1/d45/d81/d82/l97 0 2024-09-13T02:52:46.867 INFO:tasks.workunit.client.1.smithi142.stdout:2/616: creat d1/de/d31/d6c/d6d/db6/fc7 x:0 0 0 2024-09-13T02:52:46.869 INFO:tasks.workunit.client.1.smithi142.stdout:7/744: dwrite d10/d13/f1e [0,4194304] 0 2024-09-13T02:52:46.871 INFO:tasks.workunit.client.1.smithi142.stdout:9/821: dwrite dd/d87/f10a [0,4194304] 0 2024-09-13T02:52:46.871 INFO:tasks.workunit.client.1.smithi142.stdout:3/696: dread - d12/d16/d25/d2e/d48/d5c/d66/fa7 zero size 2024-09-13T02:52:46.873 INFO:tasks.workunit.client.1.smithi142.stdout:2/617: fsync d1/de/d31/d6c/d6d/d47/da8/fb3 0 2024-09-13T02:52:46.876 INFO:tasks.workunit.client.1.smithi142.stdout:8/620: dread d0/d6/d23/f7f [0,4194304] 0 2024-09-13T02:52:46.877 INFO:tasks.workunit.client.1.smithi142.stdout:6/789: write d1/d7/d19/d30/f67 [4328375,50587] 0 2024-09-13T02:52:46.878 INFO:tasks.workunit.client.1.smithi142.stdout:3/697: chown d12/d16/d25/d2e/f49 2692529 1 2024-09-13T02:52:46.879 INFO:tasks.workunit.client.1.smithi142.stdout:9/822: symlink dd/d17/d44/d82/d99/de3/l129 0 2024-09-13T02:52:46.880 INFO:tasks.workunit.client.1.smithi142.stdout:7/745: mknod d10/d13/d1d/d2b/d55/cf6 0 2024-09-13T02:52:46.880 INFO:tasks.workunit.client.1.smithi142.stdout:2/618: truncate d1/de/d31/d6c/d6d/f34 2533828 0 2024-09-13T02:52:46.882 INFO:tasks.workunit.client.1.smithi142.stdout:7/746: read - d10/d13/d1d/d2b/d56/d5f/d73/fbe zero size 2024-09-13T02:52:46.883 INFO:tasks.workunit.client.1.smithi142.stdout:9/823: mknod dd/dcb/c12a 0 2024-09-13T02:52:46.883 INFO:tasks.workunit.client.1.smithi142.stdout:2/619: symlink d1/d2d/lc8 0 2024-09-13T02:52:46.884 INFO:tasks.workunit.client.1.smithi142.stdout:8/621: mknod d0/d6/dc/d40/d46/cc6 0 2024-09-13T02:52:46.886 INFO:tasks.workunit.client.1.smithi142.stdout:7/747: symlink d10/d13/d1d/d2b/dae/lf7 0 2024-09-13T02:52:46.887 INFO:tasks.workunit.client.1.smithi142.stdout:3/698: creat d12/fdf x:0 0 0 2024-09-13T02:52:46.889 INFO:tasks.workunit.client.1.smithi142.stdout:7/748: rmdir d10/d13/d1d/d25/d45/dad 39 2024-09-13T02:52:46.891 INFO:tasks.workunit.client.1.smithi142.stdout:9/824: getdents dd/d17/d44/d95/dd1/ddf 0 2024-09-13T02:52:46.891 INFO:tasks.workunit.client.1.smithi142.stdout:7/749: write d10/d34/f38 [1047920,98047] 0 2024-09-13T02:52:46.892 INFO:tasks.workunit.client.1.smithi142.stdout:3/699: fdatasync d12/d16/d25/d2e/d38/d4d/f50 0 2024-09-13T02:52:46.893 INFO:tasks.workunit.client.1.smithi142.stdout:8/622: read d0/d6/dc/d45/d8/f9c [173013,55463] 0 2024-09-13T02:52:46.894 INFO:tasks.workunit.client.1.smithi142.stdout:2/620: dwrite d1/de/f9d [4194304,4194304] 0 2024-09-13T02:52:46.895 INFO:tasks.workunit.client.1.smithi142.stdout:7/750: write d10/d64/d88/fd6 [740718,78409] 0 2024-09-13T02:52:46.895 INFO:tasks.workunit.client.1.smithi142.stdout:4/715: dread d0/d2b/d21/d30/f54 [0,4194304] 0 2024-09-13T02:52:46.896 INFO:tasks.workunit.client.1.smithi142.stdout:3/700: creat d12/fe0 x:0 0 0 2024-09-13T02:52:46.898 INFO:tasks.workunit.client.1.smithi142.stdout:9/825: mkdir dd/d17/d44/d95/dd1/d12b 0 2024-09-13T02:52:46.898 INFO:tasks.workunit.client.1.smithi142.stdout:4/716: read d0/d2b/d2d/d31/d32/f50 [605700,125284] 0 2024-09-13T02:52:46.899 INFO:tasks.workunit.client.1.smithi142.stdout:8/623: creat d0/d6/dc/d45/d35/fc7 x:0 0 0 2024-09-13T02:52:46.899 INFO:tasks.workunit.client.1.smithi142.stdout:9/826: stat dd/d17/d68/lcf 0 2024-09-13T02:52:46.900 INFO:tasks.workunit.client.1.smithi142.stdout:7/751: creat d10/d34/d57/ff8 x:0 0 0 2024-09-13T02:52:46.904 INFO:tasks.workunit.client.1.smithi142.stdout:7/752: fdatasync d10/d13/d21/fc7 0 2024-09-13T02:52:46.906 INFO:tasks.workunit.client.1.smithi142.stdout:7/753: truncate d10/d34/d65/f6e 4812505 0 2024-09-13T02:52:46.907 INFO:tasks.workunit.client.1.smithi142.stdout:9/827: mkdir dd/d17/d44/d82/d99/daf/dc9/d12c 0 2024-09-13T02:52:46.909 INFO:tasks.workunit.client.1.smithi142.stdout:7/754: creat d10/d64/ff9 x:0 0 0 2024-09-13T02:52:46.911 INFO:tasks.workunit.client.1.smithi142.stdout:3/701: dread d12/d16/d25/d2e/d38/d4d/d53/d78/f85 [0,4194304] 0 2024-09-13T02:52:46.913 INFO:tasks.workunit.client.1.smithi142.stdout:7/755: fsync d10/d13/d1d/d2b/dae/f8f 0 2024-09-13T02:52:46.913 INFO:tasks.workunit.client.1.smithi142.stdout:4/717: dwrite d0/d2b/d2d/d31/d43/d48/f4d [0,4194304] 0 2024-09-13T02:52:46.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/790: dread d1/d7/f3e [0,4194304] 0 2024-09-13T02:52:46.919 INFO:tasks.workunit.client.1.smithi142.stdout:0/772: sync 2024-09-13T02:52:46.921 INFO:tasks.workunit.client.1.smithi142.stdout:0/773: write d10/d6c/d88/d45/f56 [690690,89222] 0 2024-09-13T02:52:46.921 INFO:tasks.workunit.client.1.smithi142.stdout:4/718: dwrite d0/df/d57/fc1 [0,4194304] 0 2024-09-13T02:52:46.922 INFO:tasks.workunit.client.1.smithi142.stdout:3/702: creat d12/d16/fe1 x:0 0 0 2024-09-13T02:52:46.924 INFO:tasks.workunit.client.1.smithi142.stdout:3/703: dread - d12/d16/d25/d2e/d48/d5c/d8c/daf/fbe zero size 2024-09-13T02:52:46.926 INFO:tasks.workunit.client.1.smithi142.stdout:7/756: link d10/d13/d1d/d2b/d56/d41/f68 d10/d34/d57/d98/ffa 0 2024-09-13T02:52:46.931 INFO:tasks.workunit.client.1.smithi142.stdout:3/704: creat d12/d16/d25/d2e/d38/d4d/d53/d78/fe2 x:0 0 0 2024-09-13T02:52:46.932 INFO:tasks.workunit.client.1.smithi142.stdout:7/757: read d10/d64/f7c [607335,21830] 0 2024-09-13T02:52:46.933 INFO:tasks.workunit.client.1.smithi142.stdout:4/719: creat d0/dc8/dcf/de0/fe5 x:0 0 0 2024-09-13T02:52:46.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/828: truncate dd/d17/d25/fac 3285851 0 2024-09-13T02:52:46.934 INFO:tasks.workunit.client.1.smithi142.stdout:4/720: chown d0/d2b/d21/d30/fa8 0 1 2024-09-13T02:52:46.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/791: write d1/d7/d19/f93 [680743,79678] 0 2024-09-13T02:52:46.935 INFO:tasks.workunit.client.1.smithi142.stdout:4/721: write d0/d2b/d2d/d65/fd7 [169278,77653] 0 2024-09-13T02:52:46.937 INFO:tasks.workunit.client.1.smithi142.stdout:3/705: mknod d12/ce3 0 2024-09-13T02:52:46.937 INFO:tasks.workunit.client.1.smithi142.stdout:4/722: chown d0/d2b/d2d/d31/d43/f46 1201 1 2024-09-13T02:52:46.939 INFO:tasks.workunit.client.1.smithi142.stdout:3/706: mkdir d12/d16/d25/d2e/d48/d5c/d66/de4 0 2024-09-13T02:52:46.941 INFO:tasks.workunit.client.1.smithi142.stdout:7/758: link d10/l52 d10/d13/d1d/d2b/d55/d32/d8c/df1/lfb 0 2024-09-13T02:52:46.942 INFO:tasks.workunit.client.1.smithi142.stdout:3/707: rename d12/d16/d25/d2e/d38/d4d/d53/c54 to d12/dd3/db6/db8/ce5 0 2024-09-13T02:52:46.944 INFO:tasks.workunit.client.1.smithi142.stdout:3/708: rmdir d12/dd3 39 2024-09-13T02:52:46.948 INFO:tasks.workunit.client.1.smithi142.stdout:8/624: dread d0/d6/dc/d45/f73 [0,4194304] 0 2024-09-13T02:52:46.951 INFO:tasks.workunit.client.1.smithi142.stdout:8/625: write d0/d6/dc/d45/d35/f63 [2849096,72365] 0 2024-09-13T02:52:46.953 INFO:tasks.workunit.client.1.smithi142.stdout:7/759: dread d10/d13/d1d/d25/d45/d6d/dc3/f4e [0,4194304] 0 2024-09-13T02:52:46.954 INFO:tasks.workunit.client.1.smithi142.stdout:8/626: readlink d0/d6/dc/d40/d46/da1/lb3 0 2024-09-13T02:52:46.955 INFO:tasks.workunit.client.1.smithi142.stdout:3/709: write fe [4867201,110712] 0 2024-09-13T02:52:46.956 INFO:tasks.workunit.client.1.smithi142.stdout:7/760: mknod d10/d13/d1d/d2b/dae/cfc 0 2024-09-13T02:52:46.959 INFO:tasks.workunit.client.1.smithi142.stdout:3/710: rename d12/l4a to d12/d16/le6 0 2024-09-13T02:52:46.961 INFO:tasks.workunit.client.1.smithi142.stdout:8/627: dwrite d0/d6/dc/d45/f3c [4194304,4194304] 0 2024-09-13T02:52:46.962 INFO:tasks.workunit.client.1.smithi142.stdout:8/628: chown d0/d6/dc/d45/d9d/faf 268572 1 2024-09-13T02:52:46.966 INFO:tasks.workunit.client.1.smithi142.stdout:7/761: write d10/d13/d1d/d25/d45/d6d/dc3/f43 [1864982,31549] 0 2024-09-13T02:52:46.966 INFO:tasks.workunit.client.1.smithi142.stdout:3/711: write d12/d16/d25/f47 [2232779,33374] 0 2024-09-13T02:52:46.969 INFO:tasks.workunit.client.1.smithi142.stdout:7/762: fdatasync d10/d64/f7c 0 2024-09-13T02:52:46.972 INFO:tasks.workunit.client.1.smithi142.stdout:8/629: dread d0/f4c [0,4194304] 0 2024-09-13T02:52:46.972 INFO:tasks.workunit.client.1.smithi142.stdout:3/712: truncate d12/d16/d25/d2e/f4c 3649027 0 2024-09-13T02:52:46.976 INFO:tasks.workunit.client.1.smithi142.stdout:7/763: dwrite d10/d34/d57/d98/fb7 [0,4194304] 0 2024-09-13T02:52:46.978 INFO:tasks.workunit.client.1.smithi142.stdout:7/764: write d10/d13/d1d/d2b/faf [857601,75259] 0 2024-09-13T02:52:46.982 INFO:tasks.workunit.client.1.smithi142.stdout:7/765: creat d10/d13/d1d/d25/d45/d92/ffd x:0 0 0 2024-09-13T02:52:46.984 INFO:tasks.workunit.client.1.smithi142.stdout:7/766: mkdir d10/d34/d57/d98/dfe 0 2024-09-13T02:52:46.985 INFO:tasks.workunit.client.1.smithi142.stdout:7/767: write d10/d64/ff9 [117869,85712] 0 2024-09-13T02:52:46.987 INFO:tasks.workunit.client.1.smithi142.stdout:7/768: fsync d10/d13/d1d/f94 0 2024-09-13T02:52:46.990 INFO:tasks.workunit.client.1.smithi142.stdout:7/769: symlink d10/d13/d1d/d25/d5c/dbd/lff 0 2024-09-13T02:52:46.991 INFO:tasks.workunit.client.1.smithi142.stdout:8/630: dread d0/d6/dc/d45/d8/f36 [0,4194304] 0 2024-09-13T02:52:46.991 INFO:tasks.workunit.client.1.smithi142.stdout:7/770: fsync d10/d13/d1d/d2b/dae/f8f 0 2024-09-13T02:52:46.992 INFO:tasks.workunit.client.1.smithi142.stdout:7/771: write d10/d34/d57/fda [5861130,109854] 0 2024-09-13T02:52:46.993 INFO:tasks.workunit.client.1.smithi142.stdout:8/631: symlink d0/d6/dc/d45/d35/d61/lc8 0 2024-09-13T02:52:46.995 INFO:tasks.workunit.client.1.smithi142.stdout:7/772: truncate d10/d13/f76 1019028 0 2024-09-13T02:52:46.997 INFO:tasks.workunit.client.1.smithi142.stdout:8/632: getdents d0/d82 0 2024-09-13T02:52:46.998 INFO:tasks.workunit.client.1.smithi142.stdout:7/773: symlink d10/d13/d1d/d2b/d40/dce/l100 0 2024-09-13T02:52:46.999 INFO:tasks.workunit.client.1.smithi142.stdout:7/774: write fd [1676175,46468] 0 2024-09-13T02:52:46.999 INFO:tasks.workunit.client.1.smithi142.stdout:3/713: dread d12/d16/d25/d2e/d48/d5c/f44 [0,4194304] 0 2024-09-13T02:52:47.000 INFO:tasks.workunit.client.1.smithi142.stdout:8/633: fdatasync d0/d6/dc/f18 0 2024-09-13T02:52:47.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:46 smithi142 ceph-mon[33443]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 69 MiB/s rd, 275 MiB/s wr, 469 op/s 2024-09-13T02:52:47.004 INFO:tasks.workunit.client.1.smithi142.stdout:7/775: symlink d10/d13/d1d/d25/l101 0 2024-09-13T02:52:47.006 INFO:tasks.workunit.client.0.smithi098.stdout:5/219: sync 2024-09-13T02:52:47.008 INFO:tasks.workunit.client.1.smithi142.stdout:7/776: creat d10/d13/d1d/d25/d5c/da3/f102 x:0 0 0 2024-09-13T02:52:47.010 INFO:tasks.workunit.client.1.smithi142.stdout:8/634: rename d0/d6/d23/d64 to d0/d80/d8c/dc9 0 2024-09-13T02:52:47.014 INFO:tasks.workunit.client.0.smithi098.stdout:5/220: symlink d0/d38/l51 0 2024-09-13T02:52:47.015 INFO:tasks.workunit.client.0.smithi098.stdout:5/221: write d0/d15/d17/d1c/f2d [818438,93722] 0 2024-09-13T02:52:47.016 INFO:tasks.workunit.client.1.smithi142.stdout:8/635: chown d0/d75/c8d 111898721 1 2024-09-13T02:52:47.017 INFO:tasks.workunit.client.1.smithi142.stdout:8/636: truncate d0/d80/d8c/dc9/fbf 534297 0 2024-09-13T02:52:47.018 INFO:tasks.workunit.client.1.smithi142.stdout:3/714: link d12/d16/d25/d2e/d38/d4d/fc4 d12/d16/d25/d2e/d38/d4d/fe7 0 2024-09-13T02:52:47.019 INFO:tasks.workunit.client.1.smithi142.stdout:7/777: mknod d10/d13/d1d/d2b/d56/d5f/c103 0 2024-09-13T02:52:47.020 INFO:tasks.workunit.client.1.smithi142.stdout:7/778: fsync d10/d13/d1d/d2b/dae/d9c/fbb 0 2024-09-13T02:52:47.020 INFO:tasks.workunit.client.1.smithi142.stdout:8/637: creat d0/d6/dc/d45/d35/fca x:0 0 0 2024-09-13T02:52:47.021 INFO:tasks.workunit.client.1.smithi142.stdout:3/715: fsync d12/d16/d25/d2e/f7b 0 2024-09-13T02:52:47.022 INFO:tasks.workunit.client.1.smithi142.stdout:3/716: write d12/fdf [277811,33561] 0 2024-09-13T02:52:47.023 INFO:tasks.workunit.client.1.smithi142.stdout:7/779: read d10/d13/d1d/d2b/d40/fa7 [3800776,75260] 0 2024-09-13T02:52:47.024 INFO:tasks.workunit.client.1.smithi142.stdout:8/638: rmdir d0/d6/d83 39 2024-09-13T02:52:47.026 INFO:tasks.workunit.client.1.smithi142.stdout:3/717: creat d12/d16/d25/d2e/d48/d5c/d66/fe8 x:0 0 0 2024-09-13T02:52:47.027 INFO:tasks.workunit.client.0.smithi098.stdout:5/222: write d0/d15/d17/f2e [699617,39137] 0 2024-09-13T02:52:47.029 INFO:tasks.workunit.client.0.smithi098.stdout:5/223: read d0/d15/f3c [321057,33177] 0 2024-09-13T02:52:47.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/780: sync 2024-09-13T02:52:47.031 INFO:tasks.workunit.client.1.smithi142.stdout:7/780: dwrite d10/d13/d21/fc7 [0,4194304] 0 2024-09-13T02:52:47.033 INFO:tasks.workunit.client.1.smithi142.stdout:8/639: dwrite d0/d80/d8c/f9a [0,4194304] 0 2024-09-13T02:52:47.035 INFO:tasks.workunit.client.1.smithi142.stdout:8/640: dread d0/f8f [0,4194304] 0 2024-09-13T02:52:47.035 INFO:tasks.workunit.client.1.smithi142.stdout:3/718: link d12/f22 d12/d16/d25/d2e/d48/d5c/d66/fe9 0 2024-09-13T02:52:47.036 INFO:tasks.workunit.client.0.smithi098.stdout:5/224: dwrite d0/d29/f2c [0,4194304] 0 2024-09-13T02:52:47.037 INFO:tasks.workunit.client.1.smithi142.stdout:7/781: mkdir d10/d13/d1d/d44/d104 0 2024-09-13T02:52:47.038 INFO:tasks.workunit.client.0.smithi098.stdout:5/225: read d0/d15/f22 [1914573,749] 0 2024-09-13T02:52:47.044 INFO:tasks.workunit.client.1.smithi142.stdout:3/719: unlink d12/d16/d25/d2e/d48/d5c/f44 0 2024-09-13T02:52:47.051 INFO:tasks.workunit.client.0.smithi098.stdout:5/226: creat d0/d38/d3f/d1a/d32/d4d/f52 x:0 0 0 2024-09-13T02:52:47.051 INFO:tasks.workunit.client.1.smithi142.stdout:7/782: mkdir d10/d105 0 2024-09-13T02:52:47.053 INFO:tasks.workunit.client.1.smithi142.stdout:8/641: link d0/d6/dc/d45/d35/f81 d0/d6/d83/daa/fcb 0 2024-09-13T02:52:47.054 INFO:tasks.workunit.client.1.smithi142.stdout:8/642: write d0/f69 [153148,84709] 0 2024-09-13T02:52:47.055 INFO:tasks.workunit.client.1.smithi142.stdout:7/783: creat d10/d13/d1d/d2b/d40/f106 x:0 0 0 2024-09-13T02:52:47.057 INFO:tasks.workunit.client.1.smithi142.stdout:8/643: symlink d0/d6/dc/d2e/lcc 0 2024-09-13T02:52:47.058 INFO:tasks.workunit.client.1.smithi142.stdout:7/784: truncate d10/d13/d1d/f23 5606452 0 2024-09-13T02:52:47.059 INFO:tasks.workunit.client.1.smithi142.stdout:3/720: dwrite d12/dd3/db6/fc6 [0,4194304] 0 2024-09-13T02:52:47.060 INFO:tasks.workunit.client.1.smithi142.stdout:3/721: readlink d12/l1c 0 2024-09-13T02:52:47.061 INFO:tasks.workunit.client.1.smithi142.stdout:8/644: symlink d0/d6/dc/d45/d35/d61/d77/lcd 0 2024-09-13T02:52:47.064 INFO:tasks.workunit.client.1.smithi142.stdout:7/785: rename d10/d13/d1d/d2b/dae/d9c/l9d to d10/d13/d1d/d2b/d55/d32/d8c/l107 0 2024-09-13T02:52:47.065 INFO:tasks.workunit.client.1.smithi142.stdout:8/645: mkdir d0/d6/d83/daa/dce 0 2024-09-13T02:52:47.071 INFO:tasks.workunit.client.1.smithi142.stdout:7/786: dwrite d10/d13/d1d/d2b/d55/f67 [0,4194304] 0 2024-09-13T02:52:47.072 INFO:tasks.workunit.client.1.smithi142.stdout:3/722: rmdir d12/d16/d25/d2e/d48/d5c/d73/d8f 0 2024-09-13T02:52:47.073 INFO:tasks.workunit.client.1.smithi142.stdout:7/787: unlink d10/fb2 0 2024-09-13T02:52:47.073 INFO:tasks.workunit.client.1.smithi142.stdout:8/646: dwrite d0/d6/dc/d45/d35/f56 [0,4194304] 0 2024-09-13T02:52:47.074 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:46 smithi098 ceph-mon[27886]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 69 MiB/s rd, 275 MiB/s wr, 469 op/s 2024-09-13T02:52:47.077 INFO:tasks.workunit.client.1.smithi142.stdout:3/723: stat d12/d16/d25/d2e/d48/d5c/d66/de4 0 2024-09-13T02:52:47.078 INFO:tasks.workunit.client.0.smithi098.stdout:9/252: sync 2024-09-13T02:52:47.078 INFO:tasks.workunit.client.0.smithi098.stdout:8/257: sync 2024-09-13T02:52:47.078 INFO:tasks.workunit.client.1.smithi142.stdout:8/647: fdatasync d0/d6/dc/d45/d8/df/f99 0 2024-09-13T02:52:47.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/724: dread - d12/d16/d3c/fd2 zero size 2024-09-13T02:52:47.079 INFO:tasks.workunit.client.1.smithi142.stdout:7/788: unlink d10/d13/d21/ff5 0 2024-09-13T02:52:47.085 INFO:tasks.workunit.client.0.smithi098.stdout:8/258: dwrite d2/dd/d11/d1d/f24 [0,4194304] 0 2024-09-13T02:52:47.087 INFO:tasks.workunit.client.1.smithi142.stdout:8/648: mknod d0/d80/d8c/dc9/ccf 0 2024-09-13T02:52:47.089 INFO:tasks.workunit.client.0.smithi098.stdout:5/227: dread d0/d38/d3f/f9 [4194304,4194304] 0 2024-09-13T02:52:47.092 INFO:tasks.workunit.client.0.smithi098.stdout:5/228: dread d0/d38/d3f/d1a/d32/f33 [0,4194304] 0 2024-09-13T02:52:47.094 INFO:tasks.workunit.client.1.smithi142.stdout:8/649: unlink d0/d6/dc/d45/f65 0 2024-09-13T02:52:47.103 INFO:tasks.workunit.client.1.smithi142.stdout:8/650: mkdir d0/d6/dc/d40/d4d/dd0 0 2024-09-13T02:52:47.103 INFO:tasks.workunit.client.1.smithi142.stdout:8/651: chown d0/d6/dc/d40/d46/da1/lb3 34970773 1 2024-09-13T02:52:47.104 INFO:tasks.workunit.client.0.smithi098.stdout:8/259: creat d2/dd/d11/f4c x:0 0 0 2024-09-13T02:52:47.109 INFO:tasks.workunit.client.0.smithi098.stdout:5/229: rename d0/d15/d17/d1c/d3d/l49 to d0/d38/d3f/l53 0 2024-09-13T02:52:47.111 INFO:tasks.workunit.client.0.smithi098.stdout:5/230: write d0/d15/d17/d1c/d3d/f47 [94275,88785] 0 2024-09-13T02:52:47.111 INFO:tasks.workunit.client.0.smithi098.stdout:8/260: readlink d2/dd/d11/d1d/l42 0 2024-09-13T02:52:47.112 INFO:tasks.workunit.client.1.smithi142.stdout:3/725: dwrite d12/d16/dc7/fda [0,4194304] 0 2024-09-13T02:52:47.112 INFO:tasks.workunit.client.0.smithi098.stdout:5/231: chown d0/d38/d3f/f11 40283649 1 2024-09-13T02:52:47.113 INFO:tasks.workunit.client.0.smithi098.stdout:5/232: write d0/d15/f18 [455682,91713] 0 2024-09-13T02:52:47.114 INFO:tasks.workunit.client.1.smithi142.stdout:8/652: creat d0/fd1 x:0 0 0 2024-09-13T02:52:47.116 INFO:tasks.workunit.client.1.smithi142.stdout:8/653: write d0/d80/fa0 [139430,91423] 0 2024-09-13T02:52:47.116 INFO:tasks.workunit.client.1.smithi142.stdout:3/726: fdatasync d12/d16/d3c/d79/fab 0 2024-09-13T02:52:47.117 INFO:tasks.workunit.client.1.smithi142.stdout:8/654: chown d0/d6/dc/d45/d35/f81 1 1 2024-09-13T02:52:47.117 INFO:tasks.workunit.client.1.smithi142.stdout:3/727: write d12/d16/d25/d2e/d38/f94 [778155,93407] 0 2024-09-13T02:52:47.119 INFO:tasks.workunit.client.0.smithi098.stdout:8/261: mkdir d2/dd/d4d 0 2024-09-13T02:52:47.120 INFO:tasks.workunit.client.1.smithi142.stdout:8/655: fdatasync d0/d6/d83/daa/fb0 0 2024-09-13T02:52:47.122 INFO:tasks.workunit.client.1.smithi142.stdout:3/728: unlink d12/d16/f6f 0 2024-09-13T02:52:47.125 INFO:tasks.workunit.client.0.smithi098.stdout:8/262: creat d2/f4e x:0 0 0 2024-09-13T02:52:47.125 INFO:tasks.workunit.client.1.smithi142.stdout:8/656: symlink d0/d6/dc/d45/d35/dae/ld2 0 2024-09-13T02:52:47.126 INFO:tasks.workunit.client.0.smithi098.stdout:6/250: sync 2024-09-13T02:52:47.126 INFO:tasks.workunit.client.0.smithi098.stdout:1/323: sync 2024-09-13T02:52:47.127 INFO:tasks.workunit.client.0.smithi098.stdout:4/272: sync 2024-09-13T02:52:47.127 INFO:tasks.workunit.client.0.smithi098.stdout:7/461: sync 2024-09-13T02:52:47.127 INFO:tasks.workunit.client.0.smithi098.stdout:3/252: sync 2024-09-13T02:52:47.127 INFO:tasks.workunit.client.0.smithi098.stdout:0/316: sync 2024-09-13T02:52:47.127 INFO:tasks.workunit.client.0.smithi098.stdout:2/243: sync 2024-09-13T02:52:47.127 INFO:tasks.workunit.client.0.smithi098.stdout:8/263: write d2/d2f/f38 [369718,54203] 0 2024-09-13T02:52:47.129 INFO:tasks.workunit.client.0.smithi098.stdout:3/253: write d7/f3d [87112,121773] 0 2024-09-13T02:52:47.129 INFO:tasks.workunit.client.0.smithi098.stdout:7/462: chown d6/d24/d63 106 1 2024-09-13T02:52:47.129 INFO:tasks.workunit.client.1.smithi142.stdout:3/729: rename d12/d16/d3c/d79/l86 to d12/d16/d25/d2e/d38/d4d/dad/lea 0 2024-09-13T02:52:47.133 INFO:tasks.workunit.client.0.smithi098.stdout:8/264: dread d2/f23 [0,4194304] 0 2024-09-13T02:52:47.136 INFO:tasks.workunit.client.1.smithi142.stdout:5/789: sync 2024-09-13T02:52:47.138 INFO:tasks.workunit.client.0.smithi098.stdout:6/251: mkdir d5/d13/d2b/d3a/d5a 0 2024-09-13T02:52:47.139 INFO:tasks.workunit.client.1.smithi142.stdout:5/790: creat d8/dc3/d64/d68/f102 x:0 0 0 2024-09-13T02:52:47.139 INFO:tasks.workunit.client.0.smithi098.stdout:2/244: write d1/d1a/dc/f37 [607890,110663] 0 2024-09-13T02:52:47.140 INFO:tasks.workunit.client.1.smithi142.stdout:5/791: write d8/d47/d65/da0/dd1/fae [261641,92127] 0 2024-09-13T02:52:47.142 INFO:tasks.workunit.client.0.smithi098.stdout:0/317: creat dd/df/d1d/d26/d28/d5d/f69 x:0 0 0 2024-09-13T02:52:47.145 INFO:tasks.workunit.client.1.smithi142.stdout:5/792: dwrite d8/d47/d65/da0/dd1/d45/f79 [0,4194304] 0 2024-09-13T02:52:47.151 INFO:tasks.workunit.client.1.smithi142.stdout:5/793: dwrite d8/dc3/d64/d68/f100 [0,4194304] 0 2024-09-13T02:52:47.152 INFO:tasks.workunit.client.0.smithi098.stdout:4/273: dwrite d6/d22/f28 [0,4194304] 0 2024-09-13T02:52:47.153 INFO:tasks.workunit.client.0.smithi098.stdout:8/265: dwrite d2/f4e [0,4194304] 0 2024-09-13T02:52:47.155 INFO:tasks.workunit.client.0.smithi098.stdout:8/266: chown d2/dd/d11/d3b/d46 10684 1 2024-09-13T02:52:47.156 INFO:tasks.workunit.client.0.smithi098.stdout:2/245: dread d1/d1a/dc/f33 [0,4194304] 0 2024-09-13T02:52:47.158 INFO:tasks.workunit.client.0.smithi098.stdout:3/254: rename d7/d9/d15/d17 to d7/d9/d25/d3a/d52 0 2024-09-13T02:52:47.159 INFO:tasks.workunit.client.0.smithi098.stdout:7/463: getdents d6/d24/d46 0 2024-09-13T02:52:47.160 INFO:tasks.workunit.client.0.smithi098.stdout:2/246: creat d1/d1f/f42 x:0 0 0 2024-09-13T02:52:47.161 INFO:tasks.workunit.client.0.smithi098.stdout:6/252: dread d5/f1b [0,4194304] 0 2024-09-13T02:52:47.162 INFO:tasks.workunit.client.0.smithi098.stdout:8/267: creat d2/dd/d11/d3b/f4f x:0 0 0 2024-09-13T02:52:47.164 INFO:tasks.workunit.client.0.smithi098.stdout:8/268: write d2/dd/d11/d1d/f3e [508701,119309] 0 2024-09-13T02:52:47.166 INFO:tasks.workunit.client.1.smithi142.stdout:3/730: dread d12/d16/d25/f47 [0,4194304] 0 2024-09-13T02:52:47.169 INFO:tasks.workunit.client.0.smithi098.stdout:7/464: dread d6/d24/d2a/d5a/f4d [0,4194304] 0 2024-09-13T02:52:47.170 INFO:tasks.workunit.client.1.smithi142.stdout:5/794: getdents d8/d47/d65/da0/dd1/d45/dc5 0 2024-09-13T02:52:47.170 INFO:tasks.workunit.client.0.smithi098.stdout:4/274: creat d6/f61 x:0 0 0 2024-09-13T02:52:47.171 INFO:tasks.workunit.client.0.smithi098.stdout:7/465: readlink d6/d1e/l7a 0 2024-09-13T02:52:47.171 INFO:tasks.workunit.client.1.smithi142.stdout:3/731: dread d12/d16/d25/d2e/d38/d4d/d53/d78/f85 [0,4194304] 0 2024-09-13T02:52:47.171 INFO:tasks.workunit.client.0.smithi098.stdout:6/253: mkdir d5/d13/d2b/d5b 0 2024-09-13T02:52:47.172 INFO:tasks.workunit.client.1.smithi142.stdout:3/732: chown d12/d16/d25/d2e/d38/d4d/d53/da0/ccb 115 1 2024-09-13T02:52:47.175 INFO:tasks.workunit.client.0.smithi098.stdout:8/269: creat d2/dd/d11/d3b/f50 x:0 0 0 2024-09-13T02:52:47.176 INFO:tasks.workunit.client.0.smithi098.stdout:4/275: dread d6/d22/d3d/d41/f42 [0,4194304] 0 2024-09-13T02:52:47.176 INFO:tasks.workunit.client.1.smithi142.stdout:5/795: truncate d8/d47/d65/da0/dd1/d2d/f84 710057 0 2024-09-13T02:52:47.177 INFO:tasks.workunit.client.0.smithi098.stdout:4/276: write d6/d22/d3d/d4d/f57 [156136,124371] 0 2024-09-13T02:52:47.180 INFO:tasks.workunit.client.1.smithi142.stdout:3/733: unlink d12/d16/d3c/d79/d9b/ca4 0 2024-09-13T02:52:47.181 INFO:tasks.workunit.client.1.smithi142.stdout:5/796: fdatasync d8/d47/f4f 0 2024-09-13T02:52:47.185 INFO:tasks.workunit.client.0.smithi098.stdout:0/318: link dd/df/d1d/d26/c3e dd/df/d1d/d40/d46/c6a 0 2024-09-13T02:52:47.187 INFO:tasks.workunit.client.0.smithi098.stdout:4/277: rename d6/d10/d20/l3f to d6/d22/d3d/d41/l62 0 2024-09-13T02:52:47.189 INFO:tasks.workunit.client.0.smithi098.stdout:6/254: symlink d5/d18/d4e/l5c 0 2024-09-13T02:52:47.189 INFO:tasks.workunit.client.0.smithi098.stdout:6/255: chown d5/d18 50 1 2024-09-13T02:52:47.190 INFO:tasks.workunit.client.0.smithi098.stdout:0/319: mkdir dd/df/d1d/d40/d46/d6b 0 2024-09-13T02:52:47.191 INFO:tasks.workunit.client.0.smithi098.stdout:4/278: creat d6/d22/f63 x:0 0 0 2024-09-13T02:52:47.192 INFO:tasks.workunit.client.0.smithi098.stdout:3/255: getdents d7/d9/d25/d3a/d52 0 2024-09-13T02:52:47.193 INFO:tasks.workunit.client.0.smithi098.stdout:5/233: dread d0/d15/d17/d1c/d3d/f47 [0,4194304] 0 2024-09-13T02:52:47.196 INFO:tasks.workunit.client.0.smithi098.stdout:6/256: creat d5/d13/d51/f5d x:0 0 0 2024-09-13T02:52:47.197 INFO:tasks.workunit.client.0.smithi098.stdout:0/320: creat dd/df/d1d/d40/f6c x:0 0 0 2024-09-13T02:52:47.198 INFO:tasks.workunit.client.0.smithi098.stdout:9/253: truncate d2/f32 202196 0 2024-09-13T02:52:47.200 INFO:tasks.workunit.client.0.smithi098.stdout:8/270: link d2/dd/d11/d1d/c36 d2/c51 0 2024-09-13T02:52:47.201 INFO:tasks.workunit.client.0.smithi098.stdout:9/254: read d2/dd/d39/d43/f50 [358059,39883] 0 2024-09-13T02:52:47.201 INFO:tasks.workunit.client.0.smithi098.stdout:3/256: dwrite d7/d9/d4c/f4f [0,4194304] 0 2024-09-13T02:52:47.212 INFO:tasks.workunit.client.0.smithi098.stdout:3/257: write d7/d9/d15/d2d/d34/f47 [411600,40494] 0 2024-09-13T02:52:47.215 INFO:tasks.workunit.client.0.smithi098.stdout:6/257: fsync d5/d18/f25 0 2024-09-13T02:52:47.218 INFO:tasks.workunit.client.0.smithi098.stdout:8/271: creat d2/dd/d11/d49/f52 x:0 0 0 2024-09-13T02:52:47.218 INFO:tasks.workunit.client.0.smithi098.stdout:5/234: link d0/d38/d3f/d1a/l45 d0/d15/d50/l54 0 2024-09-13T02:52:47.224 INFO:tasks.workunit.client.1.smithi142.stdout:8/657: truncate d0/d6/f2a 3239791 0 2024-09-13T02:52:47.224 INFO:tasks.workunit.client.1.smithi142.stdout:8/658: fsync d0/d6/dc/d2e/fa9 0 2024-09-13T02:52:47.226 INFO:tasks.workunit.client.1.smithi142.stdout:8/659: truncate d0/d6/dc/d45/d35/d93/fc2 825976 0 2024-09-13T02:52:47.226 INFO:tasks.workunit.client.0.smithi098.stdout:6/258: unlink d5/d13/c43 0 2024-09-13T02:52:47.226 INFO:tasks.workunit.client.0.smithi098.stdout:6/259: readlink d5/l12 0 2024-09-13T02:52:47.227 INFO:tasks.workunit.client.0.smithi098.stdout:0/321: link dd/df/d1d/l3a dd/df/d1d/d26/d28/l6d 0 2024-09-13T02:52:47.227 INFO:tasks.workunit.client.1.smithi142.stdout:2/621: sync 2024-09-13T02:52:47.228 INFO:tasks.workunit.client.1.smithi142.stdout:2/622: chown d1/de 6 1 2024-09-13T02:52:47.229 INFO:tasks.workunit.client.0.smithi098.stdout:8/272: symlink d2/dd/d11/d49/l53 0 2024-09-13T02:52:47.230 INFO:tasks.workunit.client.0.smithi098.stdout:0/322: dread dd/df/d1d/d26/d28/d5d/f66 [0,4194304] 0 2024-09-13T02:52:47.231 INFO:tasks.workunit.client.1.smithi142.stdout:8/660: dwrite d0/d6/dc/d45/d35/fa4 [0,4194304] 0 2024-09-13T02:52:47.231 INFO:tasks.workunit.client.0.smithi098.stdout:5/235: chown d0/d38/d3f/l53 957 1 2024-09-13T02:52:47.233 INFO:tasks.workunit.client.1.smithi142.stdout:2/623: fsync d1/de/d31/d6c/d6d/f52 0 2024-09-13T02:52:47.233 INFO:tasks.workunit.client.1.smithi142.stdout:2/624: chown d1/d29/d72 7 1 2024-09-13T02:52:47.234 INFO:tasks.workunit.client.0.smithi098.stdout:6/260: dwrite d5/d18/f2a [4194304,4194304] 0 2024-09-13T02:52:47.234 INFO:tasks.workunit.client.1.smithi142.stdout:2/625: write d1/de/d1f/d13/f9b [1150502,121501] 0 2024-09-13T02:52:47.235 INFO:tasks.workunit.client.1.smithi142.stdout:2/626: stat d1/de/da6/dbb/d92/f94 0 2024-09-13T02:52:47.243 INFO:tasks.workunit.client.0.smithi098.stdout:1/324: dwrite d9/d33/f22 [0,4194304] 0 2024-09-13T02:52:47.244 INFO:tasks.workunit.client.0.smithi098.stdout:0/323: write f4 [2608128,89546] 0 2024-09-13T02:52:47.246 INFO:tasks.workunit.client.0.smithi098.stdout:6/261: dread f3 [0,4194304] 0 2024-09-13T02:52:47.249 INFO:tasks.workunit.client.0.smithi098.stdout:8/273: rename d2/dd/d11/l14 to d2/d28/d43/l54 0 2024-09-13T02:52:47.250 INFO:tasks.workunit.client.0.smithi098.stdout:9/255: dread d2/dd/d39/f25 [0,4194304] 0 2024-09-13T02:52:47.251 INFO:tasks.workunit.client.0.smithi098.stdout:5/236: dwrite d0/d15/d17/f2e [0,4194304] 0 2024-09-13T02:52:47.252 INFO:tasks.workunit.client.0.smithi098.stdout:8/274: readlink d2/dd/l3c 0 2024-09-13T02:52:47.253 INFO:tasks.workunit.client.0.smithi098.stdout:8/275: dread - d2/dd/d11/d1d/f45 zero size 2024-09-13T02:52:47.254 INFO:tasks.workunit.client.0.smithi098.stdout:5/237: chown d0/d38/d3f/d1a/f41 119650 1 2024-09-13T02:52:47.261 INFO:tasks.workunit.client.0.smithi098.stdout:3/258: getdents d7/d9/d15/d2d/d34 0 2024-09-13T02:52:47.262 INFO:tasks.workunit.client.1.smithi142.stdout:8/661: creat d0/d80/d8c/dc9/dc0/fd3 x:0 0 0 2024-09-13T02:52:47.262 INFO:tasks.workunit.client.1.smithi142.stdout:2/627: link d1/f8c d1/d29/fc9 0 2024-09-13T02:52:47.263 INFO:tasks.workunit.client.0.smithi098.stdout:7/466: write d6/f10 [2051777,73717] 0 2024-09-13T02:52:47.264 INFO:tasks.workunit.client.0.smithi098.stdout:1/325: truncate f4 3558573 0 2024-09-13T02:52:47.265 INFO:tasks.workunit.client.1.smithi142.stdout:3/734: write d12/d16/d25/d2e/d38/d5a/f72 [917770,104415] 0 2024-09-13T02:52:47.268 INFO:tasks.workunit.client.0.smithi098.stdout:6/262: unlink d5/d36/c53 0 2024-09-13T02:52:47.268 INFO:tasks.workunit.client.1.smithi142.stdout:5/797: write d8/d47/d65/da0/dd1/f5c [1575691,94567] 0 2024-09-13T02:52:47.272 INFO:tasks.workunit.client.0.smithi098.stdout:9/256: readlink d2/l2c 0 2024-09-13T02:52:47.274 INFO:tasks.workunit.client.0.smithi098.stdout:9/257: chown d2/d6/d2b/d4d/d56 0 1 2024-09-13T02:52:47.275 INFO:tasks.workunit.client.1.smithi142.stdout:5/798: dwrite d8/d47/d65/da0/dd1/d61/f71 [0,4194304] 0 2024-09-13T02:52:47.275 INFO:tasks.workunit.client.0.smithi098.stdout:6/263: dwrite d5/d13/f28 [0,4194304] 0 2024-09-13T02:52:47.283 INFO:tasks.workunit.client.0.smithi098.stdout:4/279: truncate d6/d10/d20/f38 844764 0 2024-09-13T02:52:47.283 INFO:tasks.workunit.client.1.smithi142.stdout:2/628: dread d1/de/f22 [0,4194304] 0 2024-09-13T02:52:47.284 INFO:tasks.workunit.client.0.smithi098.stdout:3/259: mknod d7/d9/d25/d3a/c53 0 2024-09-13T02:52:47.287 INFO:tasks.workunit.client.1.smithi142.stdout:4/723: sync 2024-09-13T02:52:47.287 INFO:tasks.workunit.client.1.smithi142.stdout:0/774: sync 2024-09-13T02:52:47.287 INFO:tasks.workunit.client.1.smithi142.stdout:6/792: sync 2024-09-13T02:52:47.287 INFO:tasks.workunit.client.1.smithi142.stdout:9/829: sync 2024-09-13T02:52:47.291 INFO:tasks.workunit.client.0.smithi098.stdout:1/326: symlink d9/d33/d19/d35/d68/d4d/l78 0 2024-09-13T02:52:47.291 INFO:tasks.workunit.client.0.smithi098.stdout:1/327: stat d9/d33/d19/d35 0 2024-09-13T02:52:47.297 INFO:tasks.workunit.client.0.smithi098.stdout:0/324: mknod dd/df/d1d/d40/d46/d6b/c6e 0 2024-09-13T02:52:47.298 INFO:tasks.workunit.client.0.smithi098.stdout:0/325: stat dd/df/d1d/l62 0 2024-09-13T02:52:47.304 INFO:tasks.workunit.client.0.smithi098.stdout:6/264: mknod d5/d13/c5e 0 2024-09-13T02:52:47.305 INFO:tasks.workunit.client.0.smithi098.stdout:0/326: dwrite dd/f2c [4194304,4194304] 0 2024-09-13T02:52:47.306 INFO:tasks.workunit.client.0.smithi098.stdout:8/276: symlink d2/dd/d4d/l55 0 2024-09-13T02:52:47.313 INFO:tasks.workunit.client.0.smithi098.stdout:4/280: mkdir d6/d22/d3d/d64 0 2024-09-13T02:52:47.316 INFO:tasks.workunit.client.0.smithi098.stdout:3/260: dread d7/d9/f32 [0,4194304] 0 2024-09-13T02:52:47.320 INFO:tasks.workunit.client.0.smithi098.stdout:1/328: mknod d9/d33/d19/d35/d63/c79 0 2024-09-13T02:52:47.324 INFO:tasks.workunit.client.0.smithi098.stdout:2/247: mknod d1/d1f/d35/c43 0 2024-09-13T02:52:47.331 INFO:tasks.workunit.client.0.smithi098.stdout:8/277: mknod d2/dd/d11/d2c/c56 0 2024-09-13T02:52:47.333 INFO:tasks.workunit.client.0.smithi098.stdout:5/238: creat d0/d38/f55 x:0 0 0 2024-09-13T02:52:47.337 INFO:tasks.workunit.client.0.smithi098.stdout:7/467: link d6/d1e/l84 d6/d24/d2a/d5a/d42/l97 0 2024-09-13T02:52:47.339 INFO:tasks.workunit.client.0.smithi098.stdout:1/329: creat d9/d33/f7a x:0 0 0 2024-09-13T02:52:47.341 INFO:tasks.workunit.client.0.smithi098.stdout:9/258: creat d2/f57 x:0 0 0 2024-09-13T02:52:47.344 INFO:tasks.workunit.client.0.smithi098.stdout:6/265: mknod d5/c5f 0 2024-09-13T02:52:47.345 INFO:tasks.workunit.client.0.smithi098.stdout:6/266: chown d5/f31 0 1 2024-09-13T02:52:47.346 INFO:tasks.workunit.client.0.smithi098.stdout:1/330: dwrite d9/d33/d19/d46/f4a [0,4194304] 0 2024-09-13T02:52:47.349 INFO:tasks.workunit.client.0.smithi098.stdout:8/278: creat d2/dd/d4d/f57 x:0 0 0 2024-09-13T02:52:47.349 INFO:tasks.workunit.client.0.smithi098.stdout:8/279: chown d2/f6 1988980 1 2024-09-13T02:52:47.350 INFO:tasks.workunit.client.0.smithi098.stdout:5/239: write d0/f37 [2849934,56077] 0 2024-09-13T02:52:47.355 INFO:tasks.workunit.client.1.smithi142.stdout:7/789: sync 2024-09-13T02:52:47.355 INFO:tasks.workunit.client.1.smithi142.stdout:1/781: sync 2024-09-13T02:52:47.356 INFO:tasks.workunit.client.1.smithi142.stdout:1/782: chown d12/f65 49030 1 2024-09-13T02:52:47.356 INFO:tasks.workunit.client.1.smithi142.stdout:7/790: dread - d10/d13/d1d/d2b/d56/fe2 zero size 2024-09-13T02:52:47.357 INFO:tasks.workunit.client.0.smithi098.stdout:7/468: creat d6/d24/d2a/d5a/d42/d45/d73/f98 x:0 0 0 2024-09-13T02:52:47.361 INFO:tasks.workunit.client.0.smithi098.stdout:9/259: chown d2/dd/c12 0 1 2024-09-13T02:52:47.362 INFO:tasks.workunit.client.1.smithi142.stdout:1/783: dwrite d12/d13/d20/d66/d55/db4/ff4 [0,4194304] 0 2024-09-13T02:52:47.363 INFO:tasks.workunit.client.1.smithi142.stdout:1/784: chown d12/d13/d20/d27/d3c/f59 329391776 1 2024-09-13T02:52:47.366 INFO:tasks.workunit.client.0.smithi098.stdout:6/267: unlink d5/d18/f30 0 2024-09-13T02:52:47.374 INFO:tasks.workunit.client.0.smithi098.stdout:5/240: creat d0/d29/f56 x:0 0 0 2024-09-13T02:52:47.378 INFO:tasks.workunit.client.0.smithi098.stdout:0/327: write dd/f24 [842369,101138] 0 2024-09-13T02:52:47.379 INFO:tasks.workunit.client.0.smithi098.stdout:0/328: chown dd/df/d1d/d40/f61 2008 1 2024-09-13T02:52:47.379 INFO:tasks.workunit.client.0.smithi098.stdout:0/329: chown dd/df/d1d/f2f 24 1 2024-09-13T02:52:47.382 INFO:tasks.workunit.client.0.smithi098.stdout:2/248: rename d1/d1a/c19 to d1/d1f/d36/c44 0 2024-09-13T02:52:47.383 INFO:tasks.workunit.client.0.smithi098.stdout:0/330: read dd/df/d1d/d40/f61 [1455277,90819] 0 2024-09-13T02:52:47.384 INFO:tasks.workunit.client.0.smithi098.stdout:3/261: truncate d7/d9/d25/d2b/f2c 1727678 0 2024-09-13T02:52:47.387 INFO:tasks.workunit.client.0.smithi098.stdout:5/241: mkdir d0/d57 0 2024-09-13T02:52:47.389 INFO:tasks.workunit.client.0.smithi098.stdout:4/281: getdents d6/d10/d21 0 2024-09-13T02:52:47.391 INFO:tasks.workunit.client.1.smithi142.stdout:5/799: mknod d8/dc3/df3/c103 0 2024-09-13T02:52:47.393 INFO:tasks.workunit.client.1.smithi142.stdout:2/629: dread - d1/d29/d72/f87 zero size 2024-09-13T02:52:47.395 INFO:tasks.workunit.client.1.smithi142.stdout:4/724: write d0/d7e/fd5 [250693,99474] 0 2024-09-13T02:52:47.395 INFO:tasks.workunit.client.1.smithi142.stdout:2/630: read d1/f9 [1125913,49729] 0 2024-09-13T02:52:47.395 INFO:tasks.workunit.client.1.smithi142.stdout:4/725: chown d0/d2b/d2d/c84 83361773 1 2024-09-13T02:52:47.396 INFO:tasks.workunit.client.1.smithi142.stdout:2/631: chown d1/de/d31/d6c/d6d/l75 3172 1 2024-09-13T02:52:47.396 INFO:tasks.workunit.client.0.smithi098.stdout:9/260: rename d2/d6/f2d to d2/d6/d36/f58 0 2024-09-13T02:52:47.399 INFO:tasks.workunit.client.0.smithi098.stdout:8/280: dwrite d2/dd/f25 [0,4194304] 0 2024-09-13T02:52:47.400 INFO:tasks.workunit.client.1.smithi142.stdout:9/830: read dd/d87/f8f [1563586,1955] 0 2024-09-13T02:52:47.400 INFO:tasks.workunit.client.1.smithi142.stdout:9/831: stat dd/d17/d44/d82/d99 0 2024-09-13T02:52:47.400 INFO:tasks.workunit.client.0.smithi098.stdout:8/281: readlink d2/dd/d11/d2c/l48 0 2024-09-13T02:52:47.405 INFO:tasks.workunit.client.1.smithi142.stdout:7/791: unlink d10/d13/d1d/d2b/d55/d32/f95 0 2024-09-13T02:52:47.406 INFO:tasks.workunit.client.0.smithi098.stdout:8/282: dread d2/f27 [0,4194304] 0 2024-09-13T02:52:47.407 INFO:tasks.workunit.client.0.smithi098.stdout:8/283: stat d2/dd/d11/d1d/l1e 0 2024-09-13T02:52:47.407 INFO:tasks.workunit.client.0.smithi098.stdout:0/331: dwrite dd/df/d1d/f1a [4194304,4194304] 0 2024-09-13T02:52:47.408 INFO:tasks.workunit.client.0.smithi098.stdout:3/262: mknod d7/d3c/c54 0 2024-09-13T02:52:47.409 INFO:tasks.workunit.client.1.smithi142.stdout:7/792: read d10/d13/d1d/d2b/d56/d39/fbf [112124,88192] 0 2024-09-13T02:52:47.412 INFO:tasks.workunit.client.0.smithi098.stdout:1/331: truncate d9/d33/d19/d35/d68/d60/f6d 1894392 0 2024-09-13T02:52:47.414 INFO:tasks.workunit.client.1.smithi142.stdout:0/775: sync 2024-09-13T02:52:47.415 INFO:tasks.workunit.client.0.smithi098.stdout:4/282: rmdir d6/d37 39 2024-09-13T02:52:47.416 INFO:tasks.workunit.client.0.smithi098.stdout:3/263: dwrite d7/f3d [0,4194304] 0 2024-09-13T02:52:47.416 INFO:tasks.workunit.client.1.smithi142.stdout:0/776: dread d10/d6c/d88/d21/d51/d35/fea [0,4194304] 0 2024-09-13T02:52:47.417 INFO:tasks.workunit.client.0.smithi098.stdout:3/264: chown d7/d9/c10 14 1 2024-09-13T02:52:47.417 INFO:tasks.workunit.client.0.smithi098.stdout:7/469: creat d6/d1e/f99 x:0 0 0 2024-09-13T02:52:47.419 INFO:tasks.workunit.client.1.smithi142.stdout:3/735: dwrite d12/d16/d25/d2e/d48/d5c/d66/fe9 [0,4194304] 0 2024-09-13T02:52:47.427 INFO:tasks.workunit.client.0.smithi098.stdout:6/268: rename d5/d13/f4d to d5/d13/d51/f60 0 2024-09-13T02:52:47.427 INFO:tasks.workunit.client.0.smithi098.stdout:6/269: chown f3 14 1 2024-09-13T02:52:47.431 INFO:tasks.workunit.client.1.smithi142.stdout:4/726: rename d0/df/dc9 to d0/dc8/dcf/de6 0 2024-09-13T02:52:47.433 INFO:tasks.workunit.client.1.smithi142.stdout:6/793: symlink d1/l10e 0 2024-09-13T02:52:47.439 INFO:tasks.workunit.client.0.smithi098.stdout:8/284: creat d2/dd/d11/d49/f58 x:0 0 0 2024-09-13T02:52:47.440 INFO:tasks.workunit.client.1.smithi142.stdout:2/632: write d1/d42/d44/f84 [565939,127207] 0 2024-09-13T02:52:47.440 INFO:tasks.workunit.client.1.smithi142.stdout:8/662: link d0/d6/dc/d45/d8/df/d28/lc4 d0/d6/dc/d45/ld4 0 2024-09-13T02:52:47.441 INFO:tasks.workunit.client.0.smithi098.stdout:8/285: write d2/dd/d11/d3b/f50 [607718,78967] 0 2024-09-13T02:52:47.441 INFO:tasks.workunit.client.0.smithi098.stdout:8/286: readlink d2/l10 0 2024-09-13T02:52:47.443 INFO:tasks.workunit.client.0.smithi098.stdout:0/332: creat dd/df/d1d/d40/f6f x:0 0 0 2024-09-13T02:52:47.444 INFO:tasks.workunit.client.1.smithi142.stdout:5/800: link d8/d47/d65/da0/dd1/d45/d81/d8c/fa6 d8/d47/d65/da0/dd1/d45/dc5/f104 0 2024-09-13T02:52:47.446 INFO:tasks.workunit.client.1.smithi142.stdout:1/785: sync 2024-09-13T02:52:47.447 INFO:tasks.workunit.client.0.smithi098.stdout:9/261: dread d2/d6/f19 [0,4194304] 0 2024-09-13T02:52:47.451 INFO:tasks.workunit.client.0.smithi098.stdout:1/332: symlink d9/d33/d1f/d6b/l7b 0 2024-09-13T02:52:47.452 INFO:tasks.workunit.client.0.smithi098.stdout:4/283: creat d6/d10/d21/f65 x:0 0 0 2024-09-13T02:52:47.454 INFO:tasks.workunit.client.1.smithi142.stdout:0/777: rename d10/d6c/d88/d1a/d7a/c7e to d10/d6c/d88/d21/daf/cfe 0 2024-09-13T02:52:47.454 INFO:tasks.workunit.client.0.smithi098.stdout:0/333: dread dd/f24 [0,4194304] 0 2024-09-13T02:52:47.457 INFO:tasks.workunit.client.1.smithi142.stdout:7/793: write d10/f42 [3320289,17805] 0 2024-09-13T02:52:47.459 INFO:tasks.workunit.client.0.smithi098.stdout:4/284: dwrite d6/d22/f63 [0,4194304] 0 2024-09-13T02:52:47.460 INFO:tasks.workunit.client.1.smithi142.stdout:8/663: dread d0/d6/dc/d45/d35/d37/f54 [0,4194304] 0 2024-09-13T02:52:47.460 INFO:tasks.workunit.client.0.smithi098.stdout:6/270: symlink d5/d13/d2b/d3a/d41/l61 0 2024-09-13T02:52:47.462 INFO:tasks.workunit.client.1.smithi142.stdout:4/727: dread d0/df/f5d [0,4194304] 0 2024-09-13T02:52:47.463 INFO:tasks.workunit.client.1.smithi142.stdout:4/728: write d0/df/d57/f22 [4041466,35939] 0 2024-09-13T02:52:47.464 INFO:tasks.workunit.client.1.smithi142.stdout:5/801: mkdir d8/dc3/d105 0 2024-09-13T02:52:47.470 INFO:tasks.workunit.client.1.smithi142.stdout:2/633: rename d1/d29/d72/daa/fae to d1/d29/d72/fca 0 2024-09-13T02:52:47.472 INFO:tasks.workunit.client.0.smithi098.stdout:5/242: creat d0/d38/f58 x:0 0 0 2024-09-13T02:52:47.473 INFO:tasks.workunit.client.0.smithi098.stdout:5/243: write d0/f37 [2000718,106620] 0 2024-09-13T02:52:47.475 INFO:tasks.workunit.client.1.smithi142.stdout:6/794: dwrite d1/dd/d53/d78/f80 [0,4194304] 0 2024-09-13T02:52:47.475 INFO:tasks.workunit.client.1.smithi142.stdout:6/795: chown d1/d7/d5f/d60/d76/f10c 0 1 2024-09-13T02:52:47.477 INFO:tasks.workunit.client.1.smithi142.stdout:9/832: creat dd/d98/d126/f12d x:0 0 0 2024-09-13T02:52:47.478 INFO:tasks.workunit.client.0.smithi098.stdout:1/333: mkdir d9/d33/d1f/d6b/d7c 0 2024-09-13T02:52:47.480 INFO:tasks.workunit.client.0.smithi098.stdout:5/244: dwrite d0/f4e [0,4194304] 0 2024-09-13T02:52:47.481 INFO:tasks.workunit.client.0.smithi098.stdout:1/334: write d9/d33/d19/d2c/f5e [5020126,32658] 0 2024-09-13T02:52:47.485 INFO:tasks.workunit.client.1.smithi142.stdout:4/729: creat d0/d2b/d2d/d31/d32/d82/fe7 x:0 0 0 2024-09-13T02:52:47.488 INFO:tasks.workunit.client.0.smithi098.stdout:7/470: unlink d6/d24/d2a/d5a/d42/d45/d73/c96 0 2024-09-13T02:52:47.490 INFO:tasks.workunit.client.1.smithi142.stdout:3/736: link d12/d16/d25/f4f d12/d16/d25/d2e/d38/d4d/d53/feb 0 2024-09-13T02:52:47.490 INFO:tasks.workunit.client.1.smithi142.stdout:3/737: stat d12/d16/d25/d2e/d38/d4d 0 2024-09-13T02:52:47.493 INFO:tasks.workunit.client.1.smithi142.stdout:1/786: dread d12/d13/d20/f8c [0,4194304] 0 2024-09-13T02:52:47.493 INFO:tasks.workunit.client.1.smithi142.stdout:2/634: rmdir d1/de/da6/dbb/d92 39 2024-09-13T02:52:47.495 INFO:tasks.workunit.client.0.smithi098.stdout:2/249: getdents d1/d1a/dc 0 2024-09-13T02:52:47.498 INFO:tasks.workunit.client.1.smithi142.stdout:7/794: chown d10/d13/d1d/d2b/d40/dce 0 1 2024-09-13T02:52:47.499 INFO:tasks.workunit.client.0.smithi098.stdout:8/287: mknod d2/dd/d11/d3b/d46/d47/c59 0 2024-09-13T02:52:47.501 INFO:tasks.workunit.client.0.smithi098.stdout:8/288: read d2/f41 [5632,74491] 0 2024-09-13T02:52:47.503 INFO:tasks.workunit.client.1.smithi142.stdout:9/833: creat dd/d17/d68/f12e x:0 0 0 2024-09-13T02:52:47.503 INFO:tasks.workunit.client.0.smithi098.stdout:2/250: dread d1/f8 [4194304,4194304] 0 2024-09-13T02:52:47.503 INFO:tasks.workunit.client.0.smithi098.stdout:8/289: dread - d2/dd/d4d/f57 zero size 2024-09-13T02:52:47.507 INFO:tasks.workunit.client.0.smithi098.stdout:3/265: dwrite d7/d9/f31 [0,4194304] 0 2024-09-13T02:52:47.509 INFO:tasks.workunit.client.1.smithi142.stdout:4/730: unlink d0/df/da5/dad/fbb 0 2024-09-13T02:52:47.509 INFO:tasks.workunit.client.0.smithi098.stdout:0/334: dwrite dd/df/d1d/d40/d46/f5b [0,4194304] 0 2024-09-13T02:52:47.512 INFO:tasks.workunit.client.1.smithi142.stdout:5/802: getdents d8/dc3/d64/d68/ded/dfa 0 2024-09-13T02:52:47.513 INFO:tasks.workunit.client.0.smithi098.stdout:0/335: write dd/d1f/f25 [529534,100104] 0 2024-09-13T02:52:47.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/803: chown d8/d47/d65/da0/dd1/d2d/d90/fa1 95107 1 2024-09-13T02:52:47.516 INFO:tasks.workunit.client.1.smithi142.stdout:5/804: truncate d8/d47/d65/da0/dd1/d61/f9f 193673 0 2024-09-13T02:52:47.517 INFO:tasks.workunit.client.1.smithi142.stdout:5/805: chown d8/d47/d65/da0/dd1/d2d/f7d 12296 1 2024-09-13T02:52:47.518 INFO:tasks.workunit.client.0.smithi098.stdout:9/262: truncate d2/d6/f35 885393 0 2024-09-13T02:52:47.519 INFO:tasks.workunit.client.0.smithi098.stdout:0/336: dwrite dd/df/d1d/f1a [0,4194304] 0 2024-09-13T02:52:47.520 INFO:tasks.workunit.client.1.smithi142.stdout:2/635: unlink d1/de/d1f/d13/f33 0 2024-09-13T02:52:47.521 INFO:tasks.workunit.client.0.smithi098.stdout:1/335: mknod d9/d33/d1f/d6b/c7d 0 2024-09-13T02:52:47.523 INFO:tasks.workunit.client.1.smithi142.stdout:0/778: creat d10/d6c/d88/d1a/fff x:0 0 0 2024-09-13T02:52:47.525 INFO:tasks.workunit.client.0.smithi098.stdout:7/471: fsync d6/d24/f26 0 2024-09-13T02:52:47.526 INFO:tasks.workunit.client.1.smithi142.stdout:8/664: dwrite d0/d6/dc/f49 [0,4194304] 0 2024-09-13T02:52:47.527 INFO:tasks.workunit.client.0.smithi098.stdout:4/285: chown d6/d10/d21/f2b 0 1 2024-09-13T02:52:47.530 INFO:tasks.workunit.client.0.smithi098.stdout:6/271: rename d5/d36/c57 to d5/d13/d2b/d3a/d41/c62 0 2024-09-13T02:52:47.534 INFO:tasks.workunit.client.1.smithi142.stdout:4/731: mkdir d0/dc8/de8 0 2024-09-13T02:52:47.538 INFO:tasks.workunit.client.1.smithi142.stdout:1/787: fsync d12/d13/d20/d66/d55/db4/fd4 0 2024-09-13T02:52:47.540 INFO:tasks.workunit.client.0.smithi098.stdout:8/290: truncate f1 4625782 0 2024-09-13T02:52:47.543 INFO:tasks.workunit.client.0.smithi098.stdout:3/266: rmdir d7/d9/d15/d2d/d34 39 2024-09-13T02:52:47.545 INFO:tasks.workunit.client.1.smithi142.stdout:2/636: unlink d1/de/da6/dbb/d6f/c95 0 2024-09-13T02:52:47.547 INFO:tasks.workunit.client.0.smithi098.stdout:5/245: creat d0/d15/d50/f59 x:0 0 0 2024-09-13T02:52:47.548 INFO:tasks.workunit.client.1.smithi142.stdout:0/779: mkdir d10/d6c/d88/d1a/d7a/d100 0 2024-09-13T02:52:47.549 INFO:tasks.workunit.client.1.smithi142.stdout:9/834: dwrite dd/d17/d44/d95/dd1/ff9 [0,4194304] 0 2024-09-13T02:52:47.551 INFO:tasks.workunit.client.1.smithi142.stdout:8/665: readlink d0/d6/dc/d40/la5 0 2024-09-13T02:52:47.554 INFO:tasks.workunit.client.0.smithi098.stdout:7/472: fsync d6/d24/d2a/d5a/f22 0 2024-09-13T02:52:47.555 INFO:tasks.workunit.client.0.smithi098.stdout:7/473: write d6/f41 [915164,14717] 0 2024-09-13T02:52:47.559 INFO:tasks.workunit.client.0.smithi098.stdout:7/474: dread d6/d1e/f36 [0,4194304] 0 2024-09-13T02:52:47.560 INFO:tasks.workunit.client.0.smithi098.stdout:1/336: rename d9/c4e to d9/d33/d19/d35/c7e 0 2024-09-13T02:52:47.561 INFO:tasks.workunit.client.1.smithi142.stdout:4/732: dwrite d0/f9b [0,4194304] 0 2024-09-13T02:52:47.563 INFO:tasks.workunit.client.1.smithi142.stdout:3/738: sync 2024-09-13T02:52:47.563 INFO:tasks.workunit.client.1.smithi142.stdout:1/788: rename d12/d13/d1d to d12/d13/d20/d66/d7d/df5 0 2024-09-13T02:52:47.564 INFO:tasks.workunit.client.1.smithi142.stdout:5/806: getdents d8/d47/d65/da0/dd1/db6 0 2024-09-13T02:52:47.574 INFO:tasks.workunit.client.0.smithi098.stdout:8/291: rmdir d2/dd/d11/d1d 39 2024-09-13T02:52:47.577 INFO:tasks.workunit.client.1.smithi142.stdout:7/795: creat d10/d13/f108 x:0 0 0 2024-09-13T02:52:47.577 INFO:tasks.workunit.client.1.smithi142.stdout:7/796: stat d10/d13/d1d/d2b/d56/d5f 0 2024-09-13T02:52:47.578 INFO:tasks.workunit.client.0.smithi098.stdout:3/267: creat d7/d9/d25/d3a/d52/f55 x:0 0 0 2024-09-13T02:52:47.580 INFO:tasks.workunit.client.1.smithi142.stdout:0/780: mknod d10/d6c/d88/d1a/d1e/d42/c101 0 2024-09-13T02:52:47.581 INFO:tasks.workunit.client.0.smithi098.stdout:5/246: rmdir d0/d15/d50 39 2024-09-13T02:52:47.581 INFO:tasks.workunit.client.0.smithi098.stdout:8/292: dread d2/f4a [0,4194304] 0 2024-09-13T02:52:47.582 INFO:tasks.workunit.client.0.smithi098.stdout:8/293: chown d2/l19 32610 1 2024-09-13T02:52:47.582 INFO:tasks.workunit.client.0.smithi098.stdout:5/247: write d0/d15/d17/f28 [895730,52968] 0 2024-09-13T02:52:47.586 INFO:tasks.workunit.client.0.smithi098.stdout:9/263: fdatasync d2/d6/f2a 0 2024-09-13T02:52:47.588 INFO:tasks.workunit.client.1.smithi142.stdout:9/835: mknod dd/d17/d44/d82/d99/daf/c12f 0 2024-09-13T02:52:47.589 INFO:tasks.workunit.client.0.smithi098.stdout:0/337: getdents dd/df/d1d/d26/d37/d53 0 2024-09-13T02:52:47.595 INFO:tasks.workunit.client.0.smithi098.stdout:4/286: creat d6/d3e/d46/f66 x:0 0 0 2024-09-13T02:52:47.597 INFO:tasks.workunit.client.1.smithi142.stdout:4/733: creat d0/d2b/d2d/d31/d32/fe9 x:0 0 0 2024-09-13T02:52:47.598 INFO:tasks.workunit.client.0.smithi098.stdout:7/475: mkdir d6/d24/d2a/d5a/d86/d65/d9a 0 2024-09-13T02:52:47.599 INFO:tasks.workunit.client.1.smithi142.stdout:3/739: creat d12/d16/d25/d2e/d48/d5c/fec x:0 0 0 2024-09-13T02:52:47.601 INFO:tasks.workunit.client.0.smithi098.stdout:1/337: mknod d9/d33/d19/c7f 0 2024-09-13T02:52:47.603 INFO:tasks.workunit.client.0.smithi098.stdout:6/272: link d5/d13/d2b/d3a/f11 d5/d13/d2b/d5b/f63 0 2024-09-13T02:52:47.604 INFO:tasks.workunit.client.1.smithi142.stdout:5/807: readlink d8/d47/d65/da0/dd1/d2d/d90/l91 0 2024-09-13T02:52:47.606 INFO:tasks.workunit.client.0.smithi098.stdout:2/251: rmdir d1/d1c 0 2024-09-13T02:52:47.607 INFO:tasks.workunit.client.1.smithi142.stdout:7/797: creat d10/d13/d1d/d2b/d56/d5f/da2/f109 x:0 0 0 2024-09-13T02:52:47.608 INFO:tasks.workunit.client.1.smithi142.stdout:7/798: dread - d10/d64/fe7 zero size 2024-09-13T02:52:47.609 INFO:tasks.workunit.client.1.smithi142.stdout:8/666: write d0/d6/dc/d40/d4d/d62/f74 [931541,67536] 0 2024-09-13T02:52:47.609 INFO:tasks.workunit.client.0.smithi098.stdout:3/268: symlink d7/d9/l56 0 2024-09-13T02:52:47.609 INFO:tasks.workunit.client.1.smithi142.stdout:6/796: link d1/d7/d5f/d60/d65/lcb d1/d7/d19/d48/d90/l10f 0 2024-09-13T02:52:47.611 INFO:tasks.workunit.client.0.smithi098.stdout:5/248: symlink d0/d38/d3f/d1a/d32/d4d/l5a 0 2024-09-13T02:52:47.611 INFO:tasks.workunit.client.1.smithi142.stdout:2/637: write d1/de/da6/dbb/f51 [215367,46357] 0 2024-09-13T02:52:47.612 INFO:tasks.workunit.client.0.smithi098.stdout:5/249: stat d0/d15/d17/f26 0 2024-09-13T02:52:47.615 INFO:tasks.workunit.client.1.smithi142.stdout:9/836: dread dd/d17/d69/d84/f76 [0,4194304] 0 2024-09-13T02:52:47.616 INFO:tasks.workunit.client.0.smithi098.stdout:4/287: fsync d6/db/f29 0 2024-09-13T02:52:47.617 INFO:tasks.workunit.client.1.smithi142.stdout:3/740: unlink d12/d16/d25/d2e/f2f 0 2024-09-13T02:52:47.618 INFO:tasks.workunit.client.1.smithi142.stdout:3/741: read d12/d16/d25/d2e/f49 [796923,78854] 0 2024-09-13T02:52:47.620 INFO:tasks.workunit.client.1.smithi142.stdout:3/742: fsync d12/d16/d25/d2e/d38/d4d/d53/da0/fca 0 2024-09-13T02:52:47.620 INFO:tasks.workunit.client.1.smithi142.stdout:5/808: truncate f0 1240792 0 2024-09-13T02:52:47.622 INFO:tasks.workunit.client.1.smithi142.stdout:0/781: rmdir d10/d95 39 2024-09-13T02:52:47.624 INFO:tasks.workunit.client.0.smithi098.stdout:2/252: creat d1/d1f/d35/f45 x:0 0 0 2024-09-13T02:52:47.625 INFO:tasks.workunit.client.0.smithi098.stdout:1/338: dwrite d9/d33/d19/d35/d68/d2f/f49 [0,4194304] 0 2024-09-13T02:52:47.626 INFO:tasks.workunit.client.0.smithi098.stdout:3/269: stat d7/d9/d15/c4d 0 2024-09-13T02:52:47.626 INFO:tasks.workunit.client.1.smithi142.stdout:9/837: dread f5 [0,4194304] 0 2024-09-13T02:52:47.627 INFO:tasks.workunit.client.0.smithi098.stdout:2/253: write d1/d1a/d9/d1e/f2e [1517381,41179] 0 2024-09-13T02:52:47.628 INFO:tasks.workunit.client.1.smithi142.stdout:6/797: creat d1/d7/d5f/d60/db6/f110 x:0 0 0 2024-09-13T02:52:47.633 INFO:tasks.workunit.client.0.smithi098.stdout:1/339: dwrite d9/d33/f67 [0,4194304] 0 2024-09-13T02:52:47.634 INFO:tasks.workunit.client.0.smithi098.stdout:1/340: chown d9/d33/f67 23559 1 2024-09-13T02:52:47.634 INFO:tasks.workunit.client.1.smithi142.stdout:8/667: truncate d0/d6/d83/daa/fb0 3700131 0 2024-09-13T02:52:47.637 INFO:tasks.workunit.client.0.smithi098.stdout:5/250: readlink d0/d38/d3f/d1a/l45 0 2024-09-13T02:52:47.639 INFO:tasks.workunit.client.0.smithi098.stdout:9/264: write d2/f10 [2237327,91181] 0 2024-09-13T02:52:47.642 INFO:tasks.workunit.client.1.smithi142.stdout:4/734: link d0/d2b/d2d/d31/d32/d82/f8c d0/d7e/db8/fea 0 2024-09-13T02:52:47.649 INFO:tasks.workunit.client.0.smithi098.stdout:7/476: symlink d6/d24/d2a/d5a/d86/d65/d9a/l9b 0 2024-09-13T02:52:47.653 INFO:tasks.workunit.client.1.smithi142.stdout:1/789: creat d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/ff6 x:0 0 0 2024-09-13T02:52:47.659 INFO:tasks.workunit.client.1.smithi142.stdout:0/782: symlink d10/d6c/d88/d21/d51/d35/l102 0 2024-09-13T02:52:47.660 INFO:tasks.workunit.client.0.smithi098.stdout:3/270: mknod d7/d9/c57 0 2024-09-13T02:52:47.661 INFO:tasks.workunit.client.0.smithi098.stdout:3/271: write d7/fc [631352,3958] 0 2024-09-13T02:52:47.661 INFO:tasks.workunit.client.0.smithi098.stdout:6/273: truncate d5/d13/d2b/d3a/f11 1264227 0 2024-09-13T02:52:47.662 INFO:tasks.workunit.client.0.smithi098.stdout:6/274: stat d5/d13/f1c 0 2024-09-13T02:52:47.663 INFO:tasks.workunit.client.0.smithi098.stdout:8/294: creat d2/dd/f5a x:0 0 0 2024-09-13T02:52:47.665 INFO:tasks.workunit.client.1.smithi142.stdout:6/798: mkdir d1/d7/d5f/d60/d65/d111 0 2024-09-13T02:52:47.666 INFO:tasks.workunit.client.1.smithi142.stdout:6/799: truncate d1/dd/d53/d78/d104/dad/fed 68269 0 2024-09-13T02:52:47.668 INFO:tasks.workunit.client.0.smithi098.stdout:5/251: creat d0/d38/d3f/f5b x:0 0 0 2024-09-13T02:52:47.675 INFO:tasks.workunit.client.0.smithi098.stdout:4/288: rename d6/l7 to d6/db/l67 0 2024-09-13T02:52:47.680 INFO:tasks.workunit.client.0.smithi098.stdout:4/289: dread d6/d10/d21/f2b [0,4194304] 0 2024-09-13T02:52:47.681 INFO:tasks.workunit.client.1.smithi142.stdout:1/790: creat d12/d13/d20/d66/d55/ff7 x:0 0 0 2024-09-13T02:52:47.681 INFO:tasks.workunit.client.1.smithi142.stdout:1/791: fdatasync d12/d13/d20/d66/fbd 0 2024-09-13T02:52:47.683 INFO:tasks.workunit.client.1.smithi142.stdout:3/743: mknod d12/d16/ced 0 2024-09-13T02:52:47.684 INFO:tasks.workunit.client.0.smithi098.stdout:1/341: dwrite f8 [0,4194304] 0 2024-09-13T02:52:47.685 INFO:tasks.workunit.client.0.smithi098.stdout:2/254: symlink d1/l46 0 2024-09-13T02:52:47.690 INFO:tasks.workunit.client.0.smithi098.stdout:3/272: dread d7/d9/d15/f49 [0,4194304] 0 2024-09-13T02:52:47.690 INFO:tasks.workunit.client.0.smithi098.stdout:3/273: dread - d7/d9/d25/f39 zero size 2024-09-13T02:52:47.765 INFO:tasks.workunit.client.1.smithi142.stdout:0/783: sync 2024-09-13T02:52:47.775 INFO:tasks.workunit.client.1.smithi142.stdout:0/784: dread d10/dbf/fd4 [0,4194304] 0 2024-09-13T02:52:47.780 INFO:tasks.workunit.client.1.smithi142.stdout:0/785: dwrite d10/d6c/d88/d1a/d7a/ff0 [0,4194304] 0 2024-09-13T02:52:47.785 INFO:tasks.workunit.client.1.smithi142.stdout:5/809: mkdir d8/dc3/d105/d106 0 2024-09-13T02:52:47.789 INFO:tasks.workunit.client.0.smithi098.stdout:8/295: creat d2/d2f/f5b x:0 0 0 2024-09-13T02:52:47.791 INFO:tasks.workunit.client.1.smithi142.stdout:9/838: mknod dd/d17/d44/d95/dd1/d12b/c130 0 2024-09-13T02:52:47.792 INFO:tasks.workunit.client.0.smithi098.stdout:6/275: dwrite d5/d18/f4c [0,4194304] 0 2024-09-13T02:52:47.809 INFO:tasks.workunit.client.0.smithi098.stdout:9/265: mknod d2/d6/d2b/d4d/d56/c59 0 2024-09-13T02:52:47.809 INFO:tasks.workunit.client.0.smithi098.stdout:9/266: chown d2/d6/d2b/f31 801095426 1 2024-09-13T02:52:47.810 INFO:tasks.workunit.client.1.smithi142.stdout:2/638: mknod d1/d29/d72/daa/ccb 0 2024-09-13T02:52:47.811 INFO:tasks.workunit.client.1.smithi142.stdout:2/639: write d1/de/da6/dbb/fa2 [208573,80075] 0 2024-09-13T02:52:48.100 INFO:tasks.workunit.client.0.smithi098.stdout:5/252: write d0/d15/d17/f1e [1307207,110003] 0 2024-09-13T02:52:48.101 INFO:tasks.workunit.client.0.smithi098.stdout:1/342: mknod d9/d33/d1f/c80 0 2024-09-13T02:52:48.101 INFO:tasks.workunit.client.0.smithi098.stdout:5/253: write d0/d15/d17/f44 [559874,34434] 0 2024-09-13T02:52:48.102 INFO:tasks.workunit.client.1.smithi142.stdout:8/668: truncate d0/d6/dc/d45/f1b 1918697 0 2024-09-13T02:52:48.103 INFO:tasks.workunit.client.1.smithi142.stdout:8/669: write d0/d6/dc/d2e/fb7 [709525,66482] 0 2024-09-13T02:52:48.105 INFO:tasks.workunit.client.0.smithi098.stdout:2/255: rename d1/d1f/d35/f3c to d1/d1a/d9/d1e/f47 0 2024-09-13T02:52:48.105 INFO:tasks.workunit.client.1.smithi142.stdout:6/800: write d1/d7/f2a [310246,35848] 0 2024-09-13T02:52:48.109 INFO:tasks.workunit.client.0.smithi098.stdout:3/274: mknod d7/d9/c58 0 2024-09-13T02:52:48.110 INFO:tasks.workunit.client.0.smithi098.stdout:3/275: stat d7/f3d 0 2024-09-13T02:52:48.110 INFO:tasks.workunit.client.1.smithi142.stdout:0/786: truncate d10/d6c/d88/d21/d51/d35/fea 256269 0 2024-09-13T02:52:48.111 INFO:tasks.workunit.client.1.smithi142.stdout:0/787: fsync d10/d6c/d88/d21/d51/d35/f53 0 2024-09-13T02:52:48.112 INFO:tasks.workunit.client.0.smithi098.stdout:8/296: mkdir d2/dd/d11/d3b/d46/d5c 0 2024-09-13T02:52:48.113 INFO:tasks.workunit.client.0.smithi098.stdout:6/276: write d5/d18/f3c [416012,56711] 0 2024-09-13T02:52:48.114 INFO:tasks.workunit.client.1.smithi142.stdout:7/799: getdents d10/d13/d1d/d2b/d55 0 2024-09-13T02:52:48.117 INFO:tasks.workunit.client.1.smithi142.stdout:9/839: stat dd/d17/d44/d82/d99/daf/dc9/de9/df5 0 2024-09-13T02:52:48.121 INFO:tasks.workunit.client.0.smithi098.stdout:7/477: link d6/d24/d2a/d57/l68 d6/d24/d2a/d5a/l9c 0 2024-09-13T02:52:48.123 INFO:tasks.workunit.client.1.smithi142.stdout:4/735: truncate d0/d2b/d2d/d31/f8b 2632126 0 2024-09-13T02:52:48.124 INFO:tasks.workunit.client.1.smithi142.stdout:4/736: chown d0/d2b/d2d/d31/d43/ca0 260 1 2024-09-13T02:52:48.125 INFO:tasks.workunit.client.0.smithi098.stdout:9/267: dwrite d2/d6/f42 [0,4194304] 0 2024-09-13T02:52:48.127 INFO:tasks.workunit.client.0.smithi098.stdout:5/254: chown d0/d15/d50 0 1 2024-09-13T02:52:48.133 INFO:tasks.workunit.client.1.smithi142.stdout:6/801: rmdir d1/dd/d16/d4e 39 2024-09-13T02:52:48.133 INFO:tasks.workunit.client.0.smithi098.stdout:2/256: chown d1/d1f/d36/c44 12 1 2024-09-13T02:52:48.134 INFO:tasks.workunit.client.0.smithi098.stdout:2/257: write d1/d1a/f12 [5976861,7280] 0 2024-09-13T02:52:48.135 INFO:tasks.workunit.client.0.smithi098.stdout:3/276: symlink d7/d9/d25/d3a/d52/l59 0 2024-09-13T02:52:48.136 INFO:tasks.workunit.client.0.smithi098.stdout:5/255: dwrite d0/d15/d17/f44 [0,4194304] 0 2024-09-13T02:52:48.137 INFO:tasks.workunit.client.0.smithi098.stdout:3/277: stat d7/d9/d15/d2d 0 2024-09-13T02:52:48.138 INFO:tasks.workunit.client.0.smithi098.stdout:5/256: write d0/d29/f56 [609462,114375] 0 2024-09-13T02:52:48.138 INFO:tasks.workunit.client.0.smithi098.stdout:3/278: fsync d7/d3c/f46 0 2024-09-13T02:52:48.139 INFO:tasks.workunit.client.0.smithi098.stdout:8/297: mkdir d2/dd/d11/d3b/d5d 0 2024-09-13T02:52:48.139 INFO:tasks.workunit.client.1.smithi142.stdout:7/800: dread d10/d34/d57/fda [4194304,4194304] 0 2024-09-13T02:52:48.141 INFO:tasks.workunit.client.1.smithi142.stdout:7/801: dread - d10/d34/d57/ff8 zero size 2024-09-13T02:52:48.141 INFO:tasks.workunit.client.1.smithi142.stdout:0/788: unlink d10/d23/f2f 0 2024-09-13T02:52:48.146 INFO:tasks.workunit.client.0.smithi098.stdout:6/277: mknod d5/d13/d2b/c64 0 2024-09-13T02:52:48.146 INFO:tasks.workunit.client.1.smithi142.stdout:9/840: creat dd/d17/d44/d82/d99/de3/f131 x:0 0 0 2024-09-13T02:52:48.148 INFO:tasks.workunit.client.0.smithi098.stdout:7/478: rename d6/d24/d2a/d5a/f34 to d6/d24/d2a/d57/f9d 0 2024-09-13T02:52:48.149 INFO:tasks.workunit.client.1.smithi142.stdout:2/640: symlink d1/de/da6/dbb/dc2/lcc 0 2024-09-13T02:52:48.152 INFO:tasks.workunit.client.0.smithi098.stdout:2/258: dwrite d1/d1a/dc/f37 [8388608,4194304] 0 2024-09-13T02:52:48.152 INFO:tasks.workunit.client.0.smithi098.stdout:9/268: creat d2/dd/d39/f5a x:0 0 0 2024-09-13T02:52:48.155 INFO:tasks.workunit.client.0.smithi098.stdout:8/298: dwrite d2/dd/d11/d3b/f4f [0,4194304] 0 2024-09-13T02:52:48.155 INFO:tasks.workunit.client.1.smithi142.stdout:1/792: link d12/d13/d20/d27/d3c/fb9 d12/d13/ff8 0 2024-09-13T02:52:48.161 INFO:tasks.workunit.client.1.smithi142.stdout:3/744: mknod d12/d16/d25/d2e/d38/d4d/dad/cee 0 2024-09-13T02:52:48.162 INFO:tasks.workunit.client.0.smithi098.stdout:2/259: dwrite d1/d1a/f3a [0,4194304] 0 2024-09-13T02:52:48.163 INFO:tasks.workunit.client.1.smithi142.stdout:7/802: dread d10/d13/d1d/d25/f75 [0,4194304] 0 2024-09-13T02:52:48.164 INFO:tasks.workunit.client.0.smithi098.stdout:2/260: fdatasync d1/d1a/f7 0 2024-09-13T02:52:48.170 INFO:tasks.workunit.client.1.smithi142.stdout:8/670: rename d0/d6/dc/d2e/l3e to d0/d6/dc/d45/d35/ld5 0 2024-09-13T02:52:48.171 INFO:tasks.workunit.client.0.smithi098.stdout:3/279: fdatasync d7/f1d 0 2024-09-13T02:52:48.172 INFO:tasks.workunit.client.0.smithi098.stdout:5/257: dwrite d0/ff [0,4194304] 0 2024-09-13T02:52:48.174 INFO:tasks.workunit.client.0.smithi098.stdout:3/280: write d7/d9/d25/f39 [400709,54649] 0 2024-09-13T02:52:48.174 INFO:tasks.workunit.client.0.smithi098.stdout:3/281: chown d7/d3c/f46 36 1 2024-09-13T02:52:48.185 INFO:tasks.workunit.client.1.smithi142.stdout:9/841: symlink dd/d17/d5f/l132 0 2024-09-13T02:52:48.186 INFO:tasks.workunit.client.1.smithi142.stdout:4/737: dwrite d0/d2b/d2d/d31/d43/d48/f78 [0,4194304] 0 2024-09-13T02:52:48.189 INFO:tasks.workunit.client.1.smithi142.stdout:2/641: creat d1/de/da6/dbb/dc2/fcd x:0 0 0 2024-09-13T02:52:48.190 INFO:tasks.workunit.client.1.smithi142.stdout:2/642: chown d1/de/d31/d6c/f88 3 1 2024-09-13T02:52:48.191 INFO:tasks.workunit.client.1.smithi142.stdout:2/643: chown d1/de/d1f/d13/f89 6497 1 2024-09-13T02:52:48.192 INFO:tasks.workunit.client.1.smithi142.stdout:9/842: dwrite dd/d17/d44/f5c [4194304,4194304] 0 2024-09-13T02:52:48.192 INFO:tasks.workunit.client.1.smithi142.stdout:2/644: chown d1/d29/f30 1 1 2024-09-13T02:52:48.193 INFO:tasks.workunit.client.1.smithi142.stdout:9/843: readlink dd/d87/def/lf7 0 2024-09-13T02:52:48.194 INFO:tasks.workunit.client.1.smithi142.stdout:3/745: creat d12/d16/dc7/fef x:0 0 0 2024-09-13T02:52:48.201 INFO:tasks.workunit.client.1.smithi142.stdout:6/802: write d1/d7/d5f/f68 [1825627,88156] 0 2024-09-13T02:52:48.202 INFO:tasks.workunit.client.1.smithi142.stdout:8/671: symlink d0/d6/dc/d45/d35/d61/d77/ld6 0 2024-09-13T02:52:48.205 INFO:tasks.workunit.client.1.smithi142.stdout:5/810: getdents d8/dc3/df3/dc6/de2 0 2024-09-13T02:52:48.206 INFO:tasks.workunit.client.1.smithi142.stdout:5/811: fdatasync d8/d47/d65/da0/dd1/d61/f7e 0 2024-09-13T02:52:48.206 INFO:tasks.workunit.client.0.smithi098.stdout:7/479: symlink d6/d24/d2a/d57/d88/l9e 0 2024-09-13T02:52:48.209 INFO:tasks.workunit.client.0.smithi098.stdout:9/269: rename d2/d6/f2a to d2/d6/d36/f5b 0 2024-09-13T02:52:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:8/299: mknod d2/dd/d11/d3b/d46/c5e 0 2024-09-13T02:52:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:8/300: stat d2/d2f/f5b 0 2024-09-13T02:52:48.213 INFO:tasks.workunit.client.1.smithi142.stdout:5/812: dread d8/dc3/f3c [0,4194304] 0 2024-09-13T02:52:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:0/338: sync 2024-09-13T02:52:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:0/339: write dd/df/f3d [109063,13324] 0 2024-09-13T02:52:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:6/278: mknod d5/d18/d50/c65 0 2024-09-13T02:52:48.219 INFO:tasks.workunit.client.1.smithi142.stdout:7/803: write d10/f81 [958804,27043] 0 2024-09-13T02:52:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:6/279: write d5/f15 [326138,72615] 0 2024-09-13T02:52:48.221 INFO:tasks.workunit.client.1.smithi142.stdout:6/803: creat d1/d7/d5f/d60/d76/f112 x:0 0 0 2024-09-13T02:52:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:1/343: getdents d9/d33/d19/d35/d68/d60/d61 0 2024-09-13T02:52:48.223 INFO:tasks.workunit.client.1.smithi142.stdout:3/746: dwrite d12/fe0 [0,4194304] 0 2024-09-13T02:52:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:3/282: dwrite d7/d9/f32 [0,4194304] 0 2024-09-13T02:52:48.224 INFO:tasks.workunit.client.1.smithi142.stdout:3/747: fsync d12/d16/d25/d2e/d38/d4d/d53/d78/fc5 0 2024-09-13T02:52:48.225 INFO:tasks.workunit.client.1.smithi142.stdout:8/672: symlink d0/d6/d23/d2b/ld7 0 2024-09-13T02:52:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:3/283: chown d7/d9/d25/d3a/d52/f55 819 1 2024-09-13T02:52:48.226 INFO:tasks.workunit.client.0.smithi098.stdout:6/280: dread d5/fb [0,4194304] 0 2024-09-13T02:52:48.227 INFO:tasks.workunit.client.1.smithi142.stdout:0/789: creat d10/d95/dcf/f103 x:0 0 0 2024-09-13T02:52:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:9/270: creat d2/d6/d2b/f5c x:0 0 0 2024-09-13T02:52:48.233 INFO:tasks.workunit.client.1.smithi142.stdout:4/738: mknod d0/dc8/dcf/de6/dd2/ceb 0 2024-09-13T02:52:48.235 INFO:tasks.workunit.client.1.smithi142.stdout:1/793: creat d12/d13/ff9 x:0 0 0 2024-09-13T02:52:48.235 INFO:tasks.workunit.client.1.smithi142.stdout:2/645: creat d1/de/d31/db0/fce x:0 0 0 2024-09-13T02:52:48.236 INFO:tasks.workunit.client.0.smithi098.stdout:5/258: mknod d0/d57/c5c 0 2024-09-13T02:52:48.236 INFO:tasks.workunit.client.0.smithi098.stdout:5/259: readlink d0/d38/d3f/l53 0 2024-09-13T02:52:48.237 INFO:tasks.workunit.client.0.smithi098.stdout:0/340: readlink dd/df/d1d/d40/l68 0 2024-09-13T02:52:48.238 INFO:tasks.workunit.client.0.smithi098.stdout:0/341: dread - dd/df/d1d/d26/f51 zero size 2024-09-13T02:52:48.238 INFO:tasks.workunit.client.1.smithi142.stdout:9/844: mknod dd/d17/d44/d82/d99/c133 0 2024-09-13T02:52:48.242 INFO:tasks.workunit.client.0.smithi098.stdout:3/284: write d7/f1d [4384015,46161] 0 2024-09-13T02:52:48.243 INFO:tasks.workunit.client.0.smithi098.stdout:6/281: truncate d5/f33 3754498 0 2024-09-13T02:52:48.244 INFO:tasks.workunit.client.0.smithi098.stdout:3/285: truncate d7/d9/d25/d3a/d52/f3b 1256436 0 2024-09-13T02:52:48.245 INFO:tasks.workunit.client.0.smithi098.stdout:3/286: truncate d7/d3c/f45 612608 0 2024-09-13T02:52:48.248 INFO:tasks.workunit.client.0.smithi098.stdout:2/261: creat d1/f48 x:0 0 0 2024-09-13T02:52:48.251 INFO:tasks.workunit.client.0.smithi098.stdout:3/287: dwrite d7/d9/f31 [0,4194304] 0 2024-09-13T02:52:48.251 INFO:tasks.workunit.client.0.smithi098.stdout:5/260: dread d0/d15/f3a [0,4194304] 0 2024-09-13T02:52:48.252 INFO:tasks.workunit.client.1.smithi142.stdout:0/790: dread d10/d6c/d88/d36/f59 [0,4194304] 0 2024-09-13T02:52:48.253 INFO:tasks.workunit.client.1.smithi142.stdout:4/739: mknod d0/df/da5/dad/cec 0 2024-09-13T02:52:48.254 INFO:tasks.workunit.client.0.smithi098.stdout:0/342: rename dd/f16 to dd/df/d1d/d40/d46/d6b/f70 0 2024-09-13T02:52:48.255 INFO:tasks.workunit.client.0.smithi098.stdout:0/343: chown dd/df/d1d/f43 86223 1 2024-09-13T02:52:48.256 INFO:tasks.workunit.client.0.smithi098.stdout:0/344: stat l6 0 2024-09-13T02:52:48.258 INFO:tasks.workunit.client.0.smithi098.stdout:9/271: link d2/d6/d36/f58 d2/d6/d2b/d4d/f5d 0 2024-09-13T02:52:48.259 INFO:tasks.workunit.client.0.smithi098.stdout:9/272: write d2/d6/d36/f4e [471296,28909] 0 2024-09-13T02:52:48.260 INFO:tasks.workunit.client.1.smithi142.stdout:1/794: rmdir d12/d13/d20/d66/d55/da0 39 2024-09-13T02:52:48.266 INFO:tasks.workunit.client.1.smithi142.stdout:2/646: dwrite d1/fb5 [0,4194304] 0 2024-09-13T02:52:48.266 INFO:tasks.workunit.client.1.smithi142.stdout:7/804: dread d10/d13/d1d/d2b/d40/fca [0,4194304] 0 2024-09-13T02:52:48.266 INFO:tasks.workunit.client.1.smithi142.stdout:6/804: creat d1/dd/d16/d4e/d32/f113 x:0 0 0 2024-09-13T02:52:48.268 INFO:tasks.workunit.client.1.smithi142.stdout:3/748: rmdir d12/d16/d3c/d7d 39 2024-09-13T02:52:48.268 INFO:tasks.workunit.client.1.smithi142.stdout:6/805: write d1/d7/f24 [4984891,69347] 0 2024-09-13T02:52:48.272 INFO:tasks.workunit.client.0.smithi098.stdout:7/480: truncate d6/d24/d2a/d5a/f44 1777295 0 2024-09-13T02:52:48.273 INFO:tasks.workunit.client.0.smithi098.stdout:7/481: chown d6/d24/d2a/d5a/d42/f71 477 1 2024-09-13T02:52:48.273 INFO:tasks.workunit.client.0.smithi098.stdout:4/290: sync 2024-09-13T02:52:48.278 INFO:tasks.workunit.client.0.smithi098.stdout:6/282: rename d5/d13/d51/f5d to d5/d13/d2b/d3a/d14/f66 0 2024-09-13T02:52:48.278 INFO:tasks.workunit.client.0.smithi098.stdout:8/301: write d2/dd/d11/d1d/f3a [2801940,44956] 0 2024-09-13T02:52:48.280 INFO:tasks.workunit.client.0.smithi098.stdout:6/283: write d5/f15 [1308276,101699] 0 2024-09-13T02:52:48.280 INFO:tasks.workunit.client.1.smithi142.stdout:2/647: dwrite d1/de/da6/dbb/dc2/fcd [0,4194304] 0 2024-09-13T02:52:48.281 INFO:tasks.workunit.client.0.smithi098.stdout:0/345: truncate dd/df/d1d/d26/d28/f2e 1496541 0 2024-09-13T02:52:48.281 INFO:tasks.workunit.client.1.smithi142.stdout:7/805: dwrite d10/d13/d1d/d25/d5c/da3/f102 [0,4194304] 0 2024-09-13T02:52:48.284 INFO:tasks.workunit.client.0.smithi098.stdout:9/273: mknod d2/d6/d2b/c5e 0 2024-09-13T02:52:48.284 INFO:tasks.workunit.client.0.smithi098.stdout:1/344: write d9/d33/d19/d35/d68/d60/f6d [1597591,17278] 0 2024-09-13T02:52:48.285 INFO:tasks.workunit.client.1.smithi142.stdout:3/749: dwrite d12/d16/d25/d2e/d48/d5c/d8c/daf/fbe [0,4194304] 0 2024-09-13T02:52:48.287 INFO:tasks.workunit.client.0.smithi098.stdout:2/262: creat d1/d1f/d39/f49 x:0 0 0 2024-09-13T02:52:48.291 INFO:tasks.workunit.client.0.smithi098.stdout:8/302: fsync d2/dd/d11/d1d/f3a 0 2024-09-13T02:52:48.293 INFO:tasks.workunit.client.0.smithi098.stdout:9/274: dread d2/f10 [0,4194304] 0 2024-09-13T02:52:48.293 INFO:tasks.workunit.client.0.smithi098.stdout:5/261: unlink d0/d15/d17/c16 0 2024-09-13T02:52:48.294 INFO:tasks.workunit.client.0.smithi098.stdout:5/262: readlink d0/d15/l48 0 2024-09-13T02:52:48.294 INFO:tasks.workunit.client.0.smithi098.stdout:9/275: chown d2/d6/l26 114168788 1 2024-09-13T02:52:48.298 INFO:tasks.workunit.client.0.smithi098.stdout:3/288: creat d7/d9/d15/d2d/d34/f5a x:0 0 0 2024-09-13T02:52:48.299 INFO:tasks.workunit.client.0.smithi098.stdout:3/289: write d7/f43 [3240653,6596] 0 2024-09-13T02:52:48.302 INFO:tasks.workunit.client.0.smithi098.stdout:7/482: rmdir d6/d24/d2a/d5a/d42/d45/d73 39 2024-09-13T02:52:48.303 INFO:tasks.workunit.client.0.smithi098.stdout:7/483: write f5 [2060488,102018] 0 2024-09-13T02:52:48.308 INFO:tasks.workunit.client.1.smithi142.stdout:8/673: dwrite d0/d6/dc/d45/f1b [0,4194304] 0 2024-09-13T02:52:48.309 INFO:tasks.workunit.client.1.smithi142.stdout:8/674: write d0/d6/dc/d45/d35/fa4 [807238,129425] 0 2024-09-13T02:52:48.309 INFO:tasks.workunit.client.1.smithi142.stdout:0/791: write d10/d6c/d88/d21/f3c [4322990,124984] 0 2024-09-13T02:52:48.310 INFO:tasks.workunit.client.0.smithi098.stdout:7/484: dwrite d6/d24/d2a/d5a/d86/f8d [0,4194304] 0 2024-09-13T02:52:48.314 INFO:tasks.workunit.client.0.smithi098.stdout:6/284: mkdir d5/d13/d67 0 2024-09-13T02:52:48.320 INFO:tasks.workunit.client.0.smithi098.stdout:7/485: dwrite d6/f11 [4194304,4194304] 0 2024-09-13T02:52:48.322 INFO:tasks.workunit.client.0.smithi098.stdout:0/346: rename dd/df/d1d/d40/d46/d50 to dd/df/d1d/d26/d28/d32/d67/d71 0 2024-09-13T02:52:48.332 INFO:tasks.workunit.client.0.smithi098.stdout:2/263: symlink d1/d1a/dc/d23/l4a 0 2024-09-13T02:52:48.342 INFO:tasks.workunit.client.0.smithi098.stdout:7/486: dread d6/d24/d2a/d5a/d4c/f6a [0,4194304] 0 2024-09-13T02:52:48.354 INFO:tasks.workunit.client.0.smithi098.stdout:9/276: write d2/d6/d36/f58 [1918574,77937] 0 2024-09-13T02:52:48.355 INFO:tasks.workunit.client.0.smithi098.stdout:6/285: write d5/d13/d2b/d3a/d14/f3b [2403,2472] 0 2024-09-13T02:52:48.358 INFO:tasks.workunit.client.0.smithi098.stdout:5/263: dwrite d0/d15/d17/f26 [0,4194304] 0 2024-09-13T02:52:48.359 INFO:tasks.workunit.client.0.smithi098.stdout:0/347: readlink dd/df/d1d/d26/d28/l6d 0 2024-09-13T02:52:48.360 INFO:tasks.workunit.client.0.smithi098.stdout:0/348: dread - dd/df/d1d/d40/f6f zero size 2024-09-13T02:52:48.362 INFO:tasks.workunit.client.1.smithi142.stdout:5/813: link d8/d47/d65/da0/dd1/d45/d62/c76 d8/dc3/d3f/d4a/d4b/c107 0 2024-09-13T02:52:48.363 INFO:tasks.workunit.client.0.smithi098.stdout:1/345: truncate d9/d33/d19/f28 367448 0 2024-09-13T02:52:48.364 INFO:tasks.workunit.client.0.smithi098.stdout:1/346: chown d9/d33/d19/c20 24 1 2024-09-13T02:52:48.366 INFO:tasks.workunit.client.0.smithi098.stdout:2/264: creat d1/d1f/d35/f4b x:0 0 0 2024-09-13T02:52:48.369 INFO:tasks.workunit.client.1.smithi142.stdout:6/806: creat d1/d7/d5f/d60/d76/f114 x:0 0 0 2024-09-13T02:52:48.370 INFO:tasks.workunit.client.1.smithi142.stdout:6/807: dread - d1/d7/d5f/d60/f9a zero size 2024-09-13T02:52:48.374 INFO:tasks.workunit.client.0.smithi098.stdout:6/286: symlink d5/d13/d2b/d3a/d41/l68 0 2024-09-13T02:52:48.375 INFO:tasks.workunit.client.0.smithi098.stdout:5/264: mknod d0/d15/d17/d1c/d3d/c5d 0 2024-09-13T02:52:48.377 INFO:tasks.workunit.client.1.smithi142.stdout:7/806: mknod d10/d13/d1d/d2b/d55/d32/c10a 0 2024-09-13T02:52:48.377 INFO:tasks.workunit.client.0.smithi098.stdout:5/265: dread d0/d38/d3f/d1a/d32/f33 [0,4194304] 0 2024-09-13T02:52:48.378 INFO:tasks.workunit.client.0.smithi098.stdout:0/349: creat dd/df/d1d/d26/d28/f72 x:0 0 0 2024-09-13T02:52:48.383 INFO:tasks.workunit.client.0.smithi098.stdout:0/350: dread dd/df/d1d/f34 [0,4194304] 0 2024-09-13T02:52:48.386 INFO:tasks.workunit.client.1.smithi142.stdout:8/675: creat d0/d6/d83/fd8 x:0 0 0 2024-09-13T02:52:48.387 INFO:tasks.workunit.client.0.smithi098.stdout:7/487: creat d6/d24/d2a/d5a/d8e/f9f x:0 0 0 2024-09-13T02:52:48.387 INFO:tasks.workunit.client.1.smithi142.stdout:8/676: chown d0/d6/dc/d45/d8/df/c6e 2987 1 2024-09-13T02:52:48.387 INFO:tasks.workunit.client.1.smithi142.stdout:8/677: chown d0/d6 359486 1 2024-09-13T02:52:48.388 INFO:tasks.workunit.client.0.smithi098.stdout:7/488: write d6/d24/f28 [1248708,50052] 0 2024-09-13T02:52:48.388 INFO:tasks.workunit.client.1.smithi142.stdout:0/792: creat d10/d6c/d88/d1a/d1e/f104 x:0 0 0 2024-09-13T02:52:48.390 INFO:tasks.workunit.client.0.smithi098.stdout:3/290: rename d7/d3c to d7/d9/d15/d2d/d5b 0 2024-09-13T02:52:48.391 INFO:tasks.workunit.client.0.smithi098.stdout:3/291: chown d7/d9/d15/c4d 226191622 1 2024-09-13T02:52:48.392 INFO:tasks.workunit.client.1.smithi142.stdout:5/814: rename d8/dc3/d3f/d4a/d4b/db9/lca to d8/d47/df1/l108 0 2024-09-13T02:52:48.392 INFO:tasks.workunit.client.1.smithi142.stdout:8/678: dread d0/d80/fa0 [0,4194304] 0 2024-09-13T02:52:48.393 INFO:tasks.workunit.client.1.smithi142.stdout:1/795: dwrite d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/f80 [0,4194304] 0 2024-09-13T02:52:48.393 INFO:tasks.workunit.client.1.smithi142.stdout:9/845: link dd/d17/d25/fbc dd/d98/dca/d127/f134 0 2024-09-13T02:52:48.394 INFO:tasks.workunit.client.1.smithi142.stdout:8/679: dread - d0/d6/dc/d2e/fb9 zero size 2024-09-13T02:52:48.395 INFO:tasks.workunit.client.1.smithi142.stdout:9/846: fsync dd/d87/f10a 0 2024-09-13T02:52:48.395 INFO:tasks.workunit.client.1.smithi142.stdout:8/680: write d0/fd1 [8750,55112] 0 2024-09-13T02:52:48.396 INFO:tasks.workunit.client.0.smithi098.stdout:5/266: symlink d0/d15/d17/d1c/l5e 0 2024-09-13T02:52:48.396 INFO:tasks.workunit.client.1.smithi142.stdout:9/847: write dd/f36 [6958670,18428] 0 2024-09-13T02:52:48.398 INFO:tasks.workunit.client.1.smithi142.stdout:8/681: chown d0/d6/dc/d45/d8/df/d28 23 1 2024-09-13T02:52:48.399 INFO:tasks.workunit.client.1.smithi142.stdout:9/848: write dd/d17/d44/d82/d99/de3/f131 [52984,114945] 0 2024-09-13T02:52:48.400 INFO:tasks.workunit.client.0.smithi098.stdout:6/287: dread d5/d13/d2b/d3a/f11 [0,4194304] 0 2024-09-13T02:52:48.402 INFO:tasks.workunit.client.0.smithi098.stdout:1/347: symlink d9/d33/d1f/d6b/d7c/l81 0 2024-09-13T02:52:48.404 INFO:tasks.workunit.client.1.smithi142.stdout:2/648: mknod d1/de/d1f/ccf 0 2024-09-13T02:52:48.405 INFO:tasks.workunit.client.0.smithi098.stdout:1/348: fdatasync d9/d33/d19/d35/d63/f77 0 2024-09-13T02:52:48.405 INFO:tasks.workunit.client.0.smithi098.stdout:5/267: dwrite d0/d38/d3f/d1a/f34 [0,4194304] 0 2024-09-13T02:52:48.406 INFO:tasks.workunit.client.1.smithi142.stdout:2/649: chown d1/de/f57 8883534 1 2024-09-13T02:52:48.406 INFO:tasks.workunit.client.1.smithi142.stdout:3/750: dwrite d12/d16/f24 [0,4194304] 0 2024-09-13T02:52:48.406 INFO:tasks.workunit.client.1.smithi142.stdout:7/807: symlink d10/d13/d21/l10b 0 2024-09-13T02:52:48.407 INFO:tasks.workunit.client.1.smithi142.stdout:2/650: chown d1/de/d1f/d13/f6b 26165888 1 2024-09-13T02:52:48.408 INFO:tasks.workunit.client.1.smithi142.stdout:7/808: stat d10/d13/d1d/d25/d5c/f9b 0 2024-09-13T02:52:48.408 INFO:tasks.workunit.client.0.smithi098.stdout:8/303: getdents d2/dd 0 2024-09-13T02:52:48.408 INFO:tasks.workunit.client.1.smithi142.stdout:2/651: readlink d1/de/d1f/l5d 0 2024-09-13T02:52:48.414 INFO:tasks.workunit.client.0.smithi098.stdout:0/351: rename dd/df/d1d/d40/f6f to dd/df/d1d/d26/d37/f73 0 2024-09-13T02:52:48.415 INFO:tasks.workunit.client.0.smithi098.stdout:1/349: dwrite d9/d33/d19/d35/d68/d60/f6d [0,4194304] 0 2024-09-13T02:52:48.417 INFO:tasks.workunit.client.0.smithi098.stdout:3/292: write d7/d9/d25/d2b/f40 [4072821,60492] 0 2024-09-13T02:52:48.421 INFO:tasks.workunit.client.1.smithi142.stdout:1/796: unlink fd 0 2024-09-13T02:52:48.422 INFO:tasks.workunit.client.1.smithi142.stdout:5/815: stat d8/d47/d65/da0/dd1/d63/l9a 0 2024-09-13T02:52:48.424 INFO:tasks.workunit.client.1.smithi142.stdout:6/808: dread d1/d7/d42/fa4 [0,4194304] 0 2024-09-13T02:52:48.425 INFO:tasks.workunit.client.0.smithi098.stdout:1/350: dwrite d9/d33/f2b [0,4194304] 0 2024-09-13T02:52:48.426 INFO:tasks.workunit.client.1.smithi142.stdout:8/682: mknod d0/d6/dc/d40/d41/cd9 0 2024-09-13T02:52:48.426 INFO:tasks.workunit.client.0.smithi098.stdout:1/351: write d9/d33/d19/d46/f4a [492598,106733] 0 2024-09-13T02:52:48.428 INFO:tasks.workunit.client.1.smithi142.stdout:4/740: link d0/d2b/d21/l85 d0/led 0 2024-09-13T02:52:48.428 INFO:tasks.workunit.client.1.smithi142.stdout:8/683: stat d0/d80/d8c/dc9/ccf 0 2024-09-13T02:52:48.430 INFO:tasks.workunit.client.1.smithi142.stdout:3/751: fsync d12/d16/f17 0 2024-09-13T02:52:48.431 INFO:tasks.workunit.client.1.smithi142.stdout:4/741: dread - d0/d2b/d2d/d65/f6e zero size 2024-09-13T02:52:48.432 INFO:tasks.workunit.client.1.smithi142.stdout:2/652: chown d1/fa3 34843 1 2024-09-13T02:52:48.433 INFO:tasks.workunit.client.1.smithi142.stdout:5/816: dwrite d8/fde [0,4194304] 0 2024-09-13T02:52:48.434 INFO:tasks.workunit.client.1.smithi142.stdout:3/752: rename d12/d16/d3c to d12/d16/d3c/d79/d9e/df0 22 2024-09-13T02:52:48.437 INFO:tasks.workunit.client.1.smithi142.stdout:0/793: mknod d10/d6c/d88/d21/daf/dc4/c105 0 2024-09-13T02:52:48.441 INFO:tasks.workunit.client.0.smithi098.stdout:8/304: rename d2/dd/d11/d3b to d2/d2f/d5f 0 2024-09-13T02:52:48.442 INFO:tasks.workunit.client.0.smithi098.stdout:2/265: truncate d1/d1f/d39/f21 32592 0 2024-09-13T02:52:48.444 INFO:tasks.workunit.client.0.smithi098.stdout:0/352: creat dd/df/d1d/d26/d28/d32/f74 x:0 0 0 2024-09-13T02:52:48.445 INFO:tasks.workunit.client.1.smithi142.stdout:4/742: dwrite d0/d2b/d2d/d31/d43/d48/fd1 [0,4194304] 0 2024-09-13T02:52:48.445 INFO:tasks.workunit.client.1.smithi142.stdout:2/653: dwrite d1/de/d31/d6c/d6d/db6/fc7 [0,4194304] 0 2024-09-13T02:52:48.446 INFO:tasks.workunit.client.0.smithi098.stdout:7/489: write d6/d24/d46/f50 [3500163,64592] 0 2024-09-13T02:52:48.447 INFO:tasks.workunit.client.1.smithi142.stdout:4/743: chown d0/d2b/d2d/d31/d32/d82/f92 1442190 1 2024-09-13T02:52:48.448 INFO:tasks.workunit.client.0.smithi098.stdout:9/277: getdents d2/d6/d2b/d4d/d56 0 2024-09-13T02:52:48.448 INFO:tasks.workunit.client.1.smithi142.stdout:2/654: dread d1/de/d31/d6c/d6d/f52 [0,4194304] 0 2024-09-13T02:52:48.449 INFO:tasks.workunit.client.1.smithi142.stdout:2/655: chown d1/de/d1f/d9c/db4 1 1 2024-09-13T02:52:48.452 INFO:tasks.workunit.client.0.smithi098.stdout:3/293: mknod d7/d9/d25/d3a/c5c 0 2024-09-13T02:52:48.452 INFO:tasks.workunit.client.0.smithi098.stdout:3/294: truncate d7/d9/d25/f39 1099649 0 2024-09-13T02:52:48.458 INFO:tasks.workunit.client.0.smithi098.stdout:1/352: creat d9/d33/d29/d58/f82 x:0 0 0 2024-09-13T02:52:48.459 INFO:tasks.workunit.client.1.smithi142.stdout:5/817: mknod d8/d47/d65/da0/dd1/d45/d81/d82/c109 0 2024-09-13T02:52:48.461 INFO:tasks.workunit.client.0.smithi098.stdout:6/288: link d5/d13/d2b/d3a/d41/f4b d5/d13/d2b/f69 0 2024-09-13T02:52:48.463 INFO:tasks.workunit.client.1.smithi142.stdout:1/797: mknod d12/d13/d20/d27/cfa 0 2024-09-13T02:52:48.464 INFO:tasks.workunit.client.1.smithi142.stdout:6/809: dread d1/d7/d5f/d60/d76/d7e/fc3 [0,4194304] 0 2024-09-13T02:52:48.466 INFO:tasks.workunit.client.0.smithi098.stdout:6/289: dread d5/d18/f4c [0,4194304] 0 2024-09-13T02:52:48.466 INFO:tasks.workunit.client.0.smithi098.stdout:8/305: unlink d2/dd/d11/d1d/l42 0 2024-09-13T02:52:48.467 INFO:tasks.workunit.client.0.smithi098.stdout:6/290: readlink d5/d13/d2b/d3a/d41/l68 0 2024-09-13T02:52:48.467 INFO:tasks.workunit.client.0.smithi098.stdout:8/306: stat d2/dd/d11/d49/f58 0 2024-09-13T02:52:48.469 INFO:tasks.workunit.client.0.smithi098.stdout:8/307: write d2/dd/d2e/f3d [5101189,56792] 0 2024-09-13T02:52:48.470 INFO:tasks.workunit.client.0.smithi098.stdout:2/266: symlink d1/d1a/dc/l4c 0 2024-09-13T02:52:48.471 INFO:tasks.workunit.client.1.smithi142.stdout:0/794: creat d10/d6c/d88/d1a/d1e/d42/f106 x:0 0 0 2024-09-13T02:52:48.473 INFO:tasks.workunit.client.1.smithi142.stdout:0/795: chown d10/d6c/d88/d1a/fd5 0 1 2024-09-13T02:52:48.474 INFO:tasks.workunit.client.0.smithi098.stdout:0/353: write dd/f10 [720482,118599] 0 2024-09-13T02:52:48.475 INFO:tasks.workunit.client.1.smithi142.stdout:4/744: dread - d0/f99 zero size 2024-09-13T02:52:48.475 INFO:tasks.workunit.client.0.smithi098.stdout:7/490: write d6/d24/d46/f5c [1685043,81893] 0 2024-09-13T02:52:48.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/684: dread d0/d6/dc/d45/f6a [0,4194304] 0 2024-09-13T02:52:48.477 INFO:tasks.workunit.client.0.smithi098.stdout:9/278: rename d2/dd/d39/d43/f44 to d2/d6/d36/f5f 0 2024-09-13T02:52:48.477 INFO:tasks.workunit.client.0.smithi098.stdout:8/308: dwrite d2/dd/d11/f4c [0,4194304] 0 2024-09-13T02:52:48.478 INFO:tasks.workunit.client.0.smithi098.stdout:1/353: rename d9/d33/d1f to d9/d33/d1f/d6b/d83 22 2024-09-13T02:52:48.478 INFO:tasks.workunit.client.0.smithi098.stdout:8/309: stat d2/d2f/d5f 0 2024-09-13T02:52:48.479 INFO:tasks.workunit.client.1.smithi142.stdout:2/656: mknod d1/de/d1f/d9c/db4/cd0 0 2024-09-13T02:52:48.479 INFO:tasks.workunit.client.1.smithi142.stdout:2/657: fdatasync d1/de/d31/d6c/d6d/fa5 0 2024-09-13T02:52:48.480 INFO:tasks.workunit.client.0.smithi098.stdout:8/310: dread d2/d2f/f31 [0,4194304] 0 2024-09-13T02:52:48.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:48 smithi098 ceph-mon[27886]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 220 MiB/s wr, 375 op/s 2024-09-13T02:52:48.486 INFO:tasks.workunit.client.0.smithi098.stdout:5/268: creat d0/d15/f5f x:0 0 0 2024-09-13T02:52:48.487 INFO:tasks.workunit.client.1.smithi142.stdout:3/753: mknod d12/d16/d3c/d7d/d91/cf1 0 2024-09-13T02:52:48.489 INFO:tasks.workunit.client.1.smithi142.stdout:5/818: mkdir d8/dc3/df3/dc6/de2/d10a 0 2024-09-13T02:52:48.490 INFO:tasks.workunit.client.0.smithi098.stdout:7/491: dwrite d6/d24/d2a/d5a/d8e/f9f [0,4194304] 0 2024-09-13T02:52:48.493 INFO:tasks.workunit.client.0.smithi098.stdout:8/311: dwrite d2/dd/d11/d1d/f45 [0,4194304] 0 2024-09-13T02:52:48.494 INFO:tasks.workunit.client.0.smithi098.stdout:2/267: rmdir d1/d1f/d36 39 2024-09-13T02:52:48.495 INFO:tasks.workunit.client.0.smithi098.stdout:7/492: read d6/ff [3253340,22447] 0 2024-09-13T02:52:48.497 INFO:tasks.workunit.client.1.smithi142.stdout:0/796: truncate d10/d6c/d88/d21/d51/d79/fa0 484290 0 2024-09-13T02:52:48.498 INFO:tasks.workunit.client.1.smithi142.stdout:0/797: chown d10/d6c/d88/d21/daf/dc4 732040238 1 2024-09-13T02:52:48.498 INFO:tasks.workunit.client.0.smithi098.stdout:7/493: chown d6/d24/d46/f5c 462104 1 2024-09-13T02:52:48.499 INFO:tasks.workunit.client.1.smithi142.stdout:0/798: chown d10/d6c/d88/d1a/d1e/l4e 19 1 2024-09-13T02:52:48.500 INFO:tasks.workunit.client.0.smithi098.stdout:5/269: dwrite d0/d29/f56 [0,4194304] 0 2024-09-13T02:52:48.503 INFO:tasks.workunit.client.0.smithi098.stdout:7/494: dread d6/d24/d2a/d57/d88/f54 [0,4194304] 0 2024-09-13T02:52:48.503 INFO:tasks.workunit.client.1.smithi142.stdout:4/745: symlink d0/d2b/d2d/d65/d87/lee 0 2024-09-13T02:52:48.505 INFO:tasks.workunit.client.1.smithi142.stdout:8/685: write d0/d6/dc/d45/d8/f36 [8967602,34317] 0 2024-09-13T02:52:48.507 INFO:tasks.workunit.client.0.smithi098.stdout:1/354: creat d9/f84 x:0 0 0 2024-09-13T02:52:48.508 INFO:tasks.workunit.client.1.smithi142.stdout:7/809: getdents d10/d13/d1d/d2b/d56/d39 0 2024-09-13T02:52:48.511 INFO:tasks.workunit.client.1.smithi142.stdout:3/754: truncate d12/d16/d25/d2e/d38/f57 2440210 0 2024-09-13T02:52:48.513 INFO:tasks.workunit.client.0.smithi098.stdout:7/495: dwrite d6/d47/f7e [0,4194304] 0 2024-09-13T02:52:48.513 INFO:tasks.workunit.client.1.smithi142.stdout:3/755: dread - d12/d16/d25/d2e/d38/d4d/fc4 zero size 2024-09-13T02:52:48.516 INFO:tasks.workunit.client.0.smithi098.stdout:7/496: dread - d6/d24/d2a/d5a/d42/d45/f94 zero size 2024-09-13T02:52:48.518 INFO:tasks.workunit.client.0.smithi098.stdout:6/291: creat d5/d13/d67/f6a x:0 0 0 2024-09-13T02:52:48.519 INFO:tasks.workunit.client.1.smithi142.stdout:3/756: dwrite d12/d16/d3c/d7d/d91/fac [0,4194304] 0 2024-09-13T02:52:48.521 INFO:tasks.workunit.client.1.smithi142.stdout:4/746: mknod d0/d7e/db8/cef 0 2024-09-13T02:52:48.524 INFO:tasks.workunit.client.0.smithi098.stdout:2/268: dread d1/d1a/d9/d1e/f47 [0,4194304] 0 2024-09-13T02:52:48.524 INFO:tasks.workunit.client.1.smithi142.stdout:8/686: creat d0/d6/dc/d40/d4d/fda x:0 0 0 2024-09-13T02:52:48.526 INFO:tasks.workunit.client.1.smithi142.stdout:7/810: write d10/d13/d1d/d25/d45/dad/fe0 [550797,80456] 0 2024-09-13T02:52:48.528 INFO:tasks.workunit.client.1.smithi142.stdout:7/811: chown d10/d13/d1d/d25/d45/d6d/dc3/f4e 443 1 2024-09-13T02:52:48.529 INFO:tasks.workunit.client.1.smithi142.stdout:7/812: chown d10/d13/d1d/d2b/d56/fe2 213931789 1 2024-09-13T02:52:48.532 INFO:tasks.workunit.client.0.smithi098.stdout:1/355: creat d9/d33/d1f/d6b/d7c/f85 x:0 0 0 2024-09-13T02:52:48.532 INFO:tasks.workunit.client.0.smithi098.stdout:1/356: stat d9/d33/d1f/c80 0 2024-09-13T02:52:48.534 INFO:tasks.workunit.client.1.smithi142.stdout:6/810: creat d1/dd/d53/d78/d104/dad/f115 x:0 0 0 2024-09-13T02:52:48.536 INFO:tasks.workunit.client.1.smithi142.stdout:0/799: mkdir d10/d107 0 2024-09-13T02:52:48.537 INFO:tasks.workunit.client.1.smithi142.stdout:0/800: chown d10/d6c/d88/d1a/d1e/c97 44326 1 2024-09-13T02:52:48.539 INFO:tasks.workunit.client.0.smithi098.stdout:6/292: mkdir d5/d13/d2b/d3a/d14/d6b 0 2024-09-13T02:52:48.539 INFO:tasks.workunit.client.1.smithi142.stdout:2/658: dread d1/f8c [0,4194304] 0 2024-09-13T02:52:48.540 INFO:tasks.workunit.client.1.smithi142.stdout:4/747: fdatasync d0/d2b/d2d/d31/d43/f5a 0 2024-09-13T02:52:48.542 INFO:tasks.workunit.client.1.smithi142.stdout:8/687: mkdir d0/d80/d8c/ddb 0 2024-09-13T02:52:48.546 INFO:tasks.workunit.client.1.smithi142.stdout:5/819: write d8/d47/d65/da0/dd1/d45/dc5/f104 [634283,29480] 0 2024-09-13T02:52:48.547 INFO:tasks.workunit.client.1.smithi142.stdout:6/811: creat d1/d7/d19/d48/d90/f116 x:0 0 0 2024-09-13T02:52:48.548 INFO:tasks.workunit.client.1.smithi142.stdout:6/812: chown d1/d7/d19/d30/c8a 86404 1 2024-09-13T02:52:48.549 INFO:tasks.workunit.client.0.smithi098.stdout:0/354: creat dd/f75 x:0 0 0 2024-09-13T02:52:48.549 INFO:tasks.workunit.client.1.smithi142.stdout:6/813: chown d1/d7/d5f/d60/f9a 779139636 1 2024-09-13T02:52:48.559 INFO:tasks.workunit.client.0.smithi098.stdout:5/270: rename d0/d38/d3f/l7 to d0/d38/d3f/d1a/l60 0 2024-09-13T02:52:48.559 INFO:tasks.workunit.client.0.smithi098.stdout:1/357: rename d9/d33 to d9/d33/d1f/d23/d30/d86 22 2024-09-13T02:52:48.560 INFO:tasks.workunit.client.0.smithi098.stdout:1/358: chown d9/d33/d1f/c80 104865 1 2024-09-13T02:52:48.561 INFO:tasks.workunit.client.1.smithi142.stdout:2/659: creat d1/de/d1f/d13/d60/fd1 x:0 0 0 2024-09-13T02:52:48.562 INFO:tasks.workunit.client.0.smithi098.stdout:9/279: link d2/d6/d2b/l4b d2/dd/l60 0 2024-09-13T02:52:48.563 INFO:tasks.workunit.client.1.smithi142.stdout:8/688: fdatasync d0/f8f 0 2024-09-13T02:52:48.564 INFO:tasks.workunit.client.0.smithi098.stdout:7/497: link d6/d1e/l7a d6/d47/la0 0 2024-09-13T02:52:48.566 INFO:tasks.workunit.client.1.smithi142.stdout:7/813: mkdir d10/d13/d1d/d2b/d55/d32/d8c/df1/d10c 0 2024-09-13T02:52:48.567 INFO:tasks.workunit.client.1.smithi142.stdout:2/660: dwrite d1/de/d1f/f63 [0,4194304] 0 2024-09-13T02:52:48.568 INFO:tasks.workunit.client.0.smithi098.stdout:2/269: symlink d1/d1f/d32/l4d 0 2024-09-13T02:52:48.569 INFO:tasks.workunit.client.1.smithi142.stdout:0/801: mknod d10/d6c/d88/d1a/d1e/dc6/df3/c108 0 2024-09-13T02:52:48.569 INFO:tasks.workunit.client.1.smithi142.stdout:3/757: dwrite d12/d16/d25/d2e/d48/f6a [0,4194304] 0 2024-09-13T02:52:48.570 INFO:tasks.workunit.client.0.smithi098.stdout:0/355: rename dd/df/d1d/d40/d46/c4e to dd/df/d1d/d26/d37/d53/c76 0 2024-09-13T02:52:48.574 INFO:tasks.workunit.client.0.smithi098.stdout:5/271: mknod d0/d15/d50/c61 0 2024-09-13T02:52:48.576 INFO:tasks.workunit.client.1.smithi142.stdout:3/758: dread d12/d16/d25/d2e/d48/d5c/d66/fe9 [0,4194304] 0 2024-09-13T02:52:48.578 INFO:tasks.workunit.client.0.smithi098.stdout:1/359: mkdir d9/d33/d87 0 2024-09-13T02:52:48.578 INFO:tasks.workunit.client.1.smithi142.stdout:3/759: read d12/d16/d25/d2e/d38/d5a/f87 [3323174,74974] 0 2024-09-13T02:52:48.579 INFO:tasks.workunit.client.1.smithi142.stdout:3/760: readlink d12/d16/d3c/d79/d9e/la1 0 2024-09-13T02:52:48.580 INFO:tasks.workunit.client.1.smithi142.stdout:3/761: dread - d12/d16/d25/d2e/d38/d4d/d53/da0/fca zero size 2024-09-13T02:52:48.584 INFO:tasks.workunit.client.1.smithi142.stdout:8/689: mknod d0/da2/cdc 0 2024-09-13T02:52:48.584 INFO:tasks.workunit.client.0.smithi098.stdout:5/272: dwrite d0/ff [0,4194304] 0 2024-09-13T02:52:48.590 INFO:tasks.workunit.client.0.smithi098.stdout:6/293: dwrite d5/f1b [0,4194304] 0 2024-09-13T02:52:48.591 INFO:tasks.workunit.client.1.smithi142.stdout:9/849: sync 2024-09-13T02:52:48.591 INFO:tasks.workunit.client.0.smithi098.stdout:7/498: mknod d6/d24/d2a/d5a/d42/ca1 0 2024-09-13T02:52:48.595 INFO:tasks.workunit.client.1.smithi142.stdout:4/748: dwrite d0/d2b/d2d/d31/d32/d82/f92 [0,4194304] 0 2024-09-13T02:52:48.597 INFO:tasks.workunit.client.0.smithi098.stdout:0/356: symlink dd/df/d1d/d26/d28/l77 0 2024-09-13T02:52:48.598 INFO:tasks.workunit.client.0.smithi098.stdout:0/357: chown dd/df/d1d/d40/f6c 19 1 2024-09-13T02:52:48.598 INFO:tasks.workunit.client.1.smithi142.stdout:4/749: chown d0/d2b/d2d/d31/d43/d48/ld0 998560 1 2024-09-13T02:52:48.598 INFO:tasks.workunit.client.1.smithi142.stdout:2/661: creat d1/de/fd2 x:0 0 0 2024-09-13T02:52:48.599 INFO:tasks.workunit.client.0.smithi098.stdout:0/358: readlink dd/d1f/l39 0 2024-09-13T02:52:48.599 INFO:tasks.workunit.client.1.smithi142.stdout:7/814: creat d10/d13/d1d/d2b/d56/d5f/d73/f10d x:0 0 0 2024-09-13T02:52:48.603 INFO:tasks.workunit.client.0.smithi098.stdout:1/360: creat d9/d33/d1f/f88 x:0 0 0 2024-09-13T02:52:48.608 INFO:tasks.workunit.client.0.smithi098.stdout:5/273: mknod d0/d38/d3f/d1a/d27/c62 0 2024-09-13T02:52:48.609 INFO:tasks.workunit.client.1.smithi142.stdout:6/814: truncate d1/dd/d16/f9f 1517641 0 2024-09-13T02:52:48.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/690: mknod d0/d6/dc/d40/d46/da1/cdd 0 2024-09-13T02:52:48.615 INFO:tasks.workunit.client.0.smithi098.stdout:2/270: mknod d1/d1f/c4e 0 2024-09-13T02:52:48.617 INFO:tasks.workunit.client.0.smithi098.stdout:9/280: dwrite d2/f28 [0,4194304] 0 2024-09-13T02:52:48.617 INFO:tasks.workunit.client.0.smithi098.stdout:0/359: mknod dd/df/d1d/d26/d37/d53/c78 0 2024-09-13T02:52:48.620 INFO:tasks.workunit.client.0.smithi098.stdout:5/274: creat d0/d29/f63 x:0 0 0 2024-09-13T02:52:48.621 INFO:tasks.workunit.client.1.smithi142.stdout:7/815: rmdir d10/d13/d1d/d2b/d56/d5f/da2 39 2024-09-13T02:52:48.623 INFO:tasks.workunit.client.1.smithi142.stdout:0/802: mkdir d10/d6c/d88/d21/d51/d79/de6/d109 0 2024-09-13T02:52:48.623 INFO:tasks.workunit.client.1.smithi142.stdout:7/816: fdatasync d10/d13/d1d/d25/d5c/da3/f102 0 2024-09-13T02:52:48.626 INFO:tasks.workunit.client.0.smithi098.stdout:0/360: readlink dd/l35 0 2024-09-13T02:52:48.627 INFO:tasks.workunit.client.0.smithi098.stdout:9/281: chown d2/dd/f17 6 1 2024-09-13T02:52:48.628 INFO:tasks.workunit.client.1.smithi142.stdout:8/691: symlink d0/d75/lde 0 2024-09-13T02:52:48.631 INFO:tasks.workunit.client.0.smithi098.stdout:1/361: rename d9/d33/d19/f28 to d9/d33/d19/d35/d63/f89 0 2024-09-13T02:52:48.632 INFO:tasks.workunit.client.1.smithi142.stdout:5/820: link d8/dc3/d3f/d4a/f50 d8/dc3/d3f/f10b 0 2024-09-13T02:52:48.633 INFO:tasks.workunit.client.0.smithi098.stdout:1/362: truncate d9/d33/f7a 814304 0 2024-09-13T02:52:48.634 INFO:tasks.workunit.client.0.smithi098.stdout:5/275: symlink d0/l64 0 2024-09-13T02:52:48.635 INFO:tasks.workunit.client.1.smithi142.stdout:4/750: symlink d0/df/lf0 0 2024-09-13T02:52:48.636 INFO:tasks.workunit.client.0.smithi098.stdout:7/499: creat d6/d1e/fa2 x:0 0 0 2024-09-13T02:52:48.637 INFO:tasks.workunit.client.1.smithi142.stdout:2/662: mknod d1/d2d/cd3 0 2024-09-13T02:52:48.643 INFO:tasks.workunit.client.0.smithi098.stdout:5/276: unlink d0/ce 0 2024-09-13T02:52:48.644 INFO:tasks.workunit.client.1.smithi142.stdout:8/692: symlink d0/d6/dc/d40/d46/da1/ldf 0 2024-09-13T02:52:48.645 INFO:tasks.workunit.client.1.smithi142.stdout:0/803: dwrite d10/d6c/d88/d21/d51/d35/f76 [0,4194304] 0 2024-09-13T02:52:48.646 INFO:tasks.workunit.client.0.smithi098.stdout:0/361: mknod dd/c79 0 2024-09-13T02:52:48.647 INFO:tasks.workunit.client.1.smithi142.stdout:0/804: chown d10/d6c/d88/d1a/d1e/d42/la3 718451 1 2024-09-13T02:52:48.648 INFO:tasks.workunit.client.0.smithi098.stdout:1/363: mknod d9/d33/d29/c8a 0 2024-09-13T02:52:48.649 INFO:tasks.workunit.client.0.smithi098.stdout:1/364: fdatasync d9/d33/f66 0 2024-09-13T02:52:48.650 INFO:tasks.workunit.client.1.smithi142.stdout:8/693: creat d0/fe0 x:0 0 0 2024-09-13T02:52:48.651 INFO:tasks.workunit.client.0.smithi098.stdout:1/365: write d9/d33/d19/d35/d68/f3f [3410962,43506] 0 2024-09-13T02:52:48.651 INFO:tasks.workunit.client.0.smithi098.stdout:1/366: chown d9/d33/f17 7123806 1 2024-09-13T02:52:48.653 INFO:tasks.workunit.client.1.smithi142.stdout:6/815: dread d1/dd/d16/d4e/d32/f40 [0,4194304] 0 2024-09-13T02:52:48.654 INFO:tasks.workunit.client.1.smithi142.stdout:0/805: unlink d10/d6c/d88/d21/d51/fa7 0 2024-09-13T02:52:48.657 INFO:tasks.workunit.client.1.smithi142.stdout:2/663: dwrite d1/d29/d72/fca [0,4194304] 0 2024-09-13T02:52:48.658 INFO:tasks.workunit.client.0.smithi098.stdout:2/271: rename d1/d1f/d32 to d1/d1a/d4f 0 2024-09-13T02:52:48.660 INFO:tasks.workunit.client.0.smithi098.stdout:1/367: dwrite f1 [0,4194304] 0 2024-09-13T02:52:48.660 INFO:tasks.workunit.client.1.smithi142.stdout:5/821: dread d8/d47/d65/da0/dd1/f60 [0,4194304] 0 2024-09-13T02:52:48.662 INFO:tasks.workunit.client.1.smithi142.stdout:6/816: dread d1/fd7 [4194304,4194304] 0 2024-09-13T02:52:48.662 INFO:tasks.workunit.client.0.smithi098.stdout:6/294: write f4 [34275,53788] 0 2024-09-13T02:52:48.664 INFO:tasks.workunit.client.1.smithi142.stdout:1/798: sync 2024-09-13T02:52:48.664 INFO:tasks.workunit.client.1.smithi142.stdout:4/751: dread d0/d2b/d2d/d31/f55 [0,4194304] 0 2024-09-13T02:52:48.665 INFO:tasks.workunit.client.0.smithi098.stdout:6/295: chown d5/d18/f47 62 1 2024-09-13T02:52:48.666 INFO:tasks.workunit.client.1.smithi142.stdout:9/850: write dd/d17/d44/d82/d99/da8/db7/fc4 [454116,36045] 0 2024-09-13T02:52:48.667 INFO:tasks.workunit.client.1.smithi142.stdout:4/752: fsync d0/d2b/d2d/d31/d32/d82/f92 0 2024-09-13T02:52:48.668 INFO:tasks.workunit.client.1.smithi142.stdout:2/664: dwrite d1/d29/d72/fc0 [0,4194304] 0 2024-09-13T02:52:48.672 INFO:tasks.workunit.client.0.smithi098.stdout:0/362: mknod dd/df/c7a 0 2024-09-13T02:52:48.672 INFO:tasks.workunit.client.1.smithi142.stdout:8/694: creat d0/d6/dc/d45/d8/fe1 x:0 0 0 2024-09-13T02:52:48.675 INFO:tasks.workunit.client.1.smithi142.stdout:4/753: truncate d0/df/da5/dad/fb2 1173569 0 2024-09-13T02:52:48.676 INFO:tasks.workunit.client.1.smithi142.stdout:6/817: readlink d1/d59/l98 0 2024-09-13T02:52:48.676 INFO:tasks.workunit.client.1.smithi142.stdout:4/754: chown d0/d7e/db8/lc4 17392060 1 2024-09-13T02:52:48.679 INFO:tasks.workunit.client.0.smithi098.stdout:7/500: dread d6/fc [0,4194304] 0 2024-09-13T02:52:48.682 INFO:tasks.workunit.client.0.smithi098.stdout:0/363: dwrite dd/df/d1d/f43 [0,4194304] 0 2024-09-13T02:52:48.684 INFO:tasks.workunit.client.0.smithi098.stdout:5/277: link d0/d38/d3f/c35 d0/d38/d3f/d1a/d32/d4d/c65 0 2024-09-13T02:52:48.688 INFO:tasks.workunit.client.0.smithi098.stdout:6/296: mkdir d5/d13/d2b/d3a/d41/d6c 0 2024-09-13T02:52:48.688 INFO:tasks.workunit.client.0.smithi098.stdout:0/364: dread dd/f59 [0,4194304] 0 2024-09-13T02:52:48.690 INFO:tasks.workunit.client.0.smithi098.stdout:0/365: stat dd/df/d1d/f34 0 2024-09-13T02:52:48.692 INFO:tasks.workunit.client.0.smithi098.stdout:9/282: rename d2/d6/d2b/l4b to d2/d6/d46/l61 0 2024-09-13T02:52:48.693 INFO:tasks.workunit.client.0.smithi098.stdout:5/278: dwrite d0/d29/f63 [0,4194304] 0 2024-09-13T02:52:48.693 INFO:tasks.workunit.client.1.smithi142.stdout:8/695: mkdir d0/d6/dc/d40/d41/de2 0 2024-09-13T02:52:48.696 INFO:tasks.workunit.client.1.smithi142.stdout:7/817: dwrite d10/d13/d1d/f2d [0,4194304] 0 2024-09-13T02:52:48.697 INFO:tasks.workunit.client.1.smithi142.stdout:0/806: unlink d10/d6c/d88/d21/daf/le3 0 2024-09-13T02:52:48.698 INFO:tasks.workunit.client.0.smithi098.stdout:6/297: dwrite d5/d13/d67/f6a [0,4194304] 0 2024-09-13T02:52:48.700 INFO:tasks.workunit.client.1.smithi142.stdout:9/851: creat dd/d17/d44/dfa/f135 x:0 0 0 2024-09-13T02:52:48.703 INFO:tasks.workunit.client.1.smithi142.stdout:2/665: creat d1/de/d31/d6c/fd4 x:0 0 0 2024-09-13T02:52:48.708 INFO:tasks.workunit.client.1.smithi142.stdout:1/799: unlink d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/lcf 0 2024-09-13T02:52:48.709 INFO:tasks.workunit.client.1.smithi142.stdout:1/800: stat d12/d13/d20/d27/d3c/d71/d96 0 2024-09-13T02:52:48.712 INFO:tasks.workunit.client.1.smithi142.stdout:6/818: symlink d1/d7/d5f/d60/d76/l117 0 2024-09-13T02:52:48.714 INFO:tasks.workunit.client.1.smithi142.stdout:3/762: sync 2024-09-13T02:52:48.715 INFO:tasks.workunit.client.1.smithi142.stdout:3/763: chown d12/d16/f24 346 1 2024-09-13T02:52:48.716 INFO:tasks.workunit.client.1.smithi142.stdout:8/696: creat d0/d6/dc/d45/fe3 x:0 0 0 2024-09-13T02:52:48.717 INFO:tasks.workunit.client.0.smithi098.stdout:9/283: creat d2/dd/d39/f62 x:0 0 0 2024-09-13T02:52:48.718 INFO:tasks.workunit.client.1.smithi142.stdout:7/818: mknod d10/d13/d1d/d2b/d55/c10e 0 2024-09-13T02:52:48.720 INFO:tasks.workunit.client.1.smithi142.stdout:7/819: chown d10/d13/d1d/d25/d45/d6d/fa9 92484853 1 2024-09-13T02:52:48.720 INFO:tasks.workunit.client.1.smithi142.stdout:0/807: mknod d10/d6c/d88/d30/c10a 0 2024-09-13T02:52:48.721 INFO:tasks.workunit.client.1.smithi142.stdout:2/666: dread - d1/d29/f83 zero size 2024-09-13T02:52:48.723 INFO:tasks.workunit.client.0.smithi098.stdout:7/501: mknod d6/d1e/ca3 0 2024-09-13T02:52:48.725 INFO:tasks.workunit.client.0.smithi098.stdout:7/502: read - d6/d24/d2a/d5a/d42/f7f zero size 2024-09-13T02:52:48.725 INFO:tasks.workunit.client.1.smithi142.stdout:1/801: creat d12/d13/dd3/ffb x:0 0 0 2024-09-13T02:52:48.726 INFO:tasks.workunit.client.0.smithi098.stdout:7/503: stat d6/d24/d2a/d57/d88/l9e 0 2024-09-13T02:52:48.726 INFO:tasks.workunit.client.0.smithi098.stdout:7/504: fsync d6/d1e/f70 0 2024-09-13T02:52:48.726 INFO:tasks.workunit.client.1.smithi142.stdout:4/755: symlink d0/d2b/lf1 0 2024-09-13T02:52:48.727 INFO:tasks.workunit.client.1.smithi142.stdout:0/808: dwrite d10/d6c/d88/d21/daf/ff2 [0,4194304] 0 2024-09-13T02:52:48.728 INFO:tasks.workunit.client.1.smithi142.stdout:2/667: dread d1/de/f26 [0,4194304] 0 2024-09-13T02:52:48.729 INFO:tasks.workunit.client.1.smithi142.stdout:6/819: write d1/d7/d5f/d60/d76/d7e/fdb [1103747,123715] 0 2024-09-13T02:52:48.729 INFO:tasks.workunit.client.0.smithi098.stdout:0/366: mknod dd/df/c7b 0 2024-09-13T02:52:48.730 INFO:tasks.workunit.client.1.smithi142.stdout:0/809: write d10/d6c/d88/d1a/d1e/dc6/feb [794174,130992] 0 2024-09-13T02:52:48.731 INFO:tasks.workunit.client.1.smithi142.stdout:5/822: link d8/d47/d65/da0/lf6 d8/d47/l10c 0 2024-09-13T02:52:48.733 INFO:tasks.workunit.client.0.smithi098.stdout:9/284: symlink d2/d6/d46/l63 0 2024-09-13T02:52:48.735 INFO:tasks.workunit.client.0.smithi098.stdout:2/272: link d1/d1a/d9/d1e/l20 d1/d1f/d36/l50 0 2024-09-13T02:52:48.739 INFO:tasks.workunit.client.1.smithi142.stdout:7/820: rmdir d10/d13/d1d/d25/d45 39 2024-09-13T02:52:48.743 INFO:tasks.workunit.client.1.smithi142.stdout:9/852: mknod dd/d17/d69/d84/c136 0 2024-09-13T02:52:48.744 INFO:tasks.workunit.client.0.smithi098.stdout:1/368: getdents d9/d33/d19/d35/d68/d60 0 2024-09-13T02:52:48.744 INFO:tasks.workunit.client.0.smithi098.stdout:1/369: truncate d9/d33/f2b 4803632 0 2024-09-13T02:52:48.745 INFO:tasks.workunit.client.1.smithi142.stdout:7/821: dread d10/d13/d1d/d2b/d56/d39/fbf [0,4194304] 0 2024-09-13T02:52:48.746 INFO:tasks.workunit.client.0.smithi098.stdout:7/505: mkdir d6/d24/d2a/d57/d88/da4 0 2024-09-13T02:52:48.747 INFO:tasks.workunit.client.0.smithi098.stdout:7/506: read d6/d24/f3d [1181083,25230] 0 2024-09-13T02:52:48.748 INFO:tasks.workunit.client.1.smithi142.stdout:1/802: fdatasync d12/d13/d20/d66/d55/da0/f56 0 2024-09-13T02:52:48.748 INFO:tasks.workunit.client.0.smithi098.stdout:6/298: write d5/f1e [386751,50715] 0 2024-09-13T02:52:48.749 INFO:tasks.workunit.client.0.smithi098.stdout:9/285: creat d2/d6/d2b/d4d/f64 x:0 0 0 2024-09-13T02:52:48.750 INFO:tasks.workunit.client.0.smithi098.stdout:0/367: dread fa [0,4194304] 0 2024-09-13T02:52:48.751 INFO:tasks.workunit.client.1.smithi142.stdout:7/822: dwrite d10/d13/d1d/d2b/d56/fe2 [0,4194304] 0 2024-09-13T02:52:48.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:48 smithi142 ceph-mon[33443]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 220 MiB/s wr, 375 op/s 2024-09-13T02:52:48.751 INFO:tasks.workunit.client.0.smithi098.stdout:2/273: write d1/d1a/d9/d1e/f47 [1980239,97929] 0 2024-09-13T02:52:48.752 INFO:tasks.workunit.client.1.smithi142.stdout:7/823: fdatasync d10/d13/d1d/f2d 0 2024-09-13T02:52:48.754 INFO:tasks.workunit.client.1.smithi142.stdout:2/668: unlink d1/de/d1f/c8a 0 2024-09-13T02:52:48.755 INFO:tasks.workunit.client.0.smithi098.stdout:1/370: mknod d9/d33/d1f/d23/d30/c8b 0 2024-09-13T02:52:48.756 INFO:tasks.workunit.client.1.smithi142.stdout:2/669: chown d1/d2d/f6e 45075311 1 2024-09-13T02:52:48.756 INFO:tasks.workunit.client.1.smithi142.stdout:4/756: dwrite d0/d2b/d21/d35/f5f [0,4194304] 0 2024-09-13T02:52:48.757 INFO:tasks.workunit.client.0.smithi098.stdout:1/371: write d9/d33/d19/d35/d63/f69 [508341,83633] 0 2024-09-13T02:52:48.760 INFO:tasks.workunit.client.1.smithi142.stdout:6/820: mknod d1/dd/d16/d4e/d32/c118 0 2024-09-13T02:52:48.767 INFO:tasks.workunit.client.0.smithi098.stdout:1/372: dwrite d9/d33/f7a [0,4194304] 0 2024-09-13T02:52:48.767 INFO:tasks.workunit.client.0.smithi098.stdout:2/274: symlink d1/d1a/d9/d1e/l51 0 2024-09-13T02:52:48.770 INFO:tasks.workunit.client.0.smithi098.stdout:5/279: link d0/d38/d3f/d1a/d32/d4d/l5a d0/d38/d3f/d1a/l66 0 2024-09-13T02:52:48.772 INFO:tasks.workunit.client.0.smithi098.stdout:1/373: dread d9/d33/f7a [0,4194304] 0 2024-09-13T02:52:48.773 INFO:tasks.workunit.client.0.smithi098.stdout:1/374: fdatasync d9/d33/d29/d58/f82 0 2024-09-13T02:52:48.776 INFO:tasks.workunit.client.1.smithi142.stdout:3/764: write d12/f13 [4348162,99780] 0 2024-09-13T02:52:48.778 INFO:tasks.workunit.client.1.smithi142.stdout:3/765: dread - d12/d16/d25/d2e/d48/d5c/d66/fe8 zero size 2024-09-13T02:52:48.778 INFO:tasks.workunit.client.0.smithi098.stdout:1/375: truncate d9/d33/d1f/d6b/d7c/f85 572696 0 2024-09-13T02:52:48.779 INFO:tasks.workunit.client.1.smithi142.stdout:3/766: truncate d12/d16/f24 4578772 0 2024-09-13T02:52:48.779 INFO:tasks.workunit.client.0.smithi098.stdout:9/286: truncate d2/d6/f35 514129 0 2024-09-13T02:52:48.780 INFO:tasks.workunit.client.1.smithi142.stdout:2/670: rename d1 to d1/dc3/dd5 22 2024-09-13T02:52:48.781 INFO:tasks.workunit.client.0.smithi098.stdout:7/507: dwrite d6/d24/d2a/d5a/d4c/f6e [0,4194304] 0 2024-09-13T02:52:48.782 INFO:tasks.workunit.client.0.smithi098.stdout:6/299: dwrite d5/fb [0,4194304] 0 2024-09-13T02:52:48.783 INFO:tasks.workunit.client.1.smithi142.stdout:0/810: creat d10/d6c/d88/d21/d8f/f10b x:0 0 0 2024-09-13T02:52:48.785 INFO:tasks.workunit.client.0.smithi098.stdout:2/275: truncate d1/d1f/d30/f3e 146645 0 2024-09-13T02:52:48.793 INFO:tasks.workunit.client.0.smithi098.stdout:7/508: chown d6/d24/d2a/d57/d88/f4f 769 1 2024-09-13T02:52:48.793 INFO:tasks.workunit.client.1.smithi142.stdout:1/803: mknod d12/d13/d20/d66/d7d/df5/cfc 0 2024-09-13T02:52:48.795 INFO:tasks.workunit.client.0.smithi098.stdout:0/368: write dd/f59 [1347325,34208] 0 2024-09-13T02:52:48.795 INFO:tasks.workunit.client.0.smithi098.stdout:6/300: dwrite d5/d13/d2b/d3a/d14/f29 [0,4194304] 0 2024-09-13T02:52:48.797 INFO:tasks.workunit.client.1.smithi142.stdout:9/853: write dd/d98/d126/db8/dc0/fe4 [672261,68195] 0 2024-09-13T02:52:48.799 INFO:tasks.workunit.client.0.smithi098.stdout:0/369: read f4 [1813367,25412] 0 2024-09-13T02:52:48.803 INFO:tasks.workunit.client.0.smithi098.stdout:2/276: chown d1/d1f/d39/f21 937 1 2024-09-13T02:52:48.804 INFO:tasks.workunit.client.0.smithi098.stdout:7/509: fsync d6/d24/d2a/d5a/d42/f71 0 2024-09-13T02:52:48.805 INFO:tasks.workunit.client.0.smithi098.stdout:7/510: dread - d6/f92 zero size 2024-09-13T02:52:48.807 INFO:tasks.workunit.client.1.smithi142.stdout:6/821: creat d1/dd/d53/d78/d8f/da8/dc1/f119 x:0 0 0 2024-09-13T02:52:48.808 INFO:tasks.workunit.client.1.smithi142.stdout:8/697: getdents d0/d6/dc/d45/d35/d93 0 2024-09-13T02:52:48.811 INFO:tasks.workunit.client.1.smithi142.stdout:9/854: symlink dd/d17/d44/d82/d99/daf/dc9/de9/l137 0 2024-09-13T02:52:48.812 INFO:tasks.workunit.client.0.smithi098.stdout:2/277: creat d1/d1f/d36/f52 x:0 0 0 2024-09-13T02:52:48.813 INFO:tasks.workunit.client.1.smithi142.stdout:9/855: dread - dd/d17/d69/d84/d41/f125 zero size 2024-09-13T02:52:48.813 INFO:tasks.workunit.client.1.smithi142.stdout:8/698: dwrite d0/f95 [0,4194304] 0 2024-09-13T02:52:48.814 INFO:tasks.workunit.client.1.smithi142.stdout:2/671: unlink d1/ff 0 2024-09-13T02:52:48.818 INFO:tasks.workunit.client.1.smithi142.stdout:4/757: creat d0/df/d57/ff2 x:0 0 0 2024-09-13T02:52:48.818 INFO:tasks.workunit.client.0.smithi098.stdout:1/376: link d9/d33/c14 d9/d33/d19/d35/d68/d60/c8c 0 2024-09-13T02:52:48.819 INFO:tasks.workunit.client.1.smithi142.stdout:4/758: stat d0/df/f5d 0 2024-09-13T02:52:48.819 INFO:tasks.workunit.client.1.smithi142.stdout:0/811: dread d10/d6c/d88/d21/f3c [0,4194304] 0 2024-09-13T02:52:48.821 INFO:tasks.workunit.client.1.smithi142.stdout:6/822: creat d1/dd/d53/d78/d8f/da8/f11a x:0 0 0 2024-09-13T02:52:48.824 INFO:tasks.workunit.client.0.smithi098.stdout:1/377: dread d9/d33/f67 [0,4194304] 0 2024-09-13T02:52:48.824 INFO:tasks.workunit.client.0.smithi098.stdout:6/301: symlink d5/d13/d2b/d3a/d41/d6c/l6d 0 2024-09-13T02:52:48.826 INFO:tasks.workunit.client.0.smithi098.stdout:5/280: dread d0/d15/f22 [8388608,4194304] 0 2024-09-13T02:52:48.826 INFO:tasks.workunit.client.1.smithi142.stdout:0/812: dwrite d10/d95/dcf/f103 [0,4194304] 0 2024-09-13T02:52:48.827 INFO:tasks.workunit.client.1.smithi142.stdout:5/823: truncate d8/dc3/f3d 2472779 0 2024-09-13T02:52:48.827 INFO:tasks.workunit.client.0.smithi098.stdout:4/291: sync 2024-09-13T02:52:48.827 INFO:tasks.workunit.client.0.smithi098.stdout:5/281: fsync d0/d29/f63 0 2024-09-13T02:52:48.827 INFO:tasks.workunit.client.0.smithi098.stdout:1/378: write d9/d33/d19/d35/d68/f3f [4289086,29558] 0 2024-09-13T02:52:48.828 INFO:tasks.workunit.client.1.smithi142.stdout:0/813: write d10/d23/f8d [2349721,114479] 0 2024-09-13T02:52:48.828 INFO:tasks.workunit.client.1.smithi142.stdout:5/824: chown d8/d47/d65/da0/dd1/d45/c9d 0 1 2024-09-13T02:52:48.829 INFO:tasks.workunit.client.0.smithi098.stdout:2/278: mknod d1/d1a/dc/c53 0 2024-09-13T02:52:48.829 INFO:tasks.workunit.client.0.smithi098.stdout:5/282: stat d0/d15/d17/f26 0 2024-09-13T02:52:48.829 INFO:tasks.workunit.client.0.smithi098.stdout:1/379: chown d9/d33/d1f/d23/d30/c8b 1060 1 2024-09-13T02:52:48.830 INFO:tasks.workunit.client.0.smithi098.stdout:2/279: chown d1/d1f/d30/f3e 317323504 1 2024-09-13T02:52:48.830 INFO:tasks.workunit.client.0.smithi098.stdout:9/287: truncate d2/d6/d36/f58 1474210 0 2024-09-13T02:52:48.831 INFO:tasks.workunit.client.0.smithi098.stdout:9/288: chown d2/d6 18 1 2024-09-13T02:52:48.837 INFO:tasks.workunit.client.0.smithi098.stdout:0/370: rename dd/df/d1d/d40/d46/c5f to dd/df/d1d/d26/c7c 0 2024-09-13T02:52:48.839 INFO:tasks.workunit.client.1.smithi142.stdout:3/767: truncate d12/d16/dc7/fda 3548937 0 2024-09-13T02:52:48.840 INFO:tasks.workunit.client.0.smithi098.stdout:5/283: dwrite d0/d15/d17/f1e [0,4194304] 0 2024-09-13T02:52:48.840 INFO:tasks.workunit.client.0.smithi098.stdout:7/511: dwrite d6/d24/d2a/d5a/d42/f71 [0,4194304] 0 2024-09-13T02:52:48.842 INFO:tasks.workunit.client.0.smithi098.stdout:6/302: unlink d5/d13/d2b/d3a/d14/f66 0 2024-09-13T02:52:48.842 INFO:tasks.workunit.client.0.smithi098.stdout:0/371: write dd/df/d1d/d26/d28/d32/f74 [750543,33647] 0 2024-09-13T02:52:48.842 INFO:tasks.workunit.client.0.smithi098.stdout:7/512: fsync d6/d24/d63/f72 0 2024-09-13T02:52:48.844 INFO:tasks.workunit.client.0.smithi098.stdout:7/513: write d6/f41 [607580,48857] 0 2024-09-13T02:52:48.845 INFO:tasks.workunit.client.1.smithi142.stdout:9/856: mknod dd/d17/d44/dfa/d118/c138 0 2024-09-13T02:52:48.848 INFO:tasks.workunit.client.1.smithi142.stdout:2/672: mknod d1/de/d1f/d9c/cd6 0 2024-09-13T02:52:48.849 INFO:tasks.workunit.client.0.smithi098.stdout:5/284: dwrite d0/d15/f18 [0,4194304] 0 2024-09-13T02:52:48.849 INFO:tasks.workunit.client.1.smithi142.stdout:2/673: stat d1/de/d1f/d13/f89 0 2024-09-13T02:52:48.851 INFO:tasks.workunit.client.1.smithi142.stdout:8/699: rename d0/d6/dc/d45/d8/df/d28/lc4 to d0/d6/dc/d45/d35/d93/le4 0 2024-09-13T02:52:48.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/700: write d0/d6/dc/d45/d8/fe1 [842637,110993] 0 2024-09-13T02:52:48.856 INFO:tasks.workunit.client.0.smithi098.stdout:1/380: rename d9/d33/d1f/d23/c2a to d9/d33/d1f/d23/c8d 0 2024-09-13T02:52:48.861 INFO:tasks.workunit.client.0.smithi098.stdout:9/289: symlink d2/d6/d2b/d4d/l65 0 2024-09-13T02:52:48.862 INFO:tasks.workunit.client.0.smithi098.stdout:9/290: write d2/d6/d2b/d4d/f64 [48597,34508] 0 2024-09-13T02:52:48.863 INFO:tasks.workunit.client.1.smithi142.stdout:0/814: readlink d10/d6c/d88/d21/d51/l41 0 2024-09-13T02:52:48.865 INFO:tasks.workunit.client.1.smithi142.stdout:1/804: rmdir d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/df1 0 2024-09-13T02:52:48.867 INFO:tasks.workunit.client.0.smithi098.stdout:4/292: rename d6/d10/d20 to d6/d3e/d68 0 2024-09-13T02:52:48.870 INFO:tasks.workunit.client.1.smithi142.stdout:5/825: read d8/d47/d65/da0/dd1/d63/f73 [4547591,13951] 0 2024-09-13T02:52:48.873 INFO:tasks.workunit.client.0.smithi098.stdout:6/303: creat d5/d36/f6e x:0 0 0 2024-09-13T02:52:48.875 INFO:tasks.workunit.client.0.smithi098.stdout:0/372: write dd/df/d1d/d26/f51 [632118,70339] 0 2024-09-13T02:52:48.884 INFO:tasks.workunit.client.1.smithi142.stdout:2/674: dwrite d1/d42/d44/f84 [0,4194304] 0 2024-09-13T02:52:48.884 INFO:tasks.workunit.client.0.smithi098.stdout:2/280: symlink d1/d1f/d35/l54 0 2024-09-13T02:52:48.884 INFO:tasks.workunit.client.1.smithi142.stdout:2/675: read d1/d42/f8f [19695,53631] 0 2024-09-13T02:52:48.885 INFO:tasks.workunit.client.0.smithi098.stdout:1/381: readlink d9/d33/l6a 0 2024-09-13T02:52:48.887 INFO:tasks.workunit.client.1.smithi142.stdout:0/815: write d10/d6c/d88/d36/f59 [1474961,92196] 0 2024-09-13T02:52:48.890 INFO:tasks.workunit.client.1.smithi142.stdout:5/826: dread d8/d47/d65/f80 [4194304,4194304] 0 2024-09-13T02:52:48.891 INFO:tasks.workunit.client.0.smithi098.stdout:9/291: rename d2/d6/d46 to d2/d6/d2b/d66 0 2024-09-13T02:52:48.892 INFO:tasks.workunit.client.1.smithi142.stdout:2/676: dwrite d1/de/d31/db0/fce [0,4194304] 0 2024-09-13T02:52:48.894 INFO:tasks.workunit.client.0.smithi098.stdout:4/293: creat d6/d22/d3d/d41/d58/f69 x:0 0 0 2024-09-13T02:52:48.895 INFO:tasks.workunit.client.1.smithi142.stdout:7/824: link d10/d13/d1d/d25/d45/d6d/dc3/led d10/d13/d1d/d25/d45/d6d/dc3/l10f 0 2024-09-13T02:52:48.895 INFO:tasks.workunit.client.0.smithi098.stdout:4/294: truncate d6/d22/d3d/d4d/f5f 334016 0 2024-09-13T02:52:48.897 INFO:tasks.workunit.client.0.smithi098.stdout:0/373: truncate fa 1599018 0 2024-09-13T02:52:48.901 INFO:tasks.workunit.client.1.smithi142.stdout:8/701: truncate d0/d6/d83/daa/fb0 971032 0 2024-09-13T02:52:48.901 INFO:tasks.workunit.client.0.smithi098.stdout:7/514: dwrite d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:48.904 INFO:tasks.workunit.client.1.smithi142.stdout:7/825: dread d10/d13/d1d/d2b/faf [0,4194304] 0 2024-09-13T02:52:48.905 INFO:tasks.workunit.client.1.smithi142.stdout:9/857: dwrite dd/d17/d44/d82/d99/daf/fbe [0,4194304] 0 2024-09-13T02:52:48.906 INFO:tasks.workunit.client.1.smithi142.stdout:6/823: dwrite d1/d7/d19/d48/f9c [0,4194304] 0 2024-09-13T02:52:48.908 INFO:tasks.workunit.client.0.smithi098.stdout:4/295: mkdir d6/d54/d6a 0 2024-09-13T02:52:48.909 INFO:tasks.workunit.client.0.smithi098.stdout:3/295: sync 2024-09-13T02:52:48.910 INFO:tasks.workunit.client.1.smithi142.stdout:1/805: symlink d12/d13/d20/d27/lfd 0 2024-09-13T02:52:48.910 INFO:tasks.workunit.client.0.smithi098.stdout:4/296: write d6/db/f2f [10090139,36024] 0 2024-09-13T02:52:48.911 INFO:tasks.workunit.client.0.smithi098.stdout:5/285: creat d0/d38/d3f/d1a/f67 x:0 0 0 2024-09-13T02:52:48.912 INFO:tasks.workunit.client.1.smithi142.stdout:1/806: truncate d12/d13/d20/d27/d3c/f6d 5620427 0 2024-09-13T02:52:48.912 INFO:tasks.workunit.client.1.smithi142.stdout:0/816: mknod d10/d6c/d88/d21/daf/dc4/c10c 0 2024-09-13T02:52:48.913 INFO:tasks.workunit.client.0.smithi098.stdout:2/281: mknod d1/d1a/c55 0 2024-09-13T02:52:48.914 INFO:tasks.workunit.client.1.smithi142.stdout:1/807: readlink d12/d13/d20/d66/d7d/l8b 0 2024-09-13T02:52:48.914 INFO:tasks.workunit.client.1.smithi142.stdout:0/817: chown d10/d6c/d88/d1a 127861237 1 2024-09-13T02:52:48.915 INFO:tasks.workunit.client.0.smithi098.stdout:9/292: dwrite d2/f10 [0,4194304] 0 2024-09-13T02:52:48.916 INFO:tasks.workunit.client.1.smithi142.stdout:2/677: fsync d1/de/da6/dbb/d92/fa4 0 2024-09-13T02:52:48.918 INFO:tasks.workunit.client.1.smithi142.stdout:3/768: creat d12/d16/d25/d2e/d48/d5c/d8c/ff2 x:0 0 0 2024-09-13T02:52:48.932 INFO:tasks.workunit.client.1.smithi142.stdout:9/858: unlink dd/d17/d68/lcf 0 2024-09-13T02:52:48.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/824: truncate d1/d7/fa7 1892572 0 2024-09-13T02:52:48.935 INFO:tasks.workunit.client.0.smithi098.stdout:2/282: rmdir d1/d1f 39 2024-09-13T02:52:48.935 INFO:tasks.workunit.client.0.smithi098.stdout:9/293: readlink d2/l49 0 2024-09-13T02:52:48.936 INFO:tasks.workunit.client.0.smithi098.stdout:0/374: creat dd/df/d1d/d26/f7d x:0 0 0 2024-09-13T02:52:48.937 INFO:tasks.workunit.client.0.smithi098.stdout:6/304: truncate d5/d18/f45 380495 0 2024-09-13T02:52:48.938 INFO:tasks.workunit.client.0.smithi098.stdout:4/297: mknod d6/d10/d21/c6b 0 2024-09-13T02:52:48.939 INFO:tasks.workunit.client.0.smithi098.stdout:4/298: write d6/d22/f28 [4068375,1127] 0 2024-09-13T02:52:48.940 INFO:tasks.workunit.client.1.smithi142.stdout:1/808: mkdir d12/d13/d20/d27/d3c/d71/d81/d92/dfe 0 2024-09-13T02:52:48.944 INFO:tasks.workunit.client.0.smithi098.stdout:6/305: dwrite f4 [0,4194304] 0 2024-09-13T02:52:48.945 INFO:tasks.workunit.client.0.smithi098.stdout:9/294: truncate d2/dd/f3b 5157166 0 2024-09-13T02:52:48.946 INFO:tasks.workunit.client.1.smithi142.stdout:3/769: readlink d12/d16/d25/d2e/d38/d4d/dad/lea 0 2024-09-13T02:52:48.947 INFO:tasks.workunit.client.0.smithi098.stdout:9/295: stat d2/d6/l3c 0 2024-09-13T02:52:48.947 INFO:tasks.workunit.client.0.smithi098.stdout:9/296: write d2/dd/d39/f5a [1043224,57634] 0 2024-09-13T02:52:48.952 INFO:tasks.workunit.client.1.smithi142.stdout:4/759: rename d0/c34 to d0/df/d57/cf3 0 2024-09-13T02:52:48.953 INFO:tasks.workunit.client.1.smithi142.stdout:4/760: stat d0/d2b/d2d/d31/d32/d82/f86 0 2024-09-13T02:52:48.954 INFO:tasks.workunit.client.1.smithi142.stdout:4/761: write d0/f9b [2236767,33892] 0 2024-09-13T02:52:48.955 INFO:tasks.workunit.client.0.smithi098.stdout:4/299: unlink d6/l4c 0 2024-09-13T02:52:48.960 INFO:tasks.workunit.client.0.smithi098.stdout:3/296: dread d7/d9/d25/d3a/d52/f28 [0,4194304] 0 2024-09-13T02:52:48.960 INFO:tasks.workunit.client.1.smithi142.stdout:4/762: dwrite d0/d2b/d21/f2a [0,4194304] 0 2024-09-13T02:52:48.961 INFO:tasks.workunit.client.1.smithi142.stdout:4/763: dread - d0/d2b/d2d/fac zero size 2024-09-13T02:52:48.962 INFO:tasks.workunit.client.1.smithi142.stdout:6/825: creat d1/d7/d5f/d6a/f11b x:0 0 0 2024-09-13T02:52:48.962 INFO:tasks.workunit.client.0.smithi098.stdout:0/375: fdatasync dd/df/d1d/d26/d28/f2e 0 2024-09-13T02:52:48.963 INFO:tasks.workunit.client.1.smithi142.stdout:6/826: stat d1/dd/d57/df5 0 2024-09-13T02:52:48.965 INFO:tasks.workunit.client.0.smithi098.stdout:9/297: symlink d2/d6/d2b/d66/l67 0 2024-09-13T02:52:48.971 INFO:tasks.workunit.client.1.smithi142.stdout:2/678: chown d1/de/d31/d6c/d6d/db6/c4f 1705 1 2024-09-13T02:52:48.975 INFO:tasks.workunit.client.1.smithi142.stdout:8/702: write d0/d6/f24 [3618099,30232] 0 2024-09-13T02:52:48.979 INFO:tasks.workunit.client.0.smithi098.stdout:4/300: dread d6/d22/d3d/f49 [0,4194304] 0 2024-09-13T02:52:48.981 INFO:tasks.workunit.client.1.smithi142.stdout:8/703: dwrite d0/fe0 [0,4194304] 0 2024-09-13T02:52:48.982 INFO:tasks.workunit.client.1.smithi142.stdout:9/859: dwrite dd/d17/d25/f6a [4194304,4194304] 0 2024-09-13T02:52:48.982 INFO:tasks.workunit.client.1.smithi142.stdout:7/826: creat d10/d13/d1d/d2b/d40/f110 x:0 0 0 2024-09-13T02:52:48.984 INFO:tasks.workunit.client.0.smithi098.stdout:6/306: truncate d5/f15 1149584 0 2024-09-13T02:52:48.987 INFO:tasks.workunit.client.0.smithi098.stdout:2/283: creat d1/d1f/f56 x:0 0 0 2024-09-13T02:52:48.988 INFO:tasks.workunit.client.0.smithi098.stdout:2/284: chown d1/d1f/d39/c26 5893583 1 2024-09-13T02:52:48.989 INFO:tasks.workunit.client.0.smithi098.stdout:2/285: dread d1/d1f/d39/f21 [0,4194304] 0 2024-09-13T02:52:48.993 INFO:tasks.workunit.client.1.smithi142.stdout:6/827: rename d1/dd/d57/l71 to d1/d7/d5f/d60/l11c 0 2024-09-13T02:52:48.994 INFO:tasks.workunit.client.0.smithi098.stdout:0/376: unlink dd/df/d1d/d26/c31 0 2024-09-13T02:52:48.995 INFO:tasks.workunit.client.1.smithi142.stdout:5/827: getdents d8/d47/d65/da0/dd1/d45/d81/d82 0 2024-09-13T02:52:48.997 INFO:tasks.workunit.client.0.smithi098.stdout:6/307: fsync d5/d13/d2b/d3a/d41/f4b 0 2024-09-13T02:52:48.998 INFO:tasks.workunit.client.0.smithi098.stdout:6/308: stat d5/d13/d2b/d3a/f11 0 2024-09-13T02:52:48.998 INFO:tasks.workunit.client.0.smithi098.stdout:6/309: stat d5/d13/d2b/d3a/d41/l61 0 2024-09-13T02:52:49.000 INFO:tasks.workunit.client.0.smithi098.stdout:2/286: rename d1/d1f/c4e to d1/d1a/dc/c57 0 2024-09-13T02:52:49.001 INFO:tasks.workunit.client.0.smithi098.stdout:2/287: write d1/d1f/d39/f49 [922413,129780] 0 2024-09-13T02:52:49.002 INFO:tasks.workunit.client.0.smithi098.stdout:0/377: read dd/df/d1d/d26/d28/d5d/f66 [23752,45196] 0 2024-09-13T02:52:49.006 INFO:tasks.workunit.client.0.smithi098.stdout:3/297: truncate d7/d9/d25/d2b/f40 3551747 0 2024-09-13T02:52:49.007 INFO:tasks.workunit.client.0.smithi098.stdout:3/298: chown d7/d9/d25/d3a/f44 13897 1 2024-09-13T02:52:49.011 INFO:tasks.workunit.client.1.smithi142.stdout:4/764: creat d0/df/d57/dbf/ff4 x:0 0 0 2024-09-13T02:52:49.011 INFO:tasks.workunit.client.0.smithi098.stdout:2/288: mknod d1/d1f/d36/c58 0 2024-09-13T02:52:49.012 INFO:tasks.workunit.client.1.smithi142.stdout:0/818: link d10/l33 d10/d6c/d88/d1a/d1e/d42/l10d 0 2024-09-13T02:52:49.013 INFO:tasks.workunit.client.1.smithi142.stdout:1/809: write d12/d13/d45/f60 [595326,58404] 0 2024-09-13T02:52:49.013 INFO:tasks.workunit.client.1.smithi142.stdout:0/819: stat d10/d6c/d88/d21/d51/d35/c8e 0 2024-09-13T02:52:49.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/770: truncate d12/d16/d25/d2e/d48/d5c/d8c/daf/fbe 1889379 0 2024-09-13T02:52:49.016 INFO:tasks.workunit.client.1.smithi142.stdout:6/828: rename d1/d4a/cf8 to d1/dd/dda/c11d 0 2024-09-13T02:52:49.017 INFO:tasks.workunit.client.0.smithi098.stdout:0/378: creat dd/df/d1d/d26/d28/d32/f7e x:0 0 0 2024-09-13T02:52:49.017 INFO:tasks.workunit.client.1.smithi142.stdout:6/829: write d1/d7/d42/f8b [2473333,112431] 0 2024-09-13T02:52:49.019 INFO:tasks.workunit.client.0.smithi098.stdout:9/298: getdents d2/dd/d39 0 2024-09-13T02:52:49.020 INFO:tasks.workunit.client.1.smithi142.stdout:9/860: write dd/d17/d44/d95/fd3 [120783,42866] 0 2024-09-13T02:52:49.021 INFO:tasks.workunit.client.0.smithi098.stdout:3/299: unlink d7/l11 0 2024-09-13T02:52:49.021 INFO:tasks.workunit.client.0.smithi098.stdout:3/300: chown d7/d9/d25/d3a/d52/f3b 64211797 1 2024-09-13T02:52:49.022 INFO:tasks.workunit.client.0.smithi098.stdout:3/301: write d7/d9/d15/d2d/d34/f5a [107773,59289] 0 2024-09-13T02:52:49.030 INFO:tasks.workunit.client.0.smithi098.stdout:3/302: dwrite d7/fc [4194304,4194304] 0 2024-09-13T02:52:49.031 INFO:tasks.workunit.client.0.smithi098.stdout:3/303: stat d7/d9/d15/d2d/d34/f5a 0 2024-09-13T02:52:49.097 INFO:tasks.workunit.client.0.smithi098.stdout:6/310: mkdir d5/d6f 0 2024-09-13T02:52:49.098 INFO:tasks.workunit.client.0.smithi098.stdout:2/289: rmdir d1/d1f 39 2024-09-13T02:52:49.099 INFO:tasks.workunit.client.0.smithi098.stdout:6/311: truncate d5/d13/d51/f54 796985 0 2024-09-13T02:52:49.106 INFO:tasks.workunit.client.1.smithi142.stdout:2/679: sync 2024-09-13T02:52:49.107 INFO:tasks.workunit.client.0.smithi098.stdout:0/379: mkdir dd/df/d1d/d26/d28/d5d/d7f 0 2024-09-13T02:52:49.109 INFO:tasks.workunit.client.0.smithi098.stdout:0/380: write dd/df/d1d/d26/d28/d32/f49 [471673,123392] 0 2024-09-13T02:52:49.109 INFO:tasks.workunit.client.1.smithi142.stdout:0/820: mknod d10/d6c/d88/d21/d51/d35/d9b/da5/c10e 0 2024-09-13T02:52:49.109 INFO:tasks.workunit.client.1.smithi142.stdout:2/680: dread d1/fb5 [0,4194304] 0 2024-09-13T02:52:49.111 INFO:tasks.workunit.client.1.smithi142.stdout:0/821: write d10/d6c/d88/d1a/d1e/dc6/fef [826439,40768] 0 2024-09-13T02:52:49.118 INFO:tasks.workunit.client.0.smithi098.stdout:9/299: dread d2/d6/f35 [0,4194304] 0 2024-09-13T02:52:49.124 INFO:tasks.workunit.client.1.smithi142.stdout:5/828: symlink d8/dc3/d64/d68/ded/dfa/l10d 0 2024-09-13T02:52:49.126 INFO:tasks.workunit.client.0.smithi098.stdout:3/304: dread d7/d9/d25/d2b/f2c [0,4194304] 0 2024-09-13T02:52:49.126 INFO:tasks.workunit.client.0.smithi098.stdout:0/381: mknod dd/df/d1d/d26/d37/c80 0 2024-09-13T02:52:49.127 INFO:tasks.workunit.client.0.smithi098.stdout:3/305: chown d7/d9/d15/d2d/d34 156169 1 2024-09-13T02:52:49.128 INFO:tasks.workunit.client.1.smithi142.stdout:9/861: mknod dd/d98/c139 0 2024-09-13T02:52:49.129 INFO:tasks.workunit.client.0.smithi098.stdout:3/306: write d7/d9/d4c/f4f [4846611,10581] 0 2024-09-13T02:52:49.134 INFO:tasks.workunit.client.0.smithi098.stdout:9/300: write d2/dd/d39/f25 [3824123,63821] 0 2024-09-13T02:52:49.137 INFO:tasks.workunit.client.0.smithi098.stdout:2/290: readlink d1/d1f/d36/l50 0 2024-09-13T02:52:49.140 INFO:tasks.workunit.client.0.smithi098.stdout:0/382: mkdir dd/df/d1d/d26/d28/d32/d67/d81 0 2024-09-13T02:52:49.148 INFO:tasks.workunit.client.0.smithi098.stdout:2/291: mkdir d1/d1a/d4f/d59 0 2024-09-13T02:52:49.149 INFO:tasks.workunit.client.0.smithi098.stdout:0/383: mkdir dd/df/d1d/d26/d28/d32/d67/d82 0 2024-09-13T02:52:49.151 INFO:tasks.workunit.client.1.smithi142.stdout:5/829: chown d8/d47/c7c 853564429 1 2024-09-13T02:52:49.152 INFO:tasks.workunit.client.0.smithi098.stdout:3/307: mkdir d7/d9/d15/d5d 0 2024-09-13T02:52:49.152 INFO:tasks.workunit.client.1.smithi142.stdout:5/830: read d8/dc3/df3/f94 [424105,56328] 0 2024-09-13T02:52:49.156 INFO:tasks.workunit.client.1.smithi142.stdout:5/831: write d8/d47/d65/da0/dd1/d45/f79 [3884023,3701] 0 2024-09-13T02:52:49.156 INFO:tasks.workunit.client.1.smithi142.stdout:1/810: creat d12/d13/d20/d66/d55/db4/fff x:0 0 0 2024-09-13T02:52:49.157 INFO:tasks.workunit.client.1.smithi142.stdout:5/832: readlink d8/l58 0 2024-09-13T02:52:49.157 INFO:tasks.workunit.client.1.smithi142.stdout:1/811: stat d12/d13/d20/d27/d3c/d71/d96/c9f 0 2024-09-13T02:52:49.157 INFO:tasks.workunit.client.1.smithi142.stdout:5/833: truncate d8/d47/d65/da0/dd1/d2d/fea 420903 0 2024-09-13T02:52:49.164 INFO:tasks.workunit.client.1.smithi142.stdout:7/827: sync 2024-09-13T02:52:49.170 INFO:tasks.workunit.client.0.smithi098.stdout:2/292: rmdir d1/d1a 39 2024-09-13T02:52:49.174 INFO:tasks.workunit.client.0.smithi098.stdout:3/308: rmdir d7/d9/d15/d2d 39 2024-09-13T02:52:49.175 INFO:tasks.workunit.client.0.smithi098.stdout:3/309: fsync d7/f1d 0 2024-09-13T02:52:49.178 INFO:tasks.workunit.client.1.smithi142.stdout:7/828: dread - d10/d13/d1d/d25/d45/d6d/dc3/f63 zero size 2024-09-13T02:52:49.178 INFO:tasks.workunit.client.1.smithi142.stdout:7/829: fsync d10/f81 0 2024-09-13T02:52:49.179 INFO:tasks.workunit.client.1.smithi142.stdout:7/830: write d10/d13/f108 [930772,52558] 0 2024-09-13T02:52:49.181 INFO:tasks.workunit.client.1.smithi142.stdout:0/822: link d10/d6c/d88/d36/l9a d10/d6c/d88/d21/d51/d35/d9b/da5/ddf/l10f 0 2024-09-13T02:52:49.183 INFO:tasks.workunit.client.0.smithi098.stdout:2/293: dwrite d1/d1a/dc/f37 [0,4194304] 0 2024-09-13T02:52:49.192 INFO:tasks.workunit.client.1.smithi142.stdout:8/704: creat d0/d6/dc/d45/d8/df/fe5 x:0 0 0 2024-09-13T02:52:49.193 INFO:tasks.workunit.client.1.smithi142.stdout:0/823: mkdir d10/d6c/d88/d1a/d1e/dc6/df3/d110 0 2024-09-13T02:52:49.196 INFO:tasks.workunit.client.1.smithi142.stdout:8/705: dread d0/d6/dc/d45/d35/d37/f5d [0,4194304] 0 2024-09-13T02:52:49.199 INFO:tasks.workunit.client.1.smithi142.stdout:0/824: symlink d10/d6c/d88/d21/d51/d79/de6/l111 0 2024-09-13T02:52:49.200 INFO:tasks.workunit.client.1.smithi142.stdout:4/765: mkdir d0/d2b/d2d/d65/df5 0 2024-09-13T02:52:49.201 INFO:tasks.workunit.client.1.smithi142.stdout:7/831: dread d10/d13/d21/fc7 [0,4194304] 0 2024-09-13T02:52:49.202 INFO:tasks.workunit.client.1.smithi142.stdout:7/832: write d10/d13/f1e [846210,55663] 0 2024-09-13T02:52:49.204 INFO:tasks.workunit.client.1.smithi142.stdout:0/825: rmdir d10/d6c/d88/d1a/d1e/d42/d4b 39 2024-09-13T02:52:49.207 INFO:tasks.workunit.client.1.smithi142.stdout:8/706: link d0/d6/d23/l90 d0/d80/d8c/dc9/dc0/le6 0 2024-09-13T02:52:49.212 INFO:tasks.workunit.client.0.smithi098.stdout:9/301: symlink d2/d6/l68 0 2024-09-13T02:52:49.213 INFO:tasks.workunit.client.1.smithi142.stdout:0/826: creat d10/d6c/d88/d1a/d1e/d42/d4b/f112 x:0 0 0 2024-09-13T02:52:49.217 INFO:tasks.workunit.client.1.smithi142.stdout:0/827: stat d10/dbf/fd6 0 2024-09-13T02:52:49.218 INFO:tasks.workunit.client.1.smithi142.stdout:7/833: mknod d10/d13/d1d/d2b/d55/d32/d8c/df1/d10c/c111 0 2024-09-13T02:52:49.222 INFO:tasks.workunit.client.1.smithi142.stdout:7/834: dread - d10/d13/d1d/d2b/d56/d5f/da2/f109 zero size 2024-09-13T02:52:49.222 INFO:tasks.workunit.client.1.smithi142.stdout:0/828: mkdir d10/d6c/d88/d45/ded/d113 0 2024-09-13T02:52:49.223 INFO:tasks.workunit.client.1.smithi142.stdout:4/766: dread d0/d2b/d2d/d65/f2e [0,4194304] 0 2024-09-13T02:52:49.228 INFO:tasks.workunit.client.0.smithi098.stdout:2/294: unlink d1/d1a/d9/d1e/f2e 0 2024-09-13T02:52:49.228 INFO:tasks.workunit.client.1.smithi142.stdout:4/767: mknod d0/d2b/d2d/d31/d43/daf/cf6 0 2024-09-13T02:52:49.230 INFO:tasks.workunit.client.0.smithi098.stdout:2/295: mkdir d1/d1a/d9/d1e/d5a 0 2024-09-13T02:52:49.232 INFO:tasks.workunit.client.1.smithi142.stdout:4/768: creat d0/d7e/ff7 x:0 0 0 2024-09-13T02:52:49.235 INFO:tasks.workunit.client.1.smithi142.stdout:7/835: getdents d10/d13/d1d/d25/d45/d6d 0 2024-09-13T02:52:49.235 INFO:tasks.workunit.client.1.smithi142.stdout:7/836: chown d10/d13/d1d/d2b/d56/d5f/ldc 1 1 2024-09-13T02:52:49.237 INFO:tasks.workunit.client.0.smithi098.stdout:2/296: symlink d1/d1a/d9/d1e/d5a/l5b 0 2024-09-13T02:52:49.240 INFO:tasks.workunit.client.1.smithi142.stdout:7/837: creat d10/d13/d1d/d44/f112 x:0 0 0 2024-09-13T02:52:49.242 INFO:tasks.workunit.client.1.smithi142.stdout:7/838: mknod d10/d105/c113 0 2024-09-13T02:52:49.243 INFO:tasks.workunit.client.1.smithi142.stdout:1/812: mkdir d12/d13/d20/d100 0 2024-09-13T02:52:49.247 INFO:tasks.workunit.client.1.smithi142.stdout:7/839: creat d10/d13/d22/dea/f114 x:0 0 0 2024-09-13T02:52:49.249 INFO:tasks.workunit.client.1.smithi142.stdout:3/771: dwrite d12/d16/d3c/d7d/f96 [0,4194304] 0 2024-09-13T02:52:49.253 INFO:tasks.workunit.client.1.smithi142.stdout:6/830: dwrite d1/dd/f29 [0,4194304] 0 2024-09-13T02:52:49.253 INFO:tasks.workunit.client.1.smithi142.stdout:7/840: rmdir d10/d13/d1d/d25/d45/dad 39 2024-09-13T02:52:49.253 INFO:tasks.workunit.client.0.smithi098.stdout:8/312: sync 2024-09-13T02:52:49.256 INFO:tasks.workunit.client.1.smithi142.stdout:6/831: write d1/d7/d19/ff1 [394977,33044] 0 2024-09-13T02:52:49.259 INFO:tasks.workunit.client.1.smithi142.stdout:4/769: dread d0/d2b/d2d/d31/d43/f46 [0,4194304] 0 2024-09-13T02:52:49.259 INFO:tasks.workunit.client.1.smithi142.stdout:3/772: dread d12/d16/d3c/d7d/d91/fac [0,4194304] 0 2024-09-13T02:52:49.260 INFO:tasks.workunit.client.1.smithi142.stdout:7/841: readlink d10/d13/d1d/d25/d45/d6d/dc3/l8d 0 2024-09-13T02:52:49.261 INFO:tasks.workunit.client.1.smithi142.stdout:7/842: chown d10/d13/d1d/le6 1268397 1 2024-09-13T02:52:49.262 INFO:tasks.workunit.client.1.smithi142.stdout:6/832: mkdir d1/d7/d19/d48/d90/d11e 0 2024-09-13T02:52:49.262 INFO:tasks.workunit.client.1.smithi142.stdout:6/833: write d1/d7/d19/d30/f67 [1449547,49850] 0 2024-09-13T02:52:49.263 INFO:tasks.workunit.client.0.smithi098.stdout:8/313: creat d2/f60 x:0 0 0 2024-09-13T02:52:49.268 INFO:tasks.workunit.client.1.smithi142.stdout:7/843: read d10/d13/d1d/d25/d45/d6d/fa9 [2789089,129664] 0 2024-09-13T02:52:49.273 INFO:tasks.workunit.client.1.smithi142.stdout:9/862: dwrite dd/d17/d25/fac [0,4194304] 0 2024-09-13T02:52:49.279 INFO:tasks.workunit.client.1.smithi142.stdout:5/834: rename d8/f1b to d8/d47/d65/da0/dd1/d45/d81/d82/f10e 0 2024-09-13T02:52:49.283 INFO:tasks.workunit.client.0.smithi098.stdout:9/302: creat d2/f69 x:0 0 0 2024-09-13T02:52:49.289 INFO:tasks.workunit.client.0.smithi098.stdout:9/303: dwrite d2/f28 [0,4194304] 0 2024-09-13T02:52:49.293 INFO:tasks.workunit.client.0.smithi098.stdout:9/304: mkdir d2/d6/d36/d6a 0 2024-09-13T02:52:49.294 INFO:tasks.workunit.client.0.smithi098.stdout:2/297: creat d1/d1a/d9/f5c x:0 0 0 2024-09-13T02:52:49.302 INFO:tasks.workunit.client.0.smithi098.stdout:2/298: link d1/d1a/d9/d1e/f2c d1/d1a/dc/d23/f5d 0 2024-09-13T02:52:49.302 INFO:tasks.workunit.client.0.smithi098.stdout:2/299: stat d1/d1a/f7 0 2024-09-13T02:52:49.303 INFO:tasks.workunit.client.0.smithi098.stdout:2/300: fdatasync d1/d1a/f3a 0 2024-09-13T02:52:49.305 INFO:tasks.workunit.client.0.smithi098.stdout:0/384: rename dd/d1f/c4b to dd/df/d1d/c83 0 2024-09-13T02:52:49.306 INFO:tasks.workunit.client.1.smithi142.stdout:4/770: creat d0/df/ff8 x:0 0 0 2024-09-13T02:52:49.306 INFO:tasks.workunit.client.0.smithi098.stdout:0/385: chown dd/df/c7a 393 1 2024-09-13T02:52:49.309 INFO:tasks.workunit.client.1.smithi142.stdout:7/844: write d10/d13/d1d/d2b/d40/f106 [537159,90158] 0 2024-09-13T02:52:49.310 INFO:tasks.workunit.client.0.smithi098.stdout:2/301: dwrite d1/d1a/f7 [0,4194304] 0 2024-09-13T02:52:49.311 INFO:tasks.workunit.client.1.smithi142.stdout:8/707: dwrite d0/d6/dc/d45/d35/d37/f54 [0,4194304] 0 2024-09-13T02:52:49.311 INFO:tasks.workunit.client.1.smithi142.stdout:7/845: dread - d10/d13/d22/dea/f114 zero size 2024-09-13T02:52:49.312 INFO:tasks.workunit.client.0.smithi098.stdout:0/386: dread - dd/df/d1d/f2f zero size 2024-09-13T02:52:49.313 INFO:tasks.workunit.client.1.smithi142.stdout:5/835: unlink d8/dc3/d3f/caa 0 2024-09-13T02:52:49.319 INFO:tasks.workunit.client.0.smithi098.stdout:3/310: rename l3 to d7/d9/d15/d26/l5e 0 2024-09-13T02:52:49.320 INFO:tasks.workunit.client.0.smithi098.stdout:2/302: creat d1/d1f/d36/f5e x:0 0 0 2024-09-13T02:52:49.322 INFO:tasks.workunit.client.0.smithi098.stdout:2/303: readlink d1/d1a/dc/d23/l4a 0 2024-09-13T02:52:49.323 INFO:tasks.workunit.client.0.smithi098.stdout:3/311: dread d7/d9/f31 [0,4194304] 0 2024-09-13T02:52:49.324 INFO:tasks.workunit.client.0.smithi098.stdout:9/305: rename d2/f10 to d2/d6/d36/d6a/f6b 0 2024-09-13T02:52:49.329 INFO:tasks.workunit.client.1.smithi142.stdout:0/829: truncate d10/d6c/d88/d1a/f6b 250694 0 2024-09-13T02:52:49.332 INFO:tasks.workunit.client.0.smithi098.stdout:2/304: creat d1/d1a/d9/d1e/d5a/f5f x:0 0 0 2024-09-13T02:52:49.332 INFO:tasks.workunit.client.0.smithi098.stdout:2/305: fsync d1/d1f/d39/f41 0 2024-09-13T02:52:49.335 INFO:tasks.workunit.client.0.smithi098.stdout:3/312: rmdir d7/d9/d4c 39 2024-09-13T02:52:49.336 INFO:tasks.workunit.client.1.smithi142.stdout:2/681: link d1/de/d1f/ccf d1/cd7 0 2024-09-13T02:52:49.338 INFO:tasks.workunit.client.1.smithi142.stdout:6/834: getdents d1/dd/d16 0 2024-09-13T02:52:49.339 INFO:tasks.workunit.client.1.smithi142.stdout:6/835: dread - d1/d7/d5f/d60/d76/f114 zero size 2024-09-13T02:52:49.340 INFO:tasks.workunit.client.1.smithi142.stdout:7/846: rmdir d10/d13/d22/dea 39 2024-09-13T02:52:49.341 INFO:tasks.workunit.client.1.smithi142.stdout:1/813: write d12/d13/d45/f7c [1288795,72008] 0 2024-09-13T02:52:49.342 INFO:tasks.workunit.client.0.smithi098.stdout:2/306: unlink d1/d1f/d39/f41 0 2024-09-13T02:52:49.343 INFO:tasks.workunit.client.1.smithi142.stdout:7/847: dread d10/d13/d1d/d2b/d40/f106 [0,4194304] 0 2024-09-13T02:52:49.345 INFO:tasks.workunit.client.1.smithi142.stdout:0/830: creat d10/d6c/d88/d1a/d1e/d42/d4b/f114 x:0 0 0 2024-09-13T02:52:49.347 INFO:tasks.workunit.client.1.smithi142.stdout:7/848: dread d10/d13/d1d/d25/d5c/da3/f102 [0,4194304] 0 2024-09-13T02:52:49.349 INFO:tasks.workunit.client.1.smithi142.stdout:2/682: mknod d1/de/d1f/d13/cd8 0 2024-09-13T02:52:49.349 INFO:tasks.workunit.client.1.smithi142.stdout:2/683: fsync d1/d42/f55 0 2024-09-13T02:52:49.355 INFO:tasks.workunit.client.1.smithi142.stdout:0/831: symlink d10/d6c/l115 0 2024-09-13T02:52:49.366 INFO:tasks.workunit.client.1.smithi142.stdout:6/836: rename d1/dd/d16/f1c to d1/d7/d19/f11f 0 2024-09-13T02:52:49.367 INFO:tasks.workunit.client.1.smithi142.stdout:0/832: mkdir d10/d6c/d88/d1a/d116 0 2024-09-13T02:52:49.368 INFO:tasks.workunit.client.1.smithi142.stdout:0/833: fdatasync d10/d6c/f71 0 2024-09-13T02:52:49.369 INFO:tasks.workunit.client.1.smithi142.stdout:7/849: creat d10/d13/d1d/d25/d45/d6d/dc3/f115 x:0 0 0 2024-09-13T02:52:49.369 INFO:tasks.workunit.client.1.smithi142.stdout:0/834: truncate d10/d6c/d88/d21/d8f/f10b 169071 0 2024-09-13T02:52:49.370 INFO:tasks.workunit.client.1.smithi142.stdout:1/814: getdents d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0 0 2024-09-13T02:52:49.370 INFO:tasks.workunit.client.1.smithi142.stdout:0/835: chown d10/d6c/d88/d45/l6a 2 1 2024-09-13T02:52:49.371 INFO:tasks.workunit.client.1.smithi142.stdout:1/815: chown d12/d13/d20/d66/d7d/df5/le5 79 1 2024-09-13T02:52:49.373 INFO:tasks.workunit.client.1.smithi142.stdout:7/850: unlink d10/d13/d1d/d2b/d55/d32/ld2 0 2024-09-13T02:52:49.374 INFO:tasks.workunit.client.1.smithi142.stdout:0/836: rmdir d10/d6c/d88/d21/d8f 39 2024-09-13T02:52:49.383 INFO:tasks.workunit.client.1.smithi142.stdout:0/837: dread d10/d6c/d88/d45/f60 [0,4194304] 0 2024-09-13T02:52:49.390 INFO:tasks.workunit.client.0.smithi098.stdout:9/306: getdents d2/dd 0 2024-09-13T02:52:49.391 INFO:tasks.workunit.client.1.smithi142.stdout:1/816: mknod d12/c101 0 2024-09-13T02:52:49.393 INFO:tasks.workunit.client.1.smithi142.stdout:6/837: getdents d1/d7/d19/d30 0 2024-09-13T02:52:49.393 INFO:tasks.workunit.client.0.smithi098.stdout:3/313: dread d7/d9/d4c/f4f [0,4194304] 0 2024-09-13T02:52:49.394 INFO:tasks.workunit.client.0.smithi098.stdout:8/314: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:52:49.403 INFO:tasks.workunit.client.1.smithi142.stdout:7/851: dread d10/d13/d1d/d2b/d56/d5f/d73/f91 [0,4194304] 0 2024-09-13T02:52:49.482 INFO:tasks.workunit.client.1.smithi142.stdout:2/684: sync 2024-09-13T02:52:49.490 INFO:tasks.workunit.client.0.smithi098.stdout:9/307: mkdir d2/d6/d2b/d4d/d4f/d6c 0 2024-09-13T02:52:49.491 INFO:tasks.workunit.client.1.smithi142.stdout:6/838: creat d1/dd/d53/d78/d8f/da8/de6/f120 x:0 0 0 2024-09-13T02:52:49.492 INFO:tasks.workunit.client.0.smithi098.stdout:3/314: chown d7/d9/d15/d2d/f42 94 1 2024-09-13T02:52:49.493 INFO:tasks.workunit.client.1.smithi142.stdout:6/839: write d1/d7/d5f/d60/d76/f112 [882039,77785] 0 2024-09-13T02:52:49.493 INFO:tasks.workunit.client.0.smithi098.stdout:8/315: dread - d2/dd/f5a zero size 2024-09-13T02:52:49.494 INFO:tasks.workunit.client.0.smithi098.stdout:2/307: getdents d1/d1a/dc/d23 0 2024-09-13T02:52:49.494 INFO:tasks.workunit.client.0.smithi098.stdout:8/316: fsync d2/dd/f5a 0 2024-09-13T02:52:49.496 INFO:tasks.workunit.client.0.smithi098.stdout:9/308: symlink d2/d6/d2b/d4d/l6d 0 2024-09-13T02:52:49.497 INFO:tasks.workunit.client.0.smithi098.stdout:9/309: fdatasync d2/dd/d39/f62 0 2024-09-13T02:52:49.498 INFO:tasks.workunit.client.0.smithi098.stdout:9/310: dread - d2/d6/d36/f5f zero size 2024-09-13T02:52:49.498 INFO:tasks.workunit.client.1.smithi142.stdout:6/840: dread d1/d7/d19/d30/fa2 [0,4194304] 0 2024-09-13T02:52:49.499 INFO:tasks.workunit.client.0.smithi098.stdout:3/315: unlink d7/d9/f32 0 2024-09-13T02:52:49.501 INFO:tasks.workunit.client.1.smithi142.stdout:3/773: dwrite d12/dd3/f99 [0,4194304] 0 2024-09-13T02:52:49.501 INFO:tasks.workunit.client.1.smithi142.stdout:9/863: write dd/d17/fa1 [1393321,38774] 0 2024-09-13T02:52:49.501 INFO:tasks.workunit.client.1.smithi142.stdout:7/852: chown d10/d13/d1d/d25/d45/d92/ca0 444418891 1 2024-09-13T02:52:49.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/317: chown d2/d2f/d5f/d46 1463702307 1 2024-09-13T02:52:49.502 INFO:tasks.workunit.client.1.smithi142.stdout:3/774: fsync d12/d16/d25/d2e/d38/d4d/f50 0 2024-09-13T02:52:49.503 INFO:tasks.workunit.client.1.smithi142.stdout:7/853: read - d10/d13/d1d/d2b/d56/feb zero size 2024-09-13T02:52:49.504 INFO:tasks.workunit.client.1.smithi142.stdout:3/775: fdatasync d12/d16/d3c/d79/d9b/fd7 0 2024-09-13T02:52:49.510 INFO:tasks.workunit.client.1.smithi142.stdout:7/854: dwrite d10/d13/d1d/d25/d45/d92/ffd [0,4194304] 0 2024-09-13T02:52:49.511 INFO:tasks.workunit.client.0.smithi098.stdout:8/318: dwrite d2/dd/d4d/f57 [0,4194304] 0 2024-09-13T02:52:49.511 INFO:tasks.workunit.client.1.smithi142.stdout:7/855: dread - d10/d34/d57/ff8 zero size 2024-09-13T02:52:49.511 INFO:tasks.workunit.client.0.smithi098.stdout:8/319: dread - d2/d2f/f5b zero size 2024-09-13T02:52:49.512 INFO:tasks.workunit.client.1.smithi142.stdout:7/856: write d10/d64/ff9 [904826,81512] 0 2024-09-13T02:52:49.519 INFO:tasks.workunit.client.0.smithi098.stdout:3/316: mkdir d7/d9/d25/d3a/d5f 0 2024-09-13T02:52:49.521 INFO:tasks.workunit.client.1.smithi142.stdout:6/841: truncate d1/d7/d42/f44 182225 0 2024-09-13T02:52:49.521 INFO:tasks.workunit.client.1.smithi142.stdout:4/771: dwrite d0/df/d57/f53 [0,4194304] 0 2024-09-13T02:52:49.521 INFO:tasks.workunit.client.0.smithi098.stdout:9/311: dread d2/dd/f3b [0,4194304] 0 2024-09-13T02:52:49.522 INFO:tasks.workunit.client.1.smithi142.stdout:8/708: write d0/d6/dc/d40/d4d/d62/f98 [356467,50127] 0 2024-09-13T02:52:49.523 INFO:tasks.workunit.client.0.smithi098.stdout:9/312: write d2/dd/f17 [481318,103679] 0 2024-09-13T02:52:49.526 INFO:tasks.workunit.client.0.smithi098.stdout:8/320: rmdir d2/d2f/d5f 39 2024-09-13T02:52:49.526 INFO:tasks.workunit.client.1.smithi142.stdout:0/838: link d10/d6c/d88/d1a/d1e/l75 d10/d6c/d88/d21/d8f/de1/l117 0 2024-09-13T02:52:49.527 INFO:tasks.workunit.client.1.smithi142.stdout:3/776: rmdir d12/d16/d25/d2e/d38/d4d/d53 39 2024-09-13T02:52:49.533 INFO:tasks.workunit.client.1.smithi142.stdout:3/777: chown d12/d16/d25/d2e/d38/d5a/l97 5256 1 2024-09-13T02:52:49.533 INFO:tasks.workunit.client.1.smithi142.stdout:0/839: chown d10/d6c/d88/d1a/d1e/d42/d4b/d85/cd2 2 1 2024-09-13T02:52:49.533 INFO:tasks.workunit.client.1.smithi142.stdout:4/772: dread d0/d2b/d21/d35/f83 [0,4194304] 0 2024-09-13T02:52:49.533 INFO:tasks.workunit.client.1.smithi142.stdout:5/836: dwrite d8/dc3/d64/d68/f77 [0,4194304] 0 2024-09-13T02:52:49.534 INFO:tasks.workunit.client.0.smithi098.stdout:9/313: mknod d2/d6/d36/c6e 0 2024-09-13T02:52:49.535 INFO:tasks.workunit.client.0.smithi098.stdout:9/314: chown d2/dd/d39/d43/f4c 48548 1 2024-09-13T02:52:49.536 INFO:tasks.workunit.client.1.smithi142.stdout:4/773: fsync d0/d2b/d21/d30/fa8 0 2024-09-13T02:52:49.537 INFO:tasks.workunit.client.1.smithi142.stdout:7/857: dread - d10/d13/d1d/d2b/d55/f4f zero size 2024-09-13T02:52:49.537 INFO:tasks.workunit.client.0.smithi098.stdout:8/321: write d2/f1b [9262634,130944] 0 2024-09-13T02:52:49.539 INFO:tasks.workunit.client.0.smithi098.stdout:3/317: creat d7/d9/d25/d3a/d5f/f60 x:0 0 0 2024-09-13T02:52:49.543 INFO:tasks.workunit.client.1.smithi142.stdout:6/842: fdatasync d1/dd/f49 0 2024-09-13T02:52:49.544 INFO:tasks.workunit.client.0.smithi098.stdout:1/382: sync 2024-09-13T02:52:49.545 INFO:tasks.workunit.client.1.smithi142.stdout:9/864: unlink dd/d17/d69/d84/l111 0 2024-09-13T02:52:49.549 INFO:tasks.workunit.client.1.smithi142.stdout:8/709: rename d0/d6/dc/d45/d9d/faf to d0/d80/d8c/dc9/fe7 0 2024-09-13T02:52:49.549 INFO:tasks.workunit.client.1.smithi142.stdout:1/817: write d12/d13/d20/f5c [858045,93846] 0 2024-09-13T02:52:49.550 INFO:tasks.workunit.client.0.smithi098.stdout:3/318: creat d7/d9/d15/d2d/d34/f61 x:0 0 0 2024-09-13T02:52:49.556 INFO:tasks.workunit.client.0.smithi098.stdout:1/383: fdatasync d9/d33/d19/d35/d68/f18 0 2024-09-13T02:52:49.558 INFO:tasks.workunit.client.1.smithi142.stdout:0/840: creat d10/d6c/d88/d1a/d1e/dc6/f118 x:0 0 0 2024-09-13T02:52:49.565 INFO:tasks.workunit.client.0.smithi098.stdout:2/308: dwrite d1/d1f/d39/f21 [0,4194304] 0 2024-09-13T02:52:49.565 INFO:tasks.workunit.client.0.smithi098.stdout:1/384: dwrite d9/d33/d19/d35/d68/d2f/f49 [0,4194304] 0 2024-09-13T02:52:49.571 INFO:tasks.workunit.client.0.smithi098.stdout:8/322: dread d2/f4e [0,4194304] 0 2024-09-13T02:52:49.578 INFO:tasks.workunit.client.0.smithi098.stdout:3/319: symlink d7/d9/l62 0 2024-09-13T02:52:49.580 INFO:tasks.workunit.client.1.smithi142.stdout:9/865: creat dd/d98/f13a x:0 0 0 2024-09-13T02:52:49.582 INFO:tasks.workunit.client.1.smithi142.stdout:1/818: mkdir d12/d13/d20/d66/d7d/df5/d26/d4f/d102 0 2024-09-13T02:52:49.583 INFO:tasks.workunit.client.1.smithi142.stdout:1/819: fsync d12/d13/d20/d66/ff0 0 2024-09-13T02:52:49.585 INFO:tasks.workunit.client.1.smithi142.stdout:3/778: creat d12/d16/d25/d2e/d38/d4d/d53/d78/ff3 x:0 0 0 2024-09-13T02:52:49.588 INFO:tasks.workunit.client.1.smithi142.stdout:0/841: mkdir d10/d6c/d88/d1a/d1e/d42/d4b/d119 0 2024-09-13T02:52:49.588 INFO:tasks.workunit.client.0.smithi098.stdout:9/315: write d2/d6/d2b/d4d/f5d [2210604,128733] 0 2024-09-13T02:52:49.592 INFO:tasks.workunit.client.0.smithi098.stdout:1/385: mkdir d9/d33/d19/d35/d5a/d5f/d8e 0 2024-09-13T02:52:49.596 INFO:tasks.workunit.client.1.smithi142.stdout:4/774: mkdir d0/d2b/d2d/d31/d43/d48/dcc/df9 0 2024-09-13T02:52:49.597 INFO:tasks.workunit.client.0.smithi098.stdout:9/316: dwrite d2/f28 [0,4194304] 0 2024-09-13T02:52:49.597 INFO:tasks.workunit.client.0.smithi098.stdout:9/317: readlink d2/dd/l13 0 2024-09-13T02:52:49.597 INFO:tasks.workunit.client.0.smithi098.stdout:2/309: link d1/d1a/f3a d1/d1a/d9/d1e/d5a/f60 0 2024-09-13T02:52:49.602 INFO:tasks.workunit.client.0.smithi098.stdout:9/318: dwrite d2/d6/d2b/d4d/f5d [0,4194304] 0 2024-09-13T02:52:49.606 INFO:tasks.workunit.client.1.smithi142.stdout:6/843: read d1/dd/d16/f10a [1514252,94182] 0 2024-09-13T02:52:49.609 INFO:tasks.workunit.client.1.smithi142.stdout:9/866: rmdir dd/d17/d25 39 2024-09-13T02:52:49.611 INFO:tasks.workunit.client.1.smithi142.stdout:9/867: dread - dd/d17/d44/dfa/f135 zero size 2024-09-13T02:52:49.615 INFO:tasks.workunit.client.1.smithi142.stdout:1/820: mknod d12/d13/d20/d66/d7d/df5/d26/d4f/d72/c103 0 2024-09-13T02:52:49.615 INFO:tasks.workunit.client.1.smithi142.stdout:2/685: sync 2024-09-13T02:52:49.617 INFO:tasks.workunit.client.1.smithi142.stdout:2/686: write d1/de/da6/dbb/d92/fbf [21871,78265] 0 2024-09-13T02:52:49.618 INFO:tasks.workunit.client.0.smithi098.stdout:2/310: rmdir d1/d1f/d35 39 2024-09-13T02:52:49.621 INFO:tasks.workunit.client.1.smithi142.stdout:0/842: write d10/dbf/fd4 [4274867,70197] 0 2024-09-13T02:52:49.621 INFO:tasks.workunit.client.0.smithi098.stdout:3/320: creat d7/d9/d15/f63 x:0 0 0 2024-09-13T02:52:49.623 INFO:tasks.workunit.client.0.smithi098.stdout:9/319: truncate d2/d6/f19 1420559 0 2024-09-13T02:52:49.624 INFO:tasks.workunit.client.1.smithi142.stdout:4/775: mknod d0/dc8/cfa 0 2024-09-13T02:52:49.625 INFO:tasks.workunit.client.1.smithi142.stdout:5/837: write d8/d47/d65/da0/dd1/d45/d81/d82/f10e [5564444,98802] 0 2024-09-13T02:52:49.629 INFO:tasks.workunit.client.0.smithi098.stdout:1/386: rename d9/d33/d19/d35/d5a to d9/d33/d19/d2c/d51/d8f 0 2024-09-13T02:52:49.630 INFO:tasks.workunit.client.1.smithi142.stdout:6/844: rmdir d1/dd/d53 39 2024-09-13T02:52:49.630 INFO:tasks.workunit.client.0.smithi098.stdout:1/387: chown d9/f55 1937484976 1 2024-09-13T02:52:49.631 INFO:tasks.workunit.client.0.smithi098.stdout:1/388: write d9/d33/f66 [234289,1788] 0 2024-09-13T02:52:49.631 INFO:tasks.workunit.client.0.smithi098.stdout:9/320: unlink d2/d6/f1c 0 2024-09-13T02:52:49.634 INFO:tasks.workunit.client.0.smithi098.stdout:3/321: mkdir d7/d9/d25/d64 0 2024-09-13T02:52:49.637 INFO:tasks.workunit.client.0.smithi098.stdout:9/321: mknod d2/d6/d2b/d4d/d56/c6f 0 2024-09-13T02:52:49.638 INFO:tasks.workunit.client.0.smithi098.stdout:9/322: readlink d2/l2c 0 2024-09-13T02:52:49.639 INFO:tasks.workunit.client.0.smithi098.stdout:2/311: creat d1/d1f/d27/f61 x:0 0 0 2024-09-13T02:52:49.641 INFO:tasks.workunit.client.1.smithi142.stdout:4/776: symlink d0/dc8/lfb 0 2024-09-13T02:52:49.643 INFO:tasks.workunit.client.1.smithi142.stdout:7/858: getdents d10/d13/d1d/d2b/d56/d5f/d73 0 2024-09-13T02:52:49.644 INFO:tasks.workunit.client.1.smithi142.stdout:7/859: chown d10/d13/d1d/d2b/d55/d32/d8c/df1 3 1 2024-09-13T02:52:49.645 INFO:tasks.workunit.client.0.smithi098.stdout:1/389: truncate f4 973916 0 2024-09-13T02:52:49.647 INFO:tasks.workunit.client.0.smithi098.stdout:9/323: mknod d2/d6/d2b/d66/c70 0 2024-09-13T02:52:49.649 INFO:tasks.workunit.client.1.smithi142.stdout:6/845: write d1/dd/d53/f73 [9080625,10415] 0 2024-09-13T02:52:49.650 INFO:tasks.workunit.client.0.smithi098.stdout:2/312: readlink d1/d1f/d35/l54 0 2024-09-13T02:52:49.657 INFO:tasks.workunit.client.1.smithi142.stdout:3/779: rename d12/d16/d25/d2e/d48/d5c/fec to d12/d16/d25/d2e/ff4 0 2024-09-13T02:52:49.660 INFO:tasks.workunit.client.1.smithi142.stdout:5/838: write d8/dc3/f41 [185491,27075] 0 2024-09-13T02:52:49.661 INFO:tasks.workunit.client.0.smithi098.stdout:2/313: symlink d1/d1f/d27/l62 0 2024-09-13T02:52:49.662 INFO:tasks.workunit.client.0.smithi098.stdout:2/314: fdatasync d1/d1f/d30/f3e 0 2024-09-13T02:52:49.663 INFO:tasks.workunit.client.1.smithi142.stdout:0/843: creat d10/d6c/d88/d1a/d116/f11a x:0 0 0 2024-09-13T02:52:49.663 INFO:tasks.workunit.client.0.smithi098.stdout:2/315: chown d1/d1a/f7 383981117 1 2024-09-13T02:52:49.664 INFO:tasks.workunit.client.1.smithi142.stdout:4/777: creat d0/d2b/d21/d35/ffc x:0 0 0 2024-09-13T02:52:49.666 INFO:tasks.workunit.client.0.smithi098.stdout:1/390: symlink d9/d33/d19/d35/d68/d2f/l90 0 2024-09-13T02:52:49.667 INFO:tasks.workunit.client.1.smithi142.stdout:8/710: sync 2024-09-13T02:52:49.668 INFO:tasks.workunit.client.0.smithi098.stdout:3/322: dwrite d7/d9/fa [0,4194304] 0 2024-09-13T02:52:49.668 INFO:tasks.workunit.client.1.smithi142.stdout:8/711: write d0/d6/dc/d45/d35/f96 [389804,2408] 0 2024-09-13T02:52:49.673 INFO:tasks.workunit.client.1.smithi142.stdout:2/687: dwrite d1/de/d1f/d13/d59/f6a [0,4194304] 0 2024-09-13T02:52:49.673 INFO:tasks.workunit.client.0.smithi098.stdout:2/316: unlink d1/d1a/dc/d23/f5d 0 2024-09-13T02:52:49.674 INFO:tasks.workunit.client.1.smithi142.stdout:2/688: chown d1/de/f10 10943 1 2024-09-13T02:52:49.675 INFO:tasks.workunit.client.1.smithi142.stdout:1/821: link d12/l24 d12/d13/d20/d66/d7d/df5/d26/d4f/da9/l104 0 2024-09-13T02:52:49.681 INFO:tasks.workunit.client.0.smithi098.stdout:2/317: fdatasync d1/d1a/f3a 0 2024-09-13T02:52:49.683 INFO:tasks.workunit.client.1.smithi142.stdout:0/844: symlink d10/d6c/l11b 0 2024-09-13T02:52:49.684 INFO:tasks.workunit.client.0.smithi098.stdout:3/323: creat d7/d9/d15/d5d/f65 x:0 0 0 2024-09-13T02:52:49.684 INFO:tasks.workunit.client.1.smithi142.stdout:0/845: fdatasync d10/d6c/d88/d1a/d1e/d42/d4b/f114 0 2024-09-13T02:52:49.686 INFO:tasks.workunit.client.0.smithi098.stdout:9/324: getdents d2/d6/d2b 0 2024-09-13T02:52:49.691 INFO:tasks.workunit.client.1.smithi142.stdout:8/712: creat d0/d6/dc/d45/d35/d7e/fe8 x:0 0 0 2024-09-13T02:52:49.691 INFO:tasks.workunit.client.1.smithi142.stdout:8/713: fdatasync d0/f95 0 2024-09-13T02:52:49.691 INFO:tasks.workunit.client.1.smithi142.stdout:0/846: dwrite d10/d6c/d88/d1a/d1e/dc6/fe8 [0,4194304] 0 2024-09-13T02:52:49.692 INFO:tasks.workunit.client.0.smithi098.stdout:1/391: rename d9/d33/d1f/d23/d30/c5d to d9/d33/d29/c91 0 2024-09-13T02:52:49.692 INFO:tasks.workunit.client.0.smithi098.stdout:1/392: chown d9/d33/f22 3 1 2024-09-13T02:52:49.692 INFO:tasks.workunit.client.1.smithi142.stdout:8/714: stat d0/d6/dc/d45/f6a 0 2024-09-13T02:52:49.694 INFO:tasks.workunit.client.1.smithi142.stdout:9/868: getdents dd/d17/d44/d82/d99/daf/dc9/de9 0 2024-09-13T02:52:49.694 INFO:tasks.workunit.client.0.smithi098.stdout:9/325: mkdir d2/d6/d2b/d4d/d4f/d71 0 2024-09-13T02:52:49.700 INFO:tasks.workunit.client.1.smithi142.stdout:2/689: dread - d1/de/f56 zero size 2024-09-13T02:52:49.703 INFO:tasks.workunit.client.1.smithi142.stdout:1/822: dread d12/d13/d20/d66/d7d/df5/d26/d4f/fc7 [0,4194304] 0 2024-09-13T02:52:49.704 INFO:tasks.workunit.client.0.smithi098.stdout:1/393: mknod d9/d33/d19/d35/d68/d4d/c92 0 2024-09-13T02:52:49.705 INFO:tasks.workunit.client.1.smithi142.stdout:1/823: chown d12/cdd 6 1 2024-09-13T02:52:49.705 INFO:tasks.workunit.client.0.smithi098.stdout:9/326: mknod d2/dd/d39/c72 0 2024-09-13T02:52:49.707 INFO:tasks.workunit.client.1.smithi142.stdout:3/780: dwrite d12/d16/d3c/d7d/fbd [0,4194304] 0 2024-09-13T02:52:49.709 INFO:tasks.workunit.client.0.smithi098.stdout:9/327: mkdir d2/dd/d39/d43/d73 0 2024-09-13T02:52:49.710 INFO:tasks.workunit.client.1.smithi142.stdout:3/781: read - d12/d16/d25/d2e/d38/d4d/d53/d78/ff3 zero size 2024-09-13T02:52:49.713 INFO:tasks.workunit.client.0.smithi098.stdout:3/324: dread d7/fc [0,4194304] 0 2024-09-13T02:52:49.713 INFO:tasks.workunit.client.1.smithi142.stdout:4/778: dwrite d0/df/da5/fa6 [0,4194304] 0 2024-09-13T02:52:49.716 INFO:tasks.workunit.client.1.smithi142.stdout:7/860: dwrite d10/d13/d1d/d2b/d40/f5e [4194304,4194304] 0 2024-09-13T02:52:49.716 INFO:tasks.workunit.client.1.smithi142.stdout:4/779: dread - d0/d2b/d2d/d65/f6e zero size 2024-09-13T02:52:49.717 INFO:tasks.workunit.client.0.smithi098.stdout:3/325: truncate f4 5207158 0 2024-09-13T02:52:49.717 INFO:tasks.workunit.client.1.smithi142.stdout:7/861: write d10/d13/d1d/d25/d45/d92/ffd [4599284,56598] 0 2024-09-13T02:52:49.718 INFO:tasks.workunit.client.0.smithi098.stdout:7/515: sync 2024-09-13T02:52:49.720 INFO:tasks.workunit.client.0.smithi098.stdout:3/326: chown d7/d9/d25/f39 126646 1 2024-09-13T02:52:49.725 INFO:tasks.workunit.client.1.smithi142.stdout:0/847: mkdir d10/d6c/d88/d1a/d1e/d42/d4b/d85/d11c 0 2024-09-13T02:52:49.725 INFO:tasks.workunit.client.0.smithi098.stdout:2/318: write d1/d1a/d9/d1e/f47 [333356,66327] 0 2024-09-13T02:52:49.732 INFO:tasks.workunit.client.0.smithi098.stdout:7/516: mkdir d6/d24/d2a/d5a/d4c/da5 0 2024-09-13T02:52:49.733 INFO:tasks.workunit.client.1.smithi142.stdout:8/715: dwrite d0/d80/d8c/dc9/fe7 [0,4194304] 0 2024-09-13T02:52:49.736 INFO:tasks.workunit.client.0.smithi098.stdout:1/394: dread d9/f1c [0,4194304] 0 2024-09-13T02:52:49.737 INFO:tasks.workunit.client.1.smithi142.stdout:8/716: dread d0/d6/d23/f7f [0,4194304] 0 2024-09-13T02:52:49.738 INFO:tasks.workunit.client.1.smithi142.stdout:6/846: link d1/d7/d19/c5d d1/dd/d53/d78/db8/d108/c121 0 2024-09-13T02:52:49.739 INFO:tasks.workunit.client.1.smithi142.stdout:2/690: truncate d1/de/f61 988774 0 2024-09-13T02:52:49.741 INFO:tasks.workunit.client.0.smithi098.stdout:2/319: rename d1/d1a/dc to d1/d1f/d35/d63 0 2024-09-13T02:52:49.743 INFO:tasks.workunit.client.0.smithi098.stdout:9/328: rmdir d2/dd/d39/d43/d73 0 2024-09-13T02:52:49.746 INFO:tasks.workunit.client.0.smithi098.stdout:7/517: mknod d6/d24/d2a/d5a/d86/d65/ca6 0 2024-09-13T02:52:49.748 INFO:tasks.workunit.client.0.smithi098.stdout:3/327: creat d7/d9/d25/d3a/d51/f66 x:0 0 0 2024-09-13T02:52:49.750 INFO:tasks.workunit.client.1.smithi142.stdout:1/824: rename d12/d13/d20/d66/d7d/df5/d26/fa3 to d12/d13/d20/d27/d3c/f105 0 2024-09-13T02:52:49.752 INFO:tasks.workunit.client.0.smithi098.stdout:1/395: mknod d9/d33/d19/d35/d68/d4d/c93 0 2024-09-13T02:52:49.754 INFO:tasks.workunit.client.0.smithi098.stdout:2/320: mkdir d1/d1f/d27/d64 0 2024-09-13T02:52:49.756 INFO:tasks.workunit.client.1.smithi142.stdout:4/780: dread - d0/fb6 zero size 2024-09-13T02:52:49.759 INFO:tasks.workunit.client.0.smithi098.stdout:3/328: rename d7/d9/d15/d2d/d34/f47 to d7/d9/d25/d3a/d5f/f67 0 2024-09-13T02:52:49.760 INFO:tasks.workunit.client.0.smithi098.stdout:5/286: sync 2024-09-13T02:52:49.760 INFO:tasks.workunit.client.0.smithi098.stdout:0/387: sync 2024-09-13T02:52:49.760 INFO:tasks.workunit.client.0.smithi098.stdout:4/301: sync 2024-09-13T02:52:49.761 INFO:tasks.workunit.client.0.smithi098.stdout:8/323: sync 2024-09-13T02:52:49.761 INFO:tasks.workunit.client.0.smithi098.stdout:6/312: sync 2024-09-13T02:52:49.761 INFO:tasks.workunit.client.0.smithi098.stdout:5/287: chown d0/d15 1 1 2024-09-13T02:52:49.762 INFO:tasks.workunit.client.0.smithi098.stdout:0/388: chown l6 386657404 1 2024-09-13T02:52:49.762 INFO:tasks.workunit.client.1.smithi142.stdout:0/848: mkdir d10/d95/d11d 0 2024-09-13T02:52:49.762 INFO:tasks.workunit.client.0.smithi098.stdout:6/313: dread - d5/d13/d2b/f69 zero size 2024-09-13T02:52:49.763 INFO:tasks.workunit.client.1.smithi142.stdout:0/849: stat d10/d6c/d88/d21/d51/d35/l102 0 2024-09-13T02:52:49.765 INFO:tasks.workunit.client.0.smithi098.stdout:5/288: write d0/d29/f39 [4965198,98322] 0 2024-09-13T02:52:49.765 INFO:tasks.workunit.client.0.smithi098.stdout:9/329: symlink d2/l74 0 2024-09-13T02:52:49.769 INFO:tasks.workunit.client.1.smithi142.stdout:8/717: symlink d0/d6/dc/d40/d4d/le9 0 2024-09-13T02:52:49.769 INFO:tasks.workunit.client.1.smithi142.stdout:9/869: write dd/d17/f28 [251977,117577] 0 2024-09-13T02:52:49.772 INFO:tasks.workunit.client.1.smithi142.stdout:2/691: fdatasync d1/de/d31/d6c/d6d/f34 0 2024-09-13T02:52:49.773 INFO:tasks.workunit.client.1.smithi142.stdout:2/692: readlink d1/d2d/lc8 0 2024-09-13T02:52:49.774 INFO:tasks.workunit.client.0.smithi098.stdout:5/289: dwrite d0/d38/f58 [0,4194304] 0 2024-09-13T02:52:49.775 INFO:tasks.workunit.client.0.smithi098.stdout:1/396: mknod d9/d33/d19/d35/d68/c94 0 2024-09-13T02:52:49.775 INFO:tasks.workunit.client.1.smithi142.stdout:5/839: getdents d8/dc3/d3f/ddd 0 2024-09-13T02:52:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.776+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/1923600467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b40fef20 msgr2=0x7ff7b40ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.776+0000 7ff7ba2e6700 1 --2- 172.21.15.98:0/1923600467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b40fef20 0x7ff7b40ff330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009870 tx=0x7ff7b0009b80 comp rx=0 tx=0).stop 2024-09-13T02:52:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.777+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/1923600467 shutdown_connections 2024-09-13T02:52:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.778+0000 7ff7ba2e6700 1 --2- 172.21.15.98:0/1923600467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4100080 0x7ff7b41004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.778+0000 7ff7ba2e6700 1 --2- 172.21.15.98:0/1923600467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b40fef20 0x7ff7b40ff330 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009870 tx=0x7ff7b0009b80 comp rx=0 tx=0).stop 2024-09-13T02:52:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.778+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/1923600467 >> 172.21.15.98:0/1923600467 conn(0x7ff7b40fa4d0 msgr2=0x7ff7b40fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.778+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/1923600467 shutdown_connections 2024-09-13T02:52:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.779+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/1923600467 wait complete. 2024-09-13T02:52:49.783 INFO:tasks.workunit.client.1.smithi142.stdout:7/862: write d10/d13/d1d/f5d [2938445,74070] 0 2024-09-13T02:52:49.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.780+0000 7ff7ba2e6700 1 Processor -- start 2024-09-13T02:52:49.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.780+0000 7ff7ba2e6700 1 -- start start 2024-09-13T02:52:49.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.781+0000 7ff7ba2e6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b4100080 0x7ff7b4193910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:49.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.781+0000 7ff7ba2e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4193e50 0x7ff7b4198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:49.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.781+0000 7ff7b92e4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b4100080 0x7ff7b4193910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:49.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.781+0000 7ff7b92e4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b4100080 0x7ff7b4193910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.98:40656/0 (socket says 172.21.15.98:40656) 2024-09-13T02:52:49.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.781+0000 7ff7b92e4700 1 -- 172.21.15.98:0/2856996868 learned_addr learned my addr 172.21.15.98:0/2856996868 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.781+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b4194350 con 0x7ff7b4193e50 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.781+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b41944c0 con 0x7ff7b4100080 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.781+0000 7ff7b8ae3700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4193e50 0x7ff7b4198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.782+0000 7ff7b92e4700 1 -- 172.21.15.98:0/2856996868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4193e50 msgr2=0x7ff7b4198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.782+0000 7ff7b92e4700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4193e50 0x7ff7b4198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.782+0000 7ff7b92e4700 1 -- 172.21.15.98:0/2856996868 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0009520 con 0x7ff7b4100080 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.782+0000 7ff7b92e4700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b4100080 0x7ff7b4193910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009230 tx=0x7ff7b000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.782+0000 7ff7aa7fc700 1 -- 172.21.15.98:0/2856996868 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b001c070 con 0x7ff7b4100080 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.782+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b4199400 con 0x7ff7b4100080 2024-09-13T02:52:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.782+0000 7ff7aa7fc700 1 -- 172.21.15.98:0/2856996868 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff7b000b4e0 con 0x7ff7b4100080 2024-09-13T02:52:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.783+0000 7ff7aa7fc700 1 -- 172.21.15.98:0/2856996868 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b0022d90 con 0x7ff7b4100080 2024-09-13T02:52:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.783+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b4199800 con 0x7ff7b4100080 2024-09-13T02:52:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.785+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b41068c0 con 0x7ff7b4100080 2024-09-13T02:52:49.786 INFO:tasks.workunit.client.0.smithi098.stdout:1/397: dwrite d9/d33/d19/d35/d63/f77 [0,4194304] 0 2024-09-13T02:52:49.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.785+0000 7ff7aa7fc700 1 -- 172.21.15.98:0/2856996868 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7ff7b0020070 con 0x7ff7b4100080 2024-09-13T02:52:49.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.785+0000 7ff7aa7fc700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff7a006d3e0 0x7ff7a006f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:49.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.786+0000 7ff7aa7fc700 1 -- 172.21.15.98:0/2856996868 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff7b008db70 con 0x7ff7b4100080 2024-09-13T02:52:49.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.786+0000 7ff7b8ae3700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff7a006d3e0 0x7ff7a006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:49.788 INFO:tasks.workunit.client.1.smithi142.stdout:7/863: dread d10/d13/d1d/f2d [0,4194304] 0 2024-09-13T02:52:49.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.787+0000 7ff7b8ae3700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff7a006d3e0 0x7ff7a006f890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4005fd0 tx=0x7ff7a400f040 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:49.789 INFO:tasks.workunit.client.0.smithi098.stdout:7/518: dwrite d6/d24/d2a/d5a/f38 [0,4194304] 0 2024-09-13T02:52:49.791 INFO:tasks.workunit.client.0.smithi098.stdout:4/302: mkdir d6/d22/d3d/d6c 0 2024-09-13T02:52:49.795 INFO:tasks.workunit.client.1.smithi142.stdout:0/850: rmdir d10/d6c/d88/d21/d51/d35/d9b 39 2024-09-13T02:52:49.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:49.794+0000 7ff7aa7fc700 1 -- 172.21.15.98:0/2856996868 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff7b005aef0 con 0x7ff7b4100080 2024-09-13T02:52:49.797 INFO:tasks.workunit.client.0.smithi098.stdout:8/324: rename d2/dd/d11/d49/l53 to d2/dd/d2e/l61 0 2024-09-13T02:52:49.799 INFO:tasks.workunit.client.1.smithi142.stdout:8/718: creat d0/d75/fea x:0 0 0 2024-09-13T02:52:49.799 INFO:tasks.workunit.client.0.smithi098.stdout:8/325: write d2/dd/d11/d1d/f3a [4329042,16031] 0 2024-09-13T02:52:49.799 INFO:tasks.workunit.client.0.smithi098.stdout:3/329: creat d7/d9/d25/d64/f68 x:0 0 0 2024-09-13T02:52:49.800 INFO:tasks.workunit.client.0.smithi098.stdout:8/326: chown d2/dd/d11/l12 2 1 2024-09-13T02:52:49.803 INFO:tasks.workunit.client.1.smithi142.stdout:3/782: dwrite d12/d16/d25/d2e/d48/d5c/d8c/daf/fbe [0,4194304] 0 2024-09-13T02:52:49.805 INFO:tasks.workunit.client.1.smithi142.stdout:5/840: rmdir d8/dc3/d64 39 2024-09-13T02:52:49.808 INFO:tasks.workunit.client.1.smithi142.stdout:1/825: mkdir d12/d13/d20/d66/d7d/df5/d106 0 2024-09-13T02:52:49.810 INFO:tasks.workunit.client.0.smithi098.stdout:1/398: creat d9/d33/d19/d35/f95 x:0 0 0 2024-09-13T02:52:49.811 INFO:tasks.workunit.client.0.smithi098.stdout:1/399: write d9/d33/d29/d58/f82 [931379,117624] 0 2024-09-13T02:52:49.813 INFO:tasks.workunit.client.0.smithi098.stdout:4/303: stat d6/d37/c51 0 2024-09-13T02:52:49.815 INFO:tasks.workunit.client.1.smithi142.stdout:6/847: creat d1/d7/f122 x:0 0 0 2024-09-13T02:52:49.818 INFO:tasks.workunit.client.0.smithi098.stdout:9/330: rename d2/dd/f20 to d2/d6/d2b/d66/f75 0 2024-09-13T02:52:49.818 INFO:tasks.workunit.client.0.smithi098.stdout:9/331: chown d2/d6/f42 43990772 1 2024-09-13T02:52:49.819 INFO:tasks.workunit.client.1.smithi142.stdout:8/719: write d0/d6/dc/d45/d8/f9c [2476678,79852] 0 2024-09-13T02:52:49.826 INFO:tasks.workunit.client.1.smithi142.stdout:9/870: rename dd/d87/def/l128 to dd/d17/d44/d82/d99/daf/dc9/de9/df5/l13b 0 2024-09-13T02:52:49.827 INFO:tasks.workunit.client.1.smithi142.stdout:9/871: chown dd/d17/d44/d82/d99/daf/dc9/fd6 325083 1 2024-09-13T02:52:49.829 INFO:tasks.workunit.client.0.smithi098.stdout:2/321: getdents d1/d1f/d36 0 2024-09-13T02:52:49.830 INFO:tasks.workunit.client.0.smithi098.stdout:6/314: truncate d5/f1e 292626 0 2024-09-13T02:52:49.831 INFO:tasks.workunit.client.1.smithi142.stdout:2/693: mkdir d1/dd9 0 2024-09-13T02:52:49.833 INFO:tasks.workunit.client.0.smithi098.stdout:0/389: symlink dd/df/d1d/d40/d46/l84 0 2024-09-13T02:52:49.837 INFO:tasks.workunit.client.0.smithi098.stdout:0/390: dread dd/df/d1d/d26/f44 [0,4194304] 0 2024-09-13T02:52:49.841 INFO:tasks.workunit.client.0.smithi098.stdout:3/330: dwrite d7/d9/f31 [0,4194304] 0 2024-09-13T02:52:49.843 INFO:tasks.workunit.client.1.smithi142.stdout:3/783: dwrite d12/d16/d3c/d79/fab [0,4194304] 0 2024-09-13T02:52:49.845 INFO:tasks.workunit.client.0.smithi098.stdout:4/304: dread d6/db/f29 [0,4194304] 0 2024-09-13T02:52:49.846 INFO:tasks.workunit.client.1.smithi142.stdout:4/781: truncate d0/fb5 2656828 0 2024-09-13T02:52:49.848 INFO:tasks.workunit.client.1.smithi142.stdout:8/720: symlink d0/d6/dc/d40/d41/leb 0 2024-09-13T02:52:49.849 INFO:tasks.workunit.client.0.smithi098.stdout:9/332: mknod d2/d6/d2b/d4d/d4f/c76 0 2024-09-13T02:52:49.850 INFO:tasks.workunit.client.1.smithi142.stdout:8/721: fsync d0/d6/dc/d45/d8/df/f9f 0 2024-09-13T02:52:49.850 INFO:tasks.workunit.client.1.smithi142.stdout:0/851: truncate d10/d6c/d88/d45/f56 3024069 0 2024-09-13T02:52:49.850 INFO:tasks.workunit.client.0.smithi098.stdout:9/333: chown d2/d6/l3c 1026581 1 2024-09-13T02:52:49.851 INFO:tasks.workunit.client.1.smithi142.stdout:8/722: readlink d0/d6/dc/d40/d46/da1/lb3 0 2024-09-13T02:52:49.852 INFO:tasks.workunit.client.1.smithi142.stdout:7/864: rename d10/d13/d1d/d2b/d56/d39/cef to d10/d34/c116 0 2024-09-13T02:52:49.852 INFO:tasks.workunit.client.1.smithi142.stdout:8/723: fsync d0/d6/dc/d45/d8/df/f99 0 2024-09-13T02:52:49.853 INFO:tasks.workunit.client.1.smithi142.stdout:7/865: read - d10/d13/d1d/d2b/d56/d5f/d73/fbe zero size 2024-09-13T02:52:49.853 INFO:tasks.workunit.client.1.smithi142.stdout:9/872: mkdir dd/d17/d68/d13c 0 2024-09-13T02:52:49.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/724: write d0/d75/fea [163359,100277] 0 2024-09-13T02:52:49.854 INFO:tasks.workunit.client.0.smithi098.stdout:5/290: link d0/d15/d17/d1c/l5e d0/l68 0 2024-09-13T02:52:49.855 INFO:tasks.workunit.client.0.smithi098.stdout:6/315: mkdir d5/d13/d51/d70 0 2024-09-13T02:52:49.856 INFO:tasks.workunit.client.1.smithi142.stdout:2/694: creat d1/de/da6/dbb/dc2/fda x:0 0 0 2024-09-13T02:52:49.857 INFO:tasks.workunit.client.0.smithi098.stdout:5/291: truncate d0/d38/d3f/d1a/f67 933752 0 2024-09-13T02:52:49.860 INFO:tasks.workunit.client.1.smithi142.stdout:6/848: mknod d1/d7/d19/d48/d90/d11e/c123 0 2024-09-13T02:52:49.866 INFO:tasks.workunit.client.0.smithi098.stdout:3/331: creat d7/d9/d25/d3a/d51/f69 x:0 0 0 2024-09-13T02:52:49.871 INFO:tasks.workunit.client.0.smithi098.stdout:8/327: creat d2/d2f/f62 x:0 0 0 2024-09-13T02:52:49.872 INFO:tasks.workunit.client.1.smithi142.stdout:8/725: mkdir d0/da2/dec 0 2024-09-13T02:52:49.876 INFO:tasks.workunit.client.1.smithi142.stdout:7/866: unlink d10/d13/d1d/d25/l101 0 2024-09-13T02:52:49.876 INFO:tasks.workunit.client.1.smithi142.stdout:7/867: stat d10/d13 0 2024-09-13T02:52:49.878 INFO:tasks.workunit.client.0.smithi098.stdout:8/328: dwrite d2/d2f/f5b [0,4194304] 0 2024-09-13T02:52:49.879 INFO:tasks.workunit.client.0.smithi098.stdout:1/400: write d9/d33/d19/f21 [726202,90381] 0 2024-09-13T02:52:49.880 INFO:tasks.workunit.client.0.smithi098.stdout:5/292: rmdir d0/d15/d17/d1c 39 2024-09-13T02:52:49.882 INFO:tasks.workunit.client.0.smithi098.stdout:5/293: write d0/d38/d3f/f11 [4692651,35530] 0 2024-09-13T02:52:49.886 INFO:tasks.workunit.client.1.smithi142.stdout:1/826: creat d12/d13/d20/d66/d55/f107 x:0 0 0 2024-09-13T02:52:49.888 INFO:tasks.workunit.client.1.smithi142.stdout:6/849: dread - d1/dd/d53/d78/d104/dad/fea zero size 2024-09-13T02:52:49.889 INFO:tasks.workunit.client.0.smithi098.stdout:0/391: dwrite dd/df/d1d/f33 [0,4194304] 0 2024-09-13T02:52:49.889 INFO:tasks.workunit.client.0.smithi098.stdout:7/519: getdents d6/d24/d2a/d57 0 2024-09-13T02:52:49.889 INFO:tasks.workunit.client.0.smithi098.stdout:7/520: readlink d6/l3b 0 2024-09-13T02:52:49.889 INFO:tasks.workunit.client.0.smithi098.stdout:1/401: dread d9/d33/d29/d58/f82 [0,4194304] 0 2024-09-13T02:52:49.891 INFO:tasks.workunit.client.0.smithi098.stdout:3/332: unlink d7/f1d 0 2024-09-13T02:52:49.892 INFO:tasks.workunit.client.0.smithi098.stdout:3/333: chown d7/d9/d25/d3a/d5f 27 1 2024-09-13T02:52:49.894 INFO:tasks.workunit.client.1.smithi142.stdout:2/695: dread d1/d42/d44/f5b [0,4194304] 0 2024-09-13T02:52:49.897 INFO:tasks.workunit.client.1.smithi142.stdout:5/841: rename d8/d47/d65/da0/dd1/d45/d62/cff to d8/d47/d65/da0/dd1/d45/c10f 0 2024-09-13T02:52:49.902 INFO:tasks.workunit.client.1.smithi142.stdout:1/827: fsync fe 0 2024-09-13T02:52:49.911 INFO:tasks.workunit.client.1.smithi142.stdout:0/852: rename d10/d6c/d88/d21/daf/lbd to d10/d6c/d88/d21/d51/d35/d9b/da5/l11e 0 2024-09-13T02:52:49.916 INFO:tasks.workunit.client.0.smithi098.stdout:0/392: mkdir dd/d1f/d85 0 2024-09-13T02:52:49.918 INFO:tasks.workunit.client.0.smithi098.stdout:8/329: dread f1 [0,4194304] 0 2024-09-13T02:52:49.918 INFO:tasks.workunit.client.0.smithi098.stdout:0/393: chown dd/df/d1d/d26/d28/d32/f4d 25975 1 2024-09-13T02:52:49.918 INFO:tasks.workunit.client.1.smithi142.stdout:9/873: rmdir dd/d17/d44/d95/dd1/ddf/d113 0 2024-09-13T02:52:49.919 INFO:tasks.workunit.client.1.smithi142.stdout:5/842: dread d8/d47/d65/da0/dd1/d45/d81/d8c/fa6 [0,4194304] 0 2024-09-13T02:52:49.919 INFO:tasks.workunit.client.0.smithi098.stdout:0/394: write dd/df/f3d [350890,98186] 0 2024-09-13T02:52:49.919 INFO:tasks.workunit.client.0.smithi098.stdout:1/402: rmdir d9/d33/d19/d35/d68/d2f 39 2024-09-13T02:52:49.920 INFO:tasks.workunit.client.0.smithi098.stdout:1/403: stat d9/d33/d29/d58 0 2024-09-13T02:52:49.922 INFO:tasks.workunit.client.1.smithi142.stdout:4/782: write d0/d2b/d2d/d31/f8b [3388700,50929] 0 2024-09-13T02:52:49.926 INFO:tasks.workunit.client.0.smithi098.stdout:9/334: rmdir d2/d6/d2b/d4d/d4f/d71 0 2024-09-13T02:52:49.927 INFO:tasks.workunit.client.0.smithi098.stdout:6/316: write d5/d18/f45 [16002,7847] 0 2024-09-13T02:52:49.928 INFO:tasks.workunit.client.0.smithi098.stdout:9/335: stat d2/f69 0 2024-09-13T02:52:49.928 INFO:tasks.workunit.client.0.smithi098.stdout:3/334: dwrite d7/fc [4194304,4194304] 0 2024-09-13T02:52:49.928 INFO:tasks.workunit.client.1.smithi142.stdout:3/784: getdents d12 0 2024-09-13T02:52:49.929 INFO:tasks.workunit.client.0.smithi098.stdout:6/317: truncate d5/d18/f3c 1300462 0 2024-09-13T02:52:49.930 INFO:tasks.workunit.client.1.smithi142.stdout:2/696: symlink d1/de/d1f/d13/d60/da9/ldb 0 2024-09-13T02:52:49.933 INFO:tasks.workunit.client.1.smithi142.stdout:0/853: rmdir d10/d6c/d88/d1a/d1e/d42/d4b/d85 39 2024-09-13T02:52:49.934 INFO:tasks.workunit.client.1.smithi142.stdout:0/854: fsync d10/d23/f25 0 2024-09-13T02:52:49.935 INFO:tasks.workunit.client.0.smithi098.stdout:5/294: mkdir d0/d15/d69 0 2024-09-13T02:52:49.939 INFO:tasks.workunit.client.0.smithi098.stdout:7/521: write d6/d24/d46/f64 [3154499,42106] 0 2024-09-13T02:52:49.941 INFO:tasks.workunit.client.1.smithi142.stdout:9/874: rename dd/d17/l1e to dd/d17/d69/l13d 0 2024-09-13T02:52:49.941 INFO:tasks.workunit.client.0.smithi098.stdout:7/522: write f5 [5208020,5128] 0 2024-09-13T02:52:49.943 INFO:tasks.workunit.client.0.smithi098.stdout:7/523: stat d6/d24/d2a/d5a/f1d 0 2024-09-13T02:52:49.944 INFO:tasks.workunit.client.1.smithi142.stdout:4/783: readlink d0/d2b/d2d/l7b 0 2024-09-13T02:52:49.944 INFO:tasks.workunit.client.0.smithi098.stdout:5/295: dwrite d0/d38/d3f/d1a/f67 [0,4194304] 0 2024-09-13T02:52:49.947 INFO:tasks.workunit.client.0.smithi098.stdout:7/524: read d6/d24/d2a/d5a/d86/f8d [4014021,23176] 0 2024-09-13T02:52:49.948 INFO:tasks.workunit.client.1.smithi142.stdout:3/785: mknod d12/d16/d3c/d79/d9b/dc1/cf5 0 2024-09-13T02:52:49.949 INFO:tasks.workunit.client.0.smithi098.stdout:1/404: creat d9/d33/d1f/d6b/d7c/f96 x:0 0 0 2024-09-13T02:52:49.950 INFO:tasks.workunit.client.1.smithi142.stdout:2/697: truncate d1/de/d31/f7f 378644 0 2024-09-13T02:52:49.950 INFO:tasks.workunit.client.1.smithi142.stdout:2/698: fsync d1/de/da6/dbb/fa2 0 2024-09-13T02:52:49.953 INFO:tasks.workunit.client.0.smithi098.stdout:6/318: rename d5/d13/d2b/d3a/d41/d6c/l6d to d5/d13/d2b/d3a/d5a/l71 0 2024-09-13T02:52:49.956 INFO:tasks.workunit.client.1.smithi142.stdout:4/784: stat d0/f4c 0 2024-09-13T02:52:49.960 INFO:tasks.workunit.client.0.smithi098.stdout:8/330: creat d2/dd/d11/d44/f63 x:0 0 0 2024-09-13T02:52:49.962 INFO:tasks.workunit.client.1.smithi142.stdout:9/875: dread dd/f7e [0,4194304] 0 2024-09-13T02:52:49.964 INFO:tasks.workunit.client.1.smithi142.stdout:2/699: read d1/de/f23 [3092050,30273] 0 2024-09-13T02:52:49.967 INFO:tasks.workunit.client.0.smithi098.stdout:3/335: mknod d7/d9/d15/c6a 0 2024-09-13T02:52:49.968 INFO:tasks.workunit.client.1.smithi142.stdout:1/828: link d12/l82 d12/d13/l108 0 2024-09-13T02:52:49.972 INFO:tasks.workunit.client.1.smithi142.stdout:5/843: dread d8/d47/d65/da0/dd1/d2d/d90/fa1 [0,4194304] 0 2024-09-13T02:52:49.972 INFO:tasks.workunit.client.1.smithi142.stdout:2/700: dread d1/de/d31/f3d [4194304,4194304] 0 2024-09-13T02:52:49.974 INFO:tasks.workunit.client.0.smithi098.stdout:3/336: dwrite d7/d9/d25/d64/f68 [0,4194304] 0 2024-09-13T02:52:49.975 INFO:tasks.workunit.client.0.smithi098.stdout:1/405: rename d9/d33/d29/l37 to d9/d33/d19/d35/d68/d60/l97 0 2024-09-13T02:52:49.979 INFO:tasks.workunit.client.1.smithi142.stdout:9/876: unlink dd/l94 0 2024-09-13T02:52:49.980 INFO:tasks.workunit.client.0.smithi098.stdout:0/395: creat dd/f86 x:0 0 0 2024-09-13T02:52:49.980 INFO:tasks.workunit.client.1.smithi142.stdout:9/877: chown dd/d17/d44/d82/d99/da8 87901 1 2024-09-13T02:52:49.981 INFO:tasks.workunit.client.0.smithi098.stdout:0/396: chown dd/df/d1d/d26/d28/l77 246703151 1 2024-09-13T02:52:49.989 INFO:tasks.workunit.client.0.smithi098.stdout:7/525: mknod d6/d24/d2a/d5a/d42/d45/ca7 0 2024-09-13T02:52:49.990 INFO:tasks.workunit.client.1.smithi142.stdout:1/829: write d12/fec [17833,4785] 0 2024-09-13T02:52:49.991 INFO:tasks.workunit.client.1.smithi142.stdout:1/830: chown d12/d13/d20/d66/d7d/df5/d26 92 1 2024-09-13T02:52:49.995 INFO:tasks.workunit.client.1.smithi142.stdout:2/701: mknod d1/de/d31/d6c/d6d/db6/cdc 0 2024-09-13T02:52:49.996 INFO:tasks.workunit.client.0.smithi098.stdout:7/526: dwrite f5 [8388608,4194304] 0 2024-09-13T02:52:49.998 INFO:tasks.workunit.client.1.smithi142.stdout:0/855: getdents d10/d6c/d88/d21 0 2024-09-13T02:52:50.000 INFO:tasks.workunit.client.0.smithi098.stdout:1/406: rmdir d9/d33/d19 39 2024-09-13T02:52:50.001 INFO:tasks.workunit.client.1.smithi142.stdout:9/878: symlink dd/dcb/l13e 0 2024-09-13T02:52:50.004 INFO:tasks.workunit.client.0.smithi098.stdout:8/331: creat d2/d2f/d5f/f64 x:0 0 0 2024-09-13T02:52:50.004 INFO:tasks.workunit.client.1.smithi142.stdout:3/786: truncate d12/f13 2517448 0 2024-09-13T02:52:50.006 INFO:tasks.workunit.client.0.smithi098.stdout:0/397: truncate fc 6696791 0 2024-09-13T02:52:50.007 INFO:tasks.workunit.client.0.smithi098.stdout:0/398: truncate dd/f10 4825901 0 2024-09-13T02:52:50.008 INFO:tasks.workunit.client.0.smithi098.stdout:0/399: chown dd/f2d 1 1 2024-09-13T02:52:50.011 INFO:tasks.workunit.client.0.smithi098.stdout:5/296: truncate d0/d15/d17/f44 883891 0 2024-09-13T02:52:50.012 INFO:tasks.workunit.client.1.smithi142.stdout:1/831: dread - d12/d13/fce zero size 2024-09-13T02:52:50.012 INFO:tasks.workunit.client.1.smithi142.stdout:1/832: stat d12/d13/d45/fa8 0 2024-09-13T02:52:50.013 INFO:tasks.workunit.client.0.smithi098.stdout:5/297: read d0/d38/d3f/f36 [843435,36733] 0 2024-09-13T02:52:50.014 INFO:tasks.workunit.client.0.smithi098.stdout:5/298: fsync d0/d38/f55 0 2024-09-13T02:52:50.014 INFO:tasks.workunit.client.0.smithi098.stdout:9/336: rename d2/dd/f17 to d2/d6/d36/f77 0 2024-09-13T02:52:50.015 INFO:tasks.workunit.client.1.smithi142.stdout:4/785: dwrite d0/f8e [0,4194304] 0 2024-09-13T02:52:50.016 INFO:tasks.workunit.client.0.smithi098.stdout:5/299: dread d0/d38/d3f/d1a/d32/f33 [0,4194304] 0 2024-09-13T02:52:50.017 INFO:tasks.workunit.client.1.smithi142.stdout:5/844: creat d8/dc3/df3/dc6/de2/d10a/f110 x:0 0 0 2024-09-13T02:52:50.017 INFO:tasks.workunit.client.1.smithi142.stdout:4/786: read d0/f9b [1230326,72004] 0 2024-09-13T02:52:50.019 INFO:tasks.workunit.client.1.smithi142.stdout:5/845: fsync d8/d47/d65/da0/dd1/d2d/d90/fee 0 2024-09-13T02:52:50.019 INFO:tasks.workunit.client.1.smithi142.stdout:2/702: truncate d1/f8c 379351 0 2024-09-13T02:52:50.022 INFO:tasks.workunit.client.1.smithi142.stdout:0/856: unlink d10/d6c/d88/d1a/d3a/fce 0 2024-09-13T02:52:50.023 INFO:tasks.workunit.client.1.smithi142.stdout:0/857: write d10/d6c/d88/d21/d51/d35/f53 [2060023,112370] 0 2024-09-13T02:52:50.023 INFO:tasks.workunit.client.0.smithi098.stdout:3/337: creat d7/d9/d15/d2d/f6b x:0 0 0 2024-09-13T02:52:50.025 INFO:tasks.workunit.client.1.smithi142.stdout:0/858: read d10/d6c/d88/f6e [1223595,112847] 0 2024-09-13T02:52:50.027 INFO:tasks.workunit.client.1.smithi142.stdout:8/726: sync 2024-09-13T02:52:50.028 INFO:tasks.workunit.client.1.smithi142.stdout:8/727: write d0/d6/dc/d45/d35/fa4 [1185774,55912] 0 2024-09-13T02:52:50.034 INFO:tasks.workunit.client.0.smithi098.stdout:9/337: unlink d2/f28 0 2024-09-13T02:52:50.036 INFO:tasks.workunit.client.0.smithi098.stdout:9/338: chown d2/d6/d2b/d66/l67 2 1 2024-09-13T02:52:50.042 INFO:tasks.workunit.client.0.smithi098.stdout:5/300: mknod d0/d57/c6a 0 2024-09-13T02:52:50.048 INFO:tasks.workunit.client.1.smithi142.stdout:2/703: truncate d1/de/da6/dbb/d6f/f7a 685237 0 2024-09-13T02:52:50.049 INFO:tasks.workunit.client.1.smithi142.stdout:9/879: creat dd/d17/d44/d82/d99/daf/dc9/d103/f13f x:0 0 0 2024-09-13T02:52:50.051 INFO:tasks.workunit.client.0.smithi098.stdout:3/338: creat d7/d9/d25/d3a/f6c x:0 0 0 2024-09-13T02:52:50.052 INFO:tasks.workunit.client.0.smithi098.stdout:5/301: dwrite d0/d15/f5f [0,4194304] 0 2024-09-13T02:52:50.056 INFO:tasks.workunit.client.0.smithi098.stdout:3/339: fdatasync d7/d9/d15/d2d/f42 0 2024-09-13T02:52:50.056 INFO:tasks.workunit.client.0.smithi098.stdout:0/400: dwrite dd/df/f18 [0,4194304] 0 2024-09-13T02:52:50.057 INFO:tasks.workunit.client.1.smithi142.stdout:1/833: write d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/f5d [99080,29137] 0 2024-09-13T02:52:50.058 INFO:tasks.workunit.client.1.smithi142.stdout:1/834: chown d12/f65 777 1 2024-09-13T02:52:50.058 INFO:tasks.workunit.client.0.smithi098.stdout:1/407: dwrite d9/d33/d19/d35/d68/d2f/f48 [0,4194304] 0 2024-09-13T02:52:50.060 INFO:tasks.workunit.client.0.smithi098.stdout:3/340: dread - d7/d9/d25/d3a/d51/f69 zero size 2024-09-13T02:52:50.061 INFO:tasks.workunit.client.0.smithi098.stdout:1/408: write d9/d33/f22 [3720510,48774] 0 2024-09-13T02:52:50.063 INFO:tasks.workunit.client.1.smithi142.stdout:8/728: symlink d0/led 0 2024-09-13T02:52:50.066 INFO:tasks.workunit.client.0.smithi098.stdout:7/527: rename d6/d24/d2a/d5a/f44 to d6/d24/d63/fa8 0 2024-09-13T02:52:50.071 INFO:tasks.workunit.client.1.smithi142.stdout:5/846: mknod d8/dc3/d64/d68/db5/c111 0 2024-09-13T02:52:50.074 INFO:tasks.workunit.client.1.smithi142.stdout:5/847: write d8/d47/d65/da0/dd1/d45/d81/fd5 [568741,67532] 0 2024-09-13T02:52:50.090 INFO:tasks.workunit.client.1.smithi142.stdout:7/868: sync 2024-09-13T02:52:50.090 INFO:tasks.workunit.client.1.smithi142.stdout:6/850: sync 2024-09-13T02:52:50.105 INFO:tasks.workunit.client.1.smithi142.stdout:9/880: creat dd/d17/d4f/d91/f140 x:0 0 0 2024-09-13T02:52:50.107 INFO:tasks.workunit.client.0.smithi098.stdout:5/302: creat d0/d38/d3f/d1a/d27/f6b x:0 0 0 2024-09-13T02:52:50.111 INFO:tasks.workunit.client.1.smithi142.stdout:3/787: creat d12/d16/d25/d2e/d38/d4d/ff6 x:0 0 0 2024-09-13T02:52:50.117 INFO:tasks.workunit.client.1.smithi142.stdout:7/869: dread d10/d13/d1d/f36 [0,4194304] 0 2024-09-13T02:52:50.118 INFO:tasks.workunit.client.1.smithi142.stdout:7/870: read d10/d13/d1d/d25/d5c/da3/da8/fb0 [407040,124570] 0 2024-09-13T02:52:50.119 INFO:tasks.workunit.client.1.smithi142.stdout:4/787: truncate d0/d2b/d2d/d31/d32/daa/fc2 118260 0 2024-09-13T02:52:50.121 INFO:tasks.workunit.client.1.smithi142.stdout:2/704: mknod d1/de/d31/cdd 0 2024-09-13T02:52:50.121 INFO:tasks.workunit.client.1.smithi142.stdout:7/871: dread d10/d13/f108 [0,4194304] 0 2024-09-13T02:52:50.122 INFO:tasks.workunit.client.1.smithi142.stdout:2/705: dread - d1/de/d1f/d13/f89 zero size 2024-09-13T02:52:50.122 INFO:tasks.workunit.client.0.smithi098.stdout:8/332: rename d2/dd/d11/c22 to d2/dd/d2e/c65 0 2024-09-13T02:52:50.123 INFO:tasks.workunit.client.1.smithi142.stdout:2/706: rename d1/de/d1f/d13/d60 to d1/de/d1f/d13/d60/da9/dde 22 2024-09-13T02:52:50.123 INFO:tasks.workunit.client.1.smithi142.stdout:5/848: symlink d8/dc3/d3f/ddd/l112 0 2024-09-13T02:52:50.125 INFO:tasks.workunit.client.1.smithi142.stdout:5/849: dread d8/d47/d65/da0/dd1/d2d/fea [0,4194304] 0 2024-09-13T02:52:50.125 INFO:tasks.workunit.client.0.smithi098.stdout:0/401: write dd/f24 [3535076,102166] 0 2024-09-13T02:52:50.127 INFO:tasks.workunit.client.0.smithi098.stdout:0/402: stat dd/df/d1d/d40/d46/f5b 0 2024-09-13T02:52:50.132 INFO:tasks.workunit.client.0.smithi098.stdout:8/333: chown d2/la 0 1 2024-09-13T02:52:50.136 INFO:tasks.workunit.client.0.smithi098.stdout:5/303: rename d0/d15/d50/f59 to d0/d15/d17/d1c/f6c 0 2024-09-13T02:52:50.136 INFO:tasks.workunit.client.0.smithi098.stdout:3/341: dwrite d7/f3d [4194304,4194304] 0 2024-09-13T02:52:50.139 INFO:tasks.workunit.client.0.smithi098.stdout:9/339: getdents d2/d6/d2b/d4d/d56 0 2024-09-13T02:52:50.143 INFO:tasks.workunit.client.0.smithi098.stdout:0/403: fdatasync dd/df/d1d/d40/d46/d6b/f70 0 2024-09-13T02:52:50.147 INFO:tasks.workunit.client.1.smithi142.stdout:9/881: write dd/f1f [903603,70230] 0 2024-09-13T02:52:50.152 INFO:tasks.workunit.client.0.smithi098.stdout:0/404: dread dd/df/d1d/d26/d28/f2e [0,4194304] 0 2024-09-13T02:52:50.153 INFO:tasks.workunit.client.0.smithi098.stdout:8/334: mkdir d2/d2f/d5f/d46/d66 0 2024-09-13T02:52:50.153 INFO:tasks.workunit.client.0.smithi098.stdout:5/304: dread d0/d15/f30 [0,4194304] 0 2024-09-13T02:52:50.154 INFO:tasks.workunit.client.0.smithi098.stdout:5/305: stat d0/d15/d17/d1c/d3d 0 2024-09-13T02:52:50.158 INFO:tasks.workunit.client.1.smithi142.stdout:3/788: write d12/d16/d25/d2e/d48/d5c/d66/fe9 [408577,6742] 0 2024-09-13T02:52:50.159 INFO:tasks.workunit.client.1.smithi142.stdout:7/872: mknod d10/d13/d1d/d2b/d55/d32/d8c/c117 0 2024-09-13T02:52:50.160 INFO:tasks.workunit.client.1.smithi142.stdout:2/707: symlink d1/de/d1f/d13/d59/ldf 0 2024-09-13T02:52:50.163 INFO:tasks.workunit.client.0.smithi098.stdout:9/340: creat d2/d6/d2b/d66/f78 x:0 0 0 2024-09-13T02:52:50.167 INFO:tasks.workunit.client.0.smithi098.stdout:1/409: getdents d9/d33/d19/d35/d63 0 2024-09-13T02:52:50.172 INFO:tasks.workunit.client.1.smithi142.stdout:0/859: link d10/d6c/d88/d45/l4d d10/d6c/d88/d21/daf/l11f 0 2024-09-13T02:52:50.177 INFO:tasks.workunit.client.1.smithi142.stdout:1/835: creat d12/d13/d20/d66/d55/db4/f109 x:0 0 0 2024-09-13T02:52:50.179 INFO:tasks.workunit.client.1.smithi142.stdout:9/882: readlink dd/d17/d4f/l54 0 2024-09-13T02:52:50.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.179+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7b4199ec0 con 0x7ff7a006d3e0 2024-09-13T02:52:50.181 INFO:tasks.workunit.client.1.smithi142.stdout:1/836: dwrite d12/d13/d20/d66/d55/f7f [0,4194304] 0 2024-09-13T02:52:50.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.180+0000 7ff7aa7fc700 1 -- 172.21.15.98:0/2856996868 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7ff7b4199ec0 con 0x7ff7a006d3e0 2024-09-13T02:52:50.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.183+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff7a006d3e0 msgr2=0x7ff7a006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:50.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.183+0000 7ff7ba2e6700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff7a006d3e0 0x7ff7a006f890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4005fd0 tx=0x7ff7a400f040 comp rx=0 tx=0).stop 2024-09-13T02:52:50.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.183+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b4100080 msgr2=0x7ff7b4193910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:50.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.183+0000 7ff7ba2e6700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b4100080 0x7ff7b4193910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009230 tx=0x7ff7b000f740 comp rx=0 tx=0).stop 2024-09-13T02:52:50.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.183+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 shutdown_connections 2024-09-13T02:52:50.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.183+0000 7ff7ba2e6700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff7a006d3e0 0x7ff7a006f890 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.183+0000 7ff7ba2e6700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7b4100080 0x7ff7b4193910 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009230 tx=0x7ff7b000f740 comp rx=0 tx=0).stop 2024-09-13T02:52:50.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.183+0000 7ff7ba2e6700 1 --2- 172.21.15.98:0/2856996868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4193e50 0x7ff7b4198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.183+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 >> 172.21.15.98:0/2856996868 conn(0x7ff7b40fa4d0 msgr2=0x7ff7b4103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:50.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.184+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 shutdown_connections 2024-09-13T02:52:50.186 INFO:tasks.workunit.client.1.smithi142.stdout:3/789: write d12/d16/d25/f47 [1113287,52029] 0 2024-09-13T02:52:50.186 INFO:tasks.workunit.client.1.smithi142.stdout:4/788: sync 2024-09-13T02:52:50.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.184+0000 7ff7ba2e6700 1 -- 172.21.15.98:0/2856996868 wait complete. 2024-09-13T02:52:50.187 INFO:tasks.workunit.client.1.smithi142.stdout:7/873: write d10/d13/d1d/d2b/d56/d5f/d73/f91 [1725054,98869] 0 2024-09-13T02:52:50.188 INFO:tasks.workunit.client.1.smithi142.stdout:7/874: dread - d10/d64/fe7 zero size 2024-09-13T02:52:50.188 INFO:tasks.workunit.client.1.smithi142.stdout:2/708: truncate d1/de/da6/dbb/fa1 652360 0 2024-09-13T02:52:50.192 INFO:tasks.workunit.client.1.smithi142.stdout:6/851: link d1/dd/d16/d4e/d32/fbd d1/d7/d42/d100/f124 0 2024-09-13T02:52:50.197 INFO:tasks.workunit.client.1.smithi142.stdout:8/729: getdents d0/d80/d8c 0 2024-09-13T02:52:50.199 INFO:tasks.workunit.client.0.smithi098.stdout:5/306: creat d0/d15/d50/f6d x:0 0 0 2024-09-13T02:52:50.200 INFO:tasks.workunit.client.0.smithi098.stdout:5/307: chown d0/d15/d17/f26 31 1 2024-09-13T02:52:50.201 INFO:tasks.workunit.client.0.smithi098.stdout:3/342: mknod d7/d9/d15/d2d/c6d 0 2024-09-13T02:52:50.201 INFO:tasks.workunit.client.0.smithi098.stdout:3/343: dread - d7/d9/d25/d3a/d51/f69 zero size 2024-09-13T02:52:50.202 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:52:50.203 INFO:tasks.workunit.client.1.smithi142.stdout:9/883: dread dd/d17/d69/f89 [0,4194304] 0 2024-09-13T02:52:50.204 INFO:tasks.workunit.client.1.smithi142.stdout:4/789: creat d0/d2b/dd8/ffd x:0 0 0 2024-09-13T02:52:50.208 INFO:tasks.workunit.client.0.smithi098.stdout:1/410: fsync d9/d33/d19/d64/f65 0 2024-09-13T02:52:50.210 INFO:tasks.workunit.client.1.smithi142.stdout:2/709: rmdir d1/de/d31/db0 39 2024-09-13T02:52:50.213 INFO:tasks.workunit.client.1.smithi142.stdout:7/875: mkdir d10/d13/d1d/d25/d45/d6d/d118 0 2024-09-13T02:52:50.215 INFO:tasks.workunit.client.1.smithi142.stdout:6/852: creat d1/d7/d19/d48/d90/f125 x:0 0 0 2024-09-13T02:52:50.216 INFO:tasks.workunit.client.0.smithi098.stdout:3/344: creat d7/d9/d15/d26/f6e x:0 0 0 2024-09-13T02:52:50.217 INFO:tasks.workunit.client.0.smithi098.stdout:3/345: chown d7/d9/d15/d2d/f42 117 1 2024-09-13T02:52:50.218 INFO:tasks.workunit.client.0.smithi098.stdout:3/346: readlink d7/d9/d25/d3a/d52/l59 0 2024-09-13T02:52:50.219 INFO:tasks.workunit.client.0.smithi098.stdout:9/341: rename d2/dd/d39/d43/f53 to d2/d6/d2b/d4d/d4f/d6c/f79 0 2024-09-13T02:52:50.222 INFO:tasks.workunit.client.0.smithi098.stdout:3/347: dread d7/d9/d4c/f4f [0,4194304] 0 2024-09-13T02:52:50.223 INFO:tasks.workunit.client.0.smithi098.stdout:3/348: chown d7/d9/d15/d2d/d34 15 1 2024-09-13T02:52:50.224 INFO:tasks.workunit.client.0.smithi098.stdout:3/349: stat d7/d9/d15/d2d/d34/f61 0 2024-09-13T02:52:50.224 INFO:tasks.workunit.client.1.smithi142.stdout:5/850: truncate d8/dc3/d3f/d4a/d4b/f56 1125685 0 2024-09-13T02:52:50.227 INFO:tasks.workunit.client.0.smithi098.stdout:1/411: creat d9/d33/d19/d2c/d51/f98 x:0 0 0 2024-09-13T02:52:50.232 INFO:tasks.workunit.client.1.smithi142.stdout:3/790: getdents d12/d16/d3c/d79/d9b/dc1/dcd 0 2024-09-13T02:52:50.233 INFO:tasks.workunit.client.0.smithi098.stdout:0/405: dwrite f4 [4194304,4194304] 0 2024-09-13T02:52:50.239 INFO:tasks.workunit.client.1.smithi142.stdout:6/853: truncate d1/d7/d5f/d6a/f7a 84301 0 2024-09-13T02:52:50.244 INFO:tasks.workunit.client.0.smithi098.stdout:1/412: mknod d9/d33/d19/d35/d68/d60/c99 0 2024-09-13T02:52:50.246 INFO:tasks.workunit.client.1.smithi142.stdout:0/860: rmdir d10/d107 0 2024-09-13T02:52:50.249 INFO:tasks.workunit.client.0.smithi098.stdout:1/413: write d9/d33/d19/d35/d63/f77 [1971407,82527] 0 2024-09-13T02:52:50.251 INFO:tasks.workunit.client.1.smithi142.stdout:6/854: dread d1/d7/f8d [0,4194304] 0 2024-09-13T02:52:50.251 INFO:tasks.workunit.client.1.smithi142.stdout:5/851: mkdir d8/dc3/d3f/d4a/d4b/d113 0 2024-09-13T02:52:50.252 INFO:tasks.workunit.client.1.smithi142.stdout:6/855: fdatasync d1/dd/d16/d4e/d32/fe2 0 2024-09-13T02:52:50.253 INFO:tasks.workunit.client.0.smithi098.stdout:5/308: dwrite d0/d15/d17/f44 [0,4194304] 0 2024-09-13T02:52:50.253 INFO:tasks.workunit.client.1.smithi142.stdout:1/837: rename d12/d13/d20/d66/d55/da0/f54 to d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/dc3/f10a 0 2024-09-13T02:52:50.254 INFO:tasks.workunit.client.0.smithi098.stdout:9/342: dwrite d2/d6/d2b/f47 [0,4194304] 0 2024-09-13T02:52:50.254 INFO:tasks.workunit.client.0.smithi098.stdout:8/335: link d2/f1a d2/dd/d4d/f67 0 2024-09-13T02:52:50.255 INFO:tasks.workunit.client.1.smithi142.stdout:9/884: creat dd/d17/d68/d13c/f141 x:0 0 0 2024-09-13T02:52:50.257 INFO:tasks.workunit.client.1.smithi142.stdout:4/790: symlink d0/df/d57/lfe 0 2024-09-13T02:52:50.258 INFO:tasks.workunit.client.1.smithi142.stdout:6/856: dwrite d1/dd/d16/d4e/d32/f113 [0,4194304] 0 2024-09-13T02:52:50.260 INFO:tasks.workunit.client.1.smithi142.stdout:6/857: chown d1/d7/d5f/d60/f9a 43139 1 2024-09-13T02:52:50.267 INFO:tasks.workunit.client.1.smithi142.stdout:4/791: dwrite d0/d7e/fd5 [0,4194304] 0 2024-09-13T02:52:50.268 INFO:tasks.workunit.client.1.smithi142.stdout:3/791: unlink d12/d16/d25/d2e/d48/d5c/d66/f5d 0 2024-09-13T02:52:50.278 INFO:tasks.workunit.client.1.smithi142.stdout:8/730: truncate d0/d6/f24 2728703 0 2024-09-13T02:52:50.279 INFO:tasks.workunit.client.1.smithi142.stdout:3/792: dwrite d12/d16/d3c/fd2 [0,4194304] 0 2024-09-13T02:52:50.281 INFO:tasks.workunit.client.0.smithi098.stdout:0/406: getdents dd/d1f/d85 0 2024-09-13T02:52:50.287 INFO:tasks.workunit.client.1.smithi142.stdout:0/861: mkdir d10/d6c/d88/d21/d51/d35/d9b/d120 0 2024-09-13T02:52:50.291 INFO:tasks.workunit.client.0.smithi098.stdout:9/343: read - d2/dd/f1f zero size 2024-09-13T02:52:50.292 INFO:tasks.workunit.client.0.smithi098.stdout:9/344: dread - d2/d6/d2b/f5c zero size 2024-09-13T02:52:50.293 INFO:tasks.workunit.client.1.smithi142.stdout:2/710: rename d1/d2d/f53 to d1/d29/d72/fe0 0 2024-09-13T02:52:50.293 INFO:tasks.workunit.client.0.smithi098.stdout:9/345: dread d2/d6/f35 [0,4194304] 0 2024-09-13T02:52:50.294 INFO:tasks.workunit.client.1.smithi142.stdout:2/711: chown d1/d2d/fa0 2239 1 2024-09-13T02:52:50.296 INFO:tasks.workunit.client.1.smithi142.stdout:5/852: dread d8/d47/d65/da0/dd1/d45/f79 [0,4194304] 0 2024-09-13T02:52:50.297 INFO:tasks.workunit.client.0.smithi098.stdout:5/309: rename d0/d38/d3f/d1a/l60 to d0/d15/d50/l6e 0 2024-09-13T02:52:50.298 INFO:tasks.workunit.client.0.smithi098.stdout:5/310: stat d0/f37 0 2024-09-13T02:52:50.300 INFO:tasks.workunit.client.1.smithi142.stdout:5/853: dread d8/dc3/d64/d68/f77 [0,4194304] 0 2024-09-13T02:52:50.300 INFO:tasks.workunit.client.1.smithi142.stdout:4/792: fsync d0/f99 0 2024-09-13T02:52:50.301 INFO:tasks.workunit.client.1.smithi142.stdout:5/854: chown d8/dc3/d3f/d4a/d4b/c98 3004 1 2024-09-13T02:52:50.302 INFO:tasks.workunit.client.0.smithi098.stdout:8/336: mkdir d2/d2f/d5f/d46/d66/d68 0 2024-09-13T02:52:50.305 INFO:tasks.workunit.client.0.smithi098.stdout:3/350: getdents d7/d9/d25/d3a/d52 0 2024-09-13T02:52:50.307 INFO:tasks.workunit.client.1.smithi142.stdout:3/793: fdatasync d12/d16/d3c/fd2 0 2024-09-13T02:52:50.311 INFO:tasks.workunit.client.0.smithi098.stdout:0/407: rename dd/f2c to dd/df/d1d/d26/d28/d32/d67/d81/f87 0 2024-09-13T02:52:50.312 INFO:tasks.workunit.client.0.smithi098.stdout:1/414: dwrite d9/d33/d19/d64/f65 [0,4194304] 0 2024-09-13T02:52:50.314 INFO:tasks.workunit.client.0.smithi098.stdout:9/346: dread d2/d6/d36/d6a/f6b [0,4194304] 0 2024-09-13T02:52:50.318 INFO:tasks.workunit.client.0.smithi098.stdout:8/337: symlink d2/dd/d4d/l69 0 2024-09-13T02:52:50.321 INFO:tasks.workunit.client.0.smithi098.stdout:3/351: mkdir d7/d9/d25/d64/d6f 0 2024-09-13T02:52:50.322 INFO:tasks.workunit.client.0.smithi098.stdout:3/352: write d7/d9/d25/d3a/d51/f66 [220461,45626] 0 2024-09-13T02:52:50.325 INFO:tasks.workunit.client.0.smithi098.stdout:3/353: read d7/d9/d25/f39 [463871,61936] 0 2024-09-13T02:52:50.328 INFO:tasks.workunit.client.0.smithi098.stdout:1/415: stat d9/d33/d19/d35/d68/d2f/c44 0 2024-09-13T02:52:50.332 INFO:tasks.workunit.client.0.smithi098.stdout:8/338: truncate d2/d2f/d5f/f4b 1041677 0 2024-09-13T02:52:50.335 INFO:tasks.workunit.client.0.smithi098.stdout:5/311: dwrite d0/d38/d3f/d1a/d32/f33 [0,4194304] 0 2024-09-13T02:52:50.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.358+0000 7f17f99ba700 1 -- 172.21.15.98:0/1974823543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 msgr2=0x7f17f40fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:50.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.358+0000 7f17f99ba700 1 --2- 172.21.15.98:0/1974823543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 0x7f17f40fe910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009910 tx=0x7f17e4009c20 comp rx=0 tx=0).stop 2024-09-13T02:52:50.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.358+0000 7f17f99ba700 1 -- 172.21.15.98:0/1974823543 shutdown_connections 2024-09-13T02:52:50.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.358+0000 7f17f99ba700 1 --2- 172.21.15.98:0/1974823543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f40fee50 0x7f17f4101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.358+0000 7f17f99ba700 1 --2- 172.21.15.98:0/1974823543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 0x7f17f40fe910 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.358+0000 7f17f99ba700 1 -- 172.21.15.98:0/1974823543 >> 172.21.15.98:0/1974823543 conn(0x7f17f40f9f10 msgr2=0x7f17f40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:50.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.358+0000 7f17f99ba700 1 -- 172.21.15.98:0/1974823543 shutdown_connections 2024-09-13T02:52:50.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.359+0000 7f17f99ba700 1 -- 172.21.15.98:0/1974823543 wait complete. 2024-09-13T02:52:50.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.359+0000 7f17f99ba700 1 Processor -- start 2024-09-13T02:52:50.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.359+0000 7f17f99ba700 1 -- start start 2024-09-13T02:52:50.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.359+0000 7f17f99ba700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 0x7f17f4195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.359+0000 7f17f99ba700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f40fee50 0x7f17f41960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.359+0000 7f17f99ba700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41966f0 con 0x7f17f40fe500 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.359+0000 7f17f99ba700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4196830 con 0x7f17f40fee50 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 0x7f17f4195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 0x7f17f4195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56642/0 (socket says 172.21.15.98:56642) 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f2ffd700 1 -- 172.21.15.98:0/4242657633 learned_addr learned my addr 172.21.15.98:0/4242657633 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f27fc700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f40fee50 0x7f17f41960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f2ffd700 1 -- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f40fee50 msgr2=0x7f17f41960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f2ffd700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f40fee50 0x7f17f41960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f2ffd700 1 -- 172.21.15.98:0/4242657633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40095f0 con 0x7f17f40fe500 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f2ffd700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 0x7f17f4195b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f17e400bd70 tx=0x7f17e400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:50.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f89b8700 1 -- 172.21.15.98:0/4242657633 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17e401d070 con 0x7f17f40fe500 2024-09-13T02:52:50.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f419b280 con 0x7f17f40fe500 2024-09-13T02:52:50.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f89b8700 1 -- 172.21.15.98:0/4242657633 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17e400f460 con 0x7f17f40fe500 2024-09-13T02:52:50.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f89b8700 1 -- 172.21.15.98:0/4242657633 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17e4021640 con 0x7f17f40fe500 2024-09-13T02:52:50.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.360+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f419b770 con 0x7f17f40fe500 2024-09-13T02:52:50.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.362+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f4108db0 con 0x7f17f40fe500 2024-09-13T02:52:50.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.362+0000 7f17f89b8700 1 -- 172.21.15.98:0/4242657633 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f17e400f5d0 con 0x7f17f40fe500 2024-09-13T02:52:50.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.362+0000 7f17f89b8700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f17dc06d600 0x7f17dc06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:50.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.363+0000 7f17f89b8700 1 -- 172.21.15.98:0/4242657633 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f17e408e310 con 0x7f17f40fe500 2024-09-13T02:52:50.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.363+0000 7f17f27fc700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f17dc06d600 0x7f17dc06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:50.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.363+0000 7f17f27fc700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f17dc06d600 0x7f17dc06fab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17f4068200 tx=0x7f17e8009190 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:50.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.367+0000 7f17f89b8700 1 -- 172.21.15.98:0/4242657633 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f17e405b210 con 0x7f17f40fe500 2024-09-13T02:52:50.442 INFO:tasks.workunit.client.0.smithi098.stdout:2/322: sync 2024-09-13T02:52:50.445 INFO:tasks.workunit.client.0.smithi098.stdout:0/408: dwrite dd/df/d1d/d26/d28/d32/d67/d81/f87 [0,4194304] 0 2024-09-13T02:52:50.450 INFO:tasks.workunit.client.0.smithi098.stdout:3/354: mkdir d7/d9/d15/d2d/d5b/d70 0 2024-09-13T02:52:50.453 INFO:tasks.workunit.client.0.smithi098.stdout:0/409: dwrite dd/df/d1d/d40/d46/f5b [0,4194304] 0 2024-09-13T02:52:50.466 INFO:tasks.workunit.client.0.smithi098.stdout:9/347: rename d2/d6/d2b/d66/l63 to d2/l7a 0 2024-09-13T02:52:50.468 INFO:tasks.workunit.client.0.smithi098.stdout:9/348: write d2/dd/d39/f5a [201328,7834] 0 2024-09-13T02:52:50.469 INFO:tasks.workunit.client.0.smithi098.stdout:8/339: dread d2/dd/d11/f18 [0,4194304] 0 2024-09-13T02:52:50.477 INFO:tasks.workunit.client.0.smithi098.stdout:2/323: rename d1/d1a/d9/d1e/f2c to d1/d1f/d35/d63/f65 0 2024-09-13T02:52:50.478 INFO:tasks.workunit.client.0.smithi098.stdout:1/416: write d9/d33/f17 [1975657,38356] 0 2024-09-13T02:52:50.485 INFO:tasks.workunit.client.0.smithi098.stdout:8/340: read d2/f23 [2929962,33265] 0 2024-09-13T02:52:50.486 INFO:tasks.workunit.client.0.smithi098.stdout:9/349: creat d2/d6/d2b/d4d/f7b x:0 0 0 2024-09-13T02:52:50.486 INFO:tasks.workunit.client.0.smithi098.stdout:9/350: chown d2/d6/d2b/d4d 9507 1 2024-09-13T02:52:50.489 INFO:tasks.workunit.client.0.smithi098.stdout:3/355: creat d7/d9/d25/f71 x:0 0 0 2024-09-13T02:52:50.490 INFO:tasks.workunit.client.0.smithi098.stdout:3/356: fdatasync d7/d9/d25/f36 0 2024-09-13T02:52:50.498 INFO:tasks.workunit.client.0.smithi098.stdout:3/357: dwrite d7/d9/d15/d5d/f65 [0,4194304] 0 2024-09-13T02:52:50.498 INFO:tasks.workunit.client.0.smithi098.stdout:2/324: rmdir d1 39 2024-09-13T02:52:50.503 INFO:tasks.workunit.client.0.smithi098.stdout:1/417: unlink d9/d33/d19/f2e 0 2024-09-13T02:52:50.505 INFO:tasks.workunit.client.0.smithi098.stdout:5/312: getdents d0/d15/d17/d1c/d3d 0 2024-09-13T02:52:50.507 INFO:tasks.workunit.client.0.smithi098.stdout:5/313: write d0/d38/d3f/fc [4526113,71378] 0 2024-09-13T02:52:50.511 INFO:tasks.workunit.client.0.smithi098.stdout:9/351: truncate d2/d6/f14 3144535 0 2024-09-13T02:52:50.523 INFO:tasks.workunit.client.0.smithi098.stdout:3/358: dread d7/d9/d25/f39 [0,4194304] 0 2024-09-13T02:52:50.523 INFO:tasks.workunit.client.1.smithi142.stdout:9/885: rename dd/d17/d44/dfa/fb5 to dd/d17/d68/d13c/f142 0 2024-09-13T02:52:50.525 INFO:tasks.workunit.client.0.smithi098.stdout:3/359: write d7/d9/d15/d2d/d34/f5a [579771,11527] 0 2024-09-13T02:52:50.525 INFO:tasks.workunit.client.0.smithi098.stdout:5/314: stat d0/d38/d3f/c21 0 2024-09-13T02:52:50.527 INFO:tasks.workunit.client.0.smithi098.stdout:3/360: write d7/fc [7344142,519] 0 2024-09-13T02:52:50.528 INFO:tasks.workunit.client.0.smithi098.stdout:3/361: write d7/fc [3359688,113337] 0 2024-09-13T02:52:50.530 INFO:tasks.workunit.client.1.smithi142.stdout:1/838: mkdir d12/d13/d20/d10b 0 2024-09-13T02:52:50.531 INFO:tasks.workunit.client.1.smithi142.stdout:2/712: write d1/d29/f86 [4553261,2062] 0 2024-09-13T02:52:50.538 INFO:tasks.workunit.client.0.smithi098.stdout:0/410: rename dd/df/d1d/d26/d37/d53/c78 to dd/c88 0 2024-09-13T02:52:50.539 INFO:tasks.workunit.client.0.smithi098.stdout:8/341: dwrite d2/f41 [0,4194304] 0 2024-09-13T02:52:50.541 INFO:tasks.workunit.client.0.smithi098.stdout:3/362: dwrite d7/d9/d15/d2d/d34/f5a [0,4194304] 0 2024-09-13T02:52:50.543 INFO:tasks.workunit.client.1.smithi142.stdout:4/793: read - d0/d2b/d21/d35/f90 zero size 2024-09-13T02:52:50.544 INFO:tasks.workunit.client.0.smithi098.stdout:2/325: rmdir d1 39 2024-09-13T02:52:50.545 INFO:tasks.workunit.client.1.smithi142.stdout:5/855: fdatasync d8/d47/d65/da0/dd1/d63/fc9 0 2024-09-13T02:52:50.546 INFO:tasks.workunit.client.0.smithi098.stdout:3/363: write d7/d9/d25/d64/f68 [742232,89601] 0 2024-09-13T02:52:50.546 INFO:tasks.workunit.client.0.smithi098.stdout:7/528: sync 2024-09-13T02:52:50.547 INFO:tasks.workunit.client.0.smithi098.stdout:4/305: sync 2024-09-13T02:52:50.547 INFO:tasks.workunit.client.0.smithi098.stdout:6/319: sync 2024-09-13T02:52:50.549 INFO:tasks.workunit.client.0.smithi098.stdout:3/364: dread - d7/d9/d25/f71 zero size 2024-09-13T02:52:50.557 INFO:tasks.workunit.client.0.smithi098.stdout:7/529: read d6/d24/d2a/d57/d88/f54 [122039,98697] 0 2024-09-13T02:52:50.558 INFO:tasks.workunit.client.1.smithi142.stdout:7/876: getdents d10/d34 0 2024-09-13T02:52:50.558 INFO:tasks.workunit.client.1.smithi142.stdout:7/877: chown d10/d13/d1d/d25/d5c/dbd 82406 1 2024-09-13T02:52:50.559 INFO:tasks.workunit.client.0.smithi098.stdout:7/530: write d6/d24/d2a/d5a/d86/d65/f8f [377837,55116] 0 2024-09-13T02:52:50.562 INFO:tasks.workunit.client.0.smithi098.stdout:4/306: dwrite d6/d10/f1f [0,4194304] 0 2024-09-13T02:52:50.568 INFO:tasks.workunit.client.1.smithi142.stdout:2/713: creat d1/de/d1f/d13/d59/fe1 x:0 0 0 2024-09-13T02:52:50.568 INFO:tasks.workunit.client.0.smithi098.stdout:9/352: mknod d2/d6/c7c 0 2024-09-13T02:52:50.569 INFO:tasks.workunit.client.0.smithi098.stdout:1/418: rename f8 to d9/d33/d19/d35/d68/d60/f9a 0 2024-09-13T02:52:50.571 INFO:tasks.workunit.client.0.smithi098.stdout:5/315: dwrite d0/d15/d17/d1c/d3d/f47 [0,4194304] 0 2024-09-13T02:52:50.585 INFO:tasks.workunit.client.0.smithi098.stdout:8/342: dread d2/dd/d11/f4c [0,4194304] 0 2024-09-13T02:52:50.657 INFO:tasks.workunit.client.0.smithi098.stdout:0/411: mknod dd/df/d1d/d26/d28/d32/d67/d71/c89 0 2024-09-13T02:52:50.657 INFO:tasks.workunit.client.0.smithi098.stdout:0/412: dread - dd/f75 zero size 2024-09-13T02:52:50.661 INFO:tasks.workunit.client.1.smithi142.stdout:6/858: dread d1/d7/d5f/d6a/f7a [0,4194304] 0 2024-09-13T02:52:50.662 INFO:tasks.workunit.client.1.smithi142.stdout:6/859: fsync d1/d7/d19/ff1 0 2024-09-13T02:52:50.667 INFO:tasks.workunit.client.1.smithi142.stdout:4/794: mkdir d0/dc8/dff 0 2024-09-13T02:52:50.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.670+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17f4105ed0 con 0x7f17dc06d600 2024-09-13T02:52:50.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.671+0000 7f17f89b8700 1 -- 172.21.15.98:0/4242657633 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f17f4105ed0 con 0x7f17dc06d600 2024-09-13T02:52:50.678 INFO:tasks.workunit.client.1.smithi142.stdout:7/878: dread d10/d13/d1d/d2b/d40/f8b [0,4194304] 0 2024-09-13T02:52:50.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.675+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f17dc06d600 msgr2=0x7f17dc06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:50.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.675+0000 7f17f99ba700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f17dc06d600 0x7f17dc06fab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17f4068200 tx=0x7f17e8009190 comp rx=0 tx=0).stop 2024-09-13T02:52:50.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.675+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 msgr2=0x7f17f4195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:50.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.675+0000 7f17f99ba700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 0x7f17f4195b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f17e400bd70 tx=0x7f17e400bda0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.675+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 shutdown_connections 2024-09-13T02:52:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.675+0000 7f17f99ba700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f17dc06d600 0x7f17dc06fab0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17f4068200 tx=0x7f17e8009190 comp rx=0 tx=0).stop 2024-09-13T02:52:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.675+0000 7f17f99ba700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17f40fe500 0x7f17f4195b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.675+0000 7f17f99ba700 1 --2- 172.21.15.98:0/4242657633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f40fee50 0x7f17f41960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.675+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 >> 172.21.15.98:0/4242657633 conn(0x7f17f40f9f10 msgr2=0x7f17f41047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:50.680 INFO:tasks.workunit.client.1.smithi142.stdout:7/879: chown d10/d13/d1d/d2b/d56/d41/f68 6950 1 2024-09-13T02:52:50.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.677+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 shutdown_connections 2024-09-13T02:52:50.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.678+0000 7f17f99ba700 1 -- 172.21.15.98:0/4242657633 wait complete. 2024-09-13T02:52:50.690 INFO:tasks.workunit.client.0.smithi098.stdout:1/419: fdatasync d9/d33/d19/d35/d63/f89 0 2024-09-13T02:52:50.692 INFO:tasks.workunit.client.1.smithi142.stdout:6/860: mkdir d1/dd/d16/d4e/d32/d126 0 2024-09-13T02:52:50.694 INFO:tasks.workunit.client.0.smithi098.stdout:7/531: dread f3 [0,4194304] 0 2024-09-13T02:52:50.695 INFO:tasks.workunit.client.1.smithi142.stdout:4/795: mkdir d0/d2b/d2d/d31/d32/d100 0 2024-09-13T02:52:50.701 INFO:tasks.workunit.client.0.smithi098.stdout:9/353: rename d2/d6/d36/f77 to d2/d6/d36/d6a/f7d 0 2024-09-13T02:52:50.704 INFO:tasks.workunit.client.0.smithi098.stdout:0/413: mknod dd/df/d1d/d26/d28/c8a 0 2024-09-13T02:52:50.706 INFO:tasks.workunit.client.1.smithi142.stdout:3/794: fdatasync d12/d16/d25/d2e/d38/d6b/f89 0 2024-09-13T02:52:50.709 INFO:tasks.workunit.client.0.smithi098.stdout:0/414: dread dd/df/d1d/d26/f51 [0,4194304] 0 2024-09-13T02:52:50.711 INFO:tasks.workunit.client.1.smithi142.stdout:8/731: rename d0/d6/dc/d45/d35/f96 to d0/d6/dc/fee 0 2024-09-13T02:52:50.713 INFO:tasks.workunit.client.1.smithi142.stdout:1/839: creat d12/d13/d20/d27/d3c/d71/d81/f10c x:0 0 0 2024-09-13T02:52:50.714 INFO:tasks.workunit.client.1.smithi142.stdout:1/840: chown d12/d13/d20/d66/d55/da0 11 1 2024-09-13T02:52:50.716 INFO:tasks.workunit.client.0.smithi098.stdout:1/420: creat d9/f9b x:0 0 0 2024-09-13T02:52:50.718 INFO:tasks.workunit.client.1.smithi142.stdout:2/714: unlink d1/ld 0 2024-09-13T02:52:50.726 INFO:tasks.workunit.client.1.smithi142.stdout:4/796: mkdir d0/dc8/dcf/de6/d101 0 2024-09-13T02:52:50.731 INFO:tasks.workunit.client.0.smithi098.stdout:3/365: truncate d7/d9/d15/d2d/f42 4173925 0 2024-09-13T02:52:50.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:50 smithi098 ceph-mon[27886]: pgmap v24: 65 pgs: 65 active+clean; 2.5 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 98 MiB/s rd, 308 MiB/s wr, 568 op/s 2024-09-13T02:52:50.735 INFO:tasks.workunit.client.0.smithi098.stdout:1/421: creat d9/d33/d1f/d23/f9c x:0 0 0 2024-09-13T02:52:50.737 INFO:tasks.workunit.client.1.smithi142.stdout:3/795: dread d12/f13 [0,4194304] 0 2024-09-13T02:52:50.738 INFO:tasks.workunit.client.1.smithi142.stdout:0/862: rename d10/d6c/d88/d30/la6 to d10/d6c/d88/d1a/d1e/dc6/df3/d110/l121 0 2024-09-13T02:52:50.739 INFO:tasks.workunit.client.0.smithi098.stdout:2/326: creat d1/d1f/f66 x:0 0 0 2024-09-13T02:52:50.744 INFO:tasks.workunit.client.1.smithi142.stdout:3/796: dwrite d12/d16/da3/fde [0,4194304] 0 2024-09-13T02:52:50.744 INFO:tasks.workunit.client.1.smithi142.stdout:0/863: dwrite d10/d23/f25 [0,4194304] 0 2024-09-13T02:52:50.746 INFO:tasks.workunit.client.0.smithi098.stdout:6/320: getdents d5/d18/d50 0 2024-09-13T02:52:50.750 INFO:tasks.workunit.client.0.smithi098.stdout:3/366: unlink d7/d9/d25/f36 0 2024-09-13T02:52:50.751 INFO:tasks.workunit.client.1.smithi142.stdout:6/861: dwrite d1/dd/d53/d78/d8f/f92 [0,4194304] 0 2024-09-13T02:52:50.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:50 smithi142 ceph-mon[33443]: pgmap v24: 65 pgs: 65 active+clean; 2.5 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 98 MiB/s rd, 308 MiB/s wr, 568 op/s 2024-09-13T02:52:50.752 INFO:tasks.workunit.client.0.smithi098.stdout:3/367: chown d7/d9/d25/d3a/d5f 16 1 2024-09-13T02:52:50.752 INFO:tasks.workunit.client.1.smithi142.stdout:6/862: dread - d1/d7/d19/d48/d90/f116 zero size 2024-09-13T02:52:50.759 INFO:tasks.workunit.client.0.smithi098.stdout:3/368: dwrite d7/d9/d25/d3a/d51/f69 [0,4194304] 0 2024-09-13T02:52:50.762 INFO:tasks.workunit.client.0.smithi098.stdout:1/422: rename d9/d33/d1f/d23/f9c to d9/d33/d1f/d6b/d7c/f9d 0 2024-09-13T02:52:50.765 INFO:tasks.workunit.client.1.smithi142.stdout:4/797: rmdir d0/dc8/dcf 39 2024-09-13T02:52:50.767 INFO:tasks.workunit.client.0.smithi098.stdout:1/423: read d9/d33/d19/d35/d63/f69 [22440,60323] 0 2024-09-13T02:52:50.768 INFO:tasks.workunit.client.0.smithi098.stdout:1/424: chown d9/f1c 68803 1 2024-09-13T02:52:50.770 INFO:tasks.workunit.client.0.smithi098.stdout:1/425: readlink d9/d33/d19/d2c/d51/d8f/l76 0 2024-09-13T02:52:50.773 INFO:tasks.workunit.client.0.smithi098.stdout:2/327: fsync d1/d1f/d35/d63/d23/f28 0 2024-09-13T02:52:50.773 INFO:tasks.workunit.client.0.smithi098.stdout:3/369: dwrite d7/d9/d25/d3a/d5f/f60 [0,4194304] 0 2024-09-13T02:52:50.775 INFO:tasks.workunit.client.0.smithi098.stdout:6/321: mkdir d5/d18/d4e/d72 0 2024-09-13T02:52:50.776 INFO:tasks.workunit.client.1.smithi142.stdout:9/886: rename l9 to dd/d17/d4f/l143 0 2024-09-13T02:52:50.777 INFO:tasks.workunit.client.1.smithi142.stdout:9/887: stat dd/d17/d69/d84/c3a 0 2024-09-13T02:52:50.778 INFO:tasks.workunit.client.0.smithi098.stdout:9/354: truncate d2/d6/d2b/d4d/f5d 3675360 0 2024-09-13T02:52:50.790 INFO:tasks.workunit.client.1.smithi142.stdout:7/880: creat d10/d13/f119 x:0 0 0 2024-09-13T02:52:50.799 INFO:tasks.workunit.client.1.smithi142.stdout:0/864: creat d10/d6c/d88/d21/d51/d79/de6/f122 x:0 0 0 2024-09-13T02:52:50.800 INFO:tasks.workunit.client.0.smithi098.stdout:9/355: dread d2/d6/d2b/d66/f75 [4194304,4194304] 0 2024-09-13T02:52:50.800 INFO:tasks.workunit.client.1.smithi142.stdout:0/865: chown d10/d6c/d88/d45/fc8 7218 1 2024-09-13T02:52:50.801 INFO:tasks.workunit.client.1.smithi142.stdout:9/888: dread dd/d17/d44/f5c [4194304,4194304] 0 2024-09-13T02:52:50.803 INFO:tasks.workunit.client.1.smithi142.stdout:3/797: creat d12/d16/d25/d2e/d48/d5c/d73/ff7 x:0 0 0 2024-09-13T02:52:50.804 INFO:tasks.workunit.client.0.smithi098.stdout:1/426: dread - d9/f55 zero size 2024-09-13T02:52:50.805 INFO:tasks.workunit.client.1.smithi142.stdout:3/798: dread - d12/d16/d25/d2e/d38/d4d/d53/d78/fe2 zero size 2024-09-13T02:52:50.806 INFO:tasks.workunit.client.1.smithi142.stdout:3/799: chown d12/d16/d3c/d79/d9e/cd4 380941 1 2024-09-13T02:52:50.806 INFO:tasks.workunit.client.0.smithi098.stdout:3/370: symlink d7/d9/d15/d5d/l72 0 2024-09-13T02:52:50.808 INFO:tasks.workunit.client.0.smithi098.stdout:6/322: dread d5/d13/d2b/f2d [0,4194304] 0 2024-09-13T02:52:50.808 INFO:tasks.workunit.client.1.smithi142.stdout:6/863: creat d1/d7/d42/f127 x:0 0 0 2024-09-13T02:52:50.809 INFO:tasks.workunit.client.0.smithi098.stdout:1/427: dread d9/d33/d19/d35/d68/d2f/f49 [0,4194304] 0 2024-09-13T02:52:50.809 INFO:tasks.workunit.client.1.smithi142.stdout:6/864: chown d1/d7/d19/l5a 722639 1 2024-09-13T02:52:50.811 INFO:tasks.workunit.client.1.smithi142.stdout:4/798: mknod d0/d2b/d21/d35/c102 0 2024-09-13T02:52:50.812 INFO:tasks.workunit.client.1.smithi142.stdout:0/866: dread d10/d6c/f71 [0,4194304] 0 2024-09-13T02:52:50.815 INFO:tasks.workunit.client.1.smithi142.stdout:5/856: rename d8/f19 to d8/dc3/df3/f114 0 2024-09-13T02:52:50.819 INFO:tasks.workunit.client.1.smithi142.stdout:8/732: rmdir d0/d80/d8c/ddb 0 2024-09-13T02:52:50.819 INFO:tasks.workunit.client.1.smithi142.stdout:8/733: dread - d0/d6/dc/d2e/fb9 zero size 2024-09-13T02:52:50.821 INFO:tasks.workunit.client.0.smithi098.stdout:9/356: creat d2/d6/d2b/d4d/d56/f7e x:0 0 0 2024-09-13T02:52:50.822 INFO:tasks.workunit.client.1.smithi142.stdout:7/881: symlink d10/d34/d65/l11a 0 2024-09-13T02:52:50.827 INFO:tasks.workunit.client.1.smithi142.stdout:7/882: dwrite d10/d13/d1d/f5d [0,4194304] 0 2024-09-13T02:52:50.828 INFO:tasks.workunit.client.0.smithi098.stdout:3/371: chown d7/d9/d25/d2b/f40 380852 1 2024-09-13T02:52:50.828 INFO:tasks.workunit.client.1.smithi142.stdout:9/889: mknod dd/d17/d69/d84/df8/c144 0 2024-09-13T02:52:50.830 INFO:tasks.workunit.client.1.smithi142.stdout:2/715: rmdir d1/dd9 0 2024-09-13T02:52:50.833 INFO:tasks.workunit.client.0.smithi098.stdout:1/428: unlink d9/d33/f17 0 2024-09-13T02:52:50.834 INFO:tasks.workunit.client.1.smithi142.stdout:6/865: mkdir d1/d7/d19/d48/d90/d11e/d128 0 2024-09-13T02:52:50.835 INFO:tasks.workunit.client.0.smithi098.stdout:9/357: mknod d2/dd/d39/c7f 0 2024-09-13T02:52:50.837 INFO:tasks.workunit.client.0.smithi098.stdout:9/358: chown d2/d6/l16 120145 1 2024-09-13T02:52:50.840 INFO:tasks.workunit.client.0.smithi098.stdout:3/372: mknod d7/d9/d15/d5d/c73 0 2024-09-13T02:52:50.842 INFO:tasks.workunit.client.1.smithi142.stdout:1/841: getdents d12/d13/d20/d66/d7d/df5/d26/d4f/d72 0 2024-09-13T02:52:50.843 INFO:tasks.workunit.client.0.smithi098.stdout:1/429: dwrite d9/d33/d19/d35/f95 [0,4194304] 0 2024-09-13T02:52:50.844 INFO:tasks.workunit.client.0.smithi098.stdout:2/328: getdents d1/d1f 0 2024-09-13T02:52:50.844 INFO:tasks.workunit.client.0.smithi098.stdout:3/373: dread - d7/d9/d15/d2d/d34/f61 zero size 2024-09-13T02:52:50.844 INFO:tasks.workunit.client.0.smithi098.stdout:6/323: dread d5/f15 [0,4194304] 0 2024-09-13T02:52:50.845 INFO:tasks.workunit.client.1.smithi142.stdout:8/734: dwrite d0/d6/d23/f7f [0,4194304] 0 2024-09-13T02:52:50.846 INFO:tasks.workunit.client.0.smithi098.stdout:9/359: readlink d2/l7a 0 2024-09-13T02:52:50.847 INFO:tasks.workunit.client.0.smithi098.stdout:3/374: dread - d7/d9/d15/d2d/d34/f61 zero size 2024-09-13T02:52:50.848 INFO:tasks.workunit.client.0.smithi098.stdout:3/375: fdatasync d7/d9/d15/d2d/d5b/f45 0 2024-09-13T02:52:50.849 INFO:tasks.workunit.client.1.smithi142.stdout:9/890: truncate dd/f16 4217220 0 2024-09-13T02:52:50.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.849+0000 7faba6682700 1 -- 172.21.15.98:0/3073961404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 msgr2=0x7faba00fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:50.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.849+0000 7faba6682700 1 --2- 172.21.15.98:0/3073961404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 0x7faba00fef60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab90009910 tx=0x7fab90009c20 comp rx=0 tx=0).stop 2024-09-13T02:52:50.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.849+0000 7faba6682700 1 -- 172.21.15.98:0/3073961404 shutdown_connections 2024-09-13T02:52:50.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.849+0000 7faba6682700 1 --2- 172.21.15.98:0/3073961404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00ff4a0 0x7faba00ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.849+0000 7faba6682700 1 --2- 172.21.15.98:0/3073961404 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 0x7faba00fef60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.849+0000 7faba6682700 1 -- 172.21.15.98:0/3073961404 >> 172.21.15.98:0/3073961404 conn(0x7faba00fa780 msgr2=0x7faba00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:50.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.850+0000 7faba6682700 1 -- 172.21.15.98:0/3073961404 shutdown_connections 2024-09-13T02:52:50.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.850+0000 7faba6682700 1 -- 172.21.15.98:0/3073961404 wait complete. 2024-09-13T02:52:50.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.850+0000 7faba6682700 1 Processor -- start 2024-09-13T02:52:50.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7faba6682700 1 -- start start 2024-09-13T02:52:50.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7faba6682700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 0x7faba0197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:50.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7faba6682700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00ff4a0 0x7faba0198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:50.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7faba6682700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba0198840 con 0x7faba00feb50 2024-09-13T02:52:50.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7faba6682700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba019d250 con 0x7faba00ff4a0 2024-09-13T02:52:50.853 INFO:tasks.workunit.client.1.smithi142.stdout:2/716: truncate d1/de/f7e 657894 0 2024-09-13T02:52:50.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7fab97fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 0x7faba0197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:50.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7fab97fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 0x7faba0197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56658/0 (socket says 172.21.15.98:56658) 2024-09-13T02:52:50.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7fab97fff700 1 -- 172.21.15.98:0/2232683185 learned_addr learned my addr 172.21.15.98:0/2232683185 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:50.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7fab97fff700 1 -- 172.21.15.98:0/2232683185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00ff4a0 msgr2=0x7faba0198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:50.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.851+0000 7fab97fff700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00ff4a0 0x7faba0198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:50.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.852+0000 7fab97fff700 1 -- 172.21.15.98:0/2232683185 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900095f0 con 0x7faba00feb50 2024-09-13T02:52:50.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.852+0000 7fab97fff700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 0x7faba0197ce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab9000bda0 tx=0x7fab9000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:50.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.852+0000 7fab9dffb700 1 -- 172.21.15.98:0/2232683185 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9001d070 con 0x7faba00feb50 2024-09-13T02:52:50.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.852+0000 7fab9dffb700 1 -- 172.21.15.98:0/2232683185 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab9000f460 con 0x7faba00feb50 2024-09-13T02:52:50.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.852+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba019d3f0 con 0x7faba00feb50 2024-09-13T02:52:50.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.852+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba019d8b0 con 0x7faba00feb50 2024-09-13T02:52:50.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.852+0000 7fab9dffb700 1 -- 172.21.15.98:0/2232683185 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab90021640 con 0x7faba00feb50 2024-09-13T02:52:50.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.853+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba010aef0 con 0x7faba00feb50 2024-09-13T02:52:50.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.855+0000 7fab9dffb700 1 -- 172.21.15.98:0/2232683185 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7fab9000f5d0 con 0x7faba00feb50 2024-09-13T02:52:50.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.855+0000 7fab9dffb700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fab8c06d650 0x7fab8c06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:50.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.855+0000 7fab9dffb700 1 -- 172.21.15.98:0/2232683185 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fab9008e5b0 con 0x7faba00feb50 2024-09-13T02:52:50.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.856+0000 7fab9ffff700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fab8c06d650 0x7fab8c06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:50.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.856+0000 7fab9ffff700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fab8c06d650 0x7fab8c06fb00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab88005fd0 tx=0x7fab88005f60 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:50.859 INFO:tasks.workunit.client.0.smithi098.stdout:1/430: symlink d9/d33/d19/d35/l9e 0 2024-09-13T02:52:50.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:50.861+0000 7fab9dffb700 1 -- 172.21.15.98:0/2232683185 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fab90057b70 con 0x7faba00feb50 2024-09-13T02:52:50.864 INFO:tasks.workunit.client.0.smithi098.stdout:6/324: mknod d5/d13/d2b/d3a/d5a/c73 0 2024-09-13T02:52:50.865 INFO:tasks.workunit.client.1.smithi142.stdout:0/867: getdents d10/d6c/d88/d45/ded/d113 0 2024-09-13T02:52:50.865 INFO:tasks.workunit.client.0.smithi098.stdout:6/325: write d5/fc [5268995,46408] 0 2024-09-13T02:52:50.867 INFO:tasks.workunit.client.0.smithi098.stdout:2/329: mknod d1/d1a/d9/d1e/d5a/c67 0 2024-09-13T02:52:50.873 INFO:tasks.workunit.client.1.smithi142.stdout:1/842: dread d12/d13/d20/d66/d55/f44 [4194304,4194304] 0 2024-09-13T02:52:50.876 INFO:tasks.workunit.client.1.smithi142.stdout:7/883: truncate d10/d13/d1d/d2b/d56/d41/f68 2236456 0 2024-09-13T02:52:50.876 INFO:tasks.workunit.client.0.smithi098.stdout:1/431: fsync d9/f38 0 2024-09-13T02:52:50.878 INFO:tasks.workunit.client.1.smithi142.stdout:8/735: mknod d0/d82/cef 0 2024-09-13T02:52:50.882 INFO:tasks.workunit.client.1.smithi142.stdout:2/717: truncate d1/de/da6/dbb/f3f 267984 0 2024-09-13T02:52:50.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/360: rename d2/dd/f3b to d2/dd/d39/f80 0 2024-09-13T02:52:50.885 INFO:tasks.workunit.client.0.smithi098.stdout:3/376: symlink d7/d9/d15/d2d/l74 0 2024-09-13T02:52:50.888 INFO:tasks.workunit.client.1.smithi142.stdout:6/866: truncate d1/dd/d16/d4d/fe9 940519 0 2024-09-13T02:52:50.888 INFO:tasks.workunit.client.0.smithi098.stdout:6/326: dread d5/d18/f2a [4194304,4194304] 0 2024-09-13T02:52:50.889 INFO:tasks.workunit.client.1.smithi142.stdout:0/868: creat d10/d6c/f123 x:0 0 0 2024-09-13T02:52:50.889 INFO:tasks.workunit.client.0.smithi098.stdout:6/327: dread - d5/d13/d2b/d3a/d41/f4b zero size 2024-09-13T02:52:50.891 INFO:tasks.workunit.client.1.smithi142.stdout:5/857: link d8/dc3/d3f/ddd/cfd d8/c115 0 2024-09-13T02:52:50.891 INFO:tasks.workunit.client.1.smithi142.stdout:5/858: chown d8/c33 679604504 1 2024-09-13T02:52:50.970 INFO:tasks.workunit.client.0.smithi098.stdout:9/361: dread - d2/d6/f29 zero size 2024-09-13T02:52:50.972 INFO:tasks.workunit.client.0.smithi098.stdout:1/432: symlink d9/d33/l9f 0 2024-09-13T02:52:50.975 INFO:tasks.workunit.client.1.smithi142.stdout:7/884: creat d10/d13/d1d/d2b/dae/f11b x:0 0 0 2024-09-13T02:52:50.975 INFO:tasks.workunit.client.0.smithi098.stdout:9/362: readlink d2/dd/l60 0 2024-09-13T02:52:50.977 INFO:tasks.workunit.client.0.smithi098.stdout:3/377: link d7/d9/d25/d3a/d51/f66 d7/d9/d25/d2b/f75 0 2024-09-13T02:52:50.979 INFO:tasks.workunit.client.1.smithi142.stdout:9/891: mknod dd/d17/d68/ded/d100/c145 0 2024-09-13T02:52:50.979 INFO:tasks.workunit.client.1.smithi142.stdout:0/869: sync 2024-09-13T02:52:50.979 INFO:tasks.workunit.client.1.smithi142.stdout:4/799: sync 2024-09-13T02:52:50.980 INFO:tasks.workunit.client.0.smithi098.stdout:6/328: symlink d5/d13/d2b/d3a/d41/d55/l74 0 2024-09-13T02:52:50.980 INFO:tasks.workunit.client.1.smithi142.stdout:9/892: dread dd/f7e [0,4194304] 0 2024-09-13T02:52:50.981 INFO:tasks.workunit.client.1.smithi142.stdout:3/800: getdents d12/d16 0 2024-09-13T02:52:50.982 INFO:tasks.workunit.client.0.smithi098.stdout:9/363: creat d2/d6/d2b/d4d/d4f/d6c/f81 x:0 0 0 2024-09-13T02:52:50.983 INFO:tasks.workunit.client.0.smithi098.stdout:3/378: mknod d7/c76 0 2024-09-13T02:52:50.985 INFO:tasks.workunit.client.1.smithi142.stdout:6/867: symlink d1/dd/d53/d78/d104/dad/dd2/l129 0 2024-09-13T02:52:50.992 INFO:tasks.workunit.client.0.smithi098.stdout:9/364: rmdir d2/d6 39 2024-09-13T02:52:50.992 INFO:tasks.workunit.client.0.smithi098.stdout:9/365: write d2/f57 [481093,96029] 0 2024-09-13T02:52:50.995 INFO:tasks.workunit.client.1.smithi142.stdout:5/859: dread f0 [0,4194304] 0 2024-09-13T02:52:50.995 INFO:tasks.workunit.client.1.smithi142.stdout:1/843: symlink d12/d13/d20/d27/l10d 0 2024-09-13T02:52:50.995 INFO:tasks.workunit.client.1.smithi142.stdout:2/718: dwrite d1/d29/f83 [0,4194304] 0 2024-09-13T02:52:50.997 INFO:tasks.workunit.client.0.smithi098.stdout:6/329: write d5/f22 [403670,102019] 0 2024-09-13T02:52:50.999 INFO:tasks.workunit.client.1.smithi142.stdout:7/885: write d10/d13/f3d [463417,42151] 0 2024-09-13T02:52:50.999 INFO:tasks.workunit.client.0.smithi098.stdout:6/330: write d5/d18/f45 [1080710,114673] 0 2024-09-13T02:52:51.000 INFO:tasks.workunit.client.0.smithi098.stdout:1/433: getdents d9/d33/d19/d35 0 2024-09-13T02:52:51.001 INFO:tasks.workunit.client.1.smithi142.stdout:8/736: creat d0/d6/dc/d40/d4d/dd0/ff0 x:0 0 0 2024-09-13T02:52:51.002 INFO:tasks.workunit.client.1.smithi142.stdout:8/737: fdatasync d0/d6/dc/d40/d4d/d62/f98 0 2024-09-13T02:52:51.006 INFO:tasks.workunit.client.0.smithi098.stdout:1/434: symlink d9/d33/d29/d58/la0 0 2024-09-13T02:52:51.007 INFO:tasks.workunit.client.0.smithi098.stdout:6/331: dread d5/d13/d2b/d5b/f63 [0,4194304] 0 2024-09-13T02:52:51.007 INFO:tasks.workunit.client.1.smithi142.stdout:4/800: truncate d0/df/d57/f89 634017 0 2024-09-13T02:52:51.009 INFO:tasks.workunit.client.1.smithi142.stdout:9/893: write dd/d98/d126/f7f [3162194,9551] 0 2024-09-13T02:52:51.009 INFO:tasks.workunit.client.1.smithi142.stdout:4/801: chown d0/d2b/d2d/d65/f6e 1838024 1 2024-09-13T02:52:51.009 INFO:tasks.workunit.client.1.smithi142.stdout:9/894: chown dd/d17/d68 1962298 1 2024-09-13T02:52:51.011 INFO:tasks.workunit.client.1.smithi142.stdout:9/895: truncate dd/d17/d68/d13c/f141 77593 0 2024-09-13T02:52:51.011 INFO:tasks.workunit.client.1.smithi142.stdout:6/868: chown d1/dd/d53/c6e 287983 1 2024-09-13T02:52:51.012 INFO:tasks.workunit.client.0.smithi098.stdout:6/332: truncate d5/d13/d2b/d5b/f63 869963 0 2024-09-13T02:52:51.013 INFO:tasks.workunit.client.1.smithi142.stdout:6/869: write d1/d7/d5f/d60/db6/f110 [867614,44000] 0 2024-09-13T02:52:51.013 INFO:tasks.workunit.client.0.smithi098.stdout:9/366: link d2/dd/d39/f80 d2/d6/d36/f82 0 2024-09-13T02:52:51.014 INFO:tasks.workunit.client.1.smithi142.stdout:9/896: dread dd/d17/d44/d95/fb0 [0,4194304] 0 2024-09-13T02:52:51.015 INFO:tasks.workunit.client.1.smithi142.stdout:2/719: symlink d1/de/d31/d6c/d6d/d47/le2 0 2024-09-13T02:52:51.015 INFO:tasks.workunit.client.0.smithi098.stdout:1/435: getdents d9/d33/d19/d2c/d51/d8f/d5f/d8e 0 2024-09-13T02:52:51.017 INFO:tasks.workunit.client.1.smithi142.stdout:7/886: symlink d10/d64/d88/l11c 0 2024-09-13T02:52:51.018 INFO:tasks.workunit.client.0.smithi098.stdout:6/333: symlink d5/d36/l75 0 2024-09-13T02:52:51.019 INFO:tasks.workunit.client.1.smithi142.stdout:1/844: dwrite d12/d13/d20/d66/d7d/df5/fc6 [0,4194304] 0 2024-09-13T02:52:51.022 INFO:tasks.workunit.client.0.smithi098.stdout:1/436: creat d9/d33/d19/d35/d68/d4d/fa1 x:0 0 0 2024-09-13T02:52:51.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/367: rename d2/dd/f1e to d2/dd/d39/d43/f83 0 2024-09-13T02:52:51.032 INFO:tasks.workunit.client.1.smithi142.stdout:6/870: unlink d1/d7/d5f/d6a/lef 0 2024-09-13T02:52:51.035 INFO:tasks.workunit.client.1.smithi142.stdout:2/720: symlink d1/de/d1f/d9c/le3 0 2024-09-13T02:52:51.036 INFO:tasks.workunit.client.0.smithi098.stdout:9/368: mknod d2/d6/d2b/d4d/c84 0 2024-09-13T02:52:51.038 INFO:tasks.workunit.client.1.smithi142.stdout:9/897: read dd/d17/d44/d82/d99/daf/fb6 [838314,123970] 0 2024-09-13T02:52:51.041 INFO:tasks.workunit.client.0.smithi098.stdout:1/437: getdents d9/d33 0 2024-09-13T02:52:51.042 INFO:tasks.workunit.client.1.smithi142.stdout:7/887: mknod d10/d13/d1d/d2b/d56/d5f/da2/c11d 0 2024-09-13T02:52:51.045 INFO:tasks.workunit.client.0.smithi098.stdout:6/334: dwrite d5/d13/d2b/d3a/d41/f4b [0,4194304] 0 2024-09-13T02:52:51.047 INFO:tasks.workunit.client.0.smithi098.stdout:6/335: chown d5/d13/d51/f60 243528120 1 2024-09-13T02:52:51.047 INFO:tasks.workunit.client.0.smithi098.stdout:6/336: write d5/fb [1731822,2932] 0 2024-09-13T02:52:51.049 INFO:tasks.workunit.client.0.smithi098.stdout:6/337: write d5/d18/f47 [1388846,19542] 0 2024-09-13T02:52:51.049 INFO:tasks.workunit.client.1.smithi142.stdout:8/738: symlink d0/d80/lf1 0 2024-09-13T02:52:51.050 INFO:tasks.workunit.client.1.smithi142.stdout:9/898: dread dd/d98/dca/d127/f134 [0,4194304] 0 2024-09-13T02:52:51.051 INFO:tasks.workunit.client.1.smithi142.stdout:8/739: truncate d0/d6/dc/d45/f1b 4764424 0 2024-09-13T02:52:51.053 INFO:tasks.workunit.client.0.smithi098.stdout:9/369: rename d2/dd/d39/f80 to d2/d6/d2b/d4d/d4f/d6c/f85 0 2024-09-13T02:52:51.058 INFO:tasks.workunit.client.0.smithi098.stdout:1/438: symlink d9/d33/d87/la2 0 2024-09-13T02:52:51.058 INFO:tasks.workunit.client.1.smithi142.stdout:3/801: link d12/d16/d25/d2e/d38/d4d/d53/feb d12/d16/d25/d2e/d48/ff8 0 2024-09-13T02:52:51.058 INFO:tasks.workunit.client.0.smithi098.stdout:1/439: dread - d9/d33/d1f/f88 zero size 2024-09-13T02:52:51.059 INFO:tasks.workunit.client.0.smithi098.stdout:1/440: chown d9/d33/d1f/d6b/d7c/f9d 1 1 2024-09-13T02:52:51.060 INFO:tasks.workunit.client.1.smithi142.stdout:4/802: creat d0/d2b/d21/db4/f103 x:0 0 0 2024-09-13T02:52:51.061 INFO:tasks.workunit.client.1.smithi142.stdout:1/845: dwrite d12/d13/d20/d27/d3c/fa2 [0,4194304] 0 2024-09-13T02:52:51.064 INFO:tasks.workunit.client.0.smithi098.stdout:9/370: creat d2/dd/d39/f86 x:0 0 0 2024-09-13T02:52:51.065 INFO:tasks.workunit.client.0.smithi098.stdout:9/371: read d2/d6/f1d [7005535,51100] 0 2024-09-13T02:52:51.066 INFO:tasks.workunit.client.0.smithi098.stdout:9/372: chown d2/d6/d2b/d66/l67 208 1 2024-09-13T02:52:51.067 INFO:tasks.workunit.client.0.smithi098.stdout:9/373: readlink d2/dd/d39/l41 0 2024-09-13T02:52:51.069 INFO:tasks.workunit.client.1.smithi142.stdout:7/888: mknod d10/d13/d1d/d2b/d56/d5f/da2/c11e 0 2024-09-13T02:52:51.070 INFO:tasks.workunit.client.1.smithi142.stdout:7/889: read d10/d13/d1d/d25/d5c/da3/f102 [2861574,29626] 0 2024-09-13T02:52:51.075 INFO:tasks.workunit.client.0.smithi098.stdout:1/441: rename d9/d33/d19/d35/d68/c54 to d9/d33/d19/d35/d68/ca3 0 2024-09-13T02:52:51.077 INFO:tasks.workunit.client.1.smithi142.stdout:5/860: sync 2024-09-13T02:52:51.077 INFO:tasks.workunit.client.1.smithi142.stdout:0/870: rmdir d10/d6c/d88/d1a/d1e/d42/d4b/d85/d11c 0 2024-09-13T02:52:51.078 INFO:tasks.workunit.client.0.smithi098.stdout:9/374: truncate d2/dd/d39/d43/f83 840393 0 2024-09-13T02:52:51.079 INFO:tasks.workunit.client.0.smithi098.stdout:6/338: fsync d5/d18/f1f 0 2024-09-13T02:52:51.080 INFO:tasks.workunit.client.1.smithi142.stdout:3/802: fsync d12/d16/d3c/d7d/d91/fb4 0 2024-09-13T02:52:51.081 INFO:tasks.workunit.client.0.smithi098.stdout:1/442: creat d9/d33/fa4 x:0 0 0 2024-09-13T02:52:51.082 INFO:tasks.workunit.client.1.smithi142.stdout:5/861: dread d8/d47/d65/da0/dd1/d2d/d90/fa1 [0,4194304] 0 2024-09-13T02:52:51.083 INFO:tasks.workunit.client.1.smithi142.stdout:4/803: unlink d0/d2b/d21/c28 0 2024-09-13T02:52:51.084 INFO:tasks.workunit.client.1.smithi142.stdout:5/862: read d8/d47/d65/da0/dd1/d61/f7e [1062157,102411] 0 2024-09-13T02:52:51.086 INFO:tasks.workunit.client.0.smithi098.stdout:6/339: chown d5/d18/l32 2029 1 2024-09-13T02:52:51.089 INFO:tasks.workunit.client.1.smithi142.stdout:3/803: dwrite d12/d16/d25/d2e/d38/d4d/d53/d78/fc5 [0,4194304] 0 2024-09-13T02:52:51.089 INFO:tasks.workunit.client.1.smithi142.stdout:7/890: dread d10/f42 [0,4194304] 0 2024-09-13T02:52:51.091 INFO:tasks.workunit.client.0.smithi098.stdout:9/375: mknod d2/c87 0 2024-09-13T02:52:51.096 INFO:tasks.workunit.client.1.smithi142.stdout:5/863: dread d8/f66 [0,4194304] 0 2024-09-13T02:52:51.096 INFO:tasks.workunit.client.0.smithi098.stdout:4/307: sync 2024-09-13T02:52:51.098 INFO:tasks.workunit.client.1.smithi142.stdout:1/846: dread d12/d13/d45/f7c [0,4194304] 0 2024-09-13T02:52:51.100 INFO:tasks.workunit.client.0.smithi098.stdout:6/340: mknod d5/d13/d2b/d3a/d14/d6b/c76 0 2024-09-13T02:52:51.102 INFO:tasks.workunit.client.1.smithi142.stdout:0/871: chown d10/f7c 5215781 1 2024-09-13T02:52:51.104 INFO:tasks.workunit.client.0.smithi098.stdout:9/376: truncate d2/d6/d2b/d4d/f5d 2410158 0 2024-09-13T02:52:51.105 INFO:tasks.workunit.client.0.smithi098.stdout:9/377: rename d2 to d2/dd/d39/d88 22 2024-09-13T02:52:51.105 INFO:tasks.workunit.client.1.smithi142.stdout:4/804: mknod d0/d2b/d2d/d31/d32/d82/c104 0 2024-09-13T02:52:51.106 INFO:tasks.workunit.client.1.smithi142.stdout:4/805: readlink d0/d2b/d2d/d31/d43/lab 0 2024-09-13T02:52:51.109 INFO:tasks.workunit.client.0.smithi098.stdout:4/308: creat d6/d22/d3d/d64/f6d x:0 0 0 2024-09-13T02:52:51.110 INFO:tasks.workunit.client.0.smithi098.stdout:4/309: dread - d6/f61 zero size 2024-09-13T02:52:51.110 INFO:tasks.workunit.client.0.smithi098.stdout:9/378: dread d2/d6/d2b/d66/f75 [4194304,4194304] 0 2024-09-13T02:52:51.111 INFO:tasks.workunit.client.1.smithi142.stdout:6/871: rmdir d1/dd/d16/d4e/dee 0 2024-09-13T02:52:51.112 INFO:tasks.workunit.client.0.smithi098.stdout:9/379: dread - d2/dd/d39/f86 zero size 2024-09-13T02:52:51.113 INFO:tasks.workunit.client.0.smithi098.stdout:1/443: dwrite d9/d33/d19/d46/f4a [0,4194304] 0 2024-09-13T02:52:51.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/721: link d1/d42/d44/d99/lb8 d1/de/d31/d6c/d6d/le4 0 2024-09-13T02:52:51.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/722: write d1/de/d1f/d13/f9b [113508,46749] 0 2024-09-13T02:52:51.123 INFO:tasks.workunit.client.1.smithi142.stdout:7/891: dwrite d10/d13/d1d/d25/f75 [0,4194304] 0 2024-09-13T02:52:51.125 INFO:tasks.workunit.client.0.smithi098.stdout:4/310: rename d6/l1d to d6/d22/d3d/d4d/l6e 0 2024-09-13T02:52:51.130 INFO:tasks.workunit.client.1.smithi142.stdout:7/892: dwrite d10/d13/f3d [0,4194304] 0 2024-09-13T02:52:51.133 INFO:tasks.workunit.client.0.smithi098.stdout:1/444: symlink d9/d33/d19/d2c/d51/d8f/d5f/d8e/la5 0 2024-09-13T02:52:51.134 INFO:tasks.workunit.client.1.smithi142.stdout:1/847: fdatasync d12/d13/d20/d66/d7d/df5/f90 0 2024-09-13T02:52:51.135 INFO:tasks.workunit.client.1.smithi142.stdout:9/899: link dd/d17/d69/f10e dd/d17/d44/d82/d99/daf/dc9/d12c/f146 0 2024-09-13T02:52:51.138 INFO:tasks.workunit.client.0.smithi098.stdout:1/445: mknod d9/d33/d19/d2c/ca6 0 2024-09-13T02:52:51.139 INFO:tasks.workunit.client.0.smithi098.stdout:1/446: fdatasync d9/d33/d19/d35/d68/f18 0 2024-09-13T02:52:51.142 INFO:tasks.workunit.client.1.smithi142.stdout:6/872: mknod d1/dd/d57/d7b/c12a 0 2024-09-13T02:52:51.144 INFO:tasks.workunit.client.0.smithi098.stdout:1/447: rmdir d9/d33/d19/d35/d63 39 2024-09-13T02:52:51.146 INFO:tasks.workunit.client.1.smithi142.stdout:2/723: fdatasync d1/de/d31/d6c/d6d/f52 0 2024-09-13T02:52:51.148 INFO:tasks.workunit.client.0.smithi098.stdout:9/380: dwrite d2/d6/d36/f5b [0,4194304] 0 2024-09-13T02:52:51.150 INFO:tasks.workunit.client.1.smithi142.stdout:5/864: dwrite d8/dc3/df3/f94 [0,4194304] 0 2024-09-13T02:52:51.151 INFO:tasks.workunit.client.0.smithi098.stdout:1/448: write d9/d33/d1f/d6b/d7c/f96 [277464,48632] 0 2024-09-13T02:52:51.156 INFO:tasks.workunit.client.0.smithi098.stdout:9/381: rename d2/l49 to d2/d6/d36/d6a/l89 0 2024-09-13T02:52:51.157 INFO:tasks.workunit.client.1.smithi142.stdout:2/724: dwrite d1/de/d1f/d9c/db4/fbd [0,4194304] 0 2024-09-13T02:52:51.162 INFO:tasks.workunit.client.1.smithi142.stdout:3/804: write d12/d16/d25/d2e/d48/d5c/d8c/f9a [835664,34671] 0 2024-09-13T02:52:51.165 INFO:tasks.workunit.client.1.smithi142.stdout:9/900: fdatasync dd/d17/d4f/f67 0 2024-09-13T02:52:51.169 INFO:tasks.workunit.client.1.smithi142.stdout:0/872: dread d10/d6c/d88/d21/d51/d35/f76 [0,4194304] 0 2024-09-13T02:52:51.169 INFO:tasks.workunit.client.1.smithi142.stdout:4/806: truncate d0/d2b/f38 2740053 0 2024-09-13T02:52:51.170 INFO:tasks.workunit.client.1.smithi142.stdout:6/873: creat d1/dd/d16/d4d/f12b x:0 0 0 2024-09-13T02:52:51.172 INFO:tasks.workunit.client.1.smithi142.stdout:0/873: read - d10/d6c/d88/d21/d8f/fc5 zero size 2024-09-13T02:52:51.173 INFO:tasks.workunit.client.1.smithi142.stdout:9/901: read dd/d17/d44/d82/d99/daf/fbe [756209,91656] 0 2024-09-13T02:52:51.173 INFO:tasks.workunit.client.1.smithi142.stdout:8/740: link d0/d6/dc/d40/d46/f7b d0/d6/ff2 0 2024-09-13T02:52:51.174 INFO:tasks.workunit.client.1.smithi142.stdout:0/874: read d10/d6c/d88/d1a/d1e/d42/d4b/f74 [711141,31163] 0 2024-09-13T02:52:51.175 INFO:tasks.workunit.client.1.smithi142.stdout:2/725: dread - d1/de/d31/f62 zero size 2024-09-13T02:52:51.175 INFO:tasks.workunit.client.1.smithi142.stdout:2/726: stat d1/de/c11 0 2024-09-13T02:52:51.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.182+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faba01088a0 con 0x7fab8c06d650 2024-09-13T02:52:51.188 INFO:tasks.workunit.client.1.smithi142.stdout:5/865: creat d8/d47/d65/da0/dd1/db6/f116 x:0 0 0 2024-09-13T02:52:51.189 INFO:tasks.workunit.client.1.smithi142.stdout:8/741: creat d0/d75/ff3 x:0 0 0 2024-09-13T02:52:51.189 INFO:tasks.workunit.client.1.smithi142.stdout:7/893: dwrite d10/d13/d1d/d25/d45/d92/fba [4194304,4194304] 0 2024-09-13T02:52:51.190 INFO:tasks.workunit.client.1.smithi142.stdout:9/902: mknod dd/d17/d4f/c147 0 2024-09-13T02:52:51.192 INFO:tasks.workunit.client.1.smithi142.stdout:6/874: dread d1/dd/f35 [0,4194304] 0 2024-09-13T02:52:51.193 INFO:tasks.workunit.client.0.smithi098.stdout:9/382: symlink d2/d6/d2b/d4d/d4f/l8a 0 2024-09-13T02:52:51.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.196+0000 7fab9dffb700 1 -- 172.21.15.98:0/2232683185 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7faba01088a0 con 0x7fab8c06d650 2024-09-13T02:52:51.198 INFO:tasks.workunit.client.1.smithi142.stdout:3/805: unlink d12/d16/d3c/la6 0 2024-09-13T02:52:51.198 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:52:51.198 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (6m) 32s ago 8m 24.6M - 0.25.0 c8568f914cd2 babcc5d689b7 2024-09-13T02:52:51.198 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (8m) 32s ago 8m 7680k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:52:51.198 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (7m) 36s ago 7m 7306k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (8m) 32s ago 8m 6660k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (7m) 36s ago 7m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (6m) 32s ago 8m 87.8M - 9.4.7 954c08fa6188 6b3b619a7e20 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (2m) 32s ago 2m 161M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (2m) 32s ago 2m 152M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (2m) 36s ago 2m 12.9M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (2m) 36s ago 2m 16.0M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:9283,8765,8443 running (9m) 32s ago 9m 140M - 18.2.0 dc2bc1663786 230c0046ad07 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (60s) 36s ago 7m 479M - 19.1.1-322-g7741f7f9 19dc8d659727 0ffcd7ff6f2c 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (9m) 32s ago 9m 52.3M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (7m) 36s ago 7m 38.4M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (8m) 32s ago 8m 16.3M - 1.5.0 0da6a335fe13 5c48ece10527 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (7m) 36s ago 7m 15.0M - 1.5.0 0da6a335fe13 b2fc832c8f17 2024-09-13T02:52:51.199 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (6m) 32s ago 6m 83.7M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:52:51.200 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (6m) 32s ago 6m 78.9M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:52:51.200 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (5m) 32s ago 5m 73.4M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:52:51.200 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (5m) 36s ago 5m 83.8M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:52:51.200 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (4m) 36s ago 4m 79.2M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:52:51.200 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (4m) 36s ago 4m 73.8M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:52:51.200 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 starting - - - - 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fab8c06d650 msgr2=0x7fab8c06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fab8c06d650 0x7fab8c06fb00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab88005fd0 tx=0x7fab88005f60 comp rx=0 tx=0).stop 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 msgr2=0x7faba0197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 0x7faba0197ce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab9000bda0 tx=0x7fab9000be80 comp rx=0 tx=0).stop 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 shutdown_connections 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fab8c06d650 0x7fab8c06fb00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faba00feb50 0x7faba0197ce0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 --2- 172.21.15.98:0/2232683185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faba00ff4a0 0x7faba0198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 >> 172.21.15.98:0/2232683185 conn(0x7faba00fa780 msgr2=0x7faba0107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:51.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.199+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 shutdown_connections 2024-09-13T02:52:51.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.200+0000 7faba6682700 1 -- 172.21.15.98:0/2232683185 wait complete. 2024-09-13T02:52:51.203 INFO:tasks.workunit.client.1.smithi142.stdout:5/866: dread d8/d47/d65/da0/dd1/d45/d81/d8c/fa4 [0,4194304] 0 2024-09-13T02:52:51.203 INFO:tasks.workunit.client.1.smithi142.stdout:4/807: rename d0/d2b/d21/l85 to d0/d2b/d2d/d31/l105 0 2024-09-13T02:52:51.204 INFO:tasks.workunit.client.1.smithi142.stdout:5/867: fsync d8/d47/d65/da0/dd1/d2d/d90/fee 0 2024-09-13T02:52:51.207 INFO:tasks.workunit.client.0.smithi098.stdout:1/449: getdents d9/d33/d19/d35/d68/d4d 0 2024-09-13T02:52:51.208 INFO:tasks.workunit.client.1.smithi142.stdout:8/742: rmdir d0/d6/dc/d45/d8/df 39 2024-09-13T02:52:51.213 INFO:tasks.workunit.client.0.smithi098.stdout:1/450: unlink d9/d33/d1f/d23/c8d 0 2024-09-13T02:52:51.214 INFO:tasks.workunit.client.1.smithi142.stdout:6/875: mkdir d1/dd/d53/d78/d8f/da8/de6/d12c 0 2024-09-13T02:52:51.217 INFO:tasks.workunit.client.1.smithi142.stdout:1/848: getdents d12/d13 0 2024-09-13T02:52:51.218 INFO:tasks.workunit.client.1.smithi142.stdout:2/727: rename d1/de/d31/d6c/d6d/f5c to d1/de/d1f/d9c/fe5 0 2024-09-13T02:52:51.220 INFO:tasks.workunit.client.1.smithi142.stdout:4/808: creat d0/d2b/d21/f106 x:0 0 0 2024-09-13T02:52:51.223 INFO:tasks.workunit.client.1.smithi142.stdout:5/868: mkdir d8/dc3/df3/dc6/d117 0 2024-09-13T02:52:51.229 INFO:tasks.workunit.client.1.smithi142.stdout:7/894: mkdir d10/d34/d57/d98/dfe/d11f 0 2024-09-13T02:52:51.230 INFO:tasks.workunit.client.0.smithi098.stdout:9/383: dwrite d2/dd/d39/d43/f83 [0,4194304] 0 2024-09-13T02:52:51.235 INFO:tasks.workunit.client.1.smithi142.stdout:6/876: creat d1/d7/d5f/d60/d76/f12d x:0 0 0 2024-09-13T02:52:51.236 INFO:tasks.workunit.client.1.smithi142.stdout:6/877: chown d1/dd/f35 58 1 2024-09-13T02:52:51.237 INFO:tasks.workunit.client.0.smithi098.stdout:1/451: truncate d9/d33/f22 2796320 0 2024-09-13T02:52:51.239 INFO:tasks.workunit.client.1.smithi142.stdout:1/849: mknod d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/c10e 0 2024-09-13T02:52:51.241 INFO:tasks.workunit.client.1.smithi142.stdout:8/743: write d0/d6/d83/f9b [4068799,24400] 0 2024-09-13T02:52:51.241 INFO:tasks.workunit.client.1.smithi142.stdout:8/744: chown d0/d6/dc/d45/d35/fa4 0 1 2024-09-13T02:52:51.242 INFO:tasks.workunit.client.1.smithi142.stdout:2/728: mkdir d1/de/d1f/d13/d59/de6 0 2024-09-13T02:52:51.244 INFO:tasks.workunit.client.1.smithi142.stdout:4/809: creat d0/d2b/d2d/d31/d43/d48/f107 x:0 0 0 2024-09-13T02:52:51.246 INFO:tasks.workunit.client.0.smithi098.stdout:9/384: creat d2/d6/f8b x:0 0 0 2024-09-13T02:52:51.250 INFO:tasks.workunit.client.1.smithi142.stdout:0/875: getdents d10/d6c/d88/d1a/d1e/dc6/df3 0 2024-09-13T02:52:51.252 INFO:tasks.workunit.client.1.smithi142.stdout:3/806: creat d12/d16/d25/d2e/d38/d6b/ff9 x:0 0 0 2024-09-13T02:52:51.253 INFO:tasks.workunit.client.1.smithi142.stdout:0/876: truncate d10/d6c/d88/d45/db3/fc7 867158 0 2024-09-13T02:52:51.253 INFO:tasks.workunit.client.0.smithi098.stdout:5/316: sync 2024-09-13T02:52:51.253 INFO:tasks.workunit.client.0.smithi098.stdout:8/343: sync 2024-09-13T02:52:51.254 INFO:tasks.workunit.client.0.smithi098.stdout:7/532: sync 2024-09-13T02:52:51.254 INFO:tasks.workunit.client.0.smithi098.stdout:0/415: sync 2024-09-13T02:52:51.256 INFO:tasks.workunit.client.1.smithi142.stdout:8/745: fdatasync d0/d6/dc/d45/d35/f81 0 2024-09-13T02:52:51.257 INFO:tasks.workunit.client.0.smithi098.stdout:5/317: read d0/d15/d17/f2e [1964523,97488] 0 2024-09-13T02:52:51.259 INFO:tasks.workunit.client.1.smithi142.stdout:2/729: creat d1/de/d1f/d13/d59/fe7 x:0 0 0 2024-09-13T02:52:51.260 INFO:tasks.workunit.client.0.smithi098.stdout:1/452: write d9/d33/f22 [2640637,24012] 0 2024-09-13T02:52:51.261 INFO:tasks.workunit.client.1.smithi142.stdout:2/730: fsync d1/de/d31/d6c/d6d/d47/da8/fb3 0 2024-09-13T02:52:51.262 INFO:tasks.workunit.client.1.smithi142.stdout:8/746: dwrite d0/d6/dc/d45/fe3 [0,4194304] 0 2024-09-13T02:52:51.263 INFO:tasks.workunit.client.0.smithi098.stdout:9/385: dread d2/dd/d39/d43/f50 [0,4194304] 0 2024-09-13T02:52:51.267 INFO:tasks.workunit.client.0.smithi098.stdout:8/344: truncate d2/dd/f35 444995 0 2024-09-13T02:52:51.273 INFO:tasks.workunit.client.0.smithi098.stdout:0/416: symlink dd/df/d1d/d26/d28/l8b 0 2024-09-13T02:52:51.277 INFO:tasks.workunit.client.1.smithi142.stdout:9/903: rename dd/d17/d44/d82/d99/daf to dd/d148 0 2024-09-13T02:52:51.277 INFO:tasks.workunit.client.1.smithi142.stdout:8/747: dwrite d0/d6/dc/d45/d8/fe1 [0,4194304] 0 2024-09-13T02:52:51.279 INFO:tasks.workunit.client.1.smithi142.stdout:5/869: dwrite d8/d47/d65/da0/fd2 [0,4194304] 0 2024-09-13T02:52:51.284 INFO:tasks.workunit.client.0.smithi098.stdout:1/453: stat d9/d33/d19/d35/d68/d2f/c36 0 2024-09-13T02:52:51.286 INFO:tasks.workunit.client.0.smithi098.stdout:1/454: write d9/f84 [654035,97030] 0 2024-09-13T02:52:51.290 INFO:tasks.workunit.client.1.smithi142.stdout:6/878: truncate d1/d7/d19/f45 3232703 0 2024-09-13T02:52:51.291 INFO:tasks.workunit.client.1.smithi142.stdout:6/879: fsync d1/d7/f2a 0 2024-09-13T02:52:51.295 INFO:tasks.workunit.client.0.smithi098.stdout:9/386: creat d2/d6/d2b/d4d/f8c x:0 0 0 2024-09-13T02:52:51.298 INFO:tasks.workunit.client.1.smithi142.stdout:6/880: dwrite d1/dd/d53/d78/d8f/da8/fb4 [0,4194304] 0 2024-09-13T02:52:51.298 INFO:tasks.workunit.client.1.smithi142.stdout:4/810: dread d0/df/f1f [0,4194304] 0 2024-09-13T02:52:51.303 INFO:tasks.workunit.client.1.smithi142.stdout:2/731: symlink d1/de/da6/dbb/d6f/le8 0 2024-09-13T02:52:51.312 INFO:tasks.workunit.client.1.smithi142.stdout:2/732: dread d1/de/f22 [0,4194304] 0 2024-09-13T02:52:51.314 INFO:tasks.workunit.client.0.smithi098.stdout:7/533: write d6/d1e/f1f [1180624,17776] 0 2024-09-13T02:52:51.316 INFO:tasks.workunit.client.0.smithi098.stdout:7/534: write d6/d24/d46/f50 [4562454,50753] 0 2024-09-13T02:52:51.316 INFO:tasks.workunit.client.0.smithi098.stdout:7/535: chown d6/d47 2410 1 2024-09-13T02:52:51.321 INFO:tasks.workunit.client.0.smithi098.stdout:5/318: mknod d0/d15/d69/c6f 0 2024-09-13T02:52:51.329 INFO:tasks.workunit.client.0.smithi098.stdout:5/319: dwrite d0/d38/d3f/d1a/d27/f6b [0,4194304] 0 2024-09-13T02:52:51.329 INFO:tasks.workunit.client.1.smithi142.stdout:7/895: sync 2024-09-13T02:52:51.330 INFO:tasks.workunit.client.0.smithi098.stdout:8/345: write d2/dd/d11/f18 [2041410,14953] 0 2024-09-13T02:52:51.331 INFO:tasks.workunit.client.1.smithi142.stdout:4/811: dread d0/d2b/d2d/d31/f8b [0,4194304] 0 2024-09-13T02:52:51.331 INFO:tasks.workunit.client.1.smithi142.stdout:4/812: dread - d0/d2b/d2d/d31/d43/d48/f107 zero size 2024-09-13T02:52:51.333 INFO:tasks.workunit.client.1.smithi142.stdout:4/813: write d0/df/d57/f53 [5062500,2561] 0 2024-09-13T02:52:51.335 INFO:tasks.workunit.client.1.smithi142.stdout:7/896: dwrite d10/d13/d1d/d25/d45/d6d/dc3/f43 [0,4194304] 0 2024-09-13T02:52:51.348 INFO:tasks.workunit.client.0.smithi098.stdout:0/417: rename dd/df/d1d/d26/d37/d53/c76 to dd/df/d1d/d26/d28/d32/d67/d71/c8c 0 2024-09-13T02:52:51.351 INFO:tasks.workunit.client.0.smithi098.stdout:5/320: rename d0/c2a to d0/c70 0 2024-09-13T02:52:51.352 INFO:tasks.workunit.client.0.smithi098.stdout:5/321: truncate d0/d29/f63 4423097 0 2024-09-13T02:52:51.353 INFO:tasks.workunit.client.0.smithi098.stdout:8/346: symlink d2/dd/d11/d2c/l6a 0 2024-09-13T02:52:51.356 INFO:tasks.workunit.client.0.smithi098.stdout:1/455: rename d9/d33/d19/d2c to d9/d33/d1f/d23/da7 0 2024-09-13T02:52:51.359 INFO:tasks.workunit.client.0.smithi098.stdout:0/418: mkdir dd/df/d1d/d26/d28/d32/d8d 0 2024-09-13T02:52:51.360 INFO:tasks.workunit.client.0.smithi098.stdout:0/419: dread - dd/df/d1d/f63 zero size 2024-09-13T02:52:51.361 INFO:tasks.workunit.client.0.smithi098.stdout:5/322: creat d0/d15/d69/f71 x:0 0 0 2024-09-13T02:52:51.365 INFO:tasks.workunit.client.0.smithi098.stdout:9/387: rename d2/dd to d2/d6/d36/d8d 0 2024-09-13T02:52:51.365 INFO:tasks.workunit.client.0.smithi098.stdout:7/536: dread d6/d24/d2a/f3a [0,4194304] 0 2024-09-13T02:52:51.371 INFO:tasks.workunit.client.0.smithi098.stdout:0/420: write dd/df/d1d/d40/f6c [537138,86798] 0 2024-09-13T02:52:51.372 INFO:tasks.workunit.client.0.smithi098.stdout:8/347: mknod d2/d28/c6b 0 2024-09-13T02:52:51.375 INFO:tasks.workunit.client.0.smithi098.stdout:9/388: fsync d2/d6/d36/d8d/f1f 0 2024-09-13T02:52:51.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.374+0000 7f5a4e043700 1 -- 172.21.15.98:0/1597047528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a48100240 msgr2=0x7f5a48100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:51.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.374+0000 7f5a4e043700 1 --2- 172.21.15.98:0/1597047528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a48100240 0x7f5a48100650 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009910 tx=0x7f5a38009c20 comp rx=0 tx=0).stop 2024-09-13T02:52:51.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.374+0000 7f5a4e043700 1 -- 172.21.15.98:0/1597047528 shutdown_connections 2024-09-13T02:52:51.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.374+0000 7f5a4e043700 1 --2- 172.21.15.98:0/1597047528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a48101440 0x7f5a48101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.374+0000 7f5a4e043700 1 --2- 172.21.15.98:0/1597047528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a48100240 0x7f5a48100650 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.374+0000 7f5a4e043700 1 -- 172.21.15.98:0/1597047528 >> 172.21.15.98:0/1597047528 conn(0x7f5a480fb7f0 msgr2=0x7f5a480fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:51.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.375+0000 7f5a4e043700 1 -- 172.21.15.98:0/1597047528 shutdown_connections 2024-09-13T02:52:51.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.375+0000 7f5a4e043700 1 -- 172.21.15.98:0/1597047528 wait complete. 2024-09-13T02:52:51.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a4e043700 1 Processor -- start 2024-09-13T02:52:51.377 INFO:tasks.workunit.client.0.smithi098.stdout:9/389: truncate d2/d6/d36/f4e 1284729 0 2024-09-13T02:52:51.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a4e043700 1 -- start start 2024-09-13T02:52:51.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a4e043700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a48100240 0x7f5a48195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:51.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a4e043700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a48101440 0x7f5a48195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:51.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a4e043700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48196610 con 0x7f5a48101440 2024-09-13T02:52:51.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a4e043700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48196750 con 0x7f5a48100240 2024-09-13T02:52:51.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a477fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a48100240 0x7f5a48195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:51.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a477fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a48100240 0x7f5a48195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.98:40702/0 (socket says 172.21.15.98:40702) 2024-09-13T02:52:51.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a477fe700 1 -- 172.21.15.98:0/2576155816 learned_addr learned my addr 172.21.15.98:0/2576155816 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:51.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.376+0000 7f5a46ffd700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a48101440 0x7f5a48195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:51.379 INFO:tasks.workunit.client.0.smithi098.stdout:7/537: truncate d6/f19 723094 0 2024-09-13T02:52:51.379 INFO:tasks.workunit.client.0.smithi098.stdout:9/390: stat d2/d6/d36/d8d/d39/f5a 0 2024-09-13T02:52:51.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.377+0000 7f5a477fe700 1 -- 172.21.15.98:0/2576155816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a48101440 msgr2=0x7f5a48195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:51.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.377+0000 7f5a477fe700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a48101440 0x7f5a48195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.377+0000 7f5a477fe700 1 -- 172.21.15.98:0/2576155816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380095f0 con 0x7f5a48100240 2024-09-13T02:52:51.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.377+0000 7f5a477fe700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a48100240 0x7f5a48195ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800bda0 tx=0x7f5a3800bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:51.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.377+0000 7f5a44ff9700 1 -- 172.21.15.98:0/2576155816 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a3801d070 con 0x7f5a48100240 2024-09-13T02:52:51.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.377+0000 7f5a44ff9700 1 -- 172.21.15.98:0/2576155816 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a3800f460 con 0x7f5a48100240 2024-09-13T02:52:51.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.377+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4819b1a0 con 0x7f5a48100240 2024-09-13T02:52:51.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.377+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4819b690 con 0x7f5a48100240 2024-09-13T02:52:51.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.377+0000 7f5a44ff9700 1 -- 172.21.15.98:0/2576155816 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a38021640 con 0x7f5a48100240 2024-09-13T02:52:51.381 INFO:tasks.workunit.client.0.smithi098.stdout:9/391: chown d2/d6/d36/d8d/d39/l41 36 1 2024-09-13T02:52:51.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.379+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a34005320 con 0x7f5a48100240 2024-09-13T02:52:51.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.379+0000 7f5a44ff9700 1 -- 172.21.15.98:0/2576155816 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f5a38003a60 con 0x7f5a48100240 2024-09-13T02:52:51.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.380+0000 7f5a44ff9700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f5a3006d600 0x7f5a3006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:51.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.380+0000 7f5a44ff9700 1 -- 172.21.15.98:0/2576155816 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f5a3808df40 con 0x7f5a48100240 2024-09-13T02:52:51.382 INFO:tasks.workunit.client.0.smithi098.stdout:9/392: write d2/d6/d2b/d4d/f8c [30796,46013] 0 2024-09-13T02:52:51.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.380+0000 7f5a46ffd700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f5a3006d600 0x7f5a3006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:51.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.381+0000 7f5a46ffd700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f5a3006d600 0x7f5a3006fab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c005950 tx=0x7f5a3c00b410 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:51.384 INFO:tasks.workunit.client.1.smithi142.stdout:1/850: sync 2024-09-13T02:52:51.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.385+0000 7f5a44ff9700 1 -- 172.21.15.98:0/2576155816 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5a380c29d0 con 0x7f5a48100240 2024-09-13T02:52:51.388 INFO:tasks.workunit.client.0.smithi098.stdout:0/421: dwrite dd/df/d1d/d26/d37/f73 [0,4194304] 0 2024-09-13T02:52:51.389 INFO:tasks.workunit.client.0.smithi098.stdout:7/538: fdatasync d6/d24/d2a/d5a/d86/f4e 0 2024-09-13T02:52:51.390 INFO:tasks.workunit.client.0.smithi098.stdout:0/422: write dd/f59 [158644,14202] 0 2024-09-13T02:52:51.395 INFO:tasks.workunit.client.0.smithi098.stdout:9/393: chown d2/d6/d36/f82 2002450 1 2024-09-13T02:52:51.398 INFO:tasks.workunit.client.0.smithi098.stdout:8/348: symlink d2/l6c 0 2024-09-13T02:52:51.402 INFO:tasks.workunit.client.0.smithi098.stdout:0/423: dread dd/f24 [0,4194304] 0 2024-09-13T02:52:51.406 INFO:tasks.workunit.client.0.smithi098.stdout:1/456: creat d9/d33/d29/fa8 x:0 0 0 2024-09-13T02:52:51.406 INFO:tasks.workunit.client.0.smithi098.stdout:1/457: stat d9/d33/d19/d35/d68/d4d/c93 0 2024-09-13T02:52:51.409 INFO:tasks.workunit.client.0.smithi098.stdout:7/539: rmdir d6/d24/d2a/d5a/d42/d45 39 2024-09-13T02:52:51.414 INFO:tasks.workunit.client.0.smithi098.stdout:7/540: dwrite d6/d1e/f36 [0,4194304] 0 2024-09-13T02:52:51.415 INFO:tasks.workunit.client.0.smithi098.stdout:9/394: rename d2/d6/d36/c6e to d2/d6/d36/c8e 0 2024-09-13T02:52:51.419 INFO:tasks.workunit.client.0.smithi098.stdout:0/424: symlink dd/df/d1d/d26/d28/d32/d67/d81/l8e 0 2024-09-13T02:52:51.422 INFO:tasks.workunit.client.0.smithi098.stdout:1/458: unlink d9/c4b 0 2024-09-13T02:52:51.430 INFO:tasks.workunit.client.0.smithi098.stdout:7/541: symlink d6/d24/d2a/d5a/d86/d65/la9 0 2024-09-13T02:52:51.431 INFO:tasks.workunit.client.0.smithi098.stdout:7/542: write d6/d24/d46/f50 [653087,7033] 0 2024-09-13T02:52:51.435 INFO:tasks.workunit.client.0.smithi098.stdout:1/459: mknod d9/d33/d1f/d6b/ca9 0 2024-09-13T02:52:51.442 INFO:tasks.workunit.client.0.smithi098.stdout:7/543: creat d6/d24/d2a/d57/faa x:0 0 0 2024-09-13T02:52:51.443 INFO:tasks.workunit.client.1.smithi142.stdout:5/870: unlink d8/d47/d65/da0/dd1/l55 0 2024-09-13T02:52:51.446 INFO:tasks.workunit.client.1.smithi142.stdout:3/807: symlink d12/d16/d3c/lfa 0 2024-09-13T02:52:51.448 INFO:tasks.workunit.client.0.smithi098.stdout:8/349: dread d2/dd/d4d/f67 [4194304,4194304] 0 2024-09-13T02:52:51.448 INFO:tasks.workunit.client.0.smithi098.stdout:7/544: truncate d6/d24/f5f 438203 0 2024-09-13T02:52:51.452 INFO:tasks.workunit.client.0.smithi098.stdout:1/460: creat d9/d33/d19/d35/d63/faa x:0 0 0 2024-09-13T02:52:51.459 INFO:tasks.workunit.client.0.smithi098.stdout:0/425: dread dd/df/d1d/d26/d28/f30 [0,4194304] 0 2024-09-13T02:52:51.460 INFO:tasks.workunit.client.0.smithi098.stdout:8/350: mkdir d2/d2f/d5f/d46/d6d 0 2024-09-13T02:52:51.461 INFO:tasks.workunit.client.0.smithi098.stdout:0/426: read dd/f45 [4083183,36321] 0 2024-09-13T02:52:51.462 INFO:tasks.workunit.client.0.smithi098.stdout:1/461: dread d9/d33/d19/d35/d68/d2f/f49 [0,4194304] 0 2024-09-13T02:52:51.463 INFO:tasks.workunit.client.0.smithi098.stdout:0/427: chown dd/df/d1d/d26/d37/c48 24813 1 2024-09-13T02:52:51.466 INFO:tasks.workunit.client.0.smithi098.stdout:7/545: dread d6/d24/d2a/d5a/d42/f8b [0,4194304] 0 2024-09-13T02:52:51.469 INFO:tasks.workunit.client.0.smithi098.stdout:8/351: dwrite d2/dd/d11/d1d/f3e [0,4194304] 0 2024-09-13T02:52:51.470 INFO:tasks.workunit.client.0.smithi098.stdout:8/352: write d2/dd/d11/d1d/f3e [163751,61467] 0 2024-09-13T02:52:51.471 INFO:tasks.workunit.client.1.smithi142.stdout:2/733: rename d1/de/d1f/d9c/db4 to d1/de/d1f/d13/d60/da9/de9 0 2024-09-13T02:52:51.479 INFO:tasks.workunit.client.0.smithi098.stdout:0/428: rename dd/df/d1d/d26/d37/d53/f58 to dd/df/d1d/d40/d46/d6b/f8f 0 2024-09-13T02:52:51.480 INFO:tasks.workunit.client.0.smithi098.stdout:9/395: dwrite d2/d6/d36/f58 [0,4194304] 0 2024-09-13T02:52:51.482 INFO:tasks.workunit.client.0.smithi098.stdout:1/462: fdatasync d9/d33/f67 0 2024-09-13T02:52:51.484 INFO:tasks.workunit.client.1.smithi142.stdout:7/897: write d10/d13/d1d/d25/d45/dad/fe0 [284456,76718] 0 2024-09-13T02:52:51.485 INFO:tasks.workunit.client.0.smithi098.stdout:9/396: dread d2/d6/d2b/f47 [0,4194304] 0 2024-09-13T02:52:51.488 INFO:tasks.workunit.client.1.smithi142.stdout:1/851: creat d12/d13/d20/d27/d3c/d71/f10f x:0 0 0 2024-09-13T02:52:51.488 INFO:tasks.workunit.client.0.smithi098.stdout:9/397: chown d2/d6/d2b/d4d/d4f 365 1 2024-09-13T02:52:51.489 INFO:tasks.workunit.client.0.smithi098.stdout:7/546: mkdir d6/dab 0 2024-09-13T02:52:51.490 INFO:tasks.workunit.client.0.smithi098.stdout:9/398: write d2/d6/d36/f58 [3163207,19566] 0 2024-09-13T02:52:51.491 INFO:tasks.workunit.client.0.smithi098.stdout:9/399: chown d2/d6/l4a 9379 1 2024-09-13T02:52:51.491 INFO:tasks.workunit.client.1.smithi142.stdout:9/904: link dd/d17/d44/d82/d99/da8/db7/fc4 dd/d17/d44/d82/d99/da8/f149 0 2024-09-13T02:52:51.493 INFO:tasks.workunit.client.0.smithi098.stdout:9/400: read d2/d6/d2b/d4d/d4f/d6c/f85 [1579658,99297] 0 2024-09-13T02:52:51.494 INFO:tasks.workunit.client.0.smithi098.stdout:8/353: rename d2/d2f/d5f/d46/d66 to d2/d2f/d5f/d46/d47/d6e 0 2024-09-13T02:52:51.502 INFO:tasks.workunit.client.0.smithi098.stdout:0/429: symlink dd/df/d1d/d26/d28/d5d/l90 0 2024-09-13T02:52:51.505 INFO:tasks.workunit.client.0.smithi098.stdout:1/463: unlink d9/d33/d19/d35/d63/c79 0 2024-09-13T02:52:51.511 INFO:tasks.workunit.client.1.smithi142.stdout:2/734: symlink d1/d2d/lea 0 2024-09-13T02:52:51.512 INFO:tasks.workunit.client.1.smithi142.stdout:2/735: stat d1/de/da6/dbb/dc2/fcd 0 2024-09-13T02:52:51.514 INFO:tasks.workunit.client.1.smithi142.stdout:4/814: dwrite d0/d2b/d2d/d31/d43/d48/f68 [0,4194304] 0 2024-09-13T02:52:51.515 INFO:tasks.workunit.client.1.smithi142.stdout:4/815: chown d0/d2b/d2d/d31/d32/d82/db0 25148 1 2024-09-13T02:52:51.516 INFO:tasks.workunit.client.0.smithi098.stdout:9/401: creat d2/d6/d2b/d4d/d4f/d6c/f8f x:0 0 0 2024-09-13T02:52:51.520 INFO:tasks.workunit.client.1.smithi142.stdout:9/905: mkdir dd/d17/d69/d14a 0 2024-09-13T02:52:51.522 INFO:tasks.workunit.client.0.smithi098.stdout:0/430: creat dd/df/d1d/d26/d28/d32/d67/d81/f91 x:0 0 0 2024-09-13T02:52:51.523 INFO:tasks.workunit.client.0.smithi098.stdout:1/464: readlink d9/d33/l6a 0 2024-09-13T02:52:51.524 INFO:tasks.workunit.client.1.smithi142.stdout:4/816: dwrite d0/d2b/d21/f106 [0,4194304] 0 2024-09-13T02:52:51.524 INFO:tasks.workunit.client.1.smithi142.stdout:8/748: truncate d0/d6/dc/d45/d35/d37/f54 957495 0 2024-09-13T02:52:51.526 INFO:tasks.workunit.client.0.smithi098.stdout:7/547: dread - d6/d24/d2a/d5a/d42/d45/d73/f98 zero size 2024-09-13T02:52:51.527 INFO:tasks.workunit.client.1.smithi142.stdout:5/871: dwrite d8/dc3/d3f/d4a/fc8 [0,4194304] 0 2024-09-13T02:52:51.527 INFO:tasks.workunit.client.1.smithi142.stdout:4/817: readlink d0/d2b/d2d/d31/d32/l97 0 2024-09-13T02:52:51.527 INFO:tasks.workunit.client.0.smithi098.stdout:0/431: dread dd/df/d1d/d26/d28/f30 [0,4194304] 0 2024-09-13T02:52:51.528 INFO:tasks.workunit.client.1.smithi142.stdout:5/872: rename d8/d47/df1 to d8/d47/df1/d118 22 2024-09-13T02:52:51.529 INFO:tasks.workunit.client.1.smithi142.stdout:0/877: getdents d10/d6c/d88/d21/d8f 0 2024-09-13T02:52:51.530 INFO:tasks.workunit.client.1.smithi142.stdout:3/808: dwrite d12/f28 [0,4194304] 0 2024-09-13T02:52:51.532 INFO:tasks.workunit.client.0.smithi098.stdout:9/402: mkdir d2/d6/d36/d8d/d39/d43/d90 0 2024-09-13T02:52:51.533 INFO:tasks.workunit.client.0.smithi098.stdout:9/403: fsync d2/d6/d36/d8d/d39/f62 0 2024-09-13T02:52:51.533 INFO:tasks.workunit.client.1.smithi142.stdout:3/809: readlink d12/d16/d3c/d79/d9b/lb5 0 2024-09-13T02:52:51.533 INFO:tasks.workunit.client.0.smithi098.stdout:8/354: write f1 [4774398,121929] 0 2024-09-13T02:52:51.535 INFO:tasks.workunit.client.0.smithi098.stdout:6/341: sync 2024-09-13T02:52:51.535 INFO:tasks.workunit.client.0.smithi098.stdout:2/330: sync 2024-09-13T02:52:51.535 INFO:tasks.workunit.client.0.smithi098.stdout:3/379: sync 2024-09-13T02:52:51.536 INFO:tasks.workunit.client.1.smithi142.stdout:6/881: dwrite d1/dd/d53/d78/d8f/da8/de6/f82 [0,4194304] 0 2024-09-13T02:52:51.538 INFO:tasks.workunit.client.0.smithi098.stdout:7/548: creat d6/d24/d2a/d5a/d4c/fac x:0 0 0 2024-09-13T02:52:51.538 INFO:tasks.workunit.client.0.smithi098.stdout:2/331: chown d1/d1a/f3a 832298 1 2024-09-13T02:52:51.538 INFO:tasks.workunit.client.1.smithi142.stdout:7/898: write d10/d13/d1d/d2b/d56/d39/fbf [441876,125979] 0 2024-09-13T02:52:51.541 INFO:tasks.workunit.client.1.smithi142.stdout:8/749: chown d0/d6/d23/l90 54844998 1 2024-09-13T02:52:51.541 INFO:tasks.workunit.client.0.smithi098.stdout:1/465: dread d9/d33/f66 [0,4194304] 0 2024-09-13T02:52:51.544 INFO:tasks.workunit.client.0.smithi098.stdout:1/466: truncate d9/d33/d19/d35/d68/f3f 4898252 0 2024-09-13T02:52:51.546 INFO:tasks.workunit.client.1.smithi142.stdout:8/750: dwrite d0/d6/dc/d2e/fb7 [0,4194304] 0 2024-09-13T02:52:51.547 INFO:tasks.workunit.client.0.smithi098.stdout:3/380: readlink d7/d9/d15/l37 0 2024-09-13T02:52:51.547 INFO:tasks.workunit.client.0.smithi098.stdout:8/355: mknod d2/dd/d11/d1d/c6f 0 2024-09-13T02:52:51.548 INFO:tasks.workunit.client.0.smithi098.stdout:8/356: chown d2/dd/d11/d49 0 1 2024-09-13T02:52:51.551 INFO:tasks.workunit.client.0.smithi098.stdout:9/404: rmdir d2/d6/d2b/d4d 39 2024-09-13T02:52:51.554 INFO:tasks.workunit.client.1.smithi142.stdout:2/736: symlink d1/de/d1f/d13/d59/de6/leb 0 2024-09-13T02:52:51.554 INFO:tasks.workunit.client.1.smithi142.stdout:2/737: stat d1/de/d1f/d13/f5e 0 2024-09-13T02:52:51.556 INFO:tasks.workunit.client.1.smithi142.stdout:6/882: creat d1/d4a/f12e x:0 0 0 2024-09-13T02:52:51.557 INFO:tasks.workunit.client.1.smithi142.stdout:6/883: write d1/d7/d19/f45 [3038965,47639] 0 2024-09-13T02:52:51.560 INFO:tasks.workunit.client.0.smithi098.stdout:6/342: truncate d5/f33 1917364 0 2024-09-13T02:52:51.562 INFO:tasks.workunit.client.0.smithi098.stdout:8/357: mknod d2/dd/d2e/c70 0 2024-09-13T02:52:51.564 INFO:tasks.workunit.client.1.smithi142.stdout:5/873: rename d8/dc3/d3f/f10b to d8/dc3/d3f/ddd/f119 0 2024-09-13T02:52:51.565 INFO:tasks.workunit.client.0.smithi098.stdout:9/405: chown d2/d6/d2b/d4d/d56/c6f 6 1 2024-09-13T02:52:51.567 INFO:tasks.workunit.client.0.smithi098.stdout:7/549: rename d6/d1e/l33 to d6/d24/d63/lad 0 2024-09-13T02:52:51.571 INFO:tasks.workunit.client.0.smithi098.stdout:4/311: sync 2024-09-13T02:52:51.571 INFO:tasks.workunit.client.0.smithi098.stdout:6/343: creat d5/d13/d2b/d3a/d41/f77 x:0 0 0 2024-09-13T02:52:51.572 INFO:tasks.workunit.client.1.smithi142.stdout:2/738: fsync d1/de/f26 0 2024-09-13T02:52:51.573 INFO:tasks.workunit.client.0.smithi098.stdout:6/344: write d5/d18/f3c [442647,70564] 0 2024-09-13T02:52:51.578 INFO:tasks.workunit.client.0.smithi098.stdout:3/381: rename d7/d9/d15/d5d/c73 to d7/d9/d25/d3a/c77 0 2024-09-13T02:52:51.578 INFO:tasks.workunit.client.0.smithi098.stdout:3/382: fdatasync d7/d9/f31 0 2024-09-13T02:52:51.580 INFO:tasks.workunit.client.1.smithi142.stdout:6/884: mknod d1/d7/d19/d48/d90/d11e/c12f 0 2024-09-13T02:52:51.582 INFO:tasks.workunit.client.0.smithi098.stdout:2/332: link d1/d1f/d35/d63/d23/c25 d1/d1f/d30/c68 0 2024-09-13T02:52:51.584 INFO:tasks.workunit.client.1.smithi142.stdout:8/751: symlink d0/d6/dc/d40/d41/de2/lf4 0 2024-09-13T02:52:51.589 INFO:tasks.workunit.client.0.smithi098.stdout:4/312: rmdir d6/d22/d3d/d41/d58 39 2024-09-13T02:52:51.590 INFO:tasks.workunit.client.0.smithi098.stdout:0/432: truncate dd/f10 332017 0 2024-09-13T02:52:51.590 INFO:tasks.workunit.client.0.smithi098.stdout:2/333: dwrite d1/d1f/d30/f3e [0,4194304] 0 2024-09-13T02:52:51.590 INFO:tasks.workunit.client.1.smithi142.stdout:4/818: dwrite d0/d2b/d2d/d31/fb7 [4194304,4194304] 0 2024-09-13T02:52:51.595 INFO:tasks.workunit.client.0.smithi098.stdout:4/313: truncate d6/d10/d21/f65 85465 0 2024-09-13T02:52:51.599 INFO:tasks.workunit.client.1.smithi142.stdout:3/810: dwrite d12/d16/d25/d2e/d48/d5c/d8c/daf/fdc [0,4194304] 0 2024-09-13T02:52:51.599 INFO:tasks.workunit.client.0.smithi098.stdout:4/314: chown d6/c16 7 1 2024-09-13T02:52:51.601 INFO:tasks.workunit.client.1.smithi142.stdout:1/852: sync 2024-09-13T02:52:51.601 INFO:tasks.workunit.client.1.smithi142.stdout:3/811: write d12/d16/d3c/f62 [5078384,60859] 0 2024-09-13T02:52:51.601 INFO:tasks.workunit.client.0.smithi098.stdout:2/334: dwrite d1/d1f/f42 [0,4194304] 0 2024-09-13T02:52:51.602 INFO:tasks.workunit.client.0.smithi098.stdout:7/550: dread d6/d24/d2a/d57/f61 [0,4194304] 0 2024-09-13T02:52:51.603 INFO:tasks.workunit.client.1.smithi142.stdout:1/853: fsync d12/d13/d20/d66/d55/db4/fd5 0 2024-09-13T02:52:51.603 INFO:tasks.workunit.client.0.smithi098.stdout:9/406: mkdir d2/d6/d91 0 2024-09-13T02:52:51.604 INFO:tasks.workunit.client.1.smithi142.stdout:6/885: mknod d1/dd/d53/d78/d8f/da8/c130 0 2024-09-13T02:52:51.605 INFO:tasks.workunit.client.1.smithi142.stdout:1/854: read - d12/d13/ff9 zero size 2024-09-13T02:52:51.608 INFO:tasks.workunit.client.1.smithi142.stdout:1/855: read fe [4026439,93856] 0 2024-09-13T02:52:51.612 INFO:tasks.workunit.client.1.smithi142.stdout:0/878: truncate d10/d6c/d88/d21/d51/d35/f8c 872576 0 2024-09-13T02:52:51.614 INFO:tasks.workunit.client.0.smithi098.stdout:4/315: dwrite d6/d10/f1f [0,4194304] 0 2024-09-13T02:52:51.619 INFO:tasks.workunit.client.1.smithi142.stdout:2/739: dread d1/de/f18 [0,4194304] 0 2024-09-13T02:52:51.620 INFO:tasks.workunit.client.0.smithi098.stdout:3/383: rmdir d7/d9/d15/d5d 39 2024-09-13T02:52:51.623 INFO:tasks.workunit.client.0.smithi098.stdout:5/323: sync 2024-09-13T02:52:51.623 INFO:tasks.workunit.client.0.smithi098.stdout:5/324: dread - d0/d38/f55 zero size 2024-09-13T02:52:51.624 INFO:tasks.workunit.client.0.smithi098.stdout:5/325: readlink d0/d15/l48 0 2024-09-13T02:52:51.625 INFO:tasks.workunit.client.0.smithi098.stdout:0/433: fdatasync dd/df/d1d/f2f 0 2024-09-13T02:52:51.627 INFO:tasks.workunit.client.0.smithi098.stdout:5/326: write d0/d38/d3f/d1a/d27/f6b [2370578,72526] 0 2024-09-13T02:52:51.627 INFO:tasks.workunit.client.1.smithi142.stdout:4/819: rename d0/df/da5/dad/lbe to d0/d2b/dd8/l108 0 2024-09-13T02:52:51.631 INFO:tasks.workunit.client.1.smithi142.stdout:3/812: dread d12/d16/d25/d2e/d38/d4d/d53/feb [0,4194304] 0 2024-09-13T02:52:51.644 INFO:tasks.workunit.client.1.smithi142.stdout:6/886: rmdir d1 39 2024-09-13T02:52:51.645 INFO:tasks.workunit.client.1.smithi142.stdout:9/906: sync 2024-09-13T02:52:51.646 INFO:tasks.workunit.client.1.smithi142.stdout:7/899: getdents d10/d64/d88 0 2024-09-13T02:52:51.653 INFO:tasks.workunit.client.0.smithi098.stdout:9/407: truncate d2/d6/f35 564112 0 2024-09-13T02:52:51.654 INFO:tasks.workunit.client.1.smithi142.stdout:0/879: rmdir d10/d6c/d88/d1a/d1e/dc6/df3 39 2024-09-13T02:52:51.656 INFO:tasks.workunit.client.0.smithi098.stdout:4/316: mkdir d6/d22/d3d/d64/d6f 0 2024-09-13T02:52:51.663 INFO:tasks.workunit.client.1.smithi142.stdout:2/740: mknod d1/de/da6/dbb/dc2/cec 0 2024-09-13T02:52:51.667 INFO:tasks.workunit.client.0.smithi098.stdout:5/327: symlink d0/d38/d3f/d1a/d32/l72 0 2024-09-13T02:52:51.669 INFO:tasks.workunit.client.0.smithi098.stdout:8/358: link d2/d2f/d5f/d46/c5e d2/d28/d43/c71 0 2024-09-13T02:52:51.669 INFO:tasks.workunit.client.0.smithi098.stdout:4/317: dread d6/d22/d3d/f49 [0,4194304] 0 2024-09-13T02:52:51.671 INFO:tasks.workunit.client.1.smithi142.stdout:6/887: write d1/d7/d5f/d60/d76/f112 [1952018,21469] 0 2024-09-13T02:52:51.672 INFO:tasks.workunit.client.1.smithi142.stdout:9/907: unlink dd/d17/d68/f12e 0 2024-09-13T02:52:51.675 INFO:tasks.workunit.client.0.smithi098.stdout:6/345: rmdir d5/d13/d51/d70 0 2024-09-13T02:52:51.676 INFO:tasks.workunit.client.0.smithi098.stdout:6/346: chown d5/d13/f3f 59001 1 2024-09-13T02:52:51.677 INFO:tasks.workunit.client.1.smithi142.stdout:7/900: read d10/d13/d1d/d25/d45/d6d/fa9 [2937811,38602] 0 2024-09-13T02:52:51.679 INFO:tasks.workunit.client.0.smithi098.stdout:7/551: mknod d6/d24/d2a/d5a/d42/cae 0 2024-09-13T02:52:51.680 INFO:tasks.workunit.client.0.smithi098.stdout:7/552: read d6/d24/d2a/d5a/d42/f8b [913276,59220] 0 2024-09-13T02:52:51.681 INFO:tasks.workunit.client.0.smithi098.stdout:1/467: rename d9/d33/d19/d35/d68/d60/f9a to d9/d33/d19/d35/fab 0 2024-09-13T02:52:51.683 INFO:tasks.workunit.client.1.smithi142.stdout:0/880: chown d10/c2e 0 1 2024-09-13T02:52:51.684 INFO:tasks.workunit.client.1.smithi142.stdout:5/874: getdents d8/dc3/df3/dc6/de2/d10a 0 2024-09-13T02:52:51.684 INFO:tasks.workunit.client.0.smithi098.stdout:3/384: getdents d7/d9/d15/d2d/d5b/d70 0 2024-09-13T02:52:51.685 INFO:tasks.workunit.client.0.smithi098.stdout:9/408: dread d2/d6/d36/d8d/d39/f3e [0,4194304] 0 2024-09-13T02:52:51.686 INFO:tasks.workunit.client.0.smithi098.stdout:3/385: stat d7/d9/l2e 0 2024-09-13T02:52:51.686 INFO:tasks.workunit.client.0.smithi098.stdout:9/409: dread - d2/d6/f29 zero size 2024-09-13T02:52:51.686 INFO:tasks.workunit.client.0.smithi098.stdout:3/386: readlink d7/d9/l2e 0 2024-09-13T02:52:51.687 INFO:tasks.workunit.client.0.smithi098.stdout:5/328: creat d0/d38/d3f/f73 x:0 0 0 2024-09-13T02:52:51.687 INFO:tasks.workunit.client.0.smithi098.stdout:3/387: read - d7/d9/d25/d3a/d52/f55 zero size 2024-09-13T02:52:51.688 INFO:tasks.workunit.client.0.smithi098.stdout:3/388: fsync d7/d9/d25/d3a/d51/f69 0 2024-09-13T02:52:51.689 INFO:tasks.workunit.client.0.smithi098.stdout:8/359: rmdir d2/d28/d43 39 2024-09-13T02:52:51.690 INFO:tasks.workunit.client.0.smithi098.stdout:4/318: rmdir d6/d3e/d68 39 2024-09-13T02:52:51.692 INFO:tasks.workunit.client.0.smithi098.stdout:8/360: fsync d2/dd/d11/f18 0 2024-09-13T02:52:51.693 INFO:tasks.workunit.client.1.smithi142.stdout:7/901: dread d10/d13/d1d/d25/d45/d6d/fa9 [0,4194304] 0 2024-09-13T02:52:51.693 INFO:tasks.workunit.client.0.smithi098.stdout:4/319: truncate d6/f61 608034 0 2024-09-13T02:52:51.694 INFO:tasks.workunit.client.1.smithi142.stdout:7/902: stat d10/d13/d1d/d2b/l2f 0 2024-09-13T02:52:51.694 INFO:tasks.workunit.client.1.smithi142.stdout:6/888: mknod d1/d7/d19/d30/c131 0 2024-09-13T02:52:51.695 INFO:tasks.workunit.client.1.smithi142.stdout:6/889: dread d1/d7/d5f/d6a/f7a [0,4194304] 0 2024-09-13T02:52:51.695 INFO:tasks.workunit.client.0.smithi098.stdout:5/329: dwrite d0/d15/f3c [0,4194304] 0 2024-09-13T02:52:51.695 INFO:tasks.workunit.client.0.smithi098.stdout:8/361: write d2/dd/d11/d44/f63 [838231,2322] 0 2024-09-13T02:52:51.696 INFO:tasks.workunit.client.1.smithi142.stdout:6/890: chown d1/dd/d16/d4e/fb5 0 1 2024-09-13T02:52:51.698 INFO:tasks.workunit.client.0.smithi098.stdout:5/330: dread - d0/d38/d3f/d1a/d32/d4d/f52 zero size 2024-09-13T02:52:51.698 INFO:tasks.workunit.client.1.smithi142.stdout:1/856: creat d12/d13/d20/d27/d3c/d71/d81/d92/f110 x:0 0 0 2024-09-13T02:52:51.701 INFO:tasks.workunit.client.1.smithi142.stdout:8/752: getdents d0/d6/dc/d40/d4d 0 2024-09-13T02:52:51.703 INFO:tasks.workunit.client.1.smithi142.stdout:8/753: write d0/d6/d23/f7f [1018969,4722] 0 2024-09-13T02:52:51.703 INFO:tasks.workunit.client.1.smithi142.stdout:8/754: chown d0/d80/lf1 7847022 1 2024-09-13T02:52:51.704 INFO:tasks.workunit.client.1.smithi142.stdout:0/881: mkdir d10/d6c/d88/d1a/d1e/d124 0 2024-09-13T02:52:51.709 INFO:tasks.workunit.client.1.smithi142.stdout:5/875: dread - d8/dc3/d3f/ddd/fe0 zero size 2024-09-13T02:52:51.712 INFO:tasks.workunit.client.1.smithi142.stdout:4/820: rename d0/d2b/d2d/d31/f55 to d0/df/d57/f109 0 2024-09-13T02:52:51.714 INFO:tasks.workunit.client.1.smithi142.stdout:3/813: link d12/d16/d25/d2e/d38/d4d/d53/d78/f85 d12/d16/d25/d2e/d38/d4d/d53/ffb 0 2024-09-13T02:52:51.719 INFO:tasks.workunit.client.0.smithi098.stdout:2/335: rename d1/d1a/f12 to d1/d1a/d4f/f69 0 2024-09-13T02:52:51.721 INFO:tasks.workunit.client.0.smithi098.stdout:2/336: chown d1/d1f/d35/c43 19 1 2024-09-13T02:52:51.723 INFO:tasks.workunit.client.0.smithi098.stdout:2/337: readlink d1/d1f/d35/d63/d23/l4a 0 2024-09-13T02:52:51.724 INFO:tasks.workunit.client.0.smithi098.stdout:8/362: creat d2/dd/d11/d44/f72 x:0 0 0 2024-09-13T02:52:51.726 INFO:tasks.workunit.client.0.smithi098.stdout:1/468: dwrite d9/d33/d19/d35/d63/f69 [0,4194304] 0 2024-09-13T02:52:51.728 INFO:tasks.workunit.client.0.smithi098.stdout:5/331: creat d0/d15/d17/d1c/f74 x:0 0 0 2024-09-13T02:52:51.732 INFO:tasks.workunit.client.1.smithi142.stdout:8/755: symlink d0/d75/lf5 0 2024-09-13T02:52:51.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:51 smithi098 ceph-mon[27886]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:51.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:51 smithi098 ceph-mon[27886]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:51.734 INFO:tasks.workunit.client.0.smithi098.stdout:5/332: dread d0/d15/f30 [0,4194304] 0 2024-09-13T02:52:51.735 INFO:tasks.workunit.client.0.smithi098.stdout:5/333: dread - d0/d15/d17/d1c/f6c zero size 2024-09-13T02:52:51.736 INFO:tasks.workunit.client.0.smithi098.stdout:5/334: write d0/d15/d17/d1c/f74 [982765,52586] 0 2024-09-13T02:52:51.736 INFO:tasks.workunit.client.1.smithi142.stdout:2/741: creat d1/de/da6/dbb/fed x:0 0 0 2024-09-13T02:52:51.738 INFO:tasks.workunit.client.1.smithi142.stdout:0/882: truncate d10/d6c/d88/d30/f86 1050109 0 2024-09-13T02:52:51.739 INFO:tasks.workunit.client.0.smithi098.stdout:6/347: link d5/d18/l32 d5/d13/l78 0 2024-09-13T02:52:51.741 INFO:tasks.workunit.client.1.smithi142.stdout:5/876: truncate d8/dc3/d3f/d4a/f86 5549549 0 2024-09-13T02:52:51.741 INFO:tasks.workunit.client.1.smithi142.stdout:0/883: stat d10/d6c/d88/d21/d51/d35/d9b/da5/c10e 0 2024-09-13T02:52:51.741 INFO:tasks.workunit.client.1.smithi142.stdout:6/891: dwrite d1/dd/d53/d78/d8f/da8/de6/f56 [4194304,4194304] 0 2024-09-13T02:52:51.741 INFO:tasks.workunit.client.1.smithi142.stdout:5/877: fdatasync d8/dc3/f59 0 2024-09-13T02:52:51.742 INFO:tasks.workunit.client.1.smithi142.stdout:6/892: readlink d1/d7/d42/lbf 0 2024-09-13T02:52:51.742 INFO:tasks.workunit.client.1.smithi142.stdout:0/884: fsync d10/d6c/d88/d21/daf/ff2 0 2024-09-13T02:52:51.747 INFO:tasks.workunit.client.0.smithi098.stdout:9/410: write d2/d6/f19 [1095794,63394] 0 2024-09-13T02:52:51.748 INFO:tasks.workunit.client.1.smithi142.stdout:6/893: dread d1/dd/d16/d4e/d32/f113 [0,4194304] 0 2024-09-13T02:52:51.750 INFO:tasks.workunit.client.1.smithi142.stdout:1/857: symlink d12/d13/d20/d66/d55/db4/l111 0 2024-09-13T02:52:51.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:51 smithi142 ceph-mon[33443]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:51.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:51 smithi142 ceph-mon[33443]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:51.755 INFO:tasks.workunit.client.0.smithi098.stdout:5/335: symlink d0/d15/d17/d1c/d3d/l75 0 2024-09-13T02:52:51.755 INFO:tasks.workunit.client.0.smithi098.stdout:5/336: chown d0/d29 1 1 2024-09-13T02:52:51.757 INFO:tasks.workunit.client.0.smithi098.stdout:9/411: dwrite d2/d6/d36/d8d/d39/d43/f83 [0,4194304] 0 2024-09-13T02:52:51.757 INFO:tasks.workunit.client.0.smithi098.stdout:4/320: dread d6/d3e/d68/f38 [0,4194304] 0 2024-09-13T02:52:51.759 INFO:tasks.workunit.client.1.smithi142.stdout:4/821: creat d0/d2b/d2d/d31/d32/d82/db0/f10a x:0 0 0 2024-09-13T02:52:51.762 INFO:tasks.workunit.client.1.smithi142.stdout:2/742: write d1/de/d31/d6c/d6d/db6/f4d [1203987,109644] 0 2024-09-13T02:52:51.765 INFO:tasks.workunit.client.1.smithi142.stdout:5/878: creat d8/dc3/d64/d68/db5/f11a x:0 0 0 2024-09-13T02:52:51.766 INFO:tasks.workunit.client.0.smithi098.stdout:7/553: getdents d6/d24/d2a/d5a/d86 0 2024-09-13T02:52:51.769 INFO:tasks.workunit.client.0.smithi098.stdout:2/338: mknod d1/d1a/d4f/d59/c6a 0 2024-09-13T02:52:51.770 INFO:tasks.workunit.client.0.smithi098.stdout:2/339: write d1/d1a/d9/f5c [821054,89499] 0 2024-09-13T02:52:51.772 INFO:tasks.workunit.client.0.smithi098.stdout:8/363: creat d2/d2f/d5f/d5d/f73 x:0 0 0 2024-09-13T02:52:51.774 INFO:tasks.workunit.client.1.smithi142.stdout:7/903: creat d10/d13/d1d/d25/d45/f120 x:0 0 0 2024-09-13T02:52:51.775 INFO:tasks.workunit.client.1.smithi142.stdout:0/885: write d10/d6c/d88/d1a/f66 [912409,88002] 0 2024-09-13T02:52:51.782 INFO:tasks.workunit.client.0.smithi098.stdout:4/321: symlink d6/d3e/d46/l70 0 2024-09-13T02:52:51.783 INFO:tasks.workunit.client.0.smithi098.stdout:3/389: getdents d7/d9/d15/d2d/d34 0 2024-09-13T02:52:51.785 INFO:tasks.workunit.client.1.smithi142.stdout:1/858: write d12/d13/d20/d66/d7d/df5/f9e [2430311,40082] 0 2024-09-13T02:52:51.786 INFO:tasks.workunit.client.1.smithi142.stdout:5/879: dread d8/d47/d65/da0/dd1/d45/f54 [0,4194304] 0 2024-09-13T02:52:51.786 INFO:tasks.workunit.client.1.smithi142.stdout:1/859: chown d12/d13/d20/d66/d7d/df5/d26/d4f 23713 1 2024-09-13T02:52:51.786 INFO:tasks.workunit.client.0.smithi098.stdout:0/434: rename dd/df/f3d to dd/f92 0 2024-09-13T02:52:51.788 INFO:tasks.workunit.client.0.smithi098.stdout:0/435: write dd/d1f/f25 [8684185,38292] 0 2024-09-13T02:52:51.789 INFO:tasks.workunit.client.0.smithi098.stdout:2/340: write d1/d1f/d35/d63/f37 [6018581,27190] 0 2024-09-13T02:52:51.792 INFO:tasks.workunit.client.0.smithi098.stdout:1/469: creat d9/d33/d19/d35/fac x:0 0 0 2024-09-13T02:52:51.793 INFO:tasks.workunit.client.0.smithi098.stdout:1/470: write d9/f84 [1742411,42528] 0 2024-09-13T02:52:51.796 INFO:tasks.workunit.client.0.smithi098.stdout:9/412: mkdir d2/d6/d91/d92 0 2024-09-13T02:52:51.797 INFO:tasks.workunit.client.0.smithi098.stdout:9/413: fsync d2/d6/d36/f5b 0 2024-09-13T02:52:51.798 INFO:tasks.workunit.client.1.smithi142.stdout:7/904: creat d10/d13/d21/f121 x:0 0 0 2024-09-13T02:52:51.798 INFO:tasks.workunit.client.1.smithi142.stdout:4/822: dwrite d0/d2b/d2d/d65/f5e [0,4194304] 0 2024-09-13T02:52:51.799 INFO:tasks.workunit.client.0.smithi098.stdout:4/322: chown d6/d22/d3d/l52 7583993 1 2024-09-13T02:52:51.799 INFO:tasks.workunit.client.0.smithi098.stdout:3/390: dread - d7/d9/d25/d3a/f44 zero size 2024-09-13T02:52:51.799 INFO:tasks.workunit.client.1.smithi142.stdout:7/905: write d10/d13/d1d/d44/f89 [1905622,115045] 0 2024-09-13T02:52:51.801 INFO:tasks.workunit.client.1.smithi142.stdout:7/906: write d10/d13/f119 [48119,37519] 0 2024-09-13T02:52:51.801 INFO:tasks.workunit.client.0.smithi098.stdout:3/391: dread d7/d9/d25/d2b/f75 [0,4194304] 0 2024-09-13T02:52:51.802 INFO:tasks.workunit.client.1.smithi142.stdout:7/907: readlink d10/l12 0 2024-09-13T02:52:51.803 INFO:tasks.workunit.client.1.smithi142.stdout:0/886: unlink d10/d6c/d88/d1a/d1e/d42/l10d 0 2024-09-13T02:52:51.804 INFO:tasks.workunit.client.1.smithi142.stdout:8/756: creat d0/d6/dc/ff6 x:0 0 0 2024-09-13T02:52:51.805 INFO:tasks.workunit.client.0.smithi098.stdout:0/436: fsync dd/df/d1d/d26/d28/d32/d67/d71/f5e 0 2024-09-13T02:52:51.808 INFO:tasks.workunit.client.0.smithi098.stdout:8/364: unlink d2/dd/d11/d1d/c26 0 2024-09-13T02:52:51.811 INFO:tasks.workunit.client.0.smithi098.stdout:6/348: getdents d5/d13/d2b/d5b 0 2024-09-13T02:52:51.812 INFO:tasks.workunit.client.0.smithi098.stdout:6/349: read d5/f15 [343745,43624] 0 2024-09-13T02:52:51.812 INFO:tasks.workunit.client.0.smithi098.stdout:6/350: stat d5/ca 0 2024-09-13T02:52:51.813 INFO:tasks.workunit.client.0.smithi098.stdout:6/351: readlink d5/d13/d2b/d3a/d41/l61 0 2024-09-13T02:52:51.816 INFO:tasks.workunit.client.0.smithi098.stdout:1/471: mknod d9/d33/d1f/d23/da7/d51/cad 0 2024-09-13T02:52:51.816 INFO:tasks.workunit.client.1.smithi142.stdout:3/814: creat d12/d16/d25/d2e/d48/d5c/d66/de4/ffc x:0 0 0 2024-09-13T02:52:51.819 INFO:tasks.workunit.client.0.smithi098.stdout:9/414: fdatasync d2/d6/d2b/f31 0 2024-09-13T02:52:51.821 INFO:tasks.workunit.client.0.smithi098.stdout:6/352: dwrite d5/d18/f3c [0,4194304] 0 2024-09-13T02:52:51.822 INFO:tasks.workunit.client.0.smithi098.stdout:9/415: chown d2/d6/d36 0 1 2024-09-13T02:52:51.822 INFO:tasks.workunit.client.1.smithi142.stdout:9/908: link dd/d17/d25/deb/cf2 dd/d17/d69/d84/c14b 0 2024-09-13T02:52:51.823 INFO:tasks.workunit.client.0.smithi098.stdout:4/323: symlink d6/d37/l71 0 2024-09-13T02:52:51.824 INFO:tasks.workunit.client.1.smithi142.stdout:1/860: dwrite d12/d13/d20/d66/d55/da0/fbb [0,4194304] 0 2024-09-13T02:52:51.825 INFO:tasks.workunit.client.0.smithi098.stdout:4/324: write d6/d22/f63 [4793952,86432] 0 2024-09-13T02:52:51.825 INFO:tasks.workunit.client.0.smithi098.stdout:4/325: fdatasync d6/db/f2f 0 2024-09-13T02:52:51.827 INFO:tasks.workunit.client.1.smithi142.stdout:7/908: mknod d10/d13/d1d/d2b/d55/d32/d8c/df1/c122 0 2024-09-13T02:52:51.830 INFO:tasks.workunit.client.1.smithi142.stdout:0/887: creat d10/d6c/d88/d21/d51/d79/de6/f125 x:0 0 0 2024-09-13T02:52:51.833 INFO:tasks.workunit.client.0.smithi098.stdout:7/554: creat d6/d1e/faf x:0 0 0 2024-09-13T02:52:51.837 INFO:tasks.workunit.client.0.smithi098.stdout:2/341: mknod d1/c6b 0 2024-09-13T02:52:51.838 INFO:tasks.workunit.client.1.smithi142.stdout:4/823: dwrite d0/d2b/d2d/d31/d32/d82/fc7 [0,4194304] 0 2024-09-13T02:52:51.839 INFO:tasks.workunit.client.0.smithi098.stdout:0/437: read dd/f24 [1306289,95514] 0 2024-09-13T02:52:51.840 INFO:tasks.workunit.client.1.smithi142.stdout:6/894: sync 2024-09-13T02:52:51.841 INFO:tasks.workunit.client.1.smithi142.stdout:3/815: mknod d12/dd3/db6/cfd 0 2024-09-13T02:52:51.842 INFO:tasks.workunit.client.1.smithi142.stdout:6/895: dread d1/dd/d53/d78/d104/dad/fed [0,4194304] 0 2024-09-13T02:52:51.844 INFO:tasks.workunit.client.1.smithi142.stdout:9/909: fsync dd/d98/d126/db8/dc0/f110 0 2024-09-13T02:52:51.844 INFO:tasks.workunit.client.1.smithi142.stdout:9/910: stat dd/d17/l6c 0 2024-09-13T02:52:51.845 INFO:tasks.workunit.client.1.smithi142.stdout:1/861: stat d12/d13/d20/d27/c97 0 2024-09-13T02:52:51.846 INFO:tasks.workunit.client.1.smithi142.stdout:0/888: truncate d10/d6c/d88/d1a/d1e/d42/f77 5234229 0 2024-09-13T02:52:51.848 INFO:tasks.workunit.client.1.smithi142.stdout:8/757: fdatasync d0/d6/d83/daa/fb0 0 2024-09-13T02:52:51.849 INFO:tasks.workunit.client.0.smithi098.stdout:6/353: mkdir d5/d13/d2b/d79 0 2024-09-13T02:52:51.851 INFO:tasks.workunit.client.0.smithi098.stdout:9/416: creat d2/d6/d2b/d4d/d56/f93 x:0 0 0 2024-09-13T02:52:51.853 INFO:tasks.workunit.client.1.smithi142.stdout:5/880: rename d8/l58 to d8/d47/d65/da0/dd1/d2d/d90/l11b 0 2024-09-13T02:52:51.857 INFO:tasks.workunit.client.1.smithi142.stdout:4/824: symlink d0/d7e/db8/l10b 0 2024-09-13T02:52:51.858 INFO:tasks.workunit.client.1.smithi142.stdout:2/743: getdents d1/de/d1f/d9c 0 2024-09-13T02:52:51.860 INFO:tasks.workunit.client.0.smithi098.stdout:4/326: stat d6/d10/d21/c43 0 2024-09-13T02:52:51.866 INFO:tasks.workunit.client.1.smithi142.stdout:6/896: truncate d1/f3d 5847829 0 2024-09-13T02:52:51.867 INFO:tasks.workunit.client.1.smithi142.stdout:6/897: chown d1/dd/d53/d78/d8f/da8/f11a 43072292 1 2024-09-13T02:52:51.871 INFO:tasks.workunit.client.0.smithi098.stdout:3/392: mkdir d7/d9/d15/d2d/d78 0 2024-09-13T02:52:51.872 INFO:tasks.workunit.client.1.smithi142.stdout:4/825: dread d0/d2b/d2d/d31/d43/d48/fd1 [0,4194304] 0 2024-09-13T02:52:51.873 INFO:tasks.workunit.client.0.smithi098.stdout:2/342: rmdir d1/d1f/d39 39 2024-09-13T02:52:51.875 INFO:tasks.workunit.client.1.smithi142.stdout:9/911: symlink dd/d17/d44/d82/l14c 0 2024-09-13T02:52:51.877 INFO:tasks.workunit.client.1.smithi142.stdout:1/862: write d12/fdb [3874657,130277] 0 2024-09-13T02:52:51.880 INFO:tasks.workunit.client.1.smithi142.stdout:0/889: mkdir d10/d6c/d88/d21/d51/d35/d9b/da5/d126 0 2024-09-13T02:52:51.885 INFO:tasks.workunit.client.1.smithi142.stdout:8/758: mkdir d0/d80/d8c/dc9/dc0/df7 0 2024-09-13T02:52:51.889 INFO:tasks.workunit.client.0.smithi098.stdout:6/354: symlink d5/d13/d2b/d3a/d14/d6b/l7a 0 2024-09-13T02:52:51.891 INFO:tasks.workunit.client.0.smithi098.stdout:9/417: symlink d2/d6/d2b/d4d/d4f/l94 0 2024-09-13T02:52:51.892 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:52:51.892 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:52:51.892 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:52:51.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:52:51.892 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:52:51.893 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:52:51.894 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:52:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.889+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5a34005cc0 con 0x7f5a48100240 2024-09-13T02:52:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.890+0000 7f5a44ff9700 1 -- 172.21.15.98:0/2576155816 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7f5a3805b150 con 0x7f5a48100240 2024-09-13T02:52:51.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f5a3006d600 msgr2=0x7f5a3006fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:51.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f5a3006d600 0x7f5a3006fab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c005950 tx=0x7f5a3c00b410 comp rx=0 tx=0).stop 2024-09-13T02:52:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a48100240 msgr2=0x7f5a48195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a48100240 0x7f5a48195ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800bda0 tx=0x7f5a3800bdd0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 shutdown_connections 2024-09-13T02:52:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f5a3006d600 0x7f5a3006fab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a48100240 0x7f5a48195ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 --2- 172.21.15.98:0/2576155816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a48101440 0x7f5a48195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 >> 172.21.15.98:0/2576155816 conn(0x7f5a480fb7f0 msgr2=0x7f5a48104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 shutdown_connections 2024-09-13T02:52:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:51.894+0000 7f5a4e043700 1 -- 172.21.15.98:0/2576155816 wait complete. 2024-09-13T02:52:51.904 INFO:tasks.workunit.client.1.smithi142.stdout:4/826: creat d0/df/d57/dbf/f10c x:0 0 0 2024-09-13T02:52:51.905 INFO:tasks.workunit.client.0.smithi098.stdout:7/555: write d6/d24/d63/fa8 [1639353,50745] 0 2024-09-13T02:52:51.905 INFO:tasks.workunit.client.0.smithi098.stdout:1/472: link d9/d33/d1f/c80 d9/d33/d1f/d6b/d7c/cae 0 2024-09-13T02:52:51.905 INFO:tasks.workunit.client.0.smithi098.stdout:7/556: readlink d6/l18 0 2024-09-13T02:52:51.906 INFO:tasks.workunit.client.0.smithi098.stdout:3/393: write d7/d9/d25/d2b/f3e [896769,48313] 0 2024-09-13T02:52:51.908 INFO:tasks.workunit.client.1.smithi142.stdout:3/816: truncate d12/d16/d25/d2e/d38/d4d/d53/d78/fc5 1337173 0 2024-09-13T02:52:51.910 INFO:tasks.workunit.client.1.smithi142.stdout:3/817: dread - d12/d16/d25/d2e/d48/d5c/d8c/ff2 zero size 2024-09-13T02:52:51.910 INFO:tasks.workunit.client.1.smithi142.stdout:1/863: mkdir d12/d13/d20/d27/d3c/d71/d81/d92/d112 0 2024-09-13T02:52:51.911 INFO:tasks.workunit.client.1.smithi142.stdout:4/827: dwrite d0/d2b/d2d/d65/f5e [0,4194304] 0 2024-09-13T02:52:51.912 INFO:tasks.workunit.client.1.smithi142.stdout:1/864: write d12/d13/d20/d66/d55/db4/f109 [97832,20194] 0 2024-09-13T02:52:51.914 INFO:tasks.workunit.client.1.smithi142.stdout:0/890: unlink d10/d6c/d88/d1a/d1e/l34 0 2024-09-13T02:52:51.914 INFO:tasks.workunit.client.1.smithi142.stdout:9/912: write dd/d17/d69/d84/d41/f125 [181523,12918] 0 2024-09-13T02:52:51.918 INFO:tasks.workunit.client.1.smithi142.stdout:8/759: chown d0/d6/dc/l5e 1 1 2024-09-13T02:52:51.920 INFO:tasks.workunit.client.0.smithi098.stdout:8/365: getdents d2/dd/d11/d1d 0 2024-09-13T02:52:51.921 INFO:tasks.workunit.client.0.smithi098.stdout:7/557: dread d6/d24/d46/f50 [0,4194304] 0 2024-09-13T02:52:51.921 INFO:tasks.workunit.client.0.smithi098.stdout:8/366: truncate d2/d2f/f62 259602 0 2024-09-13T02:52:51.922 INFO:tasks.workunit.client.1.smithi142.stdout:1/865: dread d12/d13/d45/f60 [0,4194304] 0 2024-09-13T02:52:51.922 INFO:tasks.workunit.client.0.smithi098.stdout:0/438: link dd/df/d1d/d26/d28/d32/d67/d81/l8e dd/df/d1d/d26/d28/d32/d67/d82/l93 0 2024-09-13T02:52:51.924 INFO:tasks.workunit.client.0.smithi098.stdout:1/473: creat d9/d33/d19/d46/faf x:0 0 0 2024-09-13T02:52:51.925 INFO:tasks.workunit.client.0.smithi098.stdout:6/355: symlink d5/d18/d4e/d72/l7b 0 2024-09-13T02:52:51.929 INFO:tasks.workunit.client.0.smithi098.stdout:3/394: truncate d7/d9/d25/d2b/f2c 1834138 0 2024-09-13T02:52:51.929 INFO:tasks.workunit.client.0.smithi098.stdout:0/439: dwrite dd/df/d1d/d26/d37/f73 [0,4194304] 0 2024-09-13T02:52:51.931 INFO:tasks.workunit.client.0.smithi098.stdout:3/395: write d7/fc [1888236,95886] 0 2024-09-13T02:52:51.932 INFO:tasks.workunit.client.0.smithi098.stdout:9/418: mknod d2/d6/c95 0 2024-09-13T02:52:51.933 INFO:tasks.workunit.client.0.smithi098.stdout:9/419: readlink d2/l7a 0 2024-09-13T02:52:51.933 INFO:tasks.workunit.client.0.smithi098.stdout:3/396: dread d7/d9/d25/d2b/f75 [0,4194304] 0 2024-09-13T02:52:51.933 INFO:tasks.workunit.client.1.smithi142.stdout:3/818: mknod d12/cfe 0 2024-09-13T02:52:51.934 INFO:tasks.workunit.client.1.smithi142.stdout:5/881: write d8/dc3/d3f/ddd/f119 [4329152,108077] 0 2024-09-13T02:52:51.935 INFO:tasks.workunit.client.0.smithi098.stdout:9/420: dread - d2/d6/d36/d8d/d39/f86 zero size 2024-09-13T02:52:51.936 INFO:tasks.workunit.client.0.smithi098.stdout:4/327: link d6/d3e/d68/f38 d6/d37/f72 0 2024-09-13T02:52:51.936 INFO:tasks.workunit.client.0.smithi098.stdout:3/397: dread d7/d9/d15/d2d/d5b/f45 [0,4194304] 0 2024-09-13T02:52:51.939 INFO:tasks.workunit.client.0.smithi098.stdout:2/343: creat d1/d1f/d35/d63/f6c x:0 0 0 2024-09-13T02:52:51.941 INFO:tasks.workunit.client.1.smithi142.stdout:9/913: unlink dd/d17/d44/d95/dd1/d12b/c130 0 2024-09-13T02:52:51.942 INFO:tasks.workunit.client.1.smithi142.stdout:9/914: chown dd/d17/d44/d82/d99/cd5 1764 1 2024-09-13T02:52:51.942 INFO:tasks.workunit.client.0.smithi098.stdout:7/558: mknod d6/d24/d2a/d57/d88/cb0 0 2024-09-13T02:52:51.944 INFO:tasks.workunit.client.1.smithi142.stdout:7/909: rename d10/d13/d1d/d2b/d56/d39/fbf to d10/d13/d1d/f123 0 2024-09-13T02:52:51.945 INFO:tasks.workunit.client.0.smithi098.stdout:8/367: mkdir d2/d2f/d5f/d46/d74 0 2024-09-13T02:52:51.951 INFO:tasks.workunit.client.1.smithi142.stdout:1/866: fdatasync d12/d13/fce 0 2024-09-13T02:52:51.952 INFO:tasks.workunit.client.1.smithi142.stdout:1/867: chown d12/d13/f3f 634270894 1 2024-09-13T02:52:51.953 INFO:tasks.workunit.client.1.smithi142.stdout:2/744: rmdir d1/dc3 0 2024-09-13T02:52:51.954 INFO:tasks.workunit.client.0.smithi098.stdout:6/356: mkdir d5/d13/d2b/d3a/d41/d6c/d7c 0 2024-09-13T02:52:51.961 INFO:tasks.workunit.client.1.smithi142.stdout:3/819: creat d12/d16/da3/fff x:0 0 0 2024-09-13T02:52:51.973 INFO:tasks.workunit.client.1.smithi142.stdout:6/898: rename d1/l10e to d1/d7/d5f/l132 0 2024-09-13T02:52:51.974 INFO:tasks.workunit.client.1.smithi142.stdout:6/899: stat d1/dd/d53/d78/d8f/da8/de6/f120 0 2024-09-13T02:52:51.974 INFO:tasks.workunit.client.0.smithi098.stdout:2/344: mknod d1/d1a/d4f/d59/c6d 0 2024-09-13T02:52:51.976 INFO:tasks.workunit.client.0.smithi098.stdout:7/559: mkdir d6/d24/d2a/d5a/d86/db1 0 2024-09-13T02:52:51.977 INFO:tasks.workunit.client.1.smithi142.stdout:8/760: symlink d0/da2/dec/lf8 0 2024-09-13T02:52:51.979 INFO:tasks.workunit.client.0.smithi098.stdout:3/398: dwrite d7/d9/d25/d3a/d52/f28 [4194304,4194304] 0 2024-09-13T02:52:51.981 INFO:tasks.workunit.client.0.smithi098.stdout:3/399: chown d7/d9/d15/d2d/f6b 116579 1 2024-09-13T02:52:51.982 INFO:tasks.workunit.client.0.smithi098.stdout:1/474: rename d9/d33/d87/la2 to d9/d33/d1f/lb0 0 2024-09-13T02:52:51.982 INFO:tasks.workunit.client.0.smithi098.stdout:6/357: creat d5/d18/d4e/d72/f7d x:0 0 0 2024-09-13T02:52:51.990 INFO:tasks.workunit.client.0.smithi098.stdout:1/475: dwrite d9/f84 [0,4194304] 0 2024-09-13T02:52:51.991 INFO:tasks.workunit.client.0.smithi098.stdout:9/421: symlink d2/d6/d36/d8d/l96 0 2024-09-13T02:52:51.992 INFO:tasks.workunit.client.0.smithi098.stdout:2/345: truncate d1/d1f/f56 968228 0 2024-09-13T02:52:51.995 INFO:tasks.workunit.client.1.smithi142.stdout:7/910: mknod d10/d13/d1d/c124 0 2024-09-13T02:52:51.996 INFO:tasks.workunit.client.1.smithi142.stdout:7/911: write d10/d13/d1d/d44/f112 [290044,110403] 0 2024-09-13T02:52:51.997 INFO:tasks.workunit.client.0.smithi098.stdout:8/368: symlink d2/d2f/l75 0 2024-09-13T02:52:51.997 INFO:tasks.workunit.client.1.smithi142.stdout:1/868: mkdir d12/d13/d20/d27/d3c/d71/d113 0 2024-09-13T02:52:51.998 INFO:tasks.workunit.client.1.smithi142.stdout:7/912: chown d10/d13/d1d/d2b/dae/d9c/ld1 69974 1 2024-09-13T02:52:51.999 INFO:tasks.workunit.client.1.smithi142.stdout:2/745: link d1/de/d1f/d13/d60/fd1 d1/d42/fee 0 2024-09-13T02:52:52.002 INFO:tasks.workunit.client.0.smithi098.stdout:8/369: chown d2/dd/d11/f16 5 1 2024-09-13T02:52:52.003 INFO:tasks.workunit.client.1.smithi142.stdout:5/882: creat d8/dc3/d3f/f11c x:0 0 0 2024-09-13T02:52:52.006 INFO:tasks.workunit.client.0.smithi098.stdout:0/440: creat dd/df/d1d/f94 x:0 0 0 2024-09-13T02:52:52.006 INFO:tasks.workunit.client.0.smithi098.stdout:1/476: dwrite d9/d33/d1f/d23/da7/d51/f98 [0,4194304] 0 2024-09-13T02:52:52.007 INFO:tasks.workunit.client.1.smithi142.stdout:6/900: link d1/d7/d5f/d60/d76/f10c d1/dd/d16/d4e/d32/f133 0 2024-09-13T02:52:52.010 INFO:tasks.workunit.client.0.smithi098.stdout:7/560: truncate d6/f19 373585 0 2024-09-13T02:52:52.011 INFO:tasks.workunit.client.0.smithi098.stdout:0/441: dread - dd/f75 zero size 2024-09-13T02:52:52.012 INFO:tasks.workunit.client.1.smithi142.stdout:8/761: symlink d0/d80/d8c/dc9/dc0/df7/lf9 0 2024-09-13T02:52:52.012 INFO:tasks.workunit.client.0.smithi098.stdout:1/477: write d9/d33/d19/d35/d68/d4d/fa1 [77094,124269] 0 2024-09-13T02:52:52.014 INFO:tasks.workunit.client.1.smithi142.stdout:1/869: dread - d12/d13/d20/d27/d3c/d71/d81/d92/f110 zero size 2024-09-13T02:52:52.016 INFO:tasks.workunit.client.0.smithi098.stdout:2/346: dwrite d1/d1a/d4f/f69 [4194304,4194304] 0 2024-09-13T02:52:52.017 INFO:tasks.workunit.client.1.smithi142.stdout:3/820: write d12/d16/d3c/d79/d9b/fa2 [547154,120089] 0 2024-09-13T02:52:52.020 INFO:tasks.workunit.client.1.smithi142.stdout:3/821: chown d12/d16/d3c/d7d/d91/lb0 1501041045 1 2024-09-13T02:52:52.020 INFO:tasks.workunit.client.1.smithi142.stdout:3/822: chown d12/d16/d3c/d79/d9b/dc1/cf5 1426 1 2024-09-13T02:52:52.021 INFO:tasks.workunit.client.0.smithi098.stdout:3/400: dwrite d7/d9/d15/f49 [0,4194304] 0 2024-09-13T02:52:52.021 INFO:tasks.workunit.client.0.smithi098.stdout:5/337: sync 2024-09-13T02:52:52.021 INFO:tasks.workunit.client.1.smithi142.stdout:9/915: link dd/d17/d25/cc1 dd/dcb/c14d 0 2024-09-13T02:52:52.024 INFO:tasks.workunit.client.1.smithi142.stdout:6/901: mkdir d1/d7/d5f/d6a/d134 0 2024-09-13T02:52:52.028 INFO:tasks.workunit.client.0.smithi098.stdout:2/347: write d1/d1a/d9/f5c [1316998,3409] 0 2024-09-13T02:52:52.035 INFO:tasks.workunit.client.1.smithi142.stdout:8/762: unlink d0/d80/d8c/dc9/dc0/le6 0 2024-09-13T02:52:52.035 INFO:tasks.workunit.client.1.smithi142.stdout:1/870: fsync d12/d13/d20/d27/d3c/d71/d81/d92/daa/dc0/fd7 0 2024-09-13T02:52:52.038 INFO:tasks.workunit.client.1.smithi142.stdout:8/763: write d0/d75/ff3 [679573,42624] 0 2024-09-13T02:52:52.038 INFO:tasks.workunit.client.0.smithi098.stdout:9/422: dread d2/d6/d2b/f47 [0,4194304] 0 2024-09-13T02:52:52.038 INFO:tasks.workunit.client.0.smithi098.stdout:7/561: chown d6/d1e/c53 5798655 1 2024-09-13T02:52:52.040 INFO:tasks.workunit.client.1.smithi142.stdout:1/871: truncate d12/d13/d20/d66/d55/f107 179567 0 2024-09-13T02:52:52.040 INFO:tasks.workunit.client.0.smithi098.stdout:4/328: dwrite d6/d10/d21/f32 [0,4194304] 0 2024-09-13T02:52:52.043 INFO:tasks.workunit.client.1.smithi142.stdout:9/916: dwrite dd/f1b [0,4194304] 0 2024-09-13T02:52:52.043 INFO:tasks.workunit.client.0.smithi098.stdout:5/338: dwrite d0/d38/f58 [0,4194304] 0 2024-09-13T02:52:52.044 INFO:tasks.workunit.client.0.smithi098.stdout:1/478: rmdir d9/d33/d1f/d23/da7 39 2024-09-13T02:52:52.044 INFO:tasks.workunit.client.0.smithi098.stdout:2/348: rmdir d1/d1f/d35/d63 39 2024-09-13T02:52:52.045 INFO:tasks.workunit.client.1.smithi142.stdout:4/828: rename d0/df/d57/f89 to d0/d2b/f10d 0 2024-09-13T02:52:52.047 INFO:tasks.workunit.client.0.smithi098.stdout:4/329: read d6/d3e/d68/f38 [431819,104515] 0 2024-09-13T02:52:52.047 INFO:tasks.workunit.client.0.smithi098.stdout:8/370: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:52:52.050 INFO:tasks.workunit.client.0.smithi098.stdout:0/442: mkdir dd/d95 0 2024-09-13T02:52:52.051 INFO:tasks.workunit.client.1.smithi142.stdout:2/746: creat d1/de/da6/dbb/fef x:0 0 0 2024-09-13T02:52:52.052 INFO:tasks.workunit.client.1.smithi142.stdout:4/829: dread d0/d2b/d21/f106 [0,4194304] 0 2024-09-13T02:52:52.053 INFO:tasks.workunit.client.0.smithi098.stdout:2/349: dread - d1/d1a/d9/d1e/d5a/f5f zero size 2024-09-13T02:52:52.057 INFO:tasks.workunit.client.1.smithi142.stdout:3/823: mknod d12/d16/d25/d2e/d38/d4d/d53/c100 0 2024-09-13T02:52:52.060 INFO:tasks.workunit.client.1.smithi142.stdout:3/824: read fe [3308876,43447] 0 2024-09-13T02:52:52.063 INFO:tasks.workunit.client.0.smithi098.stdout:6/358: truncate d5/d13/f28 1570959 0 2024-09-13T02:52:52.064 INFO:tasks.workunit.client.0.smithi098.stdout:7/562: mknod d6/d24/d2a/cb2 0 2024-09-13T02:52:52.065 INFO:tasks.workunit.client.0.smithi098.stdout:5/339: dwrite d0/d15/d17/d1c/f6c [0,4194304] 0 2024-09-13T02:52:52.065 INFO:tasks.workunit.client.0.smithi098.stdout:6/359: chown d5/d13/d2b/d3a/d5a 45687563 1 2024-09-13T02:52:52.067 INFO:tasks.workunit.client.0.smithi098.stdout:1/479: mkdir d9/d33/d19/d35/d68/d60/d61/db1 0 2024-09-13T02:52:52.068 INFO:tasks.workunit.client.0.smithi098.stdout:1/480: chown d9/d33/d19/d35/fac 13165 1 2024-09-13T02:52:52.073 INFO:tasks.workunit.client.1.smithi142.stdout:9/917: creat dd/d98/d126/db8/dc0/f14e x:0 0 0 2024-09-13T02:52:52.074 INFO:tasks.workunit.client.1.smithi142.stdout:0/891: rename d10/d23/cd7 to d10/d6c/d88/d1a/d1e/d42/d4b/d119/c127 0 2024-09-13T02:52:52.077 INFO:tasks.workunit.client.1.smithi142.stdout:5/883: dwrite d8/d47/d65/da0/dd1/f5c [0,4194304] 0 2024-09-13T02:52:52.078 INFO:tasks.workunit.client.1.smithi142.stdout:5/884: chown d8/dc3/d105 406028 1 2024-09-13T02:52:52.079 INFO:tasks.workunit.client.0.smithi098.stdout:8/371: creat d2/dd/d11/d2c/f76 x:0 0 0 2024-09-13T02:52:52.079 INFO:tasks.workunit.client.1.smithi142.stdout:2/747: creat d1/de/d1f/d9c/ff0 x:0 0 0 2024-09-13T02:52:52.079 INFO:tasks.workunit.client.1.smithi142.stdout:4/830: readlink d0/l42 0 2024-09-13T02:52:52.080 INFO:tasks.workunit.client.0.smithi098.stdout:9/423: mknod d2/d6/d91/d92/c97 0 2024-09-13T02:52:52.080 INFO:tasks.workunit.client.1.smithi142.stdout:2/748: write d1/de/da6/dbb/dc2/fda [424117,123135] 0 2024-09-13T02:52:52.081 INFO:tasks.workunit.client.1.smithi142.stdout:2/749: fdatasync d1/fa3 0 2024-09-13T02:52:52.082 INFO:tasks.workunit.client.1.smithi142.stdout:3/825: mknod d12/d16/d3c/d79/d9e/c101 0 2024-09-13T02:52:52.082 INFO:tasks.workunit.client.1.smithi142.stdout:2/750: write d1/d29/d72/fc0 [3236876,21876] 0 2024-09-13T02:52:52.083 INFO:tasks.workunit.client.1.smithi142.stdout:8/764: truncate d0/d6/f24 1696880 0 2024-09-13T02:52:52.084 INFO:tasks.workunit.client.0.smithi098.stdout:5/340: symlink d0/l76 0 2024-09-13T02:52:52.084 INFO:tasks.workunit.client.1.smithi142.stdout:2/751: write d1/de/f57 [2677619,14868] 0 2024-09-13T02:52:52.085 INFO:tasks.workunit.client.1.smithi142.stdout:8/765: write d0/d6/dc/d45/d35/f63 [1830503,14927] 0 2024-09-13T02:52:52.086 INFO:tasks.workunit.client.1.smithi142.stdout:6/902: link d1/d7/d42/lbf d1/d7/d5f/d6a/l135 0 2024-09-13T02:52:52.091 INFO:tasks.workunit.client.0.smithi098.stdout:6/360: rename d5/d18/d4e/d72 to d5/d13/d2b/d3a/d41/d7e 0 2024-09-13T02:52:52.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.090+0000 7f20be432700 1 -- 172.21.15.98:0/3696294646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 msgr2=0x7f20b80fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:52.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.090+0000 7f20be432700 1 --2- 172.21.15.98:0/3696294646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 0x7f20b80fecd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20a800aa20 tx=0x7f20a800ad30 comp rx=0 tx=0).stop 2024-09-13T02:52:52.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.090+0000 7f20be432700 1 -- 172.21.15.98:0/3696294646 shutdown_connections 2024-09-13T02:52:52.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.090+0000 7f20be432700 1 --2- 172.21.15.98:0/3696294646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20b80ffb60 0x7f20b80fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:52.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.090+0000 7f20be432700 1 --2- 172.21.15.98:0/3696294646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 0x7f20b80fecd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:52.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.090+0000 7f20be432700 1 -- 172.21.15.98:0/3696294646 >> 172.21.15.98:0/3696294646 conn(0x7f20b80f9f10 msgr2=0x7f20b80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:52.092 INFO:tasks.workunit.client.0.smithi098.stdout:5/341: dwrite d0/d15/d17/d1c/f6c [0,4194304] 0 2024-09-13T02:52:52.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.090+0000 7f20be432700 1 -- 172.21.15.98:0/3696294646 shutdown_connections 2024-09-13T02:52:52.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.090+0000 7f20be432700 1 -- 172.21.15.98:0/3696294646 wait complete. 2024-09-13T02:52:52.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.091+0000 7f20be432700 1 Processor -- start 2024-09-13T02:52:52.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.091+0000 7f20be432700 1 -- start start 2024-09-13T02:52:52.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.091+0000 7f20be432700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 0x7f20b8191dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:52.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.092+0000 7f20be432700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20b80ffb60 0x7f20b8192300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:52.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.092+0000 7f20be432700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b818e8b0 con 0x7f20b80fe8c0 2024-09-13T02:52:52.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.092+0000 7f20be432700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b818ea20 con 0x7f20b80ffb60 2024-09-13T02:52:52.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.092+0000 7f20b7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 0x7f20b8191dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:52.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.092+0000 7f20b7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 0x7f20b8191dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56688/0 (socket says 172.21.15.98:56688) 2024-09-13T02:52:52.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.092+0000 7f20b7fff700 1 -- 172.21.15.98:0/1828243938 learned_addr learned my addr 172.21.15.98:0/1828243938 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:52:52.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.092+0000 7f20b7fff700 1 -- 172.21.15.98:0/1828243938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20b80ffb60 msgr2=0x7f20b8192300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:52.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.092+0000 7f20b7fff700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20b80ffb60 0x7f20b8192300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:52.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.092+0000 7f20b7fff700 1 -- 172.21.15.98:0/1828243938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a800a700 con 0x7f20b80fe8c0 2024-09-13T02:52:52.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.093+0000 7f20b7fff700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 0x7f20b8191dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006010 tx=0x7f20a800fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:52.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.093+0000 7f20b5ffb700 1 -- 172.21.15.98:0/1828243938 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a800caf0 con 0x7f20b80fe8c0 2024-09-13T02:52:52.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.093+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b818eca0 con 0x7f20b80fe8c0 2024-09-13T02:52:52.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.093+0000 7f20b5ffb700 1 -- 172.21.15.98:0/1828243938 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f20a800cc50 con 0x7f20b80fe8c0 2024-09-13T02:52:52.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.093+0000 7f20b5ffb700 1 -- 172.21.15.98:0/1828243938 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a80168a0 con 0x7f20b80fe8c0 2024-09-13T02:52:52.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.093+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b818f190 con 0x7f20b80fe8c0 2024-09-13T02:52:52.096 INFO:tasks.workunit.client.1.smithi142.stdout:1/872: write d12/d13/d45/fa8 [3448919,7452] 0 2024-09-13T02:52:52.097 INFO:tasks.workunit.client.0.smithi098.stdout:0/443: fsync dd/f10 0 2024-09-13T02:52:52.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.095+0000 7f20b5ffb700 1 -- 172.21.15.98:0/1828243938 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f20a8003c30 con 0x7f20b80fe8c0 2024-09-13T02:52:52.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.096+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b8103c40 con 0x7f20b80fe8c0 2024-09-13T02:52:52.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.097+0000 7f20b5ffb700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f20a406d650 0x7f20a406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:52.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.097+0000 7f20b5ffb700 1 -- 172.21.15.98:0/1828243938 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f20a8012070 con 0x7f20b80fe8c0 2024-09-13T02:52:52.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.098+0000 7f20affff700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f20a406d650 0x7f20a406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:52.099 INFO:tasks.workunit.client.0.smithi098.stdout:4/330: mkdir d6/d3e/d73 0 2024-09-13T02:52:52.102 INFO:tasks.workunit.client.1.smithi142.stdout:7/913: rename d10/d13/d1d/d2b/d55/d32/lec to d10/d13/d1d/d25/d45/d6d/d118/l125 0 2024-09-13T02:52:52.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.100+0000 7f20affff700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f20a406d650 0x7f20a406fb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f20a0005950 tx=0x7f20a00058e0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:52.102 INFO:tasks.workunit.client.0.smithi098.stdout:2/350: rename d1/d1f/d36/c58 to d1/d1f/d36/c6e 0 2024-09-13T02:52:52.104 INFO:tasks.workunit.client.0.smithi098.stdout:3/401: getdents d7/d9 0 2024-09-13T02:52:52.105 INFO:tasks.workunit.client.0.smithi098.stdout:3/402: chown d7/d9/d25/d3a/d51/f69 15490162 1 2024-09-13T02:52:52.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.105+0000 7f20b5ffb700 1 -- 172.21.15.98:0/1828243938 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f20a805c010 con 0x7f20b80fe8c0 2024-09-13T02:52:52.111 INFO:tasks.workunit.client.1.smithi142.stdout:5/885: symlink d8/dc3/df3/dc6/l11d 0 2024-09-13T02:52:52.112 INFO:tasks.workunit.client.0.smithi098.stdout:7/563: symlink d6/d24/d2a/d5a/d42/d80/lb3 0 2024-09-13T02:52:52.114 INFO:tasks.workunit.client.0.smithi098.stdout:7/564: read d6/d24/d46/f5c [884754,8358] 0 2024-09-13T02:52:52.114 INFO:tasks.workunit.client.0.smithi098.stdout:7/565: chown d6/l6d 9836408 1 2024-09-13T02:52:52.117 INFO:tasks.workunit.client.0.smithi098.stdout:6/361: creat d5/d13/d51/f7f x:0 0 0 2024-09-13T02:52:52.118 INFO:tasks.workunit.client.1.smithi142.stdout:1/873: dread d12/d13/d20/d66/d55/da0/f56 [0,4194304] 0 2024-09-13T02:52:52.120 INFO:tasks.workunit.client.0.smithi098.stdout:5/342: mknod d0/d15/d50/c77 0 2024-09-13T02:52:52.123 INFO:tasks.workunit.client.1.smithi142.stdout:3/826: truncate d12/f13 439665 0 2024-09-13T02:52:52.124 INFO:tasks.workunit.client.1.smithi142.stdout:3/827: stat d12/ce3 0 2024-09-13T02:52:52.127 INFO:tasks.workunit.client.1.smithi142.stdout:2/752: unlink d1/de/d1f/d13/d59/c66 0 2024-09-13T02:52:52.128 INFO:tasks.workunit.client.1.smithi142.stdout:5/886: dread d8/d47/fc4 [0,4194304] 0 2024-09-13T02:52:52.128 INFO:tasks.workunit.client.1.smithi142.stdout:8/766: symlink d0/d6/d23/lfa 0 2024-09-13T02:52:52.131 INFO:tasks.workunit.client.1.smithi142.stdout:3/828: dwrite d12/d16/d25/d2e/d38/d6b/ff9 [0,4194304] 0 2024-09-13T02:52:52.132 INFO:tasks.workunit.client.0.smithi098.stdout:8/372: mkdir d2/dd/d11/d77 0 2024-09-13T02:52:52.136 INFO:tasks.workunit.client.1.smithi142.stdout:2/753: dwrite d1/de/d1f/d9c/ff0 [0,4194304] 0 2024-09-13T02:52:52.137 INFO:tasks.workunit.client.1.smithi142.stdout:2/754: stat d1/de/d31/d6c/d6d/d47/da8/fb3 0 2024-09-13T02:52:52.138 INFO:tasks.workunit.client.0.smithi098.stdout:3/403: rmdir d7/d9/d25/d3a 39 2024-09-13T02:52:52.138 INFO:tasks.workunit.client.0.smithi098.stdout:0/444: dwrite dd/df/d1d/d40/d46/f47 [0,4194304] 0 2024-09-13T02:52:52.141 INFO:tasks.workunit.client.1.smithi142.stdout:7/914: mknod d10/d34/c126 0 2024-09-13T02:52:52.142 INFO:tasks.workunit.client.0.smithi098.stdout:2/351: dwrite d1/d1f/d30/f3e [0,4194304] 0 2024-09-13T02:52:52.142 INFO:tasks.workunit.client.0.smithi098.stdout:3/404: chown d7/d9/d15/d2d/f6b 3011 1 2024-09-13T02:52:52.142 INFO:tasks.workunit.client.1.smithi142.stdout:7/915: dread - d10/d13/d1d/d25/d45/d6d/dc3/f115 zero size 2024-09-13T02:52:52.143 INFO:tasks.workunit.client.1.smithi142.stdout:7/916: chown d10/d64 93393553 1 2024-09-13T02:52:52.151 INFO:tasks.workunit.client.0.smithi098.stdout:4/331: dwrite d6/db/f29 [0,4194304] 0 2024-09-13T02:52:52.163 INFO:tasks.workunit.client.1.smithi142.stdout:6/903: creat d1/dd/d16/d4e/d32/d126/f136 x:0 0 0 2024-09-13T02:52:52.166 INFO:tasks.workunit.client.1.smithi142.stdout:0/892: dwrite d10/d6c/d88/d30/f86 [0,4194304] 0 2024-09-13T02:52:52.166 INFO:tasks.workunit.client.1.smithi142.stdout:5/887: mknod d8/dc3/d3f/d4a/d4b/db9/c11e 0 2024-09-13T02:52:52.166 INFO:tasks.workunit.client.1.smithi142.stdout:6/904: write d1/dd/d53/d78/d8f/da8/f11a [639712,9021] 0 2024-09-13T02:52:52.169 INFO:tasks.workunit.client.0.smithi098.stdout:2/352: dread d1/d1a/d9/f5c [0,4194304] 0 2024-09-13T02:52:52.171 INFO:tasks.workunit.client.1.smithi142.stdout:3/829: creat d12/d16/d25/d2e/d48/f102 x:0 0 0 2024-09-13T02:52:52.171 INFO:tasks.workunit.client.0.smithi098.stdout:9/424: creat d2/f98 x:0 0 0 2024-09-13T02:52:52.173 INFO:tasks.workunit.client.0.smithi098.stdout:3/405: chown d7/d9/d25/d3a/d5f/f60 3 1 2024-09-13T02:52:52.177 INFO:tasks.workunit.client.0.smithi098.stdout:3/406: truncate d7/d9/d25/d3a/d52/f3b 1509639 0 2024-09-13T02:52:52.178 INFO:tasks.workunit.client.0.smithi098.stdout:7/566: dread d6/d24/d2a/d5a/f2b [0,4194304] 0 2024-09-13T02:52:52.179 INFO:tasks.workunit.client.1.smithi142.stdout:1/874: mknod d12/d13/d20/d27/d3c/d71/d81/d92/d112/c114 0 2024-09-13T02:52:52.183 INFO:tasks.workunit.client.1.smithi142.stdout:5/888: creat d8/d47/d65/da0/dd1/d45/d81/d82/f11f x:0 0 0 2024-09-13T02:52:52.185 INFO:tasks.workunit.client.1.smithi142.stdout:6/905: dread d1/dd/d16/d4d/fe9 [0,4194304] 0 2024-09-13T02:52:52.187 INFO:tasks.workunit.client.1.smithi142.stdout:6/906: truncate d1/dd/d16/d4e/d32/f133 934503 0 2024-09-13T02:52:52.188 INFO:tasks.workunit.client.1.smithi142.stdout:2/755: symlink d1/de/d31/d6c/lf1 0 2024-09-13T02:52:52.188 INFO:tasks.workunit.client.1.smithi142.stdout:2/756: readlink d1/d2d/l82 0 2024-09-13T02:52:52.189 INFO:tasks.workunit.client.1.smithi142.stdout:6/907: write d1/dd/d53/d78/d8f/f92 [1552760,124260] 0 2024-09-13T02:52:52.190 INFO:tasks.workunit.client.1.smithi142.stdout:9/918: getdents dd/d17/d44/d82/d99/de3 0 2024-09-13T02:52:52.191 INFO:tasks.workunit.client.1.smithi142.stdout:9/919: chown dd/d17/d69/f10e 32796479 1 2024-09-13T02:52:52.192 INFO:tasks.workunit.client.1.smithi142.stdout:4/831: getdents d0/df/d57/dbf 0 2024-09-13T02:52:52.196 INFO:tasks.workunit.client.1.smithi142.stdout:5/889: creat d8/d47/d65/da0/dd1/d45/f120 x:0 0 0 2024-09-13T02:52:52.197 INFO:tasks.workunit.client.1.smithi142.stdout:8/767: dread d0/d6/dc/d45/fa [0,4194304] 0 2024-09-13T02:52:52.199 INFO:tasks.workunit.client.0.smithi098.stdout:4/332: dread d6/d3e/f59 [0,4194304] 0 2024-09-13T02:52:52.202 INFO:tasks.workunit.client.0.smithi098.stdout:5/343: dwrite d0/d15/f3a [0,4194304] 0 2024-09-13T02:52:52.207 INFO:tasks.workunit.client.1.smithi142.stdout:7/917: rename d10/d13/d1d/d2b/d55/c10e to d10/d13/d1d/d2b/d40/c127 0 2024-09-13T02:52:52.209 INFO:tasks.workunit.client.1.smithi142.stdout:9/920: dread dd/f36 [4194304,4194304] 0 2024-09-13T02:52:52.209 INFO:tasks.workunit.client.0.smithi098.stdout:0/445: symlink dd/df/d1d/d26/l96 0 2024-09-13T02:52:52.219 INFO:tasks.workunit.client.1.smithi142.stdout:5/890: creat d8/d47/d65/da0/dd1/d2d/f121 x:0 0 0 2024-09-13T02:52:52.220 INFO:tasks.workunit.client.0.smithi098.stdout:3/407: fsync d7/d9/d15/d5d/f65 0 2024-09-13T02:52:52.221 INFO:tasks.workunit.client.0.smithi098.stdout:3/408: fdatasync d7/d9/d15/d26/f6e 0 2024-09-13T02:52:52.222 INFO:tasks.workunit.client.1.smithi142.stdout:8/768: unlink d0/f5c 0 2024-09-13T02:52:52.225 INFO:tasks.workunit.client.1.smithi142.stdout:7/918: fdatasync d10/d34/f97 0 2024-09-13T02:52:52.227 INFO:tasks.workunit.client.1.smithi142.stdout:2/757: symlink d1/de/d1f/lf2 0 2024-09-13T02:52:52.229 INFO:tasks.workunit.client.0.smithi098.stdout:5/344: rename d0/d38/d3f/d1a/d32 to d0/d15/d50/d78 0 2024-09-13T02:52:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:0/446: creat dd/df/d1d/d40/d46/f97 x:0 0 0 2024-09-13T02:52:52.234 INFO:tasks.workunit.client.0.smithi098.stdout:0/447: chown dd/df/d1d/d26/d28/d32/d67/d81/f91 177 1 2024-09-13T02:52:52.234 INFO:tasks.workunit.client.1.smithi142.stdout:6/908: unlink d1/dd/d16/f2c 0 2024-09-13T02:52:52.235 INFO:tasks.workunit.client.0.smithi098.stdout:2/353: symlink d1/d1f/d39/l6f 0 2024-09-13T02:52:52.235 INFO:tasks.workunit.client.1.smithi142.stdout:6/909: write d1/d7/d5f/d60/db6/f110 [309198,17911] 0 2024-09-13T02:52:52.235 INFO:tasks.workunit.client.1.smithi142.stdout:6/910: readlink d1/d59/l9b 0 2024-09-13T02:52:52.236 INFO:tasks.workunit.client.0.smithi098.stdout:0/448: write dd/df/d1d/d40/d46/f97 [294500,51667] 0 2024-09-13T02:52:52.236 INFO:tasks.workunit.client.1.smithi142.stdout:6/911: truncate d1/d7/d19/f93 886544 0 2024-09-13T02:52:52.237 INFO:tasks.workunit.client.0.smithi098.stdout:2/354: fsync d1/d1f/d39/f21 0 2024-09-13T02:52:52.240 INFO:tasks.workunit.client.0.smithi098.stdout:6/362: getdents d5/d36 0 2024-09-13T02:52:52.241 INFO:tasks.workunit.client.1.smithi142.stdout:0/893: dwrite d10/d6c/d88/d45/f56 [0,4194304] 0 2024-09-13T02:52:52.243 INFO:tasks.workunit.client.0.smithi098.stdout:8/373: truncate d2/d2f/f5b 1132832 0 2024-09-13T02:52:52.244 INFO:tasks.workunit.client.1.smithi142.stdout:1/875: creat d12/d13/d20/d66/d7d/df5/d26/f115 x:0 0 0 2024-09-13T02:52:52.244 INFO:tasks.workunit.client.0.smithi098.stdout:8/374: write d2/d2f/d5f/f64 [886829,123399] 0 2024-09-13T02:52:52.248 INFO:tasks.workunit.client.1.smithi142.stdout:8/769: unlink d0/d6/dc/l5e 0 2024-09-13T02:52:52.251 INFO:tasks.workunit.client.0.smithi098.stdout:4/333: mkdir d6/d22/d3d/d41/d74 0 2024-09-13T02:52:52.253 INFO:tasks.workunit.client.0.smithi098.stdout:4/334: write d6/d10/d21/f65 [316500,116523] 0 2024-09-13T02:52:52.253 INFO:tasks.workunit.client.1.smithi142.stdout:7/919: mkdir d10/d13/d21/d128 0 2024-09-13T02:52:52.254 INFO:tasks.workunit.client.0.smithi098.stdout:5/345: mknod d0/d29/c79 0 2024-09-13T02:52:52.255 INFO:tasks.workunit.client.0.smithi098.stdout:5/346: fsync d0/f37 0 2024-09-13T02:52:52.256 INFO:tasks.workunit.client.1.smithi142.stdout:9/921: write dd/d17/d25/f29 [164336,70803] 0 2024-09-13T02:52:52.258 INFO:tasks.workunit.client.0.smithi098.stdout:0/449: chown dd/df/d1d/d26/d28/d32/c55 132294774 1 2024-09-13T02:52:52.261 INFO:tasks.workunit.client.0.smithi098.stdout:2/355: dread - d1/d1f/d35/d63/f6c zero size 2024-09-13T02:52:52.262 INFO:tasks.workunit.client.1.smithi142.stdout:6/912: fdatasync d1/dd/d16/f9f 0 2024-09-13T02:52:52.266 INFO:tasks.workunit.client.1.smithi142.stdout:4/832: link d0/dc8/dcf/de0/fe5 d0/df/da5/dad/f10e 0 2024-09-13T02:52:52.267 INFO:tasks.workunit.client.0.smithi098.stdout:0/450: dwrite dd/df/d1d/d40/d46/d6b/f70 [0,4194304] 0 2024-09-13T02:52:52.269 INFO:tasks.workunit.client.0.smithi098.stdout:9/425: dwrite d2/f32 [0,4194304] 0 2024-09-13T02:52:52.270 INFO:tasks.workunit.client.1.smithi142.stdout:0/894: symlink d10/d95/l128 0 2024-09-13T02:52:52.275 INFO:tasks.workunit.client.0.smithi098.stdout:3/409: getdents d7/d9/d15/d2d/d5b/d70 0 2024-09-13T02:52:52.277 INFO:tasks.workunit.client.0.smithi098.stdout:3/410: write d7/d9/d15/d5d/f65 [1655541,27761] 0 2024-09-13T02:52:52.284 INFO:tasks.workunit.client.1.smithi142.stdout:7/920: unlink d10/d13/d1d/d2b/d55/f4f 0 2024-09-13T02:52:52.284 INFO:tasks.workunit.client.0.smithi098.stdout:3/411: dwrite d7/d9/d15/d2d/d34/f61 [0,4194304] 0 2024-09-13T02:52:52.286 INFO:tasks.workunit.client.1.smithi142.stdout:2/758: unlink d1/de/d31/d6c/c9a 0 2024-09-13T02:52:52.288 INFO:tasks.workunit.client.1.smithi142.stdout:9/922: chown dd/d87/d8e/da3/ddb/c119 65392 1 2024-09-13T02:52:52.293 INFO:tasks.workunit.client.1.smithi142.stdout:6/913: creat d1/d7/d19/d30/f137 x:0 0 0 2024-09-13T02:52:52.294 INFO:tasks.workunit.client.0.smithi098.stdout:8/375: write d2/dd/d4d/f67 [2440271,3602] 0 2024-09-13T02:52:52.295 INFO:tasks.workunit.client.0.smithi098.stdout:8/376: chown d2/dd/d4d 15 1 2024-09-13T02:52:52.296 INFO:tasks.workunit.client.0.smithi098.stdout:6/363: dwrite d5/d13/f3f [4194304,4194304] 0 2024-09-13T02:52:52.298 INFO:tasks.workunit.client.0.smithi098.stdout:2/356: creat d1/d1a/d9/d1e/d5a/f70 x:0 0 0 2024-09-13T02:52:52.298 INFO:tasks.workunit.client.0.smithi098.stdout:2/357: stat d1/d1a/d4f 0 2024-09-13T02:52:52.299 INFO:tasks.workunit.client.1.smithi142.stdout:1/876: creat d12/d13/d20/d10b/f116 x:0 0 0 2024-09-13T02:52:52.301 INFO:tasks.workunit.client.0.smithi098.stdout:0/451: creat dd/df/d1d/d26/d28/d32/f98 x:0 0 0 2024-09-13T02:52:52.303 INFO:tasks.workunit.client.0.smithi098.stdout:0/452: write dd/df/d1d/d26/d28/f72 [756772,70035] 0 2024-09-13T02:52:52.305 INFO:tasks.workunit.client.0.smithi098.stdout:0/453: chown dd/f86 30732 1 2024-09-13T02:52:52.305 INFO:tasks.workunit.client.1.smithi142.stdout:3/830: sync 2024-09-13T02:52:52.306 INFO:tasks.workunit.client.0.smithi098.stdout:7/567: getdents d6/d24/d2a 0 2024-09-13T02:52:52.311 INFO:tasks.workunit.client.0.smithi098.stdout:0/454: write dd/df/d1d/d26/d37/f73 [454022,32755] 0 2024-09-13T02:52:52.312 INFO:tasks.workunit.client.0.smithi098.stdout:3/412: creat d7/d9/d4c/f79 x:0 0 0 2024-09-13T02:52:52.312 INFO:tasks.workunit.client.0.smithi098.stdout:9/426: dwrite d2/d6/d2b/d66/f75 [8388608,4194304] 0 2024-09-13T02:52:52.317 INFO:tasks.workunit.client.0.smithi098.stdout:5/347: link d0/d38/d3f/d1a/f67 d0/d38/d3f/d1a/d27/f7a 0 2024-09-13T02:52:52.317 INFO:tasks.workunit.client.0.smithi098.stdout:3/413: write d7/d9/d25/d3a/d5f/f60 [934780,20386] 0 2024-09-13T02:52:52.319 INFO:tasks.workunit.client.0.smithi098.stdout:1/481: sync 2024-09-13T02:52:52.325 INFO:tasks.workunit.client.0.smithi098.stdout:9/427: dwrite d2/f57 [0,4194304] 0 2024-09-13T02:52:52.329 INFO:tasks.workunit.client.0.smithi098.stdout:5/348: dwrite d0/d38/f55 [0,4194304] 0 2024-09-13T02:52:52.329 INFO:tasks.workunit.client.0.smithi098.stdout:9/428: fdatasync d2/d6/d2b/d4d/d56/f93 0 2024-09-13T02:52:52.336 INFO:tasks.workunit.client.0.smithi098.stdout:0/455: symlink dd/df/d1d/d26/d28/d32/d67/d71/l99 0 2024-09-13T02:52:52.342 INFO:tasks.workunit.client.0.smithi098.stdout:4/335: dwrite d6/d10/d21/f2b [0,4194304] 0 2024-09-13T02:52:52.346 INFO:tasks.workunit.client.0.smithi098.stdout:1/482: creat d9/d33/d1f/d6b/fb2 x:0 0 0 2024-09-13T02:52:52.355 INFO:tasks.workunit.client.0.smithi098.stdout:2/358: write d1/d1f/d30/f34 [1625741,38063] 0 2024-09-13T02:52:52.364 INFO:tasks.workunit.client.0.smithi098.stdout:9/429: creat d2/d6/d2b/d4d/d56/f99 x:0 0 0 2024-09-13T02:52:52.365 INFO:tasks.workunit.client.0.smithi098.stdout:0/456: creat dd/df/d1d/d26/d28/d32/d67/d81/f9a x:0 0 0 2024-09-13T02:52:52.369 INFO:tasks.workunit.client.0.smithi098.stdout:4/336: symlink d6/d37/l75 0 2024-09-13T02:52:52.394 INFO:tasks.workunit.client.0.smithi098.stdout:1/483: creat d9/d33/d1f/fb3 x:0 0 0 2024-09-13T02:52:52.394 INFO:tasks.workunit.client.0.smithi098.stdout:3/414: mknod d7/d9/d25/d64/d6f/c7a 0 2024-09-13T02:52:52.395 INFO:tasks.workunit.client.0.smithi098.stdout:0/457: dwrite dd/df/d1d/f1a [8388608,4194304] 0 2024-09-13T02:52:52.396 INFO:tasks.workunit.client.0.smithi098.stdout:8/377: rename d2/d2f/d5f to d2/d2f/d78 0 2024-09-13T02:52:52.397 INFO:tasks.workunit.client.0.smithi098.stdout:3/415: read - d7/d9/d25/d3a/f6c zero size 2024-09-13T02:52:52.398 INFO:tasks.workunit.client.0.smithi098.stdout:7/568: creat d6/d1e/fb4 x:0 0 0 2024-09-13T02:52:52.399 INFO:tasks.workunit.client.0.smithi098.stdout:1/484: write d9/d33/f22 [3244182,81991] 0 2024-09-13T02:52:52.399 INFO:tasks.workunit.client.0.smithi098.stdout:5/349: symlink d0/d15/l7b 0 2024-09-13T02:52:52.401 INFO:tasks.workunit.client.0.smithi098.stdout:9/430: mknod d2/d6/d2b/d66/c9a 0 2024-09-13T02:52:52.404 INFO:tasks.workunit.client.0.smithi098.stdout:0/458: chown dd/df/d1d/d26/d28/d32/d67/d81/f9a 260279 1 2024-09-13T02:52:52.404 INFO:tasks.workunit.client.0.smithi098.stdout:4/337: mknod d6/d22/d3d/d4d/c76 0 2024-09-13T02:52:52.409 INFO:tasks.workunit.client.0.smithi098.stdout:5/350: mkdir d0/d7c 0 2024-09-13T02:52:52.410 INFO:tasks.workunit.client.0.smithi098.stdout:6/364: dwrite d5/f33 [0,4194304] 0 2024-09-13T02:52:52.414 INFO:tasks.workunit.client.0.smithi098.stdout:3/416: rmdir d7/d9/d25 39 2024-09-13T02:52:52.414 INFO:tasks.workunit.client.0.smithi098.stdout:8/378: dwrite d2/dd/d11/d44/f63 [0,4194304] 0 2024-09-13T02:52:52.428 INFO:tasks.workunit.client.0.smithi098.stdout:0/459: dread dd/df/d1d/d26/f44 [0,4194304] 0 2024-09-13T02:52:52.429 INFO:tasks.workunit.client.0.smithi098.stdout:0/460: write dd/df/d1d/f1a [944735,14603] 0 2024-09-13T02:52:52.435 INFO:tasks.workunit.client.0.smithi098.stdout:8/379: creat d2/d2f/d78/d5d/f79 x:0 0 0 2024-09-13T02:52:52.437 INFO:tasks.workunit.client.0.smithi098.stdout:9/431: symlink d2/d6/d36/d8d/d39/d43/d90/l9b 0 2024-09-13T02:52:52.439 INFO:tasks.workunit.client.0.smithi098.stdout:1/485: rename d9/d33/d19/d64/f65 to d9/d33/d1f/d23/da7/fb4 0 2024-09-13T02:52:52.442 INFO:tasks.workunit.client.0.smithi098.stdout:7/569: symlink d6/d24/d2a/d5a/d86/lb5 0 2024-09-13T02:52:52.447 INFO:tasks.workunit.client.0.smithi098.stdout:0/461: rmdir dd/df/d1d 39 2024-09-13T02:52:52.451 INFO:tasks.workunit.client.0.smithi098.stdout:5/351: write d0/d15/f18 [4778790,84829] 0 2024-09-13T02:52:52.453 INFO:tasks.workunit.client.0.smithi098.stdout:8/380: mknod d2/dd/d11/d1d/c7a 0 2024-09-13T02:52:52.454 INFO:tasks.workunit.client.0.smithi098.stdout:6/365: write d5/d13/d2b/f2d [825167,128182] 0 2024-09-13T02:52:52.459 INFO:tasks.workunit.client.0.smithi098.stdout:1/486: mkdir d9/d33/d19/d35/d68/d4d/db5 0 2024-09-13T02:52:52.469 INFO:tasks.workunit.client.0.smithi098.stdout:5/352: dread d0/d15/f18 [0,4194304] 0 2024-09-13T02:52:52.474 INFO:tasks.workunit.client.0.smithi098.stdout:1/487: write f1 [718906,2494] 0 2024-09-13T02:52:52.478 INFO:tasks.workunit.client.0.smithi098.stdout:3/417: symlink d7/d9/d15/l7b 0 2024-09-13T02:52:52.480 INFO:tasks.workunit.client.0.smithi098.stdout:5/353: creat d0/d29/f7d x:0 0 0 2024-09-13T02:52:52.482 INFO:tasks.workunit.client.1.smithi142.stdout:5/891: creat d8/dc3/d64/f122 x:0 0 0 2024-09-13T02:52:52.483 INFO:tasks.workunit.client.1.smithi142.stdout:5/892: readlink d8/dc3/l4e 0 2024-09-13T02:52:52.483 INFO:tasks.workunit.client.1.smithi142.stdout:5/893: stat d8/dc3/df3 0 2024-09-13T02:52:52.487 INFO:tasks.workunit.client.0.smithi098.stdout:1/488: mkdir d9/db6 0 2024-09-13T02:52:52.488 INFO:tasks.workunit.client.1.smithi142.stdout:2/759: symlink d1/d42/d44/lf3 0 2024-09-13T02:52:52.489 INFO:tasks.workunit.client.0.smithi098.stdout:0/462: mkdir dd/df/d1d/d40/d9b 0 2024-09-13T02:52:52.490 INFO:tasks.workunit.client.0.smithi098.stdout:7/570: dread - d6/d24/d2a/d5a/d86/d65/f6f zero size 2024-09-13T02:52:52.492 INFO:tasks.workunit.client.1.smithi142.stdout:6/914: symlink d1/d7/d5f/l138 0 2024-09-13T02:52:52.493 INFO:tasks.workunit.client.1.smithi142.stdout:6/915: read d1/dd/f49 [8607373,97564] 0 2024-09-13T02:52:52.493 INFO:tasks.workunit.client.1.smithi142.stdout:4/833: mknod d0/d2b/c10f 0 2024-09-13T02:52:52.494 INFO:tasks.workunit.client.1.smithi142.stdout:0/895: mkdir d10/d6c/d88/d45/ded/d113/d129 0 2024-09-13T02:52:52.494 INFO:tasks.workunit.client.0.smithi098.stdout:8/381: write d2/d2f/d78/f4b [1306328,116651] 0 2024-09-13T02:52:52.496 INFO:tasks.workunit.client.0.smithi098.stdout:8/382: write d2/d2f/d78/d5d/f73 [264262,66012] 0 2024-09-13T02:52:52.496 INFO:tasks.workunit.client.0.smithi098.stdout:5/354: unlink d0/d38/d3f/d1a/l45 0 2024-09-13T02:52:52.500 INFO:tasks.workunit.client.0.smithi098.stdout:9/432: getdents d2/d6 0 2024-09-13T02:52:52.501 INFO:tasks.workunit.client.1.smithi142.stdout:3/831: symlink d12/dd3/db6/l103 0 2024-09-13T02:52:52.501 INFO:tasks.workunit.client.0.smithi098.stdout:6/366: link d5/d13/d2b/c2e d5/d18/d50/c80 0 2024-09-13T02:52:52.504 INFO:tasks.workunit.client.0.smithi098.stdout:1/489: mknod d9/d33/d1f/d23/da7/cb7 0 2024-09-13T02:52:52.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.503+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f20b8061190 con 0x7f20a406d650 2024-09-13T02:52:52.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.504+0000 7f20b5ffb700 1 -- 172.21.15.98:0/1828243938 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f20b8061190 con 0x7f20a406d650 2024-09-13T02:52:52.506 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:52:52.506 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:52:52.506 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:52:52.506 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T02:52:52.506 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [], 2024-09-13T02:52:52.506 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "1/2 daemons upgraded", 2024-09-13T02:52:52.506 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T02:52:52.506 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:52:52.506 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:52:52.507 INFO:tasks.workunit.client.1.smithi142.stdout:8/770: truncate d0/d6/dc/d40/d4d/d62/f98 307243 0 2024-09-13T02:52:52.507 INFO:tasks.workunit.client.1.smithi142.stdout:7/921: dwrite d10/d64/f7c [0,4194304] 0 2024-09-13T02:52:52.508 INFO:tasks.workunit.client.0.smithi098.stdout:3/418: mkdir d7/d9/d25/d3a/d7c 0 2024-09-13T02:52:52.508 INFO:tasks.workunit.client.1.smithi142.stdout:7/922: chown d10/d13/d1d/d2b/d56/d5f/cdb 1975326 1 2024-09-13T02:52:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f20a406d650 msgr2=0x7f20a406fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f20a406d650 0x7f20a406fb00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f20a0005950 tx=0x7f20a00058e0 comp rx=0 tx=0).stop 2024-09-13T02:52:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 msgr2=0x7f20b8191dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 0x7f20b8191dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20a8006010 tx=0x7f20a800fe20 comp rx=0 tx=0).stop 2024-09-13T02:52:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 shutdown_connections 2024-09-13T02:52:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f20a406d650 0x7f20a406fb00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20b80fe8c0 0x7f20b8191dc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 --2- 172.21.15.98:0/1828243938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20b80ffb60 0x7f20b8192300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 >> 172.21.15.98:0/1828243938 conn(0x7f20b80f9f10 msgr2=0x7f20b8100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 shutdown_connections 2024-09-13T02:52:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:52:52.508+0000 7f20be432700 1 -- 172.21.15.98:0/1828243938 wait complete. 2024-09-13T02:52:52.510 INFO:tasks.workunit.client.1.smithi142.stdout:2/760: stat d1/de/d31/d6c/f88 0 2024-09-13T02:52:52.513 INFO:tasks.workunit.client.0.smithi098.stdout:5/355: mknod d0/d15/d50/d78/c7e 0 2024-09-13T02:52:52.514 INFO:tasks.workunit.client.0.smithi098.stdout:5/356: chown d0/d38/d3f/d1a/c4f 49085426 1 2024-09-13T02:52:52.516 INFO:tasks.workunit.client.1.smithi142.stdout:1/877: write d12/d13/d20/d27/d3c/d71/d81/d92/daa/fbe [2972698,117750] 0 2024-09-13T02:52:52.519 INFO:tasks.workunit.client.0.smithi098.stdout:9/433: rmdir d2/d6/d2b/d66 39 2024-09-13T02:52:52.522 INFO:tasks.workunit.client.1.smithi142.stdout:4/834: rename d0/d2b/d2d/d65/f2e to d0/d2b/d2d/d31/d32/daa/f110 0 2024-09-13T02:52:52.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/357: dwrite d0/d15/d17/f28 [0,4194304] 0 2024-09-13T02:52:52.523 INFO:tasks.workunit.client.0.smithi098.stdout:6/367: symlink d5/d18/d4e/l81 0 2024-09-13T02:52:52.524 INFO:tasks.workunit.client.1.smithi142.stdout:0/896: fsync d10/d6c/d88/d45/db3/fda 0 2024-09-13T02:52:52.525 INFO:tasks.workunit.client.0.smithi098.stdout:1/490: dread d9/d33/d19/d35/d63/f77 [0,4194304] 0 2024-09-13T02:52:52.526 INFO:tasks.workunit.client.1.smithi142.stdout:4/835: dread d0/df/f1f [0,4194304] 0 2024-09-13T02:52:52.530 INFO:tasks.workunit.client.1.smithi142.stdout:4/836: dread d0/d2b/d21/f106 [0,4194304] 0 2024-09-13T02:52:52.531 INFO:tasks.workunit.client.1.smithi142.stdout:4/837: chown d0/d2b/d2d/d31/cbc 0 1 2024-09-13T02:52:52.533 INFO:tasks.workunit.client.1.smithi142.stdout:5/894: mknod d8/dc3/d64/c123 0 2024-09-13T02:52:52.534 INFO:tasks.workunit.client.1.smithi142.stdout:5/895: stat d8/d47/d65/da0/ldf 0 2024-09-13T02:52:52.535 INFO:tasks.workunit.client.1.smithi142.stdout:5/896: read d8/d47/d65/da0/dd1/d45/dc5/f104 [2306176,115158] 0 2024-09-13T02:52:52.536 INFO:tasks.workunit.client.1.smithi142.stdout:5/897: write d8/dc3/d3f/f11c [23026,5498] 0 2024-09-13T02:52:52.536 INFO:tasks.workunit.client.0.smithi098.stdout:8/383: mknod d2/d2f/d78/d46/d47/d6e/d68/c7b 0 2024-09-13T02:52:52.537 INFO:tasks.workunit.client.1.smithi142.stdout:5/898: chown d8/d47/d65/da0/dd1/f8a 13888262 1 2024-09-13T02:52:52.547 INFO:tasks.workunit.client.0.smithi098.stdout:5/358: unlink d0/d38/d3f/d1a/d27/f7a 0 2024-09-13T02:52:52.548 INFO:tasks.workunit.client.0.smithi098.stdout:5/359: write d0/d38/d3f/f5b [432826,124875] 0 2024-09-13T02:52:52.549 INFO:tasks.workunit.client.1.smithi142.stdout:1/878: mknod d12/d13/d20/d66/d7d/df5/d26/d4f/da9/c117 0 2024-09-13T02:52:52.551 INFO:tasks.workunit.client.1.smithi142.stdout:0/897: mknod d10/d6c/d88/d1a/d1e/d42/d4b/d85/c12a 0 2024-09-13T02:52:52.552 INFO:tasks.workunit.client.1.smithi142.stdout:4/838: mknod d0/df/da5/c111 0 2024-09-13T02:52:52.553 INFO:tasks.workunit.client.0.smithi098.stdout:8/384: chown d2/d28/l32 1521963820 1 2024-09-13T02:52:52.553 INFO:tasks.workunit.client.0.smithi098.stdout:8/385: chown d2/dd/d11/d1d/c7a 1578820 1 2024-09-13T02:52:52.554 INFO:tasks.workunit.client.1.smithi142.stdout:3/832: symlink d12/d16/d25/d2e/l104 0 2024-09-13T02:52:52.559 INFO:tasks.workunit.client.0.smithi098.stdout:1/491: mkdir d9/d33/d19/d35/d68/d4d/db5/db8 0 2024-09-13T02:52:52.560 INFO:tasks.workunit.client.1.smithi142.stdout:4/839: dwrite d0/d2b/d2d/d31/d43/d48/f68 [4194304,4194304] 0 2024-09-13T02:52:52.560 INFO:tasks.workunit.client.0.smithi098.stdout:0/463: getdents dd/df/d1d/d26/d28/d32/d67 0 2024-09-13T02:52:52.561 INFO:tasks.workunit.client.0.smithi098.stdout:0/464: fdatasync dd/df/d1d/d40/d46/f97 0 2024-09-13T02:52:52.562 INFO:tasks.workunit.client.1.smithi142.stdout:4/840: dread d0/d2b/d2d/d31/d43/d48/fd1 [0,4194304] 0 2024-09-13T02:52:52.564 INFO:tasks.workunit.client.0.smithi098.stdout:3/419: creat d7/d9/d15/f7d x:0 0 0 2024-09-13T02:52:52.564 INFO:tasks.workunit.client.1.smithi142.stdout:4/841: dread - d0/d2b/d2d/d31/d32/d82/db0/f10a zero size 2024-09-13T02:52:52.565 INFO:tasks.workunit.client.1.smithi142.stdout:9/923: getdents dd/d98 0 2024-09-13T02:52:52.565 INFO:tasks.workunit.client.1.smithi142.stdout:4/842: chown d0/df/f5d 14428 1 2024-09-13T02:52:52.567 INFO:tasks.workunit.client.0.smithi098.stdout:9/434: creat d2/d6/d2b/f9c x:0 0 0 2024-09-13T02:52:52.567 INFO:tasks.workunit.client.0.smithi098.stdout:5/360: dread d0/d15/d17/d1c/d3d/f47 [0,4194304] 0 2024-09-13T02:52:52.570 INFO:tasks.workunit.client.0.smithi098.stdout:0/465: dwrite dd/df/d1d/d40/d46/d6b/f70 [0,4194304] 0 2024-09-13T02:52:52.571 INFO:tasks.workunit.client.1.smithi142.stdout:0/898: creat d10/d6c/d88/d21/d51/d35/d9b/da5/f12b x:0 0 0 2024-09-13T02:52:52.572 INFO:tasks.workunit.client.1.smithi142.stdout:0/899: chown d10/d6c/d88/d21/d51/d35/d9b/d120 1894 1 2024-09-13T02:52:52.574 INFO:tasks.workunit.client.0.smithi098.stdout:1/492: rename d9/d33/d19/d35/d68/d4d/fa1 to d9/d33/d29/d58/fb9 0 2024-09-13T02:52:52.574 INFO:tasks.workunit.client.0.smithi098.stdout:1/493: stat d9/d33/d29/c8a 0 2024-09-13T02:52:52.576 INFO:tasks.workunit.client.0.smithi098.stdout:6/368: dwrite d5/f1e [0,4194304] 0 2024-09-13T02:52:52.577 INFO:tasks.workunit.client.1.smithi142.stdout:3/833: chown d12/d16/d25/d2e/d38/f57 459761035 1 2024-09-13T02:52:52.578 INFO:tasks.workunit.client.0.smithi098.stdout:6/369: chown d5/d18/f1f 221898 1 2024-09-13T02:52:52.581 INFO:tasks.workunit.client.1.smithi142.stdout:2/761: link d1/de/d1f/d13/d59/de6/leb d1/de/d1f/d13/d60/da9/de9/lf4 0 2024-09-13T02:52:52.585 INFO:tasks.workunit.client.1.smithi142.stdout:4/843: mknod d0/d2b/d21/d30/c112 0 2024-09-13T02:52:52.586 INFO:tasks.workunit.client.1.smithi142.stdout:6/916: getdents d1/d7/d19/d48 0 2024-09-13T02:52:52.591 INFO:tasks.workunit.client.0.smithi098.stdout:1/494: rename d9/d33/d19/d46/faf to d9/d33/d1f/fba 0 2024-09-13T02:52:52.592 INFO:tasks.workunit.client.1.smithi142.stdout:0/900: symlink d10/d6c/d88/d1a/d3a/l12c 0 2024-09-13T02:52:52.593 INFO:tasks.workunit.client.0.smithi098.stdout:3/420: mkdir d7/d9/d15/d2d/d78/d7e 0 2024-09-13T02:52:52.594 INFO:tasks.workunit.client.1.smithi142.stdout:5/899: creat d8/d47/d65/da0/dd1/d2d/d90/f124 x:0 0 0 2024-09-13T02:52:52.601 INFO:tasks.workunit.client.0.smithi098.stdout:5/361: dwrite d0/d15/d50/d78/f33 [0,4194304] 0 2024-09-13T02:52:52.610 INFO:tasks.workunit.client.1.smithi142.stdout:6/917: dread d1/d7/f2a [0,4194304] 0 2024-09-13T02:52:52.639 INFO:tasks.workunit.client.1.smithi142.stdout:8/771: creat d0/d6/dc/d45/d8/df/ffb x:0 0 0 2024-09-13T02:52:52.640 INFO:tasks.workunit.client.1.smithi142.stdout:7/923: getdents d10/d13 0 2024-09-13T02:52:52.640 INFO:tasks.workunit.client.1.smithi142.stdout:9/924: write dd/d17/d69/d84/d41/f90 [2166927,70103] 0 2024-09-13T02:52:52.641 INFO:tasks.workunit.client.1.smithi142.stdout:7/924: stat d10/d13/c15 0 2024-09-13T02:52:52.641 INFO:tasks.workunit.client.1.smithi142.stdout:8/772: write d0/d6/dc/d45/d8/df/fe5 [593457,1402] 0 2024-09-13T02:52:52.645 INFO:tasks.workunit.client.0.smithi098.stdout:8/386: dwrite d2/fe [0,4194304] 0 2024-09-13T02:52:52.645 INFO:tasks.workunit.client.0.smithi098.stdout:9/435: dwrite d2/d6/d36/d8d/d39/f3e [0,4194304] 0 2024-09-13T02:52:52.653 INFO:tasks.workunit.client.0.smithi098.stdout:9/436: dread d2/d6/d36/f4e [0,4194304] 0 2024-09-13T02:52:52.654 INFO:tasks.workunit.client.0.smithi098.stdout:8/387: dwrite d2/d2f/d78/f4b [0,4194304] 0 2024-09-13T02:52:52.654 INFO:tasks.workunit.client.0.smithi098.stdout:9/437: readlink d2/d6/d36/d8d/l60 0 2024-09-13T02:52:52.666 INFO:tasks.workunit.client.1.smithi142.stdout:8/773: dread d0/d6/dc/f49 [0,4194304] 0 2024-09-13T02:52:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:52 smithi098 ceph-mon[27886]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:52 smithi098 ceph-mon[27886]: pgmap v25: 65 pgs: 65 active+clean; 2.5 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 71 MiB/s rd, 199 MiB/s wr, 391 op/s 2024-09-13T02:52:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:52 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2576155816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:52.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:52 smithi142 ceph-mon[33443]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:52.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:52 smithi142 ceph-mon[33443]: pgmap v25: 65 pgs: 65 active+clean; 2.5 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 71 MiB/s rd, 199 MiB/s wr, 391 op/s 2024-09-13T02:52:52.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:52 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2576155816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:52.791 INFO:tasks.workunit.client.0.smithi098.stdout:1/495: creat d9/d33/d19/d64/fbb x:0 0 0 2024-09-13T02:52:52.791 INFO:tasks.workunit.client.0.smithi098.stdout:1/496: dread - d9/f9b zero size 2024-09-13T02:52:52.792 INFO:tasks.workunit.client.1.smithi142.stdout:1/879: creat d12/d13/d20/f118 x:0 0 0 2024-09-13T02:52:52.793 INFO:tasks.workunit.client.0.smithi098.stdout:6/370: write d5/d13/d2b/d3a/d41/f59 [669523,48938] 0 2024-09-13T02:52:52.793 INFO:tasks.workunit.client.0.smithi098.stdout:1/497: write d9/d33/d19/d35/d63/f69 [1993346,91407] 0 2024-09-13T02:52:52.794 INFO:tasks.workunit.client.0.smithi098.stdout:3/421: mknod d7/c7f 0 2024-09-13T02:52:52.795 INFO:tasks.workunit.client.0.smithi098.stdout:6/371: chown d5/d36/f4f 3 1 2024-09-13T02:52:52.796 INFO:tasks.workunit.client.0.smithi098.stdout:0/466: write fa [1139239,69709] 0 2024-09-13T02:52:52.796 INFO:tasks.workunit.client.0.smithi098.stdout:3/422: chown d7/d9/d15/c6a 51893 1 2024-09-13T02:52:52.796 INFO:tasks.workunit.client.1.smithi142.stdout:4/844: write d0/dc8/dcf/de0/fe5 [638548,30702] 0 2024-09-13T02:52:52.797 INFO:tasks.workunit.client.1.smithi142.stdout:5/900: write d8/d47/d65/da0/dd1/d45/d81/d82/fa3 [872418,325] 0 2024-09-13T02:52:52.798 INFO:tasks.workunit.client.1.smithi142.stdout:5/901: readlink d8/dc3/d64/d68/db5/ld0 0 2024-09-13T02:52:52.799 INFO:tasks.workunit.client.1.smithi142.stdout:3/834: fsync d12/d16/d25/d2e/d38/d4d/d53/d78/fc5 0 2024-09-13T02:52:52.800 INFO:tasks.workunit.client.0.smithi098.stdout:5/362: write d0/d15/d17/d1c/d3d/f47 [3237310,4693] 0 2024-09-13T02:52:52.812 INFO:tasks.workunit.client.1.smithi142.stdout:9/925: rename dd/d17/d68/ded/d100 to dd/d17/d4f/d91/dab/d14f 0 2024-09-13T02:52:52.812 INFO:tasks.workunit.client.0.smithi098.stdout:9/438: mknod d2/d6/d2b/d4d/d4f/c9d 0 2024-09-13T02:52:52.816 INFO:tasks.workunit.client.1.smithi142.stdout:0/901: creat d10/d6c/d88/d21/d51/d35/d9b/d120/f12d x:0 0 0 2024-09-13T02:52:52.820 INFO:tasks.workunit.client.0.smithi098.stdout:1/498: fsync d9/d33/d29/d58/fb9 0 2024-09-13T02:52:52.821 INFO:tasks.workunit.client.1.smithi142.stdout:2/762: truncate d1/de/da6/dbb/dc2/fda 467019 0 2024-09-13T02:52:52.822 INFO:tasks.workunit.client.1.smithi142.stdout:6/918: dread d1/fd7 [0,4194304] 0 2024-09-13T02:52:52.823 INFO:tasks.workunit.client.1.smithi142.stdout:3/835: creat d12/d16/d25/d2e/d48/d5c/d8c/daf/f105 x:0 0 0 2024-09-13T02:52:52.824 INFO:tasks.workunit.client.1.smithi142.stdout:3/836: chown d12/d16/d25/d2e/d38/d4d/dad/cee 985977 1 2024-09-13T02:52:52.824 INFO:tasks.workunit.client.1.smithi142.stdout:7/925: write d10/d64/f82 [398578,75547] 0 2024-09-13T02:52:52.825 INFO:tasks.workunit.client.1.smithi142.stdout:3/837: write d12/d16/d3c/d7d/fbd [494690,5028] 0 2024-09-13T02:52:52.825 INFO:tasks.workunit.client.0.smithi098.stdout:5/363: truncate d0/d29/f2c 2320160 0 2024-09-13T02:52:52.826 INFO:tasks.workunit.client.0.smithi098.stdout:5/364: write d0/f4e [7281,24456] 0 2024-09-13T02:52:52.827 INFO:tasks.workunit.client.1.smithi142.stdout:3/838: write d12/d16/d25/d2e/d48/f6a [3523217,46832] 0 2024-09-13T02:52:52.830 INFO:tasks.workunit.client.0.smithi098.stdout:0/467: dread dd/df/d1d/d40/f61 [0,4194304] 0 2024-09-13T02:52:52.832 INFO:tasks.workunit.client.1.smithi142.stdout:1/880: rename d12/d13/d20/d27/d3c to d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119 0 2024-09-13T02:52:52.838 INFO:tasks.workunit.client.1.smithi142.stdout:8/774: dwrite d0/d6/dc/d2e/fa9 [0,4194304] 0 2024-09-13T02:52:52.839 INFO:tasks.workunit.client.0.smithi098.stdout:6/372: dwrite d5/d36/f4f [0,4194304] 0 2024-09-13T02:52:52.839 INFO:tasks.workunit.client.0.smithi098.stdout:1/499: rename d9/d33/d1f to d9/d33/d19/d35/d68/d4d/dbc 0 2024-09-13T02:52:52.840 INFO:tasks.workunit.client.1.smithi142.stdout:4/845: dwrite d0/f9b [4194304,4194304] 0 2024-09-13T02:52:52.847 INFO:tasks.workunit.client.0.smithi098.stdout:8/388: truncate d2/dd/d4d/f67 3509616 0 2024-09-13T02:52:52.853 INFO:tasks.workunit.client.0.smithi098.stdout:0/468: dread - dd/df/d1d/f2f zero size 2024-09-13T02:52:52.854 INFO:tasks.workunit.client.1.smithi142.stdout:7/926: creat d10/d13/d1d/d2b/d40/dce/f129 x:0 0 0 2024-09-13T02:52:52.855 INFO:tasks.workunit.client.1.smithi142.stdout:7/927: fdatasync d10/d13/d1d/d25/d45/dad/fe0 0 2024-09-13T02:52:52.855 INFO:tasks.workunit.client.1.smithi142.stdout:7/928: fsync d10/d64/f82 0 2024-09-13T02:52:52.856 INFO:tasks.workunit.client.1.smithi142.stdout:7/929: chown d10/d13/d1d/d2b/d55 661 1 2024-09-13T02:52:52.856 INFO:tasks.workunit.client.1.smithi142.stdout:3/839: creat d12/dd3/db6/f106 x:0 0 0 2024-09-13T02:52:52.858 INFO:tasks.workunit.client.1.smithi142.stdout:5/902: rename d8/dc3/d3f/d4a to d8/dc3/d3f/ddd/d125 0 2024-09-13T02:52:52.859 INFO:tasks.workunit.client.1.smithi142.stdout:1/881: rmdir d12/d13/d20/d66/d7d/df5/d26 39 2024-09-13T02:52:52.861 INFO:tasks.workunit.client.1.smithi142.stdout:1/882: write d12/d13/d20/d66/fbd [5708132,91881] 0 2024-09-13T02:52:52.861 INFO:tasks.workunit.client.1.smithi142.stdout:9/926: unlink dd/d17/d44/cbb 0 2024-09-13T02:52:52.865 INFO:tasks.workunit.client.1.smithi142.stdout:5/903: dread d8/dc3/d3f/ddd/f119 [4194304,4194304] 0 2024-09-13T02:52:52.867 INFO:tasks.workunit.client.1.smithi142.stdout:5/904: readlink d8/dc3/d64/d68/l78 0 2024-09-13T02:52:52.867 INFO:tasks.workunit.client.1.smithi142.stdout:8/775: truncate d0/d80/d8c/dc9/fbf 705391 0 2024-09-13T02:52:52.870 INFO:tasks.workunit.client.0.smithi098.stdout:3/423: getdents d7/d9/d25 0 2024-09-13T02:52:52.871 INFO:tasks.workunit.client.0.smithi098.stdout:3/424: chown d7/d9/d25/f39 7855981 1 2024-09-13T02:52:52.871 INFO:tasks.workunit.client.1.smithi142.stdout:7/930: dread d10/d13/d1d/d25/d45/d6d/dc3/f4e [0,4194304] 0 2024-09-13T02:52:52.873 INFO:tasks.workunit.client.1.smithi142.stdout:2/763: creat d1/de/d31/d6c/d6d/db6/ff5 x:0 0 0 2024-09-13T02:52:52.873 INFO:tasks.workunit.client.1.smithi142.stdout:8/776: dwrite d0/fd1 [0,4194304] 0 2024-09-13T02:52:52.874 INFO:tasks.workunit.client.0.smithi098.stdout:0/469: link dd/df/d1d/d26/d28/f2e dd/d95/f9c 0 2024-09-13T02:52:52.875 INFO:tasks.workunit.client.0.smithi098.stdout:0/470: write dd/df/d1d/f1a [2297953,98793] 0 2024-09-13T02:52:52.875 INFO:tasks.workunit.client.0.smithi098.stdout:0/471: readlink l9 0 2024-09-13T02:52:52.880 INFO:tasks.workunit.client.0.smithi098.stdout:1/500: dread - d9/d33/d19/d35/d63/faa zero size 2024-09-13T02:52:52.884 INFO:tasks.workunit.client.0.smithi098.stdout:0/472: dwrite dd/df/d1d/d26/f7d [0,4194304] 0 2024-09-13T02:52:52.885 INFO:tasks.workunit.client.0.smithi098.stdout:9/439: truncate d2/d6/d2b/d4d/f64 5494 0 2024-09-13T02:52:52.889 INFO:tasks.workunit.client.0.smithi098.stdout:6/373: getdents d5 0 2024-09-13T02:52:52.892 INFO:tasks.workunit.client.0.smithi098.stdout:8/389: write d2/dd/f21 [1725040,29604] 0 2024-09-13T02:52:52.896 INFO:tasks.workunit.client.0.smithi098.stdout:5/365: truncate d0/d29/f56 330615 0 2024-09-13T02:52:52.897 INFO:tasks.workunit.client.1.smithi142.stdout:1/883: dwrite d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/f110 [0,4194304] 0 2024-09-13T02:52:52.897 INFO:tasks.workunit.client.0.smithi098.stdout:3/425: mkdir d7/d9/d15/d80 0 2024-09-13T02:52:52.899 INFO:tasks.workunit.client.1.smithi142.stdout:5/905: chown d8/c1a 19 1 2024-09-13T02:52:52.900 INFO:tasks.workunit.client.0.smithi098.stdout:0/473: unlink dd/df/d1d/d26/d28/c3f 0 2024-09-13T02:52:52.906 INFO:tasks.workunit.client.0.smithi098.stdout:9/440: dread d2/d6/d36/d8d/f30 [0,4194304] 0 2024-09-13T02:52:52.907 INFO:tasks.workunit.client.0.smithi098.stdout:3/426: dwrite d7/d9/d25/d3a/d52/f3b [0,4194304] 0 2024-09-13T02:52:52.909 INFO:tasks.workunit.client.0.smithi098.stdout:6/374: mkdir d5/d13/d2b/d5b/d82 0 2024-09-13T02:52:52.909 INFO:tasks.workunit.client.0.smithi098.stdout:9/441: fsync d2/d6/d2b/d4d/d4f/d6c/f8f 0 2024-09-13T02:52:52.910 INFO:tasks.workunit.client.0.smithi098.stdout:6/375: readlink d5/d36/l75 0 2024-09-13T02:52:52.911 INFO:tasks.workunit.client.0.smithi098.stdout:6/376: write d5/d18/f47 [4250514,18561] 0 2024-09-13T02:52:52.912 INFO:tasks.workunit.client.0.smithi098.stdout:8/390: creat d2/dd/d11/d2c/f7c x:0 0 0 2024-09-13T02:52:52.913 INFO:tasks.workunit.client.1.smithi142.stdout:6/919: dwrite d1/dd/d16/f4c [0,4194304] 0 2024-09-13T02:52:52.913 INFO:tasks.workunit.client.1.smithi142.stdout:2/764: creat d1/d2d/ff6 x:0 0 0 2024-09-13T02:52:52.915 INFO:tasks.workunit.client.1.smithi142.stdout:9/927: dread dd/d17/d44/f4a [0,4194304] 0 2024-09-13T02:52:52.920 INFO:tasks.workunit.client.1.smithi142.stdout:3/840: fsync d12/f13 0 2024-09-13T02:52:52.926 INFO:tasks.workunit.client.0.smithi098.stdout:3/427: dread d7/d9/d15/f23 [0,4194304] 0 2024-09-13T02:52:52.930 INFO:tasks.workunit.client.1.smithi142.stdout:1/884: fsync d12/d13/d20/d66/d7d/df5/d26/f6a 0 2024-09-13T02:52:52.931 INFO:tasks.workunit.client.1.smithi142.stdout:1/885: truncate d12/d13/d20/d66/d7d/df5/d26/f115 792473 0 2024-09-13T02:52:52.932 INFO:tasks.workunit.client.1.smithi142.stdout:5/906: symlink d8/d47/d65/da0/dd1/d45/d81/l126 0 2024-09-13T02:52:52.933 INFO:tasks.workunit.client.1.smithi142.stdout:7/931: mknod d10/d13/d1d/d25/c12a 0 2024-09-13T02:52:52.935 INFO:tasks.workunit.client.1.smithi142.stdout:9/928: symlink dd/d148/l150 0 2024-09-13T02:52:52.939 INFO:tasks.workunit.client.1.smithi142.stdout:7/932: dwrite d10/d13/d1d/d25/d45/d92/fba [0,4194304] 0 2024-09-13T02:52:52.940 INFO:tasks.workunit.client.1.smithi142.stdout:7/933: chown d10/d13/d21/cb4 67 1 2024-09-13T02:52:52.941 INFO:tasks.workunit.client.0.smithi098.stdout:9/442: creat d2/d6/d2b/f9e x:0 0 0 2024-09-13T02:52:52.943 INFO:tasks.workunit.client.1.smithi142.stdout:3/841: creat d12/d16/d25/d2e/d48/d5c/f107 x:0 0 0 2024-09-13T02:52:52.943 INFO:tasks.workunit.client.0.smithi098.stdout:3/428: dwrite d7/d9/d25/d3a/d5f/f67 [0,4194304] 0 2024-09-13T02:52:52.944 INFO:tasks.workunit.client.0.smithi098.stdout:9/443: dread - d2/d6/d36/d8d/d39/f62 zero size 2024-09-13T02:52:52.944 INFO:tasks.workunit.client.0.smithi098.stdout:5/366: dread d0/d29/f56 [0,4194304] 0 2024-09-13T02:52:52.945 INFO:tasks.workunit.client.0.smithi098.stdout:9/444: fsync d2/f98 0 2024-09-13T02:52:52.946 INFO:tasks.workunit.client.1.smithi142.stdout:4/846: dwrite d0/d2b/d21/d35/f83 [0,4194304] 0 2024-09-13T02:52:52.947 INFO:tasks.workunit.client.1.smithi142.stdout:0/902: getdents d10/d6c/d88/d1a/d1e/dc6/df3/d110 0 2024-09-13T02:52:52.947 INFO:tasks.workunit.client.0.smithi098.stdout:9/445: write d2/d6/d2b/d4d/d4f/d6c/f8f [344284,95453] 0 2024-09-13T02:52:52.949 INFO:tasks.workunit.client.0.smithi098.stdout:9/446: chown d2/d6/d2b/d4d/l6d 40257 1 2024-09-13T02:52:52.951 INFO:tasks.workunit.client.0.smithi098.stdout:9/447: fsync d2/d6/d36/d8d/d39/f62 0 2024-09-13T02:52:52.953 INFO:tasks.workunit.client.1.smithi142.stdout:3/842: dwrite d12/d16/d25/d2e/d48/d5c/d8c/ff2 [0,4194304] 0 2024-09-13T02:52:52.953 INFO:tasks.workunit.client.0.smithi098.stdout:3/429: dwrite d7/d9/d25/d64/f68 [0,4194304] 0 2024-09-13T02:52:52.954 INFO:tasks.workunit.client.0.smithi098.stdout:8/391: getdents d2/dd/d4d 0 2024-09-13T02:52:52.961 INFO:tasks.workunit.client.0.smithi098.stdout:5/367: symlink d0/d29/l7f 0 2024-09-13T02:52:52.961 INFO:tasks.workunit.client.0.smithi098.stdout:0/474: dwrite dd/df/d1d/d26/d28/f2e [0,4194304] 0 2024-09-13T02:52:52.965 INFO:tasks.workunit.client.0.smithi098.stdout:5/368: truncate d0/d15/d50/d78/d4d/f52 295233 0 2024-09-13T02:52:52.965 INFO:tasks.workunit.client.0.smithi098.stdout:0/475: truncate dd/df/d1d/d26/d28/d32/f49 884285 0 2024-09-13T02:52:52.968 INFO:tasks.workunit.client.0.smithi098.stdout:9/448: creat d2/d6/d36/f9f x:0 0 0 2024-09-13T02:52:52.978 INFO:tasks.workunit.client.0.smithi098.stdout:8/392: chown d2/f1b 44566 1 2024-09-13T02:52:52.978 INFO:tasks.workunit.client.1.smithi142.stdout:9/929: unlink dd/d98/d126/cf0 0 2024-09-13T02:52:52.979 INFO:tasks.workunit.client.0.smithi098.stdout:6/377: dwrite d5/f15 [0,4194304] 0 2024-09-13T02:52:52.980 INFO:tasks.workunit.client.1.smithi142.stdout:9/930: truncate dd/d148/dc9/d103/f13f 104574 0 2024-09-13T02:52:52.980 INFO:tasks.workunit.client.1.smithi142.stdout:9/931: stat dd 0 2024-09-13T02:52:52.983 INFO:tasks.workunit.client.0.smithi098.stdout:5/369: dwrite d0/d15/f3a [0,4194304] 0 2024-09-13T02:52:52.983 INFO:tasks.workunit.client.0.smithi098.stdout:0/476: dwrite dd/df/d1d/d26/d28/d32/d67/d81/f9a [0,4194304] 0 2024-09-13T02:52:52.985 INFO:tasks.workunit.client.1.smithi142.stdout:7/934: rename d10/d13/d21/l3a to d10/d13/d1d/d25/d5c/da3/l12b 0 2024-09-13T02:52:52.986 INFO:tasks.workunit.client.0.smithi098.stdout:3/430: rename d7/d9/d4c/f4f to d7/d9/d4c/f81 0 2024-09-13T02:52:52.993 INFO:tasks.workunit.client.0.smithi098.stdout:9/449: rename d2/d6/d91/d92 to d2/d6/d36/d8d/d39/d43/d90/da0 0 2024-09-13T02:52:52.994 INFO:tasks.workunit.client.0.smithi098.stdout:6/378: symlink d5/d13/l83 0 2024-09-13T02:52:52.995 INFO:tasks.workunit.client.0.smithi098.stdout:6/379: write d5/d13/d2b/f48 [1325031,127062] 0 2024-09-13T02:52:52.997 INFO:tasks.workunit.client.1.smithi142.stdout:5/907: mknod d8/dc3/d3f/c127 0 2024-09-13T02:52:52.998 INFO:tasks.workunit.client.1.smithi142.stdout:5/908: chown d8/d47/d65/da0/dd1/d45/d62/f6c 46 1 2024-09-13T02:52:52.999 INFO:tasks.workunit.client.1.smithi142.stdout:1/886: link d12/d13/d20/d66/d55/db4/fd5 d12/d13/dd3/f11a 0 2024-09-13T02:52:53.003 INFO:tasks.workunit.client.1.smithi142.stdout:8/777: getdents d0/da2/dec 0 2024-09-13T02:52:53.004 INFO:tasks.workunit.client.0.smithi098.stdout:0/477: mkdir dd/d1f/d85/d9d 0 2024-09-13T02:52:53.006 INFO:tasks.workunit.client.0.smithi098.stdout:6/380: dread - d5/d18/f40 zero size 2024-09-13T02:52:53.007 INFO:tasks.workunit.client.1.smithi142.stdout:7/935: mknod d10/d34/d65/c12c 0 2024-09-13T02:52:53.010 INFO:tasks.workunit.client.0.smithi098.stdout:3/431: truncate f4 2884781 0 2024-09-13T02:52:53.011 INFO:tasks.workunit.client.1.smithi142.stdout:0/903: mknod d10/d6c/d88/d21/d51/d35/d9b/da5/d126/c12e 0 2024-09-13T02:52:53.011 INFO:tasks.workunit.client.1.smithi142.stdout:0/904: dread - d10/d6c/f123 zero size 2024-09-13T02:52:53.012 INFO:tasks.workunit.client.0.smithi098.stdout:6/381: dwrite f4 [0,4194304] 0 2024-09-13T02:52:53.015 INFO:tasks.workunit.client.1.smithi142.stdout:6/920: getdents d1/dd/d16/d4e/d32 0 2024-09-13T02:52:53.017 INFO:tasks.workunit.client.1.smithi142.stdout:5/909: rmdir d8/d47/d65/da0/dd1/d45/d81 39 2024-09-13T02:52:53.019 INFO:tasks.workunit.client.1.smithi142.stdout:3/843: write d12/d16/d25/d2e/d38/d4d/d53/feb [711122,43491] 0 2024-09-13T02:52:53.021 INFO:tasks.workunit.client.1.smithi142.stdout:2/765: link d1/de/d1f/d13/d60/da9/de9/lf4 d1/d29/d72/daa/lf7 0 2024-09-13T02:52:53.022 INFO:tasks.workunit.client.0.smithi098.stdout:9/450: creat d2/d6/d2b/fa1 x:0 0 0 2024-09-13T02:52:53.024 INFO:tasks.workunit.client.0.smithi098.stdout:9/451: truncate d2/d6/f19 1829273 0 2024-09-13T02:52:53.024 INFO:tasks.workunit.client.0.smithi098.stdout:8/393: dread d2/f4e [0,4194304] 0 2024-09-13T02:52:53.025 INFO:tasks.workunit.client.0.smithi098.stdout:9/452: dread - d2/d6/d2b/d4d/d56/f99 zero size 2024-09-13T02:52:53.026 INFO:tasks.workunit.client.0.smithi098.stdout:0/478: creat dd/d95/f9e x:0 0 0 2024-09-13T02:52:53.026 INFO:tasks.workunit.client.1.smithi142.stdout:8/778: mkdir d0/d6/dc/d45/d8/df/d28/dfc 0 2024-09-13T02:52:53.027 INFO:tasks.workunit.client.0.smithi098.stdout:9/453: write d2/d6/d36/d8d/d39/f3e [3747179,130442] 0 2024-09-13T02:52:53.029 INFO:tasks.workunit.client.0.smithi098.stdout:0/479: truncate dd/df/d1d/d26/d28/d32/f98 704163 0 2024-09-13T02:52:53.031 INFO:tasks.workunit.client.0.smithi098.stdout:0/480: readlink dd/df/d1d/d26/d28/d5d/l90 0 2024-09-13T02:52:53.032 INFO:tasks.workunit.client.0.smithi098.stdout:0/481: chown dd/d1f/d85/d9d 32 1 2024-09-13T02:52:53.032 INFO:tasks.workunit.client.0.smithi098.stdout:5/370: getdents d0/d15/d17/d1c 0 2024-09-13T02:52:53.033 INFO:tasks.workunit.client.0.smithi098.stdout:0/482: readlink dd/df/d1d/d26/d28/d32/d67/d71/l99 0 2024-09-13T02:52:53.037 INFO:tasks.workunit.client.1.smithi142.stdout:0/905: read d10/d6c/d88/d21/d51/d35/f8c [370626,121858] 0 2024-09-13T02:52:53.040 INFO:tasks.workunit.client.0.smithi098.stdout:4/338: sync 2024-09-13T02:52:53.040 INFO:tasks.workunit.client.0.smithi098.stdout:2/359: sync 2024-09-13T02:52:53.040 INFO:tasks.workunit.client.0.smithi098.stdout:7/571: sync 2024-09-13T02:52:53.040 INFO:tasks.workunit.client.0.smithi098.stdout:1/501: sync 2024-09-13T02:52:53.041 INFO:tasks.workunit.client.1.smithi142.stdout:5/910: creat d8/dc3/d64/d68/f128 x:0 0 0 2024-09-13T02:52:53.042 INFO:tasks.workunit.client.0.smithi098.stdout:0/483: dwrite dd/df/d1d/d26/d28/f2e [0,4194304] 0 2024-09-13T02:52:53.044 INFO:tasks.workunit.client.1.smithi142.stdout:1/887: mkdir d12/d13/d20/d66/d7d/df5/d11b 0 2024-09-13T02:52:53.048 INFO:tasks.workunit.client.1.smithi142.stdout:3/844: mknod d12/dd3/db6/c108 0 2024-09-13T02:52:53.052 INFO:tasks.workunit.client.1.smithi142.stdout:6/921: write d1/d7/d5f/d6a/f95 [1264509,119859] 0 2024-09-13T02:52:53.053 INFO:tasks.workunit.client.0.smithi098.stdout:9/454: dwrite d2/d6/d36/d8d/d39/d43/f50 [0,4194304] 0 2024-09-13T02:52:53.053 INFO:tasks.workunit.client.1.smithi142.stdout:8/779: fdatasync d0/d6/dc/fe 0 2024-09-13T02:52:53.055 INFO:tasks.workunit.client.1.smithi142.stdout:7/936: dwrite d10/d34/d57/d98/fb7 [4194304,4194304] 0 2024-09-13T02:52:53.056 INFO:tasks.workunit.client.1.smithi142.stdout:6/922: write d1/d7/d19/f45 [3807054,98819] 0 2024-09-13T02:52:53.056 INFO:tasks.workunit.client.1.smithi142.stdout:9/932: link dd/f11 dd/d148/dc9/d103/f151 0 2024-09-13T02:52:53.058 INFO:tasks.workunit.client.0.smithi098.stdout:2/360: write d1/d1f/d27/f61 [907109,45039] 0 2024-09-13T02:52:53.058 INFO:tasks.workunit.client.1.smithi142.stdout:8/780: write d0/d6/dc/d40/d4d/d62/f74 [1718899,107756] 0 2024-09-13T02:52:53.058 INFO:tasks.workunit.client.1.smithi142.stdout:4/847: getdents d0/d2b/d21/db4 0 2024-09-13T02:52:53.060 INFO:tasks.workunit.client.0.smithi098.stdout:1/502: mknod d9/d33/d19/d35/d68/d4d/dbc/d6b/d7c/cbd 0 2024-09-13T02:52:53.064 INFO:tasks.workunit.client.0.smithi098.stdout:0/484: creat dd/df/d1d/d40/d46/d6b/f9f x:0 0 0 2024-09-13T02:52:53.065 INFO:tasks.workunit.client.0.smithi098.stdout:6/382: link d5/d13/d2b/d3a/d14/c3e d5/d13/d2b/c84 0 2024-09-13T02:52:53.066 INFO:tasks.workunit.client.1.smithi142.stdout:2/766: write d1/de/d1f/f8d [561984,34554] 0 2024-09-13T02:52:53.066 INFO:tasks.workunit.client.0.smithi098.stdout:0/485: chown dd/df/d1d/d40/d46/d6b/c6e 1 1 2024-09-13T02:52:53.067 INFO:tasks.workunit.client.1.smithi142.stdout:5/911: truncate d8/dc3/d3f/f95 77617 0 2024-09-13T02:52:53.070 INFO:tasks.workunit.client.0.smithi098.stdout:3/432: rename d7/d9/d15/d2d/f42 to d7/d9/d15/f82 0 2024-09-13T02:52:53.071 INFO:tasks.workunit.client.0.smithi098.stdout:3/433: readlink d7/d9/d25/d3a/d52/l59 0 2024-09-13T02:52:53.073 INFO:tasks.workunit.client.1.smithi142.stdout:1/888: rmdir d12/d13/d20/d66 39 2024-09-13T02:52:53.074 INFO:tasks.workunit.client.0.smithi098.stdout:9/455: mkdir d2/d6/d36/d8d/d39/d43/d90/da2 0 2024-09-13T02:52:53.077 INFO:tasks.workunit.client.0.smithi098.stdout:8/394: creat d2/f7d x:0 0 0 2024-09-13T02:52:53.079 INFO:tasks.workunit.client.0.smithi098.stdout:8/395: write f1 [1153951,78145] 0 2024-09-13T02:52:53.079 INFO:tasks.workunit.client.0.smithi098.stdout:4/339: symlink d6/l77 0 2024-09-13T02:52:53.080 INFO:tasks.workunit.client.0.smithi098.stdout:3/434: dwrite d7/d9/d25/d3a/d52/f55 [0,4194304] 0 2024-09-13T02:52:53.089 INFO:tasks.workunit.client.0.smithi098.stdout:3/435: dwrite d7/d9/d15/d5d/f65 [4194304,4194304] 0 2024-09-13T02:52:53.091 INFO:tasks.workunit.client.0.smithi098.stdout:6/383: mkdir d5/d13/d67/d85 0 2024-09-13T02:52:53.094 INFO:tasks.workunit.client.0.smithi098.stdout:0/486: creat dd/df/d1d/d26/d37/fa0 x:0 0 0 2024-09-13T02:52:53.101 INFO:tasks.workunit.client.1.smithi142.stdout:4/848: rename d0/d2b/d2d/c84 to d0/df/da5/c113 0 2024-09-13T02:52:53.101 INFO:tasks.workunit.client.1.smithi142.stdout:9/933: write dd/d17/d4f/d91/f93 [648051,50070] 0 2024-09-13T02:52:53.104 INFO:tasks.workunit.client.1.smithi142.stdout:2/767: creat d1/de/d1f/d13/d59/ff8 x:0 0 0 2024-09-13T02:52:53.105 INFO:tasks.workunit.client.1.smithi142.stdout:2/768: stat d1/d29 0 2024-09-13T02:52:53.106 INFO:tasks.workunit.client.1.smithi142.stdout:2/769: dread - d1/de/f56 zero size 2024-09-13T02:52:53.106 INFO:tasks.workunit.client.0.smithi098.stdout:8/396: read d2/f41 [380090,74297] 0 2024-09-13T02:52:53.107 INFO:tasks.workunit.client.1.smithi142.stdout:2/770: stat d1/d2d/l8b 0 2024-09-13T02:52:53.107 INFO:tasks.workunit.client.1.smithi142.stdout:9/934: dwrite dd/d98/f13a [0,4194304] 0 2024-09-13T02:52:53.108 INFO:tasks.workunit.client.1.smithi142.stdout:2/771: dread - d1/de/d1f/d13/f89 zero size 2024-09-13T02:52:53.113 INFO:tasks.workunit.client.1.smithi142.stdout:6/923: mkdir d1/d7/d19/d139 0 2024-09-13T02:52:53.114 INFO:tasks.workunit.client.0.smithi098.stdout:3/436: creat d7/d9/d25/d64/d6f/f83 x:0 0 0 2024-09-13T02:52:53.115 INFO:tasks.workunit.client.0.smithi098.stdout:0/487: fdatasync dd/df/d1d/d26/d28/d5d/f66 0 2024-09-13T02:52:53.117 INFO:tasks.workunit.client.0.smithi098.stdout:0/488: write dd/df/d1d/d26/d28/d32/f98 [1707181,9642] 0 2024-09-13T02:52:53.118 INFO:tasks.workunit.client.1.smithi142.stdout:8/781: fsync d0/d6/dc/d40/d46/f7b 0 2024-09-13T02:52:53.120 INFO:tasks.workunit.client.1.smithi142.stdout:4/849: read - d0/d2b/d2d/d31/d43/fbd zero size 2024-09-13T02:52:53.122 INFO:tasks.workunit.client.0.smithi098.stdout:9/456: unlink d2/d6/d2b/d66/f75 0 2024-09-13T02:52:53.123 INFO:tasks.workunit.client.1.smithi142.stdout:7/937: write d10/d13/d1d/d2b/d56/d41/f68 [2432912,68734] 0 2024-09-13T02:52:53.123 INFO:tasks.workunit.client.0.smithi098.stdout:9/457: fsync d2/d6/d36/d8d/d39/d43/f50 0 2024-09-13T02:52:53.124 INFO:tasks.workunit.client.0.smithi098.stdout:4/340: dwrite d6/d22/d3d/d41/f5b [0,4194304] 0 2024-09-13T02:52:53.124 INFO:tasks.workunit.client.1.smithi142.stdout:7/938: dread - d10/d13/d1d/f94 zero size 2024-09-13T02:52:53.125 INFO:tasks.workunit.client.0.smithi098.stdout:9/458: fdatasync d2/d6/d2b/d66/f78 0 2024-09-13T02:52:53.133 INFO:tasks.workunit.client.0.smithi098.stdout:2/361: creat d1/d1f/d35/f71 x:0 0 0 2024-09-13T02:52:53.135 INFO:tasks.workunit.client.1.smithi142.stdout:5/912: truncate d8/dc3/d3f/ddd/d125/fc8 2599841 0 2024-09-13T02:52:53.139 INFO:tasks.workunit.client.1.smithi142.stdout:8/782: unlink d0/d6/dc/ld 0 2024-09-13T02:52:53.140 INFO:tasks.workunit.client.1.smithi142.stdout:9/935: dwrite dd/f58 [0,4194304] 0 2024-09-13T02:52:53.141 INFO:tasks.workunit.client.0.smithi098.stdout:0/489: chown dd/df/d1d/d40/d46/c6a 0 1 2024-09-13T02:52:53.142 INFO:tasks.workunit.client.0.smithi098.stdout:5/371: rename d0/d38/d3f/d1a/f41 to d0/d15/f80 0 2024-09-13T02:52:53.144 INFO:tasks.workunit.client.1.smithi142.stdout:0/906: creat d10/d6c/d88/d1a/d7a/d100/f12f x:0 0 0 2024-09-13T02:52:53.149 INFO:tasks.workunit.client.0.smithi098.stdout:2/362: dread d1/d1a/f7 [0,4194304] 0 2024-09-13T02:52:53.149 INFO:tasks.workunit.client.0.smithi098.stdout:5/372: dwrite d0/d15/d17/f28 [0,4194304] 0 2024-09-13T02:52:53.150 INFO:tasks.workunit.client.0.smithi098.stdout:5/373: stat d0/d29 0 2024-09-13T02:52:53.152 INFO:tasks.workunit.client.1.smithi142.stdout:2/772: fsync d1/de/da6/dbb/fa1 0 2024-09-13T02:52:53.154 INFO:tasks.workunit.client.1.smithi142.stdout:4/850: dwrite d0/d2b/d21/d30/f3a [0,4194304] 0 2024-09-13T02:52:53.155 INFO:tasks.workunit.client.1.smithi142.stdout:1/889: mkdir d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d11c 0 2024-09-13T02:52:53.158 INFO:tasks.workunit.client.1.smithi142.stdout:5/913: mknod d8/dac/c129 0 2024-09-13T02:52:53.160 INFO:tasks.workunit.client.0.smithi098.stdout:5/374: dwrite d0/d38/d3f/fc [0,4194304] 0 2024-09-13T02:52:53.165 INFO:tasks.workunit.client.1.smithi142.stdout:7/939: dwrite d10/f47 [0,4194304] 0 2024-09-13T02:52:53.165 INFO:tasks.workunit.client.0.smithi098.stdout:8/397: link d2/dd/d11/f18 d2/dd/d11/d49/f7e 0 2024-09-13T02:52:53.166 INFO:tasks.workunit.client.1.smithi142.stdout:7/940: read d10/d13/d1d/f83 [945956,52523] 0 2024-09-13T02:52:53.167 INFO:tasks.workunit.client.1.smithi142.stdout:7/941: read - d10/d13/d1d/d2b/dae/f11b zero size 2024-09-13T02:52:53.169 INFO:tasks.workunit.client.0.smithi098.stdout:6/384: creat d5/d13/d2b/d3a/f86 x:0 0 0 2024-09-13T02:52:53.169 INFO:tasks.workunit.client.1.smithi142.stdout:8/783: symlink d0/d6/dc/d45/d35/d61/d77/lfd 0 2024-09-13T02:52:53.172 INFO:tasks.workunit.client.0.smithi098.stdout:9/459: dwrite d2/d6/d36/d6a/f7d [4194304,4194304] 0 2024-09-13T02:52:53.174 INFO:tasks.workunit.client.0.smithi098.stdout:0/490: mkdir dd/df/d1d/d26/d28/d32/da1 0 2024-09-13T02:52:53.178 INFO:tasks.workunit.client.0.smithi098.stdout:2/363: mkdir d1/d1f/d35/d63/d72 0 2024-09-13T02:52:53.188 INFO:tasks.workunit.client.1.smithi142.stdout:1/890: symlink d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/d112/l11d 0 2024-09-13T02:52:53.190 INFO:tasks.workunit.client.1.smithi142.stdout:5/914: mkdir d8/d47/d65/da0/dd1/d45/d62/d12a 0 2024-09-13T02:52:53.193 INFO:tasks.workunit.client.1.smithi142.stdout:6/924: creat d1/dd/d53/d78/d104/dad/f13a x:0 0 0 2024-09-13T02:52:53.196 INFO:tasks.workunit.client.1.smithi142.stdout:7/942: creat d10/d13/d1d/d25/d45/d6d/d118/f12d x:0 0 0 2024-09-13T02:52:53.202 INFO:tasks.workunit.client.0.smithi098.stdout:3/437: truncate d7/d9/d15/f49 2410929 0 2024-09-13T02:52:53.205 INFO:tasks.workunit.client.0.smithi098.stdout:9/460: dread d2/d6/d36/d6a/f6b [0,4194304] 0 2024-09-13T02:52:53.214 INFO:tasks.workunit.client.1.smithi142.stdout:6/925: fdatasync d1/dd/d16/d4e/d32/f113 0 2024-09-13T02:52:53.219 INFO:tasks.workunit.client.1.smithi142.stdout:7/943: mknod d10/d13/d1d/d2b/d55/d32/d8c/c12e 0 2024-09-13T02:52:53.220 INFO:tasks.workunit.client.0.smithi098.stdout:1/503: getdents d9/d33/d29/d58 0 2024-09-13T02:52:53.222 INFO:tasks.workunit.client.1.smithi142.stdout:0/907: rename d10/d6c/d88/d1a/d1e/dc6/f118 to d10/d6c/d88/d1a/d7a/f130 0 2024-09-13T02:52:53.226 INFO:tasks.workunit.client.0.smithi098.stdout:6/385: mknod d5/d13/d2b/d3a/d41/d7e/c87 0 2024-09-13T02:52:53.231 INFO:tasks.workunit.client.0.smithi098.stdout:2/364: unlink d1/d1a/d4f/l4d 0 2024-09-13T02:52:53.234 INFO:tasks.workunit.client.1.smithi142.stdout:4/851: write d0/df/f23 [4677744,125810] 0 2024-09-13T02:52:53.234 INFO:tasks.workunit.client.1.smithi142.stdout:6/926: mknod d1/d7/d5f/c13b 0 2024-09-13T02:52:53.237 INFO:tasks.workunit.client.1.smithi142.stdout:1/891: write d12/d13/dd3/f11a [1764602,85197] 0 2024-09-13T02:52:53.242 INFO:tasks.workunit.client.1.smithi142.stdout:6/927: dwrite d1/d7/d5f/d6a/f95 [0,4194304] 0 2024-09-13T02:52:53.244 INFO:tasks.workunit.client.1.smithi142.stdout:6/928: chown d1/dd/d53/d78/db8/fc2 380790752 1 2024-09-13T02:52:53.244 INFO:tasks.workunit.client.1.smithi142.stdout:9/936: rename dd/d17/d69/d84/c136 to dd/d17/d25/d11c/c152 0 2024-09-13T02:52:53.244 INFO:tasks.workunit.client.0.smithi098.stdout:6/386: dread d5/d13/f3f [0,4194304] 0 2024-09-13T02:52:53.245 INFO:tasks.workunit.client.0.smithi098.stdout:7/572: rename d6/f92 to d6/d24/d2a/d5a/d42/fb6 0 2024-09-13T02:52:53.247 INFO:tasks.workunit.client.1.smithi142.stdout:2/773: getdents d1/de/d1f/d13/d59 0 2024-09-13T02:52:53.251 INFO:tasks.workunit.client.0.smithi098.stdout:6/387: dwrite d5/fb [0,4194304] 0 2024-09-13T02:52:53.252 INFO:tasks.workunit.client.0.smithi098.stdout:2/365: symlink d1/d1a/d9/l73 0 2024-09-13T02:52:53.252 INFO:tasks.workunit.client.0.smithi098.stdout:6/388: fsync d5/d13/d67/f6a 0 2024-09-13T02:52:53.255 INFO:tasks.workunit.client.0.smithi098.stdout:6/389: read d5/d13/d2b/d5b/f63 [97537,94583] 0 2024-09-13T02:52:53.256 INFO:tasks.workunit.client.0.smithi098.stdout:3/438: link d7/d9/d15/d2d/d34/f5a d7/d9/d15/d26/f84 0 2024-09-13T02:52:53.257 INFO:tasks.workunit.client.0.smithi098.stdout:1/504: write d9/d33/d19/d35/d68/d2f/f3e [1013381,46366] 0 2024-09-13T02:52:53.259 INFO:tasks.workunit.client.1.smithi142.stdout:7/944: symlink d10/d13/d1d/d2b/d56/d5f/l12f 0 2024-09-13T02:52:53.260 INFO:tasks.workunit.client.0.smithi098.stdout:5/375: dwrite d0/d38/d3f/d1a/f67 [0,4194304] 0 2024-09-13T02:52:53.260 INFO:tasks.workunit.client.1.smithi142.stdout:1/892: chown d12/d13/d20/f38 13236 1 2024-09-13T02:52:53.262 INFO:tasks.workunit.client.1.smithi142.stdout:6/929: readlink d1/d7/d5f/d6a/l135 0 2024-09-13T02:52:53.262 INFO:tasks.workunit.client.0.smithi098.stdout:5/376: write d0/d15/f5f [1214522,56797] 0 2024-09-13T02:52:53.265 INFO:tasks.workunit.client.1.smithi142.stdout:5/915: rename d8/dc3/d3f/ddd/d125/d4b to d8/d47/d65/da0/dd1/d45/d81/d82/d12b 0 2024-09-13T02:52:53.267 INFO:tasks.workunit.client.0.smithi098.stdout:0/491: rename dd/df/d1d/d26/d37/c80 to dd/df/d1d/d26/d28/d32/d67/d81/ca2 0 2024-09-13T02:52:53.270 INFO:tasks.workunit.client.1.smithi142.stdout:1/893: dread d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/dc0/dc3/f5d [0,4194304] 0 2024-09-13T02:52:53.270 INFO:tasks.workunit.client.0.smithi098.stdout:7/573: creat d6/d47/fb7 x:0 0 0 2024-09-13T02:52:53.270 INFO:tasks.workunit.client.1.smithi142.stdout:2/774: dread - d1/de/d31/d6c/d6d/d47/faf zero size 2024-09-13T02:52:53.273 INFO:tasks.workunit.client.0.smithi098.stdout:5/377: dwrite d0/d29/f7d [0,4194304] 0 2024-09-13T02:52:53.273 INFO:tasks.workunit.client.1.smithi142.stdout:8/784: mkdir d0/d6/dc/d40/d46/dfe 0 2024-09-13T02:52:53.275 INFO:tasks.workunit.client.1.smithi142.stdout:4/852: mkdir d0/dc8/d114 0 2024-09-13T02:52:53.276 INFO:tasks.workunit.client.1.smithi142.stdout:2/775: dwrite d1/de/da6/dbb/d92/fbf [0,4194304] 0 2024-09-13T02:52:53.277 INFO:tasks.workunit.client.1.smithi142.stdout:7/945: creat d10/d13/d1d/d25/d45/d6d/f130 x:0 0 0 2024-09-13T02:52:53.280 INFO:tasks.workunit.client.0.smithi098.stdout:3/439: truncate d7/d9/d25/d2b/f75 1086898 0 2024-09-13T02:52:53.282 INFO:tasks.workunit.client.1.smithi142.stdout:1/894: rmdir d12/d13/d20/d66/d55 39 2024-09-13T02:52:53.287 INFO:tasks.workunit.client.0.smithi098.stdout:7/574: rmdir d6/d24/d2a/d5a/d4c 39 2024-09-13T02:52:53.287 INFO:tasks.workunit.client.0.smithi098.stdout:2/366: dread d1/d1a/d9/d1e/f47 [0,4194304] 0 2024-09-13T02:52:53.290 INFO:tasks.workunit.client.1.smithi142.stdout:4/853: dwrite d0/d7e/ff7 [0,4194304] 0 2024-09-13T02:52:53.290 INFO:tasks.workunit.client.0.smithi098.stdout:5/378: chown d0/d15/d50/d78/d4d/c65 184026573 1 2024-09-13T02:52:53.291 INFO:tasks.workunit.client.0.smithi098.stdout:5/379: stat d0/f4b 0 2024-09-13T02:52:53.291 INFO:tasks.workunit.client.0.smithi098.stdout:2/367: read d1/d1a/d9/d1e/d5a/f60 [1209715,95697] 0 2024-09-13T02:52:53.292 INFO:tasks.workunit.client.1.smithi142.stdout:7/946: rmdir d10/d13/d1d/d2b 39 2024-09-13T02:52:53.294 INFO:tasks.workunit.client.0.smithi098.stdout:1/505: creat d9/d33/d19/d35/d68/d4d/db5/db8/fbe x:0 0 0 2024-09-13T02:52:53.296 INFO:tasks.workunit.client.1.smithi142.stdout:2/776: dread - d1/de/d31/d6c/d6d/d47/f68 zero size 2024-09-13T02:52:53.299 INFO:tasks.workunit.client.1.smithi142.stdout:3/845: sync 2024-09-13T02:52:53.300 INFO:tasks.workunit.client.0.smithi098.stdout:9/461: rename d2/d6/d36/d8d/c15 to d2/d6/d36/d8d/d39/d43/d90/ca3 0 2024-09-13T02:52:53.306 INFO:tasks.workunit.client.0.smithi098.stdout:2/368: fdatasync d1/d1a/d9/d1e/f47 0 2024-09-13T02:52:53.307 INFO:tasks.workunit.client.1.smithi142.stdout:9/937: write dd/d17/d44/d82/d99/da8/fda [7974,106275] 0 2024-09-13T02:52:53.307 INFO:tasks.workunit.client.1.smithi142.stdout:9/938: stat dd/d87/f10a 0 2024-09-13T02:52:53.311 INFO:tasks.workunit.client.0.smithi098.stdout:8/398: rename d2/fe to d2/d28/d43/f7f 0 2024-09-13T02:52:53.317 INFO:tasks.workunit.client.0.smithi098.stdout:3/440: creat d7/d9/d15/f85 x:0 0 0 2024-09-13T02:52:53.324 INFO:tasks.workunit.client.0.smithi098.stdout:6/390: rename d5/d18/d4e/l5c to d5/l88 0 2024-09-13T02:52:53.324 INFO:tasks.workunit.client.0.smithi098.stdout:0/492: dwrite dd/df/d1d/f34 [0,4194304] 0 2024-09-13T02:52:53.325 INFO:tasks.workunit.client.1.smithi142.stdout:2/777: dread d1/d29/f86 [0,4194304] 0 2024-09-13T02:52:53.333 INFO:tasks.workunit.client.0.smithi098.stdout:5/380: dwrite d0/d15/d17/d1c/f2d [4194304,4194304] 0 2024-09-13T02:52:53.335 INFO:tasks.workunit.client.0.smithi098.stdout:8/399: truncate d2/f4a 1216193 0 2024-09-13T02:52:53.335 INFO:tasks.workunit.client.0.smithi098.stdout:5/381: write d0/d38/d3f/f11 [1555528,40014] 0 2024-09-13T02:52:53.336 INFO:tasks.workunit.client.0.smithi098.stdout:5/382: readlink d0/l68 0 2024-09-13T02:52:53.340 INFO:tasks.workunit.client.0.smithi098.stdout:9/462: dwrite d2/d6/d36/f82 [0,4194304] 0 2024-09-13T02:52:53.346 INFO:tasks.workunit.client.0.smithi098.stdout:9/463: dread d2/d6/d2b/d4d/d4f/d6c/f85 [0,4194304] 0 2024-09-13T02:52:53.350 INFO:tasks.workunit.client.1.smithi142.stdout:8/785: fdatasync d0/d6/dc/d45/d35/d37/f5d 0 2024-09-13T02:52:53.351 INFO:tasks.workunit.client.0.smithi098.stdout:3/441: truncate f4 1490003 0 2024-09-13T02:52:53.352 INFO:tasks.workunit.client.1.smithi142.stdout:4/854: fdatasync d0/d2b/d2d/d31/d32/f50 0 2024-09-13T02:52:53.353 INFO:tasks.workunit.client.1.smithi142.stdout:4/855: chown d0/df/f5d 60045 1 2024-09-13T02:52:53.358 INFO:tasks.workunit.client.0.smithi098.stdout:5/383: chown d0/d15/f80 11 1 2024-09-13T02:52:53.358 INFO:tasks.workunit.client.0.smithi098.stdout:5/384: stat d0/d15/d17/f28 0 2024-09-13T02:52:53.359 INFO:tasks.workunit.client.0.smithi098.stdout:5/385: chown d0/d15/d69 25498 1 2024-09-13T02:52:53.359 INFO:tasks.workunit.client.1.smithi142.stdout:6/930: creat d1/dd/d53/d78/d104/dad/f13c x:0 0 0 2024-09-13T02:52:53.361 INFO:tasks.workunit.client.1.smithi142.stdout:3/846: fdatasync d12/d16/d25/d2e/d38/d5a/f72 0 2024-09-13T02:52:53.363 INFO:tasks.workunit.client.1.smithi142.stdout:9/939: readlink dd/l12 0 2024-09-13T02:52:53.364 INFO:tasks.workunit.client.0.smithi098.stdout:5/386: dwrite d0/d38/d3f/fc [0,4194304] 0 2024-09-13T02:52:53.368 INFO:tasks.workunit.client.0.smithi098.stdout:2/369: getdents d1/d1a/d9/d1e 0 2024-09-13T02:52:53.369 INFO:tasks.workunit.client.1.smithi142.stdout:8/786: dread d0/d6/dc/d45/d35/f63 [0,4194304] 0 2024-09-13T02:52:53.370 INFO:tasks.workunit.client.0.smithi098.stdout:8/400: write d2/d2f/d78/f50 [1346363,33434] 0 2024-09-13T02:52:53.374 INFO:tasks.workunit.client.0.smithi098.stdout:0/493: truncate dd/df/d1d/d26/d28/d32/f49 273077 0 2024-09-13T02:52:53.376 INFO:tasks.workunit.client.1.smithi142.stdout:4/856: unlink d0/d2b/d2d/d31/d32/daa/fc2 0 2024-09-13T02:52:53.379 INFO:tasks.workunit.client.1.smithi142.stdout:7/947: mkdir d10/d13/d1d/d2b/d56/d39/d131 0 2024-09-13T02:52:53.380 INFO:tasks.workunit.client.1.smithi142.stdout:2/778: dwrite d1/de/f20 [0,4194304] 0 2024-09-13T02:52:53.381 INFO:tasks.workunit.client.1.smithi142.stdout:2/779: readlink d1/de/d1f/d13/l4e 0 2024-09-13T02:52:53.383 INFO:tasks.workunit.client.0.smithi098.stdout:1/506: rename d9/d33/d19/d35/d68/d4d/dbc/d6b/d7c to d9/d33/d19/d35/d68/d2f/dbf 0 2024-09-13T02:52:53.384 INFO:tasks.workunit.client.0.smithi098.stdout:1/507: fsync d9/d33/d19/d35/d68/d2f/f3e 0 2024-09-13T02:52:53.385 INFO:tasks.workunit.client.0.smithi098.stdout:2/370: unlink d1/d1f/d27/l62 0 2024-09-13T02:52:53.385 INFO:tasks.workunit.client.0.smithi098.stdout:2/371: readlink d1/d1a/d9/l73 0 2024-09-13T02:52:53.387 INFO:tasks.workunit.client.0.smithi098.stdout:6/391: creat d5/d13/d2b/d5b/f89 x:0 0 0 2024-09-13T02:52:53.388 INFO:tasks.workunit.client.1.smithi142.stdout:3/847: creat d12/d16/f109 x:0 0 0 2024-09-13T02:52:53.389 INFO:tasks.workunit.client.1.smithi142.stdout:9/940: unlink dd/dcb/fd9 0 2024-09-13T02:52:53.390 INFO:tasks.workunit.client.0.smithi098.stdout:0/494: read - dd/df/d1d/f64 zero size 2024-09-13T02:52:53.391 INFO:tasks.workunit.client.1.smithi142.stdout:1/895: symlink d12/d13/d20/d66/d55/l11e 0 2024-09-13T02:52:53.392 INFO:tasks.workunit.client.0.smithi098.stdout:1/508: dwrite d9/d33/d19/d35/d63/faa [0,4194304] 0 2024-09-13T02:52:53.393 INFO:tasks.workunit.client.0.smithi098.stdout:0/495: write dd/df/d1d/d26/d37/f73 [4537324,24119] 0 2024-09-13T02:52:53.394 INFO:tasks.workunit.client.0.smithi098.stdout:0/496: chown dd/df/d1d/d26/d28/d32/f4d 4 1 2024-09-13T02:52:53.396 INFO:tasks.workunit.client.0.smithi098.stdout:9/464: rename d2/d6/d2b/d4d/l65 to d2/d6/d36/d8d/d39/d43/d90/la4 0 2024-09-13T02:52:53.397 INFO:tasks.workunit.client.0.smithi098.stdout:0/497: write dd/df/d1d/d26/f7d [2111039,20762] 0 2024-09-13T02:52:53.397 INFO:tasks.workunit.client.1.smithi142.stdout:5/916: sync 2024-09-13T02:52:53.397 INFO:tasks.workunit.client.1.smithi142.stdout:0/908: sync 2024-09-13T02:52:53.406 INFO:tasks.workunit.client.0.smithi098.stdout:3/442: creat d7/d9/f86 x:0 0 0 2024-09-13T02:52:53.411 INFO:tasks.workunit.client.0.smithi098.stdout:6/392: dread d5/d18/f45 [0,4194304] 0 2024-09-13T02:52:53.416 INFO:tasks.workunit.client.1.smithi142.stdout:6/931: mknod d1/d7/d42/d88/de3/c13d 0 2024-09-13T02:52:53.416 INFO:tasks.workunit.client.1.smithi142.stdout:6/932: chown d1/d7/d42/d88/cf4 31 1 2024-09-13T02:52:53.417 INFO:tasks.workunit.client.0.smithi098.stdout:1/509: creat d9/d33/d19/d35/d68/d4d/db5/fc0 x:0 0 0 2024-09-13T02:52:53.423 INFO:tasks.workunit.client.0.smithi098.stdout:5/387: rename d0/d15/d50/d78 to d0/d38/d3f/d81 0 2024-09-13T02:52:53.424 INFO:tasks.workunit.client.1.smithi142.stdout:6/933: dwrite d1/dd/d53/d78/d8f/da8/dc1/f119 [0,4194304] 0 2024-09-13T02:52:53.424 INFO:tasks.workunit.client.1.smithi142.stdout:8/787: dwrite d0/f6b [0,4194304] 0 2024-09-13T02:52:53.424 INFO:tasks.workunit.client.1.smithi142.stdout:9/941: truncate dd/d17/d69/d84/fb4 72366 0 2024-09-13T02:52:53.427 INFO:tasks.workunit.client.1.smithi142.stdout:1/896: dread - d12/d13/d20/d66/d55/ff7 zero size 2024-09-13T02:52:53.432 INFO:tasks.workunit.client.0.smithi098.stdout:8/401: truncate d2/dd/d11/d1d/f45 1063657 0 2024-09-13T02:52:53.433 INFO:tasks.workunit.client.0.smithi098.stdout:2/372: dwrite d1/d1a/d9/f5c [0,4194304] 0 2024-09-13T02:52:53.435 INFO:tasks.workunit.client.1.smithi142.stdout:4/857: dwrite d0/d2b/d2d/d31/d32/f3d [4194304,4194304] 0 2024-09-13T02:52:53.441 INFO:tasks.workunit.client.1.smithi142.stdout:2/780: dwrite d1/d42/f8f [0,4194304] 0 2024-09-13T02:52:53.447 INFO:tasks.workunit.client.1.smithi142.stdout:2/781: dread - d1/de/da6/dbb/fed zero size 2024-09-13T02:52:53.448 INFO:tasks.workunit.client.0.smithi098.stdout:4/341: sync 2024-09-13T02:52:53.449 INFO:tasks.workunit.client.1.smithi142.stdout:7/948: creat d10/d13/d21/df4/f132 x:0 0 0 2024-09-13T02:52:53.452 INFO:tasks.workunit.client.0.smithi098.stdout:9/465: rename d2/d6/d36/d8d/d39/f25 to d2/d6/d2b/d4d/d4f/d6c/fa5 0 2024-09-13T02:52:53.453 INFO:tasks.workunit.client.0.smithi098.stdout:9/466: chown d2/d6/d36/d8d/d39/f62 31 1 2024-09-13T02:52:53.458 INFO:tasks.workunit.client.0.smithi098.stdout:0/498: write dd/df/d1d/d26/d28/d5d/f66 [912504,64103] 0 2024-09-13T02:52:53.462 INFO:tasks.workunit.client.1.smithi142.stdout:6/934: unlink d1/d7/d5f/d60/l6b 0 2024-09-13T02:52:53.463 INFO:tasks.workunit.client.1.smithi142.stdout:6/935: dread - d1/dd/d16/d4e/d32/fe2 zero size 2024-09-13T02:52:53.465 INFO:tasks.workunit.client.1.smithi142.stdout:9/942: symlink dd/d148/dc9/d103/l153 0 2024-09-13T02:52:53.465 INFO:tasks.workunit.client.1.smithi142.stdout:9/943: chown dd/d17/d44/d95/dd1/ff9 45261 1 2024-09-13T02:52:53.468 INFO:tasks.workunit.client.1.smithi142.stdout:1/897: creat d12/d13/d20/d66/d7d/df5/d26/d4f/da9/f11f x:0 0 0 2024-09-13T02:52:53.468 INFO:tasks.workunit.client.0.smithi098.stdout:1/510: mknod d9/d33/d19/d35/cc1 0 2024-09-13T02:52:53.469 INFO:tasks.workunit.client.0.smithi098.stdout:1/511: readlink d9/d33/d19/d35/d68/d2f/dbf/l81 0 2024-09-13T02:52:53.470 INFO:tasks.workunit.client.1.smithi142.stdout:5/917: symlink d8/d47/d65/da0/dd1/d61/dcb/l12c 0 2024-09-13T02:52:53.473 INFO:tasks.workunit.client.1.smithi142.stdout:4/858: creat d0/d2b/d2d/d31/d32/f115 x:0 0 0 2024-09-13T02:52:53.474 INFO:tasks.workunit.client.1.smithi142.stdout:5/918: dread d8/dc3/df3/f114 [0,4194304] 0 2024-09-13T02:52:53.475 INFO:tasks.workunit.client.0.smithi098.stdout:6/393: rename d5/d13/c1a to d5/d13/d2b/d3a/d14/d6b/c8a 0 2024-09-13T02:52:53.479 INFO:tasks.workunit.client.1.smithi142.stdout:2/782: creat d1/d2d/ff9 x:0 0 0 2024-09-13T02:52:53.480 INFO:tasks.workunit.client.0.smithi098.stdout:0/499: mknod dd/df/d1d/d26/d28/d32/d67/d71/ca3 0 2024-09-13T02:52:53.482 INFO:tasks.workunit.client.0.smithi098.stdout:0/500: truncate dd/df/d1d/d26/d28/d32/d67/d81/f91 750154 0 2024-09-13T02:52:53.482 INFO:tasks.workunit.client.0.smithi098.stdout:3/443: link d7/d9/d25/d64/d6f/c7a d7/d9/d25/c87 0 2024-09-13T02:52:53.483 INFO:tasks.workunit.client.1.smithi142.stdout:6/936: dread d1/dd/d16/d4e/d32/f40 [0,4194304] 0 2024-09-13T02:52:53.483 INFO:tasks.workunit.client.0.smithi098.stdout:0/501: chown dd/df/d1d/d26/d37 40 1 2024-09-13T02:52:53.484 INFO:tasks.workunit.client.1.smithi142.stdout:3/848: mkdir d12/d16/d25/d10a 0 2024-09-13T02:52:53.488 INFO:tasks.workunit.client.1.smithi142.stdout:8/788: unlink d0/d6/dc/d45/d35/d61/cb1 0 2024-09-13T02:52:53.488 INFO:tasks.workunit.client.1.smithi142.stdout:6/937: dwrite d1/d7/d5f/d60/d76/f12d [0,4194304] 0 2024-09-13T02:52:53.489 INFO:tasks.workunit.client.0.smithi098.stdout:1/512: symlink d9/d33/d19/lc2 0 2024-09-13T02:52:53.490 INFO:tasks.workunit.client.0.smithi098.stdout:1/513: fsync d9/d33/d19/d35/d68/d4d/db5/db8/fbe 0 2024-09-13T02:52:53.491 INFO:tasks.workunit.client.0.smithi098.stdout:1/514: stat d9/d33/d19/d35/l9e 0 2024-09-13T02:52:53.493 INFO:tasks.workunit.client.1.smithi142.stdout:0/909: creat d10/d6c/d88/f131 x:0 0 0 2024-09-13T02:52:53.494 INFO:tasks.workunit.client.0.smithi098.stdout:4/342: truncate d6/d10/d21/f25 1551519 0 2024-09-13T02:52:53.501 INFO:tasks.workunit.client.1.smithi142.stdout:5/919: mknod d8/d47/d65/da0/dd1/d61/dcb/c12d 0 2024-09-13T02:52:53.502 INFO:tasks.workunit.client.0.smithi098.stdout:9/467: creat d2/d6/d36/d8d/d39/d43/d90/da2/fa6 x:0 0 0 2024-09-13T02:52:53.504 INFO:tasks.workunit.client.1.smithi142.stdout:2/783: mkdir d1/de/da6/dbb/dc2/dfa 0 2024-09-13T02:52:53.504 INFO:tasks.workunit.client.1.smithi142.stdout:2/784: stat d1/de/d31/d6c/d6d/d47/f68 0 2024-09-13T02:52:53.507 INFO:tasks.workunit.client.0.smithi098.stdout:2/373: creat d1/d1f/d35/f74 x:0 0 0 2024-09-13T02:52:53.511 INFO:tasks.workunit.client.1.smithi142.stdout:9/944: write dd/d17/d4f/f7a [3424713,22892] 0 2024-09-13T02:52:53.516 INFO:tasks.workunit.client.0.smithi098.stdout:5/388: getdents d0/d15/d69 0 2024-09-13T02:52:53.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/389: dwrite d0/d15/f3c [0,4194304] 0 2024-09-13T02:52:53.525 INFO:tasks.workunit.client.0.smithi098.stdout:8/402: link d2/dd/d11/f18 d2/d28/f80 0 2024-09-13T02:52:53.527 INFO:tasks.workunit.client.1.smithi142.stdout:0/910: unlink fd 0 2024-09-13T02:52:53.528 INFO:tasks.workunit.client.0.smithi098.stdout:1/515: creat d9/d33/d87/fc3 x:0 0 0 2024-09-13T02:52:53.529 INFO:tasks.workunit.client.1.smithi142.stdout:9/945: dwrite f5 [4194304,4194304] 0 2024-09-13T02:52:53.531 INFO:tasks.workunit.client.0.smithi098.stdout:9/468: dread d2/d6/f42 [0,4194304] 0 2024-09-13T02:52:53.531 INFO:tasks.workunit.client.0.smithi098.stdout:4/343: creat d6/d22/d3d/d41/d58/f78 x:0 0 0 2024-09-13T02:52:53.533 INFO:tasks.workunit.client.1.smithi142.stdout:0/911: chown d10/d6c/d88/d21/d51/d35/d9b/da5/d126/c12e 14 1 2024-09-13T02:52:53.534 INFO:tasks.workunit.client.1.smithi142.stdout:1/898: dwrite d12/d13/d20/d66/d7d/df5/d26/d4f/fb1 [0,4194304] 0 2024-09-13T02:52:53.536 INFO:tasks.workunit.client.1.smithi142.stdout:7/949: rename d10/d13/d1d/d2b/d56/d5f/d73 to d10/d13/d1d/d2b/d40/d133 0 2024-09-13T02:52:53.537 INFO:tasks.workunit.client.1.smithi142.stdout:5/920: write d8/dc3/d3f/ddd/ff8 [526275,53551] 0 2024-09-13T02:52:53.537 INFO:tasks.workunit.client.1.smithi142.stdout:2/785: read d1/fc [3004954,102005] 0 2024-09-13T02:52:53.541 INFO:tasks.workunit.client.0.smithi098.stdout:2/374: creat d1/d1f/d35/d63/d72/f75 x:0 0 0 2024-09-13T02:52:53.543 INFO:tasks.workunit.client.0.smithi098.stdout:2/375: write d1/f48 [102034,90500] 0 2024-09-13T02:52:53.544 INFO:tasks.workunit.client.1.smithi142.stdout:4/859: creat d0/dc8/f116 x:0 0 0 2024-09-13T02:52:53.547 INFO:tasks.workunit.client.1.smithi142.stdout:9/946: creat dd/d17/d68/d13c/f154 x:0 0 0 2024-09-13T02:52:53.548 INFO:tasks.workunit.client.1.smithi142.stdout:9/947: stat dd/d17/d68/d13c 0 2024-09-13T02:52:53.548 INFO:tasks.workunit.client.0.smithi098.stdout:9/469: mkdir d2/d6/d36/da7 0 2024-09-13T02:52:53.549 INFO:tasks.workunit.client.1.smithi142.stdout:3/849: link d12/ldb d12/d16/d25/d2e/d38/d5a/l10b 0 2024-09-13T02:52:53.549 INFO:tasks.workunit.client.0.smithi098.stdout:9/470: chown d2/d6/d36/d8d/f1f 1389405 1 2024-09-13T02:52:53.549 INFO:tasks.workunit.client.1.smithi142.stdout:3/850: readlink d12/d16/d25/l67 0 2024-09-13T02:52:53.550 INFO:tasks.workunit.client.0.smithi098.stdout:9/471: read - d2/d6/f8b zero size 2024-09-13T02:52:53.550 INFO:tasks.workunit.client.0.smithi098.stdout:4/344: unlink d6/d22/c2e 0 2024-09-13T02:52:53.552 INFO:tasks.workunit.client.1.smithi142.stdout:1/899: dread d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/dc0/dc3/f5d [0,4194304] 0 2024-09-13T02:52:53.553 INFO:tasks.workunit.client.1.smithi142.stdout:1/900: chown d12/d13/d20/d66/d55/f107 1 1 2024-09-13T02:52:53.554 INFO:tasks.workunit.client.1.smithi142.stdout:5/921: truncate d8/d47/d65/da0/dd1/d45/d81/d8c/fe3 1143366 0 2024-09-13T02:52:53.556 INFO:tasks.workunit.client.0.smithi098.stdout:2/376: mknod d1/d1f/d39/c76 0 2024-09-13T02:52:53.558 INFO:tasks.workunit.client.0.smithi098.stdout:1/516: rename f4 to d9/d33/d19/d35/d68/d60/d61/db1/fc4 0 2024-09-13T02:52:53.559 INFO:tasks.workunit.client.0.smithi098.stdout:9/472: rmdir d2/d6 39 2024-09-13T02:52:53.561 INFO:tasks.workunit.client.1.smithi142.stdout:9/948: readlink dd/d87/d8e/da3/lf3 0 2024-09-13T02:52:53.566 INFO:tasks.workunit.client.0.smithi098.stdout:8/403: rmdir d2/d2f/d78/d46/d6d 0 2024-09-13T02:52:53.566 INFO:tasks.workunit.client.0.smithi098.stdout:4/345: dwrite d6/d3e/f59 [4194304,4194304] 0 2024-09-13T02:52:53.567 INFO:tasks.workunit.client.0.smithi098.stdout:1/517: dread d9/d33/d19/d35/d68/d2f/f3e [0,4194304] 0 2024-09-13T02:52:53.571 INFO:tasks.workunit.client.0.smithi098.stdout:2/377: mknod d1/d1a/d4f/c77 0 2024-09-13T02:52:53.572 INFO:tasks.workunit.client.1.smithi142.stdout:6/938: getdents d1/dd/d53/d78/d8f 0 2024-09-13T02:52:53.575 INFO:tasks.workunit.client.0.smithi098.stdout:3/444: link d7/d9/d15/l1a d7/d9/d25/d64/l88 0 2024-09-13T02:52:53.576 INFO:tasks.workunit.client.1.smithi142.stdout:2/786: write d1/de/d31/d6c/d6d/f52 [62910,48099] 0 2024-09-13T02:52:53.576 INFO:tasks.workunit.client.1.smithi142.stdout:4/860: symlink d0/d2b/d2d/d65/df5/l117 0 2024-09-13T02:52:53.577 INFO:tasks.workunit.client.0.smithi098.stdout:5/390: truncate d0/ff 6253068 0 2024-09-13T02:52:53.578 INFO:tasks.workunit.client.1.smithi142.stdout:0/912: link d10/d6c/lfa d10/d6c/d88/d21/d51/d35/d9b/da5/ddf/l132 0 2024-09-13T02:52:53.581 INFO:tasks.workunit.client.1.smithi142.stdout:9/949: creat dd/d87/d8e/da3/f155 x:0 0 0 2024-09-13T02:52:53.582 INFO:tasks.workunit.client.0.smithi098.stdout:8/404: symlink d2/d2f/d78/d46/d47/d6e/l81 0 2024-09-13T02:52:53.582 INFO:tasks.workunit.client.0.smithi098.stdout:8/405: write d2/dd/d11/d44/f72 [934560,82698] 0 2024-09-13T02:52:53.583 INFO:tasks.workunit.client.1.smithi142.stdout:3/851: write d12/d16/d3c/d7d/d91/fac [1646654,11252] 0 2024-09-13T02:52:53.583 INFO:tasks.workunit.client.0.smithi098.stdout:2/378: creat d1/d1f/d35/d63/d72/f78 x:0 0 0 2024-09-13T02:52:53.584 INFO:tasks.workunit.client.1.smithi142.stdout:7/950: link d10/d13/d1d/d2b/d55/d32/d8c/c117 d10/d13/d1d/d25/d5c/da3/da8/c134 0 2024-09-13T02:52:53.584 INFO:tasks.workunit.client.0.smithi098.stdout:9/473: fdatasync d2/d6/d2b/d4d/d4f/d6c/fa5 0 2024-09-13T02:52:53.585 INFO:tasks.workunit.client.1.smithi142.stdout:1/901: getdents d12/d13/d20/d100 0 2024-09-13T02:52:53.585 INFO:tasks.workunit.client.1.smithi142.stdout:0/913: dwrite d10/d6c/d88/d21/d51/d79/de6/f125 [0,4194304] 0 2024-09-13T02:52:53.586 INFO:tasks.workunit.client.0.smithi098.stdout:3/445: mknod d7/d9/d4c/c89 0 2024-09-13T02:52:53.587 INFO:tasks.workunit.client.1.smithi142.stdout:0/914: readlink d10/d6c/d88/d21/d51/d35/d9b/lf8 0 2024-09-13T02:52:53.588 INFO:tasks.workunit.client.1.smithi142.stdout:1/902: read d12/d13/d45/f7c [1655098,83657] 0 2024-09-13T02:52:53.589 INFO:tasks.workunit.client.1.smithi142.stdout:6/939: unlink d1/d7/d19/d30/lfe 0 2024-09-13T02:52:53.590 INFO:tasks.workunit.client.1.smithi142.stdout:8/789: sync 2024-09-13T02:52:53.590 INFO:tasks.workunit.client.0.smithi098.stdout:5/391: mkdir d0/d38/d3f/d81/d4d/d82 0 2024-09-13T02:52:53.591 INFO:tasks.workunit.client.1.smithi142.stdout:6/940: write d1/d7/d5f/d60/d76/f112 [1798231,67240] 0 2024-09-13T02:52:53.593 INFO:tasks.workunit.client.1.smithi142.stdout:5/922: creat d8/d47/d65/da0/dd1/d45/d81/d82/d12b/dcd/f12e x:0 0 0 2024-09-13T02:52:53.595 INFO:tasks.workunit.client.0.smithi098.stdout:1/518: unlink d9/d33/f7a 0 2024-09-13T02:52:53.601 INFO:tasks.workunit.client.1.smithi142.stdout:4/861: truncate d0/d2b/dd8/fd9 639068 0 2024-09-13T02:52:53.602 INFO:tasks.workunit.client.1.smithi142.stdout:4/862: read - d0/df/d57/dbf/f10c zero size 2024-09-13T02:52:53.603 INFO:tasks.workunit.client.1.smithi142.stdout:4/863: truncate d0/d2b/d2d/d31/d32/f115 131705 0 2024-09-13T02:52:53.603 INFO:tasks.workunit.client.0.smithi098.stdout:9/474: creat d2/d6/fa8 x:0 0 0 2024-09-13T02:52:53.609 INFO:tasks.workunit.client.0.smithi098.stdout:1/519: chown d9/d33/d19/d35/d68/d4d/dbc 1 1 2024-09-13T02:52:53.610 INFO:tasks.workunit.client.0.smithi098.stdout:2/379: symlink d1/d1f/l79 0 2024-09-13T02:52:53.612 INFO:tasks.workunit.client.1.smithi142.stdout:0/915: creat d10/d6c/d88/d1a/d1e/f133 x:0 0 0 2024-09-13T02:52:53.615 INFO:tasks.workunit.client.1.smithi142.stdout:2/787: write d1/de/da6/dbb/d92/fbf [4811738,119397] 0 2024-09-13T02:52:53.618 INFO:tasks.workunit.client.1.smithi142.stdout:8/790: creat d0/d6/dc/d45/d35/d61/d77/fff x:0 0 0 2024-09-13T02:52:53.620 INFO:tasks.workunit.client.0.smithi098.stdout:3/446: creat d7/d9/d25/d3a/d52/f8a x:0 0 0 2024-09-13T02:52:53.621 INFO:tasks.workunit.client.1.smithi142.stdout:6/941: truncate d1/dd/d53/d78/f80 3121937 0 2024-09-13T02:52:53.622 INFO:tasks.workunit.client.1.smithi142.stdout:6/942: chown d1/d7/d19/l5a 744 1 2024-09-13T02:52:53.624 INFO:tasks.workunit.client.1.smithi142.stdout:2/788: dread d1/de/f22 [0,4194304] 0 2024-09-13T02:52:53.626 INFO:tasks.workunit.client.1.smithi142.stdout:9/950: creat dd/d17/d69/d14a/f156 x:0 0 0 2024-09-13T02:52:53.626 INFO:tasks.workunit.client.0.smithi098.stdout:8/406: link d2/dd/d11/d49/f58 d2/d2f/d78/d46/d47/d6e/d68/f82 0 2024-09-13T02:52:53.626 INFO:tasks.workunit.client.0.smithi098.stdout:8/407: fdatasync d2/f6 0 2024-09-13T02:52:53.628 INFO:tasks.workunit.client.1.smithi142.stdout:4/864: dread d0/d2b/f10d [0,4194304] 0 2024-09-13T02:52:53.628 INFO:tasks.workunit.client.0.smithi098.stdout:9/475: write d2/d6/d36/f5b [664928,118931] 0 2024-09-13T02:52:53.629 INFO:tasks.workunit.client.1.smithi142.stdout:3/852: mknod d12/d16/d25/d2e/d38/c10c 0 2024-09-13T02:52:53.630 INFO:tasks.workunit.client.0.smithi098.stdout:3/447: fdatasync d7/d9/d15/f23 0 2024-09-13T02:52:53.631 INFO:tasks.workunit.client.1.smithi142.stdout:7/951: symlink d10/d13/dc2/l135 0 2024-09-13T02:52:53.633 INFO:tasks.workunit.client.0.smithi098.stdout:5/392: rename d0/d15/d17/d1c/l5e to d0/d38/l83 0 2024-09-13T02:52:53.633 INFO:tasks.workunit.client.0.smithi098.stdout:5/393: chown d0/f4b 504547417 1 2024-09-13T02:52:53.634 INFO:tasks.workunit.client.0.smithi098.stdout:5/394: stat d0/d38/d3f/d1a/f67 0 2024-09-13T02:52:53.635 INFO:tasks.workunit.client.0.smithi098.stdout:5/395: write d0/d38/f58 [4756635,79751] 0 2024-09-13T02:52:53.635 INFO:tasks.workunit.client.0.smithi098.stdout:2/380: creat d1/d1f/d27/d64/f7a x:0 0 0 2024-09-13T02:52:53.637 INFO:tasks.workunit.client.1.smithi142.stdout:7/952: dwrite d10/d13/d1d/d2b/d56/d5f/da2/f109 [0,4194304] 0 2024-09-13T02:52:53.638 INFO:tasks.workunit.client.1.smithi142.stdout:0/916: chown d10/d6c/d88/d21/daf/cfe 1298171 1 2024-09-13T02:52:53.638 INFO:tasks.workunit.client.1.smithi142.stdout:7/953: chown d10/c4d 4 1 2024-09-13T02:52:53.639 INFO:tasks.workunit.client.1.smithi142.stdout:1/903: symlink d12/d13/d20/d66/d7d/df5/d106/l120 0 2024-09-13T02:52:53.647 INFO:tasks.workunit.client.0.smithi098.stdout:5/396: creat d0/d38/d3f/f84 x:0 0 0 2024-09-13T02:52:53.652 INFO:tasks.workunit.client.1.smithi142.stdout:9/951: rename dd/d87/ce5 to dd/d87/d8e/c157 0 2024-09-13T02:52:53.652 INFO:tasks.workunit.client.0.smithi098.stdout:8/408: link d2/d28/c6b d2/dd/d11/d2c/c83 0 2024-09-13T02:52:53.653 INFO:tasks.workunit.client.0.smithi098.stdout:8/409: chown d2/dd/d11/d1d/f3e 36 1 2024-09-13T02:52:53.654 INFO:tasks.workunit.client.1.smithi142.stdout:0/917: read d10/d6c/d88/d1a/d62/ff7 [3692384,83568] 0 2024-09-13T02:52:53.655 INFO:tasks.workunit.client.1.smithi142.stdout:0/918: chown d10/d6c/d88/d21/d51/f92 1482145479 1 2024-09-13T02:52:53.655 INFO:tasks.workunit.client.1.smithi142.stdout:7/954: mkdir d10/d105/d136 0 2024-09-13T02:52:53.656 INFO:tasks.workunit.client.0.smithi098.stdout:5/397: mknod d0/d38/d3f/d1a/c85 0 2024-09-13T02:52:53.657 INFO:tasks.workunit.client.0.smithi098.stdout:5/398: stat d0/d15/d17/l23 0 2024-09-13T02:52:53.657 INFO:tasks.workunit.client.1.smithi142.stdout:1/904: mkdir d12/d13/d121 0 2024-09-13T02:52:53.658 INFO:tasks.workunit.client.0.smithi098.stdout:5/399: truncate d0/d15/d69/f71 101005 0 2024-09-13T02:52:53.658 INFO:tasks.workunit.client.0.smithi098.stdout:8/410: rmdir d2/d2f/d78/d46/d47 39 2024-09-13T02:52:53.661 INFO:tasks.workunit.client.0.smithi098.stdout:3/448: link d7/d9/d25/d64/d6f/c7a d7/d9/d25/d3a/d7c/c8b 0 2024-09-13T02:52:53.666 INFO:tasks.workunit.client.1.smithi142.stdout:5/923: link d8/d47/d65/da0/dd1/d45/f120 d8/dc3/d3f/f12f 0 2024-09-13T02:52:53.667 INFO:tasks.workunit.client.0.smithi098.stdout:3/449: chown d7/d9/l2e 22 1 2024-09-13T02:52:53.669 INFO:tasks.workunit.client.1.smithi142.stdout:2/789: link d1/de/f22 d1/de/d31/d6c/d6d/d47/da8/ffb 0 2024-09-13T02:52:53.670 INFO:tasks.workunit.client.1.smithi142.stdout:4/865: symlink d0/d2b/d2d/da2/l118 0 2024-09-13T02:52:53.672 INFO:tasks.workunit.client.1.smithi142.stdout:9/952: chown dd/d17/d69/cfb 13410 1 2024-09-13T02:52:53.672 INFO:tasks.workunit.client.1.smithi142.stdout:3/853: getdents d12/d16/d25/d2e/d48/d5c/d73/dae 0 2024-09-13T02:52:53.673 INFO:tasks.workunit.client.0.smithi098.stdout:5/400: creat d0/d38/d3f/d1a/f86 x:0 0 0 2024-09-13T02:52:53.674 INFO:tasks.workunit.client.1.smithi142.stdout:8/791: dwrite d0/d80/d8c/dc9/fbf [0,4194304] 0 2024-09-13T02:52:53.674 INFO:tasks.workunit.client.1.smithi142.stdout:0/919: truncate d10/d6c/d88/d1a/fd5 1820695 0 2024-09-13T02:52:53.680 INFO:tasks.workunit.client.0.smithi098.stdout:8/411: write d2/dd/d11/d1d/f45 [114976,122799] 0 2024-09-13T02:52:53.682 INFO:tasks.workunit.client.1.smithi142.stdout:5/924: chown d8/dc3/d3f/l5d 176125385 1 2024-09-13T02:52:53.682 INFO:tasks.workunit.client.1.smithi142.stdout:5/925: write d8/dc3/f41 [4620705,97708] 0 2024-09-13T02:52:53.683 INFO:tasks.workunit.client.1.smithi142.stdout:2/790: symlink d1/de/d31/d6c/d6d/db6/lfc 0 2024-09-13T02:52:53.684 INFO:tasks.workunit.client.0.smithi098.stdout:8/412: mknod d2/d28/d43/c84 0 2024-09-13T02:52:53.685 INFO:tasks.workunit.client.0.smithi098.stdout:3/450: dread d7/d9/fa [0,4194304] 0 2024-09-13T02:52:53.686 INFO:tasks.workunit.client.0.smithi098.stdout:5/401: creat d0/d15/f87 x:0 0 0 2024-09-13T02:52:53.688 INFO:tasks.workunit.client.1.smithi142.stdout:9/953: creat dd/d17/d44/d95/dd1/ddf/f158 x:0 0 0 2024-09-13T02:52:53.689 INFO:tasks.workunit.client.1.smithi142.stdout:8/792: creat d0/d6/dc/d45/d35/f100 x:0 0 0 2024-09-13T02:52:53.689 INFO:tasks.workunit.client.0.smithi098.stdout:5/402: fdatasync d0/d15/f22 0 2024-09-13T02:52:53.694 INFO:tasks.workunit.client.1.smithi142.stdout:0/920: mknod d10/d6c/d88/d1a/d1e/dc6/df3/d110/c134 0 2024-09-13T02:52:53.696 INFO:tasks.workunit.client.0.smithi098.stdout:5/403: dwrite d0/d15/f87 [0,4194304] 0 2024-09-13T02:52:53.697 INFO:tasks.workunit.client.1.smithi142.stdout:6/943: getdents d1/dd/d57/d7b 0 2024-09-13T02:52:53.698 INFO:tasks.workunit.client.0.smithi098.stdout:8/413: write d2/dd/d11/d1d/f24 [3726914,49089] 0 2024-09-13T02:52:53.702 INFO:tasks.workunit.client.1.smithi142.stdout:7/955: truncate d10/d34/d57/d98/ffa 1929026 0 2024-09-13T02:52:53.703 INFO:tasks.workunit.client.0.smithi098.stdout:5/404: mkdir d0/d38/d3f/d81/d4d/d88 0 2024-09-13T02:52:53.703 INFO:tasks.workunit.client.1.smithi142.stdout:5/926: dread - d8/d47/d65/fd6 zero size 2024-09-13T02:52:53.720 INFO:tasks.workunit.client.0.smithi098.stdout:3/451: getdents d7/d9/d15/d2d 0 2024-09-13T02:52:53.721 INFO:tasks.workunit.client.1.smithi142.stdout:2/791: dread d1/de/f9d [4194304,4194304] 0 2024-09-13T02:52:53.721 INFO:tasks.workunit.client.1.smithi142.stdout:2/792: stat d1/d2d/db2 0 2024-09-13T02:52:53.724 INFO:tasks.workunit.client.1.smithi142.stdout:9/954: creat dd/d148/dc9/de9/f159 x:0 0 0 2024-09-13T02:52:53.725 INFO:tasks.workunit.client.1.smithi142.stdout:9/955: write dd/f58 [5237373,112429] 0 2024-09-13T02:52:53.726 INFO:tasks.workunit.client.0.smithi098.stdout:3/452: rename d7/d9/d25/d3a/d5f/f67 to d7/f8c 0 2024-09-13T02:52:53.727 INFO:tasks.workunit.client.1.smithi142.stdout:3/854: write d12/f58 [1643377,52076] 0 2024-09-13T02:52:53.729 INFO:tasks.workunit.client.1.smithi142.stdout:4/866: truncate d0/df/da5/dad/f10e 235932 0 2024-09-13T02:52:53.731 INFO:tasks.workunit.client.1.smithi142.stdout:0/921: symlink d10/d6c/d88/d1a/d1e/dc6/df3/l135 0 2024-09-13T02:52:53.732 INFO:tasks.workunit.client.1.smithi142.stdout:0/922: chown d10/d6c/l98 974069153 1 2024-09-13T02:52:53.733 INFO:tasks.workunit.client.0.smithi098.stdout:5/405: truncate d0/d15/d17/d1c/d3d/f47 3876578 0 2024-09-13T02:52:53.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:53 smithi098 ceph-mon[27886]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:53.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:53 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:53.734 INFO:tasks.workunit.client.1.smithi142.stdout:5/927: dread d8/dc3/f3d [0,4194304] 0 2024-09-13T02:52:53.739 INFO:tasks.workunit.client.0.smithi098.stdout:8/414: dread d2/dd/d4d/f67 [0,4194304] 0 2024-09-13T02:52:53.739 INFO:tasks.workunit.client.1.smithi142.stdout:2/793: rename d1/de/da6/dbb/fed to d1/d42/ffd 0 2024-09-13T02:52:53.743 INFO:tasks.workunit.client.0.smithi098.stdout:5/406: write d0/d38/d3f/f9 [1615228,113828] 0 2024-09-13T02:52:53.744 INFO:tasks.workunit.client.0.smithi098.stdout:5/407: dread - d0/d38/d3f/f84 zero size 2024-09-13T02:52:53.744 INFO:tasks.workunit.client.1.smithi142.stdout:2/794: dwrite d1/d29/d72/fca [0,4194304] 0 2024-09-13T02:52:53.745 INFO:tasks.workunit.client.0.smithi098.stdout:5/408: chown d0/cb 31870589 1 2024-09-13T02:52:53.746 INFO:tasks.workunit.client.1.smithi142.stdout:9/956: creat dd/d17/d5f/f15a x:0 0 0 2024-09-13T02:52:53.746 INFO:tasks.workunit.client.0.smithi098.stdout:8/415: write d2/f23 [3604504,37411] 0 2024-09-13T02:52:53.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:53 smithi142 ceph-mon[33443]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:53.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:53 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:53.751 INFO:tasks.workunit.client.1.smithi142.stdout:3/855: mknod d12/d16/d25/d2e/d48/d5c/d8c/daf/c10d 0 2024-09-13T02:52:53.753 INFO:tasks.workunit.client.1.smithi142.stdout:4/867: rmdir d0/df/da5 39 2024-09-13T02:52:53.753 INFO:tasks.workunit.client.0.smithi098.stdout:8/416: creat d2/dd/d11/d49/f85 x:0 0 0 2024-09-13T02:52:53.754 INFO:tasks.workunit.client.0.smithi098.stdout:5/409: symlink d0/d15/d17/l89 0 2024-09-13T02:52:53.754 INFO:tasks.workunit.client.0.smithi098.stdout:5/410: readlink d0/l46 0 2024-09-13T02:52:53.755 INFO:tasks.workunit.client.1.smithi142.stdout:0/923: mknod d10/d6c/d88/d45/ded/c136 0 2024-09-13T02:52:53.756 INFO:tasks.workunit.client.1.smithi142.stdout:1/905: mknod d12/d13/d20/c122 0 2024-09-13T02:52:53.757 INFO:tasks.workunit.client.1.smithi142.stdout:6/944: mkdir d1/dd/d53/d78/d8f/da8/de6/d12c/d13e 0 2024-09-13T02:52:53.757 INFO:tasks.workunit.client.1.smithi142.stdout:1/906: write d12/d13/d20/d66/d7d/df5/f9e [4923504,97075] 0 2024-09-13T02:52:53.758 INFO:tasks.workunit.client.1.smithi142.stdout:6/945: dread - d1/dd/d53/d78/d104/dad/f115 zero size 2024-09-13T02:52:53.759 INFO:tasks.workunit.client.1.smithi142.stdout:5/928: creat d8/d47/d65/da0/dd1/d61/dcb/f130 x:0 0 0 2024-09-13T02:52:53.761 INFO:tasks.workunit.client.0.smithi098.stdout:5/411: read d0/d15/f22 [1803767,113768] 0 2024-09-13T02:52:53.764 INFO:tasks.workunit.client.1.smithi142.stdout:2/795: rmdir d1 39 2024-09-13T02:52:53.766 INFO:tasks.workunit.client.1.smithi142.stdout:8/793: link d0/d6/dc/d40/d41/f4e d0/d75/f101 0 2024-09-13T02:52:53.767 INFO:tasks.workunit.client.1.smithi142.stdout:3/856: creat d12/d16/d25/d2e/d48/d5c/d66/de4/f10e x:0 0 0 2024-09-13T02:52:53.770 INFO:tasks.workunit.client.1.smithi142.stdout:0/924: unlink d10/d6c/d88/d36/c44 0 2024-09-13T02:52:53.774 INFO:tasks.workunit.client.0.smithi098.stdout:5/412: getdents d0/d15/d50 0 2024-09-13T02:52:53.774 INFO:tasks.workunit.client.0.smithi098.stdout:8/417: truncate d2/f1b 3542559 0 2024-09-13T02:52:53.775 INFO:tasks.workunit.client.0.smithi098.stdout:8/418: chown d2/l6c 1417 1 2024-09-13T02:52:53.775 INFO:tasks.workunit.client.1.smithi142.stdout:1/907: rmdir d12/d13/d20/d66/d7d 39 2024-09-13T02:52:53.776 INFO:tasks.workunit.client.0.smithi098.stdout:8/419: write d2/d2f/d78/f50 [618197,26505] 0 2024-09-13T02:52:53.777 INFO:tasks.workunit.client.0.smithi098.stdout:8/420: chown d2/dd/d4d/l69 4219288 1 2024-09-13T02:52:53.778 INFO:tasks.workunit.client.1.smithi142.stdout:9/957: dread dd/f4c [0,4194304] 0 2024-09-13T02:52:53.779 INFO:tasks.workunit.client.1.smithi142.stdout:5/929: write d8/d47/d65/da0/dd1/f5c [2369103,16667] 0 2024-09-13T02:52:53.780 INFO:tasks.workunit.client.1.smithi142.stdout:9/958: fsync dd/d17/d69/d14a/f156 0 2024-09-13T02:52:53.782 INFO:tasks.workunit.client.1.smithi142.stdout:8/794: chown d0/d6/d23 289000230 1 2024-09-13T02:52:53.785 INFO:tasks.workunit.client.1.smithi142.stdout:3/857: mkdir d12/d16/d3c/d79/d9e/d10f 0 2024-09-13T02:52:53.787 INFO:tasks.workunit.client.1.smithi142.stdout:4/868: mknod d0/d7e/ddd/c119 0 2024-09-13T02:52:53.788 INFO:tasks.workunit.client.0.smithi098.stdout:5/413: write d0/ff [52211,113216] 0 2024-09-13T02:52:53.789 INFO:tasks.workunit.client.1.smithi142.stdout:0/925: fsync d10/d6c/d88/d21/f91 0 2024-09-13T02:52:53.791 INFO:tasks.workunit.client.1.smithi142.stdout:0/926: truncate d10/d6c/d88/d1a/d1e/f104 973624 0 2024-09-13T02:52:53.791 INFO:tasks.workunit.client.0.smithi098.stdout:8/421: write d2/dd/d11/f18 [1186943,29573] 0 2024-09-13T02:52:53.792 INFO:tasks.workunit.client.1.smithi142.stdout:7/956: getdents d10/d13/d1d/d2b/dae 0 2024-09-13T02:52:53.797 INFO:tasks.workunit.client.0.smithi098.stdout:5/414: symlink d0/d7c/l8a 0 2024-09-13T02:52:53.797 INFO:tasks.workunit.client.1.smithi142.stdout:0/927: dwrite d10/d6c/d88/d45/f56 [0,4194304] 0 2024-09-13T02:52:53.798 INFO:tasks.workunit.client.0.smithi098.stdout:8/422: mkdir d2/d2f/d78/d46/d74/d86 0 2024-09-13T02:52:53.799 INFO:tasks.workunit.client.1.smithi142.stdout:5/930: mknod d8/dc3/d64/d68/db5/c131 0 2024-09-13T02:52:53.799 INFO:tasks.workunit.client.0.smithi098.stdout:8/423: write d2/f7d [861617,31882] 0 2024-09-13T02:52:53.800 INFO:tasks.workunit.client.1.smithi142.stdout:2/796: creat d1/de/d1f/d9c/ffe x:0 0 0 2024-09-13T02:52:53.800 INFO:tasks.workunit.client.1.smithi142.stdout:7/957: dwrite d10/d13/d1d/d44/f112 [0,4194304] 0 2024-09-13T02:52:53.800 INFO:tasks.workunit.client.0.smithi098.stdout:5/415: rmdir d0/d57 39 2024-09-13T02:52:53.801 INFO:tasks.workunit.client.0.smithi098.stdout:8/424: read d2/dd/d4d/f67 [1118221,109042] 0 2024-09-13T02:52:53.805 INFO:tasks.workunit.client.1.smithi142.stdout:8/795: rmdir d0 39 2024-09-13T02:52:53.810 INFO:tasks.workunit.client.1.smithi142.stdout:3/858: creat d12/d16/d3c/d79/d9e/f110 x:0 0 0 2024-09-13T02:52:53.810 INFO:tasks.workunit.client.1.smithi142.stdout:0/928: dwrite d10/d23/f25 [0,4194304] 0 2024-09-13T02:52:53.812 INFO:tasks.workunit.client.1.smithi142.stdout:3/859: write d12/d16/d3c/f62 [3121730,10568] 0 2024-09-13T02:52:53.813 INFO:tasks.workunit.client.0.smithi098.stdout:5/416: mknod d0/d15/d17/c8b 0 2024-09-13T02:52:53.817 INFO:tasks.workunit.client.1.smithi142.stdout:1/908: mknod d12/d13/d45/c123 0 2024-09-13T02:52:53.818 INFO:tasks.workunit.client.0.smithi098.stdout:5/417: chown d0/d15/d17/d1c/d3d/f47 1 1 2024-09-13T02:52:53.818 INFO:tasks.workunit.client.1.smithi142.stdout:1/909: write d12/d13/d20/d66/ff0 [1016403,106852] 0 2024-09-13T02:52:53.819 INFO:tasks.workunit.client.1.smithi142.stdout:6/946: link d1/d7/d19/d30/c75 d1/dd/d53/d78/d104/dad/dd2/c13f 0 2024-09-13T02:52:53.822 INFO:tasks.workunit.client.1.smithi142.stdout:6/947: truncate d1/d7/f122 780093 0 2024-09-13T02:52:53.822 INFO:tasks.workunit.client.1.smithi142.stdout:9/959: mknod dd/d17/d69/d84/c15b 0 2024-09-13T02:52:53.822 INFO:tasks.workunit.client.1.smithi142.stdout:6/948: dread - d1/d4a/f12e zero size 2024-09-13T02:52:53.827 INFO:tasks.workunit.client.0.smithi098.stdout:5/418: link d0/d15/f22 d0/d15/d50/f8c 0 2024-09-13T02:52:53.828 INFO:tasks.workunit.client.0.smithi098.stdout:5/419: write d0/d15/d69/f71 [19761,26921] 0 2024-09-13T02:52:53.832 INFO:tasks.workunit.client.1.smithi142.stdout:3/860: fsync d12/d16/d25/d2e/d48/d5c/f3f 0 2024-09-13T02:52:53.832 INFO:tasks.workunit.client.1.smithi142.stdout:0/929: dread d10/d6c/d88/fb9 [0,4194304] 0 2024-09-13T02:52:53.834 INFO:tasks.workunit.client.1.smithi142.stdout:3/861: fsync d12/d16/d25/d2e/d38/d4d/d53/d78/fe2 0 2024-09-13T02:52:53.834 INFO:tasks.workunit.client.1.smithi142.stdout:1/910: write d12/d13/d20/d66/d7d/df5/f90 [2830466,122552] 0 2024-09-13T02:52:53.836 INFO:tasks.workunit.client.1.smithi142.stdout:6/949: symlink d1/d7/d5f/d60/l140 0 2024-09-13T02:52:53.837 INFO:tasks.workunit.client.0.smithi098.stdout:5/420: creat d0/d15/f8d x:0 0 0 2024-09-13T02:52:53.838 INFO:tasks.workunit.client.0.smithi098.stdout:8/425: dread d2/d2f/d78/f4f [0,4194304] 0 2024-09-13T02:52:53.840 INFO:tasks.workunit.client.0.smithi098.stdout:8/426: write d2/dd/d11/d49/f85 [27902,119871] 0 2024-09-13T02:52:53.844 INFO:tasks.workunit.client.0.smithi098.stdout:5/421: link d0/d15/f3a d0/d15/d69/f8e 0 2024-09-13T02:52:53.846 INFO:tasks.workunit.client.1.smithi142.stdout:2/797: dwrite d1/de/d1f/d13/fc4 [0,4194304] 0 2024-09-13T02:52:53.847 INFO:tasks.workunit.client.1.smithi142.stdout:0/930: mkdir d10/d6c/d88/d21/d51/d79/d137 0 2024-09-13T02:52:53.847 INFO:tasks.workunit.client.1.smithi142.stdout:7/958: dwrite d10/d13/d1d/d2b/d56/f6a [0,4194304] 0 2024-09-13T02:52:53.849 INFO:tasks.workunit.client.1.smithi142.stdout:1/911: mkdir d12/d13/d20/d66/d7d/df5/d26/d4f/d124 0 2024-09-13T02:52:53.850 INFO:tasks.workunit.client.0.smithi098.stdout:5/422: rename d0/d29/f56 to d0/d38/d3f/d81/f8f 0 2024-09-13T02:52:53.853 INFO:tasks.workunit.client.1.smithi142.stdout:4/869: dwrite d0/df/f29 [0,4194304] 0 2024-09-13T02:52:53.856 INFO:tasks.workunit.client.1.smithi142.stdout:6/950: rename d1/d7/d19/d48/d90/lb2 to d1/d7/d19/d48/d90/d11e/l141 0 2024-09-13T02:52:53.856 INFO:tasks.workunit.client.1.smithi142.stdout:7/959: stat d10/d13/d1d/le6 0 2024-09-13T02:52:53.857 INFO:tasks.workunit.client.1.smithi142.stdout:9/960: dread dd/d17/d69/ffd [0,4194304] 0 2024-09-13T02:52:53.857 INFO:tasks.workunit.client.0.smithi098.stdout:5/423: unlink d0/d15/f22 0 2024-09-13T02:52:53.859 INFO:tasks.workunit.client.0.smithi098.stdout:5/424: write d0/d15/d17/d1c/f6c [1897492,23980] 0 2024-09-13T02:52:53.861 INFO:tasks.workunit.client.1.smithi142.stdout:9/961: stat dd/d17/d44/d82/d99/da8/le6 0 2024-09-13T02:52:53.862 INFO:tasks.workunit.client.1.smithi142.stdout:8/796: dwrite d0/d80/d8c/dc9/fc5 [0,4194304] 0 2024-09-13T02:52:53.862 INFO:tasks.workunit.client.1.smithi142.stdout:0/931: symlink d10/d6c/d88/d21/l138 0 2024-09-13T02:52:53.863 INFO:tasks.workunit.client.1.smithi142.stdout:1/912: readlink d12/d13/d20/d27/l36 0 2024-09-13T02:52:53.864 INFO:tasks.workunit.client.0.smithi098.stdout:5/425: rename d0/d38/f58 to d0/d15/d17/d1c/d3d/f90 0 2024-09-13T02:52:53.865 INFO:tasks.workunit.client.0.smithi098.stdout:5/426: chown d0/d15/f87 14809 1 2024-09-13T02:52:53.865 INFO:tasks.workunit.client.1.smithi142.stdout:2/798: creat d1/de/d1f/d13/d60/da9/fff x:0 0 0 2024-09-13T02:52:53.866 INFO:tasks.workunit.client.1.smithi142.stdout:4/870: creat d0/df/d57/dbf/f11a x:0 0 0 2024-09-13T02:52:53.868 INFO:tasks.workunit.client.1.smithi142.stdout:0/932: dread d10/d6c/d88/d21/d8f/f10b [0,4194304] 0 2024-09-13T02:52:53.869 INFO:tasks.workunit.client.1.smithi142.stdout:0/933: readlink d10/d6c/d88/d21/d51/d35/d9b/lf8 0 2024-09-13T02:52:53.870 INFO:tasks.workunit.client.1.smithi142.stdout:4/871: truncate d0/d2b/d2d/d31/d32/f115 1053427 0 2024-09-13T02:52:53.870 INFO:tasks.workunit.client.1.smithi142.stdout:4/872: stat d0/d2b/d2d/d31/d32/l97 0 2024-09-13T02:52:53.870 INFO:tasks.workunit.client.1.smithi142.stdout:6/951: creat d1/dd/d16/d4e/d32/d126/f142 x:0 0 0 2024-09-13T02:52:53.874 INFO:tasks.workunit.client.1.smithi142.stdout:9/962: rmdir dd/d17/d69/d84/d41 39 2024-09-13T02:52:53.875 INFO:tasks.workunit.client.0.smithi098.stdout:5/427: rmdir d0/d57 39 2024-09-13T02:52:53.875 INFO:tasks.workunit.client.1.smithi142.stdout:3/862: truncate d12/d16/d25/d2e/d48/d5c/d8c/daf/fbe 805464 0 2024-09-13T02:52:53.879 INFO:tasks.workunit.client.1.smithi142.stdout:6/952: dwrite d1/d7/d19/f93 [0,4194304] 0 2024-09-13T02:52:53.880 INFO:tasks.workunit.client.1.smithi142.stdout:2/799: creat d1/de/d1f/d13/d59/de6/f100 x:0 0 0 2024-09-13T02:52:53.881 INFO:tasks.workunit.client.0.smithi098.stdout:5/428: creat d0/d57/f91 x:0 0 0 2024-09-13T02:52:53.882 INFO:tasks.workunit.client.1.smithi142.stdout:1/913: truncate d12/d13/d20/d66/d7d/f98 481949 0 2024-09-13T02:52:53.883 INFO:tasks.workunit.client.1.smithi142.stdout:1/914: readlink d12/d13/d20/d66/d55/db4/l111 0 2024-09-13T02:52:53.889 INFO:tasks.workunit.client.1.smithi142.stdout:1/915: dwrite d12/d13/d20/f5c [0,4194304] 0 2024-09-13T02:52:53.890 INFO:tasks.workunit.client.1.smithi142.stdout:1/916: readlink d12/d13/d20/d66/la6 0 2024-09-13T02:52:53.891 INFO:tasks.workunit.client.0.smithi098.stdout:5/429: rmdir d0/d38/d3f/d81/d4d/d88 0 2024-09-13T02:52:53.897 INFO:tasks.workunit.client.1.smithi142.stdout:8/797: dwrite d0/d6/dc/d45/d35/f81 [0,4194304] 0 2024-09-13T02:52:53.899 INFO:tasks.workunit.client.1.smithi142.stdout:4/873: write d0/d2b/d2d/d31/f60 [781351,118269] 0 2024-09-13T02:52:53.903 INFO:tasks.workunit.client.1.smithi142.stdout:7/960: creat d10/d13/d1d/d2b/d40/f137 x:0 0 0 2024-09-13T02:52:53.906 INFO:tasks.workunit.client.1.smithi142.stdout:5/931: sync 2024-09-13T02:52:53.908 INFO:tasks.workunit.client.1.smithi142.stdout:3/863: mknod d12/d16/d3c/d79/d9e/d10f/c111 0 2024-09-13T02:52:53.911 INFO:tasks.workunit.client.1.smithi142.stdout:6/953: dread d1/d7/fa7 [0,4194304] 0 2024-09-13T02:52:53.911 INFO:tasks.workunit.client.1.smithi142.stdout:4/874: creat d0/d2b/d2d/d31/f11b x:0 0 0 2024-09-13T02:52:53.912 INFO:tasks.workunit.client.1.smithi142.stdout:9/963: link dd/d17/d69/d84/df8/c144 dd/d17/d44/d95/c15c 0 2024-09-13T02:52:53.912 INFO:tasks.workunit.client.1.smithi142.stdout:5/932: symlink d8/dc3/d64/d68/db5/l132 0 2024-09-13T02:52:53.913 INFO:tasks.workunit.client.1.smithi142.stdout:4/875: readlink d0/d2b/d2d/da2/l118 0 2024-09-13T02:52:53.916 INFO:tasks.workunit.client.0.smithi098.stdout:5/430: dread d0/d15/d17/f2e [0,4194304] 0 2024-09-13T02:52:53.959 INFO:tasks.workunit.client.1.smithi142.stdout:2/800: creat d1/de/d1f/f101 x:0 0 0 2024-09-13T02:52:53.959 INFO:tasks.workunit.client.0.smithi098.stdout:5/431: symlink d0/d15/d17/d1c/d3d/l92 0 2024-09-13T02:52:53.961 INFO:tasks.workunit.client.1.smithi142.stdout:0/934: rename d10/d6c/d88/d36/l9a to d10/d6c/d88/l139 0 2024-09-13T02:52:53.961 INFO:tasks.workunit.client.0.smithi098.stdout:5/432: fsync d0/d15/f80 0 2024-09-13T02:52:53.963 INFO:tasks.workunit.client.1.smithi142.stdout:2/801: dread d1/d42/f55 [0,4194304] 0 2024-09-13T02:52:53.964 INFO:tasks.workunit.client.1.smithi142.stdout:1/917: write d12/fa1 [1861041,18161] 0 2024-09-13T02:52:53.965 INFO:tasks.workunit.client.1.smithi142.stdout:9/964: mkdir dd/d17/d44/dfa/d15d 0 2024-09-13T02:52:53.966 INFO:tasks.workunit.client.1.smithi142.stdout:8/798: write d0/d6/dc/d45/d35/f56 [414868,47883] 0 2024-09-13T02:52:53.968 INFO:tasks.workunit.client.1.smithi142.stdout:1/918: truncate d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/f10f 61728 0 2024-09-13T02:52:53.969 INFO:tasks.workunit.client.1.smithi142.stdout:4/876: unlink d0/d2b/c5c 0 2024-09-13T02:52:53.970 INFO:tasks.workunit.client.1.smithi142.stdout:4/877: chown d0/d2b/d2d/d31/d43/d48/f78 48031 1 2024-09-13T02:52:53.971 INFO:tasks.workunit.client.0.smithi098.stdout:5/433: creat d0/d38/d3f/d81/d4d/d82/f93 x:0 0 0 2024-09-13T02:52:53.971 INFO:tasks.workunit.client.1.smithi142.stdout:4/878: read d0/f8e [3738265,120788] 0 2024-09-13T02:52:53.974 INFO:tasks.workunit.client.1.smithi142.stdout:7/961: rename d10/d13/f1c to d10/d13/d1d/d25/d5c/f138 0 2024-09-13T02:52:53.976 INFO:tasks.workunit.client.1.smithi142.stdout:2/802: unlink d1/d29/f83 0 2024-09-13T02:52:53.977 INFO:tasks.workunit.client.1.smithi142.stdout:6/954: fsync d1/dd/d16/f3c 0 2024-09-13T02:52:53.977 INFO:tasks.workunit.client.1.smithi142.stdout:3/864: write d12/d16/d25/d2e/d38/d6b/f7f [757279,14310] 0 2024-09-13T02:52:53.978 INFO:tasks.workunit.client.1.smithi142.stdout:6/955: stat d1/d7/d19/d48/f9c 0 2024-09-13T02:52:53.978 INFO:tasks.workunit.client.0.smithi098.stdout:5/434: link d0/f37 d0/d57/f94 0 2024-09-13T02:52:53.979 INFO:tasks.workunit.client.1.smithi142.stdout:6/956: read d1/d7/d42/fa4 [3467367,79032] 0 2024-09-13T02:52:53.980 INFO:tasks.workunit.client.1.smithi142.stdout:6/957: chown d1/dd/d16/d4d/fe9 451 1 2024-09-13T02:52:53.980 INFO:tasks.workunit.client.1.smithi142.stdout:9/965: creat dd/d17/d69/f15e x:0 0 0 2024-09-13T02:52:53.981 INFO:tasks.workunit.client.1.smithi142.stdout:6/958: truncate d1/d7/d5f/d60/d76/f10c 1919260 0 2024-09-13T02:52:53.982 INFO:tasks.workunit.client.1.smithi142.stdout:6/959: write d1/dd/d53/d78/d8f/da8/fb4 [640019,33146] 0 2024-09-13T02:52:53.983 INFO:tasks.workunit.client.0.smithi098.stdout:5/435: rename d0/d15/f5f to d0/d38/d3f/d81/f95 0 2024-09-13T02:52:53.984 INFO:tasks.workunit.client.1.smithi142.stdout:1/919: rmdir d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81 39 2024-09-13T02:52:53.987 INFO:tasks.workunit.client.0.smithi098.stdout:5/436: chown d0/l68 101376 1 2024-09-13T02:52:53.989 INFO:tasks.workunit.client.1.smithi142.stdout:5/933: unlink d8/d47/d65/da0/dd1/d45/d81/d82/d12b/f56 0 2024-09-13T02:52:53.990 INFO:tasks.workunit.client.1.smithi142.stdout:4/879: creat d0/d2b/dd8/f11c x:0 0 0 2024-09-13T02:52:53.990 INFO:tasks.workunit.client.1.smithi142.stdout:4/880: fdatasync d0/dc8/f116 0 2024-09-13T02:52:53.991 INFO:tasks.workunit.client.0.smithi098.stdout:5/437: creat d0/d15/d17/d1c/f96 x:0 0 0 2024-09-13T02:52:53.992 INFO:tasks.workunit.client.1.smithi142.stdout:0/935: truncate d10/f13 4871324 0 2024-09-13T02:52:53.992 INFO:tasks.workunit.client.0.smithi098.stdout:5/438: write d0/d15/d17/f28 [3231812,87286] 0 2024-09-13T02:52:53.993 INFO:tasks.workunit.client.0.smithi098.stdout:5/439: truncate d0/d38/d3f/f84 415442 0 2024-09-13T02:52:53.995 INFO:tasks.workunit.client.0.smithi098.stdout:5/440: dread d0/d38/d3f/d81/d4d/f52 [0,4194304] 0 2024-09-13T02:52:53.999 INFO:tasks.workunit.client.1.smithi142.stdout:9/966: unlink dd/d17/l6c 0 2024-09-13T02:52:54.002 INFO:tasks.workunit.client.1.smithi142.stdout:6/960: unlink d1/d7/d5f/d6a/l135 0 2024-09-13T02:52:54.004 INFO:tasks.workunit.client.0.smithi098.stdout:5/441: creat d0/d38/d3f/d1a/f97 x:0 0 0 2024-09-13T02:52:54.006 INFO:tasks.workunit.client.1.smithi142.stdout:7/962: write d10/d64/fcd [3404350,94672] 0 2024-09-13T02:52:54.011 INFO:tasks.workunit.client.1.smithi142.stdout:6/961: unlink d1/dd/f10d 0 2024-09-13T02:52:54.013 INFO:tasks.workunit.client.0.smithi098.stdout:5/442: dwrite d0/d15/d50/f6d [0,4194304] 0 2024-09-13T02:52:54.019 INFO:tasks.workunit.client.1.smithi142.stdout:8/799: rename d0/d6/dc/d45/l6d to d0/d6/dc/d40/l102 0 2024-09-13T02:52:54.021 INFO:tasks.workunit.client.1.smithi142.stdout:8/800: fsync d0/d6/dc/d45/d35/f56 0 2024-09-13T02:52:54.022 INFO:tasks.workunit.client.1.smithi142.stdout:2/803: write d1/de/d1f/d13/f2a [1348285,24478] 0 2024-09-13T02:52:54.027 INFO:tasks.workunit.client.1.smithi142.stdout:0/936: dwrite d10/d6c/d88/d45/db3/fda [0,4194304] 0 2024-09-13T02:52:54.073 INFO:tasks.workunit.client.1.smithi142.stdout:4/881: sync 2024-09-13T02:52:54.123 INFO:tasks.workunit.client.0.smithi098.stdout:5/443: creat d0/d38/d3f/d1a/f98 x:0 0 0 2024-09-13T02:52:54.127 INFO:tasks.workunit.client.1.smithi142.stdout:1/920: creat d12/d13/d20/d27/f125 x:0 0 0 2024-09-13T02:52:54.129 INFO:tasks.workunit.client.0.smithi098.stdout:5/444: unlink d0/d38/d3f/d1a/d27/c62 0 2024-09-13T02:52:54.134 INFO:tasks.workunit.client.1.smithi142.stdout:7/963: creat d10/d34/d57/d98/dfe/d11f/f139 x:0 0 0 2024-09-13T02:52:54.137 INFO:tasks.workunit.client.1.smithi142.stdout:2/804: creat d1/de/d31/d6c/d6d/db6/f102 x:0 0 0 2024-09-13T02:52:54.139 INFO:tasks.workunit.client.1.smithi142.stdout:4/882: creat d0/df/d57/dbf/f11d x:0 0 0 2024-09-13T02:52:54.144 INFO:tasks.workunit.client.1.smithi142.stdout:2/805: fdatasync d1/de/d31/f3d 0 2024-09-13T02:52:54.145 INFO:tasks.workunit.client.1.smithi142.stdout:4/883: truncate d0/df/f1f 4129153 0 2024-09-13T02:52:54.146 INFO:tasks.workunit.client.1.smithi142.stdout:4/884: write d0/f9b [5070429,27027] 0 2024-09-13T02:52:54.153 INFO:tasks.workunit.client.1.smithi142.stdout:7/964: rmdir d10/d105/d136 0 2024-09-13T02:52:54.155 INFO:tasks.workunit.client.1.smithi142.stdout:4/885: symlink d0/d2b/d2d/d31/d43/d48/dcc/df9/l11e 0 2024-09-13T02:52:54.159 INFO:tasks.workunit.client.1.smithi142.stdout:2/806: creat d1/de/d1f/f103 x:0 0 0 2024-09-13T02:52:54.163 INFO:tasks.workunit.client.1.smithi142.stdout:2/807: creat d1/de/d1f/d13/d59/f104 x:0 0 0 2024-09-13T02:52:54.164 INFO:tasks.workunit.client.1.smithi142.stdout:2/808: stat d1/d2d/fa0 0 2024-09-13T02:52:54.165 INFO:tasks.workunit.client.1.smithi142.stdout:2/809: chown d1/fb5 5683603 1 2024-09-13T02:52:54.166 INFO:tasks.workunit.client.1.smithi142.stdout:7/965: dwrite d10/d13/d1d/d25/d5c/da3/f102 [4194304,4194304] 0 2024-09-13T02:52:54.176 INFO:tasks.workunit.client.1.smithi142.stdout:2/810: fdatasync d1/de/d31/d6c/d6d/d47/faf 0 2024-09-13T02:52:54.182 INFO:tasks.workunit.client.1.smithi142.stdout:2/811: dwrite d1/de/da6/dbb/fa2 [0,4194304] 0 2024-09-13T02:52:54.191 INFO:tasks.workunit.client.1.smithi142.stdout:2/812: dwrite d1/de/d1f/d13/d59/ff8 [0,4194304] 0 2024-09-13T02:52:54.232 INFO:tasks.workunit.client.1.smithi142.stdout:0/937: mkdir d10/d6c/d13a 0 2024-09-13T02:52:54.235 INFO:tasks.workunit.client.0.smithi098.stdout:7/575: sync 2024-09-13T02:52:54.240 INFO:tasks.workunit.client.0.smithi098.stdout:7/576: creat d6/d24/d2a/d5a/d42/fb8 x:0 0 0 2024-09-13T02:52:54.243 INFO:tasks.workunit.client.0.smithi098.stdout:7/577: truncate d6/d24/d2a/d5a/d86/f7d 1004310 0 2024-09-13T02:52:54.250 INFO:tasks.workunit.client.0.smithi098.stdout:7/578: dwrite d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:54.251 INFO:tasks.workunit.client.0.smithi098.stdout:7/579: write d6/d1e/fb4 [103059,20778] 0 2024-09-13T02:52:54.253 INFO:tasks.workunit.client.1.smithi142.stdout:9/967: truncate dd/d17/d44/d82/d99/da8/fda 841200 0 2024-09-13T02:52:54.255 INFO:tasks.workunit.client.1.smithi142.stdout:9/968: symlink dd/d17/d44/d95/dd1/ddf/l15f 0 2024-09-13T02:52:54.256 INFO:tasks.workunit.client.1.smithi142.stdout:6/962: write d1/dd/f49 [11357864,61406] 0 2024-09-13T02:52:54.257 INFO:tasks.workunit.client.1.smithi142.stdout:9/969: readlink dd/d87/d8e/da3/lf3 0 2024-09-13T02:52:54.257 INFO:tasks.workunit.client.0.smithi098.stdout:7/580: mknod d6/d24/d2a/d5a/d4c/da5/cb9 0 2024-09-13T02:52:54.264 INFO:tasks.workunit.client.1.smithi142.stdout:9/970: fsync dd/d17/d25/f33 0 2024-09-13T02:52:54.265 INFO:tasks.workunit.client.0.smithi098.stdout:7/581: truncate d6/d24/d2a/d5a/d86/f8d 1551001 0 2024-09-13T02:52:54.266 INFO:tasks.workunit.client.1.smithi142.stdout:6/963: dread d1/dd/f35 [0,4194304] 0 2024-09-13T02:52:54.270 INFO:tasks.workunit.client.0.smithi098.stdout:5/445: write d0/d38/d3f/d81/d4d/f52 [1333625,68450] 0 2024-09-13T02:52:54.271 INFO:tasks.workunit.client.1.smithi142.stdout:6/964: truncate d1/dd/d57/f91 1838976 0 2024-09-13T02:52:54.276 INFO:tasks.workunit.client.0.smithi098.stdout:5/446: link d0/d38/d3f/f84 d0/d15/d17/d1c/f99 0 2024-09-13T02:52:54.281 INFO:tasks.workunit.client.1.smithi142.stdout:9/971: dread dd/f1b [0,4194304] 0 2024-09-13T02:52:54.281 INFO:tasks.workunit.client.1.smithi142.stdout:9/972: chown dd/d17/d69/f10e 4973843 1 2024-09-13T02:52:54.282 INFO:tasks.workunit.client.1.smithi142.stdout:9/973: chown dd/d148/dc9/de9/df5 7 1 2024-09-13T02:52:54.282 INFO:tasks.workunit.client.0.smithi098.stdout:5/447: dwrite d0/d38/d3f/d1a/d27/f6b [0,4194304] 0 2024-09-13T02:52:54.283 INFO:tasks.workunit.client.1.smithi142.stdout:9/974: write dd/d17/d68/d13c/f154 [1026571,103800] 0 2024-09-13T02:52:54.326 INFO:tasks.workunit.client.1.smithi142.stdout:2/813: dwrite d1/de/da6/fa7 [0,4194304] 0 2024-09-13T02:52:54.340 INFO:tasks.workunit.client.1.smithi142.stdout:3/865: rename d12/d16/d25/d2e/d38/d4d/d53/c100 to d12/d16/d25/d2e/d38/d4d/c112 0 2024-09-13T02:52:54.341 INFO:tasks.workunit.client.0.smithi098.stdout:6/394: sync 2024-09-13T02:52:54.342 INFO:tasks.workunit.client.0.smithi098.stdout:7/582: read d6/d24/d2a/d5a/d86/f7d [752325,43991] 0 2024-09-13T02:52:54.345 INFO:tasks.workunit.client.1.smithi142.stdout:5/934: rename d8/dc3/l5b to d8/d47/d65/da0/dd1/d61/l133 0 2024-09-13T02:52:54.347 INFO:tasks.workunit.client.0.smithi098.stdout:6/395: dwrite d5/d36/f4f [0,4194304] 0 2024-09-13T02:52:54.348 INFO:tasks.workunit.client.1.smithi142.stdout:2/814: dread d1/d42/d44/f84 [0,4194304] 0 2024-09-13T02:52:54.351 INFO:tasks.workunit.client.0.smithi098.stdout:6/396: chown d5/d13/d2b/d3a/d5a/l71 2 1 2024-09-13T02:52:54.355 INFO:tasks.workunit.client.1.smithi142.stdout:5/935: dwrite d8/fde [0,4194304] 0 2024-09-13T02:52:54.356 INFO:tasks.workunit.client.0.smithi098.stdout:6/397: write d5/fc [1916798,80845] 0 2024-09-13T02:52:54.357 INFO:tasks.workunit.client.0.smithi098.stdout:6/398: read d5/d13/f3f [5029495,39758] 0 2024-09-13T02:52:54.358 INFO:tasks.workunit.client.0.smithi098.stdout:6/399: write d5/d13/d51/f7f [922867,77436] 0 2024-09-13T02:52:54.363 INFO:tasks.workunit.client.0.smithi098.stdout:7/583: link d6/d24/d2a/d5a/d42/f71 d6/d24/d2a/d5a/d86/fba 0 2024-09-13T02:52:54.365 INFO:tasks.workunit.client.1.smithi142.stdout:5/936: symlink d8/d47/l134 0 2024-09-13T02:52:54.367 INFO:tasks.workunit.client.0.smithi098.stdout:6/400: symlink d5/d13/d2b/d3a/d41/d6c/l8b 0 2024-09-13T02:52:54.370 INFO:tasks.workunit.client.1.smithi142.stdout:8/801: rename d0/d80 to d0/d6/dc/d40/d103 0 2024-09-13T02:52:54.373 INFO:tasks.workunit.client.0.smithi098.stdout:6/401: rename d5/d13/d2b/d5b/d82 to d5/d36/d8c 0 2024-09-13T02:52:54.373 INFO:tasks.workunit.client.1.smithi142.stdout:6/965: dwrite d1/dd/d53/d78/d104/dad/dd2/ffa [0,4194304] 0 2024-09-13T02:52:54.375 INFO:tasks.workunit.client.1.smithi142.stdout:5/937: creat d8/d47/d65/da0/dd1/d61/dcb/f135 x:0 0 0 2024-09-13T02:52:54.376 INFO:tasks.workunit.client.0.smithi098.stdout:7/584: dread d6/f19 [0,4194304] 0 2024-09-13T02:52:54.378 INFO:tasks.workunit.client.1.smithi142.stdout:1/921: rename d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/cc8 to d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/dfe/c126 0 2024-09-13T02:52:54.380 INFO:tasks.workunit.client.1.smithi142.stdout:2/815: creat d1/f105 x:0 0 0 2024-09-13T02:52:54.382 INFO:tasks.workunit.client.0.smithi098.stdout:6/402: mknod d5/d13/d2b/d3a/c8d 0 2024-09-13T02:52:54.384 INFO:tasks.workunit.client.1.smithi142.stdout:6/966: mkdir d1/d7/d42/d143 0 2024-09-13T02:52:54.387 INFO:tasks.workunit.client.1.smithi142.stdout:9/975: dwrite dd/d148/dc9/d103/f151 [0,4194304] 0 2024-09-13T02:52:54.387 INFO:tasks.workunit.client.1.smithi142.stdout:1/922: dwrite d12/fa1 [0,4194304] 0 2024-09-13T02:52:54.387 INFO:tasks.workunit.client.0.smithi098.stdout:6/403: creat d5/d36/f8e x:0 0 0 2024-09-13T02:52:54.391 INFO:tasks.workunit.client.0.smithi098.stdout:6/404: dread f4 [0,4194304] 0 2024-09-13T02:52:54.396 INFO:tasks.workunit.client.0.smithi098.stdout:6/405: mkdir d5/d13/d2b/d3a/d14/d6b/d8f 0 2024-09-13T02:52:54.398 INFO:tasks.workunit.client.1.smithi142.stdout:6/967: symlink d1/d7/d19/d30/l144 0 2024-09-13T02:52:54.399 INFO:tasks.workunit.client.1.smithi142.stdout:9/976: dread - dd/d87/d8e/fc8 zero size 2024-09-13T02:52:54.400 INFO:tasks.workunit.client.0.smithi098.stdout:6/406: symlink d5/d13/l90 0 2024-09-13T02:52:54.406 INFO:tasks.workunit.client.1.smithi142.stdout:4/886: rename d0/dc8 to d0/d2b/d2d/d11f 0 2024-09-13T02:52:54.407 INFO:tasks.workunit.client.1.smithi142.stdout:1/923: rmdir d12/d13/d20/d66/d7d/df5/d11b 0 2024-09-13T02:52:54.407 INFO:tasks.workunit.client.0.smithi098.stdout:6/407: dread d5/d13/d2b/d5b/f63 [0,4194304] 0 2024-09-13T02:52:54.413 INFO:tasks.workunit.client.1.smithi142.stdout:7/966: rename d10/d13/d1d/d25/d45/d6d/dc3/c72 to d10/d13/dc2/c13a 0 2024-09-13T02:52:54.413 INFO:tasks.workunit.client.1.smithi142.stdout:1/924: dwrite d12/d13/d20/d66/d55/db4/fd5 [0,4194304] 0 2024-09-13T02:52:54.414 INFO:tasks.workunit.client.0.smithi098.stdout:6/408: unlink d5/d13/c17 0 2024-09-13T02:52:54.418 INFO:tasks.workunit.client.1.smithi142.stdout:0/938: rename d10/d6c/d88/fb9 to d10/d6c/d88/d36/f13b 0 2024-09-13T02:52:54.421 INFO:tasks.workunit.client.1.smithi142.stdout:7/967: truncate d10/d13/d1d/d25/d5c/dbd/fd9 37091 0 2024-09-13T02:52:54.421 INFO:tasks.workunit.client.0.smithi098.stdout:6/409: dwrite d5/f1e [0,4194304] 0 2024-09-13T02:52:54.423 INFO:tasks.workunit.client.1.smithi142.stdout:2/816: rename d1/d2d/lc8 to d1/de/d31/d6c/d6d/l106 0 2024-09-13T02:52:54.426 INFO:tasks.workunit.client.0.smithi098.stdout:6/410: dread d5/d13/d51/f7f [0,4194304] 0 2024-09-13T02:52:54.428 INFO:tasks.workunit.client.1.smithi142.stdout:9/977: rename dd/d17/d68/le8 to dd/d17/d68/d13c/l160 0 2024-09-13T02:52:54.430 INFO:tasks.workunit.client.1.smithi142.stdout:1/925: creat d12/d13/d20/d27/f127 x:0 0 0 2024-09-13T02:52:54.431 INFO:tasks.workunit.client.1.smithi142.stdout:2/817: rmdir d1/de/da6/dbb/d92 39 2024-09-13T02:52:54.433 INFO:tasks.workunit.client.1.smithi142.stdout:0/939: link d10/d6c/d88/d45/db3/fc7 d10/d6c/d88/d21/d51/d79/de6/d109/f13c 0 2024-09-13T02:52:54.433 INFO:tasks.workunit.client.1.smithi142.stdout:0/940: chown d10/d6c/d88/d45/db3/fc7 3146 1 2024-09-13T02:52:54.435 INFO:tasks.workunit.client.1.smithi142.stdout:0/941: chown d10/d6c/d88/d1a/d1e/d42/ce5 13154 1 2024-09-13T02:52:54.435 INFO:tasks.workunit.client.1.smithi142.stdout:1/926: truncate d12/d13/d20/d66/d55/da0/fcb 389444 0 2024-09-13T02:52:54.436 INFO:tasks.workunit.client.1.smithi142.stdout:2/818: symlink d1/de/d1f/d13/l107 0 2024-09-13T02:52:54.440 INFO:tasks.workunit.client.1.smithi142.stdout:9/978: creat dd/d17/d44/f161 x:0 0 0 2024-09-13T02:52:54.441 INFO:tasks.workunit.client.1.smithi142.stdout:5/938: getdents d8/dc3 0 2024-09-13T02:52:54.442 INFO:tasks.workunit.client.1.smithi142.stdout:1/927: dread - d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/dc0/dc3/ff6 zero size 2024-09-13T02:52:54.442 INFO:tasks.workunit.client.1.smithi142.stdout:0/942: dwrite d10/d6c/d88/d21/daf/ff2 [0,4194304] 0 2024-09-13T02:52:54.445 INFO:tasks.workunit.client.1.smithi142.stdout:2/819: fdatasync d1/f8c 0 2024-09-13T02:52:54.445 INFO:tasks.workunit.client.1.smithi142.stdout:3/866: write d12/d16/d25/d2e/d38/d4d/d53/faa [546498,51297] 0 2024-09-13T02:52:54.446 INFO:tasks.workunit.client.1.smithi142.stdout:5/939: mknod d8/dc3/d105/c136 0 2024-09-13T02:52:54.447 INFO:tasks.workunit.client.1.smithi142.stdout:2/820: write d1/de/f57 [1088334,103454] 0 2024-09-13T02:52:54.449 INFO:tasks.workunit.client.1.smithi142.stdout:0/943: fsync d10/d6c/d88/d21/d51/d35/d9b/da5/fdc 0 2024-09-13T02:52:54.451 INFO:tasks.workunit.client.1.smithi142.stdout:7/968: dread d10/d13/d1d/d25/d5c/f9b [0,4194304] 0 2024-09-13T02:52:54.454 INFO:tasks.workunit.client.1.smithi142.stdout:9/979: dread dd/d17/d5f/fc5 [4194304,4194304] 0 2024-09-13T02:52:54.458 INFO:tasks.workunit.client.1.smithi142.stdout:2/821: creat d1/d42/d44/f108 x:0 0 0 2024-09-13T02:52:54.460 INFO:tasks.workunit.client.1.smithi142.stdout:7/969: mkdir d10/d13/d1d/d2b/dae/d13b 0 2024-09-13T02:52:54.462 INFO:tasks.workunit.client.1.smithi142.stdout:3/867: mknod d12/d16/d25/d2e/c113 0 2024-09-13T02:52:54.464 INFO:tasks.workunit.client.1.smithi142.stdout:9/980: read dd/d17/d44/d82/d99/de3/f131 [96153,123191] 0 2024-09-13T02:52:54.465 INFO:tasks.workunit.client.1.smithi142.stdout:1/928: rename d12/d13/d20/d27/c97 to d12/d13/c128 0 2024-09-13T02:52:54.465 INFO:tasks.workunit.client.0.smithi098.stdout:7/585: write d6/d24/d2a/d5a/d86/f7d [446224,129425] 0 2024-09-13T02:52:54.466 INFO:tasks.workunit.client.0.smithi098.stdout:0/502: sync 2024-09-13T02:52:54.466 INFO:tasks.workunit.client.1.smithi142.stdout:1/929: readlink d12/d13/d20/d66/la6 0 2024-09-13T02:52:54.471 INFO:tasks.workunit.client.1.smithi142.stdout:2/822: symlink d1/l109 0 2024-09-13T02:52:54.473 INFO:tasks.workunit.client.0.smithi098.stdout:7/586: dwrite d6/d24/d2a/d57/faa [0,4194304] 0 2024-09-13T02:52:54.473 INFO:tasks.workunit.client.1.smithi142.stdout:3/868: dwrite d12/d16/d25/d2e/d38/d4d/d53/d78/fe2 [0,4194304] 0 2024-09-13T02:52:54.475 INFO:tasks.workunit.client.1.smithi142.stdout:8/802: dwrite d0/d6/dc/d45/d35/d37/f54 [0,4194304] 0 2024-09-13T02:52:54.475 INFO:tasks.workunit.client.1.smithi142.stdout:0/944: creat d10/d6c/d88/d21/d51/d35/f13d x:0 0 0 2024-09-13T02:52:54.476 INFO:tasks.workunit.client.1.smithi142.stdout:0/945: write d10/d6c/d88/d1a/d1e/f133 [876185,18468] 0 2024-09-13T02:52:54.479 INFO:tasks.workunit.client.1.smithi142.stdout:4/887: write d0/d2b/d2d/d31/fc6 [902767,91985] 0 2024-09-13T02:52:54.480 INFO:tasks.workunit.client.0.smithi098.stdout:7/587: mkdir d6/d24/d2a/d5a/d42/d80/dbb 0 2024-09-13T02:52:54.481 INFO:tasks.workunit.client.0.smithi098.stdout:7/588: fsync d6/d24/d2a/d5a/f22 0 2024-09-13T02:52:54.481 INFO:tasks.workunit.client.1.smithi142.stdout:0/946: dread - d10/d6c/d88/d1a/d7a/d100/f12f zero size 2024-09-13T02:52:54.488 INFO:tasks.workunit.client.1.smithi142.stdout:2/823: unlink d1/de/da6/dbb/fa2 0 2024-09-13T02:52:54.489 INFO:tasks.workunit.client.1.smithi142.stdout:0/947: dwrite d10/d6c/d88/d21/d8f/fc5 [0,4194304] 0 2024-09-13T02:52:54.493 INFO:tasks.workunit.client.1.smithi142.stdout:3/869: mkdir d12/d16/d25/d2e/d48/d5c/d73/d114 0 2024-09-13T02:52:54.502 INFO:tasks.workunit.client.0.smithi098.stdout:6/411: write d5/d18/f45 [41509,82812] 0 2024-09-13T02:52:54.506 INFO:tasks.workunit.client.0.smithi098.stdout:7/589: rename d6/d24/f5f to d6/d24/d2a/d5a/d42/fbc 0 2024-09-13T02:52:54.506 INFO:tasks.workunit.client.1.smithi142.stdout:6/968: sync 2024-09-13T02:52:54.509 INFO:tasks.workunit.client.1.smithi142.stdout:0/948: mkdir d10/d6c/d88/d45/d13e 0 2024-09-13T02:52:54.511 INFO:tasks.workunit.client.1.smithi142.stdout:6/969: dread d1/dd/d16/d4e/d32/f40 [0,4194304] 0 2024-09-13T02:52:54.512 INFO:tasks.workunit.client.1.smithi142.stdout:3/870: rmdir d12/d16/d25/d2e/d48/d5c/d8c/daf 39 2024-09-13T02:52:54.513 INFO:tasks.workunit.client.1.smithi142.stdout:1/930: dread d12/d13/d20/d66/d55/da0/fb2 [0,4194304] 0 2024-09-13T02:52:54.513 INFO:tasks.workunit.client.1.smithi142.stdout:8/803: mkdir d0/d6/d83/d104 0 2024-09-13T02:52:54.514 INFO:tasks.workunit.client.1.smithi142.stdout:3/871: truncate d12/d16/d3c/d7d/fbd 4387442 0 2024-09-13T02:52:54.514 INFO:tasks.workunit.client.1.smithi142.stdout:9/981: link dd/d17/d69/d84/l3b dd/d17/d44/l162 0 2024-09-13T02:52:54.514 INFO:tasks.workunit.client.1.smithi142.stdout:1/931: chown d12/d13/d20/d66/ff0 3601134 1 2024-09-13T02:52:54.515 INFO:tasks.workunit.client.1.smithi142.stdout:9/982: chown dd/d17/d69 43 1 2024-09-13T02:52:54.516 INFO:tasks.workunit.client.1.smithi142.stdout:5/940: write d8/d47/d65/da0/dd1/f6a [1518256,3995] 0 2024-09-13T02:52:54.516 INFO:tasks.workunit.client.1.smithi142.stdout:3/872: write d12/d16/d3c/d7d/d91/fac [29430,60790] 0 2024-09-13T02:52:54.518 INFO:tasks.workunit.client.1.smithi142.stdout:4/888: mkdir d0/d2b/d2d/d31/d43/d120 0 2024-09-13T02:52:54.518 INFO:tasks.workunit.client.1.smithi142.stdout:3/873: stat d12/l1c 0 2024-09-13T02:52:54.518 INFO:tasks.workunit.client.1.smithi142.stdout:4/889: read - d0/fb6 zero size 2024-09-13T02:52:54.518 INFO:tasks.workunit.client.1.smithi142.stdout:8/804: read d0/d6/dc/d45/d8/fe1 [2852580,60327] 0 2024-09-13T02:52:54.519 INFO:tasks.workunit.client.1.smithi142.stdout:0/949: unlink d10/d6c/d88/d21/d51/d35/d9b/da5/lb5 0 2024-09-13T02:52:54.521 INFO:tasks.workunit.client.1.smithi142.stdout:5/941: chown d8/dc3/d3f/ddd/d125/fd3 251 1 2024-09-13T02:52:54.523 INFO:tasks.workunit.client.1.smithi142.stdout:5/942: write d8/dc3/d3f/f11c [82898,38896] 0 2024-09-13T02:52:54.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/448: sync 2024-09-13T02:52:54.523 INFO:tasks.workunit.client.0.smithi098.stdout:1/520: sync 2024-09-13T02:52:54.523 INFO:tasks.workunit.client.0.smithi098.stdout:8/427: sync 2024-09-13T02:52:54.524 INFO:tasks.workunit.client.0.smithi098.stdout:9/476: sync 2024-09-13T02:52:54.524 INFO:tasks.workunit.client.0.smithi098.stdout:2/381: sync 2024-09-13T02:52:54.524 INFO:tasks.workunit.client.0.smithi098.stdout:3/453: sync 2024-09-13T02:52:54.524 INFO:tasks.workunit.client.0.smithi098.stdout:4/346: sync 2024-09-13T02:52:54.527 INFO:tasks.workunit.client.1.smithi142.stdout:7/970: link d10/d13/d1d/d2b/d40/fd7 d10/d13/d1d/d2b/d40/f13c 0 2024-09-13T02:52:54.528 INFO:tasks.workunit.client.0.smithi098.stdout:7/590: dread d6/d24/d2a/d5a/d4c/f6a [0,4194304] 0 2024-09-13T02:52:54.530 INFO:tasks.workunit.client.1.smithi142.stdout:9/983: symlink dd/d17/d44/d82/l163 0 2024-09-13T02:52:54.532 INFO:tasks.workunit.client.0.smithi098.stdout:0/503: dwrite dd/df/d1d/d26/d28/d32/f7e [0,4194304] 0 2024-09-13T02:52:54.534 INFO:tasks.workunit.client.0.smithi098.stdout:2/382: unlink d1/d1a/d9/d1e/l51 0 2024-09-13T02:52:54.536 INFO:tasks.workunit.client.0.smithi098.stdout:1/521: mknod d9/d33/d19/d35/d68/d4d/dbc/d23/d30/cc5 0 2024-09-13T02:52:54.538 INFO:tasks.workunit.client.1.smithi142.stdout:0/950: truncate d10/d23/f8d 1500166 0 2024-09-13T02:52:54.541 INFO:tasks.workunit.client.0.smithi098.stdout:0/504: dwrite dd/df/d1d/f34 [0,4194304] 0 2024-09-13T02:52:54.542 INFO:tasks.workunit.client.0.smithi098.stdout:1/522: dread - d9/d33/d19/d35/d68/d4d/dbc/d6b/fb2 zero size 2024-09-13T02:52:54.547 INFO:tasks.workunit.client.0.smithi098.stdout:9/477: creat d2/d6/d2b/d4d/d4f/fa9 x:0 0 0 2024-09-13T02:52:54.552 INFO:tasks.workunit.client.0.smithi098.stdout:4/347: symlink d6/l79 0 2024-09-13T02:52:54.558 INFO:tasks.workunit.client.0.smithi098.stdout:5/449: mkdir d0/d38/d3f/d81/d4d/d82/d9a 0 2024-09-13T02:52:54.560 INFO:tasks.workunit.client.1.smithi142.stdout:2/824: truncate d1/de/d1f/d13/fc4 203177 0 2024-09-13T02:52:54.563 INFO:tasks.workunit.client.0.smithi098.stdout:8/428: rename d2/dd/c13 to d2/d2f/d78/d46/d74/d86/c87 0 2024-09-13T02:52:54.563 INFO:tasks.workunit.client.1.smithi142.stdout:6/970: write d1/d7/d5f/d60/f9a [897335,30346] 0 2024-09-13T02:52:54.563 INFO:tasks.workunit.client.0.smithi098.stdout:4/348: dwrite d6/d22/f63 [4194304,4194304] 0 2024-09-13T02:52:54.564 INFO:tasks.workunit.client.1.smithi142.stdout:7/971: creat d10/d13/dc2/f13d x:0 0 0 2024-09-13T02:52:54.568 INFO:tasks.workunit.client.0.smithi098.stdout:7/591: unlink d6/d24/d2a/d5a/d42/d45/d73/c81 0 2024-09-13T02:52:54.569 INFO:tasks.workunit.client.0.smithi098.stdout:2/383: dwrite d1/d1f/f66 [0,4194304] 0 2024-09-13T02:52:54.570 INFO:tasks.workunit.client.1.smithi142.stdout:4/890: mknod d0/d2b/d2d/d65/c121 0 2024-09-13T02:52:54.573 INFO:tasks.workunit.client.0.smithi098.stdout:5/450: dwrite d0/d38/d3f/f9 [4194304,4194304] 0 2024-09-13T02:52:54.575 INFO:tasks.workunit.client.0.smithi098.stdout:5/451: chown d0/d57/c5c 1 1 2024-09-13T02:52:54.575 INFO:tasks.workunit.client.1.smithi142.stdout:3/874: symlink d12/d16/d3c/d79/d9b/dc1/dcd/l115 0 2024-09-13T02:52:54.576 INFO:tasks.workunit.client.1.smithi142.stdout:1/932: write d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/dc0/ff3 [402997,31363] 0 2024-09-13T02:52:54.578 INFO:tasks.workunit.client.1.smithi142.stdout:0/951: creat d10/dbf/f13f x:0 0 0 2024-09-13T02:52:54.589 INFO:tasks.workunit.client.1.smithi142.stdout:2/825: mknod d1/de/c10a 0 2024-09-13T02:52:54.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/984: write dd/d98/d126/f12d [376664,66286] 0 2024-09-13T02:52:54.590 INFO:tasks.workunit.client.1.smithi142.stdout:9/985: chown dd/d17/fa1 774384 1 2024-09-13T02:52:54.591 INFO:tasks.workunit.client.1.smithi142.stdout:6/971: rename d1/dd/d16/d4d/laa to d1/dd/d57/l145 0 2024-09-13T02:52:54.593 INFO:tasks.workunit.client.0.smithi098.stdout:8/429: fdatasync d2/dd/d11/f4c 0 2024-09-13T02:52:54.594 INFO:tasks.workunit.client.0.smithi098.stdout:4/349: mkdir d6/d37/d7a 0 2024-09-13T02:52:54.596 INFO:tasks.workunit.client.0.smithi098.stdout:4/350: fsync d6/d22/d3d/d41/f5b 0 2024-09-13T02:52:54.596 INFO:tasks.workunit.client.1.smithi142.stdout:3/875: fdatasync d12/d16/d25/d2e/d48/d5c/d8c/daf/f105 0 2024-09-13T02:52:54.601 INFO:tasks.workunit.client.1.smithi142.stdout:0/952: read d10/d6c/d88/d21/d51/f92 [1087492,30783] 0 2024-09-13T02:52:54.602 INFO:tasks.workunit.client.1.smithi142.stdout:0/953: truncate d10/d6c/d88/d1a/d7a/f130 951280 0 2024-09-13T02:52:54.603 INFO:tasks.workunit.client.0.smithi098.stdout:6/412: mknod d5/d13/d2b/d3a/d14/d6b/c91 0 2024-09-13T02:52:54.603 INFO:tasks.workunit.client.1.smithi142.stdout:0/954: stat d10/d6c/d88/d21/d51/d79/lf9 0 2024-09-13T02:52:54.605 INFO:tasks.workunit.client.0.smithi098.stdout:9/478: unlink d2/d6/d2b/d4d/f64 0 2024-09-13T02:52:54.607 INFO:tasks.workunit.client.1.smithi142.stdout:7/972: rename d10/d13/d1d/d25/d45/d92/lb9 to d10/d13/d1d/d44/l13e 0 2024-09-13T02:52:54.608 INFO:tasks.workunit.client.0.smithi098.stdout:8/430: mkdir d2/d28/d43/d88 0 2024-09-13T02:52:54.610 INFO:tasks.workunit.client.1.smithi142.stdout:4/891: truncate d0/d2b/d2d/d11f/dcf/de0/fe5 849436 0 2024-09-13T02:52:54.610 INFO:tasks.workunit.client.1.smithi142.stdout:4/892: stat d0/d2b/d21/l45 0 2024-09-13T02:52:54.611 INFO:tasks.workunit.client.1.smithi142.stdout:4/893: chown d0/d2b/d2d/d31/d43/d120 9 1 2024-09-13T02:52:54.611 INFO:tasks.workunit.client.0.smithi098.stdout:1/523: creat d9/d33/d19/d35/d68/d4d/dbc/d23/fc6 x:0 0 0 2024-09-13T02:52:54.612 INFO:tasks.workunit.client.0.smithi098.stdout:1/524: read - d9/f55 zero size 2024-09-13T02:52:54.614 INFO:tasks.workunit.client.1.smithi142.stdout:3/876: creat d12/d16/d25/d2e/d38/d4d/d53/da0/f116 x:0 0 0 2024-09-13T02:52:54.614 INFO:tasks.workunit.client.1.smithi142.stdout:8/805: getdents d0/d6/dc/d45/d35/dae 0 2024-09-13T02:52:54.615 INFO:tasks.workunit.client.0.smithi098.stdout:1/525: truncate d9/d33/d19/d35/fac 487760 0 2024-09-13T02:52:54.615 INFO:tasks.workunit.client.1.smithi142.stdout:8/806: stat d0 0 2024-09-13T02:52:54.616 INFO:tasks.workunit.client.1.smithi142.stdout:5/943: getdents d8/dc3/d64/d68/db5 0 2024-09-13T02:52:54.617 INFO:tasks.workunit.client.0.smithi098.stdout:1/526: read d9/d33/d19/d35/d68/d2f/dbf/f96 [36287,14939] 0 2024-09-13T02:52:54.618 INFO:tasks.workunit.client.0.smithi098.stdout:6/413: chown d5/c7 205273 1 2024-09-13T02:52:54.621 INFO:tasks.workunit.client.0.smithi098.stdout:2/384: creat d1/f7b x:0 0 0 2024-09-13T02:52:54.622 INFO:tasks.workunit.client.0.smithi098.stdout:2/385: chown d1/d1f/d35/d63/l16 6480173 1 2024-09-13T02:52:54.625 INFO:tasks.workunit.client.0.smithi098.stdout:9/479: creat d2/d6/d36/d8d/d39/d43/d90/da0/faa x:0 0 0 2024-09-13T02:52:54.625 INFO:tasks.workunit.client.0.smithi098.stdout:7/592: dread d6/d24/d2a/d5a/d42/f71 [0,4194304] 0 2024-09-13T02:52:54.629 INFO:tasks.workunit.client.0.smithi098.stdout:4/351: truncate d6/d10/d21/f3b 256576 0 2024-09-13T02:52:54.631 INFO:tasks.workunit.client.1.smithi142.stdout:6/972: symlink d1/dd/d53/d78/db8/d108/l146 0 2024-09-13T02:52:54.632 INFO:tasks.workunit.client.0.smithi098.stdout:3/454: truncate d7/d9/d25/d64/f68 85820 0 2024-09-13T02:52:54.633 INFO:tasks.workunit.client.0.smithi098.stdout:0/505: getdents dd/df 0 2024-09-13T02:52:54.635 INFO:tasks.workunit.client.0.smithi098.stdout:0/506: write dd/df/d1d/d40/d46/f97 [938033,19280] 0 2024-09-13T02:52:54.635 INFO:tasks.workunit.client.1.smithi142.stdout:1/933: creat d12/d13/d20/d66/f129 x:0 0 0 2024-09-13T02:52:54.637 INFO:tasks.workunit.client.1.smithi142.stdout:9/986: dread dd/d17/d69/d84/d41/f83 [0,4194304] 0 2024-09-13T02:52:54.641 INFO:tasks.workunit.client.0.smithi098.stdout:6/414: creat d5/d13/d2b/d3a/d41/d55/f92 x:0 0 0 2024-09-13T02:52:54.642 INFO:tasks.workunit.client.1.smithi142.stdout:9/987: dread dd/d17/d68/d13c/f142 [0,4194304] 0 2024-09-13T02:52:54.644 INFO:tasks.workunit.client.1.smithi142.stdout:8/807: read d0/d75/f101 [1720310,81870] 0 2024-09-13T02:52:54.644 INFO:tasks.workunit.client.0.smithi098.stdout:2/386: mkdir d1/d1f/d27/d7c 0 2024-09-13T02:52:54.645 INFO:tasks.workunit.client.1.smithi142.stdout:5/944: dread - d8/d47/d65/da0/dd1/d45/d81/d8c/d8d/fb1 zero size 2024-09-13T02:52:54.645 INFO:tasks.workunit.client.0.smithi098.stdout:6/415: dread f3 [0,4194304] 0 2024-09-13T02:52:54.646 INFO:tasks.workunit.client.0.smithi098.stdout:9/480: creat d2/d6/d2b/d4d/fab x:0 0 0 2024-09-13T02:52:54.646 INFO:tasks.workunit.client.0.smithi098.stdout:6/416: stat d5/d13/d2b/d3a/d14/l2f 0 2024-09-13T02:52:54.647 INFO:tasks.workunit.client.0.smithi098.stdout:5/452: truncate d0/d38/d3f/f11 4533402 0 2024-09-13T02:52:54.647 INFO:tasks.workunit.client.0.smithi098.stdout:6/417: fsync d5/d13/d2b/d3a/d41/f4b 0 2024-09-13T02:52:54.648 INFO:tasks.workunit.client.0.smithi098.stdout:6/418: stat d5/d13/d51/f54 0 2024-09-13T02:52:54.648 INFO:tasks.workunit.client.0.smithi098.stdout:6/419: dread - d5/d13/d2b/d3a/f86 zero size 2024-09-13T02:52:54.649 INFO:tasks.workunit.client.1.smithi142.stdout:5/945: dwrite d8/d47/d65/da0/fd2 [0,4194304] 0 2024-09-13T02:52:54.649 INFO:tasks.workunit.client.0.smithi098.stdout:7/593: unlink d6/d24/d46/f50 0 2024-09-13T02:52:54.652 INFO:tasks.workunit.client.1.smithi142.stdout:7/973: mkdir d10/d13/d21/d13f 0 2024-09-13T02:52:54.653 INFO:tasks.workunit.client.1.smithi142.stdout:0/955: write d10/d6c/d88/d45/db3/fc7 [1549818,88090] 0 2024-09-13T02:52:54.653 INFO:tasks.workunit.client.0.smithi098.stdout:4/352: creat d6/d54/f7b x:0 0 0 2024-09-13T02:52:54.656 INFO:tasks.workunit.client.1.smithi142.stdout:2/826: dwrite d1/f5 [0,4194304] 0 2024-09-13T02:52:54.658 INFO:tasks.workunit.client.1.smithi142.stdout:2/827: stat d1/de/d31/d6c/d6d/f52 0 2024-09-13T02:52:54.660 INFO:tasks.workunit.client.1.smithi142.stdout:4/894: truncate d0/fb5 758284 0 2024-09-13T02:52:54.660 INFO:tasks.workunit.client.1.smithi142.stdout:3/877: write d12/d16/d25/d2e/d38/f45 [48970,111292] 0 2024-09-13T02:52:54.664 INFO:tasks.workunit.client.0.smithi098.stdout:1/527: creat d9/d33/d29/d58/fc7 x:0 0 0 2024-09-13T02:52:54.664 INFO:tasks.workunit.client.1.smithi142.stdout:9/988: dread - dd/d87/f109 zero size 2024-09-13T02:52:54.667 INFO:tasks.workunit.client.0.smithi098.stdout:2/387: rename d1/c6b to d1/d1f/d35/d63/c7d 0 2024-09-13T02:52:54.668 INFO:tasks.workunit.client.1.smithi142.stdout:8/808: chown d0/d6/dc/d45/d8/l1c 45060 1 2024-09-13T02:52:54.669 INFO:tasks.workunit.client.0.smithi098.stdout:9/481: mkdir d2/d6/d36/d8d/d39/dac 0 2024-09-13T02:52:54.672 INFO:tasks.workunit.client.0.smithi098.stdout:9/482: read - d2/d6/d36/d8d/d39/f62 zero size 2024-09-13T02:52:54.672 INFO:tasks.workunit.client.1.smithi142.stdout:5/946: rename d8/dc3/d3f/l9e to d8/d47/d65/da0/dd1/d45/dc5/l137 0 2024-09-13T02:52:54.673 INFO:tasks.workunit.client.0.smithi098.stdout:5/453: read - d0/f4b zero size 2024-09-13T02:52:54.674 INFO:tasks.workunit.client.0.smithi098.stdout:6/420: mkdir d5/d13/d2b/d93 0 2024-09-13T02:52:54.675 INFO:tasks.workunit.client.0.smithi098.stdout:9/483: dread d2/d6/d2b/d4d/d4f/d6c/fa5 [4194304,4194304] 0 2024-09-13T02:52:54.677 INFO:tasks.workunit.client.0.smithi098.stdout:7/594: mkdir d6/d24/d2a/d5a/d8e/dbd 0 2024-09-13T02:52:54.680 INFO:tasks.workunit.client.1.smithi142.stdout:1/934: mkdir d12/d13/d20/d66/d7d/df5/d12a 0 2024-09-13T02:52:54.684 INFO:tasks.workunit.client.1.smithi142.stdout:4/895: fdatasync d0/df/d57/f22 0 2024-09-13T02:52:54.684 INFO:tasks.workunit.client.0.smithi098.stdout:2/388: dread d1/d1a/d4f/f69 [0,4194304] 0 2024-09-13T02:52:54.686 INFO:tasks.workunit.client.0.smithi098.stdout:2/389: write d1/d1f/d35/d63/d72/f75 [427742,123317] 0 2024-09-13T02:52:54.695 INFO:tasks.workunit.client.1.smithi142.stdout:2/828: rename d1/de/d1f/d13/d60/da9/de9/cd0 to d1/de/d1f/d13/d60/c10b 0 2024-09-13T02:52:54.697 INFO:tasks.workunit.client.1.smithi142.stdout:6/973: creat d1/dd/d53/d78/f147 x:0 0 0 2024-09-13T02:52:54.700 INFO:tasks.workunit.client.1.smithi142.stdout:5/947: creat d8/dc3/d64/d68/f138 x:0 0 0 2024-09-13T02:52:54.704 INFO:tasks.workunit.client.1.smithi142.stdout:6/974: dwrite d1/dd/d53/d78/d104/dad/dd2/ffa [0,4194304] 0 2024-09-13T02:52:54.706 INFO:tasks.workunit.client.1.smithi142.stdout:3/878: dread d12/d16/d25/f26 [0,4194304] 0 2024-09-13T02:52:54.706 INFO:tasks.workunit.client.1.smithi142.stdout:6/975: stat d1/d7/d19/d30/dfc 0 2024-09-13T02:52:54.708 INFO:tasks.workunit.client.0.smithi098.stdout:7/595: chown d6/d24/d2a/d5a/d86/l5e 1625 1 2024-09-13T02:52:54.710 INFO:tasks.workunit.client.1.smithi142.stdout:7/974: dwrite d10/d13/d1d/d25/d5c/da3/da8/fb0 [0,4194304] 0 2024-09-13T02:52:54.711 INFO:tasks.workunit.client.0.smithi098.stdout:4/353: dwrite d6/d3e/d68/f36 [0,4194304] 0 2024-09-13T02:52:54.713 INFO:tasks.workunit.client.0.smithi098.stdout:7/596: dread d6/d24/d2a/d57/d88/f54 [0,4194304] 0 2024-09-13T02:52:54.714 INFO:tasks.workunit.client.1.smithi142.stdout:9/989: creat dd/d98/dca/d127/f164 x:0 0 0 2024-09-13T02:52:54.714 INFO:tasks.workunit.client.0.smithi098.stdout:9/484: rename d2/d6/d36/d8d/d39/d43/d90/da0/c97 to d2/d6/d36/d8d/d39/d43/d90/da2/cad 0 2024-09-13T02:52:54.717 INFO:tasks.workunit.client.0.smithi098.stdout:8/431: getdents d2/d2f/d78 0 2024-09-13T02:52:54.718 INFO:tasks.workunit.client.0.smithi098.stdout:8/432: write d2/d2f/d78/f4b [4003326,5005] 0 2024-09-13T02:52:54.718 INFO:tasks.workunit.client.0.smithi098.stdout:8/433: fsync f1 0 2024-09-13T02:52:54.720 INFO:tasks.workunit.client.1.smithi142.stdout:8/809: symlink d0/d6/dc/d45/d8/l105 0 2024-09-13T02:52:54.724 INFO:tasks.workunit.client.1.smithi142.stdout:0/956: truncate d10/d6c/d88/d45/db3/fc7 1323694 0 2024-09-13T02:52:54.725 INFO:tasks.workunit.client.1.smithi142.stdout:5/948: truncate d8/d47/d65/da0/dd1/d61/f9f 1203512 0 2024-09-13T02:52:54.726 INFO:tasks.workunit.client.1.smithi142.stdout:1/935: write d12/f4d [692143,83038] 0 2024-09-13T02:52:54.727 INFO:tasks.workunit.client.0.smithi098.stdout:2/390: mknod d1/d1f/d35/d63/d23/c7e 0 2024-09-13T02:52:54.728 INFO:tasks.workunit.client.0.smithi098.stdout:0/507: rmdir dd/df/d1d/d26/d28/d5d/d7f 0 2024-09-13T02:52:54.729 INFO:tasks.workunit.client.1.smithi142.stdout:4/896: write d0/d2b/d21/d30/f54 [3696893,32774] 0 2024-09-13T02:52:54.729 INFO:tasks.workunit.client.0.smithi098.stdout:3/455: dread d7/d9/d25/d64/f68 [0,4194304] 0 2024-09-13T02:52:54.731 INFO:tasks.workunit.client.0.smithi098.stdout:1/528: link d9/d33/d19/d35/d68/d4d/dbc/d6b/fb2 d9/d33/d19/d35/d68/d4d/db5/db8/fc8 0 2024-09-13T02:52:54.731 INFO:tasks.workunit.client.0.smithi098.stdout:1/529: chown d9/d33/d29/d58/f5c 25 1 2024-09-13T02:52:54.733 INFO:tasks.workunit.client.0.smithi098.stdout:1/530: chown d9/d33/d19/d35/d68/d2f/dbf/cbd 494855 1 2024-09-13T02:52:54.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:54 smithi098 ceph-mon[27886]: pgmap v26: 65 pgs: 65 active+clean; 2.5 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 81 MiB/s rd, 219 MiB/s wr, 423 op/s 2024-09-13T02:52:54.734 INFO:tasks.workunit.client.0.smithi098.stdout:6/421: truncate d5/d13/d2b/d3a/d14/f29 1889889 0 2024-09-13T02:52:54.737 INFO:tasks.workunit.client.1.smithi142.stdout:6/976: creat d1/d7/d19/d48/d90/d11e/f148 x:0 0 0 2024-09-13T02:52:54.741 INFO:tasks.workunit.client.1.smithi142.stdout:2/829: dwrite d1/fb5 [0,4194304] 0 2024-09-13T02:52:54.743 INFO:tasks.workunit.client.1.smithi142.stdout:2/830: truncate d1/de/d31/d6c/d6d/f52 872810 0 2024-09-13T02:52:54.744 INFO:tasks.workunit.client.1.smithi142.stdout:2/831: chown d1/de/f9d 3191 1 2024-09-13T02:52:54.747 INFO:tasks.workunit.client.1.smithi142.stdout:2/832: write d1/de/d1f/d13/d60/da9/fff [645824,46255] 0 2024-09-13T02:52:54.747 INFO:tasks.workunit.client.1.smithi142.stdout:5/949: mkdir d8/d47/d65/da0/dd1/d61/dcb/d139 0 2024-09-13T02:52:54.749 INFO:tasks.workunit.client.1.smithi142.stdout:1/936: dread - d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/fdc zero size 2024-09-13T02:52:54.749 INFO:tasks.workunit.client.1.smithi142.stdout:5/950: chown d8/dc3/d3f/ddd/fe0 282 1 2024-09-13T02:52:54.751 INFO:tasks.workunit.client.1.smithi142.stdout:7/975: dread d10/d13/d1d/d25/f75 [0,4194304] 0 2024-09-13T02:52:54.751 INFO:tasks.workunit.client.1.smithi142.stdout:7/976: stat d10/d13/d1d/d25/d5c/lb6 0 2024-09-13T02:52:54.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:54 smithi142 ceph-mon[33443]: pgmap v26: 65 pgs: 65 active+clean; 2.5 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 81 MiB/s rd, 219 MiB/s wr, 423 op/s 2024-09-13T02:52:54.754 INFO:tasks.workunit.client.0.smithi098.stdout:3/456: dread d7/d9/d25/f39 [0,4194304] 0 2024-09-13T02:52:54.757 INFO:tasks.workunit.client.1.smithi142.stdout:8/810: dread d0/d6/f2a [0,4194304] 0 2024-09-13T02:52:54.760 INFO:tasks.workunit.client.1.smithi142.stdout:9/990: rename dd/d17/d25/l3f to dd/d148/l165 0 2024-09-13T02:52:54.760 INFO:tasks.workunit.client.0.smithi098.stdout:9/485: symlink d2/d6/d36/da7/lae 0 2024-09-13T02:52:54.762 INFO:tasks.workunit.client.1.smithi142.stdout:8/811: dread d0/d6/dc/d45/d8/df/fe5 [0,4194304] 0 2024-09-13T02:52:54.764 INFO:tasks.workunit.client.1.smithi142.stdout:2/833: rmdir d1 39 2024-09-13T02:52:54.764 INFO:tasks.workunit.client.1.smithi142.stdout:6/977: dwrite d1/d7/d5f/d6a/f11b [0,4194304] 0 2024-09-13T02:52:54.766 INFO:tasks.workunit.client.1.smithi142.stdout:6/978: fsync d1/d7/d5f/d60/db6/f110 0 2024-09-13T02:52:54.767 INFO:tasks.workunit.client.1.smithi142.stdout:1/937: unlink d12/d13/d20/d66/d7d/df5/f9e 0 2024-09-13T02:52:54.769 INFO:tasks.workunit.client.0.smithi098.stdout:5/454: getdents d0/d7c 0 2024-09-13T02:52:54.770 INFO:tasks.workunit.client.1.smithi142.stdout:3/879: creat d12/d16/d25/d2e/d38/d6b/f117 x:0 0 0 2024-09-13T02:52:54.770 INFO:tasks.workunit.client.1.smithi142.stdout:8/812: dwrite d0/d6/d83/daa/fcb [0,4194304] 0 2024-09-13T02:52:54.771 INFO:tasks.workunit.client.1.smithi142.stdout:8/813: dread d0/f8f [0,4194304] 0 2024-09-13T02:52:54.774 INFO:tasks.workunit.client.0.smithi098.stdout:0/508: truncate fc 6076783 0 2024-09-13T02:52:54.776 INFO:tasks.workunit.client.0.smithi098.stdout:1/531: symlink d9/d33/d19/d35/d68/d4d/dbc/d23/lc9 0 2024-09-13T02:52:54.778 INFO:tasks.workunit.client.1.smithi142.stdout:4/897: rename d0/d2b/d21/fdb to d0/d2b/d2d/d11f/de8/f122 0 2024-09-13T02:52:54.779 INFO:tasks.workunit.client.1.smithi142.stdout:4/898: chown d0/d2b/ldc 178976440 1 2024-09-13T02:52:54.780 INFO:tasks.workunit.client.1.smithi142.stdout:4/899: chown d0/d2b/d2d/d31/d32/fe9 6576476 1 2024-09-13T02:52:54.780 INFO:tasks.workunit.client.1.smithi142.stdout:9/991: symlink dd/d148/dc9/de9/l166 0 2024-09-13T02:52:54.782 INFO:tasks.workunit.client.1.smithi142.stdout:9/992: readlink dd/d17/d44/d82/d99/da8/db7/l102 0 2024-09-13T02:52:54.783 INFO:tasks.workunit.client.0.smithi098.stdout:6/422: read d5/d13/f28 [1159399,71193] 0 2024-09-13T02:52:54.784 INFO:tasks.workunit.client.1.smithi142.stdout:2/834: chown d1/de/d31/d6c/d6d/db6/lfc 1608518620 1 2024-09-13T02:52:54.784 INFO:tasks.workunit.client.0.smithi098.stdout:7/597: creat d6/d24/d2a/d5a/d86/fbe x:0 0 0 2024-09-13T02:52:54.786 INFO:tasks.workunit.client.0.smithi098.stdout:8/434: creat d2/d2f/f89 x:0 0 0 2024-09-13T02:52:54.793 INFO:tasks.workunit.client.1.smithi142.stdout:0/957: getdents d10/d6c/d88/d1a/d3a 0 2024-09-13T02:52:54.795 INFO:tasks.workunit.client.0.smithi098.stdout:1/532: rename d9/d33/d19/d35/d68/d2f/dbf/cbd to d9/d33/d19/d35/d68/d2f/dbf/cca 0 2024-09-13T02:52:54.795 INFO:tasks.workunit.client.0.smithi098.stdout:1/533: readlink d9/d33/d19/lc2 0 2024-09-13T02:52:54.796 INFO:tasks.workunit.client.0.smithi098.stdout:1/534: chown d9/l72 0 1 2024-09-13T02:52:54.799 INFO:tasks.workunit.client.1.smithi142.stdout:0/958: dwrite d10/d6c/d88/d1a/d1e/d42/d4b/f114 [0,4194304] 0 2024-09-13T02:52:54.800 INFO:tasks.workunit.client.1.smithi142.stdout:5/951: rename d8/dc3/d64/d68/db5/l132 to d8/d47/d65/da0/dd1/d45/d62/d12a/l13a 0 2024-09-13T02:52:54.800 INFO:tasks.workunit.client.0.smithi098.stdout:4/354: link d6/d22/d3d/d41/l62 d6/d22/d3d/l7c 0 2024-09-13T02:52:54.801 INFO:tasks.workunit.client.1.smithi142.stdout:0/959: readlink d10/d6c/d88/d21/d51/d35/lac 0 2024-09-13T02:52:54.802 INFO:tasks.workunit.client.0.smithi098.stdout:6/423: readlink d5/l1d 0 2024-09-13T02:52:54.803 INFO:tasks.workunit.client.0.smithi098.stdout:0/509: write dd/df/d1d/d26/f51 [690227,127569] 0 2024-09-13T02:52:54.804 INFO:tasks.workunit.client.0.smithi098.stdout:7/598: fdatasync d6/d24/d2a/d5a/f1d 0 2024-09-13T02:52:54.805 INFO:tasks.workunit.client.1.smithi142.stdout:4/900: dread d0/df/d57/f53 [0,4194304] 0 2024-09-13T02:52:54.807 INFO:tasks.workunit.client.1.smithi142.stdout:1/938: mknod d12/d13/dd3/c12b 0 2024-09-13T02:52:54.808 INFO:tasks.workunit.client.0.smithi098.stdout:8/435: chown d2/dd/d11/d2c/c83 851216 1 2024-09-13T02:52:54.808 INFO:tasks.workunit.client.1.smithi142.stdout:1/939: write d12/fec [633032,33892] 0 2024-09-13T02:52:54.812 INFO:tasks.workunit.client.0.smithi098.stdout:9/486: rename d2/d6/l3c to d2/d6/d36/d8d/d39/dac/laf 0 2024-09-13T02:52:54.813 INFO:tasks.workunit.client.1.smithi142.stdout:2/835: dwrite d1/de/da6/dbb/d92/fbf [4194304,4194304] 0 2024-09-13T02:52:54.813 INFO:tasks.workunit.client.1.smithi142.stdout:2/836: fdatasync d1/f5 0 2024-09-13T02:52:54.814 INFO:tasks.workunit.client.0.smithi098.stdout:2/391: getdents d1/d1f/d35 0 2024-09-13T02:52:54.819 INFO:tasks.workunit.client.0.smithi098.stdout:1/535: mkdir d9/d33/d19/d35/d68/d4d/db5/dcb 0 2024-09-13T02:52:54.821 INFO:tasks.workunit.client.0.smithi098.stdout:3/457: link d7/c27 d7/d9/d15/d5d/c8d 0 2024-09-13T02:52:54.821 INFO:tasks.workunit.client.1.smithi142.stdout:5/952: symlink d8/d47/d65/da0/dd1/d45/d81/d8c/l13b 0 2024-09-13T02:52:54.823 INFO:tasks.workunit.client.0.smithi098.stdout:6/424: mkdir d5/d13/d2b/d3a/d14/d94 0 2024-09-13T02:52:54.824 INFO:tasks.workunit.client.0.smithi098.stdout:6/425: chown d5/d13/d2b/d3a/cf 543 1 2024-09-13T02:52:54.827 INFO:tasks.workunit.client.1.smithi142.stdout:4/901: creat d0/d2b/d2d/da2/f123 x:0 0 0 2024-09-13T02:52:54.832 INFO:tasks.workunit.client.1.smithi142.stdout:5/953: mknod d8/dc3/c13c 0 2024-09-13T02:52:54.833 INFO:tasks.workunit.client.1.smithi142.stdout:0/960: mkdir d10/d6c/d13a/d140 0 2024-09-13T02:52:54.834 INFO:tasks.workunit.client.0.smithi098.stdout:6/426: dwrite d5/d13/d2b/f69 [4194304,4194304] 0 2024-09-13T02:52:54.835 INFO:tasks.workunit.client.0.smithi098.stdout:7/599: mknod d6/d24/d2a/d5a/d86/cbf 0 2024-09-13T02:52:54.836 INFO:tasks.workunit.client.1.smithi142.stdout:9/993: creat dd/d148/dc9/f167 x:0 0 0 2024-09-13T02:52:54.841 INFO:tasks.workunit.client.1.smithi142.stdout:1/940: mknod d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/dc0/dc3/c12c 0 2024-09-13T02:52:54.843 INFO:tasks.workunit.client.0.smithi098.stdout:6/427: dwrite d5/f1e [4194304,4194304] 0 2024-09-13T02:52:54.844 INFO:tasks.workunit.client.1.smithi142.stdout:7/977: rename d10/d13/d1d/d2b/d55/d32/d8c/df1/d10c to d10/d13/d1d/d2b/d55/d140 0 2024-09-13T02:52:54.916 INFO:tasks.workunit.client.1.smithi142.stdout:6/979: sync 2024-09-13T02:52:54.917 INFO:tasks.workunit.client.1.smithi142.stdout:6/980: dread - d1/dd/d53/d78/f147 zero size 2024-09-13T02:52:54.917 INFO:tasks.workunit.client.1.smithi142.stdout:6/981: fsync d1/d4a/f12e 0 2024-09-13T02:52:54.918 INFO:tasks.workunit.client.1.smithi142.stdout:6/982: fdatasync d1/dd/d53/d78/d104/dad/f13c 0 2024-09-13T02:52:54.918 INFO:tasks.workunit.client.1.smithi142.stdout:6/983: read - d1/d7/d19/d30/f137 zero size 2024-09-13T02:52:54.985 INFO:tasks.workunit.client.0.smithi098.stdout:5/455: rename d0/d15/d17/f28 to d0/d15/f9b 0 2024-09-13T02:52:54.986 INFO:tasks.workunit.client.1.smithi142.stdout:0/961: creat d10/d6c/d88/d1a/d1e/d42/d4b/d119/f141 x:0 0 0 2024-09-13T02:52:54.988 INFO:tasks.workunit.client.0.smithi098.stdout:0/510: link dd/df/d1d/d26/f44 dd/fa4 0 2024-09-13T02:52:54.989 INFO:tasks.workunit.client.1.smithi142.stdout:9/994: readlink dd/l23 0 2024-09-13T02:52:54.993 INFO:tasks.workunit.client.0.smithi098.stdout:5/456: dwrite d0/d15/f8d [0,4194304] 0 2024-09-13T02:52:54.993 INFO:tasks.workunit.client.0.smithi098.stdout:6/428: write d5/d13/d51/f7f [1987454,9693] 0 2024-09-13T02:52:54.994 INFO:tasks.workunit.client.0.smithi098.stdout:5/457: chown d0/d38/d3f/l53 5471448 1 2024-09-13T02:52:54.995 INFO:tasks.workunit.client.0.smithi098.stdout:5/458: dread - d0/d57/f91 zero size 2024-09-13T02:52:54.997 INFO:tasks.workunit.client.1.smithi142.stdout:1/941: mknod d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/c12d 0 2024-09-13T02:52:54.999 INFO:tasks.workunit.client.0.smithi098.stdout:9/487: dread - d2/d6/d2b/d66/f78 zero size 2024-09-13T02:52:55.000 INFO:tasks.workunit.client.0.smithi098.stdout:9/488: write d2/f98 [31342,85278] 0 2024-09-13T02:52:55.001 INFO:tasks.workunit.client.1.smithi142.stdout:4/902: write d0/df/d57/ff2 [633768,59636] 0 2024-09-13T02:52:55.003 INFO:tasks.workunit.client.0.smithi098.stdout:6/429: rmdir d5/d13/d67 39 2024-09-13T02:52:55.005 INFO:tasks.workunit.client.1.smithi142.stdout:6/984: mknod d1/dd/d16/d4e/c149 0 2024-09-13T02:52:55.006 INFO:tasks.workunit.client.1.smithi142.stdout:2/837: write d1/de/da6/dbb/f3f [530736,7754] 0 2024-09-13T02:52:55.006 INFO:tasks.workunit.client.1.smithi142.stdout:0/962: fdatasync d10/d95/dcf/f103 0 2024-09-13T02:52:55.007 INFO:tasks.workunit.client.1.smithi142.stdout:2/838: stat d1/de/d1f/d13/f89 0 2024-09-13T02:52:55.008 INFO:tasks.workunit.client.1.smithi142.stdout:2/839: read - d1/de/d31/d6c/d6d/db6/ff5 zero size 2024-09-13T02:52:55.009 INFO:tasks.workunit.client.1.smithi142.stdout:9/995: truncate dd/d87/d8e/fc8 847639 0 2024-09-13T02:52:55.009 INFO:tasks.workunit.client.1.smithi142.stdout:5/954: write d8/f13 [1721469,13047] 0 2024-09-13T02:52:55.010 INFO:tasks.workunit.client.1.smithi142.stdout:9/996: read dd/d148/dc9/d103/f13f [77286,18418] 0 2024-09-13T02:52:55.011 INFO:tasks.workunit.client.1.smithi142.stdout:1/942: truncate d12/d13/dd3/ffb 443115 0 2024-09-13T02:52:55.013 INFO:tasks.workunit.client.0.smithi098.stdout:4/355: rename l2 to d6/d10/d21/l7d 0 2024-09-13T02:52:55.014 INFO:tasks.workunit.client.0.smithi098.stdout:3/458: truncate d7/d9/d25/d2b/f3e 387654 0 2024-09-13T02:52:55.014 INFO:tasks.workunit.client.0.smithi098.stdout:4/356: dread - d6/d22/d3d/d41/d58/f78 zero size 2024-09-13T02:52:55.017 INFO:tasks.workunit.client.1.smithi142.stdout:7/978: mkdir d10/d13/d1d/d25/d45/d141 0 2024-09-13T02:52:55.018 INFO:tasks.workunit.client.0.smithi098.stdout:6/430: truncate d5/f31 864694 0 2024-09-13T02:52:55.020 INFO:tasks.workunit.client.1.smithi142.stdout:6/985: rmdir d1/d7/d5f/d60/db6 39 2024-09-13T02:52:55.021 INFO:tasks.workunit.client.1.smithi142.stdout:6/986: dread - d1/dd/d53/d78/d104/dad/f115 zero size 2024-09-13T02:52:55.021 INFO:tasks.workunit.client.0.smithi098.stdout:4/357: fsync d6/d37/f72 0 2024-09-13T02:52:55.022 INFO:tasks.workunit.client.0.smithi098.stdout:9/489: dwrite d2/d6/d36/f5f [0,4194304] 0 2024-09-13T02:52:55.023 INFO:tasks.workunit.client.1.smithi142.stdout:0/963: truncate d10/d6c/d88/d1a/fff 371852 0 2024-09-13T02:52:55.024 INFO:tasks.workunit.client.0.smithi098.stdout:9/490: truncate d2/d6/d36/f9f 413690 0 2024-09-13T02:52:55.025 INFO:tasks.workunit.client.1.smithi142.stdout:2/840: dread - d1/de/d1f/d13/fb9 zero size 2024-09-13T02:52:55.026 INFO:tasks.workunit.client.1.smithi142.stdout:2/841: read - d1/de/d1f/d13/d59/de6/f100 zero size 2024-09-13T02:52:55.027 INFO:tasks.workunit.client.0.smithi098.stdout:6/431: creat d5/d13/d2b/d3a/d41/f95 x:0 0 0 2024-09-13T02:52:55.029 INFO:tasks.workunit.client.1.smithi142.stdout:5/955: chown d8/dc3/df3/dc6/fe1 25 1 2024-09-13T02:52:55.031 INFO:tasks.workunit.client.1.smithi142.stdout:5/956: write d8/d47/d65/da0/dd1/d2d/d90/f124 [300974,54012] 0 2024-09-13T02:52:55.032 INFO:tasks.workunit.client.0.smithi098.stdout:8/436: rename d2/l10 to d2/d2f/d78/d46/d74/l8a 0 2024-09-13T02:52:55.036 INFO:tasks.workunit.client.0.smithi098.stdout:6/432: dwrite d5/d13/d2b/d3a/d41/d7e/f7d [0,4194304] 0 2024-09-13T02:52:55.036 INFO:tasks.workunit.client.0.smithi098.stdout:3/459: mkdir d7/d9/d15/d2d/d78/d7e/d8e 0 2024-09-13T02:52:55.038 INFO:tasks.workunit.client.0.smithi098.stdout:6/433: chown d5/d13/d2b/d3a/d41/d55 0 1 2024-09-13T02:52:55.038 INFO:tasks.workunit.client.0.smithi098.stdout:3/460: write d7/d9/d15/d2d/f6b [950097,111978] 0 2024-09-13T02:52:55.043 INFO:tasks.workunit.client.1.smithi142.stdout:3/880: rename d12/d16/d25/d2e/d38/d4d/d53/faa to d12/d16/d25/d2e/f118 0 2024-09-13T02:52:55.045 INFO:tasks.workunit.client.1.smithi142.stdout:7/979: chown d10/d13/d22/lc6 226 1 2024-09-13T02:52:55.050 INFO:tasks.workunit.client.0.smithi098.stdout:2/392: rename d1/d1f/d27/d64 to d1/d1a/d4f/d7f 0 2024-09-13T02:52:55.051 INFO:tasks.workunit.client.0.smithi098.stdout:8/437: symlink d2/d2f/d78/l8b 0 2024-09-13T02:52:55.051 INFO:tasks.workunit.client.1.smithi142.stdout:9/997: dwrite dd/d17/d69/d84/d41/f59 [0,4194304] 0 2024-09-13T02:52:55.052 INFO:tasks.workunit.client.1.smithi142.stdout:0/964: creat d10/d6c/d88/d21/f142 x:0 0 0 2024-09-13T02:52:55.058 INFO:tasks.workunit.client.0.smithi098.stdout:3/461: rmdir d7/d9/d15/d26 39 2024-09-13T02:52:55.060 INFO:tasks.workunit.client.1.smithi142.stdout:2/842: mkdir d1/de/da6/d10c 0 2024-09-13T02:52:55.060 INFO:tasks.workunit.client.0.smithi098.stdout:3/462: write d7/d9/d25/d3a/d52/f55 [4893461,26416] 0 2024-09-13T02:52:55.062 INFO:tasks.workunit.client.0.smithi098.stdout:4/358: symlink d6/d22/d3d/d41/l7e 0 2024-09-13T02:52:55.064 INFO:tasks.workunit.client.0.smithi098.stdout:9/491: symlink d2/d6/d91/lb0 0 2024-09-13T02:52:55.066 INFO:tasks.workunit.client.1.smithi142.stdout:1/943: mknod d12/d13/d20/d66/d55/db4/c12e 0 2024-09-13T02:52:55.066 INFO:tasks.workunit.client.0.smithi098.stdout:3/463: dwrite d7/d9/d15/d2d/d34/f61 [0,4194304] 0 2024-09-13T02:52:55.069 INFO:tasks.workunit.client.0.smithi098.stdout:2/393: mknod d1/d1f/d36/c80 0 2024-09-13T02:52:55.071 INFO:tasks.workunit.client.1.smithi142.stdout:1/944: read d12/d13/d45/f7c [3014666,60480] 0 2024-09-13T02:52:55.073 INFO:tasks.workunit.client.1.smithi142.stdout:8/814: rename d0/d6/dc/d40/d103/d8c/dc9/fbf to d0/d6/dc/d40/d41/de2/f106 0 2024-09-13T02:52:55.076 INFO:tasks.workunit.client.1.smithi142.stdout:3/881: symlink d12/dd3/db6/l119 0 2024-09-13T02:52:55.077 INFO:tasks.workunit.client.1.smithi142.stdout:7/980: mkdir d10/d13/d1d/d2b/dae/d9c/d142 0 2024-09-13T02:52:55.079 INFO:tasks.workunit.client.0.smithi098.stdout:4/359: fsync d6/d22/d3d/d4d/f5f 0 2024-09-13T02:52:55.083 INFO:tasks.workunit.client.1.smithi142.stdout:6/987: truncate d1/d7/d5f/d6a/f99 1089556 0 2024-09-13T02:52:55.087 INFO:tasks.workunit.client.0.smithi098.stdout:3/464: creat d7/d9/d25/d64/f8f x:0 0 0 2024-09-13T02:52:55.088 INFO:tasks.workunit.client.0.smithi098.stdout:3/465: fdatasync d7/d9/d25/d3a/d52/f3b 0 2024-09-13T02:52:55.088 INFO:tasks.workunit.client.1.smithi142.stdout:9/998: read dd/d148/fbe [1472155,29392] 0 2024-09-13T02:52:55.089 INFO:tasks.workunit.client.0.smithi098.stdout:8/438: creat d2/d2f/d78/d46/d47/d6e/f8c x:0 0 0 2024-09-13T02:52:55.090 INFO:tasks.workunit.client.0.smithi098.stdout:8/439: fdatasync d2/f60 0 2024-09-13T02:52:55.092 INFO:tasks.workunit.client.0.smithi098.stdout:2/394: creat d1/d1f/d35/d63/d23/f81 x:0 0 0 2024-09-13T02:52:55.093 INFO:tasks.workunit.client.0.smithi098.stdout:9/492: write d2/d6/d2b/d4d/d4f/d6c/f85 [4240637,127160] 0 2024-09-13T02:52:55.093 INFO:tasks.workunit.client.0.smithi098.stdout:2/395: chown d1/d1f/d36 0 1 2024-09-13T02:52:55.094 INFO:tasks.workunit.client.1.smithi142.stdout:2/843: mkdir d1/de/d1f/d13/d60/da9/d10d 0 2024-09-13T02:52:55.096 INFO:tasks.workunit.client.0.smithi098.stdout:6/434: write d5/f31 [1787282,57191] 0 2024-09-13T02:52:55.099 INFO:tasks.workunit.client.0.smithi098.stdout:4/360: mkdir d6/d22/d3d/d7f 0 2024-09-13T02:52:55.100 INFO:tasks.workunit.client.1.smithi142.stdout:1/945: chown d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/c93 181100 1 2024-09-13T02:52:55.102 INFO:tasks.workunit.client.1.smithi142.stdout:8/815: creat d0/d6/dc/d45/d35/d93/f107 x:0 0 0 2024-09-13T02:52:55.103 INFO:tasks.workunit.client.1.smithi142.stdout:5/957: truncate d8/d47/d65/da0/dd1/d45/f79 2137910 0 2024-09-13T02:52:55.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/816: chown d0/d6/dc/d40/d103/d8c 215 1 2024-09-13T02:52:55.104 INFO:tasks.workunit.client.1.smithi142.stdout:0/965: dwrite d10/d6c/d88/d1a/d1e/d42/fa1 [0,4194304] 0 2024-09-13T02:52:55.106 INFO:tasks.workunit.client.0.smithi098.stdout:4/361: dwrite d6/d10/d21/f65 [0,4194304] 0 2024-09-13T02:52:55.106 INFO:tasks.workunit.client.1.smithi142.stdout:7/981: creat d10/d13/d1d/d44/f143 x:0 0 0 2024-09-13T02:52:55.106 INFO:tasks.workunit.client.1.smithi142.stdout:0/966: read d10/d6c/d88/d1a/f66 [776563,26114] 0 2024-09-13T02:52:55.108 INFO:tasks.workunit.client.1.smithi142.stdout:4/903: getdents d0/df 0 2024-09-13T02:52:55.110 INFO:tasks.workunit.client.1.smithi142.stdout:6/988: fdatasync d1/dd/d16/d4e/d32/f40 0 2024-09-13T02:52:55.111 INFO:tasks.workunit.client.1.smithi142.stdout:9/999: creat dd/d98/d126/db9/f168 x:0 0 0 2024-09-13T02:52:55.112 INFO:tasks.workunit.client.0.smithi098.stdout:6/435: write d5/d13/d67/f6a [3325518,33946] 0 2024-09-13T02:52:55.114 INFO:tasks.workunit.client.1.smithi142.stdout:2/844: creat d1/d42/d44/f10e x:0 0 0 2024-09-13T02:52:55.122 INFO:tasks.workunit.client.0.smithi098.stdout:7/600: rename d6/d24/d2a/d5a/d42/fbc to d6/d24/d2a/d5a/d42/d45/fc0 0 2024-09-13T02:52:55.123 INFO:tasks.workunit.client.0.smithi098.stdout:8/440: write d2/d2f/d78/f4f [3227758,82105] 0 2024-09-13T02:52:55.124 INFO:tasks.workunit.client.0.smithi098.stdout:8/441: write d2/dd/f21 [286969,33806] 0 2024-09-13T02:52:55.124 INFO:tasks.workunit.client.0.smithi098.stdout:3/466: mkdir d7/d9/d15/d2d/d5b/d70/d90 0 2024-09-13T02:52:55.125 INFO:tasks.workunit.client.0.smithi098.stdout:3/467: stat d7/d9/d15/d2d/d5b/c54 0 2024-09-13T02:52:55.127 INFO:tasks.workunit.client.0.smithi098.stdout:4/362: creat d6/d10/f80 x:0 0 0 2024-09-13T02:52:55.130 INFO:tasks.workunit.client.0.smithi098.stdout:9/493: mkdir d2/db1 0 2024-09-13T02:52:55.133 INFO:tasks.workunit.client.0.smithi098.stdout:2/396: mknod d1/d1a/c82 0 2024-09-13T02:52:55.134 INFO:tasks.workunit.client.0.smithi098.stdout:2/397: write d1/d1f/d30/f3e [554617,115550] 0 2024-09-13T02:52:55.136 INFO:tasks.workunit.client.1.smithi142.stdout:0/967: mkdir d10/d6c/d88/d21/d8f/de1/d143 0 2024-09-13T02:52:55.141 INFO:tasks.workunit.client.0.smithi098.stdout:3/468: fsync d7/d9/d4c/f81 0 2024-09-13T02:52:55.142 INFO:tasks.workunit.client.1.smithi142.stdout:2/845: creat d1/d42/d44/f10f x:0 0 0 2024-09-13T02:52:55.143 INFO:tasks.workunit.client.0.smithi098.stdout:4/363: symlink d6/db/l81 0 2024-09-13T02:52:55.145 INFO:tasks.workunit.client.0.smithi098.stdout:6/436: write d5/d13/f28 [462025,89235] 0 2024-09-13T02:52:55.145 INFO:tasks.workunit.client.1.smithi142.stdout:1/946: creat d12/d13/d20/d66/d7d/df5/d26/d4f/d102/f12f x:0 0 0 2024-09-13T02:52:55.145 INFO:tasks.workunit.client.0.smithi098.stdout:6/437: chown d5/d13/f28 3974183 1 2024-09-13T02:52:55.146 INFO:tasks.workunit.client.0.smithi098.stdout:9/494: creat d2/d6/d2b/d66/fb2 x:0 0 0 2024-09-13T02:52:55.146 INFO:tasks.workunit.client.1.smithi142.stdout:1/947: chown d12/d13/d20/c84 246650191 1 2024-09-13T02:52:55.147 INFO:tasks.workunit.client.1.smithi142.stdout:3/882: creat d12/d16/d25/d2e/d38/d4d/f11a x:0 0 0 2024-09-13T02:52:55.148 INFO:tasks.workunit.client.1.smithi142.stdout:7/982: dwrite d10/d13/d1d/d2b/d56/fe2 [0,4194304] 0 2024-09-13T02:52:55.149 INFO:tasks.workunit.client.1.smithi142.stdout:5/958: truncate d8/dc3/d3f/ddd/d125/f9c 926551 0 2024-09-13T02:52:55.150 INFO:tasks.workunit.client.1.smithi142.stdout:5/959: chown d8/d47/d65/da0/dd1/d45/d81/l126 6937 1 2024-09-13T02:52:55.152 INFO:tasks.workunit.client.1.smithi142.stdout:5/960: chown d8/d47/d65/da0/fbe 2 1 2024-09-13T02:52:55.153 INFO:tasks.workunit.client.1.smithi142.stdout:5/961: write d8/d47/d65/da0/dd1/d2d/d90/f6f [2588425,12798] 0 2024-09-13T02:52:55.154 INFO:tasks.workunit.client.1.smithi142.stdout:0/968: mkdir d10/d6c/d88/d45/ded/d113/d144 0 2024-09-13T02:52:55.156 INFO:tasks.workunit.client.0.smithi098.stdout:4/364: unlink d6/d3e/d46/l70 0 2024-09-13T02:52:55.157 INFO:tasks.workunit.client.0.smithi098.stdout:2/398: dread d1/d1f/d30/f3e [0,4194304] 0 2024-09-13T02:52:55.157 INFO:tasks.workunit.client.1.smithi142.stdout:4/904: mkdir d0/df/d57/d124 0 2024-09-13T02:52:55.162 INFO:tasks.workunit.client.0.smithi098.stdout:6/438: dread d5/fb [0,4194304] 0 2024-09-13T02:52:55.165 INFO:tasks.workunit.client.1.smithi142.stdout:2/846: rename d1/de/d1f/d13/c1b to d1/de/d1f/d13/d60/da9/d10d/c110 0 2024-09-13T02:52:55.166 INFO:tasks.workunit.client.1.smithi142.stdout:3/883: mkdir d12/d11b 0 2024-09-13T02:52:55.167 INFO:tasks.workunit.client.1.smithi142.stdout:8/817: write d0/d6/ff2 [469248,12505] 0 2024-09-13T02:52:55.168 INFO:tasks.workunit.client.0.smithi098.stdout:3/469: mknod d7/d9/d15/d26/c91 0 2024-09-13T02:52:55.168 INFO:tasks.workunit.client.1.smithi142.stdout:8/818: dread - d0/d6/dc/d45/d35/d61/d77/fff zero size 2024-09-13T02:52:55.170 INFO:tasks.workunit.client.1.smithi142.stdout:7/983: creat d10/d13/d1d/d2b/d56/d5f/da2/f144 x:0 0 0 2024-09-13T02:52:55.172 INFO:tasks.workunit.client.1.smithi142.stdout:5/962: mknod d8/d47/d65/da0/dd1/d45/d62/c13d 0 2024-09-13T02:52:55.173 INFO:tasks.workunit.client.1.smithi142.stdout:7/984: dread d10/d13/d1d/d2b/d40/f8b [0,4194304] 0 2024-09-13T02:52:55.173 INFO:tasks.workunit.client.1.smithi142.stdout:3/884: dwrite d12/d16/d3c/f62 [0,4194304] 0 2024-09-13T02:52:55.174 INFO:tasks.workunit.client.1.smithi142.stdout:8/819: dread d0/d6/d83/daa/fcb [0,4194304] 0 2024-09-13T02:52:55.175 INFO:tasks.workunit.client.1.smithi142.stdout:7/985: write d10/d64/f82 [3592253,75693] 0 2024-09-13T02:52:55.175 INFO:tasks.workunit.client.0.smithi098.stdout:7/601: dwrite d6/d47/f90 [0,4194304] 0 2024-09-13T02:52:55.175 INFO:tasks.workunit.client.1.smithi142.stdout:4/905: creat d0/df/da5/dad/f125 x:0 0 0 2024-09-13T02:52:55.178 INFO:tasks.workunit.client.1.smithi142.stdout:6/989: link d1/dd/f35 d1/d7/d19/d30/f14a 0 2024-09-13T02:52:55.179 INFO:tasks.workunit.client.0.smithi098.stdout:8/442: getdents d2 0 2024-09-13T02:52:55.182 INFO:tasks.workunit.client.0.smithi098.stdout:8/443: dread d2/dd/d11/d49/f85 [0,4194304] 0 2024-09-13T02:52:55.184 INFO:tasks.workunit.client.1.smithi142.stdout:6/990: dread d1/d7/f6d [0,4194304] 0 2024-09-13T02:52:55.186 INFO:tasks.workunit.client.0.smithi098.stdout:4/365: mkdir d6/d22/d3d/d6c/d82 0 2024-09-13T02:52:55.192 INFO:tasks.workunit.client.0.smithi098.stdout:3/470: dread d7/d9/d15/d26/f84 [0,4194304] 0 2024-09-13T02:52:55.193 INFO:tasks.workunit.client.1.smithi142.stdout:0/969: write d10/d6c/d88/d21/d51/f54 [1158198,86170] 0 2024-09-13T02:52:55.196 INFO:tasks.workunit.client.0.smithi098.stdout:2/399: dwrite d1/d1f/d39/f29 [4194304,4194304] 0 2024-09-13T02:52:55.197 INFO:tasks.workunit.client.1.smithi142.stdout:5/963: mkdir d8/d47/d13e 0 2024-09-13T02:52:55.198 INFO:tasks.workunit.client.1.smithi142.stdout:3/885: creat d12/dd3/db6/f11c x:0 0 0 2024-09-13T02:52:55.199 INFO:tasks.workunit.client.1.smithi142.stdout:3/886: write d12/d16/d25/d2e/d38/d4d/d53/da0/f116 [851070,113699] 0 2024-09-13T02:52:55.201 INFO:tasks.workunit.client.1.smithi142.stdout:7/986: readlink d10/d13/d1d/d2b/d55/l33 0 2024-09-13T02:52:55.201 INFO:tasks.workunit.client.1.smithi142.stdout:7/987: chown d10/f42 222 1 2024-09-13T02:52:55.202 INFO:tasks.workunit.client.1.smithi142.stdout:4/906: fdatasync d0/d2b/d2d/d65/f6e 0 2024-09-13T02:52:55.203 INFO:tasks.workunit.client.1.smithi142.stdout:4/907: chown d0/d2b/d21/d35/c102 20642 1 2024-09-13T02:52:55.205 INFO:tasks.workunit.client.1.smithi142.stdout:2/847: symlink d1/de/da6/d10c/l111 0 2024-09-13T02:52:55.208 INFO:tasks.workunit.client.1.smithi142.stdout:0/970: mkdir d10/d6c/d13a/d145 0 2024-09-13T02:52:55.209 INFO:tasks.workunit.client.0.smithi098.stdout:6/439: symlink d5/d13/d2b/d3a/d14/d94/l96 0 2024-09-13T02:52:55.211 INFO:tasks.workunit.client.1.smithi142.stdout:5/964: unlink d8/d47/d65/da0/dd1/d45/d81/d8c/d8d/l9b 0 2024-09-13T02:52:55.211 INFO:tasks.workunit.client.1.smithi142.stdout:8/820: mknod d0/d6/d83/d104/c108 0 2024-09-13T02:52:55.212 INFO:tasks.workunit.client.1.smithi142.stdout:5/965: chown d8/d47/d65/da0/dd1/d63/fc9 44670 1 2024-09-13T02:52:55.212 INFO:tasks.workunit.client.0.smithi098.stdout:7/602: creat d6/d24/d63/fc1 x:0 0 0 2024-09-13T02:52:55.213 INFO:tasks.workunit.client.1.smithi142.stdout:3/887: truncate d12/d16/d25/d2e/d38/d4d/d53/da0/fca 689030 0 2024-09-13T02:52:55.214 INFO:tasks.workunit.client.1.smithi142.stdout:7/988: rmdir d10/d13/d1d/d25/d5c/dbd 39 2024-09-13T02:52:55.215 INFO:tasks.workunit.client.1.smithi142.stdout:8/821: read d0/d6/dc/fee [3958856,71186] 0 2024-09-13T02:52:55.215 INFO:tasks.workunit.client.0.smithi098.stdout:8/444: mknod d2/d2f/d78/d46/d47/c8d 0 2024-09-13T02:52:55.216 INFO:tasks.workunit.client.1.smithi142.stdout:6/991: mkdir d1/dd/d53/d78/d104/dad/d14b 0 2024-09-13T02:52:55.217 INFO:tasks.workunit.client.0.smithi098.stdout:4/366: unlink d6/d3e/d46/f66 0 2024-09-13T02:52:55.219 INFO:tasks.workunit.client.1.smithi142.stdout:4/908: symlink d0/d2b/d2d/d11f/dcf/de6/l126 0 2024-09-13T02:52:55.219 INFO:tasks.workunit.client.1.smithi142.stdout:2/848: dread - d1/de/d31/d6c/d6d/fa5 zero size 2024-09-13T02:52:55.221 INFO:tasks.workunit.client.1.smithi142.stdout:1/948: link d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/fdc d12/f130 0 2024-09-13T02:52:55.222 INFO:tasks.workunit.client.1.smithi142.stdout:0/971: truncate d10/d6c/d88/d21/f91 179391 0 2024-09-13T02:52:55.223 INFO:tasks.workunit.client.0.smithi098.stdout:9/495: getdents d2/d6/d36/d8d 0 2024-09-13T02:52:55.224 INFO:tasks.workunit.client.0.smithi098.stdout:9/496: dread - d2/d6/d36/d8d/d39/f62 zero size 2024-09-13T02:52:55.225 INFO:tasks.workunit.client.0.smithi098.stdout:6/440: mkdir d5/d13/d2b/d3a/d14/d94/d97 0 2024-09-13T02:52:55.226 INFO:tasks.workunit.client.0.smithi098.stdout:9/497: write d2/d6/d36/d8d/d39/d43/d90/da0/faa [696404,52934] 0 2024-09-13T02:52:55.227 INFO:tasks.workunit.client.1.smithi142.stdout:5/966: dread - d8/dc3/d64/d68/f138 zero size 2024-09-13T02:52:55.228 INFO:tasks.workunit.client.1.smithi142.stdout:5/967: stat d8/d47/d65/da0/dd1/d45/d81/d82/d12b 0 2024-09-13T02:52:55.229 INFO:tasks.workunit.client.1.smithi142.stdout:7/989: stat d10/d13/d1d/d2b/d40/f13c 0 2024-09-13T02:52:55.231 INFO:tasks.workunit.client.1.smithi142.stdout:8/822: mknod d0/d6/dc/d45/c109 0 2024-09-13T02:52:55.231 INFO:tasks.workunit.client.1.smithi142.stdout:8/823: stat d0/d6/dc/d45/l7c 0 2024-09-13T02:52:55.232 INFO:tasks.workunit.client.0.smithi098.stdout:3/471: rename d7/d9/c57 to d7/d9/d15/d2d/d78/d7e/c92 0 2024-09-13T02:52:55.236 INFO:tasks.workunit.client.1.smithi142.stdout:4/909: mkdir d0/d2b/d2d/d31/d127 0 2024-09-13T02:52:55.237 INFO:tasks.workunit.client.0.smithi098.stdout:6/441: mknod d5/d13/d2b/c98 0 2024-09-13T02:52:55.238 INFO:tasks.workunit.client.0.smithi098.stdout:6/442: readlink d5/d13/d2b/d3a/l2c 0 2024-09-13T02:52:55.239 INFO:tasks.workunit.client.0.smithi098.stdout:7/603: mkdir d6/d24/d2a/d5a/d86/db1/dc2 0 2024-09-13T02:52:55.242 INFO:tasks.workunit.client.0.smithi098.stdout:9/498: creat d2/d6/d36/d8d/d39/d43/d90/da0/fb3 x:0 0 0 2024-09-13T02:52:55.244 INFO:tasks.workunit.client.1.smithi142.stdout:0/972: rename d10/d6c/d88/d30/cb1 to d10/d6c/d88/d1a/d62/c146 0 2024-09-13T02:52:55.245 INFO:tasks.workunit.client.0.smithi098.stdout:3/472: rmdir d7/d9/d25/d3a/d5f 39 2024-09-13T02:52:55.246 INFO:tasks.workunit.client.0.smithi098.stdout:4/367: dread d6/d22/f28 [0,4194304] 0 2024-09-13T02:52:55.246 INFO:tasks.workunit.client.0.smithi098.stdout:3/473: stat d7/d9/d15/d2d/d5b/d70 0 2024-09-13T02:52:55.247 INFO:tasks.workunit.client.0.smithi098.stdout:3/474: write d7/fc [8478566,43596] 0 2024-09-13T02:52:55.248 INFO:tasks.workunit.client.1.smithi142.stdout:3/888: mknod d12/d16/d25/d2e/d48/d5c/d8c/c11d 0 2024-09-13T02:52:55.250 INFO:tasks.workunit.client.1.smithi142.stdout:5/968: mknod d8/dc3/df3/dc6/c13f 0 2024-09-13T02:52:55.254 INFO:tasks.workunit.client.0.smithi098.stdout:9/499: mknod d2/d6/d36/cb4 0 2024-09-13T02:52:55.254 INFO:tasks.workunit.client.0.smithi098.stdout:3/475: dwrite d7/fc [0,4194304] 0 2024-09-13T02:52:55.254 INFO:tasks.workunit.client.0.smithi098.stdout:7/604: dread d6/d1e/f70 [0,4194304] 0 2024-09-13T02:52:55.255 INFO:tasks.workunit.client.1.smithi142.stdout:5/969: dread d8/d47/f4f [0,4194304] 0 2024-09-13T02:52:55.256 INFO:tasks.workunit.client.1.smithi142.stdout:8/824: unlink d0/d6/dc/d40/d103/l8e 0 2024-09-13T02:52:55.258 INFO:tasks.workunit.client.0.smithi098.stdout:4/368: mkdir d6/d37/d83 0 2024-09-13T02:52:55.262 INFO:tasks.workunit.client.0.smithi098.stdout:7/605: dread d6/f15 [0,4194304] 0 2024-09-13T02:52:55.263 INFO:tasks.workunit.client.0.smithi098.stdout:2/400: getdents d1/d1f 0 2024-09-13T02:52:55.263 INFO:tasks.workunit.client.1.smithi142.stdout:2/849: write d1/de/d31/f3d [6704117,20210] 0 2024-09-13T02:52:55.264 INFO:tasks.workunit.client.1.smithi142.stdout:1/949: write d12/d13/d20/d66/d7d/df5/d26/d4f/fe3 [693315,29152] 0 2024-09-13T02:52:55.268 INFO:tasks.workunit.client.0.smithi098.stdout:2/401: creat d1/d1f/d35/f83 x:0 0 0 2024-09-13T02:52:55.270 INFO:tasks.workunit.client.1.smithi142.stdout:5/970: symlink d8/d47/df1/l140 0 2024-09-13T02:52:55.272 INFO:tasks.workunit.client.0.smithi098.stdout:3/476: rename d7/d9/d25/d3a/c77 to d7/d9/d15/d2d/d78/d7e/c93 0 2024-09-13T02:52:55.273 INFO:tasks.workunit.client.1.smithi142.stdout:3/889: dread d12/d16/d25/d2e/f49 [0,4194304] 0 2024-09-13T02:52:55.273 INFO:tasks.workunit.client.0.smithi098.stdout:9/500: link d2/d6/d2b/f5c d2/d6/d36/d8d/d39/dac/fb5 0 2024-09-13T02:52:55.274 INFO:tasks.workunit.client.1.smithi142.stdout:5/971: dread d8/fde [0,4194304] 0 2024-09-13T02:52:55.274 INFO:tasks.workunit.client.1.smithi142.stdout:4/910: symlink d0/d2b/d2d/d31/d32/d100/l128 0 2024-09-13T02:52:55.275 INFO:tasks.workunit.client.1.smithi142.stdout:5/972: readlink d8/d47/d65/da0/dd1/d2d/l35 0 2024-09-13T02:52:55.275 INFO:tasks.workunit.client.1.smithi142.stdout:0/973: mknod d10/d6c/d88/d1a/d1e/d42/d4b/c147 0 2024-09-13T02:52:55.276 INFO:tasks.workunit.client.0.smithi098.stdout:7/606: mkdir d6/d24/d2a/d5a/d8e/dbd/dc3 0 2024-09-13T02:52:55.277 INFO:tasks.workunit.client.1.smithi142.stdout:1/950: truncate d12/d13/d20/d66/d7d/df5/f6c 4928498 0 2024-09-13T02:52:55.277 INFO:tasks.workunit.client.1.smithi142.stdout:0/974: dread d10/d6c/d88/d1a/d7a/f130 [0,4194304] 0 2024-09-13T02:52:55.282 INFO:tasks.workunit.client.0.smithi098.stdout:3/477: dwrite d7/d9/d25/d3a/d5f/f60 [0,4194304] 0 2024-09-13T02:52:55.313 INFO:tasks.workunit.client.0.smithi098.stdout:9/501: unlink d2/d6/d36/d8d/d39/d43/l48 0 2024-09-13T02:52:55.314 INFO:tasks.workunit.client.1.smithi142.stdout:6/992: getdents d1/d7/d5f/d60/d76/d7e 0 2024-09-13T02:52:55.315 INFO:tasks.workunit.client.0.smithi098.stdout:4/369: link d6/db/c4e d6/d3e/d46/c84 0 2024-09-13T02:52:55.316 INFO:tasks.workunit.client.0.smithi098.stdout:7/607: truncate d6/d24/d2a/d5a/d4c/f60 870416 0 2024-09-13T02:52:55.318 INFO:tasks.workunit.client.1.smithi142.stdout:4/911: chown d0/led 118173283 1 2024-09-13T02:52:55.318 INFO:tasks.workunit.client.1.smithi142.stdout:4/912: chown d0/d2b/d2d/d31/d43/d48/dcc 592690 1 2024-09-13T02:52:55.321 INFO:tasks.workunit.client.0.smithi098.stdout:3/478: fdatasync d7/d9/d25/d3a/f44 0 2024-09-13T02:52:55.322 INFO:tasks.workunit.client.1.smithi142.stdout:7/990: getdents d10/d34/d57 0 2024-09-13T02:52:55.324 INFO:tasks.workunit.client.0.smithi098.stdout:9/502: mkdir d2/d6/d36/d8d/d39/d43/d90/da2/db6 0 2024-09-13T02:52:55.328 INFO:tasks.workunit.client.0.smithi098.stdout:7/608: creat d6/d24/d46/fc4 x:0 0 0 2024-09-13T02:52:55.329 INFO:tasks.workunit.client.1.smithi142.stdout:0/975: creat d10/d6c/d88/d21/d51/d35/d9b/da5/d126/f148 x:0 0 0 2024-09-13T02:52:55.330 INFO:tasks.workunit.client.0.smithi098.stdout:2/402: write d1/d1f/d35/d63/d23/f28 [1980604,77746] 0 2024-09-13T02:52:55.333 INFO:tasks.workunit.client.0.smithi098.stdout:9/503: chown d2/d6/f1d 196721 1 2024-09-13T02:52:55.335 INFO:tasks.workunit.client.0.smithi098.stdout:9/504: dread - d2/d6/d2b/d66/f78 zero size 2024-09-13T02:52:55.337 INFO:tasks.workunit.client.0.smithi098.stdout:3/479: dwrite d7/f8c [0,4194304] 0 2024-09-13T02:52:55.337 INFO:tasks.workunit.client.0.smithi098.stdout:9/505: chown d2/d6/d36/d8d/d39/l41 3 1 2024-09-13T02:52:55.341 INFO:tasks.workunit.client.0.smithi098.stdout:2/403: symlink d1/d1f/d35/d63/d23/l84 0 2024-09-13T02:52:55.343 INFO:tasks.workunit.client.0.smithi098.stdout:4/370: link d6/l14 d6/d22/d3d/d4d/l85 0 2024-09-13T02:52:55.348 INFO:tasks.workunit.client.0.smithi098.stdout:9/506: symlink d2/d6/d36/d8d/d39/d43/d90/da2/lb7 0 2024-09-13T02:52:55.350 INFO:tasks.workunit.client.0.smithi098.stdout:2/404: rmdir d1/d1f/d36 39 2024-09-13T02:52:55.351 INFO:tasks.workunit.client.0.smithi098.stdout:7/609: write d6/d1e/f70 [857154,103869] 0 2024-09-13T02:52:55.355 INFO:tasks.workunit.client.0.smithi098.stdout:2/405: creat d1/d1a/d4f/d7f/f85 x:0 0 0 2024-09-13T02:52:55.361 INFO:tasks.workunit.client.0.smithi098.stdout:3/480: write d7/d9/d15/f49 [890884,31346] 0 2024-09-13T02:52:55.363 INFO:tasks.workunit.client.0.smithi098.stdout:7/610: mkdir d6/d24/dc5 0 2024-09-13T02:52:55.365 INFO:tasks.workunit.client.0.smithi098.stdout:4/371: rmdir d6/d22/d3d/d7f 0 2024-09-13T02:52:55.365 INFO:tasks.workunit.client.0.smithi098.stdout:4/372: chown d6/l77 6836239 1 2024-09-13T02:52:55.366 INFO:tasks.workunit.client.0.smithi098.stdout:4/373: chown d6/d3e/d68/f38 92033 1 2024-09-13T02:52:55.368 INFO:tasks.workunit.client.0.smithi098.stdout:9/507: rename d2/l7a to d2/d6/lb8 0 2024-09-13T02:52:55.370 INFO:tasks.workunit.client.0.smithi098.stdout:7/611: truncate d6/d24/d2a/d5a/d4c/f6a 1931987 0 2024-09-13T02:52:55.375 INFO:tasks.workunit.client.0.smithi098.stdout:7/612: dwrite d6/d1e/f1f [0,4194304] 0 2024-09-13T02:52:55.378 INFO:tasks.workunit.client.0.smithi098.stdout:9/508: mkdir d2/d6/d2b/d4d/d56/db9 0 2024-09-13T02:52:55.381 INFO:tasks.workunit.client.0.smithi098.stdout:7/613: creat d6/d24/d2a/d5a/d4c/fc6 x:0 0 0 2024-09-13T02:52:55.383 INFO:tasks.workunit.client.0.smithi098.stdout:4/374: rmdir d6/d22/d3d/d6c/d82 0 2024-09-13T02:52:55.386 INFO:tasks.workunit.client.0.smithi098.stdout:7/614: chown d6/d24/d2a/d5a/d86/f8d 327023 1 2024-09-13T02:52:55.390 INFO:tasks.workunit.client.0.smithi098.stdout:9/509: unlink d2/d6/d36/cb4 0 2024-09-13T02:52:55.394 INFO:tasks.workunit.client.1.smithi142.stdout:8/825: sync 2024-09-13T02:52:55.394 INFO:tasks.workunit.client.1.smithi142.stdout:2/850: sync 2024-09-13T02:52:55.394 INFO:tasks.workunit.client.0.smithi098.stdout:4/375: fdatasync d6/d10/d21/f3b 0 2024-09-13T02:52:55.395 INFO:tasks.workunit.client.0.smithi098.stdout:9/510: read - d2/d6/f8b zero size 2024-09-13T02:52:55.395 INFO:tasks.workunit.client.1.smithi142.stdout:2/851: write d1/de/d31/d6c/d6d/db6/f4d [1920879,46991] 0 2024-09-13T02:52:55.400 INFO:tasks.workunit.client.0.smithi098.stdout:4/376: getdents d6/d3e/d73 0 2024-09-13T02:52:55.403 INFO:tasks.workunit.client.0.smithi098.stdout:4/377: rmdir d6/d22/d3d/d41/d58 39 2024-09-13T02:52:55.406 INFO:tasks.workunit.client.0.smithi098.stdout:4/378: creat d6/d3e/d46/f86 x:0 0 0 2024-09-13T02:52:55.410 INFO:tasks.workunit.client.0.smithi098.stdout:4/379: symlink d6/d37/l87 0 2024-09-13T02:52:55.413 INFO:tasks.workunit.client.0.smithi098.stdout:4/380: chown d6/d10/d21/l3a 0 1 2024-09-13T02:52:55.415 INFO:tasks.workunit.client.0.smithi098.stdout:4/381: creat d6/d54/f88 x:0 0 0 2024-09-13T02:52:55.419 INFO:tasks.workunit.client.0.smithi098.stdout:4/382: creat d6/d37/d7a/f89 x:0 0 0 2024-09-13T02:52:55.421 INFO:tasks.workunit.client.1.smithi142.stdout:4/913: creat d0/d2b/d2d/d31/f129 x:0 0 0 2024-09-13T02:52:55.422 INFO:tasks.workunit.client.1.smithi142.stdout:7/991: truncate d10/d13/d1d/d25/d45/d6d/dc3/f4e 278378 0 2024-09-13T02:52:55.423 INFO:tasks.workunit.client.1.smithi142.stdout:1/951: mkdir d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d11c/d131 0 2024-09-13T02:52:55.425 INFO:tasks.workunit.client.1.smithi142.stdout:0/976: creat d10/d6c/d88/d21/d51/d35/d9b/da5/f149 x:0 0 0 2024-09-13T02:52:55.426 INFO:tasks.workunit.client.1.smithi142.stdout:8/826: mknod d0/d6/d83/c10a 0 2024-09-13T02:52:55.426 INFO:tasks.workunit.client.0.smithi098.stdout:7/615: write d6/d1e/f23 [3711646,91805] 0 2024-09-13T02:52:55.427 INFO:tasks.workunit.client.1.smithi142.stdout:7/992: dread d10/d13/d1d/d25/d5c/da3/da8/fb0 [0,4194304] 0 2024-09-13T02:52:55.428 INFO:tasks.workunit.client.1.smithi142.stdout:7/993: fdatasync d10/d13/d1d/d2b/dae/f11b 0 2024-09-13T02:52:55.429 INFO:tasks.workunit.client.0.smithi098.stdout:4/383: link d6/c16 d6/c8a 0 2024-09-13T02:52:55.430 INFO:tasks.workunit.client.0.smithi098.stdout:4/384: truncate d6/d3e/d46/f86 160922 0 2024-09-13T02:52:55.431 INFO:tasks.workunit.client.1.smithi142.stdout:0/977: dwrite d10/d6c/d88/f131 [0,4194304] 0 2024-09-13T02:52:55.432 INFO:tasks.workunit.client.1.smithi142.stdout:0/978: read d10/d6c/d88/d1a/d1e/d42/d4b/f114 [2829268,46889] 0 2024-09-13T02:52:55.433 INFO:tasks.workunit.client.1.smithi142.stdout:0/979: chown d10/d6c/d88/d21/d51/d35/cde 416581 1 2024-09-13T02:52:55.435 INFO:tasks.workunit.client.1.smithi142.stdout:5/973: rename d8/dc3/df3/ca7 to d8/d47/d65/da0/dd1/c141 0 2024-09-13T02:52:55.436 INFO:tasks.workunit.client.1.smithi142.stdout:0/980: write d10/d6c/d88/d1a/d7a/d100/f12f [663454,77558] 0 2024-09-13T02:52:55.437 INFO:tasks.workunit.client.1.smithi142.stdout:4/914: creat d0/d2b/d2d/d31/d43/d48/dcc/df9/f12a x:0 0 0 2024-09-13T02:52:55.438 INFO:tasks.workunit.client.0.smithi098.stdout:4/385: symlink d6/l8b 0 2024-09-13T02:52:55.440 INFO:tasks.workunit.client.0.smithi098.stdout:7/616: link d6/d24/d2a/cb2 d6/d24/d2a/cc7 0 2024-09-13T02:52:55.450 INFO:tasks.workunit.client.1.smithi142.stdout:6/993: rmdir d1/d7/d42/d143 0 2024-09-13T02:52:55.452 INFO:tasks.workunit.client.1.smithi142.stdout:3/890: getdents d12/d16/d25/d2e/d38 0 2024-09-13T02:52:55.452 INFO:tasks.workunit.client.0.smithi098.stdout:4/386: link d6/db/c4e d6/d3e/d46/c8c 0 2024-09-13T02:52:55.457 INFO:tasks.workunit.client.1.smithi142.stdout:4/915: dread d0/f4c [0,4194304] 0 2024-09-13T02:52:55.457 INFO:tasks.workunit.client.1.smithi142.stdout:2/852: rename d1/d42/d44/f84 to d1/de/da6/dbb/d92/f112 0 2024-09-13T02:52:55.458 INFO:tasks.workunit.client.1.smithi142.stdout:4/916: chown d0/df/da5/dad/fb2 124 1 2024-09-13T02:52:55.459 INFO:tasks.workunit.client.1.smithi142.stdout:2/853: write d1/fb5 [2001111,105468] 0 2024-09-13T02:52:55.459 INFO:tasks.workunit.client.1.smithi142.stdout:5/974: unlink d8/d47/d65/da0/dd1/d45/d62/la9 0 2024-09-13T02:52:55.460 INFO:tasks.workunit.client.0.smithi098.stdout:4/387: dwrite d6/d54/f88 [0,4194304] 0 2024-09-13T02:52:55.460 INFO:tasks.workunit.client.1.smithi142.stdout:4/917: stat d0/d2b/d2d/d65/l3c 0 2024-09-13T02:52:55.460 INFO:tasks.workunit.client.1.smithi142.stdout:2/854: chown d1/d2d/f64 2 1 2024-09-13T02:52:55.461 INFO:tasks.workunit.client.1.smithi142.stdout:0/981: creat d10/d6c/d88/d30/f14a x:0 0 0 2024-09-13T02:52:55.461 INFO:tasks.workunit.client.1.smithi142.stdout:4/918: truncate d0/d2b/dd8/f11c 964090 0 2024-09-13T02:52:55.462 INFO:tasks.workunit.client.1.smithi142.stdout:0/982: chown d10/d6c/d88/d1a/d62/c9d 919466348 1 2024-09-13T02:52:55.467 INFO:tasks.workunit.client.0.smithi098.stdout:4/388: dwrite d6/d22/d3d/d64/f6d [0,4194304] 0 2024-09-13T02:52:55.477 INFO:tasks.workunit.client.1.smithi142.stdout:6/994: rename d1/d7/d19/f81 to d1/d7/d42/d88/f14c 0 2024-09-13T02:52:55.477 INFO:tasks.workunit.client.1.smithi142.stdout:7/994: write d10/d13/d1d/d2b/dae/fee [250566,22817] 0 2024-09-13T02:52:55.478 INFO:tasks.workunit.client.1.smithi142.stdout:2/855: rmdir d1/de/d1f/d13/d60/da9/d10d 39 2024-09-13T02:52:55.480 INFO:tasks.workunit.client.1.smithi142.stdout:1/952: dwrite d12/d13/d20/d66/d55/db4/fd5 [4194304,4194304] 0 2024-09-13T02:52:55.482 INFO:tasks.workunit.client.1.smithi142.stdout:3/891: creat d12/d16/d25/d2e/d48/d5c/d73/dae/f11e x:0 0 0 2024-09-13T02:52:55.488 INFO:tasks.workunit.client.0.smithi098.stdout:4/389: dread d6/d10/d21/f25 [0,4194304] 0 2024-09-13T02:52:55.538 INFO:tasks.workunit.client.0.smithi098.stdout:4/390: getdents d6/d22/d3d/d64/d6f 0 2024-09-13T02:52:55.538 INFO:tasks.workunit.client.0.smithi098.stdout:4/391: chown d6/d22/d3d/d41 891253058 1 2024-09-13T02:52:55.538 INFO:tasks.workunit.client.0.smithi098.stdout:4/392: mkdir d6/d8d 0 2024-09-13T02:52:55.538 INFO:tasks.workunit.client.0.smithi098.stdout:4/393: chown d6/d22/d3d/f49 17619 1 2024-09-13T02:52:55.539 INFO:tasks.workunit.client.0.smithi098.stdout:7/617: dwrite d6/d24/d2a/d5a/d4c/f6a [0,4194304] 0 2024-09-13T02:52:55.539 INFO:tasks.workunit.client.0.smithi098.stdout:7/618: dread d6/d1e/f23 [0,4194304] 0 2024-09-13T02:52:55.539 INFO:tasks.workunit.client.0.smithi098.stdout:7/619: write d6/d24/d2a/d5a/d4c/fc6 [452347,71427] 0 2024-09-13T02:52:55.539 INFO:tasks.workunit.client.0.smithi098.stdout:4/394: dread d6/d10/d21/f2b [0,4194304] 0 2024-09-13T02:52:55.539 INFO:tasks.workunit.client.0.smithi098.stdout:7/620: creat d6/d24/d2a/d5a/fc8 x:0 0 0 2024-09-13T02:52:55.539 INFO:tasks.workunit.client.0.smithi098.stdout:7/621: write d6/d24/f26 [2528936,49063] 0 2024-09-13T02:52:55.540 INFO:tasks.workunit.client.1.smithi142.stdout:7/995: mkdir d10/d13/d1d/d2b/d145 0 2024-09-13T02:52:55.540 INFO:tasks.workunit.client.1.smithi142.stdout:7/996: chown d10/d13/d21/l10b 0 1 2024-09-13T02:52:55.540 INFO:tasks.workunit.client.1.smithi142.stdout:0/983: dread d10/d6c/d88/d1a/d62/ff7 [0,4194304] 0 2024-09-13T02:52:55.540 INFO:tasks.workunit.client.1.smithi142.stdout:8/827: truncate d0/f6b 1785654 0 2024-09-13T02:52:55.540 INFO:tasks.workunit.client.1.smithi142.stdout:3/892: fsync d12/d16/d25/d2e/d38/d4d/d53/d78/ff3 0 2024-09-13T02:52:55.540 INFO:tasks.workunit.client.1.smithi142.stdout:8/828: symlink d0/da2/dec/l10b 0 2024-09-13T02:52:55.540 INFO:tasks.workunit.client.1.smithi142.stdout:6/995: write d1/d7/f3e [3374533,97685] 0 2024-09-13T02:52:55.540 INFO:tasks.workunit.client.1.smithi142.stdout:2/856: dread d1/de/f17 [0,4194304] 0 2024-09-13T02:52:55.540 INFO:tasks.workunit.client.1.smithi142.stdout:2/857: readlink d1/l109 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:4/919: write d0/d2b/f38 [1208895,78576] 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:0/984: creat d10/d6c/d88/d1a/d7a/f14b x:0 0 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:0/985: readlink d10/d6c/d88/d1a/d62/lcb 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:8/829: rename d0/d6/dc/d40/d103/d8c to d0/d6/dc/d45/d9d/d10c 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:6/996: write d1/d7/d19/d48/d90/f125 [1027861,70390] 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:1/953: getdents d12/d13/d20 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:2/858: fdatasync d1/de/d31/d6c/d6d/d47/f68 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:0/986: readlink d10/d6c/d88/d21/d51/d35/d9b/da5/l11e 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:3/893: dwrite d12/d16/da3/fa9 [0,4194304] 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:2/859: dwrite d1/de/d1f/d9c/ffe [0,4194304] 0 2024-09-13T02:52:55.541 INFO:tasks.workunit.client.1.smithi142.stdout:3/894: stat d12/d16/d25/d2e/d48/d5c/d8c/daf/c10d 0 2024-09-13T02:52:55.542 INFO:tasks.workunit.client.1.smithi142.stdout:0/987: creat d10/d6c/d88/d21/d51/d79/f14c x:0 0 0 2024-09-13T02:52:55.543 INFO:tasks.workunit.client.1.smithi142.stdout:4/920: write d0/d2b/d21/d35/f5f [1304297,112210] 0 2024-09-13T02:52:55.545 INFO:tasks.workunit.client.1.smithi142.stdout:2/860: mkdir d1/de/d31/d6c/d6d/d113 0 2024-09-13T02:52:55.545 INFO:tasks.workunit.client.1.smithi142.stdout:6/997: write d1/dd/d16/d4e/d32/f133 [1571729,23108] 0 2024-09-13T02:52:55.546 INFO:tasks.workunit.client.1.smithi142.stdout:2/861: chown d1/d42/d44/d99 667 1 2024-09-13T02:52:55.548 INFO:tasks.workunit.client.1.smithi142.stdout:3/895: fsync d12/d16/d3c/d79/fab 0 2024-09-13T02:52:55.549 INFO:tasks.workunit.client.0.smithi098.stdout:4/395: mknod d6/d54/d6a/c8e 0 2024-09-13T02:52:55.549 INFO:tasks.workunit.client.1.smithi142.stdout:8/830: write d0/d6/dc/f72 [2632274,44635] 0 2024-09-13T02:52:55.550 INFO:tasks.workunit.client.1.smithi142.stdout:3/896: write d12/d16/d25/f40 [1329460,86617] 0 2024-09-13T02:52:55.550 INFO:tasks.workunit.client.0.smithi098.stdout:4/396: write d6/d3e/d68/f36 [2182493,80746] 0 2024-09-13T02:52:55.551 INFO:tasks.workunit.client.0.smithi098.stdout:7/622: mknod d6/d24/d2a/d5a/cc9 0 2024-09-13T02:52:55.551 INFO:tasks.workunit.client.0.smithi098.stdout:4/397: chown d6/d22/d3d/d41/f42 5916470 1 2024-09-13T02:52:55.553 INFO:tasks.workunit.client.0.smithi098.stdout:7/623: truncate d6/d24/d63/fc1 397734 0 2024-09-13T02:52:55.553 INFO:tasks.workunit.client.1.smithi142.stdout:4/921: creat d0/d2b/d2d/d11f/de8/f12b x:0 0 0 2024-09-13T02:52:55.555 INFO:tasks.workunit.client.1.smithi142.stdout:4/922: write d0/d2b/d2d/d11f/de8/f12b [275818,32765] 0 2024-09-13T02:52:55.555 INFO:tasks.workunit.client.1.smithi142.stdout:6/998: creat d1/dd/d53/f14d x:0 0 0 2024-09-13T02:52:55.557 INFO:tasks.workunit.client.1.smithi142.stdout:6/999: write d1/d7/d19/d48/d90/f125 [441668,81939] 0 2024-09-13T02:52:55.559 INFO:tasks.workunit.client.1.smithi142.stdout:2/862: truncate d1/de/d1f/f63 1167185 0 2024-09-13T02:52:55.560 INFO:tasks.workunit.client.0.smithi098.stdout:4/398: creat d6/d3e/d73/f8f x:0 0 0 2024-09-13T02:52:55.560 INFO:tasks.workunit.client.0.smithi098.stdout:7/624: dwrite d6/d1e/faf [0,4194304] 0 2024-09-13T02:52:55.562 INFO:tasks.workunit.client.0.smithi098.stdout:7/625: chown d6/d24/d2a/d5a/d42/f7f 5576 1 2024-09-13T02:52:55.562 INFO:tasks.workunit.client.1.smithi142.stdout:1/954: getdents d12/d13/d20/d66/d7d/df5/d26 0 2024-09-13T02:52:55.562 INFO:tasks.workunit.client.1.smithi142.stdout:0/988: dread d10/f7c [0,4194304] 0 2024-09-13T02:52:55.564 INFO:tasks.workunit.client.1.smithi142.stdout:8/831: rename d0/d6/dc/d40/d4d/fda to d0/d6/d83/f10d 0 2024-09-13T02:52:55.565 INFO:tasks.workunit.client.1.smithi142.stdout:5/975: sync 2024-09-13T02:52:55.565 INFO:tasks.workunit.client.1.smithi142.stdout:5/976: chown d8/dc3/df3/dc6/de2/d10a 6 1 2024-09-13T02:52:55.567 INFO:tasks.workunit.client.1.smithi142.stdout:5/977: stat d8/d47/d65/da0/dd1/d45/ccf 0 2024-09-13T02:52:55.569 INFO:tasks.workunit.client.0.smithi098.stdout:4/399: symlink d6/d22/d3d/d41/d58/l90 0 2024-09-13T02:52:55.573 INFO:tasks.workunit.client.0.smithi098.stdout:4/400: mkdir d6/d22/d3d/d6c/d91 0 2024-09-13T02:52:55.575 INFO:tasks.workunit.client.1.smithi142.stdout:0/989: read d10/d6c/d88/d21/d51/f3e [4156903,72135] 0 2024-09-13T02:52:55.578 INFO:tasks.workunit.client.0.smithi098.stdout:7/626: rename d6/d24/d2a/d57/f61 to d6/fca 0 2024-09-13T02:52:55.580 INFO:tasks.workunit.client.1.smithi142.stdout:4/923: write d0/d2b/d2d/d31/d43/f5a [3410824,100602] 0 2024-09-13T02:52:55.584 INFO:tasks.workunit.client.1.smithi142.stdout:3/897: creat d12/d16/d3c/d7d/f11f x:0 0 0 2024-09-13T02:52:55.585 INFO:tasks.workunit.client.1.smithi142.stdout:1/955: creat d12/d13/d20/d66/d7d/df5/d26/d4f/d124/f132 x:0 0 0 2024-09-13T02:52:55.586 INFO:tasks.workunit.client.1.smithi142.stdout:3/898: fsync d12/d16/d25/d2e/d48/d5c/d8c/ff2 0 2024-09-13T02:52:55.586 INFO:tasks.workunit.client.0.smithi098.stdout:4/401: getdents d6/d22/d3d/d4d 0 2024-09-13T02:52:55.587 INFO:tasks.workunit.client.1.smithi142.stdout:3/899: chown d12/d16/d3c/d79/d9e/la1 56650944 1 2024-09-13T02:52:55.587 INFO:tasks.workunit.client.1.smithi142.stdout:0/990: fsync d10/d6c/d88/d1a/d62/fd0 0 2024-09-13T02:52:55.588 INFO:tasks.workunit.client.0.smithi098.stdout:7/627: creat d6/d1e/fcb x:0 0 0 2024-09-13T02:52:55.588 INFO:tasks.workunit.client.0.smithi098.stdout:4/402: rmdir d6/db 39 2024-09-13T02:52:55.589 INFO:tasks.workunit.client.1.smithi142.stdout:8/832: dwrite d0/d6/dc/d45/d8/f36 [4194304,4194304] 0 2024-09-13T02:52:55.589 INFO:tasks.workunit.client.0.smithi098.stdout:4/403: chown d6 4 1 2024-09-13T02:52:55.590 INFO:tasks.workunit.client.0.smithi098.stdout:4/404: write d6/d22/d3d/d41/d58/f78 [590465,119033] 0 2024-09-13T02:52:55.592 INFO:tasks.workunit.client.0.smithi098.stdout:7/628: stat d6/d47/la0 0 2024-09-13T02:52:55.595 INFO:tasks.workunit.client.1.smithi142.stdout:1/956: dread d12/d13/d20/f5c [0,4194304] 0 2024-09-13T02:52:55.595 INFO:tasks.workunit.client.1.smithi142.stdout:2/863: write d1/de/d1f/f63 [580171,31199] 0 2024-09-13T02:52:55.597 INFO:tasks.workunit.client.1.smithi142.stdout:2/864: write d1/de/d1f/f101 [606462,59086] 0 2024-09-13T02:52:55.598 INFO:tasks.workunit.client.1.smithi142.stdout:2/865: chown d1/d42/l81 517204 1 2024-09-13T02:52:55.600 INFO:tasks.workunit.client.0.smithi098.stdout:4/405: truncate d6/d10/d21/f32 1919054 0 2024-09-13T02:52:55.603 INFO:tasks.workunit.client.1.smithi142.stdout:4/924: dwrite d0/d2b/f67 [0,4194304] 0 2024-09-13T02:52:55.604 INFO:tasks.workunit.client.0.smithi098.stdout:7/629: rename d6/l3b to d6/d24/d2a/d5a/d42/lcc 0 2024-09-13T02:52:55.605 INFO:tasks.workunit.client.0.smithi098.stdout:4/406: symlink d6/d8d/l92 0 2024-09-13T02:52:55.605 INFO:tasks.workunit.client.1.smithi142.stdout:5/978: dwrite d8/dc3/d3f/ddd/d125/fc8 [0,4194304] 0 2024-09-13T02:52:55.606 INFO:tasks.workunit.client.0.smithi098.stdout:4/407: mknod d6/d37/c93 0 2024-09-13T02:52:55.607 INFO:tasks.workunit.client.1.smithi142.stdout:1/957: chown d12/d13/d20/d66/d7d/df5/l41 176913 1 2024-09-13T02:52:55.608 INFO:tasks.workunit.client.1.smithi142.stdout:1/958: chown d12/d13/d20/d66/d55/c8e 184 1 2024-09-13T02:52:55.609 INFO:tasks.workunit.client.1.smithi142.stdout:0/991: write d10/d95/dcf/f103 [4543728,68455] 0 2024-09-13T02:52:55.611 INFO:tasks.workunit.client.1.smithi142.stdout:1/959: chown d12/d13/d20/d66/d7d/df5/c79 229702719 1 2024-09-13T02:52:55.611 INFO:tasks.workunit.client.1.smithi142.stdout:7/997: sync 2024-09-13T02:52:55.615 INFO:tasks.workunit.client.0.smithi098.stdout:4/408: rename d6/l17 to d6/l94 0 2024-09-13T02:52:55.616 INFO:tasks.workunit.client.1.smithi142.stdout:8/833: mkdir d0/d6/dc/d10e 0 2024-09-13T02:52:55.617 INFO:tasks.workunit.client.1.smithi142.stdout:5/979: mkdir d8/d47/d65/da0/dd1/db6/d142 0 2024-09-13T02:52:55.620 INFO:tasks.workunit.client.1.smithi142.stdout:3/900: creat d12/d16/d25/d2e/d38/d6b/f120 x:0 0 0 2024-09-13T02:52:55.620 INFO:tasks.workunit.client.1.smithi142.stdout:4/925: mknod d0/d2b/d2d/d31/dd4/c12c 0 2024-09-13T02:52:55.621 INFO:tasks.workunit.client.1.smithi142.stdout:3/901: read - d12/d16/d25/d2e/ff4 zero size 2024-09-13T02:52:55.622 INFO:tasks.workunit.client.0.smithi098.stdout:4/409: symlink d6/d10/d21/l95 0 2024-09-13T02:52:55.622 INFO:tasks.workunit.client.1.smithi142.stdout:4/926: chown d0/d2b/d2d/d65/d87/lee 864 1 2024-09-13T02:52:55.623 INFO:tasks.workunit.client.0.smithi098.stdout:7/630: dread d6/d24/d63/fa8 [0,4194304] 0 2024-09-13T02:52:55.623 INFO:tasks.workunit.client.1.smithi142.stdout:1/960: mknod d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/c133 0 2024-09-13T02:52:55.625 INFO:tasks.workunit.client.1.smithi142.stdout:5/980: dwrite d8/d47/d65/da0/dd1/f6a [8388608,4194304] 0 2024-09-13T02:52:55.626 INFO:tasks.workunit.client.1.smithi142.stdout:3/902: chown d12/d16/d25/d2e/d48/d5c/d66/lc2 5185582 1 2024-09-13T02:52:55.627 INFO:tasks.workunit.client.1.smithi142.stdout:5/981: chown d8/d47/d65/da0/dd1/d61/dcb 19 1 2024-09-13T02:52:55.628 INFO:tasks.workunit.client.1.smithi142.stdout:5/982: chown d8/d47/d65/da0/dd1/db6/f116 90 1 2024-09-13T02:52:55.632 INFO:tasks.workunit.client.1.smithi142.stdout:3/903: creat d12/d16/d25/d2e/d48/d5c/f121 x:0 0 0 2024-09-13T02:52:55.633 INFO:tasks.workunit.client.0.smithi098.stdout:7/631: creat d6/d24/d2a/fcd x:0 0 0 2024-09-13T02:52:55.635 INFO:tasks.workunit.client.1.smithi142.stdout:7/998: rename d10/d13/ccf to d10/d13/d22/c146 0 2024-09-13T02:52:55.636 INFO:tasks.workunit.client.0.smithi098.stdout:4/410: rename d6/d22/d3d/d4d/l5e to d6/d10/d21/l96 0 2024-09-13T02:52:55.637 INFO:tasks.workunit.client.1.smithi142.stdout:7/999: fsync d10/d13/d1d/d2b/dae/f11b 0 2024-09-13T02:52:55.638 INFO:tasks.workunit.client.0.smithi098.stdout:7/632: stat d6/d24/d2a/d5a/d4c/f6e 0 2024-09-13T02:52:55.639 INFO:tasks.workunit.client.1.smithi142.stdout:1/961: creat d12/d13/d20/d66/d7d/df5/d12a/f134 x:0 0 0 2024-09-13T02:52:55.639 INFO:tasks.workunit.client.1.smithi142.stdout:2/866: dwrite d1/de/d1f/d13/d60/f7c [0,4194304] 0 2024-09-13T02:52:55.640 INFO:tasks.workunit.client.0.smithi098.stdout:4/411: creat d6/d22/d3d/d41/d58/f97 x:0 0 0 2024-09-13T02:52:55.640 INFO:tasks.workunit.client.1.smithi142.stdout:3/904: truncate fe 4733105 0 2024-09-13T02:52:55.641 INFO:tasks.workunit.client.1.smithi142.stdout:2/867: write d1/d42/d44/f10f [158771,72577] 0 2024-09-13T02:52:55.642 INFO:tasks.workunit.client.1.smithi142.stdout:1/962: read d12/d13/d20/f38 [2172367,29672] 0 2024-09-13T02:52:55.643 INFO:tasks.workunit.client.1.smithi142.stdout:0/992: rename d10/dbf/ld1 to d10/d6c/d88/d45/ded/d113/d144/l14d 0 2024-09-13T02:52:55.644 INFO:tasks.workunit.client.1.smithi142.stdout:1/963: readlink d12/d13/d45/l5f 0 2024-09-13T02:52:55.648 INFO:tasks.workunit.client.1.smithi142.stdout:3/905: readlink d12/d16/d25/d2e/d38/d4d/l81 0 2024-09-13T02:52:55.651 INFO:tasks.workunit.client.1.smithi142.stdout:8/834: rename d0/d6/dc/d40/d41/de2/f106 to d0/d6/dc/d45/d35/d7e/f10f 0 2024-09-13T02:52:55.654 INFO:tasks.workunit.client.1.smithi142.stdout:8/835: symlink d0/d6/dc/d40/d41/l110 0 2024-09-13T02:52:55.656 INFO:tasks.workunit.client.1.smithi142.stdout:4/927: rename d0/d2b/ldc to d0/d2b/d2d/d11f/l12d 0 2024-09-13T02:52:55.658 INFO:tasks.workunit.client.0.smithi098.stdout:7/633: write d6/f19 [597108,30503] 0 2024-09-13T02:52:55.660 INFO:tasks.workunit.client.1.smithi142.stdout:5/983: dwrite d8/dc3/df3/dc6/de2/d10a/f110 [0,4194304] 0 2024-09-13T02:52:55.664 INFO:tasks.workunit.client.0.smithi098.stdout:7/634: mkdir d6/d24/d2a/d57/dce 0 2024-09-13T02:52:55.667 INFO:tasks.workunit.client.0.smithi098.stdout:4/412: dwrite d6/d22/d3d/d4d/f5f [0,4194304] 0 2024-09-13T02:52:55.668 INFO:tasks.workunit.client.0.smithi098.stdout:7/635: chown d6/d1e/l84 14774200 1 2024-09-13T02:52:55.668 INFO:tasks.workunit.client.1.smithi142.stdout:4/928: dwrite d0/f4c [4194304,4194304] 0 2024-09-13T02:52:55.669 INFO:tasks.workunit.client.0.smithi098.stdout:4/413: fsync d6/d10/d21/f65 0 2024-09-13T02:52:55.670 INFO:tasks.workunit.client.1.smithi142.stdout:4/929: stat d0/d2b/d2d/d31/fb7 0 2024-09-13T02:52:55.672 INFO:tasks.workunit.client.0.smithi098.stdout:7/636: mkdir d6/d24/d2a/d5a/d8e/dbd/dc3/dcf 0 2024-09-13T02:52:55.673 INFO:tasks.workunit.client.1.smithi142.stdout:0/993: dread d10/d6c/d88/d1a/d3a/fc9 [0,4194304] 0 2024-09-13T02:52:55.673 INFO:tasks.workunit.client.0.smithi098.stdout:7/637: readlink d6/d24/d2a/d5a/d86/lb5 0 2024-09-13T02:52:55.673 INFO:tasks.workunit.client.0.smithi098.stdout:4/414: mkdir d6/d22/d3d/d41/d74/d98 0 2024-09-13T02:52:55.674 INFO:tasks.workunit.client.0.smithi098.stdout:4/415: dread - d6/d3e/d73/f8f zero size 2024-09-13T02:52:55.676 INFO:tasks.workunit.client.1.smithi142.stdout:3/906: dread d12/d16/f43 [4194304,4194304] 0 2024-09-13T02:52:55.677 INFO:tasks.workunit.client.1.smithi142.stdout:4/930: creat d0/d2b/d2d/d31/d43/daf/f12e x:0 0 0 2024-09-13T02:52:55.679 INFO:tasks.workunit.client.0.smithi098.stdout:7/638: creat d6/d24/d2a/d5a/d42/d80/fd0 x:0 0 0 2024-09-13T02:52:55.680 INFO:tasks.workunit.client.0.smithi098.stdout:7/639: write d6/d24/d2a/d57/faa [1341378,39453] 0 2024-09-13T02:52:55.683 INFO:tasks.workunit.client.1.smithi142.stdout:2/868: dwrite d1/de/d31/d6c/d6d/d47/faf [0,4194304] 0 2024-09-13T02:52:55.685 INFO:tasks.workunit.client.1.smithi142.stdout:3/907: creat d12/d16/d3c/d79/d9e/f122 x:0 0 0 2024-09-13T02:52:55.686 INFO:tasks.workunit.client.1.smithi142.stdout:2/869: fdatasync d1/de/d1f/d13/d59/fe1 0 2024-09-13T02:52:55.688 INFO:tasks.workunit.client.1.smithi142.stdout:3/908: dread - d12/d16/d25/d2e/d38/d6b/f120 zero size 2024-09-13T02:52:55.688 INFO:tasks.workunit.client.1.smithi142.stdout:8/836: dwrite d0/d6/dc/d45/f73 [0,4194304] 0 2024-09-13T02:52:55.693 INFO:tasks.workunit.client.0.smithi098.stdout:4/416: link d6/d22/d3d/d4d/c76 d6/d22/d3d/d41/d58/c99 0 2024-09-13T02:52:55.693 INFO:tasks.workunit.client.1.smithi142.stdout:4/931: rename d0/d2b/d21/d30/f54 to d0/d2b/d2d/d31/d32/f12f 0 2024-09-13T02:52:55.694 INFO:tasks.workunit.client.1.smithi142.stdout:2/870: rmdir d1/d42 39 2024-09-13T02:52:55.695 INFO:tasks.workunit.client.1.smithi142.stdout:8/837: mkdir d0/d6/d83/daa/d111 0 2024-09-13T02:52:55.703 INFO:tasks.workunit.client.0.smithi098.stdout:4/417: dwrite d6/db/f2f [0,4194304] 0 2024-09-13T02:52:55.705 INFO:tasks.workunit.client.1.smithi142.stdout:3/909: rename d12/d16/d25/d2e/d48/d5c/d73 to d12/d16/d25/d2e/d48/d5c/d123 0 2024-09-13T02:52:55.705 INFO:tasks.workunit.client.1.smithi142.stdout:5/984: dread d8/d47/d65/da0/dd1/d61/f83 [4194304,4194304] 0 2024-09-13T02:52:55.708 INFO:tasks.workunit.client.0.smithi098.stdout:7/640: link d6/d24/d2a/d5a/d4c/c77 d6/d24/d2a/d5a/d8e/dbd/dc3/cd1 0 2024-09-13T02:52:55.709 INFO:tasks.workunit.client.0.smithi098.stdout:7/641: chown d6/d24/d2a 139 1 2024-09-13T02:52:55.710 INFO:tasks.workunit.client.0.smithi098.stdout:4/418: rmdir d6 39 2024-09-13T02:52:55.712 INFO:tasks.workunit.client.0.smithi098.stdout:7/642: creat d6/d24/d63/fd2 x:0 0 0 2024-09-13T02:52:55.714 INFO:tasks.workunit.client.1.smithi142.stdout:5/985: symlink d8/dc3/l143 0 2024-09-13T02:52:55.715 INFO:tasks.workunit.client.0.smithi098.stdout:4/419: mknod d6/d37/d7a/c9a 0 2024-09-13T02:52:55.716 INFO:tasks.workunit.client.1.smithi142.stdout:3/910: dwrite d12/d16/d25/d2e/d48/d5c/d123/ff7 [0,4194304] 0 2024-09-13T02:52:55.717 INFO:tasks.workunit.client.0.smithi098.stdout:7/643: truncate d6/d24/d2a/d5a/f38 3088738 0 2024-09-13T02:52:55.718 INFO:tasks.workunit.client.1.smithi142.stdout:5/986: chown d8/d47/df1/l140 613766739 1 2024-09-13T02:52:55.719 INFO:tasks.workunit.client.1.smithi142.stdout:8/838: dread d0/d6/dc/d40/d4d/d62/f74 [0,4194304] 0 2024-09-13T02:52:55.719 INFO:tasks.workunit.client.1.smithi142.stdout:2/871: dread d1/de/f23 [0,4194304] 0 2024-09-13T02:52:55.720 INFO:tasks.workunit.client.1.smithi142.stdout:0/994: dread d10/d6c/d88/d21/d51/f3e [0,4194304] 0 2024-09-13T02:52:55.722 INFO:tasks.workunit.client.1.smithi142.stdout:8/839: chown d0/d6/dc/d2e/fb7 1013367277 1 2024-09-13T02:52:55.722 INFO:tasks.workunit.client.1.smithi142.stdout:3/911: write d12/d16/d25/d2e/d38/d6b/ff9 [4338147,118652] 0 2024-09-13T02:52:55.724 INFO:tasks.workunit.client.1.smithi142.stdout:0/995: write d10/d6c/d88/d30/f86 [2795984,32331] 0 2024-09-13T02:52:55.737 INFO:tasks.workunit.client.1.smithi142.stdout:1/964: sync 2024-09-13T02:52:55.815 INFO:tasks.workunit.client.0.smithi098.stdout:4/420: rename d6/d22/d3d/d4d/f5f to d6/d54/f9b 0 2024-09-13T02:52:55.819 INFO:tasks.workunit.client.1.smithi142.stdout:5/987: readlink d8/d47/d65/da0/dd1/d45/dc5/l137 0 2024-09-13T02:52:55.821 INFO:tasks.workunit.client.0.smithi098.stdout:7/644: dread - d6/d1e/f62 zero size 2024-09-13T02:52:55.822 INFO:tasks.workunit.client.0.smithi098.stdout:4/421: dwrite d6/d22/d3d/d41/d58/f97 [0,4194304] 0 2024-09-13T02:52:55.823 INFO:tasks.workunit.client.0.smithi098.stdout:4/422: stat d6/d10/d21/c43 0 2024-09-13T02:52:55.829 INFO:tasks.workunit.client.0.smithi098.stdout:7/645: mknod d6/d24/d2a/d5a/d8e/dbd/dc3/cd3 0 2024-09-13T02:52:55.832 INFO:tasks.workunit.client.1.smithi142.stdout:3/912: unlink d12/d16/d25/d2e/f49 0 2024-09-13T02:52:55.834 INFO:tasks.workunit.client.1.smithi142.stdout:4/932: dwrite d0/d2b/d2d/d31/d43/d48/f78 [0,4194304] 0 2024-09-13T02:52:55.835 INFO:tasks.workunit.client.1.smithi142.stdout:4/933: stat d0/df/l49 0 2024-09-13T02:52:55.837 INFO:tasks.workunit.client.1.smithi142.stdout:1/965: symlink d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/dc0/l135 0 2024-09-13T02:52:55.837 INFO:tasks.workunit.client.1.smithi142.stdout:4/934: chown d0/d2b/d2d/d31/d32/d82/c104 3 1 2024-09-13T02:52:55.839 INFO:tasks.workunit.client.0.smithi098.stdout:7/646: mkdir d6/d1e/dd4 0 2024-09-13T02:52:55.839 INFO:tasks.workunit.client.1.smithi142.stdout:3/913: dwrite d12/d16/d25/d2e/d38/d4d/d53/d78/fe2 [0,4194304] 0 2024-09-13T02:52:55.840 INFO:tasks.workunit.client.1.smithi142.stdout:4/935: dread - d0/d2b/d2d/d31/d43/d48/dcc/df9/f12a zero size 2024-09-13T02:52:55.842 INFO:tasks.workunit.client.1.smithi142.stdout:4/936: chown d0/d2b/d21/d35/f79 28 1 2024-09-13T02:52:55.843 INFO:tasks.workunit.client.1.smithi142.stdout:4/937: rename d0/d2b/d2d/d31/d32 to d0/d2b/d2d/d31/d32/d82/d130 22 2024-09-13T02:52:55.850 INFO:tasks.workunit.client.1.smithi142.stdout:8/840: truncate d0/d6/f24 474142 0 2024-09-13T02:52:55.854 INFO:tasks.workunit.client.0.smithi098.stdout:7/647: mknod d6/d24/d2a/d57/cd5 0 2024-09-13T02:52:55.856 INFO:tasks.workunit.client.0.smithi098.stdout:4/423: getdents d6/d54 0 2024-09-13T02:52:55.859 INFO:tasks.workunit.client.0.smithi098.stdout:7/648: mknod d6/d24/d2a/d5a/d8e/dbd/cd6 0 2024-09-13T02:52:55.859 INFO:tasks.workunit.client.0.smithi098.stdout:4/424: rmdir d6/db 39 2024-09-13T02:52:55.860 INFO:tasks.workunit.client.0.smithi098.stdout:4/425: fdatasync d6/d10/f1f 0 2024-09-13T02:52:55.861 INFO:tasks.workunit.client.0.smithi098.stdout:4/426: dread - d6/d10/f80 zero size 2024-09-13T02:52:55.861 INFO:tasks.workunit.client.0.smithi098.stdout:7/649: dread - d6/f78 zero size 2024-09-13T02:52:55.862 INFO:tasks.workunit.client.1.smithi142.stdout:4/938: creat d0/d2b/d2d/d11f/de8/f131 x:0 0 0 2024-09-13T02:52:55.864 INFO:tasks.workunit.client.1.smithi142.stdout:3/914: dread d12/dd3/f9c [0,4194304] 0 2024-09-13T02:52:55.865 INFO:tasks.workunit.client.1.smithi142.stdout:8/841: creat d0/da2/f112 x:0 0 0 2024-09-13T02:52:55.866 INFO:tasks.workunit.client.1.smithi142.stdout:8/842: write d0/d6/dc/d45/d8/df/ffb [404363,87109] 0 2024-09-13T02:52:55.866 INFO:tasks.workunit.client.1.smithi142.stdout:2/872: truncate d1/de/d31/d6c/d6d/d47/da8/fb3 1184659 0 2024-09-13T02:52:55.868 INFO:tasks.workunit.client.1.smithi142.stdout:0/996: creat d10/d6c/d88/f14e x:0 0 0 2024-09-13T02:52:55.869 INFO:tasks.workunit.client.1.smithi142.stdout:0/997: fsync d10/d6c/d88/d21/d51/d79/de6/f125 0 2024-09-13T02:52:55.870 INFO:tasks.workunit.client.1.smithi142.stdout:1/966: creat d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d96/f136 x:0 0 0 2024-09-13T02:52:55.870 INFO:tasks.workunit.client.0.smithi098.stdout:7/650: getdents d6/d24/d2a/d57/d88/da4 0 2024-09-13T02:52:55.871 INFO:tasks.workunit.client.1.smithi142.stdout:1/967: chown d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/f105 113795 1 2024-09-13T02:52:55.874 INFO:tasks.workunit.client.0.smithi098.stdout:4/427: rename d6/d22/d3d/d41/l55 to d6/d10/d21/l9c 0 2024-09-13T02:52:55.875 INFO:tasks.workunit.client.1.smithi142.stdout:4/939: unlink d0/d2b/d2d/d65/fd7 0 2024-09-13T02:52:55.879 INFO:tasks.workunit.client.0.smithi098.stdout:4/428: creat d6/d10/f9d x:0 0 0 2024-09-13T02:52:55.880 INFO:tasks.workunit.client.0.smithi098.stdout:4/429: write d6/d10/f9d [203888,106093] 0 2024-09-13T02:52:55.882 INFO:tasks.workunit.client.1.smithi142.stdout:2/873: fdatasync d1/d29/fc9 0 2024-09-13T02:52:55.884 INFO:tasks.workunit.client.0.smithi098.stdout:4/430: write d6/d54/f9b [1831455,29625] 0 2024-09-13T02:52:55.885 INFO:tasks.workunit.client.1.smithi142.stdout:0/998: mknod d10/d6c/d88/d1a/d1e/dc6/df3/d110/c14f 0 2024-09-13T02:52:55.886 INFO:tasks.workunit.client.1.smithi142.stdout:5/988: link d8/d47/d65/da0/dd1/d2d/d90/f88 d8/d47/d65/da0/dd1/d45/f144 0 2024-09-13T02:52:55.886 INFO:tasks.workunit.client.1.smithi142.stdout:0/999: fsync d10/d6c/d88/d21/d51/d79/f14c 0 2024-09-13T02:52:55.888 INFO:tasks.workunit.client.1.smithi142.stdout:1/968: mknod d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/dfe/c137 0 2024-09-13T02:52:55.890 INFO:tasks.workunit.client.1.smithi142.stdout:4/940: creat d0/d2b/d2d/d31/d32/daa/f132 x:0 0 0 2024-09-13T02:52:55.897 INFO:tasks.workunit.client.0.smithi098.stdout:7/651: dwrite d6/d24/d2a/d5a/f1d [0,4194304] 0 2024-09-13T02:52:55.898 INFO:tasks.workunit.client.0.smithi098.stdout:7/652: read - d6/d24/d2a/d5a/d42/d45/d73/f98 zero size 2024-09-13T02:52:55.901 INFO:tasks.workunit.client.1.smithi142.stdout:3/915: creat d12/d16/f124 x:0 0 0 2024-09-13T02:52:55.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/431: write d6/d10/d21/f56 [3244549,19057] 0 2024-09-13T02:52:55.903 INFO:tasks.workunit.client.1.smithi142.stdout:1/969: dread d12/d13/f19 [0,4194304] 0 2024-09-13T02:52:55.907 INFO:tasks.workunit.client.1.smithi142.stdout:5/989: fsync d8/dc3/d3f/f95 0 2024-09-13T02:52:55.910 INFO:tasks.workunit.client.1.smithi142.stdout:2/874: link d1/d29/d72/f87 d1/de/d31/d6c/d6d/db6/f114 0 2024-09-13T02:52:55.910 INFO:tasks.workunit.client.1.smithi142.stdout:5/990: read d8/d47/d65/da0/fd2 [760917,38898] 0 2024-09-13T02:52:55.911 INFO:tasks.workunit.client.0.smithi098.stdout:4/432: unlink d6/db/l67 0 2024-09-13T02:52:55.911 INFO:tasks.workunit.client.1.smithi142.stdout:8/843: dwrite d0/d6/dc/d2e/f57 [0,4194304] 0 2024-09-13T02:52:55.913 INFO:tasks.workunit.client.1.smithi142.stdout:4/941: dread d0/d2b/d21/d35/f83 [0,4194304] 0 2024-09-13T02:52:55.913 INFO:tasks.workunit.client.0.smithi098.stdout:7/653: dwrite d6/d24/d2a/d57/d88/f54 [0,4194304] 0 2024-09-13T02:52:55.915 INFO:tasks.workunit.client.0.smithi098.stdout:7/654: dread - d6/d24/d2a/d5a/fc8 zero size 2024-09-13T02:52:55.916 INFO:tasks.workunit.client.0.smithi098.stdout:7/655: readlink d6/d24/d2a/d5a/d42/d45/l74 0 2024-09-13T02:52:55.919 INFO:tasks.workunit.client.0.smithi098.stdout:7/656: write d6/d24/d2a/d5a/d42/fb8 [151431,15648] 0 2024-09-13T02:52:55.923 INFO:tasks.workunit.client.1.smithi142.stdout:1/970: creat d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d113/f138 x:0 0 0 2024-09-13T02:52:55.925 INFO:tasks.workunit.client.1.smithi142.stdout:8/844: rename d0/d6/dc/d40/d4d to d0/d6/dc/d45/d9d/d10c/dc9/d113 0 2024-09-13T02:52:55.927 INFO:tasks.workunit.client.1.smithi142.stdout:5/991: truncate d8/d47/d65/da0/dd1/d45/d81/d82/f10e 6319230 0 2024-09-13T02:52:55.928 INFO:tasks.workunit.client.0.smithi098.stdout:7/657: dwrite d6/d24/f26 [0,4194304] 0 2024-09-13T02:52:55.928 INFO:tasks.workunit.client.1.smithi142.stdout:2/875: symlink d1/d42/d44/d99/l115 0 2024-09-13T02:52:55.931 INFO:tasks.workunit.client.1.smithi142.stdout:8/845: creat d0/d6/dc/d45/d9d/d10c/dc9/d113/d62/f114 x:0 0 0 2024-09-13T02:52:55.933 INFO:tasks.workunit.client.0.smithi098.stdout:7/658: getdents d6/d24/d2a/d5a/d8e/dbd/dc3/dcf 0 2024-09-13T02:52:55.937 INFO:tasks.workunit.client.1.smithi142.stdout:5/992: dwrite d8/d47/d65/da0/dd1/d2d/d90/f6f [0,4194304] 0 2024-09-13T02:52:55.938 INFO:tasks.workunit.client.0.smithi098.stdout:7/659: mkdir d6/d24/d2a/d5a/d8e/dbd/dd7 0 2024-09-13T02:52:55.939 INFO:tasks.workunit.client.1.smithi142.stdout:2/876: getdents d1/de/d1f/d13/d60/da9/de9 0 2024-09-13T02:52:55.939 INFO:tasks.workunit.client.1.smithi142.stdout:3/916: write d12/d16/d25/d2e/d48/f5f [4064230,50489] 0 2024-09-13T02:52:55.944 INFO:tasks.workunit.client.0.smithi098.stdout:4/433: dwrite d6/d37/f39 [0,4194304] 0 2024-09-13T02:52:55.945 INFO:tasks.workunit.client.0.smithi098.stdout:7/660: creat d6/d24/d2a/d5a/d4c/fd8 x:0 0 0 2024-09-13T02:52:55.945 INFO:tasks.workunit.client.0.smithi098.stdout:7/661: chown d6/d24/d63 872286714 1 2024-09-13T02:52:55.947 INFO:tasks.workunit.client.1.smithi142.stdout:5/993: creat d8/d47/d65/da0/dd1/d61/f145 x:0 0 0 2024-09-13T02:52:55.947 INFO:tasks.workunit.client.1.smithi142.stdout:4/942: write d0/d2b/d2d/d31/d32/daa/fe2 [1041206,86343] 0 2024-09-13T02:52:55.949 INFO:tasks.workunit.client.1.smithi142.stdout:4/943: write d0/d2b/d2d/d31/d43/f5a [3239603,27605] 0 2024-09-13T02:52:55.951 INFO:tasks.workunit.client.0.smithi098.stdout:7/662: mknod d6/d24/d2a/d5a/d42/d80/cd9 0 2024-09-13T02:52:55.957 INFO:tasks.workunit.client.1.smithi142.stdout:3/917: mkdir d12/d16/d3c/d79/d9b/dc1/d125 0 2024-09-13T02:52:55.958 INFO:tasks.workunit.client.1.smithi142.stdout:1/971: dwrite d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/dc0/dc3/f80 [4194304,4194304] 0 2024-09-13T02:52:55.961 INFO:tasks.workunit.client.1.smithi142.stdout:2/877: link d1/de/d1f/f103 d1/de/da6/dbb/dc2/dfa/f116 0 2024-09-13T02:52:55.963 INFO:tasks.workunit.client.1.smithi142.stdout:8/846: dwrite d0/d6/dc/d45/d8/df/f99 [0,4194304] 0 2024-09-13T02:52:55.963 INFO:tasks.workunit.client.1.smithi142.stdout:4/944: mknod d0/d2b/d2d/d11f/dcf/de6/dd2/c133 0 2024-09-13T02:52:55.967 INFO:tasks.workunit.client.1.smithi142.stdout:8/847: chown d0/d6/dc/d45/d35/d61/c92 67863 1 2024-09-13T02:52:55.967 INFO:tasks.workunit.client.0.smithi098.stdout:7/663: rename d6/d24/d2a/d5a/d42/d80 to d6/d24/d2a/dda 0 2024-09-13T02:52:55.969 INFO:tasks.workunit.client.0.smithi098.stdout:4/434: symlink d6/l9e 0 2024-09-13T02:52:55.970 INFO:tasks.workunit.client.1.smithi142.stdout:3/918: chown d12/d16/da3/fde 144938 1 2024-09-13T02:52:55.971 INFO:tasks.workunit.client.1.smithi142.stdout:3/919: chown d12/d16/d25/d2e/d38/d4d/dad 27841503 1 2024-09-13T02:52:55.971 INFO:tasks.workunit.client.1.smithi142.stdout:5/994: dwrite d8/d47/d65/da0/dd1/d45/f120 [0,4194304] 0 2024-09-13T02:52:55.972 INFO:tasks.workunit.client.1.smithi142.stdout:2/878: mkdir d1/de/d31/d6c/d6d/d117 0 2024-09-13T02:52:55.975 INFO:tasks.workunit.client.1.smithi142.stdout:4/945: rmdir d0/d2b/d2d/d65/df5 39 2024-09-13T02:52:55.978 INFO:tasks.workunit.client.1.smithi142.stdout:1/972: rename d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/c94 to d12/d13/d20/d66/d7d/df5/d26/d4f/c139 0 2024-09-13T02:52:55.979 INFO:tasks.workunit.client.1.smithi142.stdout:5/995: mkdir d8/d47/d65/da0/dd1/d2d/d146 0 2024-09-13T02:52:55.980 INFO:tasks.workunit.client.1.smithi142.stdout:4/946: rmdir d0/d2b/d2d/d65/d87 39 2024-09-13T02:52:55.981 INFO:tasks.workunit.client.1.smithi142.stdout:5/996: truncate d8/dc3/d3f/ddd/d125/fc8 4314770 0 2024-09-13T02:52:55.983 INFO:tasks.workunit.client.1.smithi142.stdout:5/997: write d8/d47/d65/da0/dd1/d45/f120 [3770644,32844] 0 2024-09-13T02:52:55.989 INFO:tasks.workunit.client.0.smithi098.stdout:7/664: write d6/d24/d2a/d5a/d4c/f60 [1150462,84812] 0 2024-09-13T02:52:55.989 INFO:tasks.workunit.client.1.smithi142.stdout:1/973: dwrite d12/d13/d20/d66/d55/f44 [4194304,4194304] 0 2024-09-13T02:52:55.989 INFO:tasks.workunit.client.0.smithi098.stdout:4/435: chown d6/d37/l50 0 1 2024-09-13T02:52:55.990 INFO:tasks.workunit.client.1.smithi142.stdout:3/920: write d12/d16/d25/d2e/d38/d4d/f50 [321845,62079] 0 2024-09-13T02:52:55.993 INFO:tasks.workunit.client.1.smithi142.stdout:8/848: dread d0/d6/d83/daa/fb0 [0,4194304] 0 2024-09-13T02:52:55.993 INFO:tasks.workunit.client.1.smithi142.stdout:3/921: stat c5 0 2024-09-13T02:52:55.993 INFO:tasks.workunit.client.1.smithi142.stdout:4/947: write d0/d7e/db8/fea [3327481,25200] 0 2024-09-13T02:52:55.995 INFO:tasks.workunit.client.0.smithi098.stdout:4/436: creat d6/d54/f9f x:0 0 0 2024-09-13T02:52:55.995 INFO:tasks.workunit.client.1.smithi142.stdout:1/974: creat d12/d13/d20/d10b/f13a x:0 0 0 2024-09-13T02:52:55.996 INFO:tasks.workunit.client.0.smithi098.stdout:4/437: write d6/d37/f39 [1812233,75544] 0 2024-09-13T02:52:55.997 INFO:tasks.workunit.client.1.smithi142.stdout:3/922: creat d12/f126 x:0 0 0 2024-09-13T02:52:55.999 INFO:tasks.workunit.client.1.smithi142.stdout:2/879: dread d1/de/d1f/f8d [0,4194304] 0 2024-09-13T02:52:56.000 INFO:tasks.workunit.client.0.smithi098.stdout:4/438: rename d6/d22/d3d/d41/f42 to d6/d22/d3d/d4d/fa0 0 2024-09-13T02:52:56.003 INFO:tasks.workunit.client.1.smithi142.stdout:2/880: fdatasync d1/de/da6/dbb/d92/fa4 0 2024-09-13T02:52:56.004 INFO:tasks.workunit.client.1.smithi142.stdout:3/923: mkdir d12/d16/d25/d2e/d127 0 2024-09-13T02:52:56.009 INFO:tasks.workunit.client.1.smithi142.stdout:3/924: dread d12/d16/d25/d2e/d48/d5c/d8c/f98 [0,4194304] 0 2024-09-13T02:52:56.010 INFO:tasks.workunit.client.0.smithi098.stdout:4/439: write d6/d37/f72 [1620665,93957] 0 2024-09-13T02:52:56.011 INFO:tasks.workunit.client.1.smithi142.stdout:3/925: symlink d12/d16/d3c/d79/d9b/l128 0 2024-09-13T02:52:56.012 INFO:tasks.workunit.client.1.smithi142.stdout:5/998: dread d8/dc3/df3/f94 [0,4194304] 0 2024-09-13T02:52:56.012 INFO:tasks.workunit.client.0.smithi098.stdout:4/440: creat d6/d37/d7a/fa1 x:0 0 0 2024-09-13T02:52:56.013 INFO:tasks.workunit.client.1.smithi142.stdout:2/881: write d1/de/f17 [2489708,34375] 0 2024-09-13T02:52:56.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/926: chown d12/d16/d3c/d7d/d91/l9f 148578 1 2024-09-13T02:52:56.015 INFO:tasks.workunit.client.1.smithi142.stdout:1/975: dwrite d12/d13/d20/d66/d7d/df5/d26/f6a [0,4194304] 0 2024-09-13T02:52:56.016 INFO:tasks.workunit.client.0.smithi098.stdout:4/441: dread d6/d10/d21/f25 [0,4194304] 0 2024-09-13T02:52:56.016 INFO:tasks.workunit.client.0.smithi098.stdout:4/442: rename d6/d22/d3d to d6/d22/d3d/d41/d58/da2 22 2024-09-13T02:52:56.017 INFO:tasks.workunit.client.0.smithi098.stdout:4/443: chown d6/d10/l2c 39860 1 2024-09-13T02:52:56.017 INFO:tasks.workunit.client.0.smithi098.stdout:4/444: readlink d6/d37/l71 0 2024-09-13T02:52:56.021 INFO:tasks.workunit.client.1.smithi142.stdout:3/927: dread d12/d16/da3/fa9 [0,4194304] 0 2024-09-13T02:52:56.024 INFO:tasks.workunit.client.1.smithi142.stdout:2/882: symlink d1/de/d31/l118 0 2024-09-13T02:52:56.025 INFO:tasks.workunit.client.1.smithi142.stdout:8/849: dread d0/d6/dc/d45/d9d/d10c/dc9/fe7 [0,4194304] 0 2024-09-13T02:52:56.027 INFO:tasks.workunit.client.1.smithi142.stdout:5/999: getdents d8/d47/d65/da0/dd1 0 2024-09-13T02:52:56.029 INFO:tasks.workunit.client.1.smithi142.stdout:3/928: mknod d12/d16/d3c/d79/d9b/dc1/d125/c129 0 2024-09-13T02:52:56.029 INFO:tasks.workunit.client.1.smithi142.stdout:4/948: dread d0/d7e/fd5 [0,4194304] 0 2024-09-13T02:52:56.029 INFO:tasks.workunit.client.1.smithi142.stdout:1/976: link d12/d13/fba d12/d13/d20/d10b/f13b 0 2024-09-13T02:52:56.031 INFO:tasks.workunit.client.1.smithi142.stdout:8/850: mkdir d0/d6/dc/d10e/d115 0 2024-09-13T02:52:56.032 INFO:tasks.workunit.client.1.smithi142.stdout:4/949: fsync d0/df/d57/f88 0 2024-09-13T02:52:56.034 INFO:tasks.workunit.client.1.smithi142.stdout:3/929: creat d12/d16/d25/d2e/d38/d4d/d53/d78/f12a x:0 0 0 2024-09-13T02:52:56.034 INFO:tasks.workunit.client.1.smithi142.stdout:2/883: dwrite d1/de/d1f/d13/d59/fe7 [0,4194304] 0 2024-09-13T02:52:56.036 INFO:tasks.workunit.client.0.smithi098.stdout:4/445: dread d6/d3e/d68/f38 [0,4194304] 0 2024-09-13T02:52:56.037 INFO:tasks.workunit.client.1.smithi142.stdout:1/977: truncate d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/f10f 87780 0 2024-09-13T02:52:56.037 INFO:tasks.workunit.client.0.smithi098.stdout:4/446: readlink d6/d22/d3d/l52 0 2024-09-13T02:52:56.038 INFO:tasks.workunit.client.0.smithi098.stdout:4/447: fdatasync d6/d3e/f59 0 2024-09-13T02:52:56.039 INFO:tasks.workunit.client.1.smithi142.stdout:2/884: unlink d1/de/f23 0 2024-09-13T02:52:56.040 INFO:tasks.workunit.client.1.smithi142.stdout:2/885: dread - d1/de/d1f/d13/d59/fe1 zero size 2024-09-13T02:52:56.040 INFO:tasks.workunit.client.1.smithi142.stdout:4/950: mknod d0/d2b/d2d/d31/d43/d48/dcc/df9/c134 0 2024-09-13T02:52:56.044 INFO:tasks.workunit.client.0.smithi098.stdout:4/448: symlink d6/d22/d3d/d64/la3 0 2024-09-13T02:52:56.045 INFO:tasks.workunit.client.0.smithi098.stdout:4/449: truncate d6/d3e/d46/f86 757794 0 2024-09-13T02:52:56.045 INFO:tasks.workunit.client.1.smithi142.stdout:1/978: creat d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d11c/f13c x:0 0 0 2024-09-13T02:52:56.046 INFO:tasks.workunit.client.1.smithi142.stdout:4/951: creat d0/d2b/d2d/d31/d43/d48/dcc/f135 x:0 0 0 2024-09-13T02:52:56.048 INFO:tasks.workunit.client.1.smithi142.stdout:2/886: link d1/de/d1f/d9c/ffe d1/d29/d72/daa/f119 0 2024-09-13T02:52:56.049 INFO:tasks.workunit.client.1.smithi142.stdout:8/851: dwrite d0/fe0 [0,4194304] 0 2024-09-13T02:52:56.050 INFO:tasks.workunit.client.1.smithi142.stdout:4/952: mkdir d0/d2b/d2d/da2/d136 0 2024-09-13T02:52:56.053 INFO:tasks.workunit.client.1.smithi142.stdout:2/887: fsync d1/d42/ffd 0 2024-09-13T02:52:56.055 INFO:tasks.workunit.client.1.smithi142.stdout:1/979: mknod d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/c13d 0 2024-09-13T02:52:56.056 INFO:tasks.workunit.client.1.smithi142.stdout:4/953: unlink d0/df/da5/dad/fb2 0 2024-09-13T02:52:56.058 INFO:tasks.workunit.client.1.smithi142.stdout:3/930: dwrite fe [0,4194304] 0 2024-09-13T02:52:56.059 INFO:tasks.workunit.client.0.smithi098.stdout:4/450: write d6/db/f40 [619590,109679] 0 2024-09-13T02:52:56.060 INFO:tasks.workunit.client.1.smithi142.stdout:3/931: readlink d12/d16/d25/d2e/d48/d5c/d66/lc2 0 2024-09-13T02:52:56.064 INFO:tasks.workunit.client.1.smithi142.stdout:3/932: mknod d12/d16/d25/d2e/d38/d4d/dad/c12b 0 2024-09-13T02:52:56.064 INFO:tasks.workunit.client.0.smithi098.stdout:4/451: mknod d6/d10/d21/ca4 0 2024-09-13T02:52:56.065 INFO:tasks.workunit.client.1.smithi142.stdout:8/852: link d0/d6/dc/d45/d35/d93/le4 d0/d6/dc/d40/d41/l116 0 2024-09-13T02:52:56.068 INFO:tasks.workunit.client.0.smithi098.stdout:4/452: symlink d6/d22/d3d/d6c/la5 0 2024-09-13T02:52:56.069 INFO:tasks.workunit.client.1.smithi142.stdout:1/980: write d12/d13/d45/fed [4126329,116615] 0 2024-09-13T02:52:56.070 INFO:tasks.workunit.client.1.smithi142.stdout:4/954: write d0/fb6 [484379,74171] 0 2024-09-13T02:52:56.070 INFO:tasks.workunit.client.1.smithi142.stdout:3/933: dwrite d12/d16/d25/d2e/d38/d6b/ff9 [0,4194304] 0 2024-09-13T02:52:56.074 INFO:tasks.workunit.client.1.smithi142.stdout:1/981: chown d12/d13/d20/d66/d7d/df5/d26/d4f/d102/f12f 16525017 1 2024-09-13T02:52:56.074 INFO:tasks.workunit.client.0.smithi098.stdout:4/453: getdents d6/d22/d3d/d4d 0 2024-09-13T02:52:56.075 INFO:tasks.workunit.client.0.smithi098.stdout:4/454: chown d6/d37/l50 30771 1 2024-09-13T02:52:56.076 INFO:tasks.workunit.client.1.smithi142.stdout:2/888: dwrite d1/f54 [0,4194304] 0 2024-09-13T02:52:56.077 INFO:tasks.workunit.client.1.smithi142.stdout:2/889: chown d1/de/d31/cdd 94093 1 2024-09-13T02:52:56.078 INFO:tasks.workunit.client.1.smithi142.stdout:1/982: creat d12/d13/d20/d66/d7d/df5/d26/d4f/d124/f13e x:0 0 0 2024-09-13T02:52:56.080 INFO:tasks.workunit.client.0.smithi098.stdout:4/455: link d6/d37/d7a/f89 d6/d22/d3d/d64/fa6 0 2024-09-13T02:52:56.081 INFO:tasks.workunit.client.0.smithi098.stdout:4/456: dread - d6/d3e/d73/f8f zero size 2024-09-13T02:52:56.084 INFO:tasks.workunit.client.1.smithi142.stdout:2/890: unlink d1/de/da6/dbb/dc2/fda 0 2024-09-13T02:52:56.087 INFO:tasks.workunit.client.1.smithi142.stdout:1/983: creat d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d81/d92/daa/dc0/f13f x:0 0 0 2024-09-13T02:52:56.087 INFO:tasks.workunit.client.0.smithi098.stdout:4/457: dwrite d6/d22/f63 [4194304,4194304] 0 2024-09-13T02:52:56.088 INFO:tasks.workunit.client.1.smithi142.stdout:2/891: unlink d1/de/l3a 0 2024-09-13T02:52:56.094 INFO:tasks.workunit.client.1.smithi142.stdout:8/853: rename d0/d6/dc/d45/d35/d93 to d0/d6/dc/d45/d8/d117 0 2024-09-13T02:52:56.095 INFO:tasks.workunit.client.1.smithi142.stdout:2/892: mkdir d1/de/da6/dbb/dc2/d11a 0 2024-09-13T02:52:56.100 INFO:tasks.workunit.client.1.smithi142.stdout:2/893: unlink d1/de/d31/d6c/d6d/db6/cdc 0 2024-09-13T02:52:56.100 INFO:tasks.workunit.client.1.smithi142.stdout:4/955: write d0/d2b/d2d/d31/d43/fa9 [2581155,128392] 0 2024-09-13T02:52:56.104 INFO:tasks.workunit.client.1.smithi142.stdout:2/894: stat d1/de/da6/dbb/fa1 0 2024-09-13T02:52:56.104 INFO:tasks.workunit.client.1.smithi142.stdout:3/934: dread d12/d16/d25/d2e/d38/d6b/fd9 [0,4194304] 0 2024-09-13T02:52:56.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/854: getdents d0 0 2024-09-13T02:52:56.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/956: write d0/df/d57/f53 [3963653,119178] 0 2024-09-13T02:52:56.108 INFO:tasks.workunit.client.1.smithi142.stdout:8/855: creat d0/d6/dc/d45/d9d/d10c/dc9/d113/f118 x:0 0 0 2024-09-13T02:52:56.109 INFO:tasks.workunit.client.1.smithi142.stdout:1/984: write d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/fdc [406927,59286] 0 2024-09-13T02:52:56.110 INFO:tasks.workunit.client.1.smithi142.stdout:4/957: mkdir d0/d2b/d2d/d31/d32/d82/db0/d137 0 2024-09-13T02:52:56.111 INFO:tasks.workunit.client.1.smithi142.stdout:4/958: read d0/fb6 [262400,69855] 0 2024-09-13T02:52:56.113 INFO:tasks.workunit.client.1.smithi142.stdout:8/856: symlink d0/d6/dc/d45/d8/l119 0 2024-09-13T02:52:56.115 INFO:tasks.workunit.client.1.smithi142.stdout:1/985: creat d12/d13/d20/d66/d7d/df5/d26/d4f/d72/d119/d71/d11c/f140 x:0 0 0 2024-09-13T02:52:56.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/895: write d1/de/da6/dbb/f51 [2346400,39206] 0 2024-09-13T02:52:56.116 INFO:tasks.workunit.client.1.smithi142.stdout:4/959: chown d0/df/da5/dad/f10e 101792 1 2024-09-13T02:52:56.117 INFO:tasks.workunit.client.1.smithi142.stdout:4/960: dread - d0/df/da5/dad/f125 zero size 2024-09-13T02:52:56.117 INFO:tasks.workunit.client.1.smithi142.stdout:8/857: mkdir d0/d6/dc/d45/d9d/d10c/d11a 0 2024-09-13T02:52:56.120 INFO:tasks.workunit.client.1.smithi142.stdout:1/986: mkdir d12/d13/d20/d66/d55/db4/d141 0 2024-09-13T02:52:56.121 INFO:tasks.workunit.client.1.smithi142.stdout:2/896: dread d1/de/f17 [0,4194304] 0 2024-09-13T02:52:56.121 INFO:tasks.workunit.client.1.smithi142.stdout:8/858: creat d0/d6/d23/f11b x:0 0 0 2024-09-13T02:52:56.124 INFO:tasks.workunit.client.1.smithi142.stdout:1/987: creat d12/d13/d20/d66/d7d/df5/d106/f142 x:0 0 0 2024-09-13T02:52:56.125 INFO:tasks.workunit.client.1.smithi142.stdout:2/897: creat d1/de/d31/d6c/d6d/d47/da8/f11b x:0 0 0 2024-09-13T02:52:56.126 INFO:tasks.workunit.client.1.smithi142.stdout:3/935: dread d12/d16/d25/d2e/d48/d5c/d8c/daf/fdc [0,4194304] 0 2024-09-13T02:52:56.129 INFO:tasks.workunit.client.1.smithi142.stdout:1/988: mkdir d12/d13/d20/d66/d55/db4/d143 0 2024-09-13T02:52:56.130 INFO:tasks.workunit.client.0.smithi098.stdout:1/536: sync 2024-09-13T02:52:56.132 INFO:tasks.workunit.client.1.smithi142.stdout:2/898: rename d1/f35 to d1/d42/d44/d99/f11c 0 2024-09-13T02:52:56.133 INFO:tasks.workunit.client.1.smithi142.stdout:3/936: mknod d12/d11b/c12c 0 2024-09-13T02:52:56.135 INFO:tasks.workunit.client.0.smithi098.stdout:1/537: dwrite d9/d33/d19/d35/d68/f3f [0,4194304] 0 2024-09-13T02:52:56.137 INFO:tasks.workunit.client.1.smithi142.stdout:4/961: write d0/d2b/d2d/d31/d32/fca [124538,85547] 0 2024-09-13T02:52:56.138 INFO:tasks.workunit.client.0.smithi098.stdout:1/538: unlink d9/d33/d19/d35/d63/faa 0 2024-09-13T02:52:56.140 INFO:tasks.workunit.client.0.smithi098.stdout:1/539: write d9/d33/d19/d35/d68/d4d/dbc/d23/fc6 [780673,36930] 0 2024-09-13T02:52:56.141 INFO:tasks.workunit.client.0.smithi098.stdout:1/540: write d9/d33/d19/d35/d63/f69 [3489781,76301] 0 2024-09-13T02:52:56.141 INFO:tasks.workunit.client.1.smithi142.stdout:3/937: symlink d12/d16/d25/d2e/d38/d6b/l12d 0 2024-09-13T02:52:56.142 INFO:tasks.workunit.client.1.smithi142.stdout:1/989: rmdir d12/d13/d20/d66/d7d/df5/d106 39 2024-09-13T02:52:56.144 INFO:tasks.workunit.client.1.smithi142.stdout:1/990: dread - d12/d13/d20/d66/d7d/df5/d26/d4f/d124/f13e zero size 2024-09-13T02:52:56.149 INFO:tasks.workunit.client.1.smithi142.stdout:4/962: mkdir d0/d2b/d2d/d65/df5/d138 0 2024-09-13T02:52:56.150 INFO:tasks.workunit.client.1.smithi142.stdout:4/963: write d0/d2b/d2d/d31/d32/f115 [1449700,78027] 0 2024-09-13T02:52:56.150 INFO:tasks.workunit.client.1.smithi142.stdout:1/991: unlink d12/d13/d20/d66/d7d/df5/d26/d4f/fb1 0 2024-09-13T02:52:56.151 INFO:tasks.workunit.client.1.smithi142.stdout:3/938: truncate d12/d16/d25/d2e/d48/d5c/d66/fe8 43220 0 2024-09-13T02:52:56.152 INFO:tasks.workunit.client.1.smithi142.stdout:3/939: dread - d12/d16/d25/d2e/d38/d4d/fe7 zero size 2024-09-13T02:52:56.155 INFO:tasks.workunit.client.1.smithi142.stdout:4/964: mkdir d0/d2b/d21/d139 0 2024-09-13T02:52:56.156 INFO:tasks.workunit.client.0.smithi098.stdout:1/541: link d9/d33/f2b d9/d33/d19/d35/d68/d4d/dbc/d23/da7/d51/d8f/fcc 0 2024-09-13T02:52:56.157 INFO:tasks.workunit.client.1.smithi142.stdout:4/965: symlink d0/d2b/d21/d139/l13a 0 2024-09-13T02:52:56.158 INFO:tasks.workunit.client.0.smithi098.stdout:1/542: readlink d9/d33/d19/d35/d68/d4d/dbc/d23/da7/d51/d8f/l76 0 2024-09-13T02:52:56.159 INFO:tasks.workunit.client.0.smithi098.stdout:1/543: write d9/d33/d19/d35/d68/d4d/dbc/f88 [818934,117458] 0 2024-09-13T02:52:56.162 INFO:tasks.workunit.client.0.smithi098.stdout:1/544: fsync d9/d33/f6f 0 2024-09-13T02:52:56.167 INFO:tasks.workunit.client.1.smithi142.stdout:1/992: write d12/d13/d20/f48 [4442324,91195] 0 2024-09-13T02:52:56.169 INFO:tasks.workunit.client.1.smithi142.stdout:1/993: fdatasync d12/d13/d20/d66/d55/db4/fd4 0 2024-09-13T02:52:56.170 INFO:tasks.workunit.client.1.smithi142.stdout:1/994: write d12/d13/d20/d66/fbd [3509211,99153] 0 2024-09-13T02:52:56.171 INFO:tasks.workunit.client.0.smithi098.stdout:1/545: dread d9/d33/d19/d35/d68/d60/d61/db1/fc4 [0,4194304] 0 2024-09-13T02:52:56.171 INFO:tasks.workunit.client.1.smithi142.stdout:4/966: dread d0/d2b/d2d/d31/f8b [0,4194304] 0 2024-09-13T02:52:56.172 INFO:tasks.workunit.client.1.smithi142.stdout:1/995: write d12/d13/d20/d66/d7d/df5/d26/d4f/d124/f13e [931855,20061] 0 2024-09-13T02:52:56.172 INFO:tasks.workunit.client.1.smithi142.stdout:4/967: dread - d0/df/d57/dbf/f10c zero size 2024-09-13T02:52:56.261 INFO:tasks.workunit.client.0.smithi098.stdout:0/511: sync 2024-09-13T02:52:56.262 INFO:tasks.workunit.client.0.smithi098.stdout:1/546: write d9/d33/d19/d35/d63/f89 [603653,89800] 0 2024-09-13T02:52:56.263 INFO:tasks.workunit.client.1.smithi142.stdout:1/996: mkdir d12/d13/d20/d66/d7d/df5/d144 0 2024-09-13T02:52:56.267 INFO:tasks.workunit.client.1.smithi142.stdout:4/968: dwrite d0/d2b/d2d/d31/d32/fe9 [0,4194304] 0 2024-09-13T02:52:56.267 INFO:tasks.workunit.client.0.smithi098.stdout:1/547: dread d9/d33/d19/d35/d68/d4d/dbc/d23/fc6 [0,4194304] 0 2024-09-13T02:52:56.269 INFO:tasks.workunit.client.1.smithi142.stdout:4/969: write d0/d7e/db8/fea [2595395,33751] 0 2024-09-13T02:52:56.278 INFO:tasks.workunit.client.1.smithi142.stdout:4/970: creat d0/df/f13b x:0 0 0 2024-09-13T02:52:56.282 INFO:tasks.workunit.client.1.smithi142.stdout:1/997: dwrite d12/d13/dd3/ffb [0,4194304] 0 2024-09-13T02:52:56.283 INFO:tasks.workunit.client.0.smithi098.stdout:0/512: unlink dd/df/d1d/d26/d28/d32/d67/d81/f9a 0 2024-09-13T02:52:56.283 INFO:tasks.workunit.client.1.smithi142.stdout:1/998: chown d12/d13/d20/d27/cfa 84828005 1 2024-09-13T02:52:56.284 INFO:tasks.workunit.client.0.smithi098.stdout:0/513: write dd/df/d1d/d40/f6c [1460421,67199] 0 2024-09-13T02:52:56.285 INFO:tasks.workunit.client.1.smithi142.stdout:1/999: chown d12/d13/d20/d66/d55/c8e 0 1 2024-09-13T02:52:56.286 INFO:tasks.workunit.client.0.smithi098.stdout:1/548: write d9/d33/d19/d35/f95 [4450525,41074] 0 2024-09-13T02:52:56.287 INFO:tasks.workunit.client.1.smithi142.stdout:3/940: sync 2024-09-13T02:52:56.287 INFO:tasks.workunit.client.1.smithi142.stdout:8/859: sync 2024-09-13T02:52:56.287 INFO:tasks.workunit.client.1.smithi142.stdout:2/899: sync 2024-09-13T02:52:56.288 INFO:tasks.workunit.client.0.smithi098.stdout:1/549: stat d9/d33/d19/d35/d68/d4d/dbc/d23/c26 0 2024-09-13T02:52:56.288 INFO:tasks.workunit.client.1.smithi142.stdout:8/860: read - d0/d6/dc/ff6 zero size 2024-09-13T02:52:56.288 INFO:tasks.workunit.client.1.smithi142.stdout:2/900: write d1/f54 [4776437,36368] 0 2024-09-13T02:52:56.295 INFO:tasks.workunit.client.0.smithi098.stdout:1/550: mkdir d9/d33/d19/d35/d63/dcd 0 2024-09-13T02:52:56.301 INFO:tasks.workunit.client.1.smithi142.stdout:2/901: creat d1/de/d1f/d13/f11d x:0 0 0 2024-09-13T02:52:56.301 INFO:tasks.workunit.client.1.smithi142.stdout:8/861: fsync d0/d6/dc/d45/d8/df/f9f 0 2024-09-13T02:52:56.304 INFO:tasks.workunit.client.1.smithi142.stdout:3/941: write d12/fdf [502446,62466] 0 2024-09-13T02:52:56.304 INFO:tasks.workunit.client.1.smithi142.stdout:3/942: chown d12/d16/d3c/f62 90504 1 2024-09-13T02:52:56.305 INFO:tasks.workunit.client.1.smithi142.stdout:3/943: dread - d12/d16/d3c/d7d/f11f zero size 2024-09-13T02:52:56.309 INFO:tasks.workunit.client.0.smithi098.stdout:0/514: dread fc [0,4194304] 0 2024-09-13T02:52:56.317 INFO:tasks.workunit.client.0.smithi098.stdout:1/551: dread d9/d33/d19/d35/fab [0,4194304] 0 2024-09-13T02:52:56.318 INFO:tasks.workunit.client.0.smithi098.stdout:1/552: dread - d9/d33/f6f zero size 2024-09-13T02:52:56.321 INFO:tasks.workunit.client.0.smithi098.stdout:1/553: mknod d9/d33/d19/d64/cce 0 2024-09-13T02:52:56.323 INFO:tasks.workunit.client.0.smithi098.stdout:0/515: dread dd/df/d1d/d26/d37/f73 [0,4194304] 0 2024-09-13T02:52:56.324 INFO:tasks.workunit.client.0.smithi098.stdout:1/554: mknod d9/d33/d19/d35/d68/d4d/dbc/d23/da7/ccf 0 2024-09-13T02:52:56.325 INFO:tasks.workunit.client.1.smithi142.stdout:4/971: mknod d0/df/da5/dad/dae/c13c 0 2024-09-13T02:52:56.326 INFO:tasks.workunit.client.1.smithi142.stdout:2/902: symlink d1/de/d1f/d9c/l11e 0 2024-09-13T02:52:56.326 INFO:tasks.workunit.client.0.smithi098.stdout:1/555: write d9/d33/d19/d35/d68/d4d/dbc/d23/da7/d51/f98 [1330853,92601] 0 2024-09-13T02:52:56.327 INFO:tasks.workunit.client.0.smithi098.stdout:0/516: rename dd/df/d1d/f1a to dd/df/d1d/d26/d28/d32/d8d/fa5 0 2024-09-13T02:52:56.328 INFO:tasks.workunit.client.0.smithi098.stdout:1/556: truncate d9/f9b 1044532 0 2024-09-13T02:52:56.329 INFO:tasks.workunit.client.0.smithi098.stdout:0/517: stat dd/df/d1d/d26/d28/d32/d8d 0 2024-09-13T02:52:56.329 INFO:tasks.workunit.client.1.smithi142.stdout:8/862: creat d0/d6/dc/d45/d35/d61/f11c x:0 0 0 2024-09-13T02:52:56.329 INFO:tasks.workunit.client.0.smithi098.stdout:0/518: chown dd/df/d1d/d26/d37/f73 866795 1 2024-09-13T02:52:56.333 INFO:tasks.workunit.client.1.smithi142.stdout:4/972: dwrite d0/d2b/d2d/d31/f129 [0,4194304] 0 2024-09-13T02:52:56.334 INFO:tasks.workunit.client.0.smithi098.stdout:1/557: chown d9/d33/f66 5 1 2024-09-13T02:52:56.335 INFO:tasks.workunit.client.1.smithi142.stdout:2/903: dwrite d1/de/d31/d6c/d6d/d47/faf [4194304,4194304] 0 2024-09-13T02:52:56.341 INFO:tasks.workunit.client.1.smithi142.stdout:3/944: dwrite d12/d16/d25/d2e/ff4 [0,4194304] 0 2024-09-13T02:52:56.345 INFO:tasks.workunit.client.1.smithi142.stdout:4/973: link d0/d2b/d21/d35/f5f d0/d2b/d2d/d65/df5/f13d 0 2024-09-13T02:52:56.346 INFO:tasks.workunit.client.1.smithi142.stdout:8/863: rmdir d0/d6/dc/d45/d8/df/d28/dfc 0 2024-09-13T02:52:56.350 INFO:tasks.workunit.client.1.smithi142.stdout:2/904: dwrite d1/de/f17 [0,4194304] 0 2024-09-13T02:52:56.351 INFO:tasks.workunit.client.1.smithi142.stdout:2/905: chown d1 174 1 2024-09-13T02:52:56.352 INFO:tasks.workunit.client.1.smithi142.stdout:3/945: dwrite d12/d16/d25/d2e/d48/d5c/d66/de4/ffc [0,4194304] 0 2024-09-13T02:52:56.353 INFO:tasks.workunit.client.1.smithi142.stdout:2/906: chown d1/d42/c74 194613 1 2024-09-13T02:52:56.358 INFO:tasks.workunit.client.1.smithi142.stdout:3/946: readlink d12/d16/d25/d2e/d38/d4d/l81 0 2024-09-13T02:52:56.361 INFO:tasks.workunit.client.0.smithi098.stdout:1/558: write d9/d33/d19/d35/d63/f77 [2581071,76849] 0 2024-09-13T02:52:56.362 INFO:tasks.workunit.client.1.smithi142.stdout:4/974: dwrite d0/d2b/d2d/d31/d43/fa9 [0,4194304] 0 2024-09-13T02:52:56.364 INFO:tasks.workunit.client.1.smithi142.stdout:3/947: fsync d12/d16/d3c/fd2 0 2024-09-13T02:52:56.364 INFO:tasks.workunit.client.0.smithi098.stdout:1/559: write d9/d33/d19/d64/fbb [982485,2411] 0 2024-09-13T02:52:56.367 INFO:tasks.workunit.client.0.smithi098.stdout:0/519: dwrite f4 [4194304,4194304] 0 2024-09-13T02:52:56.368 INFO:tasks.workunit.client.1.smithi142.stdout:2/907: rename d1/de/f7e to d1/de/d1f/d13/d60/da9/d10d/f11f 0 2024-09-13T02:52:56.370 INFO:tasks.workunit.client.0.smithi098.stdout:1/560: creat d9/d33/d19/d35/d68/d60/d61/db1/fd0 x:0 0 0 2024-09-13T02:52:56.372 INFO:tasks.workunit.client.0.smithi098.stdout:1/561: chown d9/d33/d19/d35/d68/d4d/c92 61233619 1 2024-09-13T02:52:56.372 INFO:tasks.workunit.client.0.smithi098.stdout:0/520: symlink dd/df/la6 0 2024-09-13T02:52:56.373 INFO:tasks.workunit.client.1.smithi142.stdout:4/975: dwrite d0/df/d57/dbf/f11d [0,4194304] 0 2024-09-13T02:52:56.375 INFO:tasks.workunit.client.1.smithi142.stdout:3/948: dread d12/d16/da3/fd1 [0,4194304] 0 2024-09-13T02:52:56.376 INFO:tasks.workunit.client.0.smithi098.stdout:1/562: mkdir d9/d33/d19/d35/d63/dd1 0 2024-09-13T02:52:56.379 INFO:tasks.workunit.client.0.smithi098.stdout:5/459: sync 2024-09-13T02:52:56.382 INFO:tasks.workunit.client.1.smithi142.stdout:8/864: dread d0/d6/dc/d45/d35/d7e/f10f [0,4194304] 0 2024-09-13T02:52:56.383 INFO:tasks.workunit.client.1.smithi142.stdout:3/949: mkdir d12/d16/d3c/d79/d9e/d10f/d12e 0 2024-09-13T02:52:56.384 INFO:tasks.workunit.client.1.smithi142.stdout:2/908: dwrite d1/de/da6/fa7 [0,4194304] 0 2024-09-13T02:52:56.389 INFO:tasks.workunit.client.1.smithi142.stdout:2/909: truncate d1/de/f9d 8817364 0 2024-09-13T02:52:56.389 INFO:tasks.workunit.client.1.smithi142.stdout:3/950: write d12/d16/d25/d2e/d38/d4d/f50 [671481,63257] 0 2024-09-13T02:52:56.392 INFO:tasks.workunit.client.1.smithi142.stdout:2/910: unlink d1/fa3 0 2024-09-13T02:52:56.394 INFO:tasks.workunit.client.1.smithi142.stdout:8/865: truncate d0/d6/dc/d45/d35/fca 620020 0 2024-09-13T02:52:56.396 INFO:tasks.workunit.client.1.smithi142.stdout:3/951: mkdir d12/d16/d3c/d12f 0 2024-09-13T02:52:56.398 INFO:tasks.workunit.client.1.smithi142.stdout:3/952: creat d12/d16/d25/d2e/d38/f130 x:0 0 0 2024-09-13T02:52:56.419 INFO:tasks.workunit.client.0.smithi098.stdout:5/460: dread d0/d29/f39 [0,4194304] 0 2024-09-13T02:52:56.421 INFO:tasks.workunit.client.0.smithi098.stdout:5/461: write d0/d15/d17/d1c/f6c [2379233,37187] 0 2024-09-13T02:52:56.422 INFO:tasks.workunit.client.0.smithi098.stdout:1/563: truncate d9/f84 4033924 0 2024-09-13T02:52:56.423 INFO:tasks.workunit.client.0.smithi098.stdout:0/521: rmdir dd/df/d1d/d26/d37 39 2024-09-13T02:52:56.424 INFO:tasks.workunit.client.0.smithi098.stdout:5/462: creat d0/d15/d17/d1c/f9c x:0 0 0 2024-09-13T02:52:56.425 INFO:tasks.workunit.client.1.smithi142.stdout:4/976: write d0/d2b/d2d/d31/d32/daa/f110 [18648,81143] 0 2024-09-13T02:52:56.425 INFO:tasks.workunit.client.0.smithi098.stdout:1/564: dread - d9/d33/fa4 zero size 2024-09-13T02:52:56.428 INFO:tasks.workunit.client.0.smithi098.stdout:5/463: creat d0/d15/d17/d1c/f9d x:0 0 0 2024-09-13T02:52:56.428 INFO:tasks.workunit.client.0.smithi098.stdout:5/464: write d0/d15/f8d [201569,97907] 0 2024-09-13T02:52:56.429 INFO:tasks.workunit.client.1.smithi142.stdout:4/977: creat d0/d2b/d2d/d31/f13e x:0 0 0 2024-09-13T02:52:56.429 INFO:tasks.workunit.client.0.smithi098.stdout:5/465: truncate d0/d57/f91 282684 0 2024-09-13T02:52:56.430 INFO:tasks.workunit.client.0.smithi098.stdout:1/565: mknod d9/d33/d19/cd2 0 2024-09-13T02:52:56.430 INFO:tasks.workunit.client.0.smithi098.stdout:5/466: stat d0/d29 0 2024-09-13T02:52:56.431 INFO:tasks.workunit.client.0.smithi098.stdout:0/522: mkdir dd/df/d1d/da7 0 2024-09-13T02:52:56.435 INFO:tasks.workunit.client.0.smithi098.stdout:5/467: mkdir d0/d38/d3f/d81/d9e 0 2024-09-13T02:52:56.435 INFO:tasks.workunit.client.1.smithi142.stdout:2/911: dwrite d1/de/d31/f62 [0,4194304] 0 2024-09-13T02:52:56.435 INFO:tasks.workunit.client.0.smithi098.stdout:5/468: readlink d0/d38/l51 0 2024-09-13T02:52:56.436 INFO:tasks.workunit.client.0.smithi098.stdout:5/469: write d0/d15/d17/d1c/f9c [1004847,111283] 0 2024-09-13T02:52:56.437 INFO:tasks.workunit.client.1.smithi142.stdout:2/912: read - d1/de/d1f/d13/f89 zero size 2024-09-13T02:52:56.437 INFO:tasks.workunit.client.1.smithi142.stdout:3/953: dwrite d12/d16/d3c/fd2 [0,4194304] 0 2024-09-13T02:52:56.441 INFO:tasks.workunit.client.0.smithi098.stdout:0/523: symlink dd/d1f/la8 0 2024-09-13T02:52:56.470 INFO:tasks.workunit.client.1.smithi142.stdout:8/866: sync 2024-09-13T02:52:56.471 INFO:tasks.workunit.client.1.smithi142.stdout:8/867: chown d0/d6/dc/d45/d35/d61/d77/lcd 0 1 2024-09-13T02:52:56.499 INFO:tasks.workunit.client.0.smithi098.stdout:8/445: sync 2024-09-13T02:52:56.501 INFO:tasks.workunit.client.1.smithi142.stdout:4/978: write d0/d2b/d21/d35/ffc [638886,7347] 0 2024-09-13T02:52:56.506 INFO:tasks.workunit.client.0.smithi098.stdout:8/446: creat d2/d2f/d78/d46/d74/d86/f8e x:0 0 0 2024-09-13T02:52:56.506 INFO:tasks.workunit.client.0.smithi098.stdout:1/566: write d9/d33/d19/d35/d68/d2f/dbf/f85 [645190,86178] 0 2024-09-13T02:52:56.508 INFO:tasks.workunit.client.1.smithi142.stdout:2/913: rename d1/d29/d72/fca to d1/de/d31/f120 0 2024-09-13T02:52:56.509 INFO:tasks.workunit.client.1.smithi142.stdout:4/979: creat d0/d2b/dd8/f13f x:0 0 0 2024-09-13T02:52:56.510 INFO:tasks.workunit.client.0.smithi098.stdout:8/447: symlink d2/dd/l8f 0 2024-09-13T02:52:56.510 INFO:tasks.workunit.client.0.smithi098.stdout:0/524: write dd/df/d1d/f2f [467507,71688] 0 2024-09-13T02:52:56.511 INFO:tasks.workunit.client.0.smithi098.stdout:8/448: stat d2/dd/d11/d49/f85 0 2024-09-13T02:52:56.513 INFO:tasks.workunit.client.1.smithi142.stdout:3/954: dread d12/d16/d25/d2e/d38/f6d [0,4194304] 0 2024-09-13T02:52:56.516 INFO:tasks.workunit.client.1.smithi142.stdout:2/914: mkdir d1/d2d/db2/d121 0 2024-09-13T02:52:56.516 INFO:tasks.workunit.client.1.smithi142.stdout:2/915: chown d1/de/f17 47 1 2024-09-13T02:52:56.516 INFO:tasks.workunit.client.1.smithi142.stdout:4/980: mkdir d0/d2b/d2d/da2/d140 0 2024-09-13T02:52:56.517 INFO:tasks.workunit.client.1.smithi142.stdout:4/981: chown d0/df/da5/dad/dae/fcd 389 1 2024-09-13T02:52:56.517 INFO:tasks.workunit.client.1.smithi142.stdout:8/868: getdents d0/d6/dc/d45/d8/d117 0 2024-09-13T02:52:56.518 INFO:tasks.workunit.client.1.smithi142.stdout:2/916: creat d1/de/da6/d10c/f122 x:0 0 0 2024-09-13T02:52:56.519 INFO:tasks.workunit.client.1.smithi142.stdout:4/982: mkdir d0/d2b/d2d/d31/d43/d48/d141 0 2024-09-13T02:52:56.521 INFO:tasks.workunit.client.1.smithi142.stdout:8/869: rmdir d0/d6/dc/d10e/d115 0 2024-09-13T02:52:56.522 INFO:tasks.workunit.client.1.smithi142.stdout:3/955: dwrite d12/d16/d25/d2e/d38/d4d/d53/d78/fe2 [0,4194304] 0 2024-09-13T02:52:56.524 INFO:tasks.workunit.client.1.smithi142.stdout:8/870: write d0/d6/dc/d45/d35/f100 [720877,71351] 0 2024-09-13T02:52:56.524 INFO:tasks.workunit.client.1.smithi142.stdout:4/983: truncate d0/d2b/d2d/d11f/dcf/fd6 1132441 0 2024-09-13T02:52:56.526 INFO:tasks.workunit.client.1.smithi142.stdout:3/956: read d12/d16/d25/d2e/d48/d5c/d8c/f9a [133059,87307] 0 2024-09-13T02:52:56.527 INFO:tasks.workunit.client.1.smithi142.stdout:3/957: chown d12/dd3/db6/cfd 161945 1 2024-09-13T02:52:56.528 INFO:tasks.workunit.client.1.smithi142.stdout:8/871: dread d0/d6/dc/d45/d8/df/f99 [0,4194304] 0 2024-09-13T02:52:56.529 INFO:tasks.workunit.client.1.smithi142.stdout:4/984: fdatasync d0/d2b/d75/f91 0 2024-09-13T02:52:56.529 INFO:tasks.workunit.client.1.smithi142.stdout:4/985: readlink d0/d2b/lf1 0 2024-09-13T02:52:56.533 INFO:tasks.workunit.client.1.smithi142.stdout:4/986: mknod d0/d2b/d2d/d31/d43/daf/c142 0 2024-09-13T02:52:56.535 INFO:tasks.workunit.client.1.smithi142.stdout:8/872: mkdir d0/d6/dc/d11d 0 2024-09-13T02:52:56.535 INFO:tasks.workunit.client.1.smithi142.stdout:4/987: rmdir d0/d2b/d2d/d11f 39 2024-09-13T02:52:56.539 INFO:tasks.workunit.client.1.smithi142.stdout:4/988: creat d0/d2b/d2d/d65/df5/f143 x:0 0 0 2024-09-13T02:52:56.539 INFO:tasks.workunit.client.1.smithi142.stdout:2/917: write d1/de/f10 [1961192,124318] 0 2024-09-13T02:52:56.540 INFO:tasks.workunit.client.1.smithi142.stdout:2/918: chown d1/de/da6/dbb/d92/fbf 2144 1 2024-09-13T02:52:56.542 INFO:tasks.workunit.client.1.smithi142.stdout:2/919: write d1/d2d/ff6 [84733,94024] 0 2024-09-13T02:52:56.543 INFO:tasks.workunit.client.1.smithi142.stdout:4/989: unlink d0/d2b/d2d/d31/d43/fa9 0 2024-09-13T02:52:56.543 INFO:tasks.workunit.client.1.smithi142.stdout:8/873: getdents d0/d6/dc/d45/d9d/d10c/dc9/d113 0 2024-09-13T02:52:56.545 INFO:tasks.workunit.client.1.smithi142.stdout:2/920: mknod d1/d42/c123 0 2024-09-13T02:52:56.548 INFO:tasks.workunit.client.1.smithi142.stdout:2/921: creat d1/de/d1f/d13/d60/da9/d10d/f124 x:0 0 0 2024-09-13T02:52:56.549 INFO:tasks.workunit.client.1.smithi142.stdout:4/990: dwrite d0/d2b/d21/d30/f3a [0,4194304] 0 2024-09-13T02:52:56.553 INFO:tasks.workunit.client.1.smithi142.stdout:4/991: truncate d0/d2b/d2d/d31/f8b 3992084 0 2024-09-13T02:52:56.556 INFO:tasks.workunit.client.0.smithi098.stdout:6/443: sync 2024-09-13T02:52:56.556 INFO:tasks.workunit.client.0.smithi098.stdout:2/406: sync 2024-09-13T02:52:56.556 INFO:tasks.workunit.client.0.smithi098.stdout:7/665: sync 2024-09-13T02:52:56.556 INFO:tasks.workunit.client.0.smithi098.stdout:3/481: sync 2024-09-13T02:52:56.556 INFO:tasks.workunit.client.0.smithi098.stdout:9/511: sync 2024-09-13T02:52:56.557 INFO:tasks.workunit.client.0.smithi098.stdout:4/458: sync 2024-09-13T02:52:56.558 INFO:tasks.workunit.client.1.smithi142.stdout:2/922: dread d1/de/d31/f3d [4194304,4194304] 0 2024-09-13T02:52:56.559 INFO:tasks.workunit.client.1.smithi142.stdout:4/992: dread d0/d2b/f38 [0,4194304] 0 2024-09-13T02:52:56.561 INFO:tasks.workunit.client.1.smithi142.stdout:4/993: creat d0/d2b/d21/d30/f144 x:0 0 0 2024-09-13T02:52:56.562 INFO:tasks.workunit.client.0.smithi098.stdout:1/567: rename d9/d33/d19/d35/d68/d4d/dbc/d23/da7/d51/d8f/d5f to d9/d33/d19/d35/d68/d4d/db5/dd3 0 2024-09-13T02:52:56.563 INFO:tasks.workunit.client.1.smithi142.stdout:2/923: getdents d1/de/da6/d10c 0 2024-09-13T02:52:56.565 INFO:tasks.workunit.client.0.smithi098.stdout:1/568: chown d9/lb 292217 1 2024-09-13T02:52:56.566 INFO:tasks.workunit.client.0.smithi098.stdout:9/512: readlink d2/d6/d2b/d4d/l6d 0 2024-09-13T02:52:56.567 INFO:tasks.workunit.client.0.smithi098.stdout:3/482: rmdir d7/d9/d15 39 2024-09-13T02:52:56.567 INFO:tasks.workunit.client.0.smithi098.stdout:6/444: write d5/d13/f3f [4676491,95964] 0 2024-09-13T02:52:56.567 INFO:tasks.workunit.client.1.smithi142.stdout:2/924: truncate d1/de/d1f/d9c/f9e 350631 0 2024-09-13T02:52:56.568 INFO:tasks.workunit.client.0.smithi098.stdout:4/459: write d6/d22/d3d/d41/d58/f78 [11803,114505] 0 2024-09-13T02:52:56.571 INFO:tasks.workunit.client.1.smithi142.stdout:4/994: getdents d0/d2b/d2d/d31/d32/daa 0 2024-09-13T02:52:56.572 INFO:tasks.workunit.client.0.smithi098.stdout:7/666: read d6/d24/d46/f5c [1359977,13709] 0 2024-09-13T02:52:56.572 INFO:tasks.workunit.client.0.smithi098.stdout:6/445: chown d5/d13/d2b/d3a/c26 1034014149 1 2024-09-13T02:52:56.573 INFO:tasks.workunit.client.0.smithi098.stdout:0/525: dwrite dd/df/d1d/d40/d46/d6b/f9f [0,4194304] 0 2024-09-13T02:52:56.575 INFO:tasks.workunit.client.0.smithi098.stdout:2/407: creat d1/d1a/d9/d1e/d5a/f86 x:0 0 0 2024-09-13T02:52:56.575 INFO:tasks.workunit.client.0.smithi098.stdout:7/667: readlink d6/d24/d2a/d57/l5b 0 2024-09-13T02:52:56.576 INFO:tasks.workunit.client.1.smithi142.stdout:2/925: mkdir d1/de/da6/dbb/d125 0 2024-09-13T02:52:56.579 INFO:tasks.workunit.client.0.smithi098.stdout:1/569: rmdir d9/d33/d29/d58 39 2024-09-13T02:52:56.580 INFO:tasks.workunit.client.0.smithi098.stdout:4/460: dwrite d6/db/f2f [0,4194304] 0 2024-09-13T02:52:56.581 INFO:tasks.workunit.client.1.smithi142.stdout:4/995: creat d0/d2b/d2d/d31/dd4/f145 x:0 0 0 2024-09-13T02:52:56.582 INFO:tasks.workunit.client.0.smithi098.stdout:4/461: write d6/d37/d7a/fa1 [602023,43305] 0 2024-09-13T02:52:56.583 INFO:tasks.workunit.client.0.smithi098.stdout:9/513: dread - d2/d6/d36/f38 zero size 2024-09-13T02:52:56.587 INFO:tasks.workunit.client.0.smithi098.stdout:8/449: getdents d2/d28/d43 0 2024-09-13T02:52:56.587 INFO:tasks.workunit.client.0.smithi098.stdout:8/450: readlink d2/dd/l3c 0 2024-09-13T02:52:56.593 INFO:tasks.workunit.client.0.smithi098.stdout:6/446: mknod d5/d36/c99 0 2024-09-13T02:52:56.595 INFO:tasks.workunit.client.1.smithi142.stdout:4/996: link d0/d2b/d2d/d11f/de8/f12b d0/d2b/d21/d139/f146 0 2024-09-13T02:52:56.597 INFO:tasks.workunit.client.1.smithi142.stdout:4/997: chown d0/d2b/d21/d35/la3 1980 1 2024-09-13T02:52:56.600 INFO:tasks.workunit.client.1.smithi142.stdout:2/926: dwrite d1/de/d1f/d13/d60/da9/d10d/f11f [0,4194304] 0 2024-09-13T02:52:56.601 INFO:tasks.workunit.client.0.smithi098.stdout:9/514: unlink d2/d6/d36/d8d/c12 0 2024-09-13T02:52:56.604 INFO:tasks.workunit.client.0.smithi098.stdout:4/462: rename d6/d22/d3d/d41/f45 to d6/d54/fa7 0 2024-09-13T02:52:56.606 INFO:tasks.workunit.client.1.smithi142.stdout:4/998: creat d0/d2b/d2d/d31/d43/d48/dcc/df9/f147 x:0 0 0 2024-09-13T02:52:56.607 INFO:tasks.workunit.client.1.smithi142.stdout:2/927: readlink d1/l2e 0 2024-09-13T02:52:56.608 INFO:tasks.workunit.client.0.smithi098.stdout:2/408: write d1/d1a/f3a [2907108,60260] 0 2024-09-13T02:52:56.611 INFO:tasks.workunit.client.1.smithi142.stdout:2/928: mknod d1/de/d31/d6c/d6d/c126 0 2024-09-13T02:52:56.613 INFO:tasks.workunit.client.0.smithi098.stdout:0/526: creat dd/df/d1d/d26/d28/d32/da1/fa9 x:0 0 0 2024-09-13T02:52:56.614 INFO:tasks.workunit.client.1.smithi142.stdout:4/999: creat d0/f148 x:0 0 0 2024-09-13T02:52:56.614 INFO:tasks.workunit.client.0.smithi098.stdout:1/570: dwrite d9/d33/d19/d35/d68/d4d/db5/db8/fc8 [0,4194304] 0 2024-09-13T02:52:56.617 INFO:tasks.workunit.client.1.smithi142.stdout:2/929: truncate d1/d2d/f40 4953379 0 2024-09-13T02:52:56.619 INFO:tasks.workunit.client.0.smithi098.stdout:9/515: mknod d2/d6/d2b/d4d/d4f/cba 0 2024-09-13T02:52:56.620 INFO:tasks.workunit.client.0.smithi098.stdout:4/463: fdatasync d6/d22/d3d/d4d/f57 0 2024-09-13T02:52:56.621 INFO:tasks.workunit.client.0.smithi098.stdout:0/527: dwrite f4 [0,4194304] 0 2024-09-13T02:52:56.621 INFO:tasks.workunit.client.0.smithi098.stdout:3/483: write d7/d9/d25/d2b/f2c [206457,90920] 0 2024-09-13T02:52:56.622 INFO:tasks.workunit.client.1.smithi142.stdout:2/930: creat d1/d2d/f127 x:0 0 0 2024-09-13T02:52:56.623 INFO:tasks.workunit.client.1.smithi142.stdout:8/874: sync 2024-09-13T02:52:56.623 INFO:tasks.workunit.client.1.smithi142.stdout:3/958: sync 2024-09-13T02:52:56.623 INFO:tasks.workunit.client.0.smithi098.stdout:8/451: mknod d2/dd/d11/c90 0 2024-09-13T02:52:56.623 INFO:tasks.workunit.client.0.smithi098.stdout:8/452: readlink d2/l19 0 2024-09-13T02:52:56.624 INFO:tasks.workunit.client.1.smithi142.stdout:3/959: chown d12/d16/d3c/d12f 5769540 1 2024-09-13T02:52:56.624 INFO:tasks.workunit.client.1.smithi142.stdout:2/931: read d1/fb5 [1656193,28762] 0 2024-09-13T02:52:56.629 INFO:tasks.workunit.client.1.smithi142.stdout:8/875: symlink d0/d6/dc/d45/d9d/d10c/l11e 0 2024-09-13T02:52:56.631 INFO:tasks.workunit.client.0.smithi098.stdout:7/668: creat d6/fdb x:0 0 0 2024-09-13T02:52:56.633 INFO:tasks.workunit.client.0.smithi098.stdout:0/528: dread dd/df/d1d/d40/f6c [0,4194304] 0 2024-09-13T02:52:56.636 INFO:tasks.workunit.client.1.smithi142.stdout:2/932: rename d1/de/d31/d6c/d6d/f34 to d1/de/da6/dbb/dc2/dfa/f128 0 2024-09-13T02:52:56.638 INFO:tasks.workunit.client.0.smithi098.stdout:9/516: fdatasync d2/d6/d2b/f47 0 2024-09-13T02:52:56.639 INFO:tasks.workunit.client.0.smithi098.stdout:4/464: rmdir d6/d22/d3d/d41/d58 39 2024-09-13T02:52:56.642 INFO:tasks.workunit.client.0.smithi098.stdout:3/484: truncate d7/d9/d15/d2d/d5b/f45 1279785 0 2024-09-13T02:52:56.643 INFO:tasks.workunit.client.0.smithi098.stdout:3/485: chown d7/d9/d25/d3a/d52/l59 43445 1 2024-09-13T02:52:56.644 INFO:tasks.workunit.client.0.smithi098.stdout:8/453: write d2/f4e [2211302,99338] 0 2024-09-13T02:52:56.645 INFO:tasks.workunit.client.1.smithi142.stdout:3/960: dread d12/d16/d25/f4f [0,4194304] 0 2024-09-13T02:52:56.646 INFO:tasks.workunit.client.0.smithi098.stdout:2/409: read d1/d1f/f66 [527753,74792] 0 2024-09-13T02:52:56.648 INFO:tasks.workunit.client.1.smithi142.stdout:8/876: creat d0/d6/dc/f11f x:0 0 0 2024-09-13T02:52:56.650 INFO:tasks.workunit.client.0.smithi098.stdout:6/447: mkdir d5/d13/d2b/d3a/d14/d6b/d9a 0 2024-09-13T02:52:56.650 INFO:tasks.workunit.client.0.smithi098.stdout:0/529: dread dd/f2d [0,4194304] 0 2024-09-13T02:52:56.652 INFO:tasks.workunit.client.1.smithi142.stdout:2/933: creat d1/de/d31/d6c/f129 x:0 0 0 2024-09-13T02:52:56.653 INFO:tasks.workunit.client.1.smithi142.stdout:8/877: dwrite d0/d75/ff3 [0,4194304] 0 2024-09-13T02:52:56.655 INFO:tasks.workunit.client.1.smithi142.stdout:3/961: unlink d12/d16/d25/d2e/d38/d4d/fc4 0 2024-09-13T02:52:56.655 INFO:tasks.workunit.client.1.smithi142.stdout:3/962: read - d12/d16/da3/fff zero size 2024-09-13T02:52:56.658 INFO:tasks.workunit.client.0.smithi098.stdout:3/486: dread d7/d9/d25/d3a/d52/f3b [0,4194304] 0 2024-09-13T02:52:56.659 INFO:tasks.workunit.client.1.smithi142.stdout:8/878: unlink d0/d6/dc/d45/d9d/d10c/dc9/d113/lbd 0 2024-09-13T02:52:56.663 INFO:tasks.workunit.client.1.smithi142.stdout:2/934: dread d1/de/f22 [0,4194304] 0 2024-09-13T02:52:56.663 INFO:tasks.workunit.client.0.smithi098.stdout:4/465: dread d6/f61 [0,4194304] 0 2024-09-13T02:52:56.664 INFO:tasks.workunit.client.1.smithi142.stdout:8/879: mkdir d0/d6/dc/d45/d35/d120 0 2024-09-13T02:52:56.670 INFO:tasks.workunit.client.1.smithi142.stdout:2/935: fsync d1/de/d1f/d13/f9b 0 2024-09-13T02:52:56.671 INFO:tasks.workunit.client.0.smithi098.stdout:2/410: dread - d1/d1f/d35/f74 zero size 2024-09-13T02:52:56.674 INFO:tasks.workunit.client.1.smithi142.stdout:3/963: write d12/d16/d25/d2e/d48/d5c/d66/f63 [2001036,85534] 0 2024-09-13T02:52:56.675 INFO:tasks.workunit.client.0.smithi098.stdout:6/448: symlink d5/d13/d2b/d3a/d41/l9b 0 2024-09-13T02:52:56.677 INFO:tasks.workunit.client.0.smithi098.stdout:7/669: creat d6/d24/dc5/fdc x:0 0 0 2024-09-13T02:52:56.681 INFO:tasks.workunit.client.0.smithi098.stdout:8/454: dwrite d2/dd/d4d/f57 [0,4194304] 0 2024-09-13T02:52:56.683 INFO:tasks.workunit.client.0.smithi098.stdout:6/449: dwrite d5/f1e [4194304,4194304] 0 2024-09-13T02:52:56.684 INFO:tasks.workunit.client.1.smithi142.stdout:2/936: creat d1/de/d1f/d13/d60/da9/de9/f12a x:0 0 0 2024-09-13T02:52:56.686 INFO:tasks.workunit.client.1.smithi142.stdout:8/880: dwrite d0/d6/dc/d2e/fb9 [0,4194304] 0 2024-09-13T02:52:56.695 INFO:tasks.workunit.client.1.smithi142.stdout:2/937: fsync d1/de/d31/d6c/f88 0 2024-09-13T02:52:56.697 INFO:tasks.workunit.client.1.smithi142.stdout:3/964: chown d12/d16/d25/d2e/d38/d4d/dad/cee 22329 1 2024-09-13T02:52:56.698 INFO:tasks.workunit.client.1.smithi142.stdout:2/938: read d1/d29/d72/daa/f119 [2940967,83578] 0 2024-09-13T02:52:56.698 INFO:tasks.workunit.client.1.smithi142.stdout:3/965: chown d12/d16/d25/d2e/d48/d5c/f107 13381177 1 2024-09-13T02:52:56.699 INFO:tasks.workunit.client.0.smithi098.stdout:1/571: link d9/d33/d29/d58/f5c d9/d33/d19/d35/d68/d60/d61/db1/fd4 0 2024-09-13T02:52:56.700 INFO:tasks.workunit.client.1.smithi142.stdout:3/966: readlink d12/d16/d3c/d7d/d91/lb0 0 2024-09-13T02:52:56.700 INFO:tasks.workunit.client.1.smithi142.stdout:2/939: fdatasync d1/de/d1f/d13/d60/da9/d10d/f124 0 2024-09-13T02:52:56.701 INFO:tasks.workunit.client.1.smithi142.stdout:3/967: write fe [4315534,58651] 0 2024-09-13T02:52:56.704 INFO:tasks.workunit.client.0.smithi098.stdout:9/517: mknod d2/d6/d36/d8d/d39/cbb 0 2024-09-13T02:52:56.705 INFO:tasks.workunit.client.1.smithi142.stdout:2/940: creat d1/d42/d44/d99/f12b x:0 0 0 2024-09-13T02:52:56.707 INFO:tasks.workunit.client.0.smithi098.stdout:4/466: creat d6/d22/d3d/d41/d74/d98/fa8 x:0 0 0 2024-09-13T02:52:56.708 INFO:tasks.workunit.client.0.smithi098.stdout:0/530: creat dd/df/faa x:0 0 0 2024-09-13T02:52:56.709 INFO:tasks.workunit.client.0.smithi098.stdout:2/411: mknod d1/c87 0 2024-09-13T02:52:56.710 INFO:tasks.workunit.client.1.smithi142.stdout:3/968: dwrite d12/d16/d25/d2e/d38/f45 [0,4194304] 0 2024-09-13T02:52:56.711 INFO:tasks.workunit.client.0.smithi098.stdout:8/455: chown d2/dd/d2e/c65 133 1 2024-09-13T02:52:56.711 INFO:tasks.workunit.client.0.smithi098.stdout:6/450: chown d5/d13/d2b/d3a/d14/d6b/l7a 6925251 1 2024-09-13T02:52:56.712 INFO:tasks.workunit.client.0.smithi098.stdout:8/456: stat d2/d2f/d78 0 2024-09-13T02:52:56.712 INFO:tasks.workunit.client.1.smithi142.stdout:3/969: chown d12/d16/d3c/d79/d9b/l128 508 1 2024-09-13T02:52:56.713 INFO:tasks.workunit.client.0.smithi098.stdout:9/518: mkdir d2/d6/d2b/d4d/d56/dbc 0 2024-09-13T02:52:56.717 INFO:tasks.workunit.client.1.smithi142.stdout:3/970: truncate d12/d16/d3c/d79/fab 1629918 0 2024-09-13T02:52:56.718 INFO:tasks.workunit.client.1.smithi142.stdout:8/881: write d0/f4c [1405700,36695] 0 2024-09-13T02:52:56.723 INFO:tasks.workunit.client.0.smithi098.stdout:4/467: dwrite d6/d22/d3d/d41/d58/f97 [0,4194304] 0 2024-09-13T02:52:56.724 INFO:tasks.workunit.client.1.smithi142.stdout:3/971: chown d12/d16/d3c/d7d/d91/lbb 1561865468 1 2024-09-13T02:52:56.725 INFO:tasks.workunit.client.0.smithi098.stdout:8/457: rename d2/dd/d11/d77 to d2/d91 0 2024-09-13T02:52:56.726 INFO:tasks.workunit.client.0.smithi098.stdout:9/519: creat d2/d6/d2b/d4d/d56/fbd x:0 0 0 2024-09-13T02:52:56.727 INFO:tasks.workunit.client.1.smithi142.stdout:8/882: mknod d0/d6/dc/d45/d9d/c121 0 2024-09-13T02:52:56.729 INFO:tasks.workunit.client.0.smithi098.stdout:6/451: symlink d5/d13/d2b/d3a/d14/d6b/l9c 0 2024-09-13T02:52:56.732 INFO:tasks.workunit.client.0.smithi098.stdout:4/468: mkdir d6/d22/d3d/d41/d58/da9 0 2024-09-13T02:52:56.733 INFO:tasks.workunit.client.0.smithi098.stdout:9/520: mkdir d2/d6/d36/d8d/d39/dac/dbe 0 2024-09-13T02:52:56.735 INFO:tasks.workunit.client.0.smithi098.stdout:8/458: dwrite f1 [0,4194304] 0 2024-09-13T02:52:56.735 INFO:tasks.workunit.client.1.smithi142.stdout:8/883: dwrite d0/d6/dc/d45/f73 [0,4194304] 0 2024-09-13T02:52:56.736 INFO:tasks.workunit.client.0.smithi098.stdout:7/670: dread d6/d24/d46/f64 [0,4194304] 0 2024-09-13T02:52:56.739 INFO:tasks.workunit.client.0.smithi098.stdout:7/671: write d6/d24/d2a/d57/faa [5068263,5607] 0 2024-09-13T02:52:56.740 INFO:tasks.workunit.client.0.smithi098.stdout:4/469: creat d6/d22/d3d/d41/d58/faa x:0 0 0 2024-09-13T02:52:56.743 INFO:tasks.workunit.client.0.smithi098.stdout:1/572: dread d9/d33/f2b [0,4194304] 0 2024-09-13T02:52:56.744 INFO:tasks.workunit.client.0.smithi098.stdout:4/470: chown d6/db/f29 510945547 1 2024-09-13T02:52:56.746 INFO:tasks.workunit.client.0.smithi098.stdout:1/573: chown d9/d33/f66 112579 1 2024-09-13T02:52:56.747 INFO:tasks.workunit.client.0.smithi098.stdout:2/412: dread d1/d1a/f7 [0,4194304] 0 2024-09-13T02:52:56.748 INFO:tasks.workunit.client.0.smithi098.stdout:7/672: fdatasync d6/d24/d2a/d5a/d42/d45/f94 0 2024-09-13T02:52:56.750 INFO:tasks.workunit.client.0.smithi098.stdout:4/471: symlink d6/db/lab 0 2024-09-13T02:52:56.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:56 smithi142 ceph-mon[33443]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 97 MiB/s rd, 250 MiB/s wr, 537 op/s 2024-09-13T02:52:56.752 INFO:tasks.workunit.client.0.smithi098.stdout:2/413: chown d1/d1f/d39/f21 0 1 2024-09-13T02:52:56.754 INFO:tasks.workunit.client.0.smithi098.stdout:1/574: dread - d9/d33/d19/f27 zero size 2024-09-13T02:52:56.757 INFO:tasks.workunit.client.0.smithi098.stdout:4/472: mknod d6/d10/cac 0 2024-09-13T02:52:56.760 INFO:tasks.workunit.client.0.smithi098.stdout:7/673: rename d6/d24/d2a/d5a/d42/ca1 to d6/d24/d2a/d5a/d86/db1/cdd 0 2024-09-13T02:52:56.760 INFO:tasks.workunit.client.0.smithi098.stdout:7/674: dread - d6/d1e/f62 zero size 2024-09-13T02:52:56.761 INFO:tasks.workunit.client.0.smithi098.stdout:2/414: mkdir d1/d1f/d35/d63/d72/d88 0 2024-09-13T02:52:56.762 INFO:tasks.workunit.client.0.smithi098.stdout:2/415: chown d1/d1a/f3a 7031128 1 2024-09-13T02:52:56.764 INFO:tasks.workunit.client.0.smithi098.stdout:2/416: dread - d1/d1f/d35/d63/d23/f81 zero size 2024-09-13T02:52:56.765 INFO:tasks.workunit.client.0.smithi098.stdout:4/473: creat d6/d3e/d68/fad x:0 0 0 2024-09-13T02:52:56.766 INFO:tasks.workunit.client.0.smithi098.stdout:0/531: write dd/df/d1d/d26/d28/d32/f49 [655264,21325] 0 2024-09-13T02:52:56.767 INFO:tasks.workunit.client.0.smithi098.stdout:1/575: symlink d9/d33/d19/d35/d63/dcd/ld5 0 2024-09-13T02:52:56.769 INFO:tasks.workunit.client.0.smithi098.stdout:8/459: truncate d2/dd/f25 1562345 0 2024-09-13T02:52:56.769 INFO:tasks.workunit.client.0.smithi098.stdout:2/417: symlink d1/d1f/d39/l89 0 2024-09-13T02:52:56.770 INFO:tasks.workunit.client.0.smithi098.stdout:2/418: fsync d1/d1f/d39/f21 0 2024-09-13T02:52:56.771 INFO:tasks.workunit.client.0.smithi098.stdout:7/675: mkdir d6/d24/d2a/d5a/d42/dde 0 2024-09-13T02:52:56.773 INFO:tasks.workunit.client.0.smithi098.stdout:7/676: write d6/d1e/fcb [186197,107526] 0 2024-09-13T02:52:56.774 INFO:tasks.workunit.client.0.smithi098.stdout:8/460: fdatasync d2/d2f/d78/f64 0 2024-09-13T02:52:56.774 INFO:tasks.workunit.client.0.smithi098.stdout:4/474: getdents d6/d37/d83 0 2024-09-13T02:52:56.775 INFO:tasks.workunit.client.0.smithi098.stdout:6/452: truncate d5/d13/d51/f7f 566617 0 2024-09-13T02:52:56.775 INFO:tasks.workunit.client.0.smithi098.stdout:2/419: symlink d1/d1a/d9/l8a 0 2024-09-13T02:52:56.776 INFO:tasks.workunit.client.0.smithi098.stdout:4/475: stat d6/d10/l2c 0 2024-09-13T02:52:56.779 INFO:tasks.workunit.client.0.smithi098.stdout:7/677: mkdir d6/d24/d2a/d5a/d8e/dbd/dc3/ddf 0 2024-09-13T02:52:56.781 INFO:tasks.workunit.client.0.smithi098.stdout:4/476: dread d6/d54/f88 [0,4194304] 0 2024-09-13T02:52:56.783 INFO:tasks.workunit.client.0.smithi098.stdout:8/461: rmdir d2/dd/d11/d49 39 2024-09-13T02:52:56.791 INFO:tasks.workunit.client.0.smithi098.stdout:2/420: symlink d1/d1f/d30/l8b 0 2024-09-13T02:52:56.792 INFO:tasks.workunit.client.0.smithi098.stdout:2/421: dread - d1/d1a/d9/d1e/d5a/f5f zero size 2024-09-13T02:52:56.793 INFO:tasks.workunit.client.0.smithi098.stdout:8/462: mknod d2/dd/c92 0 2024-09-13T02:52:56.794 INFO:tasks.workunit.client.0.smithi098.stdout:0/532: write dd/f45 [585363,120291] 0 2024-09-13T02:52:56.795 INFO:tasks.workunit.client.0.smithi098.stdout:1/576: getdents d9/d33/d19/d35/d68/d4d/dbc 0 2024-09-13T02:52:56.800 INFO:tasks.workunit.client.0.smithi098.stdout:6/453: symlink d5/d13/d2b/d3a/d41/d6c/d7c/l9d 0 2024-09-13T02:52:56.801 INFO:tasks.workunit.client.0.smithi098.stdout:0/533: dread dd/df/d1d/d26/d28/f72 [0,4194304] 0 2024-09-13T02:52:56.804 INFO:tasks.workunit.client.0.smithi098.stdout:8/463: dwrite d2/d2f/d78/f4f [0,4194304] 0 2024-09-13T02:52:56.807 INFO:tasks.workunit.client.0.smithi098.stdout:1/577: dwrite d9/d33/d19/d35/d68/d4d/dbc/fb3 [0,4194304] 0 2024-09-13T02:52:56.807 INFO:tasks.workunit.client.0.smithi098.stdout:8/464: write d2/dd/d11/d2c/f76 [785215,99399] 0 2024-09-13T02:52:56.816 INFO:tasks.workunit.client.0.smithi098.stdout:7/678: dwrite d6/d24/f28 [0,4194304] 0 2024-09-13T02:52:56.817 INFO:tasks.workunit.client.0.smithi098.stdout:0/534: chown dd/df/l3b 508 1 2024-09-13T02:52:56.817 INFO:tasks.workunit.client.0.smithi098.stdout:8/465: mknod d2/dd/d11/d44/c93 0 2024-09-13T02:52:56.819 INFO:tasks.workunit.client.0.smithi098.stdout:1/578: creat d9/fd6 x:0 0 0 2024-09-13T02:52:56.820 INFO:tasks.workunit.client.0.smithi098.stdout:4/477: dwrite d6/d10/d21/f25 [0,4194304] 0 2024-09-13T02:52:56.820 INFO:tasks.workunit.client.0.smithi098.stdout:2/422: rmdir d1/d1f/d27/d7c 0 2024-09-13T02:52:56.823 INFO:tasks.workunit.client.0.smithi098.stdout:8/466: write d2/dd/d11/d2c/f76 [34152,92572] 0 2024-09-13T02:52:56.825 INFO:tasks.workunit.client.0.smithi098.stdout:2/423: write d1/d1a/d9/d1e/f47 [2779618,79128] 0 2024-09-13T02:52:56.829 INFO:tasks.workunit.client.1.smithi142.stdout:3/972: sync 2024-09-13T02:52:56.829 INFO:tasks.workunit.client.1.smithi142.stdout:2/941: sync 2024-09-13T02:52:56.830 INFO:tasks.workunit.client.0.smithi098.stdout:7/679: chown d6/d24/d2a/d5a/d42/d45/fc0 464671818 1 2024-09-13T02:52:56.832 INFO:tasks.workunit.client.0.smithi098.stdout:1/579: creat d9/d33/d19/d35/d68/d4d/db5/dcb/fd7 x:0 0 0 2024-09-13T02:52:56.833 INFO:tasks.workunit.client.0.smithi098.stdout:4/478: symlink d6/d22/d3d/d41/d58/da9/lae 0 2024-09-13T02:52:56.833 INFO:tasks.workunit.client.0.smithi098.stdout:2/424: read d1/d1a/d9/d1e/d5a/f60 [278125,113405] 0 2024-09-13T02:52:56.834 INFO:tasks.workunit.client.1.smithi142.stdout:2/942: fsync d1/de/da6/dbb/fa1 0 2024-09-13T02:52:56.835 INFO:tasks.workunit.client.0.smithi098.stdout:7/680: dread d6/d24/d2a/d5a/d42/d45/fc0 [0,4194304] 0 2024-09-13T02:52:56.836 INFO:tasks.workunit.client.1.smithi142.stdout:3/973: chown d12/d16/d25/d2e/d38/d4d/d53/ffb 19 1 2024-09-13T02:52:56.836 INFO:tasks.workunit.client.0.smithi098.stdout:8/467: dwrite d2/d2f/f89 [0,4194304] 0 2024-09-13T02:52:56.836 INFO:tasks.workunit.client.0.smithi098.stdout:2/425: dread - d1/d1f/d35/d63/d72/f78 zero size 2024-09-13T02:52:56.838 INFO:tasks.workunit.client.0.smithi098.stdout:2/426: fsync d1/d1f/d39/f29 0 2024-09-13T02:52:56.839 INFO:tasks.workunit.client.0.smithi098.stdout:2/427: fsync d1/d1f/f42 0 2024-09-13T02:52:56.839 INFO:tasks.workunit.client.0.smithi098.stdout:8/468: rmdir d2/d2f/d78/d46/d74 39 2024-09-13T02:52:56.840 INFO:tasks.workunit.client.1.smithi142.stdout:2/943: dwrite d1/de/d1f/d13/f11d [0,4194304] 0 2024-09-13T02:52:56.841 INFO:tasks.workunit.client.0.smithi098.stdout:8/469: chown d2/d2f/d78/d46/d47 695106 1 2024-09-13T02:52:56.843 INFO:tasks.workunit.client.1.smithi142.stdout:3/974: mknod d12/d16/dc7/dd6/c131 0 2024-09-13T02:52:56.844 INFO:tasks.workunit.client.1.smithi142.stdout:2/944: symlink d1/d29/l12c 0 2024-09-13T02:52:56.845 INFO:tasks.workunit.client.1.smithi142.stdout:2/945: dread - d1/d2d/f127 zero size 2024-09-13T02:52:56.845 INFO:tasks.workunit.client.0.smithi098.stdout:4/479: dwrite d6/d37/f39 [0,4194304] 0 2024-09-13T02:52:56.846 INFO:tasks.workunit.client.0.smithi098.stdout:4/480: fsync d6/d10/f9d 0 2024-09-13T02:52:56.848 INFO:tasks.workunit.client.0.smithi098.stdout:2/428: creat d1/d1a/d4f/f8c x:0 0 0 2024-09-13T02:52:56.853 INFO:tasks.workunit.client.1.smithi142.stdout:2/946: mkdir d1/de/da6/dbb/dc2/d12d 0 2024-09-13T02:52:56.853 INFO:tasks.workunit.client.1.smithi142.stdout:2/947: stat d1/de/da6/dbb/d92/f94 0 2024-09-13T02:52:56.856 INFO:tasks.workunit.client.0.smithi098.stdout:2/429: mknod d1/d1a/d9/d1e/c8d 0 2024-09-13T02:52:56.858 INFO:tasks.workunit.client.0.smithi098.stdout:8/470: creat d2/d2f/d78/d46/d74/f94 x:0 0 0 2024-09-13T02:52:56.859 INFO:tasks.workunit.client.0.smithi098.stdout:8/471: chown d2/dd/d11/f4c 3 1 2024-09-13T02:52:56.859 INFO:tasks.workunit.client.0.smithi098.stdout:4/481: getdents d6/d22/d3d/d64/d6f 0 2024-09-13T02:52:56.861 INFO:tasks.workunit.client.0.smithi098.stdout:8/472: write d2/dd/d11/d1d/f45 [519611,68175] 0 2024-09-13T02:52:56.861 INFO:tasks.workunit.client.0.smithi098.stdout:1/580: fsync d9/fd6 0 2024-09-13T02:52:56.862 INFO:tasks.workunit.client.0.smithi098.stdout:8/473: fdatasync d2/dd/d4d/f57 0 2024-09-13T02:52:56.863 INFO:tasks.workunit.client.0.smithi098.stdout:1/581: write d9/d33/d29/fa8 [678556,11001] 0 2024-09-13T02:52:56.864 INFO:tasks.workunit.client.0.smithi098.stdout:4/482: chown d6/f1c 0 1 2024-09-13T02:52:56.866 INFO:tasks.workunit.client.0.smithi098.stdout:4/483: chown d6/d22/d3d/d64/f6d 21219 1 2024-09-13T02:52:56.869 INFO:tasks.workunit.client.1.smithi142.stdout:2/948: creat d1/de/da6/dbb/f12e x:0 0 0 2024-09-13T02:52:56.871 INFO:tasks.workunit.client.1.smithi142.stdout:8/884: sync 2024-09-13T02:52:56.873 INFO:tasks.workunit.client.0.smithi098.stdout:4/484: mkdir d6/d22/d3d/d41/d74/d98/daf 0 2024-09-13T02:52:56.873 INFO:tasks.workunit.client.0.smithi098.stdout:2/430: link d1/d1f/d35/f45 d1/d1f/d39/f8e 0 2024-09-13T02:52:56.875 INFO:tasks.workunit.client.0.smithi098.stdout:2/431: dread - d1/d1f/d35/f83 zero size 2024-09-13T02:52:56.875 INFO:tasks.workunit.client.1.smithi142.stdout:2/949: creat d1/de/d31/db0/f12f x:0 0 0 2024-09-13T02:52:56.876 INFO:tasks.workunit.client.1.smithi142.stdout:2/950: chown d1/de/d1f/d13/l4e 281 1 2024-09-13T02:52:56.877 INFO:tasks.workunit.client.1.smithi142.stdout:2/951: read d1/de/d31/d6c/f88 [105958,53010] 0 2024-09-13T02:52:56.877 INFO:tasks.workunit.client.0.smithi098.stdout:8/474: link d2/dd/d11/d1d/f3e d2/d2f/d78/d5d/f95 0 2024-09-13T02:52:56.878 INFO:tasks.workunit.client.0.smithi098.stdout:8/475: fdatasync d2/d2f/d78/f4f 0 2024-09-13T02:52:56.879 INFO:tasks.workunit.client.0.smithi098.stdout:8/476: chown d2/dd/d11/d1d/c7a 12289 1 2024-09-13T02:52:56.881 INFO:tasks.workunit.client.0.smithi098.stdout:8/477: read d2/d2f/f89 [3928211,89514] 0 2024-09-13T02:52:56.884 INFO:tasks.workunit.client.1.smithi142.stdout:3/975: write d12/f13 [1414032,127097] 0 2024-09-13T02:52:56.886 INFO:tasks.workunit.client.1.smithi142.stdout:3/976: dread d12/d16/d25/d2e/d48/d5c/d8c/f98 [0,4194304] 0 2024-09-13T02:52:56.886 INFO:tasks.workunit.client.0.smithi098.stdout:1/582: dread d9/d33/d19/d35/d68/d4d/dbc/d23/da7/d51/f98 [0,4194304] 0 2024-09-13T02:52:56.887 INFO:tasks.workunit.client.1.smithi142.stdout:8/885: rename d0/d6/dc/d40/l60 to d0/d6/dc/d40/d41/de2/l122 0 2024-09-13T02:52:56.887 INFO:tasks.workunit.client.1.smithi142.stdout:3/977: dread - d12/d16/d25/d2e/d38/f130 zero size 2024-09-13T02:52:56.888 INFO:tasks.workunit.client.0.smithi098.stdout:2/432: fsync d1/d1a/f3a 0 2024-09-13T02:52:56.888 INFO:tasks.workunit.client.0.smithi098.stdout:2/433: chown d1/d1f/d30 4006209 1 2024-09-13T02:52:56.888 INFO:tasks.workunit.client.1.smithi142.stdout:8/886: chown d0/d6/dc/d11d 3946515 1 2024-09-13T02:52:56.888 INFO:tasks.workunit.client.1.smithi142.stdout:2/952: getdents d1/de/d31/d6c/d6d/d113 0 2024-09-13T02:52:56.889 INFO:tasks.workunit.client.1.smithi142.stdout:8/887: chown d0/d6/dc/d45/d35/d37/f54 6 1 2024-09-13T02:52:56.891 INFO:tasks.workunit.client.1.smithi142.stdout:2/953: symlink d1/d2d/db2/l130 0 2024-09-13T02:52:56.893 INFO:tasks.workunit.client.0.smithi098.stdout:1/583: symlink d9/d33/d29/d58/ld8 0 2024-09-13T02:52:56.894 INFO:tasks.workunit.client.0.smithi098.stdout:1/584: write d9/d33/d29/fa8 [914905,45931] 0 2024-09-13T02:52:56.896 INFO:tasks.workunit.client.1.smithi142.stdout:2/954: mkdir d1/de/d31/d6c/d6d/d47/d131 0 2024-09-13T02:52:56.899 INFO:tasks.workunit.client.0.smithi098.stdout:8/478: rename d2/dd/d11/d49 to d2/dd/d4d/d96 0 2024-09-13T02:52:56.900 INFO:tasks.workunit.client.0.smithi098.stdout:4/485: link d6/d10/d21/ca4 d6/d54/cb0 0 2024-09-13T02:52:56.901 INFO:tasks.workunit.client.0.smithi098.stdout:4/486: dread - d6/d3e/d68/fad zero size 2024-09-13T02:52:56.902 INFO:tasks.workunit.client.1.smithi142.stdout:2/955: rename d1/de/d1f/d9c/ff0 to d1/de/d1f/d13/f132 0 2024-09-13T02:52:56.902 INFO:tasks.workunit.client.1.smithi142.stdout:2/956: fsync d1/de/d31/d6c/f129 0 2024-09-13T02:52:56.903 INFO:tasks.workunit.client.1.smithi142.stdout:3/978: link d12/d16/d3c/d79/d9b/fd7 d12/d16/d25/d2e/d127/f132 0 2024-09-13T02:52:56.903 INFO:tasks.workunit.client.1.smithi142.stdout:2/957: chown d1/de/d31/d6c/d6d/db6/ff5 124266 1 2024-09-13T02:52:56.904 INFO:tasks.workunit.client.1.smithi142.stdout:2/958: stat d1/de/d1f/f63 0 2024-09-13T02:52:56.904 INFO:tasks.workunit.client.1.smithi142.stdout:3/979: chown d12/d16/d25/d2e/d48/d5c/d123/dae/f11e 502869599 1 2024-09-13T02:52:56.904 INFO:tasks.workunit.client.1.smithi142.stdout:8/888: link d0/d6/dc/d45/d8/df/l34 d0/d6/dc/d45/d9d/l123 0 2024-09-13T02:52:56.907 INFO:tasks.workunit.client.0.smithi098.stdout:4/487: dwrite d6/d22/f63 [4194304,4194304] 0 2024-09-13T02:52:56.911 INFO:tasks.workunit.client.0.smithi098.stdout:2/434: creat d1/f8f x:0 0 0 2024-09-13T02:52:56.911 INFO:tasks.workunit.client.0.smithi098.stdout:2/435: chown d1/d1f/d27 321339 1 2024-09-13T02:52:56.912 INFO:tasks.workunit.client.0.smithi098.stdout:2/436: stat d1/d1f/d35/d63 0 2024-09-13T02:52:56.913 INFO:tasks.workunit.client.1.smithi142.stdout:2/959: truncate d1/de/d1f/d13/f3c 170669 0 2024-09-13T02:52:56.914 INFO:tasks.workunit.client.1.smithi142.stdout:2/960: write d1/de/d1f/d13/d59/f104 [718031,16460] 0 2024-09-13T02:52:56.917 INFO:tasks.workunit.client.0.smithi098.stdout:4/488: rmdir d6/db 39 2024-09-13T02:52:56.919 INFO:tasks.workunit.client.1.smithi142.stdout:8/889: symlink d0/d6/dc/d40/d46/l124 0 2024-09-13T02:52:56.920 INFO:tasks.workunit.client.1.smithi142.stdout:8/890: fsync d0/d6/dc/d45/d8/f36 0 2024-09-13T02:52:56.921 INFO:tasks.workunit.client.0.smithi098.stdout:8/479: creat d2/dd/d11/f97 x:0 0 0 2024-09-13T02:52:56.924 INFO:tasks.workunit.client.0.smithi098.stdout:1/585: dread d9/d33/d19/d35/d68/f18 [0,4194304] 0 2024-09-13T02:52:56.925 INFO:tasks.workunit.client.1.smithi142.stdout:3/980: creat d12/d16/d25/d2e/f133 x:0 0 0 2024-09-13T02:52:56.925 INFO:tasks.workunit.client.0.smithi098.stdout:4/489: stat d6/d22/d3d 0 2024-09-13T02:52:56.926 INFO:tasks.workunit.client.0.smithi098.stdout:2/437: fsync d1/d1f/d35/f45 0 2024-09-13T02:52:56.929 INFO:tasks.workunit.client.0.smithi098.stdout:1/586: dread d9/d33/d19/d35/d68/d2f/f3e [0,4194304] 0 2024-09-13T02:52:56.930 INFO:tasks.workunit.client.0.smithi098.stdout:8/480: unlink d2/dd/d11/d2c/c56 0 2024-09-13T02:52:56.931 INFO:tasks.workunit.client.1.smithi142.stdout:8/891: rmdir d0/d6/dc/d45/d9d/d10c 39 2024-09-13T02:52:56.934 INFO:tasks.workunit.client.1.smithi142.stdout:3/981: mknod d12/d16/d3c/d79/d9e/c134 0 2024-09-13T02:52:56.936 INFO:tasks.workunit.client.1.smithi142.stdout:2/961: creat d1/f133 x:0 0 0 2024-09-13T02:52:56.937 INFO:tasks.workunit.client.1.smithi142.stdout:8/892: dwrite d0/d6/dc/d40/d41/f4e [4194304,4194304] 0 2024-09-13T02:52:56.937 INFO:tasks.workunit.client.1.smithi142.stdout:2/962: chown d1/d42/d44/lf3 17626019 1 2024-09-13T02:52:56.940 INFO:tasks.workunit.client.1.smithi142.stdout:2/963: write d1/d42/d44/f108 [355960,53331] 0 2024-09-13T02:52:56.941 INFO:tasks.workunit.client.1.smithi142.stdout:3/982: symlink d12/d16/d3c/d7d/d91/l135 0 2024-09-13T02:52:56.942 INFO:tasks.workunit.client.1.smithi142.stdout:2/964: write d1/de/da6/dbb/f3f [3325,117693] 0 2024-09-13T02:52:56.946 INFO:tasks.workunit.client.1.smithi142.stdout:3/983: mknod d12/d16/d25/d2e/d38/d5a/c136 0 2024-09-13T02:52:56.947 INFO:tasks.workunit.client.1.smithi142.stdout:8/893: creat d0/d6/dc/d40/f125 x:0 0 0 2024-09-13T02:52:56.953 INFO:tasks.workunit.client.1.smithi142.stdout:8/894: dwrite d0/d6/dc/d45/d8/d117/f107 [0,4194304] 0 2024-09-13T02:52:56.957 INFO:tasks.workunit.client.1.smithi142.stdout:8/895: rmdir d0/d6/dc/d40/d46/dfe 0 2024-09-13T02:52:56.958 INFO:tasks.workunit.client.1.smithi142.stdout:3/984: rmdir d12/d16/d3c/d7d 39 2024-09-13T02:52:56.961 INFO:tasks.workunit.client.1.smithi142.stdout:2/965: write d1/d29/d72/f87 [737786,66150] 0 2024-09-13T02:52:56.963 INFO:tasks.workunit.client.1.smithi142.stdout:2/966: chown d1/d2d/f40 899 1 2024-09-13T02:52:56.965 INFO:tasks.workunit.client.1.smithi142.stdout:2/967: mkdir d1/de/d31/d6c/d6d/d47/da8/d134 0 2024-09-13T02:52:56.966 INFO:tasks.workunit.client.1.smithi142.stdout:2/968: read d1/de/d1f/d13/f3c [20870,75559] 0 2024-09-13T02:52:56.967 INFO:tasks.workunit.client.1.smithi142.stdout:2/969: creat d1/de/d1f/d13/d59/f135 x:0 0 0 2024-09-13T02:52:56.971 INFO:tasks.workunit.client.1.smithi142.stdout:8/896: write d0/d6/dc/d2e/fb7 [4432155,41402] 0 2024-09-13T02:52:56.972 INFO:tasks.workunit.client.1.smithi142.stdout:3/985: write d12/d16/d25/d2e/d38/d4d/d53/d78/fc5 [2007106,89606] 0 2024-09-13T02:52:56.972 INFO:tasks.workunit.client.1.smithi142.stdout:2/970: rmdir d1/de/d31/d6c/d6d/d47/da8 39 2024-09-13T02:52:56.973 INFO:tasks.workunit.client.1.smithi142.stdout:2/971: write d1/de/d31/f62 [3729444,82814] 0 2024-09-13T02:52:56.974 INFO:tasks.workunit.client.1.smithi142.stdout:3/986: creat d12/dd3/db6/f137 x:0 0 0 2024-09-13T02:52:56.974 INFO:tasks.workunit.client.1.smithi142.stdout:2/972: chown d1/de/da6/dbb/d125 7240430 1 2024-09-13T02:52:56.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:56 smithi098 ceph-mon[27886]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 97 MiB/s rd, 250 MiB/s wr, 537 op/s 2024-09-13T02:52:57.017 INFO:tasks.workunit.client.0.smithi098.stdout:5/470: sync 2024-09-13T02:52:57.026 INFO:tasks.workunit.client.1.smithi142.stdout:3/987: dread - d12/d16/d25/d2e/d38/d4d/ff6 zero size 2024-09-13T02:52:57.026 INFO:tasks.workunit.client.0.smithi098.stdout:4/490: write d6/d10/f9d [330749,92241] 0 2024-09-13T02:52:57.026 INFO:tasks.workunit.client.0.smithi098.stdout:8/481: fsync d2/f6 0 2024-09-13T02:52:57.026 INFO:tasks.workunit.client.0.smithi098.stdout:2/438: read d1/d1f/f56 [438541,99973] 0 2024-09-13T02:52:57.027 INFO:tasks.workunit.client.1.smithi142.stdout:2/973: creat d1/de/d31/d6c/d6d/f136 x:0 0 0 2024-09-13T02:52:57.028 INFO:tasks.workunit.client.0.smithi098.stdout:5/471: rmdir d0/d29 39 2024-09-13T02:52:57.029 INFO:tasks.workunit.client.0.smithi098.stdout:5/472: read - d0/d15/d17/d1c/f96 zero size 2024-09-13T02:52:57.031 INFO:tasks.workunit.client.1.smithi142.stdout:3/988: dwrite d12/d16/d25/d2e/d38/d4d/d53/d78/fe2 [0,4194304] 0 2024-09-13T02:52:57.033 INFO:tasks.workunit.client.0.smithi098.stdout:1/587: rename d9/d33/d19/d35/d68/d2f/dbf/f96 to d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fd9 0 2024-09-13T02:52:57.034 INFO:tasks.workunit.client.1.smithi142.stdout:8/897: truncate d0/d6/dc/d45/d35/d7e/f10f 3541000 0 2024-09-13T02:52:57.034 INFO:tasks.workunit.client.0.smithi098.stdout:1/588: read - d9/d33/d19/d35/d68/d2f/dbf/f9d zero size 2024-09-13T02:52:57.035 INFO:tasks.workunit.client.1.smithi142.stdout:3/989: dread d12/fdf [0,4194304] 0 2024-09-13T02:52:57.035 INFO:tasks.workunit.client.0.smithi098.stdout:2/439: rmdir d1/d1f 39 2024-09-13T02:52:57.036 INFO:tasks.workunit.client.1.smithi142.stdout:3/990: fdatasync d12/d16/d25/d2e/d48/d5c/f121 0 2024-09-13T02:52:57.037 INFO:tasks.workunit.client.1.smithi142.stdout:8/898: mknod d0/c126 0 2024-09-13T02:52:57.040 INFO:tasks.workunit.client.1.smithi142.stdout:2/974: rename d1/de/f9d to d1/d2d/db2/d121/f137 0 2024-09-13T02:52:57.042 INFO:tasks.workunit.client.0.smithi098.stdout:4/491: dwrite d6/d37/d7a/fa1 [0,4194304] 0 2024-09-13T02:52:57.044 INFO:tasks.workunit.client.1.smithi142.stdout:3/991: rmdir d12/d16/d3c/d79/d9b/dc1 39 2024-09-13T02:52:57.045 INFO:tasks.workunit.client.1.smithi142.stdout:8/899: creat d0/d6/dc/d45/d8/df/d28/f127 x:0 0 0 2024-09-13T02:52:57.050 INFO:tasks.workunit.client.0.smithi098.stdout:8/482: link d2/d2f/f62 d2/d2f/d78/d5d/f98 0 2024-09-13T02:52:57.051 INFO:tasks.workunit.client.0.smithi098.stdout:8/483: stat d2/dd/d11/d1d/f45 0 2024-09-13T02:52:57.051 INFO:tasks.workunit.client.1.smithi142.stdout:3/992: chown d12/d16/d3c/d7d/d91/cf1 79 1 2024-09-13T02:52:57.052 INFO:tasks.workunit.client.1.smithi142.stdout:3/993: write d12/d16/d25/d2e/d38/f45 [868475,52630] 0 2024-09-13T02:52:57.055 INFO:tasks.workunit.client.0.smithi098.stdout:2/440: symlink d1/d1f/d35/d63/d72/l90 0 2024-09-13T02:52:57.060 INFO:tasks.workunit.client.0.smithi098.stdout:5/473: creat d0/d15/d50/f9f x:0 0 0 2024-09-13T02:52:57.061 INFO:tasks.workunit.client.0.smithi098.stdout:4/492: creat d6/d22/d3d/d6c/d91/fb1 x:0 0 0 2024-09-13T02:52:57.062 INFO:tasks.workunit.client.0.smithi098.stdout:8/484: truncate d2/dd/d4d/d96/f52 460339 0 2024-09-13T02:52:57.063 INFO:tasks.workunit.client.1.smithi142.stdout:3/994: fsync d12/d16/fe1 0 2024-09-13T02:52:57.066 INFO:tasks.workunit.client.0.smithi098.stdout:1/589: creat d9/d33/d19/d35/d68/d4d/dbc/d23/fda x:0 0 0 2024-09-13T02:52:57.066 INFO:tasks.workunit.client.1.smithi142.stdout:2/975: dwrite d1/de/f26 [0,4194304] 0 2024-09-13T02:52:57.066 INFO:tasks.workunit.client.1.smithi142.stdout:8/900: chown d0/d6/dc/d45/d35/d7e/f10f 1812556 1 2024-09-13T02:52:57.071 INFO:tasks.workunit.client.1.smithi142.stdout:8/901: dread d0/d75/ff3 [0,4194304] 0 2024-09-13T02:52:57.073 INFO:tasks.workunit.client.1.smithi142.stdout:8/902: read d0/d6/dc/d45/d8/df/ffb [475043,63669] 0 2024-09-13T02:52:57.077 INFO:tasks.workunit.client.1.smithi142.stdout:3/995: symlink d12/d16/d3c/d79/d9e/d10f/d12e/l138 0 2024-09-13T02:52:57.078 INFO:tasks.workunit.client.0.smithi098.stdout:5/474: rename d0/d29/f7d to d0/d7c/fa0 0 2024-09-13T02:52:57.078 INFO:tasks.workunit.client.0.smithi098.stdout:5/475: readlink d0/d15/l48 0 2024-09-13T02:52:57.082 INFO:tasks.workunit.client.0.smithi098.stdout:2/441: write d1/d1f/d36/f52 [257146,44718] 0 2024-09-13T02:52:57.083 INFO:tasks.workunit.client.1.smithi142.stdout:2/976: write d1/de/d31/d6c/d6d/d47/f91 [595394,113597] 0 2024-09-13T02:52:57.086 INFO:tasks.workunit.client.0.smithi098.stdout:5/476: dwrite d0/d38/d3f/d1a/f98 [0,4194304] 0 2024-09-13T02:52:57.088 INFO:tasks.workunit.client.0.smithi098.stdout:4/493: creat d6/d22/d3d/d41/fb2 x:0 0 0 2024-09-13T02:52:57.089 INFO:tasks.workunit.client.1.smithi142.stdout:8/903: write d0/d6/d83/f9b [5204229,60720] 0 2024-09-13T02:52:57.090 INFO:tasks.workunit.client.0.smithi098.stdout:8/485: mkdir d2/d28/d43/d88/d99 0 2024-09-13T02:52:57.091 INFO:tasks.workunit.client.0.smithi098.stdout:8/486: fsync d2/d28/f80 0 2024-09-13T02:52:57.093 INFO:tasks.workunit.client.1.smithi142.stdout:3/996: symlink d12/d16/d25/d2e/d48/d5c/d123/d114/l139 0 2024-09-13T02:52:57.094 INFO:tasks.workunit.client.1.smithi142.stdout:3/997: chown d12/d16/d25/d2e/d38/d4d/d53/d78/fc5 786113548 1 2024-09-13T02:52:57.095 INFO:tasks.workunit.client.1.smithi142.stdout:3/998: readlink d12/d16/d3c/d79/d9e/lb3 0 2024-09-13T02:52:57.096 INFO:tasks.workunit.client.0.smithi098.stdout:2/442: unlink d1/d1f/d35/c43 0 2024-09-13T02:52:57.096 INFO:tasks.workunit.client.1.smithi142.stdout:3/999: write fe [1376604,34871] 0 2024-09-13T02:52:57.097 INFO:tasks.workunit.client.1.smithi142.stdout:8/904: mknod d0/d6/dc/d45/d8/df/d28/c128 0 2024-09-13T02:52:57.097 INFO:tasks.workunit.client.0.smithi098.stdout:1/590: dread d9/f38 [0,4194304] 0 2024-09-13T02:52:57.098 INFO:tasks.workunit.client.0.smithi098.stdout:5/477: symlink d0/d38/d3f/la1 0 2024-09-13T02:52:57.099 INFO:tasks.workunit.client.1.smithi142.stdout:2/977: creat d1/de/d31/d6c/d6d/d117/f138 x:0 0 0 2024-09-13T02:52:57.099 INFO:tasks.workunit.client.0.smithi098.stdout:4/494: readlink d6/l3c 0 2024-09-13T02:52:57.102 INFO:tasks.workunit.client.0.smithi098.stdout:8/487: rmdir d2/d28/d43/d88 39 2024-09-13T02:52:57.104 INFO:tasks.workunit.client.1.smithi142.stdout:2/978: mknod d1/de/da6/dbb/d6f/c139 0 2024-09-13T02:52:57.106 INFO:tasks.workunit.client.0.smithi098.stdout:2/443: dread d1/d1f/f56 [0,4194304] 0 2024-09-13T02:52:57.106 INFO:tasks.workunit.client.0.smithi098.stdout:5/478: creat d0/d15/d17/d1c/fa2 x:0 0 0 2024-09-13T02:52:57.107 INFO:tasks.workunit.client.0.smithi098.stdout:5/479: fdatasync d0/d15/f3c 0 2024-09-13T02:52:57.108 INFO:tasks.workunit.client.1.smithi142.stdout:2/979: mkdir d1/de/d13a 0 2024-09-13T02:52:57.108 INFO:tasks.workunit.client.1.smithi142.stdout:2/980: dread - d1/de/da6/dbb/f12e zero size 2024-09-13T02:52:57.109 INFO:tasks.workunit.client.0.smithi098.stdout:4/495: mknod d6/d22/d3d/d64/cb3 0 2024-09-13T02:52:57.109 INFO:tasks.workunit.client.1.smithi142.stdout:8/905: dread d0/d6/d83/f9b [0,4194304] 0 2024-09-13T02:52:57.110 INFO:tasks.workunit.client.1.smithi142.stdout:8/906: write d0/d6/d23/f7f [1663148,67357] 0 2024-09-13T02:52:57.110 INFO:tasks.workunit.client.0.smithi098.stdout:2/444: rename d1/d1a/d4f/d59/c6d to d1/d1a/d9/d1e/d5a/c91 0 2024-09-13T02:52:57.111 INFO:tasks.workunit.client.0.smithi098.stdout:2/445: readlink d1/d1a/d9/lf 0 2024-09-13T02:52:57.111 INFO:tasks.workunit.client.0.smithi098.stdout:5/480: creat d0/d7c/fa3 x:0 0 0 2024-09-13T02:52:57.112 INFO:tasks.workunit.client.0.smithi098.stdout:1/591: dread d9/d33/d19/d35/d68/d4d/dbc/d23/da7/fb4 [0,4194304] 0 2024-09-13T02:52:57.113 INFO:tasks.workunit.client.1.smithi142.stdout:2/981: unlink d1/d2d/db2/lba 0 2024-09-13T02:52:57.114 INFO:tasks.workunit.client.0.smithi098.stdout:8/488: mknod d2/d2f/c9a 0 2024-09-13T02:52:57.115 INFO:tasks.workunit.client.0.smithi098.stdout:4/496: creat d6/d22/d3d/d64/fb4 x:0 0 0 2024-09-13T02:52:57.116 INFO:tasks.workunit.client.0.smithi098.stdout:2/446: mknod d1/d1a/d9/d1e/d5a/c92 0 2024-09-13T02:52:57.117 INFO:tasks.workunit.client.0.smithi098.stdout:1/592: mkdir d9/d33/d19/d35/d68/d60/d61/ddb 0 2024-09-13T02:52:57.118 INFO:tasks.workunit.client.1.smithi142.stdout:2/982: dwrite d1/de/d31/f62 [4194304,4194304] 0 2024-09-13T02:52:57.120 INFO:tasks.workunit.client.1.smithi142.stdout:8/907: link d0/d6/dc/d45/d8/d117/f107 d0/d6/dc/d2e/f129 0 2024-09-13T02:52:57.121 INFO:tasks.workunit.client.0.smithi098.stdout:4/497: chown d6/d54/f88 10 1 2024-09-13T02:52:57.122 INFO:tasks.workunit.client.0.smithi098.stdout:4/498: write d6/d54/f7b [257330,32068] 0 2024-09-13T02:52:57.123 INFO:tasks.workunit.client.1.smithi142.stdout:2/983: fdatasync d1/fc 0 2024-09-13T02:52:57.123 INFO:tasks.workunit.client.1.smithi142.stdout:2/984: chown d1/de/d31/db0 5 1 2024-09-13T02:52:57.124 INFO:tasks.workunit.client.0.smithi098.stdout:5/481: mkdir d0/d15/da4 0 2024-09-13T02:52:57.125 INFO:tasks.workunit.client.0.smithi098.stdout:5/482: chown d0/d15/f3c 878 1 2024-09-13T02:52:57.128 INFO:tasks.workunit.client.0.smithi098.stdout:1/593: truncate d9/d33/d29/d58/f82 425436 0 2024-09-13T02:52:57.129 INFO:tasks.workunit.client.0.smithi098.stdout:4/499: mknod d6/d22/d3d/d64/cb5 0 2024-09-13T02:52:57.130 INFO:tasks.workunit.client.0.smithi098.stdout:1/594: write d9/d33/d19/d35/d68/d4d/dbc/fb3 [3183824,62567] 0 2024-09-13T02:52:57.132 INFO:tasks.workunit.client.1.smithi142.stdout:8/908: creat d0/d6/dc/d45/d9d/d10c/dc9/dc0/df7/f12a x:0 0 0 2024-09-13T02:52:57.133 INFO:tasks.workunit.client.0.smithi098.stdout:2/447: unlink d1/d1f/f3d 0 2024-09-13T02:52:57.137 INFO:tasks.workunit.client.1.smithi142.stdout:8/909: symlink d0/d6/d83/daa/l12b 0 2024-09-13T02:52:57.139 INFO:tasks.workunit.client.0.smithi098.stdout:1/595: dwrite d9/d33/d19/d35/d68/d60/d61/db1/fd0 [0,4194304] 0 2024-09-13T02:52:57.140 INFO:tasks.workunit.client.1.smithi142.stdout:2/985: creat d1/de/d31/d6c/f13b x:0 0 0 2024-09-13T02:52:57.141 INFO:tasks.workunit.client.1.smithi142.stdout:2/986: write d1/de/d31/d6c/d6d/f136 [69382,51305] 0 2024-09-13T02:52:57.145 INFO:tasks.workunit.client.0.smithi098.stdout:2/448: dwrite d1/f8f [0,4194304] 0 2024-09-13T02:52:57.145 INFO:tasks.workunit.client.0.smithi098.stdout:5/483: dread d0/f4e [0,4194304] 0 2024-09-13T02:52:57.146 INFO:tasks.workunit.client.0.smithi098.stdout:5/484: fsync d0/d38/d3f/d1a/f86 0 2024-09-13T02:52:57.150 INFO:tasks.workunit.client.1.smithi142.stdout:8/910: link d0/d6/dc/d45/d35/f56 d0/d6/dc/d45/d9d/d10c/dc9/dc0/f12c 0 2024-09-13T02:52:57.155 INFO:tasks.workunit.client.0.smithi098.stdout:4/500: symlink d6/d3e/d46/lb6 0 2024-09-13T02:52:57.157 INFO:tasks.workunit.client.1.smithi142.stdout:8/911: symlink d0/d6/d83/d104/l12d 0 2024-09-13T02:52:57.157 INFO:tasks.workunit.client.0.smithi098.stdout:8/489: dwrite d2/dd/d11/f16 [0,4194304] 0 2024-09-13T02:52:57.161 INFO:tasks.workunit.client.0.smithi098.stdout:1/596: rename d9/d33/f66 to d9/d33/d19/d35/d68/d4d/dbc/fdc 0 2024-09-13T02:52:57.163 INFO:tasks.workunit.client.0.smithi098.stdout:2/449: creat d1/d1f/d35/d63/d72/f93 x:0 0 0 2024-09-13T02:52:57.163 INFO:tasks.workunit.client.0.smithi098.stdout:2/450: stat d1/d1f/d35/f45 0 2024-09-13T02:52:57.168 INFO:tasks.workunit.client.1.smithi142.stdout:8/912: getdents d0/d6/d83/daa/d111 0 2024-09-13T02:52:57.170 INFO:tasks.workunit.client.0.smithi098.stdout:5/485: getdents d0/d38/d3f/d81/d9e 0 2024-09-13T02:52:57.171 INFO:tasks.workunit.client.0.smithi098.stdout:5/486: readlink d0/d15/d17/d1c/d3d/l75 0 2024-09-13T02:52:57.172 INFO:tasks.workunit.client.1.smithi142.stdout:2/987: write d1/de/d31/d6c/d6d/d47/f68 [804995,12003] 0 2024-09-13T02:52:57.173 INFO:tasks.workunit.client.0.smithi098.stdout:5/487: mknod d0/d57/ca5 0 2024-09-13T02:52:57.174 INFO:tasks.workunit.client.0.smithi098.stdout:5/488: chown d0/d38/d3f/d81/f33 8744 1 2024-09-13T02:52:57.176 INFO:tasks.workunit.client.1.smithi142.stdout:2/988: symlink d1/d42/l13c 0 2024-09-13T02:52:57.177 INFO:tasks.workunit.client.1.smithi142.stdout:2/989: chown d1/d29/c58 83707207 1 2024-09-13T02:52:57.179 INFO:tasks.workunit.client.0.smithi098.stdout:1/597: link d9/d33/d29/c3b d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/cdd 0 2024-09-13T02:52:57.180 INFO:tasks.workunit.client.0.smithi098.stdout:8/490: write d2/dd/d11/d1d/f3a [3826584,82644] 0 2024-09-13T02:52:57.181 INFO:tasks.workunit.client.1.smithi142.stdout:2/990: symlink d1/de/d13a/l13d 0 2024-09-13T02:52:57.181 INFO:tasks.workunit.client.0.smithi098.stdout:2/451: write d1/f8 [3945040,21555] 0 2024-09-13T02:52:57.182 INFO:tasks.workunit.client.0.smithi098.stdout:2/452: readlink d1/d1f/d35/d63/l4c 0 2024-09-13T02:52:57.196 INFO:tasks.workunit.client.1.smithi142.stdout:2/991: dread d1/de/d1f/d13/d59/ff8 [0,4194304] 0 2024-09-13T02:52:57.196 INFO:tasks.workunit.client.0.smithi098.stdout:8/491: chown d2/d2f/d78/d46/d74/l8a 15574455 1 2024-09-13T02:52:57.198 INFO:tasks.workunit.client.0.smithi098.stdout:2/453: mknod d1/d1f/d35/c94 0 2024-09-13T02:52:57.198 INFO:tasks.workunit.client.0.smithi098.stdout:5/489: link d0/l68 d0/d38/d3f/d81/d4d/d82/d9a/la6 0 2024-09-13T02:52:57.199 INFO:tasks.workunit.client.0.smithi098.stdout:2/454: write d1/d1f/d35/d63/d23/f28 [3965611,7406] 0 2024-09-13T02:52:57.203 INFO:tasks.workunit.client.1.smithi142.stdout:2/992: getdents d1 0 2024-09-13T02:52:57.205 INFO:tasks.workunit.client.0.smithi098.stdout:1/598: link d9/d33/d19/d35/d68/d4d/dbc/d23/d30/l62 d9/d33/d19/d35/d68/d2f/lde 0 2024-09-13T02:52:57.208 INFO:tasks.workunit.client.0.smithi098.stdout:1/599: symlink d9/d33/ldf 0 2024-09-13T02:52:57.210 INFO:tasks.workunit.client.1.smithi142.stdout:2/993: dread d1/de/da6/dbb/dc2/dfa/f128 [0,4194304] 0 2024-09-13T02:52:57.210 INFO:tasks.workunit.client.0.smithi098.stdout:5/490: rename d0/d38/d3f/c3 to d0/d15/d50/ca7 0 2024-09-13T02:52:57.211 INFO:tasks.workunit.client.1.smithi142.stdout:2/994: truncate d1/d29/d72/fe0 1546947 0 2024-09-13T02:52:57.214 INFO:tasks.workunit.client.0.smithi098.stdout:1/600: dread d9/d33/d19/f21 [0,4194304] 0 2024-09-13T02:52:57.215 INFO:tasks.workunit.client.1.smithi142.stdout:2/995: dwrite d1/de/f20 [0,4194304] 0 2024-09-13T02:52:57.220 INFO:tasks.workunit.client.0.smithi098.stdout:8/492: dwrite d2/d2f/d78/d46/d47/d6e/d68/f82 [0,4194304] 0 2024-09-13T02:52:57.224 INFO:tasks.workunit.client.0.smithi098.stdout:8/493: fsync d2/dd/d4d/d96/f85 0 2024-09-13T02:52:57.227 INFO:tasks.workunit.client.0.smithi098.stdout:8/494: truncate d2/d2f/d78/d46/d74/f94 358931 0 2024-09-13T02:52:57.229 INFO:tasks.workunit.client.0.smithi098.stdout:8/495: unlink d2/d2f/f89 0 2024-09-13T02:52:57.231 INFO:tasks.workunit.client.0.smithi098.stdout:8/496: mkdir d2/dd/d11/d2c/d9b 0 2024-09-13T02:52:57.237 INFO:tasks.workunit.client.1.smithi142.stdout:2/996: dread d1/de/d1f/d13/f5e [0,4194304] 0 2024-09-13T02:52:57.239 INFO:tasks.workunit.client.1.smithi142.stdout:2/997: unlink d1/de/f57 0 2024-09-13T02:52:57.240 INFO:tasks.workunit.client.1.smithi142.stdout:2/998: chown d1/de/d1f/d13/d59/f6a 4174748 1 2024-09-13T02:52:57.241 INFO:tasks.workunit.client.1.smithi142.stdout:2/999: fsync d1/de/fd2 0 2024-09-13T02:52:57.249 INFO:tasks.workunit.client.0.smithi098.stdout:8/497: dwrite d2/dd/f5a [0,4194304] 0 2024-09-13T02:52:57.254 INFO:tasks.workunit.client.0.smithi098.stdout:8/498: write d2/dd/d2e/f3d [5932788,103621] 0 2024-09-13T02:52:57.255 INFO:tasks.workunit.client.0.smithi098.stdout:8/499: chown d2/f4a 63 1 2024-09-13T02:52:57.257 INFO:tasks.workunit.client.1.smithi142.stdout:8/913: sync 2024-09-13T02:52:57.261 INFO:tasks.workunit.client.1.smithi142.stdout:8/914: link d0/d6/dc/d45/c109 d0/d6/dc/d45/d35/d61/d77/c12e 0 2024-09-13T02:52:57.264 INFO:tasks.workunit.client.1.smithi142.stdout:8/915: rename d0/d6/dc/d45/d35/fca to d0/d6/dc/d40/d41/f12f 0 2024-09-13T02:52:57.265 INFO:tasks.workunit.client.1.smithi142.stdout:8/916: chown d0/d6/dc/d40/d46/da1/lb3 93 1 2024-09-13T02:52:57.266 INFO:tasks.workunit.client.0.smithi098.stdout:8/500: truncate d2/f4e 1921988 0 2024-09-13T02:52:57.266 INFO:tasks.workunit.client.1.smithi142.stdout:8/917: chown d0/d6/dc/d45/f73 60388805 1 2024-09-13T02:52:57.266 INFO:tasks.workunit.client.0.smithi098.stdout:8/501: rmdir d2/dd 39 2024-09-13T02:52:57.268 INFO:tasks.workunit.client.0.smithi098.stdout:8/502: chown d2/d2f/d78/d46 34288 1 2024-09-13T02:52:57.270 INFO:tasks.workunit.client.0.smithi098.stdout:8/503: mknod d2/dd/d11/c9c 0 2024-09-13T02:52:57.271 INFO:tasks.workunit.client.1.smithi142.stdout:8/918: dwrite d0/d6/dc/d45/d9d/d10c/dc9/dc0/df7/f12a [0,4194304] 0 2024-09-13T02:52:57.276 INFO:tasks.workunit.client.0.smithi098.stdout:8/504: link d2/dd/d11/d1d/c30 d2/d2f/d78/c9d 0 2024-09-13T02:52:57.277 INFO:tasks.workunit.client.1.smithi142.stdout:8/919: dread d0/d6/dc/d45/d35/f100 [0,4194304] 0 2024-09-13T02:52:57.278 INFO:tasks.workunit.client.0.smithi098.stdout:8/505: rmdir d2 39 2024-09-13T02:52:57.289 INFO:tasks.workunit.client.0.smithi098.stdout:8/506: dwrite d2/f4a [0,4194304] 0 2024-09-13T02:52:57.298 INFO:tasks.workunit.client.1.smithi142.stdout:8/920: dread d0/d6/d23/f7f [0,4194304] 0 2024-09-13T02:52:57.305 INFO:tasks.workunit.client.1.smithi142.stdout:8/921: write d0/d6/dc/d2e/f129 [3492847,37890] 0 2024-09-13T02:52:57.305 INFO:tasks.workunit.client.1.smithi142.stdout:8/922: readlink d0/d75/lde 0 2024-09-13T02:52:57.327 INFO:tasks.workunit.client.0.smithi098.stdout:3/487: sync 2024-09-13T02:52:57.330 INFO:tasks.workunit.client.0.smithi098.stdout:3/488: creat d7/d9/d15/d2d/d5b/f94 x:0 0 0 2024-09-13T02:52:57.332 INFO:tasks.workunit.client.1.smithi142.stdout:8/923: creat d0/d6/dc/d40/f130 x:0 0 0 2024-09-13T02:52:57.336 INFO:tasks.workunit.client.1.smithi142.stdout:8/924: creat d0/d75/f131 x:0 0 0 2024-09-13T02:52:57.336 INFO:tasks.workunit.client.0.smithi098.stdout:3/489: dwrite d7/d9/d25/d64/f8f [0,4194304] 0 2024-09-13T02:52:57.337 INFO:tasks.workunit.client.1.smithi142.stdout:8/925: creat d0/d6/d83/daa/dce/f132 x:0 0 0 2024-09-13T02:52:57.344 INFO:tasks.workunit.client.1.smithi142.stdout:8/926: getdents d0/da2 0 2024-09-13T02:52:57.344 INFO:tasks.workunit.client.0.smithi098.stdout:3/490: link d7/d9/d15/d2d/d5b/c54 d7/d9/d15/d2d/c95 0 2024-09-13T02:52:57.346 INFO:tasks.workunit.client.0.smithi098.stdout:3/491: truncate d7/d9/f86 759204 0 2024-09-13T02:52:57.346 INFO:tasks.workunit.client.1.smithi142.stdout:8/927: creat d0/d6/dc/d45/d9d/d10c/dc9/f133 x:0 0 0 2024-09-13T02:52:57.350 INFO:tasks.workunit.client.0.smithi098.stdout:3/492: rename d7/d9/d25/d3a/d7c/c8b to d7/d9/d25/d3a/d51/c96 0 2024-09-13T02:52:57.356 INFO:tasks.workunit.client.0.smithi098.stdout:3/493: read d7/d9/d15/f82 [2753553,70250] 0 2024-09-13T02:52:57.357 INFO:tasks.workunit.client.1.smithi142.stdout:8/928: write d0/d6/dc/d45/d35/fc7 [615161,83928] 0 2024-09-13T02:52:57.358 INFO:tasks.workunit.client.1.smithi142.stdout:8/929: chown d0/d6/dc/d45/c42 1371466 1 2024-09-13T02:52:57.359 INFO:tasks.workunit.client.1.smithi142.stdout:8/930: dread - d0/d6/d23/d2b/f78 zero size 2024-09-13T02:52:57.362 INFO:tasks.workunit.client.0.smithi098.stdout:3/494: dwrite d7/d9/d25/d3a/d52/f8a [0,4194304] 0 2024-09-13T02:52:57.368 INFO:tasks.workunit.client.0.smithi098.stdout:3/495: creat d7/d9/d15/d2d/d34/f97 x:0 0 0 2024-09-13T02:52:57.369 INFO:tasks.workunit.client.0.smithi098.stdout:3/496: readlink d7/d9/d15/d2d/l74 0 2024-09-13T02:52:57.373 INFO:tasks.workunit.client.1.smithi142.stdout:8/931: dwrite d0/d6/dc/d45/d35/f63 [4194304,4194304] 0 2024-09-13T02:52:57.374 INFO:tasks.workunit.client.0.smithi098.stdout:3/497: read d7/d9/d25/d3a/d51/f66 [153324,107042] 0 2024-09-13T02:52:57.376 INFO:tasks.workunit.client.0.smithi098.stdout:3/498: chown d7/d9/d15/d2d/d78 23661 1 2024-09-13T02:52:57.378 INFO:tasks.workunit.client.1.smithi142.stdout:8/932: rmdir d0/d6/dc/d11d 0 2024-09-13T02:52:57.379 INFO:tasks.workunit.client.1.smithi142.stdout:8/933: read - d0/d6/dc/d45/d9d/d10c/dc9/d113/d62/f114 zero size 2024-09-13T02:52:57.383 INFO:tasks.workunit.client.1.smithi142.stdout:8/934: mkdir d0/d6/dc/d134 0 2024-09-13T02:52:57.384 INFO:tasks.workunit.client.1.smithi142.stdout:8/935: stat d0/d6/dc/d45/c42 0 2024-09-13T02:52:57.388 INFO:tasks.workunit.client.1.smithi142.stdout:8/936: link d0/d6/dc/d45/d8/l119 d0/d6/d23/d2b/l135 0 2024-09-13T02:52:57.388 INFO:tasks.workunit.client.0.smithi098.stdout:3/499: write d7/d9/d15/d2d/d5b/f46 [336954,73120] 0 2024-09-13T02:52:57.389 INFO:tasks.workunit.client.0.smithi098.stdout:3/500: creat d7/d9/d15/d2d/d78/f98 x:0 0 0 2024-09-13T02:52:57.391 INFO:tasks.workunit.client.0.smithi098.stdout:3/501: write d7/d9/d15/d2d/d78/f98 [961694,57210] 0 2024-09-13T02:52:57.394 INFO:tasks.workunit.client.0.smithi098.stdout:3/502: creat d7/d9/d15/d2d/d34/f99 x:0 0 0 2024-09-13T02:52:57.395 INFO:tasks.workunit.client.1.smithi142.stdout:8/937: write d0/d6/dc/d45/d35/d7e/fe8 [626334,105944] 0 2024-09-13T02:52:57.396 INFO:tasks.workunit.client.1.smithi142.stdout:8/938: write d0/d6/dc/d40/d46/f7b [745341,61307] 0 2024-09-13T02:52:57.405 INFO:tasks.workunit.client.1.smithi142.stdout:8/939: dwrite d0/d6/dc/d45/d8/f71 [4194304,4194304] 0 2024-09-13T02:52:57.409 INFO:tasks.workunit.client.1.smithi142.stdout:8/940: mkdir d0/d6/dc/d45/d8/df/d136 0 2024-09-13T02:52:57.413 INFO:tasks.workunit.client.1.smithi142.stdout:8/941: creat d0/d6/dc/d45/d35/d120/f137 x:0 0 0 2024-09-13T02:52:57.414 INFO:tasks.workunit.client.0.smithi098.stdout:3/503: dread d7/d9/d15/d5d/f65 [0,4194304] 0 2024-09-13T02:52:57.416 INFO:tasks.workunit.client.0.smithi098.stdout:3/504: readlink d7/d9/d15/d26/l5e 0 2024-09-13T02:52:57.451 INFO:tasks.workunit.client.0.smithi098.stdout:9/521: sync 2024-09-13T02:52:57.508 INFO:tasks.workunit.client.0.smithi098.stdout:3/505: mknod d7/d9/d15/d2d/d5b/d70/d90/c9a 0 2024-09-13T02:52:57.509 INFO:tasks.workunit.client.0.smithi098.stdout:9/522: mkdir d2/d6/d2b/d4d/d56/dbc/dbf 0 2024-09-13T02:52:57.510 INFO:tasks.workunit.client.0.smithi098.stdout:3/506: truncate d7/d9/d15/d2d/f6b 1576954 0 2024-09-13T02:52:57.511 INFO:tasks.workunit.client.0.smithi098.stdout:3/507: truncate d7/f8c 4661697 0 2024-09-13T02:52:57.511 INFO:tasks.workunit.client.0.smithi098.stdout:3/508: chown d7/d9/d15/f85 1519421 1 2024-09-13T02:52:57.513 INFO:tasks.workunit.client.1.smithi142.stdout:8/942: dwrite d0/d6/dc/d45/d8/df/fe5 [0,4194304] 0 2024-09-13T02:52:57.514 INFO:tasks.workunit.client.0.smithi098.stdout:3/509: write d7/d9/d15/d5d/f65 [2704321,70240] 0 2024-09-13T02:52:57.515 INFO:tasks.workunit.client.0.smithi098.stdout:3/510: readlink d7/d9/d15/l7b 0 2024-09-13T02:52:57.535 INFO:tasks.workunit.client.1.smithi142.stdout:8/943: dread d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:57.535 INFO:tasks.workunit.client.0.smithi098.stdout:9/523: dread d2/d6/d2b/d4d/f5d [0,4194304] 0 2024-09-13T02:52:57.536 INFO:tasks.workunit.client.1.smithi142.stdout:8/944: write d0/da2/f112 [843416,78529] 0 2024-09-13T02:52:57.536 INFO:tasks.workunit.client.1.smithi142.stdout:8/945: chown d0/d6/dc/d40/d41/cd9 5298515 1 2024-09-13T02:52:57.571 INFO:tasks.workunit.client.0.smithi098.stdout:6/454: sync 2024-09-13T02:52:57.573 INFO:tasks.workunit.client.0.smithi098.stdout:3/511: symlink d7/d9/d25/d64/l9b 0 2024-09-13T02:52:57.575 INFO:tasks.workunit.client.0.smithi098.stdout:9/524: mkdir d2/d6/d2b/d4d/d4f/d6c/dc0 0 2024-09-13T02:52:57.575 INFO:tasks.workunit.client.0.smithi098.stdout:3/512: write d7/d9/d15/d2d/d34/f61 [1278689,114902] 0 2024-09-13T02:52:57.575 INFO:tasks.workunit.client.1.smithi142.stdout:8/946: rmdir d0/d6/dc/d45 39 2024-09-13T02:52:57.577 INFO:tasks.workunit.client.0.smithi098.stdout:3/513: mkdir d7/d9/d25/d3a/d51/d9c 0 2024-09-13T02:52:57.577 INFO:tasks.workunit.client.0.smithi098.stdout:3/514: chown d7/d9/d15/d80 49 1 2024-09-13T02:52:57.578 INFO:tasks.workunit.client.0.smithi098.stdout:6/455: link d5/d13/d2b/d3a/f86 d5/d13/d2b/d93/f9e 0 2024-09-13T02:52:57.581 INFO:tasks.workunit.client.0.smithi098.stdout:6/456: symlink d5/d13/d51/l9f 0 2024-09-13T02:52:57.582 INFO:tasks.workunit.client.0.smithi098.stdout:6/457: readlink d5/d13/d2b/d3a/d14/l2f 0 2024-09-13T02:52:57.584 INFO:tasks.workunit.client.0.smithi098.stdout:6/458: symlink d5/d13/d2b/d3a/d41/d7e/la0 0 2024-09-13T02:52:57.585 INFO:tasks.workunit.client.0.smithi098.stdout:6/459: chown d5/d18/f4c 3 1 2024-09-13T02:52:57.588 INFO:tasks.workunit.client.0.smithi098.stdout:3/515: dwrite d7/d9/d25/d2b/f75 [0,4194304] 0 2024-09-13T02:52:57.589 INFO:tasks.workunit.client.1.smithi142.stdout:8/947: dwrite d0/d6/dc/f18 [0,4194304] 0 2024-09-13T02:52:57.589 INFO:tasks.workunit.client.0.smithi098.stdout:6/460: unlink d5/d13/d51/f7f 0 2024-09-13T02:52:57.594 INFO:tasks.workunit.client.0.smithi098.stdout:6/461: fdatasync d5/d13/d2b/d93/f9e 0 2024-09-13T02:52:57.595 INFO:tasks.workunit.client.0.smithi098.stdout:3/516: dread d7/d9/d25/d3a/d51/f66 [0,4194304] 0 2024-09-13T02:52:57.598 INFO:tasks.workunit.client.0.smithi098.stdout:6/462: mknod d5/d13/d2b/ca1 0 2024-09-13T02:52:57.601 INFO:tasks.workunit.client.1.smithi142.stdout:8/948: rename d0/d6/dc/d45/d9d/l123 to d0/d75/l138 0 2024-09-13T02:52:57.602 INFO:tasks.workunit.client.0.smithi098.stdout:6/463: rmdir d5/d13/d2b/d3a/d41/d6c/d7c 39 2024-09-13T02:52:57.604 INFO:tasks.workunit.client.1.smithi142.stdout:8/949: mkdir d0/d6/d83/d139 0 2024-09-13T02:52:57.606 INFO:tasks.workunit.client.0.smithi098.stdout:6/464: dread - d5/d36/f6e zero size 2024-09-13T02:52:57.607 INFO:tasks.workunit.client.0.smithi098.stdout:6/465: readlink d5/d13/d2b/d3a/d41/d55/l74 0 2024-09-13T02:52:57.608 INFO:tasks.workunit.client.0.smithi098.stdout:6/466: truncate d5/d13/d67/f6a 4301642 0 2024-09-13T02:52:57.609 INFO:tasks.workunit.client.1.smithi142.stdout:8/950: dwrite d0/d6/dc/d2e/fb7 [0,4194304] 0 2024-09-13T02:52:57.613 INFO:tasks.workunit.client.0.smithi098.stdout:3/517: dwrite d7/d9/d15/f23 [0,4194304] 0 2024-09-13T02:52:57.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/951: mkdir d0/d6/d23/d13a 0 2024-09-13T02:52:57.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/952: chown d0/d6/dc/d45 69571 1 2024-09-13T02:52:57.614 INFO:tasks.workunit.client.0.smithi098.stdout:3/518: chown d7/d9/d25/d3a/d52/f3b 129278 1 2024-09-13T02:52:57.618 INFO:tasks.workunit.client.0.smithi098.stdout:3/519: symlink d7/l9d 0 2024-09-13T02:52:57.621 INFO:tasks.workunit.client.0.smithi098.stdout:6/467: write d5/d13/d2b/d3a/d14/f3b [730672,21923] 0 2024-09-13T02:52:57.624 INFO:tasks.workunit.client.0.smithi098.stdout:6/468: fdatasync d5/d13/d2b/d3a/f11 0 2024-09-13T02:52:57.626 INFO:tasks.workunit.client.0.smithi098.stdout:3/520: dwrite d7/d9/d25/d2b/f2c [0,4194304] 0 2024-09-13T02:52:57.641 INFO:tasks.workunit.client.0.smithi098.stdout:3/521: truncate d7/f8c 2276877 0 2024-09-13T02:52:57.642 INFO:tasks.workunit.client.0.smithi098.stdout:3/522: fdatasync d7/d9/d25/d64/d6f/f83 0 2024-09-13T02:52:57.644 INFO:tasks.workunit.client.0.smithi098.stdout:6/469: dwrite d5/d13/f1c [0,4194304] 0 2024-09-13T02:52:57.645 INFO:tasks.workunit.client.0.smithi098.stdout:3/523: creat d7/d9/d15/d2d/d5b/f9e x:0 0 0 2024-09-13T02:52:57.646 INFO:tasks.workunit.client.0.smithi098.stdout:3/524: chown d7/c1f 122718 1 2024-09-13T02:52:57.651 INFO:tasks.workunit.client.0.smithi098.stdout:3/525: mknod d7/d9/d15/d2d/d78/d7e/d8e/c9f 0 2024-09-13T02:52:57.654 INFO:tasks.workunit.client.0.smithi098.stdout:6/470: rename d5/d13/d2b/d3a/d41/f77 to d5/d13/d2b/d3a/fa2 0 2024-09-13T02:52:57.656 INFO:tasks.workunit.client.0.smithi098.stdout:3/526: mkdir d7/d9/d15/d80/da0 0 2024-09-13T02:52:57.656 INFO:tasks.workunit.client.0.smithi098.stdout:0/535: sync 2024-09-13T02:52:57.657 INFO:tasks.workunit.client.0.smithi098.stdout:6/471: mkdir d5/d13/d2b/d3a/d14/d94/d97/da3 0 2024-09-13T02:52:57.659 INFO:tasks.workunit.client.0.smithi098.stdout:0/536: unlink dd/f24 0 2024-09-13T02:52:57.662 INFO:tasks.workunit.client.0.smithi098.stdout:6/472: creat d5/d18/d50/fa4 x:0 0 0 2024-09-13T02:52:57.663 INFO:tasks.workunit.client.0.smithi098.stdout:3/527: dwrite d7/d9/d15/f23 [0,4194304] 0 2024-09-13T02:52:57.670 INFO:tasks.workunit.client.0.smithi098.stdout:6/473: rename d5/d18/d4e to d5/d13/d2b/d3a/d14/d6b/d9a/da5 0 2024-09-13T02:52:57.673 INFO:tasks.workunit.client.0.smithi098.stdout:6/474: symlink d5/d13/d2b/d3a/d41/d55/la6 0 2024-09-13T02:52:57.677 INFO:tasks.workunit.client.0.smithi098.stdout:0/537: write dd/df/d1d/d26/d28/f72 [1441102,80445] 0 2024-09-13T02:52:57.677 INFO:tasks.workunit.client.0.smithi098.stdout:3/528: write d7/f3d [4995619,23924] 0 2024-09-13T02:52:57.680 INFO:tasks.workunit.client.0.smithi098.stdout:6/475: dwrite d5/f1e [4194304,4194304] 0 2024-09-13T02:52:57.680 INFO:tasks.workunit.client.0.smithi098.stdout:3/529: chown d7/d9/d25/f71 3 1 2024-09-13T02:52:57.682 INFO:tasks.workunit.client.0.smithi098.stdout:6/476: read f4 [1517045,98298] 0 2024-09-13T02:52:57.683 INFO:tasks.workunit.client.0.smithi098.stdout:3/530: mkdir d7/d9/d15/d5d/da1 0 2024-09-13T02:52:57.685 INFO:tasks.workunit.client.0.smithi098.stdout:6/477: unlink d5/d36/c52 0 2024-09-13T02:52:57.686 INFO:tasks.workunit.client.0.smithi098.stdout:6/478: chown d5/d13/d2b/d5b/f89 30 1 2024-09-13T02:52:57.687 INFO:tasks.workunit.client.0.smithi098.stdout:0/538: dread dd/f10 [0,4194304] 0 2024-09-13T02:52:57.690 INFO:tasks.workunit.client.0.smithi098.stdout:0/539: rename dd/f92 to dd/d1f/d85/fab 0 2024-09-13T02:52:57.695 INFO:tasks.workunit.client.0.smithi098.stdout:0/540: dwrite dd/df/d1d/d40/d46/d6b/f70 [0,4194304] 0 2024-09-13T02:52:57.699 INFO:tasks.workunit.client.1.smithi142.stdout:8/953: sync 2024-09-13T02:52:57.701 INFO:tasks.workunit.client.0.smithi098.stdout:0/541: creat dd/df/d1d/d40/fac x:0 0 0 2024-09-13T02:52:57.702 INFO:tasks.workunit.client.1.smithi142.stdout:8/954: rmdir d0/d6/dc/d45/d9d/d10c/dc9/dc0 39 2024-09-13T02:52:57.703 INFO:tasks.workunit.client.0.smithi098.stdout:3/531: write d7/d9/d25/d3a/f44 [687154,101254] 0 2024-09-13T02:52:57.704 INFO:tasks.workunit.client.0.smithi098.stdout:0/542: creat dd/df/d1d/d40/d46/fad x:0 0 0 2024-09-13T02:52:57.706 INFO:tasks.workunit.client.1.smithi142.stdout:8/955: creat d0/d6/dc/d45/d9d/d10c/f13b x:0 0 0 2024-09-13T02:52:57.706 INFO:tasks.workunit.client.0.smithi098.stdout:6/479: write d5/f1b [2007340,100064] 0 2024-09-13T02:52:57.708 INFO:tasks.workunit.client.0.smithi098.stdout:3/532: unlink d7/d9/d15/d5d/c8d 0 2024-09-13T02:52:57.710 INFO:tasks.workunit.client.0.smithi098.stdout:6/480: rename d5/d13/d2b/d3a to d5/d13/d2b/d3a/d14/d6b/d9a/da5/da7 22 2024-09-13T02:52:57.711 INFO:tasks.workunit.client.0.smithi098.stdout:3/533: chown d7/d9/d15/d2d/d5b/f94 1109465 1 2024-09-13T02:52:57.713 INFO:tasks.workunit.client.0.smithi098.stdout:6/481: dread - d5/d13/d51/f56 zero size 2024-09-13T02:52:57.713 INFO:tasks.workunit.client.0.smithi098.stdout:0/543: dwrite dd/df/d1d/d26/d28/d32/d67/d81/f91 [0,4194304] 0 2024-09-13T02:52:57.715 INFO:tasks.workunit.client.0.smithi098.stdout:6/482: write d5/d13/d2b/d3a/d41/d7e/f7d [1851894,122326] 0 2024-09-13T02:52:57.718 INFO:tasks.workunit.client.0.smithi098.stdout:0/544: mknod dd/df/d1d/d26/d28/d32/d8d/cae 0 2024-09-13T02:52:57.718 INFO:tasks.workunit.client.0.smithi098.stdout:3/534: dread d7/d9/d25/d3a/f44 [0,4194304] 0 2024-09-13T02:52:57.721 INFO:tasks.workunit.client.0.smithi098.stdout:6/483: unlink d5/d13/d2b/d3a/d41/f59 0 2024-09-13T02:52:57.724 INFO:tasks.workunit.client.0.smithi098.stdout:0/545: symlink dd/df/d1d/d40/d46/laf 0 2024-09-13T02:52:57.724 INFO:tasks.workunit.client.0.smithi098.stdout:0/546: readlink dd/d1f/la8 0 2024-09-13T02:52:57.725 INFO:tasks.workunit.client.0.smithi098.stdout:3/535: write d7/d9/fa [1631689,76812] 0 2024-09-13T02:52:57.727 INFO:tasks.workunit.client.0.smithi098.stdout:6/484: mkdir d5/d13/d2b/d3a/d5a/da8 0 2024-09-13T02:52:57.728 INFO:tasks.workunit.client.1.smithi142.stdout:8/956: write d0/d6/dc/d45/d9d/d10c/dc9/dc0/fd3 [912875,126267] 0 2024-09-13T02:52:57.728 INFO:tasks.workunit.client.0.smithi098.stdout:0/547: truncate dd/df/d1d/f63 997521 0 2024-09-13T02:52:57.728 INFO:tasks.workunit.client.0.smithi098.stdout:3/536: write d7/d9/d15/d26/f6e [75704,119330] 0 2024-09-13T02:52:57.731 INFO:tasks.workunit.client.0.smithi098.stdout:3/537: read d7/d9/d15/d2d/d5b/f45 [724367,79948] 0 2024-09-13T02:52:57.732 INFO:tasks.workunit.client.1.smithi142.stdout:8/957: truncate d0/f69 4945256 0 2024-09-13T02:52:57.734 INFO:tasks.workunit.client.0.smithi098.stdout:6/485: mknod d5/d13/d2b/d3a/d14/d94/d97/da3/ca9 0 2024-09-13T02:52:57.735 INFO:tasks.workunit.client.0.smithi098.stdout:3/538: creat d7/d9/d25/d2b/fa2 x:0 0 0 2024-09-13T02:52:57.739 INFO:tasks.workunit.client.0.smithi098.stdout:6/486: rename d5/d13/d2b/d3a/d41/d7e/l7b to d5/d18/d50/laa 0 2024-09-13T02:52:57.741 INFO:tasks.workunit.client.0.smithi098.stdout:0/548: getdents dd/df/d1d/d40 0 2024-09-13T02:52:57.742 INFO:tasks.workunit.client.0.smithi098.stdout:7/681: sync 2024-09-13T02:52:57.746 INFO:tasks.workunit.client.0.smithi098.stdout:3/539: creat d7/d9/d15/fa3 x:0 0 0 2024-09-13T02:52:57.748 INFO:tasks.workunit.client.0.smithi098.stdout:0/549: rename dd/df/d1d/d26/f7d to dd/df/d1d/d26/d28/d32/fb0 0 2024-09-13T02:52:57.753 INFO:tasks.workunit.client.1.smithi142.stdout:8/958: dwrite d0/d75/fea [0,4194304] 0 2024-09-13T02:52:57.761 INFO:tasks.workunit.client.0.smithi098.stdout:6/487: dread d5/f15 [0,4194304] 0 2024-09-13T02:52:57.830 INFO:tasks.workunit.client.0.smithi098.stdout:7/682: creat d6/d24/d2a/d5a/d42/fe0 x:0 0 0 2024-09-13T02:52:57.833 INFO:tasks.workunit.client.1.smithi142.stdout:8/959: truncate d0/d6/dc/d45/d8/d117/fc2 1685544 0 2024-09-13T02:52:57.835 INFO:tasks.workunit.client.0.smithi098.stdout:7/683: rmdir d6/d24/d63 39 2024-09-13T02:52:57.839 INFO:tasks.workunit.client.1.smithi142.stdout:8/960: dwrite d0/d6/dc/d45/d8/f36 [0,4194304] 0 2024-09-13T02:52:57.840 INFO:tasks.workunit.client.0.smithi098.stdout:6/488: dread d5/f22 [0,4194304] 0 2024-09-13T02:52:57.842 INFO:tasks.workunit.client.0.smithi098.stdout:0/550: getdents dd/df/d1d/d26/d28/d32/d8d 0 2024-09-13T02:52:57.845 INFO:tasks.workunit.client.0.smithi098.stdout:7/684: fsync d6/d24/d63/f72 0 2024-09-13T02:52:57.850 INFO:tasks.workunit.client.1.smithi142.stdout:8/961: rename d0/d75/f86 to d0/d6/dc/d134/f13c 0 2024-09-13T02:52:57.851 INFO:tasks.workunit.client.0.smithi098.stdout:6/489: truncate d5/d13/d2b/d3a/f37 648954 0 2024-09-13T02:52:57.852 INFO:tasks.workunit.client.0.smithi098.stdout:6/490: dread - d5/d36/f8e zero size 2024-09-13T02:52:57.852 INFO:tasks.workunit.client.0.smithi098.stdout:0/551: fdatasync dd/df/d1d/f64 0 2024-09-13T02:52:57.859 INFO:tasks.workunit.client.0.smithi098.stdout:0/552: fsync dd/d1f/d85/fab 0 2024-09-13T02:52:57.865 INFO:tasks.workunit.client.1.smithi142.stdout:8/962: link d0/d6/dc/d45/d35/d7e/l89 d0/d6/d83/daa/d111/l13d 0 2024-09-13T02:52:57.869 INFO:tasks.workunit.client.0.smithi098.stdout:6/491: rmdir d5/d13/d2b/d3a/d14/d6b 39 2024-09-13T02:52:57.869 INFO:tasks.workunit.client.0.smithi098.stdout:0/553: creat dd/df/d1d/d40/d46/d6b/fb1 x:0 0 0 2024-09-13T02:52:57.870 INFO:tasks.workunit.client.1.smithi142.stdout:8/963: rename d0/d6/dc/d40/la5 to d0/d6/dc/d45/d8/df/d28/l13e 0 2024-09-13T02:52:57.873 INFO:tasks.workunit.client.0.smithi098.stdout:6/492: mknod d5/d13/d2b/d3a/d41/d55/cab 0 2024-09-13T02:52:57.876 INFO:tasks.workunit.client.0.smithi098.stdout:7/685: link d6/d24/d2a/d5a/f22 d6/dab/fe1 0 2024-09-13T02:52:57.877 INFO:tasks.workunit.client.1.smithi142.stdout:8/964: truncate d0/d6/dc/d45/d8/d117/fc2 904943 0 2024-09-13T02:52:57.878 INFO:tasks.workunit.client.0.smithi098.stdout:6/493: unlink d5/d13/c21 0 2024-09-13T02:52:57.882 INFO:tasks.workunit.client.0.smithi098.stdout:4/501: sync 2024-09-13T02:52:57.882 INFO:tasks.workunit.client.0.smithi098.stdout:2/455: sync 2024-09-13T02:52:57.885 INFO:tasks.workunit.client.0.smithi098.stdout:2/456: creat d1/d1f/d39/f95 x:0 0 0 2024-09-13T02:52:57.885 INFO:tasks.workunit.client.0.smithi098.stdout:4/502: mknod d6/d54/d6a/cb7 0 2024-09-13T02:52:57.886 INFO:tasks.workunit.client.0.smithi098.stdout:2/457: dread - d1/d1f/d35/d63/f6c zero size 2024-09-13T02:52:57.887 INFO:tasks.workunit.client.0.smithi098.stdout:4/503: write d6/d54/f9f [1023332,30756] 0 2024-09-13T02:52:57.887 INFO:tasks.workunit.client.0.smithi098.stdout:0/554: write dd/df/d1d/d26/d28/d32/d67/d71/f5e [503769,835] 0 2024-09-13T02:52:57.889 INFO:tasks.workunit.client.0.smithi098.stdout:2/458: truncate d1/d1f/d30/f34 1971323 0 2024-09-13T02:52:57.891 INFO:tasks.workunit.client.0.smithi098.stdout:0/555: chown dd/df/d1d/d40/c54 670560 1 2024-09-13T02:52:57.891 INFO:tasks.workunit.client.1.smithi142.stdout:8/965: write d0/d6/dc/d45/d35/f81 [4230838,30457] 0 2024-09-13T02:52:57.895 INFO:tasks.workunit.client.0.smithi098.stdout:4/504: rename d6/d22/d3d/d41/d58/f97 to d6/db/fb8 0 2024-09-13T02:52:57.897 INFO:tasks.workunit.client.0.smithi098.stdout:2/459: creat d1/d1f/d35/d63/d72/d88/f96 x:0 0 0 2024-09-13T02:52:57.900 INFO:tasks.workunit.client.0.smithi098.stdout:0/556: creat dd/df/fb2 x:0 0 0 2024-09-13T02:52:57.901 INFO:tasks.workunit.client.0.smithi098.stdout:2/460: stat d1/d1f/l79 0 2024-09-13T02:52:57.903 INFO:tasks.workunit.client.0.smithi098.stdout:4/505: dwrite d6/d54/f7b [0,4194304] 0 2024-09-13T02:52:57.905 INFO:tasks.workunit.client.0.smithi098.stdout:7/686: dread d6/d24/d2a/d5a/d86/f4e [0,4194304] 0 2024-09-13T02:52:57.907 INFO:tasks.workunit.client.0.smithi098.stdout:0/557: creat dd/df/d1d/d26/d28/d32/d67/d82/fb3 x:0 0 0 2024-09-13T02:52:57.910 INFO:tasks.workunit.client.0.smithi098.stdout:2/461: getdents d1/d1a/d9/d1e 0 2024-09-13T02:52:57.915 INFO:tasks.workunit.client.0.smithi098.stdout:4/506: rename d6/d22/d3d/d41/d74/d98/daf to d6/d8d/db9 0 2024-09-13T02:52:57.918 INFO:tasks.workunit.client.0.smithi098.stdout:4/507: chown d6/d10/d21/l7d 0 1 2024-09-13T02:52:57.921 INFO:tasks.workunit.client.0.smithi098.stdout:4/508: truncate d6/d22/d3d/d41/d74/d98/fa8 508478 0 2024-09-13T02:52:57.921 INFO:tasks.workunit.client.0.smithi098.stdout:2/462: creat d1/f97 x:0 0 0 2024-09-13T02:52:57.921 INFO:tasks.workunit.client.0.smithi098.stdout:7/687: write d6/d24/d2a/d5a/f38 [1444629,63600] 0 2024-09-13T02:52:57.923 INFO:tasks.workunit.client.0.smithi098.stdout:4/509: creat d6/d54/d6a/fba x:0 0 0 2024-09-13T02:52:57.924 INFO:tasks.workunit.client.0.smithi098.stdout:2/463: mknod d1/d1f/d35/c98 0 2024-09-13T02:52:57.928 INFO:tasks.workunit.client.0.smithi098.stdout:7/688: link d6/d1e/l7a d6/d24/d63/le2 0 2024-09-13T02:52:57.933 INFO:tasks.workunit.client.0.smithi098.stdout:7/689: rename d6/d24/d2a/d5a/d8e/dbd/dc3 to d6/d24/dc5/de3 0 2024-09-13T02:52:57.933 INFO:tasks.workunit.client.0.smithi098.stdout:4/510: write d6/d10/d21/f3b [401767,63102] 0 2024-09-13T02:52:57.934 INFO:tasks.workunit.client.0.smithi098.stdout:2/464: link d1/d1f/d35/d63/d72/l90 d1/d1a/d9/l99 0 2024-09-13T02:52:57.935 INFO:tasks.workunit.client.0.smithi098.stdout:7/690: symlink d6/d24/d2a/d57/d88/le4 0 2024-09-13T02:52:57.937 INFO:tasks.workunit.client.0.smithi098.stdout:4/511: creat d6/d22/d3d/d4d/fbb x:0 0 0 2024-09-13T02:52:57.939 INFO:tasks.workunit.client.0.smithi098.stdout:4/512: creat d6/d54/fbc x:0 0 0 2024-09-13T02:52:57.940 INFO:tasks.workunit.client.0.smithi098.stdout:4/513: chown d6/d22/d3d/d4d/l6e 2 1 2024-09-13T02:52:57.940 INFO:tasks.workunit.client.0.smithi098.stdout:7/691: creat d6/d24/d2a/d5a/fe5 x:0 0 0 2024-09-13T02:52:57.941 INFO:tasks.workunit.client.0.smithi098.stdout:2/465: getdents d1/d1f/d36 0 2024-09-13T02:52:57.942 INFO:tasks.workunit.client.0.smithi098.stdout:7/692: mkdir d6/d24/dc5/de3/de6 0 2024-09-13T02:52:57.944 INFO:tasks.workunit.client.0.smithi098.stdout:2/466: creat d1/d1f/d35/d63/f9a x:0 0 0 2024-09-13T02:52:57.945 INFO:tasks.workunit.client.0.smithi098.stdout:7/693: symlink d6/d24/d46/le7 0 2024-09-13T02:52:57.945 INFO:tasks.workunit.client.0.smithi098.stdout:2/467: write d1/d1f/f42 [1411021,79548] 0 2024-09-13T02:52:57.946 INFO:tasks.workunit.client.0.smithi098.stdout:7/694: dread - d6/d24/d2a/dda/fd0 zero size 2024-09-13T02:52:57.948 INFO:tasks.workunit.client.0.smithi098.stdout:7/695: fsync d6/d24/d2a/d5a/d86/fbe 0 2024-09-13T02:52:57.950 INFO:tasks.workunit.client.0.smithi098.stdout:7/696: readlink d6/d24/d2a/d5a/d86/l5e 0 2024-09-13T02:52:57.953 INFO:tasks.workunit.client.0.smithi098.stdout:2/468: dwrite d1/d1a/d4f/d7f/f85 [0,4194304] 0 2024-09-13T02:52:57.957 INFO:tasks.workunit.client.1.smithi142.stdout:8/966: sync 2024-09-13T02:52:57.958 INFO:tasks.workunit.client.0.smithi098.stdout:2/469: unlink d1/d1a/c5 0 2024-09-13T02:52:57.959 INFO:tasks.workunit.client.0.smithi098.stdout:7/697: getdents d6/d24/d2a/d5a/d8e/dbd 0 2024-09-13T02:52:57.960 INFO:tasks.workunit.client.0.smithi098.stdout:4/514: truncate d6/d22/f63 6512763 0 2024-09-13T02:52:57.961 INFO:tasks.workunit.client.0.smithi098.stdout:2/470: creat d1/d1f/d35/d63/d72/f9b x:0 0 0 2024-09-13T02:52:57.965 INFO:tasks.workunit.client.0.smithi098.stdout:2/471: rename d1/d1f/d36/f5e to d1/d1f/d27/f9c 0 2024-09-13T02:52:57.969 INFO:tasks.workunit.client.0.smithi098.stdout:2/472: rename d1/d1f/f56 to d1/d1f/d35/d63/d72/f9d 0 2024-09-13T02:52:57.971 INFO:tasks.workunit.client.0.smithi098.stdout:2/473: mkdir d1/d1a/d4f/d59/d9e 0 2024-09-13T02:52:57.972 INFO:tasks.workunit.client.0.smithi098.stdout:4/515: fsync d6/d22/f63 0 2024-09-13T02:52:57.977 INFO:tasks.workunit.client.1.smithi142.stdout:8/967: dread d0/d6/dc/f49 [0,4194304] 0 2024-09-13T02:52:57.978 INFO:tasks.workunit.client.0.smithi098.stdout:4/516: fsync d6/d22/d3d/f49 0 2024-09-13T02:52:57.978 INFO:tasks.workunit.client.0.smithi098.stdout:7/698: dwrite d6/f41 [0,4194304] 0 2024-09-13T02:52:57.982 INFO:tasks.workunit.client.0.smithi098.stdout:4/517: truncate d6/d10/d21/f3b 1512845 0 2024-09-13T02:52:57.982 INFO:tasks.workunit.client.0.smithi098.stdout:2/474: mkdir d1/d1a/d4f/d59/d9e/d9f 0 2024-09-13T02:52:57.982 INFO:tasks.workunit.client.0.smithi098.stdout:4/518: fdatasync d6/d22/d3d/d6c/d91/fb1 0 2024-09-13T02:52:57.984 INFO:tasks.workunit.client.0.smithi098.stdout:4/519: write d6/d22/d3d/d41/d74/d98/fa8 [149479,120080] 0 2024-09-13T02:52:57.987 INFO:tasks.workunit.client.0.smithi098.stdout:4/520: write d6/d22/d3d/d41/d58/f78 [1664906,125892] 0 2024-09-13T02:52:57.988 INFO:tasks.workunit.client.0.smithi098.stdout:2/475: mknod d1/d1f/d27/ca0 0 2024-09-13T02:52:57.988 INFO:tasks.workunit.client.0.smithi098.stdout:2/476: stat d1/f97 0 2024-09-13T02:52:57.990 INFO:tasks.workunit.client.1.smithi142.stdout:8/968: mkdir d0/d6/dc/d45/d9d/d13f 0 2024-09-13T02:52:57.991 INFO:tasks.workunit.client.1.smithi142.stdout:8/969: chown d0/d6/dc/d40/d46/da1/fbb 61 1 2024-09-13T02:52:57.992 INFO:tasks.workunit.client.0.smithi098.stdout:4/521: mknod d6/d22/d3d/d41/d74/d98/cbd 0 2024-09-13T02:52:57.995 INFO:tasks.workunit.client.0.smithi098.stdout:4/522: symlink d6/d37/lbe 0 2024-09-13T02:52:57.997 INFO:tasks.workunit.client.0.smithi098.stdout:2/477: read d1/d1f/d39/f49 [9276,55246] 0 2024-09-13T02:52:58.000 INFO:tasks.workunit.client.0.smithi098.stdout:2/478: creat d1/d1f/d30/fa1 x:0 0 0 2024-09-13T02:52:58.003 INFO:tasks.workunit.client.0.smithi098.stdout:4/523: dwrite d6/d10/d21/f2b [0,4194304] 0 2024-09-13T02:52:58.005 INFO:tasks.workunit.client.1.smithi142.stdout:8/970: dwrite d0/d6/dc/d45/fa [0,4194304] 0 2024-09-13T02:52:58.007 INFO:tasks.workunit.client.1.smithi142.stdout:8/971: chown d0/d6/dc/d45/d9d/d10c/dc9/d113/d62/f114 1225 1 2024-09-13T02:52:58.008 INFO:tasks.workunit.client.0.smithi098.stdout:4/524: creat d6/d22/d3d/d6c/d91/fbf x:0 0 0 2024-09-13T02:52:58.009 INFO:tasks.workunit.client.0.smithi098.stdout:2/479: link d1/d1f/d35/d63/d23/f81 d1/d1a/d4f/d59/fa2 0 2024-09-13T02:52:58.010 INFO:tasks.workunit.client.0.smithi098.stdout:4/525: chown d6/d37/l87 113 1 2024-09-13T02:52:58.011 INFO:tasks.workunit.client.1.smithi142.stdout:8/972: symlink d0/d6/dc/d45/d8/df/d28/l140 0 2024-09-13T02:52:58.011 INFO:tasks.workunit.client.0.smithi098.stdout:2/480: symlink d1/d1a/d9/la3 0 2024-09-13T02:52:58.012 INFO:tasks.workunit.client.1.smithi142.stdout:8/973: truncate d0/d6/dc/fee 5560203 0 2024-09-13T02:52:58.017 INFO:tasks.workunit.client.1.smithi142.stdout:8/974: unlink d0/d6/dc/d45/d9d/d10c/dc9/ccf 0 2024-09-13T02:52:58.018 INFO:tasks.workunit.client.0.smithi098.stdout:4/526: symlink d6/d37/d83/lc0 0 2024-09-13T02:52:58.020 INFO:tasks.workunit.client.1.smithi142.stdout:8/975: creat d0/d6/dc/d40/d41/f141 x:0 0 0 2024-09-13T02:52:58.021 INFO:tasks.workunit.client.1.smithi142.stdout:8/976: write d0/d6/dc/d45/f3c [3819799,41632] 0 2024-09-13T02:52:58.023 INFO:tasks.workunit.client.0.smithi098.stdout:2/481: dwrite d1/f7b [0,4194304] 0 2024-09-13T02:52:58.027 INFO:tasks.workunit.client.1.smithi142.stdout:8/977: mknod d0/d6/dc/d45/d9d/d10c/d11a/c142 0 2024-09-13T02:52:58.027 INFO:tasks.workunit.client.0.smithi098.stdout:4/527: unlink d6/l79 0 2024-09-13T02:52:58.028 INFO:tasks.workunit.client.0.smithi098.stdout:2/482: fdatasync d1/d1f/d35/f4b 0 2024-09-13T02:52:58.028 INFO:tasks.workunit.client.0.smithi098.stdout:4/528: chown d6/d10/d21/l7d 3 1 2024-09-13T02:52:58.028 INFO:tasks.workunit.client.1.smithi142.stdout:8/978: write d0/d6/dc/d40/d41/f141 [485720,32727] 0 2024-09-13T02:52:58.029 INFO:tasks.workunit.client.0.smithi098.stdout:2/483: dread - d1/d1f/d30/fa1 zero size 2024-09-13T02:52:58.030 INFO:tasks.workunit.client.0.smithi098.stdout:4/529: mknod d6/d54/d6a/cc1 0 2024-09-13T02:52:58.032 INFO:tasks.workunit.client.1.smithi142.stdout:8/979: rename d0/d6/d23/d2b/l7a to d0/d6/dc/d45/d35/l143 0 2024-09-13T02:52:58.033 INFO:tasks.workunit.client.1.smithi142.stdout:8/980: chown d0/d6/d23/f3d 3 1 2024-09-13T02:52:58.036 INFO:tasks.workunit.client.0.smithi098.stdout:2/484: creat d1/d1f/fa4 x:0 0 0 2024-09-13T02:52:58.037 INFO:tasks.workunit.client.0.smithi098.stdout:2/485: write d1/d1a/d9/f5c [3721171,66085] 0 2024-09-13T02:52:58.038 INFO:tasks.workunit.client.1.smithi142.stdout:8/981: rename d0/d6/dc/d45/d35/d61/d77/lcd to d0/d6/d83/d104/l144 0 2024-09-13T02:52:58.041 INFO:tasks.workunit.client.0.smithi098.stdout:2/486: write d1/d1a/d9/d1e/d5a/f86 [451330,96263] 0 2024-09-13T02:52:58.042 INFO:tasks.workunit.client.0.smithi098.stdout:4/530: dwrite d6/d37/f72 [0,4194304] 0 2024-09-13T02:52:58.042 INFO:tasks.workunit.client.0.smithi098.stdout:2/487: fsync d1/d1f/d30/f34 0 2024-09-13T02:52:58.043 INFO:tasks.workunit.client.0.smithi098.stdout:2/488: dread - d1/d1a/d4f/f8c zero size 2024-09-13T02:52:58.045 INFO:tasks.workunit.client.1.smithi142.stdout:8/982: dwrite d0/d6/dc/d45/d35/d7e/fe8 [0,4194304] 0 2024-09-13T02:52:58.046 INFO:tasks.workunit.client.0.smithi098.stdout:4/531: chown d6/c8a 259 1 2024-09-13T02:52:58.049 INFO:tasks.workunit.client.0.smithi098.stdout:2/489: truncate d1/d1f/d39/f8e 574453 0 2024-09-13T02:52:58.062 INFO:tasks.workunit.client.0.smithi098.stdout:4/532: creat d6/d22/d3d/d41/d58/da9/fc2 x:0 0 0 2024-09-13T02:52:58.063 INFO:tasks.workunit.client.0.smithi098.stdout:4/533: truncate d6/d54/fbc 890107 0 2024-09-13T02:52:58.065 INFO:tasks.workunit.client.0.smithi098.stdout:4/534: truncate d6/d22/d3d/d41/d58/da9/fc2 220762 0 2024-09-13T02:52:58.067 INFO:tasks.workunit.client.0.smithi098.stdout:4/535: creat d6/d22/d3d/d41/d74/d98/fc3 x:0 0 0 2024-09-13T02:52:58.068 INFO:tasks.workunit.client.1.smithi142.stdout:8/983: write d0/d6/dc/d45/d8/fe1 [4558445,108403] 0 2024-09-13T02:52:58.070 INFO:tasks.workunit.client.1.smithi142.stdout:8/984: getdents d0/d6/d23/d13a 0 2024-09-13T02:52:58.071 INFO:tasks.workunit.client.0.smithi098.stdout:2/490: write d1/d1f/d35/d63/f3f [443275,112179] 0 2024-09-13T02:52:58.074 INFO:tasks.workunit.client.1.smithi142.stdout:8/985: dread d0/d6/dc/d45/fa [0,4194304] 0 2024-09-13T02:52:58.075 INFO:tasks.workunit.client.0.smithi098.stdout:2/491: getdents d1/d1f/d35/d63/d72 0 2024-09-13T02:52:58.075 INFO:tasks.workunit.client.1.smithi142.stdout:8/986: fdatasync d0/d6/dc/d45/d9d/d10c/f13b 0 2024-09-13T02:52:58.078 INFO:tasks.workunit.client.1.smithi142.stdout:8/987: creat d0/d6/dc/d40/d46/da1/f145 x:0 0 0 2024-09-13T02:52:58.079 INFO:tasks.workunit.client.0.smithi098.stdout:2/492: unlink d1/d1f/d39/f95 0 2024-09-13T02:52:58.081 INFO:tasks.workunit.client.0.smithi098.stdout:2/493: mknod d1/d1f/d39/ca5 0 2024-09-13T02:52:58.081 INFO:tasks.workunit.client.0.smithi098.stdout:2/494: chown d1/d1f/d35/d63/d23/l4a 12944 1 2024-09-13T02:52:58.083 INFO:tasks.workunit.client.1.smithi142.stdout:8/988: dwrite d0/d6/dc/d45/d35/f63 [4194304,4194304] 0 2024-09-13T02:52:58.083 INFO:tasks.workunit.client.0.smithi098.stdout:2/495: creat d1/fa6 x:0 0 0 2024-09-13T02:52:58.085 INFO:tasks.workunit.client.0.smithi098.stdout:2/496: mkdir d1/da7 0 2024-09-13T02:52:58.086 INFO:tasks.workunit.client.0.smithi098.stdout:2/497: rmdir d1/d1a/d9/d1e 39 2024-09-13T02:52:58.088 INFO:tasks.workunit.client.0.smithi098.stdout:2/498: dread d1/d1f/d39/f8e [0,4194304] 0 2024-09-13T02:52:58.090 INFO:tasks.workunit.client.0.smithi098.stdout:2/499: write d1/d1a/d9/d1e/d5a/f5f [65098,37205] 0 2024-09-13T02:52:58.114 INFO:tasks.workunit.client.0.smithi098.stdout:2/500: dread d1/d1f/f66 [0,4194304] 0 2024-09-13T02:52:58.116 INFO:tasks.workunit.client.0.smithi098.stdout:2/501: unlink d1/d1f/d30/f3e 0 2024-09-13T02:52:58.121 INFO:tasks.workunit.client.0.smithi098.stdout:2/502: dwrite d1/d1a/d9/d1e/d5a/f86 [0,4194304] 0 2024-09-13T02:52:58.122 INFO:tasks.workunit.client.0.smithi098.stdout:2/503: read d1/d1a/f3a [1997037,35731] 0 2024-09-13T02:52:58.124 INFO:tasks.workunit.client.0.smithi098.stdout:2/504: mkdir d1/d1f/d35/d63/d72/d88/da8 0 2024-09-13T02:52:58.127 INFO:tasks.workunit.client.0.smithi098.stdout:2/505: write d1/d1f/d39/f29 [8700866,119609] 0 2024-09-13T02:52:58.128 INFO:tasks.workunit.client.0.smithi098.stdout:5/491: sync 2024-09-13T02:52:58.128 INFO:tasks.workunit.client.0.smithi098.stdout:1/601: sync 2024-09-13T02:52:58.128 INFO:tasks.workunit.client.0.smithi098.stdout:8/507: sync 2024-09-13T02:52:58.128 INFO:tasks.workunit.client.0.smithi098.stdout:2/506: dread - d1/d1f/d35/f74 zero size 2024-09-13T02:52:58.128 INFO:tasks.workunit.client.0.smithi098.stdout:9/525: sync 2024-09-13T02:52:58.129 INFO:tasks.workunit.client.0.smithi098.stdout:1/602: chown d9/d33/ldf 17111782 1 2024-09-13T02:52:58.130 INFO:tasks.workunit.client.0.smithi098.stdout:8/508: readlink d2/d2f/d78/d46/d47/d6e/l81 0 2024-09-13T02:52:58.130 INFO:tasks.workunit.client.0.smithi098.stdout:5/492: read - d0/d38/d3f/d81/d4d/d82/f93 zero size 2024-09-13T02:52:58.132 INFO:tasks.workunit.client.0.smithi098.stdout:9/526: mknod d2/d6/d2b/d4d/cc1 0 2024-09-13T02:52:58.134 INFO:tasks.workunit.client.0.smithi098.stdout:2/507: creat d1/d1a/d4f/d59/d9e/d9f/fa9 x:0 0 0 2024-09-13T02:52:58.135 INFO:tasks.workunit.client.0.smithi098.stdout:2/508: dread - d1/d1a/d4f/d7f/f7a zero size 2024-09-13T02:52:58.135 INFO:tasks.workunit.client.0.smithi098.stdout:5/493: symlink d0/la8 0 2024-09-13T02:52:58.138 INFO:tasks.workunit.client.0.smithi098.stdout:9/527: mknod d2/d6/d36/d8d/d39/d43/d90/da2/cc2 0 2024-09-13T02:52:58.140 INFO:tasks.workunit.client.0.smithi098.stdout:1/603: link d9/d33/d19/d35/d68/d4d/dbc/d6b/l7b d9/le0 0 2024-09-13T02:52:58.141 INFO:tasks.workunit.client.0.smithi098.stdout:8/509: link d2/dd/d11/d1d/c6f d2/dd/d11/d44/c9e 0 2024-09-13T02:52:58.143 INFO:tasks.workunit.client.0.smithi098.stdout:2/509: dwrite d1/fa6 [0,4194304] 0 2024-09-13T02:52:58.145 INFO:tasks.workunit.client.0.smithi098.stdout:5/494: creat d0/fa9 x:0 0 0 2024-09-13T02:52:58.148 INFO:tasks.workunit.client.1.smithi142.stdout:8/989: sync 2024-09-13T02:52:58.150 INFO:tasks.workunit.client.0.smithi098.stdout:2/510: rename d1/d1f/d35/c94 to d1/d1f/d35/d63/caa 0 2024-09-13T02:52:58.152 INFO:tasks.workunit.client.0.smithi098.stdout:2/511: write d1/d1f/d35/d63/f65 [4209653,19638] 0 2024-09-13T02:52:58.153 INFO:tasks.workunit.client.1.smithi142.stdout:8/990: mkdir d0/d75/d146 0 2024-09-13T02:52:58.153 INFO:tasks.workunit.client.0.smithi098.stdout:2/512: dread - d1/d1f/d35/d63/d72/f78 zero size 2024-09-13T02:52:58.156 INFO:tasks.workunit.client.0.smithi098.stdout:2/513: write d1/d1a/d4f/f8c [611675,37913] 0 2024-09-13T02:52:58.157 INFO:tasks.workunit.client.0.smithi098.stdout:5/495: truncate d0/d38/d3f/d1a/f34 440134 0 2024-09-13T02:52:58.157 INFO:tasks.workunit.client.1.smithi142.stdout:8/991: dread d0/d6/dc/d2e/f129 [0,4194304] 0 2024-09-13T02:52:58.159 INFO:tasks.workunit.client.0.smithi098.stdout:1/604: mkdir d9/d33/d19/d35/de1 0 2024-09-13T02:52:58.160 INFO:tasks.workunit.client.0.smithi098.stdout:9/528: getdents d2/d6/d2b/d66 0 2024-09-13T02:52:58.161 INFO:tasks.workunit.client.0.smithi098.stdout:1/605: write d9/d33/d19/d35/d68/d60/d61/db1/fd0 [947736,28420] 0 2024-09-13T02:52:58.166 INFO:tasks.workunit.client.0.smithi098.stdout:2/514: symlink d1/d1f/d35/d63/d72/lab 0 2024-09-13T02:52:58.167 INFO:tasks.workunit.client.0.smithi098.stdout:9/529: dwrite d2/d6/f8b [0,4194304] 0 2024-09-13T02:52:58.168 INFO:tasks.workunit.client.1.smithi142.stdout:8/992: mkdir d0/d6/dc/d147 0 2024-09-13T02:52:58.168 INFO:tasks.workunit.client.1.smithi142.stdout:8/993: chown d0/d6/dc/d45/d35/f81 97890432 1 2024-09-13T02:52:58.171 INFO:tasks.workunit.client.0.smithi098.stdout:1/606: mkdir d9/d33/d19/d35/d68/d4d/db5/de2 0 2024-09-13T02:52:58.173 INFO:tasks.workunit.client.1.smithi142.stdout:8/994: rmdir d0/d6/d23/d2b 39 2024-09-13T02:52:58.177 INFO:tasks.workunit.client.0.smithi098.stdout:9/530: chown d2/d6/d91 774 1 2024-09-13T02:52:58.185 INFO:tasks.workunit.client.0.smithi098.stdout:5/496: mkdir d0/d15/d17/daa 0 2024-09-13T02:52:58.185 INFO:tasks.workunit.client.0.smithi098.stdout:1/607: mknod d9/d33/d19/d35/d68/d60/d61/db1/ce3 0 2024-09-13T02:52:58.188 INFO:tasks.workunit.client.1.smithi142.stdout:8/995: rename d0/d6/dc/d45/f6a to d0/d6/dc/d45/d8/df/f148 0 2024-09-13T02:52:58.188 INFO:tasks.workunit.client.1.smithi142.stdout:8/996: readlink d0/d6/dc/d45/d8/df/d28/l9e 0 2024-09-13T02:52:58.189 INFO:tasks.workunit.client.0.smithi098.stdout:9/531: write d2/d6/d36/d6a/f6b [3419120,36961] 0 2024-09-13T02:52:58.190 INFO:tasks.workunit.client.0.smithi098.stdout:9/532: write d2/d6/d36/f82 [6122999,36192] 0 2024-09-13T02:52:58.197 INFO:tasks.workunit.client.0.smithi098.stdout:9/533: dwrite d2/d6/d2b/d4d/fab [0,4194304] 0 2024-09-13T02:52:58.207 INFO:tasks.workunit.client.0.smithi098.stdout:8/510: getdents d2/d28/d43/d88 0 2024-09-13T02:52:58.208 INFO:tasks.workunit.client.0.smithi098.stdout:1/608: dread - d9/d33/d29/d58/f5c zero size 2024-09-13T02:52:58.211 INFO:tasks.workunit.client.0.smithi098.stdout:9/534: mknod d2/d6/d36/d8d/d39/d43/cc3 0 2024-09-13T02:52:58.212 INFO:tasks.workunit.client.0.smithi098.stdout:8/511: truncate d2/d2f/f38 399392 0 2024-09-13T02:52:58.213 INFO:tasks.workunit.client.0.smithi098.stdout:5/497: mkdir d0/d15/d17/daa/dab 0 2024-09-13T02:52:58.214 INFO:tasks.workunit.client.0.smithi098.stdout:2/515: getdents d1/d1f/d35/d63/d23 0 2024-09-13T02:52:58.215 INFO:tasks.workunit.client.0.smithi098.stdout:5/498: chown d0/d38/d3f/d81/d4d/d82/d9a 18 1 2024-09-13T02:52:58.216 INFO:tasks.workunit.client.0.smithi098.stdout:2/516: truncate d1/f97 320138 0 2024-09-13T02:52:58.216 INFO:tasks.workunit.client.0.smithi098.stdout:1/609: symlink d9/d33/d19/d35/d68/d60/d61/ddb/le4 0 2024-09-13T02:52:58.217 INFO:tasks.workunit.client.0.smithi098.stdout:9/535: truncate d2/d6/d2b/d4d/d56/f7e 782183 0 2024-09-13T02:52:58.218 INFO:tasks.workunit.client.0.smithi098.stdout:2/517: chown d1/d1a/d4f/d59/fa2 245198235 1 2024-09-13T02:52:58.220 INFO:tasks.workunit.client.0.smithi098.stdout:5/499: creat d0/d38/d3f/fac x:0 0 0 2024-09-13T02:52:58.221 INFO:tasks.workunit.client.0.smithi098.stdout:9/536: chown d2/d6/d36/d8d/d39/c72 373864 1 2024-09-13T02:52:58.221 INFO:tasks.workunit.client.0.smithi098.stdout:8/512: dwrite d2/d2f/d78/f4f [0,4194304] 0 2024-09-13T02:52:58.222 INFO:tasks.workunit.client.0.smithi098.stdout:6/494: sync 2024-09-13T02:52:58.222 INFO:tasks.workunit.client.0.smithi098.stdout:3/540: sync 2024-09-13T02:52:58.222 INFO:tasks.workunit.client.0.smithi098.stdout:1/610: creat d9/d33/d19/d35/d68/d4d/dbc/d6b/fe5 x:0 0 0 2024-09-13T02:52:58.224 INFO:tasks.workunit.client.0.smithi098.stdout:2/518: creat d1/d1a/d9/d1e/d5a/fac x:0 0 0 2024-09-13T02:52:58.225 INFO:tasks.workunit.client.0.smithi098.stdout:8/513: write d2/dd/d11/d1d/f45 [1679122,6756] 0 2024-09-13T02:52:58.225 INFO:tasks.workunit.client.0.smithi098.stdout:9/537: dread - d2/d6/d2b/d4d/d56/f93 zero size 2024-09-13T02:52:58.237 INFO:tasks.workunit.client.0.smithi098.stdout:3/541: symlink d7/d9/d15/d80/da0/la4 0 2024-09-13T02:52:58.239 INFO:tasks.workunit.client.1.smithi142.stdout:8/997: sync 2024-09-13T02:52:58.240 INFO:tasks.workunit.client.0.smithi098.stdout:8/514: mkdir d2/d28/d43/d9f 0 2024-09-13T02:52:58.241 INFO:tasks.workunit.client.0.smithi098.stdout:5/500: link d0/d29/c79 d0/d38/d3f/d81/d4d/d82/cad 0 2024-09-13T02:52:58.241 INFO:tasks.workunit.client.0.smithi098.stdout:8/515: chown d2/d28/c6b 329973 1 2024-09-13T02:52:58.241 INFO:tasks.workunit.client.0.smithi098.stdout:8/516: chown d2/d2f/d78/d5d/f79 8320165 1 2024-09-13T02:52:58.245 INFO:tasks.workunit.client.0.smithi098.stdout:3/542: creat d7/d9/d25/d64/d6f/fa5 x:0 0 0 2024-09-13T02:52:58.247 INFO:tasks.workunit.client.0.smithi098.stdout:5/501: rmdir d0/d15/d50 39 2024-09-13T02:52:58.248 INFO:tasks.workunit.client.0.smithi098.stdout:5/502: chown d0/d38/d3f/d81/d4d 97924 1 2024-09-13T02:52:58.252 INFO:tasks.workunit.client.0.smithi098.stdout:2/519: getdents d1/d1f/d35/d63 0 2024-09-13T02:52:58.253 INFO:tasks.workunit.client.1.smithi142.stdout:8/998: link d0/d6/dc/d134/f13c d0/d6/dc/d45/d9d/d10c/d11a/f149 0 2024-09-13T02:52:58.254 INFO:tasks.workunit.client.0.smithi098.stdout:9/538: link d2/d6/l68 d2/d6/d2b/d4d/d4f/d6c/dc0/lc4 0 2024-09-13T02:52:58.254 INFO:tasks.workunit.client.0.smithi098.stdout:3/543: read f4 [1026779,53097] 0 2024-09-13T02:52:58.257 INFO:tasks.workunit.client.0.smithi098.stdout:2/520: write d1/d1f/f66 [961560,125439] 0 2024-09-13T02:52:58.259 INFO:tasks.workunit.client.0.smithi098.stdout:2/521: read - d1/d1f/d35/f4b zero size 2024-09-13T02:52:58.262 INFO:tasks.workunit.client.0.smithi098.stdout:8/517: creat d2/dd/d2e/fa0 x:0 0 0 2024-09-13T02:52:58.263 INFO:tasks.workunit.client.0.smithi098.stdout:3/544: symlink d7/d9/d4c/la6 0 2024-09-13T02:52:58.265 INFO:tasks.workunit.client.0.smithi098.stdout:5/503: symlink d0/d38/d3f/d81/d4d/d82/d9a/lae 0 2024-09-13T02:52:58.268 INFO:tasks.workunit.client.0.smithi098.stdout:2/522: mknod d1/d1a/d9/d1e/d5a/cad 0 2024-09-13T02:52:58.269 INFO:tasks.workunit.client.0.smithi098.stdout:8/518: symlink d2/dd/d11/d44/la1 0 2024-09-13T02:52:58.269 INFO:tasks.workunit.client.0.smithi098.stdout:2/523: truncate d1/f48 410274 0 2024-09-13T02:52:58.270 INFO:tasks.workunit.client.0.smithi098.stdout:3/545: readlink d7/d9/l62 0 2024-09-13T02:52:58.270 INFO:tasks.workunit.client.1.smithi142.stdout:8/999: dread d0/d6/d83/daa/fcb [0,4194304] 0 2024-09-13T02:52:58.273 INFO:tasks.workunit.client.1.smithi142.stderr:+ rm -rf -- ./tmp.zW5d2o33f4 2024-09-13T02:52:58.275 INFO:tasks.workunit.client.0.smithi098.stdout:3/546: creat d7/d9/d15/d2d/d78/fa7 x:0 0 0 2024-09-13T02:52:58.278 INFO:tasks.workunit.client.0.smithi098.stdout:1/611: truncate d9/d33/d19/d35/d68/d2f/dbf/f85 139067 0 2024-09-13T02:52:58.278 INFO:tasks.workunit.client.0.smithi098.stdout:8/519: dread d2/f27 [0,4194304] 0 2024-09-13T02:52:58.279 INFO:tasks.workunit.client.0.smithi098.stdout:6/495: dwrite d5/d13/d2b/d3a/f86 [0,4194304] 0 2024-09-13T02:52:58.282 INFO:tasks.workunit.client.0.smithi098.stdout:2/524: getdents d1/d1f/d35/d63/d72/d88/da8 0 2024-09-13T02:52:58.286 INFO:tasks.workunit.client.0.smithi098.stdout:5/504: dread d0/d15/d17/d1c/f6c [0,4194304] 0 2024-09-13T02:52:58.288 INFO:tasks.workunit.client.0.smithi098.stdout:5/505: chown d0/d38/d3f/d81/f95 11 1 2024-09-13T02:52:58.289 INFO:tasks.workunit.client.0.smithi098.stdout:5/506: stat d0/d7c/fa0 0 2024-09-13T02:52:58.290 INFO:tasks.workunit.client.0.smithi098.stdout:2/525: creat d1/d1a/d4f/d7f/fae x:0 0 0 2024-09-13T02:52:58.293 INFO:tasks.workunit.client.0.smithi098.stdout:3/547: link d7/d9/d15/d2d/d5b/f46 d7/d9/d15/d5d/fa8 0 2024-09-13T02:52:58.294 INFO:tasks.workunit.client.0.smithi098.stdout:9/539: dwrite d2/f69 [0,4194304] 0 2024-09-13T02:52:58.297 INFO:tasks.workunit.client.0.smithi098.stdout:1/612: truncate d9/d33/d19/d35/d68/d4d/dbc/d6b/fb2 4865472 0 2024-09-13T02:52:58.299 INFO:tasks.workunit.client.0.smithi098.stdout:1/613: chown d9/d33/d19/d46/f4a 10267 1 2024-09-13T02:52:58.306 INFO:tasks.workunit.client.0.smithi098.stdout:2/526: chown d1/d1a/d9/l99 1280382036 1 2024-09-13T02:52:58.307 INFO:tasks.workunit.client.0.smithi098.stdout:3/548: symlink d7/d9/d15/d2d/d78/d7e/la9 0 2024-09-13T02:52:58.307 INFO:tasks.workunit.client.0.smithi098.stdout:1/614: dwrite d9/d33/d19/d35/d68/d4d/dbc/fb3 [0,4194304] 0 2024-09-13T02:52:58.310 INFO:tasks.workunit.client.0.smithi098.stdout:0/558: sync 2024-09-13T02:52:58.310 INFO:tasks.workunit.client.0.smithi098.stdout:9/540: unlink d2/d6/d36/d8d/d39/d43/d90/da0/faa 0 2024-09-13T02:52:58.311 INFO:tasks.workunit.client.0.smithi098.stdout:0/559: stat dd/f45 0 2024-09-13T02:52:58.316 INFO:tasks.workunit.client.0.smithi098.stdout:8/520: rename d2/d91 to d2/d2f/d78/d46/da2 0 2024-09-13T02:52:58.318 INFO:tasks.workunit.client.0.smithi098.stdout:3/549: dwrite d7/d9/d15/d2d/d34/f97 [0,4194304] 0 2024-09-13T02:52:58.330 INFO:tasks.workunit.client.0.smithi098.stdout:5/507: dwrite d0/d15/d17/d1c/d3d/f47 [4194304,4194304] 0 2024-09-13T02:52:58.332 INFO:tasks.workunit.client.0.smithi098.stdout:5/508: write d0/d38/d3f/d1a/f86 [380984,113118] 0 2024-09-13T02:52:58.344 INFO:tasks.workunit.client.0.smithi098.stdout:6/496: rename d5/d18/f47 to d5/d13/d2b/d3a/d14/d94/d97/da3/fac 0 2024-09-13T02:52:58.354 INFO:tasks.workunit.client.0.smithi098.stdout:1/615: dread d9/d33/d19/d35/d68/d2f/dbf/f85 [0,4194304] 0 2024-09-13T02:52:58.355 INFO:tasks.workunit.client.0.smithi098.stdout:3/550: dwrite d7/d9/d25/d2b/f75 [0,4194304] 0 2024-09-13T02:52:58.358 INFO:tasks.workunit.client.0.smithi098.stdout:2/527: mknod d1/d1f/d35/d63/d72/d88/da8/caf 0 2024-09-13T02:52:58.362 INFO:tasks.workunit.client.0.smithi098.stdout:5/509: dread d0/d15/f9b [0,4194304] 0 2024-09-13T02:52:58.364 INFO:tasks.workunit.client.0.smithi098.stdout:9/541: mkdir d2/db1/dc5 0 2024-09-13T02:52:58.366 INFO:tasks.workunit.client.0.smithi098.stdout:1/616: dwrite d9/d33/d19/d35/d63/f77 [0,4194304] 0 2024-09-13T02:52:58.367 INFO:tasks.workunit.client.0.smithi098.stdout:5/510: dread d0/d15/d69/f71 [0,4194304] 0 2024-09-13T02:52:58.368 INFO:tasks.workunit.client.0.smithi098.stdout:1/617: dread - d9/d33/fa4 zero size 2024-09-13T02:52:58.377 INFO:tasks.workunit.client.0.smithi098.stdout:4/536: sync 2024-09-13T02:52:58.378 INFO:tasks.workunit.client.0.smithi098.stdout:7/699: sync 2024-09-13T02:52:58.378 INFO:tasks.workunit.client.0.smithi098.stdout:3/551: mknod d7/d9/d25/d3a/d52/caa 0 2024-09-13T02:52:58.383 INFO:tasks.workunit.client.0.smithi098.stdout:0/560: write dd/df/d1d/d26/d37/fa0 [780431,122940] 0 2024-09-13T02:52:58.384 INFO:tasks.workunit.client.0.smithi098.stdout:9/542: truncate d2/d6/d36/d8d/d39/f86 937379 0 2024-09-13T02:52:58.384 INFO:tasks.workunit.client.0.smithi098.stdout:0/561: chown dd/df/d1d/d26/d28/c8a 48320494 1 2024-09-13T02:52:58.387 INFO:tasks.workunit.client.0.smithi098.stdout:5/511: mknod d0/d15/d17/d1c/caf 0 2024-09-13T02:52:58.390 INFO:tasks.workunit.client.0.smithi098.stdout:6/497: getdents d5/d13/d67/d85 0 2024-09-13T02:52:58.393 INFO:tasks.workunit.client.0.smithi098.stdout:2/528: mknod d1/da7/cb0 0 2024-09-13T02:52:58.394 INFO:tasks.workunit.client.0.smithi098.stdout:2/529: chown d1/f8 124263 1 2024-09-13T02:52:58.395 INFO:tasks.workunit.client.0.smithi098.stdout:2/530: dread - d1/d1f/d35/d63/d72/f9b zero size 2024-09-13T02:52:58.397 INFO:tasks.workunit.client.0.smithi098.stdout:4/537: dread d6/d22/d3d/d4d/fa0 [0,4194304] 0 2024-09-13T02:52:58.402 INFO:tasks.workunit.client.0.smithi098.stdout:4/538: dread d6/d10/d21/f3b [0,4194304] 0 2024-09-13T02:52:58.403 INFO:tasks.workunit.client.0.smithi098.stdout:8/521: rename d2/d2f/d78/d46/d47/d6e/d68/f82 to d2/d28/fa3 0 2024-09-13T02:52:58.406 INFO:tasks.workunit.client.0.smithi098.stdout:5/512: dread d0/d38/d3f/f36 [0,4194304] 0 2024-09-13T02:52:58.407 INFO:tasks.workunit.client.0.smithi098.stdout:3/552: mknod d7/d9/d15/d2d/cab 0 2024-09-13T02:52:58.410 INFO:tasks.workunit.client.0.smithi098.stdout:2/531: fsync d1/d1f/d35/d63/d72/f9d 0 2024-09-13T02:52:58.419 INFO:tasks.workunit.client.0.smithi098.stdout:4/539: unlink d6/d37/d83/lc0 0 2024-09-13T02:52:58.420 INFO:tasks.workunit.client.0.smithi098.stdout:6/498: dread d5/f33 [0,4194304] 0 2024-09-13T02:52:58.423 INFO:tasks.workunit.client.0.smithi098.stdout:6/499: read d5/d13/d2b/d3a/d41/d7e/f7d [2015504,48630] 0 2024-09-13T02:52:58.424 INFO:tasks.workunit.client.0.smithi098.stdout:3/553: truncate d7/d9/d25/d3a/d51/f69 3688531 0 2024-09-13T02:52:58.424 INFO:tasks.workunit.client.0.smithi098.stdout:7/700: link d6/d24/d46/le7 d6/d24/d2a/d5a/d42/dde/le8 0 2024-09-13T02:52:58.427 INFO:tasks.workunit.client.0.smithi098.stdout:0/562: creat dd/fb4 x:0 0 0 2024-09-13T02:52:58.428 INFO:tasks.workunit.client.0.smithi098.stdout:2/532: symlink d1/d1a/d4f/d7f/lb1 0 2024-09-13T02:52:58.444 INFO:tasks.workunit.client.0.smithi098.stdout:4/540: dwrite d6/d22/d3d/d41/d74/d98/fa8 [0,4194304] 0 2024-09-13T02:52:58.445 INFO:tasks.workunit.client.0.smithi098.stdout:3/554: creat d7/d9/d15/d2d/d78/fac x:0 0 0 2024-09-13T02:52:58.447 INFO:tasks.workunit.client.0.smithi098.stdout:7/701: creat d6/d24/d2a/d5a/d42/d45/d73/fe9 x:0 0 0 2024-09-13T02:52:58.447 INFO:tasks.workunit.client.0.smithi098.stdout:5/513: dwrite d0/d38/d3f/d81/f95 [0,4194304] 0 2024-09-13T02:52:58.449 INFO:tasks.workunit.client.0.smithi098.stdout:9/543: write d2/d6/d36/d8d/f30 [1327354,125091] 0 2024-09-13T02:52:58.449 INFO:tasks.workunit.client.0.smithi098.stdout:4/541: write d6/d37/d7a/fa1 [2085636,119613] 0 2024-09-13T02:52:58.449 INFO:tasks.workunit.client.0.smithi098.stdout:1/618: rename d9/d33/d19/d35/d68/d60 to d9/d33/de6 0 2024-09-13T02:52:58.454 INFO:tasks.workunit.client.0.smithi098.stdout:4/542: chown d6/d3e/d73 0 1 2024-09-13T02:52:58.455 INFO:tasks.workunit.client.0.smithi098.stdout:1/619: stat d9/d33/d19/d35/d68 0 2024-09-13T02:52:58.459 INFO:tasks.workunit.client.0.smithi098.stdout:1/620: dread - d9/d33/d29/d58/fc7 zero size 2024-09-13T02:52:58.460 INFO:tasks.workunit.client.0.smithi098.stdout:2/533: dwrite d1/d1f/d30/f34 [0,4194304] 0 2024-09-13T02:52:58.464 INFO:tasks.workunit.client.0.smithi098.stdout:8/522: dwrite d2/d2f/d78/d5d/f79 [0,4194304] 0 2024-09-13T02:52:58.465 INFO:tasks.workunit.client.0.smithi098.stdout:8/523: write d2/d2f/d78/f50 [319900,80872] 0 2024-09-13T02:52:58.466 INFO:tasks.workunit.client.0.smithi098.stdout:2/534: write d1/f8 [6050785,81599] 0 2024-09-13T02:52:58.470 INFO:tasks.workunit.client.0.smithi098.stdout:3/555: dread d7/d9/d25/d3a/d51/f66 [0,4194304] 0 2024-09-13T02:52:58.472 INFO:tasks.workunit.client.0.smithi098.stdout:3/556: stat d7/d9/d4c/f81 0 2024-09-13T02:52:58.474 INFO:tasks.workunit.client.0.smithi098.stdout:0/563: dread dd/df/d1d/f34 [0,4194304] 0 2024-09-13T02:52:58.475 INFO:tasks.workunit.client.0.smithi098.stdout:0/564: chown dd/d1f/d85/fab 3 1 2024-09-13T02:52:58.604 INFO:tasks.workunit.client.0.smithi098.stdout:9/544: write d2/d6/d2b/d4d/f8c [811750,8136] 0 2024-09-13T02:52:58.610 INFO:tasks.workunit.client.0.smithi098.stdout:4/543: getdents d6/d8d/db9 0 2024-09-13T02:52:58.615 INFO:tasks.workunit.client.0.smithi098.stdout:2/535: dwrite d1/d1a/d4f/d59/fa2 [0,4194304] 0 2024-09-13T02:52:58.615 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:52:58 smithi098 ceph-mon[27886]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 168 MiB/s wr, 369 op/s 2024-09-13T02:52:58.618 INFO:tasks.workunit.client.0.smithi098.stdout:9/545: rename d2/d6/d36/d8d/d39/d43/d90/da2 to d2/d6/d36/d8d/d39/d43/d90/da0/dc6 0 2024-09-13T02:52:58.621 INFO:tasks.workunit.client.0.smithi098.stdout:8/524: write d2/f1b [2117238,36924] 0 2024-09-13T02:52:58.622 INFO:tasks.workunit.client.0.smithi098.stdout:3/557: symlink d7/d9/d15/d2d/lad 0 2024-09-13T02:52:58.623 INFO:tasks.workunit.client.0.smithi098.stdout:2/536: dwrite d1/f48 [0,4194304] 0 2024-09-13T02:52:58.628 INFO:tasks.workunit.client.0.smithi098.stdout:4/544: dread d6/d37/d7a/fa1 [0,4194304] 0 2024-09-13T02:52:58.629 INFO:tasks.workunit.client.0.smithi098.stdout:9/546: mknod d2/d6/d36/d8d/d39/cc7 0 2024-09-13T02:52:58.630 INFO:tasks.workunit.client.0.smithi098.stdout:9/547: chown d2/d6/d36/d8d/d39/f62 13833892 1 2024-09-13T02:52:58.631 INFO:tasks.workunit.client.0.smithi098.stdout:8/525: fdatasync d2/d2f/d78/d5d/f98 0 2024-09-13T02:52:58.635 INFO:tasks.workunit.client.0.smithi098.stdout:2/537: symlink d1/d1f/d35/d63/lb2 0 2024-09-13T02:52:58.642 INFO:tasks.workunit.client.0.smithi098.stdout:4/545: creat d6/d22/d3d/d41/d74/fc4 x:0 0 0 2024-09-13T02:52:58.643 INFO:tasks.workunit.client.0.smithi098.stdout:2/538: dwrite d1/d1f/d36/f52 [0,4194304] 0 2024-09-13T02:52:58.645 INFO:tasks.workunit.client.0.smithi098.stdout:0/565: getdents dd/df/d1d/d26/d37/d53 0 2024-09-13T02:52:58.650 INFO:tasks.workunit.client.0.smithi098.stdout:0/566: dwrite dd/df/faa [0,4194304] 0 2024-09-13T02:52:58.657 INFO:tasks.workunit.client.0.smithi098.stdout:1/621: getdents d9/d33/d87 0 2024-09-13T02:52:58.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/548: mkdir d2/d6/d36/d8d/dc8 0 2024-09-13T02:52:58.669 INFO:tasks.workunit.client.0.smithi098.stdout:2/539: symlink d1/d1f/d27/lb3 0 2024-09-13T02:52:58.674 INFO:tasks.workunit.client.0.smithi098.stdout:1/622: mknod d9/d33/d19/d35/d68/d4d/dbc/d6b/ce7 0 2024-09-13T02:52:58.675 INFO:tasks.workunit.client.0.smithi098.stdout:1/623: chown d9/d33/d19/f21 27647 1 2024-09-13T02:52:58.677 INFO:tasks.workunit.client.0.smithi098.stdout:2/540: truncate d1/d1f/d35/f71 362664 0 2024-09-13T02:52:58.677 INFO:tasks.workunit.client.0.smithi098.stdout:8/526: write d2/d2f/f5b [805537,108884] 0 2024-09-13T02:52:58.679 INFO:tasks.workunit.client.0.smithi098.stdout:0/567: creat dd/df/d1d/da7/fb5 x:0 0 0 2024-09-13T02:52:58.680 INFO:tasks.workunit.client.0.smithi098.stdout:9/549: creat d2/d6/d2b/d4d/d56/db9/fc9 x:0 0 0 2024-09-13T02:52:58.685 INFO:tasks.workunit.client.0.smithi098.stdout:8/527: dwrite d2/dd/d11/f4c [4194304,4194304] 0 2024-09-13T02:52:58.687 INFO:tasks.workunit.client.0.smithi098.stdout:0/568: symlink dd/d1f/d85/lb6 0 2024-09-13T02:52:58.693 INFO:tasks.workunit.client.0.smithi098.stdout:1/624: write d9/f38 [4070731,99319] 0 2024-09-13T02:52:58.693 INFO:tasks.workunit.client.0.smithi098.stdout:8/528: dwrite d2/f4a [0,4194304] 0 2024-09-13T02:52:58.694 INFO:tasks.workunit.client.0.smithi098.stdout:4/546: getdents d6/d22/d3d/d6c 0 2024-09-13T02:52:58.703 INFO:tasks.workunit.client.0.smithi098.stdout:2/541: dwrite d1/d1a/d9/d1e/d5a/f70 [0,4194304] 0 2024-09-13T02:52:58.706 INFO:tasks.workunit.client.0.smithi098.stdout:0/569: rename dd/df/d1d/d26/d28/d32/d8d/cae to dd/df/d1d/d26/d28/d32/d67/d71/cb7 0 2024-09-13T02:52:58.707 INFO:tasks.workunit.client.0.smithi098.stdout:8/529: dwrite d2/dd/d11/f97 [0,4194304] 0 2024-09-13T02:52:58.715 INFO:tasks.workunit.client.0.smithi098.stdout:9/550: creat d2/d6/d36/d8d/fca x:0 0 0 2024-09-13T02:52:58.716 INFO:tasks.workunit.client.0.smithi098.stdout:9/551: dread - d2/d6/d2b/d4d/d56/fbd zero size 2024-09-13T02:52:58.717 INFO:tasks.workunit.client.0.smithi098.stdout:1/625: write d9/d33/fa4 [975427,85315] 0 2024-09-13T02:52:58.718 INFO:tasks.workunit.client.0.smithi098.stdout:2/542: symlink d1/d1a/d4f/d59/d9e/d9f/lb4 0 2024-09-13T02:52:58.721 INFO:tasks.workunit.client.0.smithi098.stdout:4/547: rename d6/d10/cac to d6/d8d/cc5 0 2024-09-13T02:52:58.724 INFO:tasks.workunit.client.0.smithi098.stdout:4/548: write d6/d22/d3d/d41/d74/d98/fc3 [609440,105690] 0 2024-09-13T02:52:58.724 INFO:tasks.workunit.client.0.smithi098.stdout:1/626: dread - d9/f3d zero size 2024-09-13T02:52:58.724 INFO:tasks.workunit.client.0.smithi098.stdout:9/552: chown d2/d6/d36/d8d/d39/d43/f50 4244 1 2024-09-13T02:52:58.726 INFO:tasks.workunit.client.0.smithi098.stdout:2/543: dread d1/d1a/d4f/d7f/f85 [0,4194304] 0 2024-09-13T02:52:58.731 INFO:tasks.workunit.client.0.smithi098.stdout:0/570: dwrite dd/df/d1d/d26/d37/f73 [0,4194304] 0 2024-09-13T02:52:58.731 INFO:tasks.workunit.client.0.smithi098.stdout:8/530: getdents d2/dd/d2e 0 2024-09-13T02:52:58.734 INFO:tasks.workunit.client.0.smithi098.stdout:1/627: symlink d9/d33/de6/le8 0 2024-09-13T02:52:58.736 INFO:tasks.workunit.client.0.smithi098.stdout:1/628: truncate d9/f9b 1957485 0 2024-09-13T02:52:58.737 INFO:tasks.workunit.client.0.smithi098.stdout:2/544: rename d1/d1f/d35/d63/f33 to d1/da7/fb5 0 2024-09-13T02:52:58.737 INFO:tasks.workunit.client.0.smithi098.stdout:4/549: write d6/d54/f88 [3471584,74258] 0 2024-09-13T02:52:58.739 INFO:tasks.workunit.client.0.smithi098.stdout:8/531: mknod d2/d2f/d78/ca4 0 2024-09-13T02:52:58.741 INFO:tasks.workunit.client.0.smithi098.stdout:1/629: unlink d9/d33/fa4 0 2024-09-13T02:52:58.742 INFO:tasks.workunit.client.0.smithi098.stdout:1/630: write d9/f38 [3655549,80492] 0 2024-09-13T02:52:58.742 INFO:tasks.workunit.client.0.smithi098.stdout:9/553: rename d2/d6/d2b/d4d/d56/dbc/dbf to d2/db1/dcb 0 2024-09-13T02:52:58.744 INFO:tasks.workunit.client.0.smithi098.stdout:4/550: chown d6/db/c35 5 1 2024-09-13T02:52:58.744 INFO:tasks.workunit.client.0.smithi098.stdout:9/554: write d2/d6/d2b/d4d/fab [3000555,44948] 0 2024-09-13T02:52:58.746 INFO:tasks.workunit.client.0.smithi098.stdout:0/571: symlink dd/df/d1d/d40/d9b/lb8 0 2024-09-13T02:52:58.747 INFO:tasks.workunit.client.0.smithi098.stdout:8/532: creat d2/dd/fa5 x:0 0 0 2024-09-13T02:52:58.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:52:58 smithi142 ceph-mon[33443]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 168 MiB/s wr, 369 op/s 2024-09-13T02:52:58.753 INFO:tasks.workunit.client.0.smithi098.stdout:1/631: mknod d9/d33/d19/d35/d68/d4d/dbc/d23/da7/ce9 0 2024-09-13T02:52:58.754 INFO:tasks.workunit.client.0.smithi098.stdout:8/533: dwrite d2/d2f/d78/d46/d47/d6e/f8c [0,4194304] 0 2024-09-13T02:52:58.755 INFO:tasks.workunit.client.0.smithi098.stdout:9/555: symlink d2/d6/d2b/d66/lcc 0 2024-09-13T02:52:58.764 INFO:tasks.workunit.client.0.smithi098.stdout:9/556: creat d2/d6/d36/d8d/d39/d43/d90/da0/fcd x:0 0 0 2024-09-13T02:52:58.765 INFO:tasks.workunit.client.0.smithi098.stdout:0/572: mkdir dd/db9 0 2024-09-13T02:52:58.766 INFO:tasks.workunit.client.0.smithi098.stdout:2/545: getdents d1/d1a/d4f/d59/d9e 0 2024-09-13T02:52:58.769 INFO:tasks.workunit.client.0.smithi098.stdout:1/632: symlink d9/d33/d19/d35/d68/d4d/db5/de2/lea 0 2024-09-13T02:52:58.769 INFO:tasks.workunit.client.0.smithi098.stdout:8/534: symlink d2/d28/la6 0 2024-09-13T02:52:58.772 INFO:tasks.workunit.client.0.smithi098.stdout:0/573: mknod dd/d1f/cba 0 2024-09-13T02:52:58.775 INFO:tasks.workunit.client.0.smithi098.stdout:9/557: rename d2/d6/d36/d8d/d39/d43/d90/da0/dc6/db6 to d2/d6/d2b/d4d/d4f/d6c/dce 0 2024-09-13T02:52:58.776 INFO:tasks.workunit.client.0.smithi098.stdout:2/546: creat d1/d1a/d4f/fb6 x:0 0 0 2024-09-13T02:52:58.777 INFO:tasks.workunit.client.0.smithi098.stdout:1/633: rmdir d9/d33/de6 39 2024-09-13T02:52:58.778 INFO:tasks.workunit.client.0.smithi098.stdout:4/551: getdents d6/d22/d3d/d6c/d91 0 2024-09-13T02:52:58.778 INFO:tasks.workunit.client.0.smithi098.stdout:4/552: stat d6/d37/l4b 0 2024-09-13T02:52:58.779 INFO:tasks.workunit.client.0.smithi098.stdout:4/553: fsync d6/d10/f80 0 2024-09-13T02:52:58.781 INFO:tasks.workunit.client.0.smithi098.stdout:9/558: mkdir d2/d6/d2b/d4d/dcf 0 2024-09-13T02:52:58.781 INFO:tasks.workunit.client.0.smithi098.stdout:9/559: readlink d2/d6/d2b/d66/lcc 0 2024-09-13T02:52:58.782 INFO:tasks.workunit.client.0.smithi098.stdout:8/535: mknod d2/d28/ca7 0 2024-09-13T02:52:58.785 INFO:tasks.workunit.client.0.smithi098.stdout:4/554: unlink d6/d54/fbc 0 2024-09-13T02:52:58.786 INFO:tasks.workunit.client.0.smithi098.stdout:4/555: fdatasync d6/d3e/d68/f38 0 2024-09-13T02:52:58.788 INFO:tasks.workunit.client.0.smithi098.stdout:4/556: write d6/d3e/d73/f8f [421798,78586] 0 2024-09-13T02:52:58.788 INFO:tasks.workunit.client.0.smithi098.stdout:8/536: mkdir d2/d2f/d78/d46/d74/d86/da8 0 2024-09-13T02:52:58.790 INFO:tasks.workunit.client.0.smithi098.stdout:0/574: link dd/d1f/c38 dd/df/d1d/d26/d28/d32/d67/cbb 0 2024-09-13T02:52:58.793 INFO:tasks.workunit.client.0.smithi098.stdout:8/537: dread d2/dd/d11/d44/f72 [0,4194304] 0 2024-09-13T02:52:58.794 INFO:tasks.workunit.client.0.smithi098.stdout:8/538: chown d2/d2f/d78/d5d/f95 11 1 2024-09-13T02:52:58.796 INFO:tasks.workunit.client.0.smithi098.stdout:1/634: write d9/d33/de6/d61/db1/fd4 [868269,9240] 0 2024-09-13T02:52:58.800 INFO:tasks.workunit.client.0.smithi098.stdout:4/557: truncate d6/d22/d3d/d4d/fa0 3734479 0 2024-09-13T02:52:58.801 INFO:tasks.workunit.client.0.smithi098.stdout:4/558: write d6/d54/f88 [3332145,14815] 0 2024-09-13T02:52:58.802 INFO:tasks.workunit.client.0.smithi098.stdout:4/559: chown d6/d54/d6a 0 1 2024-09-13T02:52:58.804 INFO:tasks.workunit.client.0.smithi098.stdout:0/575: dread dd/f2d [0,4194304] 0 2024-09-13T02:52:58.806 INFO:tasks.workunit.client.0.smithi098.stdout:8/539: creat d2/dd/d11/d2c/d9b/fa9 x:0 0 0 2024-09-13T02:52:58.806 INFO:tasks.workunit.client.0.smithi098.stdout:1/635: mknod d9/d33/d19/d35/ceb 0 2024-09-13T02:52:58.810 INFO:tasks.workunit.client.0.smithi098.stdout:8/540: fdatasync d2/d2f/d78/d5d/f95 0 2024-09-13T02:52:58.810 INFO:tasks.workunit.client.0.smithi098.stdout:4/560: dwrite d6/d3e/f59 [4194304,4194304] 0 2024-09-13T02:52:58.812 INFO:tasks.workunit.client.0.smithi098.stdout:8/541: chown d2/dd/d4d/d96/f7e 15501445 1 2024-09-13T02:52:58.813 INFO:tasks.workunit.client.0.smithi098.stdout:1/636: dread d9/d33/de6/d61/db1/fd4 [0,4194304] 0 2024-09-13T02:52:58.813 INFO:tasks.workunit.client.0.smithi098.stdout:1/637: stat d9/d33/f6f 0 2024-09-13T02:52:58.820 INFO:tasks.workunit.client.0.smithi098.stdout:4/561: read d6/f1c [3744310,9581] 0 2024-09-13T02:52:58.821 INFO:tasks.workunit.client.0.smithi098.stdout:8/542: rmdir d2/dd/d2e 39 2024-09-13T02:52:58.824 INFO:tasks.workunit.client.0.smithi098.stdout:0/576: write dd/df/f18 [3590044,23819] 0 2024-09-13T02:52:58.827 INFO:tasks.workunit.client.0.smithi098.stdout:4/562: write d6/db/fb8 [1342692,130542] 0 2024-09-13T02:52:58.838 INFO:tasks.workunit.client.0.smithi098.stdout:1/638: creat d9/d33/d19/d35/d68/d2f/fec x:0 0 0 2024-09-13T02:52:58.840 INFO:tasks.workunit.client.0.smithi098.stdout:8/543: link d2/dd/d11/d2c/c83 d2/d2f/d78/d46/d47/d6e/d68/caa 0 2024-09-13T02:52:58.841 INFO:tasks.workunit.client.0.smithi098.stdout:0/577: dread dd/df/d1d/d40/d46/d6b/f9f [0,4194304] 0 2024-09-13T02:52:58.843 INFO:tasks.workunit.client.0.smithi098.stdout:8/544: write d2/dd/d11/d1d/f45 [714048,37723] 0 2024-09-13T02:52:58.843 INFO:tasks.workunit.client.0.smithi098.stdout:4/563: write d6/f1c [1552753,53236] 0 2024-09-13T02:52:58.846 INFO:tasks.workunit.client.0.smithi098.stdout:1/639: dwrite d9/d33/d29/fa8 [0,4194304] 0 2024-09-13T02:52:58.853 INFO:tasks.workunit.client.0.smithi098.stdout:4/564: getdents d6/d22/d3d/d64/d6f 0 2024-09-13T02:52:58.856 INFO:tasks.workunit.client.0.smithi098.stdout:0/578: dwrite dd/df/d1d/d26/d28/d32/d8d/fa5 [12582912,4194304] 0 2024-09-13T02:52:58.858 INFO:tasks.workunit.client.0.smithi098.stdout:8/545: getdents d2/dd/d11/d2c/d9b 0 2024-09-13T02:52:58.858 INFO:tasks.workunit.client.0.smithi098.stdout:8/546: readlink d2/d2f/l75 0 2024-09-13T02:52:58.859 INFO:tasks.workunit.client.0.smithi098.stdout:4/565: symlink d6/d22/d3d/d41/d74/lc6 0 2024-09-13T02:52:58.860 INFO:tasks.workunit.client.0.smithi098.stdout:1/640: getdents d9/d33/d19/d35 0 2024-09-13T02:52:58.863 INFO:tasks.workunit.client.0.smithi098.stdout:0/579: write dd/df/d1d/d40/d46/d6b/f9f [365717,50662] 0 2024-09-13T02:52:58.863 INFO:tasks.workunit.client.0.smithi098.stdout:8/547: stat d2/dd/f35 0 2024-09-13T02:52:58.868 INFO:tasks.workunit.client.0.smithi098.stdout:8/548: symlink d2/dd/d11/d1d/lab 0 2024-09-13T02:52:58.869 INFO:tasks.workunit.client.0.smithi098.stdout:4/566: dwrite d6/d10/f80 [0,4194304] 0 2024-09-13T02:52:58.871 INFO:tasks.workunit.client.0.smithi098.stdout:0/580: symlink dd/df/lbc 0 2024-09-13T02:52:58.872 INFO:tasks.workunit.client.0.smithi098.stdout:0/581: write dd/df/d1d/da7/fb5 [146465,35156] 0 2024-09-13T02:52:58.874 INFO:tasks.workunit.client.0.smithi098.stdout:4/567: mkdir d6/d3e/d46/dc7 0 2024-09-13T02:52:58.874 INFO:tasks.workunit.client.0.smithi098.stdout:4/568: chown d6/d3e/d46/lb6 181831095 1 2024-09-13T02:52:58.876 INFO:tasks.workunit.client.0.smithi098.stdout:8/549: symlink d2/dd/lac 0 2024-09-13T02:52:58.877 INFO:tasks.workunit.client.0.smithi098.stdout:0/582: mkdir dd/df/d1d/d26/d28/d32/d67/d71/dbd 0 2024-09-13T02:52:58.878 INFO:tasks.workunit.client.0.smithi098.stdout:0/583: readlink dd/df/d1d/d26/l96 0 2024-09-13T02:52:58.881 INFO:tasks.workunit.client.0.smithi098.stdout:8/550: creat d2/dd/d11/d2c/d9b/fad x:0 0 0 2024-09-13T02:52:58.882 INFO:tasks.workunit.client.0.smithi098.stdout:1/641: dwrite d9/d33/f6f [0,4194304] 0 2024-09-13T02:52:58.884 INFO:tasks.workunit.client.0.smithi098.stdout:0/584: creat dd/df/d1d/d26/d28/d32/da1/fbe x:0 0 0 2024-09-13T02:52:58.886 INFO:tasks.workunit.client.0.smithi098.stdout:4/569: getdents d6/d22/d3d/d6c/d91 0 2024-09-13T02:52:58.887 INFO:tasks.workunit.client.0.smithi098.stdout:4/570: read - d6/d22/d3d/d64/fa6 zero size 2024-09-13T02:52:58.888 INFO:tasks.workunit.client.0.smithi098.stdout:1/642: mknod d9/d33/d19/d35/d68/d4d/db5/db8/ced 0 2024-09-13T02:52:58.889 INFO:tasks.workunit.client.0.smithi098.stdout:1/643: read - d9/f3d zero size 2024-09-13T02:52:58.899 INFO:tasks.workunit.client.0.smithi098.stdout:0/585: dread dd/df/d1d/d26/d28/f72 [0,4194304] 0 2024-09-13T02:52:58.901 INFO:tasks.workunit.client.0.smithi098.stdout:0/586: readlink dd/df/d1d/d40/d46/l84 0 2024-09-13T02:52:58.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/571: mkdir d6/d22/d3d/dc8 0 2024-09-13T02:52:58.903 INFO:tasks.workunit.client.0.smithi098.stdout:8/551: write d2/dd/d4d/d96/f85 [1122467,48396] 0 2024-09-13T02:52:58.904 INFO:tasks.workunit.client.0.smithi098.stdout:4/572: creat d6/d54/fc9 x:0 0 0 2024-09-13T02:52:58.909 INFO:tasks.workunit.client.0.smithi098.stdout:0/587: rename dd/df/d1d/l62 to dd/df/d1d/d26/d28/d32/d67/d81/lbf 0 2024-09-13T02:52:58.910 INFO:tasks.workunit.client.0.smithi098.stdout:8/552: mkdir d2/d2f/d78/dae 0 2024-09-13T02:52:58.914 INFO:tasks.workunit.client.0.smithi098.stdout:4/573: truncate d6/d10/d21/f32 107851 0 2024-09-13T02:52:58.918 INFO:tasks.workunit.client.0.smithi098.stdout:8/553: dwrite d2/f60 [0,4194304] 0 2024-09-13T02:52:58.919 INFO:tasks.workunit.client.0.smithi098.stdout:1/644: getdents d9/d33/d19/d35 0 2024-09-13T02:52:58.922 INFO:tasks.workunit.client.0.smithi098.stdout:4/574: read d6/f61 [209333,98795] 0 2024-09-13T02:52:58.927 INFO:tasks.workunit.client.0.smithi098.stdout:1/645: unlink d9/cc 0 2024-09-13T02:52:58.930 INFO:tasks.workunit.client.0.smithi098.stdout:0/588: dwrite dd/df/d1d/d26/d28/d32/f4d [0,4194304] 0 2024-09-13T02:52:58.931 INFO:tasks.workunit.client.0.smithi098.stdout:4/575: symlink d6/d3e/d46/lca 0 2024-09-13T02:52:58.933 INFO:tasks.workunit.client.0.smithi098.stdout:1/646: fdatasync d9/d33/de6/f6d 0 2024-09-13T02:52:58.938 INFO:tasks.workunit.client.0.smithi098.stdout:0/589: mknod dd/d1f/d85/cc0 0 2024-09-13T02:52:58.945 INFO:tasks.workunit.client.0.smithi098.stdout:1/647: mknod d9/d33/d19/d35/d68/d4d/dbc/d23/da7/d51/cee 0 2024-09-13T02:52:58.946 INFO:tasks.workunit.client.0.smithi098.stdout:0/590: dwrite dd/d1f/d85/fab [0,4194304] 0 2024-09-13T02:52:58.949 INFO:tasks.workunit.client.0.smithi098.stdout:8/554: dread d2/f41 [0,4194304] 0 2024-09-13T02:52:58.957 INFO:tasks.workunit.client.0.smithi098.stdout:0/591: rename l9 to dd/df/d1d/d26/d28/d32/d67/d82/lc1 0 2024-09-13T02:52:58.959 INFO:tasks.workunit.client.0.smithi098.stdout:8/555: dread d2/d2f/f31 [0,4194304] 0 2024-09-13T02:52:58.965 INFO:tasks.workunit.client.0.smithi098.stdout:8/556: symlink d2/dd/d11/d44/laf 0 2024-09-13T02:52:58.972 INFO:tasks.workunit.client.0.smithi098.stdout:1/648: rename d9/f9b to d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fef 0 2024-09-13T02:52:58.974 INFO:tasks.workunit.client.0.smithi098.stdout:0/592: truncate dd/df/d1d/d40/d46/f5b 2698629 0 2024-09-13T02:52:58.975 INFO:tasks.workunit.client.0.smithi098.stdout:8/557: dwrite d2/dd/d2e/f3d [4194304,4194304] 0 2024-09-13T02:52:58.976 INFO:tasks.workunit.client.0.smithi098.stdout:1/649: creat d9/d33/d87/ff0 x:0 0 0 2024-09-13T02:52:58.977 INFO:tasks.workunit.client.0.smithi098.stdout:8/558: write d2/d2f/d78/d5d/f79 [1322740,122562] 0 2024-09-13T02:52:58.988 INFO:tasks.workunit.client.0.smithi098.stdout:8/559: symlink d2/d2f/d78/d46/d74/d86/da8/lb0 0 2024-09-13T02:52:58.989 INFO:tasks.workunit.client.0.smithi098.stdout:1/650: dwrite d9/d33/d19/d35/d68/d4d/db5/db8/fc8 [0,4194304] 0 2024-09-13T02:52:58.991 INFO:tasks.workunit.client.0.smithi098.stdout:8/560: symlink d2/dd/d11/d1d/lb1 0 2024-09-13T02:52:58.992 INFO:tasks.workunit.client.0.smithi098.stdout:1/651: symlink d9/d33/d19/d35/d68/d4d/lf1 0 2024-09-13T02:52:58.993 INFO:tasks.workunit.client.0.smithi098.stdout:1/652: stat d9/d33/d19/d35/d68/d4d/db5/de2 0 2024-09-13T02:52:58.994 INFO:tasks.workunit.client.0.smithi098.stdout:8/561: creat d2/d2f/d78/d5d/fb2 x:0 0 0 2024-09-13T02:52:58.995 INFO:tasks.workunit.client.0.smithi098.stdout:8/562: write d2/f1b [2528570,3098] 0 2024-09-13T02:52:58.995 INFO:tasks.workunit.client.0.smithi098.stdout:1/653: mknod d9/d33/d19/d35/d63/cf2 0 2024-09-13T02:52:58.997 INFO:tasks.workunit.client.0.smithi098.stdout:8/563: symlink d2/d2f/d78/d46/d47/lb3 0 2024-09-13T02:52:58.998 INFO:tasks.workunit.client.0.smithi098.stdout:1/654: fdatasync d9/d33/d19/f50 0 2024-09-13T02:52:58.998 INFO:tasks.workunit.client.0.smithi098.stdout:8/564: write d2/d2f/d78/d46/d74/f94 [1025465,115589] 0 2024-09-13T02:52:59.000 INFO:tasks.workunit.client.0.smithi098.stdout:1/655: dread - d9/d33/d19/d35/d68/d2f/fec zero size 2024-09-13T02:52:59.006 INFO:tasks.workunit.client.0.smithi098.stdout:8/565: dread d2/d2f/f5b [0,4194304] 0 2024-09-13T02:52:59.020 INFO:tasks.workunit.client.0.smithi098.stdout:8/566: truncate d2/dd/d11/d2c/f76 237311 0 2024-09-13T02:52:59.100 INFO:tasks.workunit.client.0.smithi098.stdout:7/702: sync 2024-09-13T02:52:59.100 INFO:tasks.workunit.client.0.smithi098.stdout:6/500: sync 2024-09-13T02:52:59.101 INFO:tasks.workunit.client.0.smithi098.stdout:6/501: write d5/f1b [4874848,7309] 0 2024-09-13T02:52:59.102 INFO:tasks.workunit.client.0.smithi098.stdout:7/703: write d6/d24/d2a/d5a/f22 [3532960,12011] 0 2024-09-13T02:52:59.213 INFO:tasks.workunit.client.0.smithi098.stdout:8/567: creat d2/d2f/d78/d46/d47/fb4 x:0 0 0 2024-09-13T02:52:59.218 INFO:tasks.workunit.client.0.smithi098.stdout:6/502: mkdir d5/d13/d2b/d3a/d41/d55/dad 0 2024-09-13T02:52:59.253 INFO:tasks.workunit.client.0.smithi098.stdout:8/568: symlink d2/d28/d43/d88/d99/lb5 0 2024-09-13T02:52:59.254 INFO:tasks.workunit.client.0.smithi098.stdout:8/569: fdatasync d2/d2f/d78/f4b 0 2024-09-13T02:52:59.256 INFO:tasks.workunit.client.0.smithi098.stdout:7/704: rename d6/d24/d2a/d57/d88/le4 to d6/d24/d2a/lea 0 2024-09-13T02:52:59.259 INFO:tasks.workunit.client.0.smithi098.stdout:7/705: readlink d6/d24/d2a/d5a/d42/dde/le8 0 2024-09-13T02:52:59.263 INFO:tasks.workunit.client.0.smithi098.stdout:7/706: symlink d6/d24/d2a/d5a/d42/dde/leb 0 2024-09-13T02:52:59.265 INFO:tasks.workunit.client.0.smithi098.stdout:7/707: fdatasync d6/d1e/f3c 0 2024-09-13T02:52:59.267 INFO:tasks.workunit.client.0.smithi098.stdout:7/708: fdatasync d6/d1e/faf 0 2024-09-13T02:52:59.268 INFO:tasks.workunit.client.0.smithi098.stdout:6/503: dread d5/d18/f3c [0,4194304] 0 2024-09-13T02:52:59.270 INFO:tasks.workunit.client.0.smithi098.stdout:7/709: creat d6/d24/d46/fec x:0 0 0 2024-09-13T02:52:59.273 INFO:tasks.workunit.client.0.smithi098.stdout:8/570: dread d2/dd/d11/d1d/f3e [0,4194304] 0 2024-09-13T02:52:59.277 INFO:tasks.workunit.client.0.smithi098.stdout:7/710: mkdir d6/d24/dc5/de3/dcf/ded 0 2024-09-13T02:52:59.278 INFO:tasks.workunit.client.0.smithi098.stdout:6/504: dwrite d5/f15 [4194304,4194304] 0 2024-09-13T02:52:59.281 INFO:tasks.workunit.client.0.smithi098.stdout:8/571: creat d2/d2f/d78/d46/da2/fb6 x:0 0 0 2024-09-13T02:52:59.289 INFO:tasks.workunit.client.0.smithi098.stdout:6/505: creat d5/d6f/fae x:0 0 0 2024-09-13T02:52:59.294 INFO:tasks.workunit.client.0.smithi098.stdout:7/711: getdents d6/d24/d2a/d5a 0 2024-09-13T02:52:59.295 INFO:tasks.workunit.client.0.smithi098.stdout:6/506: mknod d5/d18/d50/caf 0 2024-09-13T02:52:59.296 INFO:tasks.workunit.client.0.smithi098.stdout:6/507: read d5/d13/f28 [1591975,46941] 0 2024-09-13T02:52:59.297 INFO:tasks.workunit.client.0.smithi098.stdout:8/572: link d2/d2f/d78/f4b d2/fb7 0 2024-09-13T02:52:59.300 INFO:tasks.workunit.client.0.smithi098.stdout:6/508: rmdir d5/d13 39 2024-09-13T02:52:59.309 INFO:tasks.workunit.client.0.smithi098.stdout:8/573: getdents d2/d2f/d78/d46/d74/d86 0 2024-09-13T02:52:59.318 INFO:tasks.workunit.client.0.smithi098.stdout:6/509: getdents d5/d13/d2b/d3a/d14/d94 0 2024-09-13T02:52:59.322 INFO:tasks.workunit.client.0.smithi098.stdout:6/510: readlink d5/d13/d2b/d3a/d14/d6b/l7a 0 2024-09-13T02:52:59.322 INFO:tasks.workunit.client.0.smithi098.stdout:6/511: stat d5/d13/d51/f60 0 2024-09-13T02:52:59.326 INFO:tasks.workunit.client.0.smithi098.stdout:8/574: dread d2/dd/d4d/d96/f58 [0,4194304] 0 2024-09-13T02:52:59.328 INFO:tasks.workunit.client.0.smithi098.stdout:6/512: chown d5/d13/d2b/d3a/d41/d6c/d7c/l9d 0 1 2024-09-13T02:52:59.343 INFO:tasks.workunit.client.0.smithi098.stdout:8/575: link d2/d2f/d78/d46/d47/d6e/d68/caa d2/dd/d4d/cb8 0 2024-09-13T02:52:59.343 INFO:tasks.workunit.client.0.smithi098.stdout:8/576: chown d2/dd/d11/d2c 194 1 2024-09-13T02:52:59.343 INFO:tasks.workunit.client.0.smithi098.stdout:8/577: chown d2/dd/d4d 143867934 1 2024-09-13T02:52:59.345 INFO:tasks.workunit.client.0.smithi098.stdout:8/578: write d2/d2f/d78/d5d/fb2 [427527,119757] 0 2024-09-13T02:52:59.371 INFO:tasks.workunit.client.0.smithi098.stdout:5/514: sync 2024-09-13T02:52:59.375 INFO:tasks.workunit.client.0.smithi098.stdout:5/515: symlink d0/d38/d3f/d81/d4d/lb0 0 2024-09-13T02:52:59.376 INFO:tasks.workunit.client.0.smithi098.stdout:5/516: write d0/d15/d17/d1c/f9c [1740605,127547] 0 2024-09-13T02:52:59.377 INFO:tasks.workunit.client.0.smithi098.stdout:5/517: chown d0/d15/d17/d1c/caf 1 1 2024-09-13T02:52:59.384 INFO:tasks.workunit.client.0.smithi098.stdout:5/518: read d0/d38/d3f/f11 [1454998,63355] 0 2024-09-13T02:52:59.386 INFO:tasks.workunit.client.0.smithi098.stdout:5/519: mkdir d0/d15/da4/db1 0 2024-09-13T02:52:59.389 INFO:tasks.workunit.client.0.smithi098.stdout:5/520: chown d0/d38/d3f/c4 2720581 1 2024-09-13T02:52:59.392 INFO:tasks.workunit.client.0.smithi098.stdout:5/521: readlink d0/d38/l83 0 2024-09-13T02:52:59.395 INFO:tasks.workunit.client.0.smithi098.stdout:5/522: creat d0/d38/d3f/d81/d4d/d82/d9a/fb2 x:0 0 0 2024-09-13T02:52:59.399 INFO:tasks.workunit.client.0.smithi098.stdout:5/523: write d0/d15/d17/f2e [1986212,81318] 0 2024-09-13T02:52:59.401 INFO:tasks.workunit.client.0.smithi098.stdout:5/524: write d0/d38/d3f/d1a/f97 [88389,22327] 0 2024-09-13T02:52:59.408 INFO:tasks.workunit.client.0.smithi098.stdout:5/525: rename d0/d15/l7b to d0/d38/d3f/d81/d4d/d82/d9a/lb3 0 2024-09-13T02:52:59.408 INFO:tasks.workunit.client.0.smithi098.stdout:5/526: chown d0/d15/d17/l31 14400 1 2024-09-13T02:52:59.413 INFO:tasks.workunit.client.0.smithi098.stdout:1/656: sync 2024-09-13T02:52:59.413 INFO:tasks.workunit.client.0.smithi098.stdout:4/576: sync 2024-09-13T02:52:59.413 INFO:tasks.workunit.client.0.smithi098.stdout:9/560: sync 2024-09-13T02:52:59.413 INFO:tasks.workunit.client.0.smithi098.stdout:2/547: sync 2024-09-13T02:52:59.413 INFO:tasks.workunit.client.0.smithi098.stdout:3/558: sync 2024-09-13T02:52:59.413 INFO:tasks.workunit.client.0.smithi098.stdout:0/593: sync 2024-09-13T02:52:59.413 INFO:tasks.workunit.client.0.smithi098.stdout:5/527: link d0/d38/d3f/f9 d0/d15/fb4 0 2024-09-13T02:52:59.415 INFO:tasks.workunit.client.0.smithi098.stdout:2/548: read - d1/d1a/d4f/fb6 zero size 2024-09-13T02:52:59.415 INFO:tasks.workunit.client.0.smithi098.stdout:1/657: chown d9/d33/d19/d35/d68/d2f/c44 19 1 2024-09-13T02:52:59.416 INFO:tasks.workunit.client.0.smithi098.stdout:1/658: stat d9/lb 0 2024-09-13T02:52:59.416 INFO:tasks.workunit.client.0.smithi098.stdout:4/577: symlink d6/d8d/lcb 0 2024-09-13T02:52:59.416 INFO:tasks.workunit.client.0.smithi098.stdout:2/549: dread - d1/d1f/d35/f74 zero size 2024-09-13T02:52:59.420 INFO:tasks.workunit.client.0.smithi098.stdout:9/561: rename d2/d6/d2b/f9c to d2/db1/dcb/fd0 0 2024-09-13T02:52:59.423 INFO:tasks.workunit.client.0.smithi098.stdout:2/550: stat d1/d1f/d39/f21 0 2024-09-13T02:52:59.427 INFO:tasks.workunit.client.0.smithi098.stdout:3/559: dwrite d7/d9/d15/d26/f84 [0,4194304] 0 2024-09-13T02:52:59.428 INFO:tasks.workunit.client.0.smithi098.stdout:4/578: dwrite d6/d22/d3d/d64/fb4 [0,4194304] 0 2024-09-13T02:52:59.431 INFO:tasks.workunit.client.0.smithi098.stdout:9/562: mknod d2/d6/d2b/d66/cd1 0 2024-09-13T02:52:59.437 INFO:tasks.workunit.client.0.smithi098.stdout:4/579: creat d6/d37/d83/fcc x:0 0 0 2024-09-13T02:52:59.439 INFO:tasks.workunit.client.0.smithi098.stdout:2/551: dwrite d1/d1a/d9/d1e/f47 [0,4194304] 0 2024-09-13T02:52:59.441 INFO:tasks.workunit.client.0.smithi098.stdout:4/580: chown d6/d22/d3d/d41/d74/d98/cbd 42584608 1 2024-09-13T02:52:59.442 INFO:tasks.workunit.client.0.smithi098.stdout:0/594: dread dd/d1f/f25 [4194304,4194304] 0 2024-09-13T02:52:59.443 INFO:tasks.workunit.client.0.smithi098.stdout:8/579: getdents d2/d28/d43/d88/d99 0 2024-09-13T02:52:59.445 INFO:tasks.workunit.client.0.smithi098.stdout:3/560: link d7/d9/d25/d3a/f44 d7/d9/d15/d5d/da1/fae 0 2024-09-13T02:52:59.450 INFO:tasks.workunit.client.0.smithi098.stdout:8/580: fsync d2/f9 0 2024-09-13T02:52:59.451 INFO:tasks.workunit.client.0.smithi098.stdout:0/595: dread - dd/f75 zero size 2024-09-13T02:52:59.457 INFO:tasks.workunit.client.0.smithi098.stdout:3/561: dread d7/d9/d15/d2d/f6b [0,4194304] 0 2024-09-13T02:52:59.458 INFO:tasks.workunit.client.0.smithi098.stdout:2/552: getdents d1/d1a/d9/d1e 0 2024-09-13T02:52:59.460 INFO:tasks.workunit.client.0.smithi098.stdout:0/596: mkdir dd/d1f/d85/d9d/dc2 0 2024-09-13T02:52:59.464 INFO:tasks.workunit.client.0.smithi098.stdout:3/562: mknod d7/d9/d25/d3a/d51/d9c/caf 0 2024-09-13T02:52:59.465 INFO:tasks.workunit.client.0.smithi098.stdout:3/563: chown d7/d9/d25/d3a/d52 0 1 2024-09-13T02:52:59.467 INFO:tasks.workunit.client.0.smithi098.stdout:2/553: dwrite d1/d1f/d35/d63/f65 [4194304,4194304] 0 2024-09-13T02:52:59.469 INFO:tasks.workunit.client.0.smithi098.stdout:2/554: write d1/d1f/d39/f29 [7861878,89771] 0 2024-09-13T02:52:59.470 INFO:tasks.workunit.client.0.smithi098.stdout:7/712: creat d6/d24/fee x:0 0 0 2024-09-13T02:52:59.473 INFO:tasks.workunit.client.0.smithi098.stdout:7/713: readlink d6/d24/d46/l76 0 2024-09-13T02:52:59.475 INFO:tasks.workunit.client.0.smithi098.stdout:0/597: dwrite dd/df/d1d/d26/d28/f72 [0,4194304] 0 2024-09-13T02:52:59.476 INFO:tasks.workunit.client.0.smithi098.stdout:3/564: mknod d7/d9/d15/d2d/d5b/d70/d90/cb0 0 2024-09-13T02:52:59.480 INFO:tasks.workunit.client.0.smithi098.stdout:7/714: chown d6/d24/d2a/d5a/d4c/fac 148 1 2024-09-13T02:52:59.482 INFO:tasks.workunit.client.0.smithi098.stdout:8/581: dread d2/dd/d4d/f67 [0,4194304] 0 2024-09-13T02:52:59.482 INFO:tasks.workunit.client.0.smithi098.stdout:2/555: dread d1/d1a/d4f/d59/fa2 [0,4194304] 0 2024-09-13T02:52:59.486 INFO:tasks.workunit.client.0.smithi098.stdout:2/556: stat d1/d1f/d35/d63/d72/f78 0 2024-09-13T02:52:59.486 INFO:tasks.workunit.client.0.smithi098.stdout:3/565: creat d7/d9/d25/d2b/fb1 x:0 0 0 2024-09-13T02:52:59.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/513: creat d5/d13/d2b/fb0 x:0 0 0 2024-09-13T02:52:59.492 INFO:tasks.workunit.client.0.smithi098.stdout:7/715: dwrite d6/d24/fee [0,4194304] 0 2024-09-13T02:52:59.616 INFO:tasks.workunit.client.0.smithi098.stdout:9/563: rename d2/l2c to d2/d6/d2b/ld2 0 2024-09-13T02:52:59.616 INFO:tasks.workunit.client.0.smithi098.stdout:8/582: dread d2/dd/d4d/d96/f85 [0,4194304] 0 2024-09-13T02:52:59.618 INFO:tasks.workunit.client.0.smithi098.stdout:9/564: write d2/f69 [4847609,107655] 0 2024-09-13T02:52:59.618 INFO:tasks.workunit.client.0.smithi098.stdout:7/716: mkdir d6/d24/d46/def 0 2024-09-13T02:52:59.620 INFO:tasks.workunit.client.0.smithi098.stdout:3/566: dwrite d7/d9/d15/d2d/d78/fac [0,4194304] 0 2024-09-13T02:52:59.621 INFO:tasks.workunit.client.0.smithi098.stdout:6/514: link d5/d13/d2b/d3a/d14/d6b/c91 d5/d13/d2b/d3a/d5a/cb1 0 2024-09-13T02:52:59.622 INFO:tasks.workunit.client.0.smithi098.stdout:9/565: write d2/d6/d2b/d4d/d4f/d6c/fa5 [2712805,106538] 0 2024-09-13T02:52:59.628 INFO:tasks.workunit.client.0.smithi098.stdout:3/567: creat d7/d9/d25/d3a/d51/d9c/fb2 x:0 0 0 2024-09-13T02:52:59.629 INFO:tasks.workunit.client.0.smithi098.stdout:8/583: dwrite d2/dd/d11/f18 [0,4194304] 0 2024-09-13T02:52:59.631 INFO:tasks.workunit.client.0.smithi098.stdout:6/515: symlink d5/d6f/lb2 0 2024-09-13T02:52:59.632 INFO:tasks.workunit.client.0.smithi098.stdout:3/568: read d7/d9/fa [720691,112104] 0 2024-09-13T02:52:59.633 INFO:tasks.workunit.client.0.smithi098.stdout:9/566: mkdir d2/d6/d36/d8d/dd3 0 2024-09-13T02:52:59.638 INFO:tasks.workunit.client.0.smithi098.stdout:7/717: dread d6/d24/d2a/d5a/f1d [0,4194304] 0 2024-09-13T02:52:59.641 INFO:tasks.workunit.client.0.smithi098.stdout:8/584: mknod d2/dd/d11/cb9 0 2024-09-13T02:52:59.643 INFO:tasks.workunit.client.0.smithi098.stdout:7/718: mkdir d6/d24/d2a/d5a/d8e/df0 0 2024-09-13T02:52:59.643 INFO:tasks.workunit.client.0.smithi098.stdout:9/567: truncate d2/d6/d36/d8d/f1f 326170 0 2024-09-13T02:52:59.648 INFO:tasks.workunit.client.0.smithi098.stdout:8/585: dwrite d2/d2f/d78/d46/d74/d86/f8e [0,4194304] 0 2024-09-13T02:52:59.651 INFO:tasks.workunit.client.0.smithi098.stdout:9/568: rename d2/d6/d36/d8d/d39 to d2/d6/d2b/d4d/d4f/d6c/dd4 0 2024-09-13T02:52:59.652 INFO:tasks.workunit.client.0.smithi098.stdout:7/719: rmdir d6/d24/d2a/d5a/d8e/dbd/dd7 0 2024-09-13T02:52:59.655 INFO:tasks.workunit.client.0.smithi098.stdout:7/720: readlink d6/d1e/l7a 0 2024-09-13T02:52:59.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/569: dwrite d2/f69 [0,4194304] 0 2024-09-13T02:52:59.658 INFO:tasks.workunit.client.0.smithi098.stdout:7/721: chown d6/d1e/f36 1340 1 2024-09-13T02:52:59.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/570: chown d2/db1/dc5 2 1 2024-09-13T02:52:59.660 INFO:tasks.workunit.client.0.smithi098.stdout:8/586: dwrite d2/d28/d43/f7f [0,4194304] 0 2024-09-13T02:52:59.667 INFO:tasks.workunit.client.0.smithi098.stdout:9/571: creat d2/d6/d2b/d4d/fd5 x:0 0 0 2024-09-13T02:52:59.669 INFO:tasks.workunit.client.0.smithi098.stdout:9/572: read d2/d6/f8b [2412631,63439] 0 2024-09-13T02:52:59.674 INFO:tasks.workunit.client.0.smithi098.stdout:8/587: dwrite d2/dd/d2e/fa0 [0,4194304] 0 2024-09-13T02:52:59.679 INFO:tasks.workunit.client.0.smithi098.stdout:9/573: dwrite d2/d6/d36/d8d/fca [0,4194304] 0 2024-09-13T02:52:59.681 INFO:tasks.workunit.client.0.smithi098.stdout:8/588: rename f1 to d2/d28/d43/d9f/fba 0 2024-09-13T02:52:59.686 INFO:tasks.workunit.client.0.smithi098.stdout:9/574: write d2/d6/f8b [1396251,39613] 0 2024-09-13T02:52:59.689 INFO:tasks.workunit.client.0.smithi098.stdout:8/589: fsync d2/dd/f25 0 2024-09-13T02:52:59.699 INFO:tasks.workunit.client.0.smithi098.stdout:1/659: write d9/f3d [644552,40533] 0 2024-09-13T02:52:59.700 INFO:tasks.workunit.client.0.smithi098.stdout:8/590: getdents d2/dd/d11/d1d 0 2024-09-13T02:52:59.705 INFO:tasks.workunit.client.0.smithi098.stdout:8/591: creat d2/d2f/d78/d46/d74/d86/fbb x:0 0 0 2024-09-13T02:52:59.705 INFO:tasks.workunit.client.0.smithi098.stdout:5/528: dwrite d0/d38/d3f/d1a/f34 [0,4194304] 0 2024-09-13T02:52:59.712 INFO:tasks.workunit.client.0.smithi098.stdout:5/529: creat d0/d15/da4/fb5 x:0 0 0 2024-09-13T02:52:59.714 INFO:tasks.workunit.client.0.smithi098.stdout:4/581: write d6/d22/d3d/d4d/f57 [952800,84158] 0 2024-09-13T02:52:59.719 INFO:tasks.workunit.client.0.smithi098.stdout:8/592: creat d2/d2f/d78/d46/fbc x:0 0 0 2024-09-13T02:52:59.719 INFO:tasks.workunit.client.0.smithi098.stdout:8/593: readlink d2/dd/l3c 0 2024-09-13T02:52:59.721 INFO:tasks.workunit.client.0.smithi098.stdout:5/530: read d0/d29/f2c [1063238,80799] 0 2024-09-13T02:52:59.722 INFO:tasks.workunit.client.0.smithi098.stdout:5/531: fsync d0/d15/d17/f2e 0 2024-09-13T02:52:59.724 INFO:tasks.workunit.client.0.smithi098.stdout:5/532: write d0/d38/d3f/d81/d4d/d82/f93 [980243,92412] 0 2024-09-13T02:52:59.725 INFO:tasks.workunit.client.0.smithi098.stdout:7/722: unlink f5 0 2024-09-13T02:52:59.730 INFO:tasks.workunit.client.0.smithi098.stdout:5/533: truncate d0/d29/f63 3890893 0 2024-09-13T02:52:59.732 INFO:tasks.workunit.client.0.smithi098.stdout:4/582: getdents d6/d37/d7a 0 2024-09-13T02:52:59.732 INFO:tasks.workunit.client.0.smithi098.stdout:7/723: getdents d6/d24/dc5/de3/de6 0 2024-09-13T02:52:59.734 INFO:tasks.workunit.client.0.smithi098.stdout:8/594: dread d2/d28/d43/d9f/fba [0,4194304] 0 2024-09-13T02:52:59.736 INFO:tasks.workunit.client.0.smithi098.stdout:5/534: creat d0/d38/d3f/fb6 x:0 0 0 2024-09-13T02:52:59.737 INFO:tasks.workunit.client.0.smithi098.stdout:0/598: dwrite dd/df/d1d/d26/d28/f30 [4194304,4194304] 0 2024-09-13T02:52:59.737 INFO:tasks.workunit.client.0.smithi098.stdout:5/535: chown d0/cb 710 1 2024-09-13T02:52:59.739 INFO:tasks.workunit.client.0.smithi098.stdout:5/536: chown d0/d38/d3f/d81/f33 1635324 1 2024-09-13T02:52:59.740 INFO:tasks.workunit.client.0.smithi098.stdout:8/595: unlink d2/d2f/f62 0 2024-09-13T02:52:59.742 INFO:tasks.workunit.client.0.smithi098.stdout:8/596: dread - d2/d2f/d78/d46/fbc zero size 2024-09-13T02:52:59.743 INFO:tasks.workunit.client.0.smithi098.stdout:7/724: rename d6/d24/d2a/d5a/d86/l5e to d6/d24/d2a/d5a/d86/db1/lf1 0 2024-09-13T02:52:59.744 INFO:tasks.workunit.client.0.smithi098.stdout:0/599: dwrite dd/df/d1d/d26/d28/d32/f7e [4194304,4194304] 0 2024-09-13T02:52:59.746 INFO:tasks.workunit.client.0.smithi098.stdout:7/725: write d6/d24/d2a/d5a/d42/fb8 [59953,92549] 0 2024-09-13T02:52:59.747 INFO:tasks.workunit.client.0.smithi098.stdout:0/600: chown dd/df/d1d/d40/d46/laf 744 1 2024-09-13T02:52:59.752 INFO:tasks.workunit.client.0.smithi098.stdout:4/583: link d6/d54/f9b d6/d3e/d46/dc7/fcd 0 2024-09-13T02:52:59.753 INFO:tasks.workunit.client.0.smithi098.stdout:4/584: dread - d6/d22/d3d/d64/fa6 zero size 2024-09-13T02:52:59.753 INFO:tasks.workunit.client.0.smithi098.stdout:6/516: write d5/d13/d2b/f2d [1573602,23337] 0 2024-09-13T02:52:59.754 INFO:tasks.workunit.client.0.smithi098.stdout:3/569: write d7/d9/d15/f82 [983760,99166] 0 2024-09-13T02:52:59.755 INFO:tasks.workunit.client.0.smithi098.stdout:3/570: stat d7/f43 0 2024-09-13T02:52:59.761 INFO:tasks.workunit.client.0.smithi098.stdout:5/537: symlink d0/d15/lb7 0 2024-09-13T02:52:59.765 INFO:tasks.workunit.client.0.smithi098.stdout:6/517: chown d5/f1b 21840 1 2024-09-13T02:52:59.769 INFO:tasks.workunit.client.0.smithi098.stdout:4/585: dread d6/d54/f88 [0,4194304] 0 2024-09-13T02:52:59.771 INFO:tasks.workunit.client.0.smithi098.stdout:9/575: write d2/d6/d2b/d4d/d56/f7e [1562047,100424] 0 2024-09-13T02:52:59.773 INFO:tasks.workunit.client.0.smithi098.stdout:5/538: rename d0/d38/d3f/d81/f8f to d0/d15/d17/daa/fb8 0 2024-09-13T02:52:59.777 INFO:tasks.workunit.client.0.smithi098.stdout:0/601: link dd/df/d1d/d26/d28/d32/d67/d71/f52 dd/df/d1d/d40/d46/fc3 0 2024-09-13T02:52:59.778 INFO:tasks.workunit.client.0.smithi098.stdout:1/660: write d9/d33/d19/f21 [746410,24769] 0 2024-09-13T02:52:59.781 INFO:tasks.workunit.client.0.smithi098.stdout:3/571: creat d7/d9/fb3 x:0 0 0 2024-09-13T02:52:59.782 INFO:tasks.workunit.client.0.smithi098.stdout:3/572: chown d7/d9/d15/f85 287665986 1 2024-09-13T02:52:59.785 INFO:tasks.workunit.client.0.smithi098.stdout:1/661: read - d9/f25 zero size 2024-09-13T02:52:59.789 INFO:tasks.workunit.client.0.smithi098.stdout:5/539: link d0/d38/d3f/d81/f33 d0/d38/d3f/d1a/d27/fb9 0 2024-09-13T02:52:59.798 INFO:tasks.workunit.client.0.smithi098.stdout:0/602: rename dd/df/d1d/d40/d46/d6b/f9f to dd/fc4 0 2024-09-13T02:52:59.799 INFO:tasks.workunit.client.0.smithi098.stdout:4/586: dread d6/db/f29 [0,4194304] 0 2024-09-13T02:52:59.799 INFO:tasks.workunit.client.0.smithi098.stdout:1/662: dwrite d9/d33/d19/d64/fbb [0,4194304] 0 2024-09-13T02:52:59.809 INFO:tasks.workunit.client.0.smithi098.stdout:8/597: dwrite d2/d2f/d78/f4b [0,4194304] 0 2024-09-13T02:52:59.810 INFO:tasks.workunit.client.0.smithi098.stdout:8/598: chown d2/d2f/d78/f4b 16808 1 2024-09-13T02:52:59.811 INFO:tasks.workunit.client.0.smithi098.stdout:4/587: unlink d6/d3e/d46/lb6 0 2024-09-13T02:52:59.812 INFO:tasks.workunit.client.0.smithi098.stdout:8/599: write d2/dd/f5a [3314751,89392] 0 2024-09-13T02:52:59.812 INFO:tasks.workunit.client.0.smithi098.stdout:4/588: chown d6/d22/d3d/d4d/fbb 916816 1 2024-09-13T02:52:59.813 INFO:tasks.workunit.client.0.smithi098.stdout:0/603: mkdir dd/df/d1d/d26/d28/d32/d8d/dc5 0 2024-09-13T02:52:59.817 INFO:tasks.workunit.client.0.smithi098.stdout:8/600: dread d2/dd/d11/d44/f72 [0,4194304] 0 2024-09-13T02:52:59.817 INFO:tasks.workunit.client.0.smithi098.stdout:6/518: truncate d5/d13/d2b/d3a/f86 3937166 0 2024-09-13T02:52:59.819 INFO:tasks.workunit.client.0.smithi098.stdout:8/601: read d2/dd/d4d/d96/f7e [2096002,109600] 0 2024-09-13T02:52:59.820 INFO:tasks.workunit.client.0.smithi098.stdout:9/576: write d2/d6/d36/d8d/f1f [844226,113847] 0 2024-09-13T02:52:59.820 INFO:tasks.workunit.client.0.smithi098.stdout:0/604: creat dd/df/d1d/da7/fc6 x:0 0 0 2024-09-13T02:52:59.824 INFO:tasks.workunit.client.0.smithi098.stdout:5/540: write d0/d15/d17/f1e [1933771,70117] 0 2024-09-13T02:52:59.832 INFO:tasks.workunit.client.0.smithi098.stdout:1/663: dread d9/d33/f22 [0,4194304] 0 2024-09-13T02:52:59.838 INFO:tasks.workunit.client.0.smithi098.stdout:6/519: symlink d5/d13/d2b/d3a/d14/d94/d97/lb3 0 2024-09-13T02:52:59.846 INFO:tasks.workunit.client.0.smithi098.stdout:0/605: truncate dd/f86 87048 0 2024-09-13T02:52:59.853 INFO:tasks.workunit.client.0.smithi098.stdout:1/664: mkdir d9/d33/d19/d35/d68/d4d/db5/df3 0 2024-09-13T02:52:59.856 INFO:tasks.workunit.client.0.smithi098.stdout:9/577: mknod d2/db1/dc5/cd6 0 2024-09-13T02:52:59.857 INFO:tasks.workunit.client.0.smithi098.stdout:9/578: readlink d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/l9b 0 2024-09-13T02:52:59.858 INFO:tasks.workunit.client.0.smithi098.stdout:5/541: fdatasync d0/d15/d17/daa/fb8 0 2024-09-13T02:52:59.860 INFO:tasks.workunit.client.0.smithi098.stdout:4/589: getdents d6/d54/d6a 0 2024-09-13T02:52:59.862 INFO:tasks.workunit.client.0.smithi098.stdout:6/520: mknod d5/d13/d67/d85/cb4 0 2024-09-13T02:52:59.870 INFO:tasks.workunit.client.0.smithi098.stdout:9/579: write d2/d6/d36/f4e [1846854,60403] 0 2024-09-13T02:52:59.872 INFO:tasks.workunit.client.0.smithi098.stdout:4/590: creat d6/d10/fce x:0 0 0 2024-09-13T02:52:59.873 INFO:tasks.workunit.client.0.smithi098.stdout:1/665: symlink d9/d33/d19/d46/lf4 0 2024-09-13T02:52:59.874 INFO:tasks.workunit.client.0.smithi098.stdout:4/591: read d6/d3e/d68/f38 [2923173,36083] 0 2024-09-13T02:52:59.875 INFO:tasks.workunit.client.0.smithi098.stdout:4/592: fdatasync d6/d22/d3d/d41/d74/d98/fa8 0 2024-09-13T02:52:59.876 INFO:tasks.workunit.client.0.smithi098.stdout:9/580: symlink d2/d6/d2b/d4d/d56/db9/ld7 0 2024-09-13T02:52:59.876 INFO:tasks.workunit.client.0.smithi098.stdout:4/593: write d6/d10/d21/f56 [623497,128641] 0 2024-09-13T02:52:59.878 INFO:tasks.workunit.client.0.smithi098.stdout:5/542: truncate d0/d15/d50/f6d 315334 0 2024-09-13T02:52:59.880 INFO:tasks.workunit.client.0.smithi098.stdout:5/543: read d0/d38/d3f/f11 [115831,78331] 0 2024-09-13T02:52:59.882 INFO:tasks.workunit.client.0.smithi098.stdout:0/606: truncate dd/df/d1d/d26/d28/d32/f7e 1397513 0 2024-09-13T02:52:59.882 INFO:tasks.workunit.client.0.smithi098.stdout:1/666: truncate d9/d33/de6/f6d 1555274 0 2024-09-13T02:52:59.887 INFO:tasks.workunit.client.0.smithi098.stdout:9/581: unlink d2/l18 0 2024-09-13T02:52:59.890 INFO:tasks.workunit.client.0.smithi098.stdout:4/594: mknod d6/d10/ccf 0 2024-09-13T02:52:59.896 INFO:tasks.workunit.client.0.smithi098.stdout:6/521: dwrite d5/d13/d2b/d3a/fa2 [0,4194304] 0 2024-09-13T02:52:59.896 INFO:tasks.workunit.client.0.smithi098.stdout:8/602: link d2/d2f/d78/d5d/f95 d2/d28/fbd 0 2024-09-13T02:52:59.898 INFO:tasks.workunit.client.0.smithi098.stdout:8/603: chown d2/d28/d43/d9f/fba 8488340 1 2024-09-13T02:52:59.899 INFO:tasks.workunit.client.0.smithi098.stdout:8/604: read d2/f27 [232950,21283] 0 2024-09-13T02:52:59.905 INFO:tasks.workunit.client.0.smithi098.stdout:4/595: creat d6/d8d/fd0 x:0 0 0 2024-09-13T02:52:59.910 INFO:tasks.workunit.client.0.smithi098.stdout:5/544: creat d0/d15/da4/db1/fba x:0 0 0 2024-09-13T02:52:59.915 INFO:tasks.workunit.client.0.smithi098.stdout:0/607: unlink dd/df/d1d/d26/d28/d32/f7e 0 2024-09-13T02:52:59.916 INFO:tasks.workunit.client.0.smithi098.stdout:1/667: dwrite d9/d33/d29/d58/fb9 [0,4194304] 0 2024-09-13T02:52:59.918 INFO:tasks.workunit.client.0.smithi098.stdout:9/582: dwrite d2/d6/d2b/d4d/d4f/d6c/f8f [0,4194304] 0 2024-09-13T02:52:59.926 INFO:tasks.workunit.client.0.smithi098.stdout:6/522: write d5/d13/d2b/d5b/f89 [297837,2512] 0 2024-09-13T02:52:59.930 INFO:tasks.workunit.client.0.smithi098.stdout:0/608: mkdir dd/df/d1d/d26/d28/d32/d67/d81/dc7 0 2024-09-13T02:52:59.931 INFO:tasks.workunit.client.0.smithi098.stdout:1/668: creat d9/d33/d19/d35/ff5 x:0 0 0 2024-09-13T02:52:59.931 INFO:tasks.workunit.client.0.smithi098.stdout:8/605: truncate d2/dd/d11/d2c/f76 344525 0 2024-09-13T02:52:59.934 INFO:tasks.workunit.client.0.smithi098.stdout:6/523: mknod d5/d13/d2b/d5b/cb5 0 2024-09-13T02:52:59.935 INFO:tasks.workunit.client.0.smithi098.stdout:0/609: creat dd/df/d1d/d26/d28/d32/da1/fc8 x:0 0 0 2024-09-13T02:52:59.937 INFO:tasks.workunit.client.0.smithi098.stdout:1/669: fdatasync d9/d33/d19/d35/d68/d4d/db5/db8/fbe 0 2024-09-13T02:52:59.939 INFO:tasks.workunit.client.0.smithi098.stdout:0/610: read dd/f86 [144,81511] 0 2024-09-13T02:52:59.941 INFO:tasks.workunit.client.0.smithi098.stdout:0/611: read dd/df/f18 [3216668,78665] 0 2024-09-13T02:52:59.945 INFO:tasks.workunit.client.0.smithi098.stdout:9/583: rmdir d2/d6/d36/d8d/dd3 0 2024-09-13T02:52:59.947 INFO:tasks.workunit.client.0.smithi098.stdout:4/596: dwrite d6/db/f29 [0,4194304] 0 2024-09-13T02:52:59.947 INFO:tasks.workunit.client.0.smithi098.stdout:5/545: dwrite d0/d38/d3f/f9 [4194304,4194304] 0 2024-09-13T02:52:59.948 INFO:tasks.workunit.client.0.smithi098.stdout:4/597: readlink d6/d37/l71 0 2024-09-13T02:52:59.950 INFO:tasks.workunit.client.0.smithi098.stdout:1/670: mknod d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/cf6 0 2024-09-13T02:52:59.954 INFO:tasks.workunit.client.0.smithi098.stdout:0/612: chown dd/df/d1d/d40/d46/f5b 801534090 1 2024-09-13T02:52:59.954 INFO:tasks.workunit.client.0.smithi098.stdout:9/584: truncate d2/d6/d2b/f47 62060 0 2024-09-13T02:52:59.959 INFO:tasks.workunit.client.0.smithi098.stdout:6/524: creat d5/d13/d2b/d3a/d14/d6b/d8f/fb6 x:0 0 0 2024-09-13T02:52:59.960 INFO:tasks.workunit.client.0.smithi098.stdout:0/613: mkdir dd/d1f/d85/d9d/dc9 0 2024-09-13T02:52:59.962 INFO:tasks.workunit.client.0.smithi098.stdout:9/585: mknod d2/d6/d2b/d4d/d4f/d6c/cd8 0 2024-09-13T02:52:59.964 INFO:tasks.workunit.client.0.smithi098.stdout:1/671: dread d9/d33/d19/d35/d68/d4d/db5/db8/fc8 [4194304,4194304] 0 2024-09-13T02:52:59.968 INFO:tasks.workunit.client.0.smithi098.stdout:4/598: link d6/d8d/lcb d6/d22/d3d/d4d/ld1 0 2024-09-13T02:52:59.968 INFO:tasks.workunit.client.0.smithi098.stdout:9/586: dread - d2/d6/d2b/d4d/f7b zero size 2024-09-13T02:52:59.970 INFO:tasks.workunit.client.0.smithi098.stdout:1/672: creat d9/d33/d19/d35/d68/d4d/dbc/d6b/ff7 x:0 0 0 2024-09-13T02:52:59.970 INFO:tasks.workunit.client.0.smithi098.stdout:6/525: dwrite d5/d13/d2b/d3a/fa2 [0,4194304] 0 2024-09-13T02:52:59.973 INFO:tasks.workunit.client.0.smithi098.stdout:5/546: dread d0/d15/d50/f8c [8388608,4194304] 0 2024-09-13T02:52:59.975 INFO:tasks.workunit.client.0.smithi098.stdout:9/587: mkdir d2/d6/d2b/d4d/d4f/d6c/dd4/dac/dd9 0 2024-09-13T02:52:59.979 INFO:tasks.workunit.client.0.smithi098.stdout:6/526: mknod d5/d13/d2b/d3a/d5a/cb7 0 2024-09-13T02:52:59.982 INFO:tasks.workunit.client.0.smithi098.stdout:4/599: dwrite d6/d22/d3d/d41/d74/fc4 [0,4194304] 0 2024-09-13T02:52:59.984 INFO:tasks.workunit.client.0.smithi098.stdout:4/600: chown d6/d10 3165 1 2024-09-13T02:52:59.984 INFO:tasks.workunit.client.0.smithi098.stdout:1/673: dwrite d9/d33/d19/d35/d68/d2f/fec [0,4194304] 0 2024-09-13T02:52:59.986 INFO:tasks.workunit.client.0.smithi098.stdout:4/601: write d6/d54/f7b [2483249,31478] 0 2024-09-13T02:52:59.988 INFO:tasks.workunit.client.0.smithi098.stdout:2/557: sync 2024-09-13T02:52:59.993 INFO:tasks.workunit.client.0.smithi098.stdout:6/527: mkdir d5/d13/d2b/d3a/d14/d6b/d9a/da5/db8 0 2024-09-13T02:52:59.997 INFO:tasks.workunit.client.0.smithi098.stdout:1/674: fsync d9/d33/f22 0 2024-09-13T02:53:00.000 INFO:tasks.workunit.client.0.smithi098.stdout:4/602: rename d6/d3e/d46/dc7 to d6/d3e/d46/dd2 0 2024-09-13T02:53:00.001 INFO:tasks.workunit.client.0.smithi098.stdout:0/614: write dd/df/d1d/d40/d46/f47 [3776792,85239] 0 2024-09-13T02:53:00.003 INFO:tasks.workunit.client.0.smithi098.stdout:0/615: write dd/df/d1d/d40/d46/f97 [1616478,92336] 0 2024-09-13T02:53:00.009 INFO:tasks.workunit.client.0.smithi098.stdout:2/558: symlink d1/lb7 0 2024-09-13T02:53:00.010 INFO:tasks.workunit.client.0.smithi098.stdout:6/528: creat d5/d13/d2b/d79/fb9 x:0 0 0 2024-09-13T02:53:00.012 INFO:tasks.workunit.client.0.smithi098.stdout:1/675: dwrite f1 [4194304,4194304] 0 2024-09-13T02:53:00.013 INFO:tasks.workunit.client.0.smithi098.stdout:6/529: write d5/d6f/fae [393056,106140] 0 2024-09-13T02:53:00.015 INFO:tasks.workunit.client.0.smithi098.stdout:0/616: mknod dd/df/d1d/d40/cca 0 2024-09-13T02:53:00.017 INFO:tasks.workunit.client.0.smithi098.stdout:2/559: mkdir d1/da7/db8 0 2024-09-13T02:53:00.018 INFO:tasks.workunit.client.0.smithi098.stdout:1/676: write d9/d33/d19/d35/d68/d4d/dbc/d23/fda [610695,28039] 0 2024-09-13T02:53:00.019 INFO:tasks.workunit.client.0.smithi098.stdout:0/617: write dd/df/d1d/f2f [992639,15798] 0 2024-09-13T02:53:00.021 INFO:tasks.workunit.client.0.smithi098.stdout:2/560: readlink d1/d1a/d4f/d59/d9e/d9f/lb4 0 2024-09-13T02:53:00.022 INFO:tasks.workunit.client.0.smithi098.stdout:1/677: write d9/d33/d19/d35/ff5 [53668,62841] 0 2024-09-13T02:53:00.026 INFO:tasks.workunit.client.0.smithi098.stdout:9/588: dwrite d2/d6/d36/f58 [0,4194304] 0 2024-09-13T02:53:00.026 INFO:tasks.workunit.client.0.smithi098.stdout:0/618: write dd/df/d1d/d26/f51 [982235,26937] 0 2024-09-13T02:53:00.028 INFO:tasks.workunit.client.0.smithi098.stdout:4/603: write d6/d37/d7a/f89 [697240,41752] 0 2024-09-13T02:53:00.028 INFO:tasks.workunit.client.0.smithi098.stdout:6/530: write d5/d13/d51/f60 [195530,89883] 0 2024-09-13T02:53:00.030 INFO:tasks.workunit.client.0.smithi098.stdout:1/678: stat d9/d33/d19/d35/d68/d4d/dbc/d23/da7/l74 0 2024-09-13T02:53:00.032 INFO:tasks.workunit.client.0.smithi098.stdout:6/531: chown d5/d13/d2b/d3a/d41/d6c 6867555 1 2024-09-13T02:53:00.036 INFO:tasks.workunit.client.0.smithi098.stdout:9/589: chown d2/d6/c7c 139 1 2024-09-13T02:53:00.037 INFO:tasks.workunit.client.0.smithi098.stdout:9/590: truncate d2/f98 675449 0 2024-09-13T02:53:00.041 INFO:tasks.workunit.client.0.smithi098.stdout:2/561: rename d1/c87 to d1/d1a/d9/d1e/d5a/cb9 0 2024-09-13T02:53:00.041 INFO:tasks.workunit.client.0.smithi098.stdout:0/619: dread dd/df/d1d/d40/f6c [0,4194304] 0 2024-09-13T02:53:00.045 INFO:tasks.workunit.client.0.smithi098.stdout:1/679: creat d9/d33/d19/d35/d63/ff8 x:0 0 0 2024-09-13T02:53:00.047 INFO:tasks.workunit.client.0.smithi098.stdout:6/532: symlink d5/d13/d2b/d3a/d41/d6c/d7c/lba 0 2024-09-13T02:53:00.051 INFO:tasks.workunit.client.0.smithi098.stdout:9/591: rmdir d2 39 2024-09-13T02:53:00.053 INFO:tasks.workunit.client.0.smithi098.stdout:0/620: truncate dd/df/d1d/d26/d28/d32/f98 68999 0 2024-09-13T02:53:00.055 INFO:tasks.workunit.client.0.smithi098.stdout:6/533: mknod d5/d13/d2b/d3a/d14/d6b/d9a/cbb 0 2024-09-13T02:53:00.058 INFO:tasks.workunit.client.0.smithi098.stdout:4/604: dread d6/d54/fa7 [0,4194304] 0 2024-09-13T02:53:00.058 INFO:tasks.workunit.client.0.smithi098.stdout:9/592: chown d2/d6/d2b/d4d/d4f/d6c/dd4/c72 1102497 1 2024-09-13T02:53:00.066 INFO:tasks.workunit.client.0.smithi098.stdout:6/534: creat d5/d13/d2b/d3a/d14/d6b/d8f/fbc x:0 0 0 2024-09-13T02:53:00.067 INFO:tasks.workunit.client.0.smithi098.stdout:6/535: dread - d5/d13/d2b/d3a/d14/d6b/d8f/fbc zero size 2024-09-13T02:53:00.070 INFO:tasks.workunit.client.0.smithi098.stdout:2/562: creat d1/d1f/d39/fba x:0 0 0 2024-09-13T02:53:00.071 INFO:tasks.workunit.client.0.smithi098.stdout:2/563: fsync d1/f48 0 2024-09-13T02:53:00.074 INFO:tasks.workunit.client.0.smithi098.stdout:9/593: creat d2/db1/dc5/fda x:0 0 0 2024-09-13T02:53:00.077 INFO:tasks.workunit.client.0.smithi098.stdout:1/680: dwrite d9/d33/d19/f27 [0,4194304] 0 2024-09-13T02:53:00.079 INFO:tasks.workunit.client.0.smithi098.stdout:6/536: unlink d5/d13/d2b/d3a/d14/d94/d97/da3/ca9 0 2024-09-13T02:53:00.087 INFO:tasks.workunit.client.0.smithi098.stdout:6/537: dwrite d5/f1b [0,4194304] 0 2024-09-13T02:53:00.093 INFO:tasks.workunit.client.0.smithi098.stdout:9/594: symlink d2/d6/d36/d8d/ldb 0 2024-09-13T02:53:00.095 INFO:tasks.workunit.client.0.smithi098.stdout:4/605: dwrite d6/d22/d3d/d4d/fa0 [0,4194304] 0 2024-09-13T02:53:00.097 INFO:tasks.workunit.client.0.smithi098.stdout:1/681: mknod d9/d33/d19/d35/d68/d4d/db5/df3/cf9 0 2024-09-13T02:53:00.101 INFO:tasks.workunit.client.0.smithi098.stdout:2/564: link d1/c13 d1/d1a/d4f/cbb 0 2024-09-13T02:53:00.101 INFO:tasks.workunit.client.0.smithi098.stdout:6/538: dread d5/d13/d2b/d3a/f37 [0,4194304] 0 2024-09-13T02:53:00.102 INFO:tasks.workunit.client.0.smithi098.stdout:2/565: fsync d1/d1f/d35/f83 0 2024-09-13T02:53:00.103 INFO:tasks.workunit.client.0.smithi098.stdout:0/621: link dd/df/d1d/d26/c3e dd/ccb 0 2024-09-13T02:53:00.107 INFO:tasks.workunit.client.0.smithi098.stdout:6/539: mknod d5/d13/d2b/d3a/d14/d94/d97/da3/cbd 0 2024-09-13T02:53:00.107 INFO:tasks.workunit.client.0.smithi098.stdout:6/540: fsync d5/d13/d2b/d3a/d41/f95 0 2024-09-13T02:53:00.109 INFO:tasks.workunit.client.0.smithi098.stdout:4/606: rename d6/d22/d3d/d4d/ld1 to d6/d54/ld3 0 2024-09-13T02:53:00.110 INFO:tasks.workunit.client.0.smithi098.stdout:4/607: chown d6/d8d/db9 2398724 1 2024-09-13T02:53:00.119 INFO:tasks.workunit.client.0.smithi098.stdout:0/622: rename dd/df/d1d/d26/l96 to dd/df/d1d/d26/d28/d32/lcc 0 2024-09-13T02:53:00.120 INFO:tasks.workunit.client.0.smithi098.stdout:1/682: dread d9/d33/d29/fa8 [0,4194304] 0 2024-09-13T02:53:00.122 INFO:tasks.workunit.client.0.smithi098.stdout:4/608: chown d6/d22/d3d/d41/d58/c99 81964 1 2024-09-13T02:53:00.124 INFO:tasks.workunit.client.0.smithi098.stdout:9/595: dread d2/d6/f14 [0,4194304] 0 2024-09-13T02:53:00.124 INFO:tasks.workunit.client.0.smithi098.stdout:6/541: mkdir d5/d36/d8c/dbe 0 2024-09-13T02:53:00.125 INFO:tasks.workunit.client.0.smithi098.stdout:6/542: chown d5/d13/d2b/d3a/d41/d55/f92 1 1 2024-09-13T02:53:00.127 INFO:tasks.workunit.client.0.smithi098.stdout:1/683: creat d9/d33/de6/d61/ddb/ffa x:0 0 0 2024-09-13T02:53:00.128 INFO:tasks.workunit.client.0.smithi098.stdout:1/684: write d9/d33/d19/d35/d68/d4d/dbc/d23/fda [323135,26695] 0 2024-09-13T02:53:00.129 INFO:tasks.workunit.client.0.smithi098.stdout:1/685: chown d9/f3d 162584013 1 2024-09-13T02:53:00.129 INFO:tasks.workunit.client.0.smithi098.stdout:1/686: fdatasync d9/d33/d19/d35/fab 0 2024-09-13T02:53:00.129 INFO:tasks.workunit.client.0.smithi098.stdout:9/596: unlink d2/d6/d2b/d4d/f5d 0 2024-09-13T02:53:00.130 INFO:tasks.workunit.client.0.smithi098.stdout:9/597: stat d2/d6/d2b/d66/f78 0 2024-09-13T02:53:00.132 INFO:tasks.workunit.client.0.smithi098.stdout:6/543: rmdir d5/d13/d2b/d3a/d41/d6c/d7c 39 2024-09-13T02:53:00.137 INFO:tasks.workunit.client.0.smithi098.stdout:2/566: truncate d1/d1f/d35/d63/d23/f81 3818591 0 2024-09-13T02:53:00.138 INFO:tasks.workunit.client.0.smithi098.stdout:1/687: dwrite d9/d33/de6/d61/ddb/ffa [0,4194304] 0 2024-09-13T02:53:00.139 INFO:tasks.workunit.client.0.smithi098.stdout:2/567: write d1/d1a/f3a [4431002,92175] 0 2024-09-13T02:53:00.140 INFO:tasks.workunit.client.0.smithi098.stdout:9/598: dwrite d2/d6/d2b/d4d/fab [0,4194304] 0 2024-09-13T02:53:00.141 INFO:tasks.workunit.client.0.smithi098.stdout:1/688: stat d9/d33/d19/d35/d68/d4d/dbc/d23/da7 0 2024-09-13T02:53:00.145 INFO:tasks.workunit.client.0.smithi098.stdout:0/623: rename dd/df/d1d/d26/f44 to dd/df/fcd 0 2024-09-13T02:53:00.147 INFO:tasks.workunit.client.0.smithi098.stdout:2/568: chown d1/d1f/d35/f71 583503919 1 2024-09-13T02:53:00.148 INFO:tasks.workunit.client.0.smithi098.stdout:9/599: readlink d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/la4 0 2024-09-13T02:53:00.149 INFO:tasks.workunit.client.0.smithi098.stdout:2/569: write d1/d1a/d4f/d59/d9e/d9f/fa9 [863020,79161] 0 2024-09-13T02:53:00.152 INFO:tasks.workunit.client.0.smithi098.stdout:1/689: mknod d9/d33/de6/cfb 0 2024-09-13T02:53:00.153 INFO:tasks.workunit.client.0.smithi098.stdout:4/609: rename d6/d10/d21/f56 to d6/d22/d3d/d6c/fd4 0 2024-09-13T02:53:00.156 INFO:tasks.workunit.client.0.smithi098.stdout:0/624: dread - dd/df/d1d/d26/d28/d5d/f69 zero size 2024-09-13T02:53:00.159 INFO:tasks.workunit.client.0.smithi098.stdout:2/570: mknod d1/d1f/d35/d63/d72/cbc 0 2024-09-13T02:53:00.160 INFO:tasks.workunit.client.0.smithi098.stdout:1/690: dwrite d9/d33/d19/d35/d63/f89 [0,4194304] 0 2024-09-13T02:53:00.161 INFO:tasks.workunit.client.0.smithi098.stdout:6/544: link d5/d13/d2b/d3a/d14/d94/d97/da3/cbd d5/d13/d2b/d5b/cbf 0 2024-09-13T02:53:00.168 INFO:tasks.workunit.client.0.smithi098.stdout:1/691: creat d9/d33/d19/d35/d68/d4d/db5/dd3/ffc x:0 0 0 2024-09-13T02:53:00.172 INFO:tasks.workunit.client.0.smithi098.stdout:0/625: mknod dd/df/d1d/cce 0 2024-09-13T02:53:00.174 INFO:tasks.workunit.client.0.smithi098.stdout:1/692: chown d9/d33/de6/c8c 14867335 1 2024-09-13T02:53:00.175 INFO:tasks.workunit.client.0.smithi098.stdout:1/693: stat d9/d33/d19/d64 0 2024-09-13T02:53:00.175 INFO:tasks.workunit.client.0.smithi098.stdout:6/545: mknod d5/d13/cc0 0 2024-09-13T02:53:00.178 INFO:tasks.workunit.client.0.smithi098.stdout:9/600: getdents d2/d6/d2b/d4d 0 2024-09-13T02:53:00.185 INFO:tasks.workunit.client.0.smithi098.stdout:4/610: dread d6/d22/d3d/d6c/fd4 [0,4194304] 0 2024-09-13T02:53:00.185 INFO:tasks.workunit.client.0.smithi098.stdout:4/611: write d6/d54/f9f [1390724,29830] 0 2024-09-13T02:53:00.186 INFO:tasks.workunit.client.0.smithi098.stdout:9/601: readlink d2/d6/d36/d8d/l96 0 2024-09-13T02:53:00.187 INFO:tasks.workunit.client.0.smithi098.stdout:4/612: dread d6/f61 [0,4194304] 0 2024-09-13T02:53:00.193 INFO:tasks.workunit.client.0.smithi098.stdout:0/626: write dd/f75 [420023,20591] 0 2024-09-13T02:53:00.193 INFO:tasks.workunit.client.0.smithi098.stdout:1/694: symlink d9/db6/lfd 0 2024-09-13T02:53:00.194 INFO:tasks.workunit.client.0.smithi098.stdout:9/602: creat d2/db1/dc5/fdc x:0 0 0 2024-09-13T02:53:00.331 INFO:tasks.workunit.client.0.smithi098.stdout:6/546: creat d5/d13/fc1 x:0 0 0 2024-09-13T02:53:00.333 INFO:tasks.workunit.client.0.smithi098.stdout:1/695: symlink d9/d33/de6/d61/ddb/lfe 0 2024-09-13T02:53:00.334 INFO:tasks.workunit.client.0.smithi098.stdout:1/696: stat d9/d33/d87 0 2024-09-13T02:53:00.336 INFO:tasks.workunit.client.0.smithi098.stdout:4/613: mkdir d6/d22/d3d/dc8/dd5 0 2024-09-13T02:53:00.337 INFO:tasks.workunit.client.0.smithi098.stdout:0/627: dwrite dd/fc4 [0,4194304] 0 2024-09-13T02:53:00.337 INFO:tasks.workunit.client.0.smithi098.stdout:1/697: chown d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fef 215040471 1 2024-09-13T02:53:00.337 INFO:tasks.workunit.client.0.smithi098.stdout:2/571: read d1/d1a/d4f/d59/fa2 [2843,855] 0 2024-09-13T02:53:00.338 INFO:tasks.workunit.client.0.smithi098.stdout:2/572: chown d1/f97 1 1 2024-09-13T02:53:00.339 INFO:tasks.workunit.client.0.smithi098.stdout:6/547: fsync d5/d13/d2b/d3a/d14/f29 0 2024-09-13T02:53:00.343 INFO:tasks.workunit.client.0.smithi098.stdout:9/603: rename d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/cad to d2/d6/d2b/d4d/d4f/d6c/dce/cdd 0 2024-09-13T02:53:00.347 INFO:tasks.workunit.client.0.smithi098.stdout:1/698: mkdir d9/d33/d19/d35/d68/d4d/db5/dff 0 2024-09-13T02:53:00.349 INFO:tasks.workunit.client.0.smithi098.stdout:6/548: dwrite d5/d13/d2b/d5b/f89 [0,4194304] 0 2024-09-13T02:53:00.350 INFO:tasks.workunit.client.0.smithi098.stdout:6/549: chown d5/d13/d2b/c98 10324543 1 2024-09-13T02:53:00.358 INFO:tasks.workunit.client.0.smithi098.stdout:4/614: creat d6/d22/d3d/d64/d6f/fd6 x:0 0 0 2024-09-13T02:53:00.360 INFO:tasks.workunit.client.0.smithi098.stdout:9/604: mknod d2/d6/d2b/d4d/d4f/cde 0 2024-09-13T02:53:00.361 INFO:tasks.workunit.client.0.smithi098.stdout:9/605: fdatasync d2/d6/d2b/d4d/d56/db9/fc9 0 2024-09-13T02:53:00.366 INFO:tasks.workunit.client.0.smithi098.stdout:2/573: dread d1/f7b [0,4194304] 0 2024-09-13T02:53:00.368 INFO:tasks.workunit.client.0.smithi098.stdout:6/550: creat d5/d13/d2b/d3a/d14/d94/fc2 x:0 0 0 2024-09-13T02:53:00.369 INFO:tasks.workunit.client.0.smithi098.stdout:6/551: stat d5/d13/d2b/d3a/d14/d6b/d9a/da5 0 2024-09-13T02:53:00.376 INFO:tasks.workunit.client.0.smithi098.stdout:2/574: mknod d1/d1f/d35/cbd 0 2024-09-13T02:53:00.379 INFO:tasks.workunit.client.0.smithi098.stdout:6/552: mkdir d5/d36/d8c/dc3 0 2024-09-13T02:53:00.380 INFO:tasks.workunit.client.0.smithi098.stdout:0/628: link dd/d95/f9e dd/df/d1d/d40/d46/fcf 0 2024-09-13T02:53:00.383 INFO:tasks.workunit.client.0.smithi098.stdout:4/615: getdents d6/d22/d3d/dc8/dd5 0 2024-09-13T02:53:00.384 INFO:tasks.workunit.client.0.smithi098.stdout:0/629: write dd/df/d1d/d26/d37/fa0 [1156152,5306] 0 2024-09-13T02:53:00.385 INFO:tasks.workunit.client.0.smithi098.stdout:2/575: dwrite d1/d1f/d39/fba [0,4194304] 0 2024-09-13T02:53:00.390 INFO:tasks.workunit.client.0.smithi098.stdout:1/699: link d9/d33/d29/d58/f5c d9/d33/d19/d35/d68/d4d/dbc/d23/f100 0 2024-09-13T02:53:00.391 INFO:tasks.workunit.client.0.smithi098.stdout:7/726: sync 2024-09-13T02:53:00.391 INFO:tasks.workunit.client.0.smithi098.stdout:8/606: sync 2024-09-13T02:53:00.391 INFO:tasks.workunit.client.0.smithi098.stdout:3/573: sync 2024-09-13T02:53:00.393 INFO:tasks.workunit.client.0.smithi098.stdout:3/574: stat d7/d9/d15/d5d/l72 0 2024-09-13T02:53:00.395 INFO:tasks.workunit.client.0.smithi098.stdout:7/727: truncate d6/d24/d2a/d5a/d4c/f60 1452993 0 2024-09-13T02:53:00.398 INFO:tasks.workunit.client.0.smithi098.stdout:4/616: dread d6/d22/d3d/f49 [0,4194304] 0 2024-09-13T02:53:00.399 INFO:tasks.workunit.client.0.smithi098.stdout:4/617: dread - d6/d22/d3d/d41/fb2 zero size 2024-09-13T02:53:00.399 INFO:tasks.workunit.client.0.smithi098.stdout:4/618: readlink d6/db/l81 0 2024-09-13T02:53:00.400 INFO:tasks.workunit.client.0.smithi098.stdout:0/630: creat dd/df/d1d/d40/d9b/fd0 x:0 0 0 2024-09-13T02:53:00.401 INFO:tasks.workunit.client.0.smithi098.stdout:4/619: write d6/d22/d3d/d64/d6f/fd6 [165102,64694] 0 2024-09-13T02:53:00.408 INFO:tasks.workunit.client.0.smithi098.stdout:6/553: mknod d5/d13/d2b/d93/cc4 0 2024-09-13T02:53:00.409 INFO:tasks.workunit.client.0.smithi098.stdout:6/554: write d5/d13/d2b/d3a/fa2 [2102307,123359] 0 2024-09-13T02:53:00.425 INFO:tasks.workunit.client.0.smithi098.stdout:0/631: fdatasync dd/df/fcd 0 2024-09-13T02:53:00.428 INFO:tasks.workunit.client.0.smithi098.stdout:1/700: creat d9/d33/d19/d35/d68/f101 x:0 0 0 2024-09-13T02:53:00.428 INFO:tasks.workunit.client.0.smithi098.stdout:9/606: write d2/f32 [4841250,38802] 0 2024-09-13T02:53:00.431 INFO:tasks.workunit.client.0.smithi098.stdout:8/607: rename d2/dd/d2e/fa0 to d2/fbe 0 2024-09-13T02:53:00.433 INFO:tasks.workunit.client.0.smithi098.stdout:8/608: read d2/dd/f25 [558067,113372] 0 2024-09-13T02:53:00.443 INFO:tasks.workunit.client.0.smithi098.stdout:9/607: dread - d2/d6/d2b/d4d/d56/f99 zero size 2024-09-13T02:53:00.445 INFO:tasks.workunit.client.0.smithi098.stdout:3/575: rename d7/d9/d15/d2d/d5b/d70/d90/c9a to d7/d9/d15/d26/cb4 0 2024-09-13T02:53:00.448 INFO:tasks.workunit.client.0.smithi098.stdout:8/609: dread d2/d2f/d78/d46/d47/d6e/f8c [0,4194304] 0 2024-09-13T02:53:00.449 INFO:tasks.workunit.client.0.smithi098.stdout:8/610: chown d2/dd/d11/d44/f63 12 1 2024-09-13T02:53:00.450 INFO:tasks.workunit.client.0.smithi098.stdout:8/611: write d2/dd/d11/f97 [1319118,733] 0 2024-09-13T02:53:00.455 INFO:tasks.workunit.client.0.smithi098.stdout:2/576: write d1/d1f/d35/d63/f37 [12873063,20622] 0 2024-09-13T02:53:00.457 INFO:tasks.workunit.client.0.smithi098.stdout:2/577: write d1/d1a/d9/f5c [4306571,29125] 0 2024-09-13T02:53:00.461 INFO:tasks.workunit.client.0.smithi098.stdout:3/576: dread d7/d9/d15/d2d/d34/f61 [0,4194304] 0 2024-09-13T02:53:00.461 INFO:tasks.workunit.client.0.smithi098.stdout:2/578: dread d1/d1f/d39/fba [0,4194304] 0 2024-09-13T02:53:00.463 INFO:tasks.workunit.client.0.smithi098.stdout:7/728: write d6/d24/d2a/d5a/d42/f71 [1685205,53983] 0 2024-09-13T02:53:00.465 INFO:tasks.workunit.client.0.smithi098.stdout:8/612: mknod d2/d28/d43/d88/cbf 0 2024-09-13T02:53:00.466 INFO:tasks.workunit.client.0.smithi098.stdout:7/729: write d6/d24/d2a/dda/fd0 [444412,42786] 0 2024-09-13T02:53:00.467 INFO:tasks.workunit.client.0.smithi098.stdout:8/613: chown d2/dd/d11/d1d/f24 196 1 2024-09-13T02:53:00.469 INFO:tasks.workunit.client.0.smithi098.stdout:8/614: write d2/d2f/d78/f50 [2261023,32302] 0 2024-09-13T02:53:00.470 INFO:tasks.workunit.client.0.smithi098.stdout:3/577: dwrite d7/d9/fb3 [0,4194304] 0 2024-09-13T02:53:00.476 INFO:tasks.workunit.client.0.smithi098.stdout:2/579: creat d1/da7/fbe x:0 0 0 2024-09-13T02:53:00.478 INFO:tasks.workunit.client.0.smithi098.stdout:6/555: dwrite d5/d13/d2b/d5b/f63 [0,4194304] 0 2024-09-13T02:53:00.479 INFO:tasks.workunit.client.0.smithi098.stdout:6/556: stat d5/d13/d2b/d93 0 2024-09-13T02:53:00.484 INFO:tasks.workunit.client.0.smithi098.stdout:4/620: rename d6/d37/c93 to d6/d10/d21/cd7 0 2024-09-13T02:53:00.489 INFO:tasks.workunit.client.0.smithi098.stdout:4/621: dread d6/d22/d3d/d41/d74/fc4 [0,4194304] 0 2024-09-13T02:53:00.489 INFO:tasks.workunit.client.0.smithi098.stdout:7/730: fdatasync d6/d47/f7e 0 2024-09-13T02:53:00.499 INFO:tasks.workunit.client.0.smithi098.stdout:1/701: dwrite d9/d33/d19/d35/d68/d2f/dbf/f85 [0,4194304] 0 2024-09-13T02:53:00.504 INFO:tasks.workunit.client.0.smithi098.stdout:9/608: getdents d2/d6/d2b/d4d/d4f/d6c/dd4/dac 0 2024-09-13T02:53:00.512 INFO:tasks.workunit.client.0.smithi098.stdout:9/609: dwrite d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/fcd [0,4194304] 0 2024-09-13T02:53:00.514 INFO:tasks.workunit.client.0.smithi098.stdout:9/610: fsync d2/d6/d2b/d4d/d4f/d6c/fa5 0 2024-09-13T02:53:00.515 INFO:tasks.workunit.client.0.smithi098.stdout:9/611: chown d2/d6/fa8 10878725 1 2024-09-13T02:53:00.526 INFO:tasks.workunit.client.0.smithi098.stdout:1/702: mkdir d9/d33/d19/d102 0 2024-09-13T02:53:00.527 INFO:tasks.workunit.client.0.smithi098.stdout:9/612: truncate d2/d6/d2b/f9e 606869 0 2024-09-13T02:53:00.530 INFO:tasks.workunit.client.0.smithi098.stdout:3/578: dwrite d7/d9/d15/d26/f2a [0,4194304] 0 2024-09-13T02:53:00.530 INFO:tasks.workunit.client.0.smithi098.stdout:6/557: write d5/d36/f4f [2591516,30520] 0 2024-09-13T02:53:00.532 INFO:tasks.workunit.client.0.smithi098.stdout:3/579: stat d7/d9/d25/d64/f68 0 2024-09-13T02:53:00.534 INFO:tasks.workunit.client.0.smithi098.stdout:4/622: link l4 d6/d10/d21/ld8 0 2024-09-13T02:53:00.538 INFO:tasks.workunit.client.0.smithi098.stdout:8/615: truncate d2/f4a 2612427 0 2024-09-13T02:53:00.540 INFO:tasks.workunit.client.0.smithi098.stdout:9/613: truncate d2/d6/d2b/d4d/d4f/fa9 791326 0 2024-09-13T02:53:00.540 INFO:tasks.workunit.client.0.smithi098.stdout:2/580: truncate d1/d1f/d35/d63/f3f 361806 0 2024-09-13T02:53:00.541 INFO:tasks.workunit.client.0.smithi098.stdout:7/731: dwrite d6/d1e/fb4 [0,4194304] 0 2024-09-13T02:53:00.542 INFO:tasks.workunit.client.0.smithi098.stdout:9/614: write d2/d6/d36/d6a/f7d [5612264,73560] 0 2024-09-13T02:53:00.543 INFO:tasks.workunit.client.0.smithi098.stdout:9/615: dread - d2/d6/d2b/d66/f78 zero size 2024-09-13T02:53:00.545 INFO:tasks.workunit.client.0.smithi098.stdout:3/580: rename d7/d9/d15/d2d/d5b/f45 to d7/d9/d15/d2d/d78/d7e/fb5 0 2024-09-13T02:53:00.547 INFO:tasks.workunit.client.0.smithi098.stdout:4/623: rmdir d6/d22/d3d/d64/d6f 39 2024-09-13T02:53:00.555 INFO:tasks.workunit.client.0.smithi098.stdout:7/732: mkdir d6/d24/dc5/de3/df2 0 2024-09-13T02:53:00.556 INFO:tasks.workunit.client.0.smithi098.stdout:7/733: fdatasync d6/d1e/faf 0 2024-09-13T02:53:00.557 INFO:tasks.workunit.client.0.smithi098.stdout:9/616: mkdir d2/d6/d2b/d4d/d56/db9/ddf 0 2024-09-13T02:53:00.558 INFO:tasks.workunit.client.0.smithi098.stdout:6/558: dwrite d5/f22 [0,4194304] 0 2024-09-13T02:53:00.559 INFO:tasks.workunit.client.0.smithi098.stdout:6/559: stat d5/d13/d2b/d3a/d14/d94/fc2 0 2024-09-13T02:53:00.567 INFO:tasks.workunit.client.0.smithi098.stdout:3/581: rmdir d7/d9/d15/d2d/d5b 39 2024-09-13T02:53:00.570 INFO:tasks.workunit.client.0.smithi098.stdout:3/582: chown d7/d9/d15/d2d/d78/d7e/d8e/c9f 10967735 1 2024-09-13T02:53:00.571 INFO:tasks.workunit.client.0.smithi098.stdout:1/703: dwrite d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fd9 [0,4194304] 0 2024-09-13T02:53:00.573 INFO:tasks.workunit.client.0.smithi098.stdout:9/617: mkdir d2/d6/d2b/d66/de0 0 2024-09-13T02:53:00.577 INFO:tasks.workunit.client.0.smithi098.stdout:3/583: read d7/d9/d25/d2b/f2c [972013,46719] 0 2024-09-13T02:53:00.578 INFO:tasks.workunit.client.0.smithi098.stdout:6/560: rename d5/d13/f3f to d5/d13/d2b/d3a/d41/d55/dad/fc5 0 2024-09-13T02:53:00.579 INFO:tasks.workunit.client.0.smithi098.stdout:6/561: dread - d5/d36/f8e zero size 2024-09-13T02:53:00.580 INFO:tasks.workunit.client.0.smithi098.stdout:6/562: chown d5/d6f 60647621 1 2024-09-13T02:53:00.582 INFO:tasks.workunit.client.0.smithi098.stdout:4/624: link d6/d22/d3d/d41/d58/f78 d6/d3e/d46/dd2/fd9 0 2024-09-13T02:53:00.589 INFO:tasks.workunit.client.0.smithi098.stdout:7/734: dread d6/d24/f26 [0,4194304] 0 2024-09-13T02:53:00.590 INFO:tasks.workunit.client.0.smithi098.stdout:1/704: symlink d9/d33/d19/d35/d68/d4d/dbc/d6b/l103 0 2024-09-13T02:53:00.591 INFO:tasks.workunit.client.0.smithi098.stdout:4/625: dwrite d6/d22/d3d/d4d/fa0 [4194304,4194304] 0 2024-09-13T02:53:00.595 INFO:tasks.workunit.client.0.smithi098.stdout:5/547: sync 2024-09-13T02:53:00.597 INFO:tasks.workunit.client.0.smithi098.stdout:5/548: chown d0/d38/d3f/d1a/f67 26991816 1 2024-09-13T02:53:00.597 INFO:tasks.workunit.client.0.smithi098.stdout:6/563: chown d5/l27 249 1 2024-09-13T02:53:00.598 INFO:tasks.workunit.client.0.smithi098.stdout:5/549: dread d0/d57/f91 [0,4194304] 0 2024-09-13T02:53:00.604 INFO:tasks.workunit.client.0.smithi098.stdout:7/735: dread d6/d24/d2a/d5a/f2b [0,4194304] 0 2024-09-13T02:53:00.612 INFO:tasks.workunit.client.0.smithi098.stdout:9/618: creat d2/d6/d2b/d4d/d56/db9/ddf/fe1 x:0 0 0 2024-09-13T02:53:00.614 INFO:tasks.workunit.client.0.smithi098.stdout:6/564: fdatasync d5/d18/f1f 0 2024-09-13T02:53:00.617 INFO:tasks.workunit.client.0.smithi098.stdout:2/581: truncate d1/d1f/d35/d63/f3f 895973 0 2024-09-13T02:53:00.617 INFO:tasks.workunit.client.0.smithi098.stdout:8/616: link d2/d2f/d78/c9d d2/dd/d11/cc0 0 2024-09-13T02:53:00.617 INFO:tasks.workunit.client.0.smithi098.stdout:2/582: dread - d1/d1f/d35/d63/d72/f93 zero size 2024-09-13T02:53:00.619 INFO:tasks.workunit.client.0.smithi098.stdout:7/736: fsync d6/d1e/f23 0 2024-09-13T02:53:00.620 INFO:tasks.workunit.client.0.smithi098.stdout:1/705: mknod d9/d33/c104 0 2024-09-13T02:53:00.621 INFO:tasks.workunit.client.0.smithi098.stdout:4/626: unlink d6/d3e/d46/c8c 0 2024-09-13T02:53:00.625 INFO:tasks.workunit.client.0.smithi098.stdout:3/584: link d7/d9/d15/d26/c2f d7/d9/d25/d3a/d51/cb6 0 2024-09-13T02:53:00.646 INFO:tasks.workunit.client.0.smithi098.stdout:6/565: symlink d5/d13/d2b/d3a/d41/d55/lc6 0 2024-09-13T02:53:00.647 INFO:tasks.workunit.client.0.smithi098.stdout:5/550: mkdir d0/d38/dbb 0 2024-09-13T02:53:00.648 INFO:tasks.workunit.client.0.smithi098.stdout:8/617: mknod d2/d2f/d78/d46/da2/cc1 0 2024-09-13T02:53:00.650 INFO:tasks.workunit.client.0.smithi098.stdout:7/737: dwrite d6/d24/d2a/d5a/d42/fb8 [0,4194304] 0 2024-09-13T02:53:00.654 INFO:tasks.workunit.client.0.smithi098.stdout:1/706: write d9/d33/d19/d35/d68/d4d/dbc/fdc [831814,63160] 0 2024-09-13T02:53:00.656 INFO:tasks.workunit.client.0.smithi098.stdout:4/627: dwrite d6/d37/d83/fcc [0,4194304] 0 2024-09-13T02:53:00.659 INFO:tasks.workunit.client.0.smithi098.stdout:5/551: creat d0/d15/da4/db1/fbc x:0 0 0 2024-09-13T02:53:00.659 INFO:tasks.workunit.client.0.smithi098.stdout:1/707: chown d9/d33/d29/fa8 643923 1 2024-09-13T02:53:00.660 INFO:tasks.workunit.client.0.smithi098.stdout:8/618: symlink d2/d28/d43/d88/d99/lc2 0 2024-09-13T02:53:00.662 INFO:tasks.workunit.client.0.smithi098.stdout:8/619: stat d2/dd/lac 0 2024-09-13T02:53:00.662 INFO:tasks.workunit.client.0.smithi098.stdout:4/628: chown d6/d22/d3d/d41/d58/c99 9484755 1 2024-09-13T02:53:00.663 INFO:tasks.workunit.client.0.smithi098.stdout:9/619: dwrite d2/d6/d2b/d4d/f7b [0,4194304] 0 2024-09-13T02:53:00.663 INFO:tasks.workunit.client.0.smithi098.stdout:6/566: dwrite d5/f22 [0,4194304] 0 2024-09-13T02:53:00.664 INFO:tasks.workunit.client.0.smithi098.stdout:1/708: read d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fd9 [664422,82758] 0 2024-09-13T02:53:00.666 INFO:tasks.workunit.client.0.smithi098.stdout:4/629: write d6/d22/d3d/d6c/d91/fb1 [371179,86611] 0 2024-09-13T02:53:00.714 INFO:tasks.workunit.client.0.smithi098.stdout:3/585: mkdir d7/d9/d25/d3a/db7 0 2024-09-13T02:53:00.714 INFO:tasks.workunit.client.0.smithi098.stdout:3/586: chown d7/d9/d15/d2d 34 1 2024-09-13T02:53:00.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:00 smithi098 ceph-mon[27886]: pgmap v29: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 102 MiB/s rd, 240 MiB/s wr, 544 op/s 2024-09-13T02:53:00.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:00 smithi142 ceph-mon[33443]: pgmap v29: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 102 MiB/s rd, 240 MiB/s wr, 544 op/s 2024-09-13T02:53:00.799 INFO:tasks.workunit.client.0.smithi098.stdout:4/630: rename d6/d10/d21/c6b to d6/d22/cda 0 2024-09-13T02:53:00.800 INFO:tasks.workunit.client.0.smithi098.stdout:4/631: write d6/d37/d7a/f89 [360126,28481] 0 2024-09-13T02:53:00.802 INFO:tasks.workunit.client.0.smithi098.stdout:1/709: symlink d9/d33/d19/d35/d68/l105 0 2024-09-13T02:53:00.804 INFO:tasks.workunit.client.0.smithi098.stdout:6/567: mkdir d5/d13/d2b/d3a/d41/d6c/d7c/dc7 0 2024-09-13T02:53:00.806 INFO:tasks.workunit.client.0.smithi098.stdout:9/620: write d2/d6/f1d [5355757,17310] 0 2024-09-13T02:53:00.808 INFO:tasks.workunit.client.0.smithi098.stdout:5/552: rmdir d0/d38/dbb 0 2024-09-13T02:53:00.808 INFO:tasks.workunit.client.0.smithi098.stdout:4/632: readlink d6/d22/d3d/d41/l62 0 2024-09-13T02:53:00.811 INFO:tasks.workunit.client.0.smithi098.stdout:9/621: fdatasync d2/d6/d2b/d4d/d4f/d6c/f79 0 2024-09-13T02:53:00.816 INFO:tasks.workunit.client.0.smithi098.stdout:5/553: creat d0/d15/d17/d1c/d3d/fbd x:0 0 0 2024-09-13T02:53:00.816 INFO:tasks.workunit.client.0.smithi098.stdout:1/710: dread d9/d33/d19/d35/d68/d4d/dbc/d23/fc6 [0,4194304] 0 2024-09-13T02:53:00.817 INFO:tasks.workunit.client.0.smithi098.stdout:4/633: dwrite d6/d10/fce [0,4194304] 0 2024-09-13T02:53:00.817 INFO:tasks.workunit.client.0.smithi098.stdout:3/587: rename d7/d9/d25/d3a to d7/d9/d15/d2d/db8 0 2024-09-13T02:53:00.821 INFO:tasks.workunit.client.0.smithi098.stdout:9/622: unlink d2/d6/d36/d8d/f1f 0 2024-09-13T02:53:00.823 INFO:tasks.workunit.client.0.smithi098.stdout:6/568: link d5/d13/d2b/ca1 d5/d6f/cc8 0 2024-09-13T02:53:00.824 INFO:tasks.workunit.client.0.smithi098.stdout:6/569: readlink d5/d13/d2b/d3a/l3d 0 2024-09-13T02:53:00.826 INFO:tasks.workunit.client.0.smithi098.stdout:6/570: readlink d5/d13/d2b/d3a/l2c 0 2024-09-13T02:53:00.828 INFO:tasks.workunit.client.0.smithi098.stdout:9/623: dwrite d2/d6/d36/d6a/f6b [4194304,4194304] 0 2024-09-13T02:53:00.830 INFO:tasks.workunit.client.0.smithi098.stdout:1/711: unlink d9/d33/d19/d35/d68/d4d/db5/dcb/fd7 0 2024-09-13T02:53:00.838 INFO:tasks.workunit.client.0.smithi098.stdout:6/571: creat d5/d18/d50/fc9 x:0 0 0 2024-09-13T02:53:00.839 INFO:tasks.workunit.client.0.smithi098.stdout:6/572: dread - d5/d36/f8e zero size 2024-09-13T02:53:00.839 INFO:tasks.workunit.client.0.smithi098.stdout:9/624: chown d2/d6/f19 5526 1 2024-09-13T02:53:00.843 INFO:tasks.workunit.client.0.smithi098.stdout:1/712: unlink d9/d33/de6/le8 0 2024-09-13T02:53:00.848 INFO:tasks.workunit.client.0.smithi098.stdout:6/573: symlink d5/d13/d2b/d3a/d14/d94/d97/lca 0 2024-09-13T02:53:00.849 INFO:tasks.workunit.client.0.smithi098.stdout:6/574: truncate d5/d6f/fae 513537 0 2024-09-13T02:53:00.852 INFO:tasks.workunit.client.0.smithi098.stdout:1/713: creat d9/d33/de6/d61/db1/f106 x:0 0 0 2024-09-13T02:53:00.853 INFO:tasks.workunit.client.0.smithi098.stdout:5/554: link d0/d38/d3f/d81/c7e d0/d38/cbe 0 2024-09-13T02:53:00.859 INFO:tasks.workunit.client.0.smithi098.stdout:1/714: dwrite d9/d33/d19/d35/d68/d4d/dbc/f88 [0,4194304] 0 2024-09-13T02:53:00.859 INFO:tasks.workunit.client.0.smithi098.stdout:4/634: truncate d6/d22/d3d/d4d/fa0 7279551 0 2024-09-13T02:53:00.861 INFO:tasks.workunit.client.0.smithi098.stdout:5/555: rmdir d0/d15/da4/db1 39 2024-09-13T02:53:00.862 INFO:tasks.workunit.client.0.smithi098.stdout:5/556: write d0/d15/d17/d1c/f9d [849263,114329] 0 2024-09-13T02:53:00.865 INFO:tasks.workunit.client.0.smithi098.stdout:3/588: truncate d7/d9/d15/d2d/d34/f97 694112 0 2024-09-13T02:53:00.865 INFO:tasks.workunit.client.0.smithi098.stdout:6/575: mkdir d5/d36/d8c/dbe/dcb 0 2024-09-13T02:53:00.867 INFO:tasks.workunit.client.0.smithi098.stdout:4/635: mkdir d6/d22/d3d/d41/d74/ddb 0 2024-09-13T02:53:00.869 INFO:tasks.workunit.client.0.smithi098.stdout:1/715: mknod d9/d33/d19/d35/d68/d4d/dbc/d23/d30/c107 0 2024-09-13T02:53:00.870 INFO:tasks.workunit.client.0.smithi098.stdout:5/557: unlink d0/d15/d17/f1e 0 2024-09-13T02:53:00.872 INFO:tasks.workunit.client.0.smithi098.stdout:9/625: write d2/d6/d36/f5b [4334783,84019] 0 2024-09-13T02:53:00.873 INFO:tasks.workunit.client.0.smithi098.stdout:1/716: unlink d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/cf6 0 2024-09-13T02:53:00.874 INFO:tasks.workunit.client.0.smithi098.stdout:1/717: chown d9/d33/d29/d58 6 1 2024-09-13T02:53:00.877 INFO:tasks.workunit.client.0.smithi098.stdout:9/626: creat d2/d6/d2b/d4d/d56/dbc/fe2 x:0 0 0 2024-09-13T02:53:00.878 INFO:tasks.workunit.client.0.smithi098.stdout:5/558: mknod d0/cbf 0 2024-09-13T02:53:00.880 INFO:tasks.workunit.client.0.smithi098.stdout:3/589: rename d7/d9/d15/d2d/cab to d7/d9/d15/d2d/cb9 0 2024-09-13T02:53:00.882 INFO:tasks.workunit.client.0.smithi098.stdout:1/718: truncate d9/d33/d19/d35/d68/d4d/db5/fc0 730255 0 2024-09-13T02:53:00.882 INFO:tasks.workunit.client.0.smithi098.stdout:5/559: symlink d0/d38/d3f/d81/d4d/lc0 0 2024-09-13T02:53:00.884 INFO:tasks.workunit.client.0.smithi098.stdout:9/627: rename d2/d6/d2b/d4d/d4f/d6c/dd4/d43/f4c to d2/d6/d2b/d4d/d4f/d6c/fe3 0 2024-09-13T02:53:00.890 INFO:tasks.workunit.client.0.smithi098.stdout:9/628: mkdir d2/d6/d2b/d4d/d4f/d6c/dd4/de4 0 2024-09-13T02:53:00.898 INFO:tasks.workunit.client.0.smithi098.stdout:9/629: truncate d2/d6/d2b/d4d/d4f/d6c/f81 212445 0 2024-09-13T02:53:00.905 INFO:tasks.workunit.client.0.smithi098.stdout:5/560: dread d0/d38/d3f/d81/f95 [0,4194304] 0 2024-09-13T02:53:00.908 INFO:tasks.workunit.client.0.smithi098.stdout:6/576: truncate d5/d13/d2b/d5b/f89 923079 0 2024-09-13T02:53:00.915 INFO:tasks.workunit.client.0.smithi098.stdout:9/630: getdents d2/d6/d2b/d4d/d4f/d6c/dd4/d43 0 2024-09-13T02:53:00.916 INFO:tasks.workunit.client.0.smithi098.stdout:1/719: write d9/f84 [3741840,1419] 0 2024-09-13T02:53:00.917 INFO:tasks.workunit.client.0.smithi098.stdout:9/631: mkdir d2/d6/d36/da7/de5 0 2024-09-13T02:53:00.918 INFO:tasks.workunit.client.0.smithi098.stdout:9/632: stat d2/d6/d2b/d66/f78 0 2024-09-13T02:53:00.920 INFO:tasks.workunit.client.0.smithi098.stdout:9/633: write d2/d6/d36/d8d/fca [4053243,44765] 0 2024-09-13T02:53:00.922 INFO:tasks.workunit.client.0.smithi098.stdout:5/561: write d0/d15/d17/d1c/f99 [1251814,118271] 0 2024-09-13T02:53:00.924 INFO:tasks.workunit.client.0.smithi098.stdout:0/632: sync 2024-09-13T02:53:00.926 INFO:tasks.workunit.client.0.smithi098.stdout:9/634: creat d2/d6/d2b/d4d/fe6 x:0 0 0 2024-09-13T02:53:00.926 INFO:tasks.workunit.client.0.smithi098.stdout:1/720: dwrite d9/d33/d29/fa8 [4194304,4194304] 0 2024-09-13T02:53:00.928 INFO:tasks.workunit.client.0.smithi098.stdout:1/721: truncate d9/d33/d19/d35/d68/d2f/fec 5009767 0 2024-09-13T02:53:00.931 INFO:tasks.workunit.client.0.smithi098.stdout:0/633: creat dd/d1f/d85/d9d/fd1 x:0 0 0 2024-09-13T02:53:00.933 INFO:tasks.workunit.client.0.smithi098.stdout:9/635: readlink d2/d6/l16 0 2024-09-13T02:53:00.940 INFO:tasks.workunit.client.0.smithi098.stdout:6/577: dwrite d5/d13/d2b/d3a/d41/d55/f92 [0,4194304] 0 2024-09-13T02:53:00.940 INFO:tasks.workunit.client.0.smithi098.stdout:1/722: dwrite d9/d33/d19/d35/d68/d4d/dbc/fdc [0,4194304] 0 2024-09-13T02:53:00.940 INFO:tasks.workunit.client.0.smithi098.stdout:0/634: write dd/df/d1d/d26/d28/d32/fb0 [3175271,106118] 0 2024-09-13T02:53:00.946 INFO:tasks.workunit.client.0.smithi098.stdout:6/578: chown d5/ca 52312 1 2024-09-13T02:53:00.948 INFO:tasks.workunit.client.0.smithi098.stdout:5/562: link d0/d38/d3f/d81/d4d/lc0 d0/d38/d3f/d1a/lc1 0 2024-09-13T02:53:00.951 INFO:tasks.workunit.client.0.smithi098.stdout:1/723: dread d9/d33/de6/d61/db1/fd4 [0,4194304] 0 2024-09-13T02:53:00.952 INFO:tasks.workunit.client.0.smithi098.stdout:9/636: creat d2/d6/d2b/d4d/d4f/d6c/dd4/dac/dd9/fe7 x:0 0 0 2024-09-13T02:53:00.953 INFO:tasks.workunit.client.0.smithi098.stdout:9/637: chown d2/d6/d2b/d4d/d56/f7e 2630726 1 2024-09-13T02:53:00.955 INFO:tasks.workunit.client.0.smithi098.stdout:0/635: truncate dd/df/d1d/d40/d46/f5b 2789335 0 2024-09-13T02:53:00.956 INFO:tasks.workunit.client.0.smithi098.stdout:0/636: write dd/f75 [846907,29875] 0 2024-09-13T02:53:00.962 INFO:tasks.workunit.client.0.smithi098.stdout:9/638: creat d2/db1/fe8 x:0 0 0 2024-09-13T02:53:00.962 INFO:tasks.workunit.client.0.smithi098.stdout:6/579: mknod d5/d13/d2b/d3a/d5a/da8/ccc 0 2024-09-13T02:53:00.965 INFO:tasks.workunit.client.0.smithi098.stdout:5/563: link d0/l76 d0/d15/d17/daa/dab/lc2 0 2024-09-13T02:53:00.967 INFO:tasks.workunit.client.0.smithi098.stdout:9/639: fdatasync d2/d6/f29 0 2024-09-13T02:53:00.969 INFO:tasks.workunit.client.0.smithi098.stdout:1/724: getdents d9/d33/d19/d35/d68/d4d/dbc/d6b 0 2024-09-13T02:53:00.969 INFO:tasks.workunit.client.0.smithi098.stdout:1/725: stat f1 0 2024-09-13T02:53:00.974 INFO:tasks.workunit.client.0.smithi098.stdout:1/726: symlink d9/d33/de6/l108 0 2024-09-13T02:53:00.975 INFO:tasks.workunit.client.0.smithi098.stdout:5/564: mkdir d0/d38/dc3 0 2024-09-13T02:53:00.979 INFO:tasks.workunit.client.0.smithi098.stdout:9/640: mkdir d2/d6/d2b/d66/de0/de9 0 2024-09-13T02:53:00.979 INFO:tasks.workunit.client.0.smithi098.stdout:9/641: dread - d2/d6/d2b/d4d/d56/dbc/fe2 zero size 2024-09-13T02:53:00.981 INFO:tasks.workunit.client.0.smithi098.stdout:1/727: rename d9/d33/d19/d35/d68/d2f/dbf/l81 to d9/d33/d19/d35/d68/d4d/db5/l109 0 2024-09-13T02:53:00.984 INFO:tasks.workunit.client.0.smithi098.stdout:9/642: rename d2/d6/d36/d8d/fca to d2/d6/d36/fea 0 2024-09-13T02:53:00.985 INFO:tasks.workunit.client.0.smithi098.stdout:9/643: dread - d2/d6/d2b/d4d/d4f/d6c/dd4/dac/fb5 zero size 2024-09-13T02:53:00.988 INFO:tasks.workunit.client.0.smithi098.stdout:5/565: link d0/d15/d17/daa/fb8 d0/d38/d3f/d81/d4d/d82/d9a/fc4 0 2024-09-13T02:53:00.996 INFO:tasks.workunit.client.0.smithi098.stdout:1/728: getdents d9/d33/d29/d58 0 2024-09-13T02:53:00.997 INFO:tasks.workunit.client.0.smithi098.stdout:9/644: link d2/d6/d2b/d4d/d4f/d6c/dd4/d43/f50 d2/d6/d2b/d4d/d56/db9/feb 0 2024-09-13T02:53:01.001 INFO:tasks.workunit.client.0.smithi098.stdout:1/729: dwrite d9/d33/d19/f21 [0,4194304] 0 2024-09-13T02:53:01.001 INFO:tasks.workunit.client.0.smithi098.stdout:9/645: fsync d2/f57 0 2024-09-13T02:53:01.006 INFO:tasks.workunit.client.0.smithi098.stdout:9/646: mknod d2/db1/dc5/cec 0 2024-09-13T02:53:01.008 INFO:tasks.workunit.client.0.smithi098.stdout:5/566: write d0/d38/d3f/f5b [1199586,108516] 0 2024-09-13T02:53:01.009 INFO:tasks.workunit.client.0.smithi098.stdout:1/730: mkdir d9/d33/d19/d35/d10a 0 2024-09-13T02:53:01.010 INFO:tasks.workunit.client.0.smithi098.stdout:1/731: write d9/d33/d19/f21 [659021,16370] 0 2024-09-13T02:53:01.016 INFO:tasks.workunit.client.0.smithi098.stdout:5/567: dwrite d0/fa9 [0,4194304] 0 2024-09-13T02:53:01.017 INFO:tasks.workunit.client.0.smithi098.stdout:9/647: fdatasync d2/d6/d2b/d4d/d56/db9/feb 0 2024-09-13T02:53:01.020 INFO:tasks.workunit.client.0.smithi098.stdout:9/648: stat d2/f98 0 2024-09-13T02:53:01.022 INFO:tasks.workunit.client.0.smithi098.stdout:1/732: dwrite d9/d33/d19/d35/d68/d2f/f3e [0,4194304] 0 2024-09-13T02:53:01.030 INFO:tasks.workunit.client.0.smithi098.stdout:5/568: dwrite d0/d15/d17/d1c/f6c [0,4194304] 0 2024-09-13T02:53:01.031 INFO:tasks.workunit.client.0.smithi098.stdout:5/569: chown d0/c40 0 1 2024-09-13T02:53:01.037 INFO:tasks.workunit.client.0.smithi098.stdout:5/570: rename d0/d15/d17/d1c/d3d/fbd to d0/d38/d3f/fc5 0 2024-09-13T02:53:01.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/571: rename d0/d15/d17/f44 to d0/d15/d17/daa/dab/fc6 0 2024-09-13T02:53:01.045 INFO:tasks.workunit.client.0.smithi098.stdout:5/572: truncate d0/d29/f39 5246372 0 2024-09-13T02:53:01.047 INFO:tasks.workunit.client.0.smithi098.stdout:9/649: dwrite d2/d6/d2b/f31 [0,4194304] 0 2024-09-13T02:53:01.048 INFO:tasks.workunit.client.0.smithi098.stdout:9/650: readlink d2/d6/d36/da7/lae 0 2024-09-13T02:53:01.049 INFO:tasks.workunit.client.0.smithi098.stdout:5/573: rmdir d0/d38/d3f/d81/d4d/d82/d9a 39 2024-09-13T02:53:01.054 INFO:tasks.workunit.client.0.smithi098.stdout:1/733: dread d9/d33/d19/d46/f4a [0,4194304] 0 2024-09-13T02:53:01.055 INFO:tasks.workunit.client.0.smithi098.stdout:1/734: fsync d9/d33/d19/d35/d68/d2f/f3e 0 2024-09-13T02:53:01.056 INFO:tasks.workunit.client.0.smithi098.stdout:9/651: unlink d2/d6/d2b/f47 0 2024-09-13T02:53:01.057 INFO:tasks.workunit.client.0.smithi098.stdout:9/652: chown d2/d6/d2b/d66/l67 420445891 1 2024-09-13T02:53:01.064 INFO:tasks.workunit.client.0.smithi098.stdout:9/653: getdents d2/d6/d2b/d4d/dcf 0 2024-09-13T02:53:01.066 INFO:tasks.workunit.client.0.smithi098.stdout:9/654: mkdir d2/d6/d36/ded 0 2024-09-13T02:53:01.066 INFO:tasks.workunit.client.0.smithi098.stdout:9/655: fdatasync d2/f32 0 2024-09-13T02:53:01.076 INFO:tasks.workunit.client.0.smithi098.stdout:5/574: dwrite d0/d15/d50/f6d [0,4194304] 0 2024-09-13T02:53:01.078 INFO:tasks.workunit.client.0.smithi098.stdout:5/575: chown d0/d29/f2c 11 1 2024-09-13T02:53:01.081 INFO:tasks.workunit.client.0.smithi098.stdout:1/735: dwrite d9/d33/d29/d58/f82 [0,4194304] 0 2024-09-13T02:53:01.085 INFO:tasks.workunit.client.0.smithi098.stdout:5/576: unlink d0/d38/d3f/f36 0 2024-09-13T02:53:01.086 INFO:tasks.workunit.client.0.smithi098.stdout:9/656: truncate d2/d6/d36/d6a/f7d 3769526 0 2024-09-13T02:53:01.087 INFO:tasks.workunit.client.0.smithi098.stdout:9/657: chown d2/d6/d2b/d4d/d4f/cde 1764842 1 2024-09-13T02:53:01.096 INFO:tasks.workunit.client.0.smithi098.stdout:1/736: creat d9/d33/d19/d35/d68/d2f/f10b x:0 0 0 2024-09-13T02:53:01.098 INFO:tasks.workunit.client.0.smithi098.stdout:5/577: truncate d0/d38/d3f/d81/f33 702974 0 2024-09-13T02:53:01.099 INFO:tasks.workunit.client.0.smithi098.stdout:5/578: stat d0/d38/d3f/d81/d4d/c65 0 2024-09-13T02:53:01.099 INFO:tasks.workunit.client.0.smithi098.stdout:1/737: creat d9/d33/d19/d35/d68/d4d/db5/dcb/f10c x:0 0 0 2024-09-13T02:53:01.101 INFO:tasks.workunit.client.0.smithi098.stdout:1/738: write d9/d33/d19/d35/d68/d4d/dbc/d6b/fe5 [370362,875] 0 2024-09-13T02:53:01.101 INFO:tasks.workunit.client.0.smithi098.stdout:5/579: unlink d0/d15/d69/f8e 0 2024-09-13T02:53:01.102 INFO:tasks.workunit.client.0.smithi098.stdout:1/739: stat d9/d33/d29/d58/ld8 0 2024-09-13T02:53:01.104 INFO:tasks.workunit.client.0.smithi098.stdout:5/580: mknod d0/d38/d3f/d81/cc7 0 2024-09-13T02:53:01.106 INFO:tasks.workunit.client.0.smithi098.stdout:1/740: unlink d9/d33/d19/d35/d68/d2f/f3e 0 2024-09-13T02:53:01.108 INFO:tasks.workunit.client.0.smithi098.stdout:5/581: symlink d0/d15/d17/d1c/d3d/lc8 0 2024-09-13T02:53:01.117 INFO:tasks.workunit.client.0.smithi098.stdout:5/582: creat d0/d38/d3f/d81/d4d/d82/fc9 x:0 0 0 2024-09-13T02:53:01.117 INFO:tasks.workunit.client.0.smithi098.stdout:9/658: dwrite d2/d6/d2b/d4d/d4f/d6c/dd4/f45 [0,4194304] 0 2024-09-13T02:53:01.118 INFO:tasks.workunit.client.0.smithi098.stdout:5/583: write d0/d38/d3f/f84 [1540064,36846] 0 2024-09-13T02:53:01.131 INFO:tasks.workunit.client.0.smithi098.stdout:9/659: truncate d2/d6/d36/f58 3199008 0 2024-09-13T02:53:01.133 INFO:tasks.workunit.client.0.smithi098.stdout:5/584: creat d0/d38/d3f/d81/d4d/d82/d9a/fca x:0 0 0 2024-09-13T02:53:01.135 INFO:tasks.workunit.client.0.smithi098.stdout:5/585: fdatasync d0/d38/d3f/f73 0 2024-09-13T02:53:01.140 INFO:tasks.workunit.client.0.smithi098.stdout:5/586: link d0/l64 d0/d38/d3f/d81/d4d/lcb 0 2024-09-13T02:53:01.140 INFO:tasks.workunit.client.0.smithi098.stdout:5/587: chown d0/d15/d17/daa 0 1 2024-09-13T02:53:01.143 INFO:tasks.workunit.client.0.smithi098.stdout:5/588: creat d0/d15/d17/daa/fcc x:0 0 0 2024-09-13T02:53:01.144 INFO:tasks.workunit.client.0.smithi098.stdout:5/589: write d0/d15/d17/d1c/fa2 [171912,95906] 0 2024-09-13T02:53:01.150 INFO:tasks.workunit.client.0.smithi098.stdout:5/590: creat d0/d15/d17/daa/fcd x:0 0 0 2024-09-13T02:53:01.153 INFO:tasks.workunit.client.0.smithi098.stdout:5/591: read d0/f37 [1605858,124743] 0 2024-09-13T02:53:01.155 INFO:tasks.workunit.client.0.smithi098.stdout:9/660: dwrite d2/d6/d2b/d4d/d4f/d6c/dd4/f3e [0,4194304] 0 2024-09-13T02:53:01.160 INFO:tasks.workunit.client.0.smithi098.stdout:9/661: creat d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/fee x:0 0 0 2024-09-13T02:53:01.169 INFO:tasks.workunit.client.0.smithi098.stdout:5/592: dread d0/d15/d17/d1c/d3d/f47 [4194304,4194304] 0 2024-09-13T02:53:01.172 INFO:tasks.workunit.client.0.smithi098.stdout:9/662: dwrite d2/d6/d36/d8d/f30 [0,4194304] 0 2024-09-13T02:53:01.174 INFO:tasks.workunit.client.0.smithi098.stdout:5/593: unlink d0/d38/d3f/c42 0 2024-09-13T02:53:01.174 INFO:tasks.workunit.client.0.smithi098.stdout:9/663: chown d2/d6/d2b/d4d/d56/fbd 98 1 2024-09-13T02:53:01.179 INFO:tasks.workunit.client.0.smithi098.stdout:9/664: creat d2/d6/d2b/d4d/fef x:0 0 0 2024-09-13T02:53:01.182 INFO:tasks.workunit.client.0.smithi098.stdout:5/594: link d0/d15/f3a d0/d57/fce 0 2024-09-13T02:53:01.185 INFO:tasks.workunit.client.0.smithi098.stdout:9/665: dwrite d2/d6/d2b/f31 [0,4194304] 0 2024-09-13T02:53:01.188 INFO:tasks.workunit.client.0.smithi098.stdout:9/666: fdatasync d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/fb3 0 2024-09-13T02:53:01.190 INFO:tasks.workunit.client.0.smithi098.stdout:5/595: rename d0/d15/d50/c77 to d0/d38/d3f/d81/d4d/d82/ccf 0 2024-09-13T02:53:01.190 INFO:tasks.workunit.client.0.smithi098.stdout:9/667: symlink d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/lf0 0 2024-09-13T02:53:01.192 INFO:tasks.workunit.client.0.smithi098.stdout:5/596: rename d0/d15/d17/d1c/caf to d0/d15/d69/cd0 0 2024-09-13T02:53:01.197 INFO:tasks.workunit.client.0.smithi098.stdout:9/668: mkdir d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/df1 0 2024-09-13T02:53:01.219 INFO:tasks.workunit.client.0.smithi098.stdout:5/597: mknod d0/d38/dc3/cd1 0 2024-09-13T02:53:01.220 INFO:tasks.workunit.client.0.smithi098.stdout:9/669: symlink d2/d6/d2b/d4d/d4f/d6c/dc0/lf2 0 2024-09-13T02:53:01.222 INFO:tasks.workunit.client.0.smithi098.stdout:5/598: creat d0/d15/d69/fd2 x:0 0 0 2024-09-13T02:53:01.224 INFO:tasks.workunit.client.0.smithi098.stdout:5/599: read d0/d15/d50/f8c [2604411,86426] 0 2024-09-13T02:53:01.225 INFO:tasks.workunit.client.0.smithi098.stdout:9/670: rename d2/f69 to d2/d6/d2b/d4d/ff3 0 2024-09-13T02:53:01.229 INFO:tasks.workunit.client.0.smithi098.stdout:5/600: mkdir d0/d15/d50/dd3 0 2024-09-13T02:53:01.230 INFO:tasks.workunit.client.0.smithi098.stdout:9/671: symlink d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/df1/lf4 0 2024-09-13T02:53:01.231 INFO:tasks.workunit.client.0.smithi098.stdout:9/672: chown d2/d6/d2b/d4d/d4f/d6c/dd4/f45 89646 1 2024-09-13T02:53:01.232 INFO:tasks.workunit.client.0.smithi098.stdout:5/601: mkdir d0/d38/d3f/d81/d9e/dd4 0 2024-09-13T02:53:01.238 INFO:tasks.workunit.client.0.smithi098.stdout:5/602: link d0/fa9 d0/d29/fd5 0 2024-09-13T02:53:01.240 INFO:tasks.workunit.client.0.smithi098.stdout:5/603: mkdir d0/d15/d17/d1c/dd6 0 2024-09-13T02:53:01.242 INFO:tasks.workunit.client.0.smithi098.stdout:5/604: creat d0/d38/d3f/d81/d9e/dd4/fd7 x:0 0 0 2024-09-13T02:53:01.258 INFO:tasks.workunit.client.0.smithi098.stdout:5/605: dread d0/d29/f39 [0,4194304] 0 2024-09-13T02:53:01.260 INFO:tasks.workunit.client.0.smithi098.stdout:5/606: creat d0/d15/d69/fd8 x:0 0 0 2024-09-13T02:53:01.263 INFO:tasks.workunit.client.0.smithi098.stdout:9/673: dwrite d2/d6/d2b/d4d/d4f/d6c/dd4/dac/fb5 [0,4194304] 0 2024-09-13T02:53:01.265 INFO:tasks.workunit.client.0.smithi098.stdout:5/607: symlink d0/ld9 0 2024-09-13T02:53:01.281 INFO:tasks.workunit.client.0.smithi098.stdout:9/674: getdents d2/d6/d36/d8d 0 2024-09-13T02:53:01.282 INFO:tasks.workunit.client.0.smithi098.stdout:9/675: truncate d2/d6/d2b/d4d/d4f/d6c/f79 934219 0 2024-09-13T02:53:01.293 INFO:tasks.workunit.client.0.smithi098.stdout:5/608: truncate d0/f4e 782541 0 2024-09-13T02:53:01.298 INFO:tasks.workunit.client.0.smithi098.stdout:9/676: write d2/d6/d36/d8d/f30 [4672699,128850] 0 2024-09-13T02:53:01.299 INFO:tasks.workunit.client.0.smithi098.stdout:5/609: mknod d0/d15/d17/d1c/dd6/cda 0 2024-09-13T02:53:01.301 INFO:tasks.workunit.client.0.smithi098.stdout:5/610: rename d0/d38/d3f/fb6 to d0/d38/d3f/fdb 0 2024-09-13T02:53:01.302 INFO:tasks.workunit.client.0.smithi098.stdout:5/611: dread - d0/d15/da4/fb5 zero size 2024-09-13T02:53:01.304 INFO:tasks.workunit.client.0.smithi098.stdout:5/612: truncate d0/d38/d3f/d81/d9e/dd4/fd7 190629 0 2024-09-13T02:53:01.305 INFO:tasks.workunit.client.0.smithi098.stdout:5/613: fdatasync d0/d15/d17/d1c/f6c 0 2024-09-13T02:53:01.307 INFO:tasks.workunit.client.0.smithi098.stdout:9/677: link d2/d6/d2b/d4d/d4f/d6c/dd4/l41 d2/d6/d2b/d4d/d56/db9/lf5 0 2024-09-13T02:53:01.307 INFO:tasks.workunit.client.0.smithi098.stdout:9/678: chown d2/d6/l16 6912523 1 2024-09-13T02:53:01.308 INFO:tasks.workunit.client.0.smithi098.stdout:9/679: fdatasync d2/d6/d2b/d4d/d4f/d6c/dd4/dac/dd9/fe7 0 2024-09-13T02:53:01.309 INFO:tasks.workunit.client.0.smithi098.stdout:5/614: truncate d0/f37 616537 0 2024-09-13T02:53:01.311 INFO:tasks.workunit.client.0.smithi098.stdout:2/583: sync 2024-09-13T02:53:01.312 INFO:tasks.workunit.client.0.smithi098.stdout:9/680: symlink d2/d6/d36/d8d/dc8/lf6 0 2024-09-13T02:53:01.313 INFO:tasks.workunit.client.0.smithi098.stdout:9/681: chown d2/d6/d36/d6a/f6b 7712392 1 2024-09-13T02:53:01.314 INFO:tasks.workunit.client.0.smithi098.stdout:5/615: symlink d0/d38/d3f/d81/d4d/d82/ldc 0 2024-09-13T02:53:01.315 INFO:tasks.workunit.client.0.smithi098.stdout:2/584: creat d1/d1a/d4f/d59/d9e/d9f/fbf x:0 0 0 2024-09-13T02:53:01.316 INFO:tasks.workunit.client.0.smithi098.stdout:2/585: fdatasync d1/d1a/d4f/d7f/fae 0 2024-09-13T02:53:01.319 INFO:tasks.workunit.client.0.smithi098.stdout:5/616: symlink d0/d38/d3f/d1a/d27/ldd 0 2024-09-13T02:53:01.319 INFO:tasks.workunit.client.0.smithi098.stdout:5/617: chown d0/d7c/l8a 6123943 1 2024-09-13T02:53:01.319 INFO:tasks.workunit.client.0.smithi098.stdout:5/618: write d0/d38/d3f/fac [212894,46278] 0 2024-09-13T02:53:01.330 INFO:tasks.workunit.client.0.smithi098.stdout:5/619: mkdir d0/d15/da4/dde 0 2024-09-13T02:53:01.333 INFO:tasks.workunit.client.0.smithi098.stdout:2/586: creat d1/d1a/fc0 x:0 0 0 2024-09-13T02:53:01.334 INFO:tasks.workunit.client.0.smithi098.stdout:2/587: chown d1/d1f/d35/d63/f9a 99 1 2024-09-13T02:53:01.340 INFO:tasks.workunit.client.0.smithi098.stdout:2/588: dwrite d1/d1a/fc0 [0,4194304] 0 2024-09-13T02:53:01.341 INFO:tasks.workunit.client.0.smithi098.stdout:2/589: stat d1/d1f/d35/d63/d72/f75 0 2024-09-13T02:53:01.347 INFO:tasks.workunit.client.0.smithi098.stdout:9/682: truncate d2/d6/d2b/d4d/ff3 4587139 0 2024-09-13T02:53:01.348 INFO:tasks.workunit.client.0.smithi098.stdout:9/683: write d2/d6/f8b [4625432,114783] 0 2024-09-13T02:53:01.349 INFO:tasks.workunit.client.0.smithi098.stdout:2/590: mkdir d1/d1a/d4f/d59/d9e/d9f/dc1 0 2024-09-13T02:53:01.349 INFO:tasks.workunit.client.0.smithi098.stdout:9/684: chown d2/d6/d2b/d4d/d4f/d6c/dd4/f5a 28 1 2024-09-13T02:53:01.351 INFO:tasks.workunit.client.0.smithi098.stdout:5/620: link d0/d38/d3f/d1a/f67 d0/d15/da4/fdf 0 2024-09-13T02:53:01.355 INFO:tasks.workunit.client.0.smithi098.stdout:2/591: truncate d1/d1f/d39/fba 462270 0 2024-09-13T02:53:01.355 INFO:tasks.workunit.client.0.smithi098.stdout:2/592: fdatasync d1/fa6 0 2024-09-13T02:53:01.361 INFO:tasks.workunit.client.0.smithi098.stdout:2/593: dwrite d1/d1a/d9/d1e/d5a/f5f [0,4194304] 0 2024-09-13T02:53:01.373 INFO:tasks.workunit.client.0.smithi098.stdout:2/594: unlink d1/d1f/fa4 0 2024-09-13T02:53:01.386 INFO:tasks.workunit.client.0.smithi098.stdout:5/621: dwrite d0/fa9 [0,4194304] 0 2024-09-13T02:53:01.392 INFO:tasks.workunit.client.0.smithi098.stdout:5/622: rmdir d0/d15/d17/d1c 39 2024-09-13T02:53:01.394 INFO:tasks.workunit.client.0.smithi098.stdout:2/595: dread d1/f48 [0,4194304] 0 2024-09-13T02:53:01.397 INFO:tasks.workunit.client.0.smithi098.stdout:5/623: readlink d0/d15/d17/daa/dab/lc2 0 2024-09-13T02:53:01.409 INFO:tasks.workunit.client.0.smithi098.stdout:5/624: rename d0/d15/d17/d1c/f9c to d0/d29/fe0 0 2024-09-13T02:53:01.415 INFO:tasks.workunit.client.0.smithi098.stdout:5/625: truncate d0/d57/f91 617361 0 2024-09-13T02:53:01.418 INFO:tasks.workunit.client.0.smithi098.stdout:5/626: dread - d0/d15/da4/db1/fba zero size 2024-09-13T02:53:01.427 INFO:tasks.workunit.client.0.smithi098.stdout:2/596: write d1/d1f/d27/f61 [1317347,52848] 0 2024-09-13T02:53:01.432 INFO:tasks.workunit.client.0.smithi098.stdout:2/597: mknod d1/d1f/d35/cc2 0 2024-09-13T02:53:01.435 INFO:tasks.workunit.client.0.smithi098.stdout:2/598: chown d1/d1f/d39/l6f 54 1 2024-09-13T02:53:01.438 INFO:tasks.workunit.client.0.smithi098.stdout:2/599: creat d1/d1f/d36/fc3 x:0 0 0 2024-09-13T02:53:01.445 INFO:tasks.workunit.client.0.smithi098.stdout:5/627: dwrite d0/d15/d17/f26 [4194304,4194304] 0 2024-09-13T02:53:01.466 INFO:tasks.workunit.client.0.smithi098.stdout:2/600: dwrite d1/d1f/d35/d63/d72/f9d [0,4194304] 0 2024-09-13T02:53:01.468 INFO:tasks.workunit.client.0.smithi098.stdout:2/601: dread d1/d1f/d35/f45 [0,4194304] 0 2024-09-13T02:53:01.469 INFO:tasks.workunit.client.0.smithi098.stdout:2/602: chown d1/d1f/d35/d63/c38 2 1 2024-09-13T02:53:01.475 INFO:tasks.workunit.client.0.smithi098.stdout:2/603: mknod d1/d1f/d27/cc4 0 2024-09-13T02:53:01.476 INFO:tasks.workunit.client.0.smithi098.stdout:2/604: chown d1/d1a/d9/d1e/d5a/l5b 240097 1 2024-09-13T02:53:01.479 INFO:tasks.workunit.client.0.smithi098.stdout:2/605: unlink d1/d1f/d36/fc3 0 2024-09-13T02:53:01.482 INFO:tasks.workunit.client.0.smithi098.stdout:2/606: symlink d1/d1a/d4f/d59/d9e/lc5 0 2024-09-13T02:53:01.503 INFO:tasks.workunit.client.0.smithi098.stdout:2/607: truncate d1/d1f/d36/f52 2179341 0 2024-09-13T02:53:01.509 INFO:tasks.workunit.client.0.smithi098.stdout:2/608: dwrite d1/f97 [0,4194304] 0 2024-09-13T02:53:01.511 INFO:tasks.workunit.client.0.smithi098.stdout:2/609: stat d1/d1f/d35/d63/d72/f78 0 2024-09-13T02:53:01.516 INFO:tasks.workunit.client.0.smithi098.stdout:2/610: rmdir d1/d1f/d35/d63 39 2024-09-13T02:53:01.518 INFO:tasks.workunit.client.0.smithi098.stdout:2/611: mknod d1/d1f/d30/cc6 0 2024-09-13T02:53:01.519 INFO:tasks.workunit.client.0.smithi098.stdout:2/612: read d1/d1f/f42 [3886711,75728] 0 2024-09-13T02:53:01.520 INFO:tasks.workunit.client.0.smithi098.stdout:2/613: chown d1/d1f/d39/f29 669991 1 2024-09-13T02:53:01.521 INFO:tasks.workunit.client.0.smithi098.stdout:2/614: chown d1/d1a/d4f 4 1 2024-09-13T02:53:01.521 INFO:tasks.workunit.client.0.smithi098.stdout:2/615: chown d1/d1f/d39/l6f 889791863 1 2024-09-13T02:53:01.524 INFO:tasks.workunit.client.0.smithi098.stdout:2/616: mknod d1/d1a/d4f/d59/d9e/cc7 0 2024-09-13T02:53:01.531 INFO:tasks.workunit.client.0.smithi098.stdout:2/617: creat d1/d1a/fc8 x:0 0 0 2024-09-13T02:53:01.533 INFO:tasks.workunit.client.0.smithi098.stdout:2/618: readlink d1/d1f/d35/d63/d72/lab 0 2024-09-13T02:53:01.534 INFO:tasks.workunit.client.0.smithi098.stdout:2/619: readlink d1/d1f/d35/d63/d72/lab 0 2024-09-13T02:53:01.536 INFO:tasks.workunit.client.0.smithi098.stdout:2/620: mknod d1/d1a/d9/d1e/cc9 0 2024-09-13T02:53:01.540 INFO:tasks.workunit.client.0.smithi098.stdout:2/621: dread - d1/d1a/d4f/d59/d9e/d9f/fbf zero size 2024-09-13T02:53:01.550 INFO:tasks.workunit.client.0.smithi098.stdout:2/622: getdents d1/d1a/d4f/d59/d9e 0 2024-09-13T02:53:01.551 INFO:tasks.workunit.client.0.smithi098.stdout:2/623: chown d1/d1f/d35/d63/d23/f28 7 1 2024-09-13T02:53:01.557 INFO:tasks.workunit.client.0.smithi098.stdout:2/624: dwrite d1/d1a/d9/d1e/d5a/f86 [0,4194304] 0 2024-09-13T02:53:01.568 INFO:tasks.workunit.client.0.smithi098.stdout:2/625: link d1/d1a/d4f/cbb d1/d1f/d35/d63/d23/cca 0 2024-09-13T02:53:01.569 INFO:tasks.workunit.client.0.smithi098.stdout:2/626: chown d1/d1a/d4f/d7f/f85 10726 1 2024-09-13T02:53:01.570 INFO:tasks.workunit.client.0.smithi098.stdout:2/627: write d1/d1a/fc0 [151981,122425] 0 2024-09-13T02:53:01.857 INFO:tasks.workunit.client.0.smithi098.stdout:7/738: sync 2024-09-13T02:53:01.861 INFO:tasks.workunit.client.0.smithi098.stdout:7/739: creat d6/d24/d2a/d57/ff3 x:0 0 0 2024-09-13T02:53:01.865 INFO:tasks.workunit.client.0.smithi098.stdout:7/740: chown d6/d24/d2a/d5a/d86/d65/ca6 268 1 2024-09-13T02:53:01.872 INFO:tasks.workunit.client.0.smithi098.stdout:7/741: rename d6/d24/d2a/d5a/d86/fbe to d6/d24/d2a/d5a/d8e/df0/ff4 0 2024-09-13T02:53:01.919 INFO:tasks.workunit.client.0.smithi098.stdout:7/742: dwrite d6/d24/d2a/d5a/f2b [4194304,4194304] 0 2024-09-13T02:53:02.096 INFO:tasks.workunit.client.0.smithi098.stdout:7/743: write d6/ff [2972003,33236] 0 2024-09-13T02:53:02.097 INFO:tasks.workunit.client.0.smithi098.stdout:7/744: readlink d6/d24/d2a/d5a/d86/d65/la9 0 2024-09-13T02:53:02.098 INFO:tasks.workunit.client.0.smithi098.stdout:7/745: fsync d6/d47/fb7 0 2024-09-13T02:53:02.102 INFO:tasks.workunit.client.0.smithi098.stdout:7/746: mkdir d6/d24/d2a/d5a/d86/d65/df5 0 2024-09-13T02:53:02.114 INFO:tasks.workunit.client.0.smithi098.stdout:7/747: dwrite d6/d24/d63/fd2 [0,4194304] 0 2024-09-13T02:53:02.119 INFO:tasks.workunit.client.0.smithi098.stdout:7/748: dread d6/d24/f26 [0,4194304] 0 2024-09-13T02:53:02.119 INFO:tasks.workunit.client.0.smithi098.stdout:7/749: chown d6/d24/d46/fc4 983101 1 2024-09-13T02:53:02.124 INFO:tasks.workunit.client.0.smithi098.stdout:7/750: mkdir d6/df6 0 2024-09-13T02:53:02.127 INFO:tasks.workunit.client.0.smithi098.stdout:7/751: mkdir d6/d24/d2a/df7 0 2024-09-13T02:53:02.133 INFO:tasks.workunit.client.0.smithi098.stdout:7/752: dwrite d6/d24/d2a/d57/faa [4194304,4194304] 0 2024-09-13T02:53:02.143 INFO:tasks.workunit.client.0.smithi098.stdout:7/753: write d6/d24/d2a/d5a/d86/d65/f6f [937755,77539] 0 2024-09-13T02:53:02.151 INFO:tasks.workunit.client.0.smithi098.stdout:7/754: write d6/d1e/f99 [715720,92861] 0 2024-09-13T02:53:02.157 INFO:tasks.workunit.client.0.smithi098.stdout:7/755: mkdir d6/d24/d2a/d5a/d86/db1/dc2/df8 0 2024-09-13T02:53:02.175 INFO:tasks.workunit.client.0.smithi098.stdout:8/620: sync 2024-09-13T02:53:02.175 INFO:tasks.workunit.client.0.smithi098.stdout:4/636: sync 2024-09-13T02:53:02.177 INFO:tasks.workunit.client.0.smithi098.stdout:7/756: dwrite d6/d1e/fa2 [0,4194304] 0 2024-09-13T02:53:02.177 INFO:tasks.workunit.client.0.smithi098.stdout:7/757: stat l2 0 2024-09-13T02:53:02.178 INFO:tasks.workunit.client.0.smithi098.stdout:7/758: readlink d6/d47/la0 0 2024-09-13T02:53:02.184 INFO:tasks.workunit.client.0.smithi098.stdout:4/637: dwrite d6/d22/f63 [4194304,4194304] 0 2024-09-13T02:53:02.193 INFO:tasks.workunit.client.0.smithi098.stdout:4/638: dread d6/d10/d21/f32 [0,4194304] 0 2024-09-13T02:53:02.193 INFO:tasks.workunit.client.0.smithi098.stdout:8/621: rename d2/d2f/f5b to d2/dd/d11/fc3 0 2024-09-13T02:53:02.196 INFO:tasks.workunit.client.0.smithi098.stdout:4/639: dread d6/d10/d21/f32 [0,4194304] 0 2024-09-13T02:53:02.201 INFO:tasks.workunit.client.0.smithi098.stdout:7/759: dwrite d6/d24/d2a/d5a/fc8 [0,4194304] 0 2024-09-13T02:53:02.227 INFO:tasks.workunit.client.0.smithi098.stdout:4/640: dread d6/d3e/d68/f38 [0,4194304] 0 2024-09-13T02:53:02.228 INFO:tasks.workunit.client.0.smithi098.stdout:4/641: stat d6/d22/d3d/d41/d74 0 2024-09-13T02:53:02.243 INFO:tasks.workunit.client.0.smithi098.stdout:4/642: dread - d6/d22/d3d/d41/d58/faa zero size 2024-09-13T02:53:02.243 INFO:tasks.workunit.client.0.smithi098.stdout:7/760: getdents d6/d24/d2a/d57/d88/da4 0 2024-09-13T02:53:02.244 INFO:tasks.workunit.client.0.smithi098.stdout:7/761: chown d6/d24/c25 115494293 1 2024-09-13T02:53:02.252 INFO:tasks.workunit.client.0.smithi098.stdout:4/643: dwrite d6/d37/d7a/f89 [0,4194304] 0 2024-09-13T02:53:02.253 INFO:tasks.workunit.client.0.smithi098.stdout:7/762: mkdir d6/df9 0 2024-09-13T02:53:02.257 INFO:tasks.workunit.client.0.smithi098.stdout:7/763: creat d6/d24/d2a/d5a/d8e/df0/ffa x:0 0 0 2024-09-13T02:53:02.265 INFO:tasks.workunit.client.0.smithi098.stdout:7/764: mknod d6/d24/dc5/de3/ddf/cfb 0 2024-09-13T02:53:02.272 INFO:tasks.workunit.client.0.smithi098.stdout:0/637: sync 2024-09-13T02:53:02.272 INFO:tasks.workunit.client.0.smithi098.stdout:3/590: sync 2024-09-13T02:53:02.272 INFO:tasks.workunit.client.0.smithi098.stdout:1/741: sync 2024-09-13T02:53:02.272 INFO:tasks.workunit.client.0.smithi098.stdout:2/628: sync 2024-09-13T02:53:02.272 INFO:tasks.workunit.client.0.smithi098.stdout:5/628: sync 2024-09-13T02:53:02.272 INFO:tasks.workunit.client.0.smithi098.stdout:9/685: sync 2024-09-13T02:53:02.272 INFO:tasks.workunit.client.0.smithi098.stdout:6/580: sync 2024-09-13T02:53:02.276 INFO:tasks.workunit.client.0.smithi098.stdout:2/629: truncate d1/d1a/d4f/d7f/f7a 343371 0 2024-09-13T02:53:02.276 INFO:tasks.workunit.client.0.smithi098.stdout:1/742: chown d9/d33/d19/d35/d68/d2f/l90 62 1 2024-09-13T02:53:02.279 INFO:tasks.workunit.client.0.smithi098.stdout:5/629: truncate d0/d15/da4/db1/fbc 319340 0 2024-09-13T02:53:02.280 INFO:tasks.workunit.client.0.smithi098.stdout:1/743: stat d9/d33/de6/d61/db1/fc4 0 2024-09-13T02:53:02.280 INFO:tasks.workunit.client.0.smithi098.stdout:5/630: write d0/d38/d3f/f84 [350677,32088] 0 2024-09-13T02:53:02.284 INFO:tasks.workunit.client.0.smithi098.stdout:3/591: stat d7/d9/d15/d2d/cb9 0 2024-09-13T02:53:02.284 INFO:tasks.workunit.client.0.smithi098.stdout:3/592: chown d7/d9/l2e 7 1 2024-09-13T02:53:02.288 INFO:tasks.workunit.client.0.smithi098.stdout:2/630: read d1/d1f/d39/fba [457466,18493] 0 2024-09-13T02:53:02.290 INFO:tasks.workunit.client.0.smithi098.stdout:2/631: write d1/d1a/fc0 [769755,97732] 0 2024-09-13T02:53:02.291 INFO:tasks.workunit.client.0.smithi098.stdout:2/632: write d1/d1f/d27/f61 [2325124,122579] 0 2024-09-13T02:53:02.294 INFO:tasks.workunit.client.0.smithi098.stdout:2/633: readlink d1/d1f/d35/d63/d72/lab 0 2024-09-13T02:53:02.296 INFO:tasks.workunit.client.0.smithi098.stdout:8/622: truncate d2/dd/d11/f16 84921 0 2024-09-13T02:53:02.298 INFO:tasks.workunit.client.0.smithi098.stdout:8/623: chown d2/dd/d11/c37 430 1 2024-09-13T02:53:02.299 INFO:tasks.workunit.client.0.smithi098.stdout:8/624: chown d2/dd/d11/d2c/l48 1 1 2024-09-13T02:53:02.300 INFO:tasks.workunit.client.0.smithi098.stdout:2/634: dwrite d1/f48 [0,4194304] 0 2024-09-13T02:53:02.303 INFO:tasks.workunit.client.0.smithi098.stdout:9/686: link d2/d6/d2b/d4d/d56/fbd d2/d6/d36/da7/de5/ff7 0 2024-09-13T02:53:02.305 INFO:tasks.workunit.client.0.smithi098.stdout:3/593: creat d7/d9/d15/d5d/fba x:0 0 0 2024-09-13T02:53:02.306 INFO:tasks.workunit.client.0.smithi098.stdout:3/594: write d7/d9/d25/d64/d6f/f83 [54334,53281] 0 2024-09-13T02:53:02.310 INFO:tasks.workunit.client.0.smithi098.stdout:4/644: truncate d6/d3e/f59 7450770 0 2024-09-13T02:53:02.314 INFO:tasks.workunit.client.0.smithi098.stdout:5/631: mkdir d0/d15/d50/dd3/de1 0 2024-09-13T02:53:02.316 INFO:tasks.workunit.client.0.smithi098.stdout:7/765: write d6/fca [2227183,85719] 0 2024-09-13T02:53:02.322 INFO:tasks.workunit.client.0.smithi098.stdout:0/638: dwrite dd/fa4 [0,4194304] 0 2024-09-13T02:53:02.323 INFO:tasks.workunit.client.0.smithi098.stdout:2/635: rmdir d1/d1a/d4f/d59/d9e/d9f 39 2024-09-13T02:53:02.324 INFO:tasks.workunit.client.0.smithi098.stdout:6/581: write d5/f33 [2989748,94000] 0 2024-09-13T02:53:02.325 INFO:tasks.workunit.client.0.smithi098.stdout:0/639: readlink dd/df/d1d/d40/l68 0 2024-09-13T02:53:02.327 INFO:tasks.workunit.client.0.smithi098.stdout:9/687: mkdir d2/d6/d36/d8d/dc8/df8 0 2024-09-13T02:53:02.336 INFO:tasks.workunit.client.0.smithi098.stdout:4/645: write d6/d22/d3d/d64/d6f/fd6 [468837,89986] 0 2024-09-13T02:53:02.340 INFO:tasks.workunit.client.0.smithi098.stdout:3/595: dwrite d7/d9/d15/d2d/d5b/f9e [0,4194304] 0 2024-09-13T02:53:02.348 INFO:tasks.workunit.client.0.smithi098.stdout:4/646: dwrite d6/db/fb8 [0,4194304] 0 2024-09-13T02:53:02.356 INFO:tasks.workunit.client.0.smithi098.stdout:6/582: fsync d5/d18/f3c 0 2024-09-13T02:53:02.358 INFO:tasks.workunit.client.0.smithi098.stdout:0/640: read fc [6252575,126642] 0 2024-09-13T02:53:02.361 INFO:tasks.workunit.client.0.smithi098.stdout:4/647: dwrite d6/d22/d3d/d64/d6f/fd6 [0,4194304] 0 2024-09-13T02:53:02.374 INFO:tasks.workunit.client.0.smithi098.stdout:1/744: link d9/d33/d19/d35/d68/d4d/dbc/d6b/ce7 d9/d33/d19/d35/d68/c10d 0 2024-09-13T02:53:02.378 INFO:tasks.workunit.client.0.smithi098.stdout:3/596: truncate d7/d9/fa 62469 0 2024-09-13T02:53:02.383 INFO:tasks.workunit.client.0.smithi098.stdout:2/636: dread d1/d1a/f7 [0,4194304] 0 2024-09-13T02:53:02.388 INFO:tasks.workunit.client.0.smithi098.stdout:9/688: dread d2/d6/f42 [0,4194304] 0 2024-09-13T02:53:02.389 INFO:tasks.workunit.client.0.smithi098.stdout:1/745: read d9/d33/d19/d35/d63/f69 [2544059,108686] 0 2024-09-13T02:53:02.390 INFO:tasks.workunit.client.0.smithi098.stdout:8/625: rename d2/f41 to d2/dd/d2e/fc4 0 2024-09-13T02:53:02.391 INFO:tasks.workunit.client.0.smithi098.stdout:3/597: rmdir d7 39 2024-09-13T02:53:02.395 INFO:tasks.workunit.client.0.smithi098.stdout:2/637: rmdir d1/d1f/d35/d63/d23 39 2024-09-13T02:53:02.399 INFO:tasks.workunit.client.0.smithi098.stdout:0/641: symlink dd/ld2 0 2024-09-13T02:53:02.403 INFO:tasks.workunit.client.0.smithi098.stdout:6/583: dwrite d5/d13/d51/f54 [0,4194304] 0 2024-09-13T02:53:02.410 INFO:tasks.workunit.client.0.smithi098.stdout:2/638: creat d1/d1f/d35/d63/d72/d88/fcb x:0 0 0 2024-09-13T02:53:02.413 INFO:tasks.workunit.client.0.smithi098.stdout:1/746: symlink d9/d33/d19/d102/l10e 0 2024-09-13T02:53:02.420 INFO:tasks.workunit.client.0.smithi098.stdout:8/626: symlink d2/dd/lc5 0 2024-09-13T02:53:02.425 INFO:tasks.workunit.client.0.smithi098.stdout:3/598: unlink d7/c1f 0 2024-09-13T02:53:02.430 INFO:tasks.workunit.client.0.smithi098.stdout:1/747: rmdir d9/d33/d19/d64 39 2024-09-13T02:53:02.431 INFO:tasks.workunit.client.0.smithi098.stdout:1/748: chown d9/d33/d19/d35/d68/d2f/f49 3 1 2024-09-13T02:53:02.438 INFO:tasks.workunit.client.0.smithi098.stdout:3/599: mknod d7/cbb 0 2024-09-13T02:53:02.442 INFO:tasks.workunit.client.0.smithi098.stdout:1/749: chown d9/d33/d19/d35/d68/f18 18 1 2024-09-13T02:53:02.447 INFO:tasks.workunit.client.0.smithi098.stdout:6/584: creat d5/d13/d2b/d3a/d41/d6c/fcd x:0 0 0 2024-09-13T02:53:02.449 INFO:tasks.workunit.client.0.smithi098.stdout:9/689: getdents d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6 0 2024-09-13T02:53:02.453 INFO:tasks.workunit.client.0.smithi098.stdout:2/639: rename d1/d1f/d35/d63/d72/f93 to d1/d1a/fcc 0 2024-09-13T02:53:02.456 INFO:tasks.workunit.client.0.smithi098.stdout:6/585: dwrite d5/d36/f8e [0,4194304] 0 2024-09-13T02:53:02.458 INFO:tasks.workunit.client.0.smithi098.stdout:0/642: getdents dd/df/d1d/d26/d28/d32/d67 0 2024-09-13T02:53:02.459 INFO:tasks.workunit.client.0.smithi098.stdout:6/586: readlink d5/d13/d2b/d3a/d14/d6b/l9c 0 2024-09-13T02:53:02.460 INFO:tasks.workunit.client.0.smithi098.stdout:1/750: dread d9/d33/d19/d35/d63/f77 [0,4194304] 0 2024-09-13T02:53:02.463 INFO:tasks.workunit.client.0.smithi098.stdout:2/640: dwrite d1/d1a/d9/d1e/d5a/f5f [0,4194304] 0 2024-09-13T02:53:02.471 INFO:tasks.workunit.client.0.smithi098.stdout:2/641: dwrite d1/f8 [4194304,4194304] 0 2024-09-13T02:53:02.474 INFO:tasks.workunit.client.0.smithi098.stdout:1/751: fdatasync d9/f25 0 2024-09-13T02:53:02.481 INFO:tasks.workunit.client.0.smithi098.stdout:6/587: mkdir d5/d13/d2b/d3a/d41/d55/dce 0 2024-09-13T02:53:02.487 INFO:tasks.workunit.client.0.smithi098.stdout:3/600: link d7/d9/d15/d80/da0/la4 d7/d9/d15/d2d/d5b/d70/d90/lbc 0 2024-09-13T02:53:02.489 INFO:tasks.workunit.client.0.smithi098.stdout:2/642: creat d1/d1a/d4f/d59/fcd x:0 0 0 2024-09-13T02:53:02.493 INFO:tasks.workunit.client.0.smithi098.stdout:1/752: symlink d9/d33/d19/d35/d68/d4d/db5/db8/l10f 0 2024-09-13T02:53:02.496 INFO:tasks.workunit.client.0.smithi098.stdout:6/588: mkdir d5/d18/dcf 0 2024-09-13T02:53:02.497 INFO:tasks.workunit.client.0.smithi098.stdout:3/601: dread - d7/d9/d15/f7d zero size 2024-09-13T02:53:02.497 INFO:tasks.workunit.client.0.smithi098.stdout:6/589: write d5/d13/d51/f60 [4592685,102657] 0 2024-09-13T02:53:02.499 INFO:tasks.workunit.client.0.smithi098.stdout:3/602: truncate d7/d9/d15/d5d/fba 218605 0 2024-09-13T02:53:02.500 INFO:tasks.workunit.client.0.smithi098.stdout:2/643: creat d1/d1f/d30/fce x:0 0 0 2024-09-13T02:53:02.505 INFO:tasks.workunit.client.0.smithi098.stdout:6/590: dwrite d5/d36/f8e [0,4194304] 0 2024-09-13T02:53:02.507 INFO:tasks.workunit.client.0.smithi098.stdout:6/591: write d5/d36/f4f [2443092,39140] 0 2024-09-13T02:53:02.508 INFO:tasks.workunit.client.0.smithi098.stdout:3/603: symlink d7/d9/d15/d2d/d34/lbd 0 2024-09-13T02:53:02.511 INFO:tasks.workunit.client.0.smithi098.stdout:9/690: truncate d2/d6/f1d 11143777 0 2024-09-13T02:53:02.512 INFO:tasks.workunit.client.0.smithi098.stdout:6/592: symlink d5/d13/d67/ld0 0 2024-09-13T02:53:02.513 INFO:tasks.workunit.client.0.smithi098.stdout:3/604: readlink d7/d9/d15/l29 0 2024-09-13T02:53:02.513 INFO:tasks.workunit.client.0.smithi098.stdout:6/593: write d5/d18/d50/fc9 [391269,80002] 0 2024-09-13T02:53:02.515 INFO:tasks.workunit.client.0.smithi098.stdout:2/644: mknod d1/d1a/d4f/d59/d9e/ccf 0 2024-09-13T02:53:02.518 INFO:tasks.workunit.client.0.smithi098.stdout:3/605: symlink d7/d9/d15/d2d/d78/lbe 0 2024-09-13T02:53:02.610 INFO:tasks.workunit.client.0.smithi098.stdout:9/691: symlink d2/d6/lf9 0 2024-09-13T02:53:02.611 INFO:tasks.workunit.client.0.smithi098.stdout:1/753: write d9/d33/de6/f6d [1554826,111546] 0 2024-09-13T02:53:02.612 INFO:tasks.workunit.client.0.smithi098.stdout:2/645: link d1/d1a/d4f/d7f/f7a d1/d1a/d4f/d59/fd0 0 2024-09-13T02:53:02.613 INFO:tasks.workunit.client.0.smithi098.stdout:2/646: stat d1/d1f 0 2024-09-13T02:53:02.614 INFO:tasks.workunit.client.0.smithi098.stdout:9/692: rmdir d2/db1/dc5 39 2024-09-13T02:53:02.624 INFO:tasks.workunit.client.0.smithi098.stdout:2/647: write d1/d1a/d4f/d59/d9e/d9f/fa9 [1469163,61338] 0 2024-09-13T02:53:02.625 INFO:tasks.workunit.client.0.smithi098.stdout:2/648: write d1/d1a/fc0 [1610779,31862] 0 2024-09-13T02:53:02.626 INFO:tasks.workunit.client.0.smithi098.stdout:3/606: getdents d7/d9/d15/d2d/d34 0 2024-09-13T02:53:02.633 INFO:tasks.workunit.client.0.smithi098.stdout:1/754: dwrite d9/d33/d19/d35/fac [0,4194304] 0 2024-09-13T02:53:02.638 INFO:tasks.workunit.client.0.smithi098.stdout:9/693: write d2/d6/d2b/d4d/ff3 [3099351,22852] 0 2024-09-13T02:53:02.643 INFO:tasks.workunit.client.0.smithi098.stdout:2/649: link d1/d1a/d4f/d59/fcd d1/d1a/d4f/d7f/fd1 0 2024-09-13T02:53:02.645 INFO:tasks.workunit.client.0.smithi098.stdout:1/755: creat d9/d33/d19/d35/de1/f110 x:0 0 0 2024-09-13T02:53:02.648 INFO:tasks.workunit.client.0.smithi098.stdout:2/650: symlink d1/d1a/d9/d1e/ld2 0 2024-09-13T02:53:02.650 INFO:tasks.workunit.client.0.smithi098.stdout:3/607: getdents d7/d9/d25/d64/d6f 0 2024-09-13T02:53:02.651 INFO:tasks.workunit.client.0.smithi098.stdout:1/756: mkdir d9/d33/d19/d35/de1/d111 0 2024-09-13T02:53:02.653 INFO:tasks.workunit.client.0.smithi098.stdout:3/608: read d7/d9/d15/d2d/d34/f61 [1181584,22769] 0 2024-09-13T02:53:02.656 INFO:tasks.workunit.client.0.smithi098.stdout:2/651: dwrite d1/d1f/d35/f74 [0,4194304] 0 2024-09-13T02:53:02.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/694: write d2/d6/f19 [1890471,38238] 0 2024-09-13T02:53:02.664 INFO:tasks.workunit.client.0.smithi098.stdout:2/652: fdatasync d1/d1f/d35/f45 0 2024-09-13T02:53:02.666 INFO:tasks.workunit.client.0.smithi098.stdout:9/695: creat d2/d6/d2b/d4d/d56/db9/ffa x:0 0 0 2024-09-13T02:53:02.670 INFO:tasks.workunit.client.0.smithi098.stdout:2/653: chown d1/da7/fb5 9401 1 2024-09-13T02:53:02.671 INFO:tasks.workunit.client.0.smithi098.stdout:1/757: getdents d9/d33/d19/d35/d68/d4d/dbc/d23 0 2024-09-13T02:53:02.673 INFO:tasks.workunit.client.0.smithi098.stdout:9/696: mkdir d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/df1/dfb 0 2024-09-13T02:53:02.677 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:02 smithi098 ceph-mon[27886]: pgmap v30: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 152 MiB/s wr, 350 op/s 2024-09-13T02:53:02.680 INFO:tasks.workunit.client.0.smithi098.stdout:3/609: dwrite d7/d9/d25/f71 [0,4194304] 0 2024-09-13T02:53:02.680 INFO:tasks.workunit.client.0.smithi098.stdout:1/758: creat d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/f112 x:0 0 0 2024-09-13T02:53:02.691 INFO:tasks.workunit.client.0.smithi098.stdout:2/654: write d1/d1f/d36/f52 [738327,124090] 0 2024-09-13T02:53:02.693 INFO:tasks.workunit.client.0.smithi098.stdout:9/697: dwrite d2/d6/d2b/fa1 [0,4194304] 0 2024-09-13T02:53:02.705 INFO:tasks.workunit.client.0.smithi098.stdout:3/610: write d7/f43 [4468450,88003] 0 2024-09-13T02:53:02.706 INFO:tasks.workunit.client.0.smithi098.stdout:3/611: fdatasync d7/d9/d15/fa3 0 2024-09-13T02:53:02.708 INFO:tasks.workunit.client.0.smithi098.stdout:9/698: mkdir d2/dfc 0 2024-09-13T02:53:02.713 INFO:tasks.workunit.client.0.smithi098.stdout:9/699: fdatasync d2/d6/d2b/d66/fb2 0 2024-09-13T02:53:02.714 INFO:tasks.workunit.client.0.smithi098.stdout:1/759: getdents d9/d33/d19/d35/d68/d4d/db5/dcb 0 2024-09-13T02:53:02.716 INFO:tasks.workunit.client.0.smithi098.stdout:9/700: write d2/d6/d2b/d4d/d56/f93 [570867,79317] 0 2024-09-13T02:53:02.718 INFO:tasks.workunit.client.0.smithi098.stdout:2/655: dread d1/da7/fb5 [0,4194304] 0 2024-09-13T02:53:02.726 INFO:tasks.workunit.client.0.smithi098.stdout:2/656: link d1/d1a/d9/d1e/d5a/f86 d1/d1f/d30/fd3 0 2024-09-13T02:53:02.729 INFO:tasks.workunit.client.0.smithi098.stdout:2/657: write d1/d1f/d35/d63/f65 [1014514,34697] 0 2024-09-13T02:53:02.730 INFO:tasks.workunit.client.0.smithi098.stdout:3/612: dwrite d7/d9/d15/d2d/d5b/f46 [0,4194304] 0 2024-09-13T02:53:02.737 INFO:tasks.workunit.client.0.smithi098.stdout:3/613: creat d7/fbf x:0 0 0 2024-09-13T02:53:02.738 INFO:tasks.workunit.client.0.smithi098.stdout:2/658: unlink d1/d1a/c55 0 2024-09-13T02:53:02.740 INFO:tasks.workunit.client.0.smithi098.stdout:1/760: dwrite d9/d33/d87/fc3 [0,4194304] 0 2024-09-13T02:53:02.744 INFO:tasks.workunit.client.0.smithi098.stdout:9/701: dread d2/d6/d2b/d4d/fab [0,4194304] 0 2024-09-13T02:53:02.745 INFO:tasks.workunit.client.0.smithi098.stdout:2/659: creat d1/da7/fd4 x:0 0 0 2024-09-13T02:53:02.750 INFO:tasks.workunit.client.0.smithi098.stdout:3/614: rename d7/d9/d15/d2d/db8/d52/l21 to d7/d9/d15/d26/lc0 0 2024-09-13T02:53:02.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:02 smithi142 ceph-mon[33443]: pgmap v30: 65 pgs: 65 active+clean; 3.3 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 152 MiB/s wr, 350 op/s 2024-09-13T02:53:02.752 INFO:tasks.workunit.client.0.smithi098.stdout:2/660: creat d1/d1a/d9/d1e/fd5 x:0 0 0 2024-09-13T02:53:02.753 INFO:tasks.workunit.client.0.smithi098.stdout:9/702: read d2/d6/d2b/d4d/d4f/d6c/dd4/f5a [536783,69452] 0 2024-09-13T02:53:02.760 INFO:tasks.workunit.client.0.smithi098.stdout:1/761: truncate f1 3669884 0 2024-09-13T02:53:02.762 INFO:tasks.workunit.client.0.smithi098.stdout:9/703: dwrite d2/d6/f8b [0,4194304] 0 2024-09-13T02:53:02.764 INFO:tasks.workunit.client.0.smithi098.stdout:2/661: rename d1/d1a/d4f/c77 to d1/d1a/d4f/d59/cd6 0 2024-09-13T02:53:02.765 INFO:tasks.workunit.client.0.smithi098.stdout:9/704: truncate d2/d6/d2b/d66/f78 109763 0 2024-09-13T02:53:02.769 INFO:tasks.workunit.client.0.smithi098.stdout:1/762: creat d9/d33/d19/d35/d68/d4d/dbc/f113 x:0 0 0 2024-09-13T02:53:02.772 INFO:tasks.workunit.client.0.smithi098.stdout:1/763: write d9/d33/d19/d35/d68/d4d/dbc/d6b/ff7 [327150,14177] 0 2024-09-13T02:53:02.774 INFO:tasks.workunit.client.0.smithi098.stdout:3/615: creat d7/d9/d15/d2d/db8/fc1 x:0 0 0 2024-09-13T02:53:02.775 INFO:tasks.workunit.client.0.smithi098.stdout:9/705: dread d2/d6/d2b/d4d/d4f/d6c/dd4/f86 [0,4194304] 0 2024-09-13T02:53:02.778 INFO:tasks.workunit.client.0.smithi098.stdout:2/662: fsync d1/d1f/d35/d63/f3f 0 2024-09-13T02:53:02.786 INFO:tasks.workunit.client.0.smithi098.stdout:3/616: rename d7/d9/d4c/c89 to d7/d9/d25/cc2 0 2024-09-13T02:53:02.787 INFO:tasks.workunit.client.0.smithi098.stdout:2/663: creat d1/d1f/fd7 x:0 0 0 2024-09-13T02:53:02.791 INFO:tasks.workunit.client.0.smithi098.stdout:1/764: truncate d9/d33/d19/d35/d68/d4d/dbc/fdc 3608551 0 2024-09-13T02:53:02.793 INFO:tasks.workunit.client.0.smithi098.stdout:9/706: rename d2/d6/d2b/d4d/d4f/c9d to d2/cfd 0 2024-09-13T02:53:02.796 INFO:tasks.workunit.client.0.smithi098.stdout:2/664: creat d1/d1f/d39/fd8 x:0 0 0 2024-09-13T02:53:02.799 INFO:tasks.workunit.client.0.smithi098.stdout:2/665: read d1/d1f/d36/f52 [1063835,119094] 0 2024-09-13T02:53:02.800 INFO:tasks.workunit.client.0.smithi098.stdout:3/617: rename d7/d9/d15/d2d/db8/d5f to d7/d9/d15/d5d/dc3 0 2024-09-13T02:53:02.801 INFO:tasks.workunit.client.0.smithi098.stdout:1/765: mkdir d9/d33/d19/d35/d10a/d114 0 2024-09-13T02:53:02.803 INFO:tasks.workunit.client.0.smithi098.stdout:9/707: dwrite d2/d6/d36/f4e [0,4194304] 0 2024-09-13T02:53:02.805 INFO:tasks.workunit.client.0.smithi098.stdout:2/666: creat d1/d1a/d4f/fd9 x:0 0 0 2024-09-13T02:53:02.807 INFO:tasks.workunit.client.0.smithi098.stdout:1/766: mknod d9/d33/de6/d61/c115 0 2024-09-13T02:53:02.807 INFO:tasks.workunit.client.0.smithi098.stdout:2/667: chown d1/d1a/d4f/d59/c6a 14563 1 2024-09-13T02:53:02.808 INFO:tasks.workunit.client.0.smithi098.stdout:1/767: chown d9/d33/d19/d35/d63/dd1 30840 1 2024-09-13T02:53:02.809 INFO:tasks.workunit.client.0.smithi098.stdout:2/668: write d1/d1a/d9/f5c [276977,123271] 0 2024-09-13T02:53:02.810 INFO:tasks.workunit.client.0.smithi098.stdout:3/618: creat d7/d9/d15/d2d/db8/d51/fc4 x:0 0 0 2024-09-13T02:53:02.813 INFO:tasks.workunit.client.0.smithi098.stdout:9/708: rmdir d2/d6/d36/da7/de5 39 2024-09-13T02:53:02.822 INFO:tasks.workunit.client.0.smithi098.stdout:1/768: write d9/d33/d19/d64/fbb [404443,3453] 0 2024-09-13T02:53:02.828 INFO:tasks.workunit.client.0.smithi098.stdout:3/619: truncate d7/d9/d15/d2d/db8/d51/f66 3200023 0 2024-09-13T02:53:02.829 INFO:tasks.workunit.client.0.smithi098.stdout:1/769: dwrite d9/d33/d19/f27 [0,4194304] 0 2024-09-13T02:53:02.838 INFO:tasks.workunit.client.0.smithi098.stdout:3/620: dread d7/d9/d15/d5d/fa8 [0,4194304] 0 2024-09-13T02:53:02.843 INFO:tasks.workunit.client.0.smithi098.stdout:1/770: dwrite d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/f112 [0,4194304] 0 2024-09-13T02:53:02.843 INFO:tasks.workunit.client.0.smithi098.stdout:9/709: rmdir d2/d6/d36/ded 0 2024-09-13T02:53:02.844 INFO:tasks.workunit.client.0.smithi098.stdout:9/710: fsync d2/d6/d2b/d4d/ff3 0 2024-09-13T02:53:02.855 INFO:tasks.workunit.client.0.smithi098.stdout:2/669: getdents d1/d1a 0 2024-09-13T02:53:02.856 INFO:tasks.workunit.client.0.smithi098.stdout:2/670: chown d1/d1a/d9/lf 138 1 2024-09-13T02:53:02.860 INFO:tasks.workunit.client.0.smithi098.stdout:3/621: truncate d7/d9/d15/d2d/db8/f44 701161 0 2024-09-13T02:53:02.861 INFO:tasks.workunit.client.0.smithi098.stdout:2/671: dread d1/da7/fb5 [0,4194304] 0 2024-09-13T02:53:02.864 INFO:tasks.workunit.client.0.smithi098.stdout:9/711: creat d2/d6/d36/da7/ffe x:0 0 0 2024-09-13T02:53:02.866 INFO:tasks.workunit.client.0.smithi098.stdout:3/622: symlink d7/d9/d15/d5d/lc5 0 2024-09-13T02:53:02.869 INFO:tasks.workunit.client.0.smithi098.stdout:9/712: read - d2/d6/d2b/d4d/d4f/d6c/fe3 zero size 2024-09-13T02:53:02.871 INFO:tasks.workunit.client.0.smithi098.stdout:2/672: symlink d1/d1f/d35/lda 0 2024-09-13T02:53:02.873 INFO:tasks.workunit.client.0.smithi098.stdout:3/623: truncate d7/d9/d25/d2b/f2c 3062672 0 2024-09-13T02:53:02.880 INFO:tasks.workunit.client.0.smithi098.stdout:3/624: creat d7/d9/d4c/fc6 x:0 0 0 2024-09-13T02:53:02.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/713: dread d2/d6/d2b/d4d/ff3 [0,4194304] 0 2024-09-13T02:53:02.887 INFO:tasks.workunit.client.0.smithi098.stdout:3/625: read d7/d9/d25/d64/f68 [13816,60225] 0 2024-09-13T02:53:02.888 INFO:tasks.workunit.client.0.smithi098.stdout:3/626: chown d7/fbf 3 1 2024-09-13T02:53:02.891 INFO:tasks.workunit.client.0.smithi098.stdout:9/714: symlink d2/d6/d2b/d4d/d4f/d6c/dd4/lff 0 2024-09-13T02:53:02.896 INFO:tasks.workunit.client.0.smithi098.stdout:3/627: dwrite d7/d9/d15/d2d/d78/fac [0,4194304] 0 2024-09-13T02:53:02.901 INFO:tasks.workunit.client.0.smithi098.stdout:3/628: creat d7/d9/d25/d64/fc7 x:0 0 0 2024-09-13T02:53:02.902 INFO:tasks.workunit.client.0.smithi098.stdout:3/629: dread - d7/fbf zero size 2024-09-13T02:53:02.905 INFO:tasks.workunit.client.0.smithi098.stdout:2/673: truncate d1/d1a/d4f/d59/d9e/d9f/fa9 1165960 0 2024-09-13T02:53:02.913 INFO:tasks.workunit.client.0.smithi098.stdout:2/674: creat d1/d1a/d9/fdb x:0 0 0 2024-09-13T02:53:02.920 INFO:tasks.workunit.client.0.smithi098.stdout:5/632: sync 2024-09-13T02:53:02.922 INFO:tasks.workunit.client.0.smithi098.stdout:2/675: fdatasync d1/d1a/d4f/d59/d9e/d9f/fa9 0 2024-09-13T02:53:02.924 INFO:tasks.workunit.client.0.smithi098.stdout:5/633: creat d0/d15/d17/d1c/d3d/fe2 x:0 0 0 2024-09-13T02:53:02.927 INFO:tasks.workunit.client.0.smithi098.stdout:9/715: write d2/f57 [1807486,1529] 0 2024-09-13T02:53:02.931 INFO:tasks.workunit.client.0.smithi098.stdout:9/716: dread - d2/db1/dcb/fd0 zero size 2024-09-13T02:53:02.933 INFO:tasks.workunit.client.0.smithi098.stdout:5/634: dwrite d0/d15/d69/fd2 [0,4194304] 0 2024-09-13T02:53:02.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/635: chown d0/d38/d3f/c4a 1 1 2024-09-13T02:53:02.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/636: fdatasync d0/d29/fd5 0 2024-09-13T02:53:02.945 INFO:tasks.workunit.client.0.smithi098.stdout:2/676: getdents d1/d1f/d35/d63/d72 0 2024-09-13T02:53:02.946 INFO:tasks.workunit.client.0.smithi098.stdout:2/677: readlink d1/d1a/d4f/d59/d9e/lc5 0 2024-09-13T02:53:02.947 INFO:tasks.workunit.client.0.smithi098.stdout:2/678: fdatasync d1/d1f/d35/d63/f37 0 2024-09-13T02:53:02.952 INFO:tasks.workunit.client.0.smithi098.stdout:3/630: write d7/d9/d25/d2b/f3e [53798,100760] 0 2024-09-13T02:53:02.956 INFO:tasks.workunit.client.0.smithi098.stdout:3/631: unlink d7/d9/d25/f39 0 2024-09-13T02:53:02.957 INFO:tasks.workunit.client.0.smithi098.stdout:2/679: symlink d1/ldc 0 2024-09-13T02:53:02.958 INFO:tasks.workunit.client.0.smithi098.stdout:5/637: dread d0/d7c/fa0 [0,4194304] 0 2024-09-13T02:53:02.959 INFO:tasks.workunit.client.0.smithi098.stdout:5/638: chown d0/d15/f80 133232384 1 2024-09-13T02:53:02.967 INFO:tasks.workunit.client.0.smithi098.stdout:2/680: dread d1/d1f/d27/f61 [0,4194304] 0 2024-09-13T02:53:02.976 INFO:tasks.workunit.client.0.smithi098.stdout:3/632: dread d7/f43 [0,4194304] 0 2024-09-13T02:53:02.976 INFO:tasks.workunit.client.0.smithi098.stdout:2/681: dwrite d1/d1a/d4f/d59/d9e/d9f/fa9 [0,4194304] 0 2024-09-13T02:53:02.979 INFO:tasks.workunit.client.0.smithi098.stdout:2/682: truncate d1/d1f/d35/d63/d72/d88/f96 360952 0 2024-09-13T02:53:02.998 INFO:tasks.workunit.client.0.smithi098.stdout:3/633: creat d7/d9/d15/d80/fc8 x:0 0 0 2024-09-13T02:53:02.999 INFO:tasks.workunit.client.0.smithi098.stdout:9/717: write d2/d6/d2b/f9e [920857,119205] 0 2024-09-13T02:53:03.011 INFO:tasks.workunit.client.0.smithi098.stdout:2/683: rename d1/d1a/d4f to d1/d1a/d9/d1e/ddd 0 2024-09-13T02:53:03.013 INFO:tasks.workunit.client.0.smithi098.stdout:2/684: dread d1/d1f/d35/d63/d72/d88/f96 [0,4194304] 0 2024-09-13T02:53:03.026 INFO:tasks.workunit.client.0.smithi098.stdout:5/639: getdents d0/d38/d3f/d81/d9e 0 2024-09-13T02:53:03.028 INFO:tasks.workunit.client.0.smithi098.stdout:9/718: creat d2/d6/d36/d8d/dc8/f100 x:0 0 0 2024-09-13T02:53:03.043 INFO:tasks.workunit.client.0.smithi098.stdout:3/634: symlink d7/d9/d15/d2d/d78/d7e/lc9 0 2024-09-13T02:53:03.045 INFO:tasks.workunit.client.0.smithi098.stdout:2/685: unlink d1/d1f/d35/l54 0 2024-09-13T02:53:03.048 INFO:tasks.workunit.client.0.smithi098.stdout:2/686: write d1/d1f/d35/d63/d72/f78 [738213,67885] 0 2024-09-13T02:53:03.052 INFO:tasks.workunit.client.0.smithi098.stdout:9/719: symlink d2/d6/d2b/d4d/d56/dbc/l101 0 2024-09-13T02:53:03.054 INFO:tasks.workunit.client.0.smithi098.stdout:9/720: write d2/d6/d2b/d4d/d56/dbc/fe2 [861288,90828] 0 2024-09-13T02:53:03.056 INFO:tasks.workunit.client.0.smithi098.stdout:9/721: chown d2/d6/d2b/d4d/d4f/d6c/dd4/de4 3068 1 2024-09-13T02:53:03.063 INFO:tasks.workunit.client.0.smithi098.stdout:3/635: rename d7/d9/d15/d2d/db8/d52/l1b to d7/d9/d15/d5d/dc3/lca 0 2024-09-13T02:53:03.065 INFO:tasks.workunit.client.0.smithi098.stdout:2/687: unlink d1/da7/fbe 0 2024-09-13T02:53:03.067 INFO:tasks.workunit.client.0.smithi098.stdout:9/722: dwrite d2/d6/d2b/d4d/d56/dbc/fe2 [0,4194304] 0 2024-09-13T02:53:03.073 INFO:tasks.workunit.client.0.smithi098.stdout:5/640: dwrite d0/d15/f8d [0,4194304] 0 2024-09-13T02:53:03.074 INFO:tasks.workunit.client.0.smithi098.stdout:9/723: stat d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/cc2 0 2024-09-13T02:53:03.081 INFO:tasks.workunit.client.0.smithi098.stdout:9/724: mkdir d2/d6/d2b/d66/de0/d102 0 2024-09-13T02:53:03.081 INFO:tasks.workunit.client.0.smithi098.stdout:3/636: dwrite d7/d9/d15/d2d/db8/d52/f8a [0,4194304] 0 2024-09-13T02:53:03.083 INFO:tasks.workunit.client.0.smithi098.stdout:3/637: dread - d7/d9/d25/d2b/fa2 zero size 2024-09-13T02:53:03.085 INFO:tasks.workunit.client.0.smithi098.stdout:9/725: dread - d2/d6/d2b/d4d/fd5 zero size 2024-09-13T02:53:03.085 INFO:tasks.workunit.client.0.smithi098.stdout:7/766: sync 2024-09-13T02:53:03.088 INFO:tasks.workunit.client.0.smithi098.stdout:5/641: truncate d0/d15/d17/daa/dab/fc6 704558 0 2024-09-13T02:53:03.089 INFO:tasks.workunit.client.0.smithi098.stdout:3/638: stat d7/d9/d25/d64/l88 0 2024-09-13T02:53:03.091 INFO:tasks.workunit.client.0.smithi098.stdout:2/688: mkdir d1/d1a/d9/d1e/ddd/d59/d9e/dde 0 2024-09-13T02:53:03.093 INFO:tasks.workunit.client.0.smithi098.stdout:2/689: write d1/d1f/d30/f34 [4105815,60] 0 2024-09-13T02:53:03.096 INFO:tasks.workunit.client.0.smithi098.stdout:9/726: rename d2/d6/d2b/d66/cd1 to d2/d6/d2b/d4d/d4f/d6c/dd4/dac/dd9/c103 0 2024-09-13T02:53:03.098 INFO:tasks.workunit.client.0.smithi098.stdout:9/727: chown d2/d6/d2b/d4d/d4f/d6c/dd4/dac/dd9 105777 1 2024-09-13T02:53:03.103 INFO:tasks.workunit.client.0.smithi098.stdout:3/639: creat d7/d9/d15/d2d/d34/fcb x:0 0 0 2024-09-13T02:53:03.104 INFO:tasks.workunit.client.0.smithi098.stdout:7/767: write d6/d24/d63/fa8 [1570851,54433] 0 2024-09-13T02:53:03.108 INFO:tasks.workunit.client.0.smithi098.stdout:5/642: unlink d0/f37 0 2024-09-13T02:53:03.109 INFO:tasks.workunit.client.0.smithi098.stdout:2/690: rename d1/d1f/d35/d63/l4c to d1/d1a/d9/d1e/ddd/ldf 0 2024-09-13T02:53:03.113 INFO:tasks.workunit.client.0.smithi098.stdout:9/728: rmdir d2/d6/d2b/d4d/d56/dbc 39 2024-09-13T02:53:03.115 INFO:tasks.workunit.client.0.smithi098.stdout:3/640: mknod d7/d9/d15/d5d/ccc 0 2024-09-13T02:53:03.120 INFO:tasks.workunit.client.0.smithi098.stdout:5/643: creat d0/d29/fe3 x:0 0 0 2024-09-13T02:53:03.122 INFO:tasks.workunit.client.0.smithi098.stdout:2/691: mkdir d1/d1a/d9/d1e/ddd/d59/d9e/d9f/de0 0 2024-09-13T02:53:03.124 INFO:tasks.workunit.client.0.smithi098.stdout:3/641: rmdir d7/d9/d15/d2d/d34 39 2024-09-13T02:53:03.126 INFO:tasks.workunit.client.0.smithi098.stdout:5/644: dwrite d0/d15/d17/f26 [0,4194304] 0 2024-09-13T02:53:03.136 INFO:tasks.workunit.client.0.smithi098.stdout:2/692: mknod d1/d1a/d9/d1e/d5a/ce1 0 2024-09-13T02:53:03.137 INFO:tasks.workunit.client.0.smithi098.stdout:9/729: mkdir d2/d6/d2b/d4d/dcf/d104 0 2024-09-13T02:53:03.138 INFO:tasks.workunit.client.0.smithi098.stdout:9/730: chown d2/d6/d2b/d4d/d4f/l94 1170916396 1 2024-09-13T02:53:03.141 INFO:tasks.workunit.client.0.smithi098.stdout:7/768: rmdir d6/d24/d2a/d5a/d86/d65/df5 0 2024-09-13T02:53:03.147 INFO:tasks.workunit.client.0.smithi098.stdout:2/693: unlink d1/d1a/d9/d1e/ddd/d7f/f7a 0 2024-09-13T02:53:03.150 INFO:tasks.workunit.client.0.smithi098.stdout:0/643: sync 2024-09-13T02:53:03.150 INFO:tasks.workunit.client.0.smithi098.stdout:4/648: sync 2024-09-13T02:53:03.150 INFO:tasks.workunit.client.0.smithi098.stdout:1/771: sync 2024-09-13T02:53:03.150 INFO:tasks.workunit.client.0.smithi098.stdout:6/594: sync 2024-09-13T02:53:03.150 INFO:tasks.workunit.client.0.smithi098.stdout:8/627: sync 2024-09-13T02:53:03.153 INFO:tasks.workunit.client.0.smithi098.stdout:1/772: chown d9/d33/d19/d35/d68/d4d/dbc/d23 630456 1 2024-09-13T02:53:03.154 INFO:tasks.workunit.client.0.smithi098.stdout:3/642: mknod d7/d9/d15/d2d/ccd 0 2024-09-13T02:53:03.159 INFO:tasks.workunit.client.0.smithi098.stdout:2/694: symlink d1/d1a/d9/d1e/ddd/d7f/le2 0 2024-09-13T02:53:03.160 INFO:tasks.workunit.client.0.smithi098.stdout:5/645: dwrite d0/d15/f30 [0,4194304] 0 2024-09-13T02:53:03.163 INFO:tasks.workunit.client.0.smithi098.stdout:9/731: rename d2/d6/f1d to d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/f105 0 2024-09-13T02:53:03.164 INFO:tasks.workunit.client.0.smithi098.stdout:5/646: truncate d0/d15/d17/daa/fcd 908445 0 2024-09-13T02:53:03.167 INFO:tasks.workunit.client.0.smithi098.stdout:5/647: stat d0/d29/fd5 0 2024-09-13T02:53:03.167 INFO:tasks.workunit.client.0.smithi098.stdout:4/649: mkdir d6/d10/ddc 0 2024-09-13T02:53:03.172 INFO:tasks.workunit.client.0.smithi098.stdout:9/732: dwrite d2/d6/d2b/d4d/fe6 [0,4194304] 0 2024-09-13T02:53:03.176 INFO:tasks.workunit.client.0.smithi098.stdout:2/695: dread d1/d1f/d35/f74 [0,4194304] 0 2024-09-13T02:53:03.177 INFO:tasks.workunit.client.0.smithi098.stdout:3/643: creat d7/d9/d15/d2d/db8/d51/d9c/fce x:0 0 0 2024-09-13T02:53:03.182 INFO:tasks.workunit.client.0.smithi098.stdout:6/595: mknod d5/d13/d2b/d3a/d14/d6b/cd1 0 2024-09-13T02:53:03.183 INFO:tasks.workunit.client.0.smithi098.stdout:8/628: dread d2/d2f/d78/d5d/f73 [0,4194304] 0 2024-09-13T02:53:03.183 INFO:tasks.workunit.client.0.smithi098.stdout:6/596: stat d5/l27 0 2024-09-13T02:53:03.185 INFO:tasks.workunit.client.0.smithi098.stdout:9/733: unlink d2/d6/f14 0 2024-09-13T02:53:03.186 INFO:tasks.workunit.client.0.smithi098.stdout:0/644: getdents dd/d1f/d85/d9d/dc2 0 2024-09-13T02:53:03.186 INFO:tasks.workunit.client.0.smithi098.stdout:4/650: read d6/d10/d21/f3b [1437826,101766] 0 2024-09-13T02:53:03.188 INFO:tasks.workunit.client.0.smithi098.stdout:9/734: dread - d2/d6/d2b/d4d/d56/db9/ddf/fe1 zero size 2024-09-13T02:53:03.190 INFO:tasks.workunit.client.0.smithi098.stdout:9/735: write d2/d6/d36/da7/ffe [116058,252] 0 2024-09-13T02:53:03.194 INFO:tasks.workunit.client.0.smithi098.stdout:9/736: dread d2/d6/d2b/fa1 [0,4194304] 0 2024-09-13T02:53:03.195 INFO:tasks.workunit.client.0.smithi098.stdout:7/769: write d6/d24/d2a/f31 [1842996,45304] 0 2024-09-13T02:53:03.198 INFO:tasks.workunit.client.0.smithi098.stdout:8/629: mknod d2/dd/d4d/d96/cc6 0 2024-09-13T02:53:03.207 INFO:tasks.workunit.client.0.smithi098.stdout:1/773: write d9/d33/d19/d35/fab [3163021,11081] 0 2024-09-13T02:53:03.208 INFO:tasks.workunit.client.0.smithi098.stdout:4/651: unlink d6/d3e/d73/f8f 0 2024-09-13T02:53:03.209 INFO:tasks.workunit.client.0.smithi098.stdout:0/645: creat dd/df/d1d/d26/d28/d32/d67/d71/fd3 x:0 0 0 2024-09-13T02:53:03.211 INFO:tasks.workunit.client.0.smithi098.stdout:2/696: mkdir d1/da7/db8/de3 0 2024-09-13T02:53:03.211 INFO:tasks.workunit.client.0.smithi098.stdout:0/646: write dd/df/d1d/d26/d28/f72 [3736556,51762] 0 2024-09-13T02:53:03.213 INFO:tasks.workunit.client.0.smithi098.stdout:3/644: symlink d7/d9/d15/d5d/da1/lcf 0 2024-09-13T02:53:03.222 INFO:tasks.workunit.client.0.smithi098.stdout:8/630: creat d2/d2f/d78/d46/d47/d6e/fc7 x:0 0 0 2024-09-13T02:53:03.230 INFO:tasks.workunit.client.0.smithi098.stdout:2/697: dread d1/fa6 [0,4194304] 0 2024-09-13T02:53:03.237 INFO:tasks.workunit.client.0.smithi098.stdout:2/698: dwrite d1/d1f/fd7 [0,4194304] 0 2024-09-13T02:53:03.288 INFO:tasks.workunit.client.0.smithi098.stdout:4/652: creat d6/d3e/d73/fdd x:0 0 0 2024-09-13T02:53:03.291 INFO:tasks.workunit.client.0.smithi098.stdout:3/645: fdatasync d7/d9/d15/d2d/d5b/f46 0 2024-09-13T02:53:03.296 INFO:tasks.workunit.client.0.smithi098.stdout:0/647: mknod dd/df/d1d/da7/cd4 0 2024-09-13T02:53:03.296 INFO:tasks.workunit.client.0.smithi098.stdout:9/737: creat d2/d6/d2b/d4d/d56/dbc/f106 x:0 0 0 2024-09-13T02:53:03.297 INFO:tasks.workunit.client.0.smithi098.stdout:1/774: dwrite d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fd9 [0,4194304] 0 2024-09-13T02:53:03.298 INFO:tasks.workunit.client.0.smithi098.stdout:5/648: link d0/d15/d50/ca7 d0/d15/d17/daa/ce4 0 2024-09-13T02:53:03.299 INFO:tasks.workunit.client.0.smithi098.stdout:7/770: creat d6/d24/d2a/d5a/d86/db1/dc2/df8/ffc x:0 0 0 2024-09-13T02:53:03.300 INFO:tasks.workunit.client.0.smithi098.stdout:5/649: readlink d0/d15/lb7 0 2024-09-13T02:53:03.302 INFO:tasks.workunit.client.0.smithi098.stdout:1/775: stat d9/d33/d19/d35/d68/d4d/dbc/lb0 0 2024-09-13T02:53:03.302 INFO:tasks.workunit.client.0.smithi098.stdout:2/699: mkdir d1/da7/de4 0 2024-09-13T02:53:03.303 INFO:tasks.workunit.client.0.smithi098.stdout:4/653: rmdir d6/d22/d3d/d41/d74/d98 39 2024-09-13T02:53:03.322 INFO:tasks.workunit.client.0.smithi098.stdout:9/738: mkdir d2/d6/d36/d8d/d107 0 2024-09-13T02:53:03.322 INFO:tasks.workunit.client.0.smithi098.stdout:9/739: dread - d2/d6/d2b/d4d/fef zero size 2024-09-13T02:53:03.327 INFO:tasks.workunit.client.0.smithi098.stdout:7/771: mknod d6/d24/d2a/d5a/d86/db1/dc2/df8/cfd 0 2024-09-13T02:53:03.330 INFO:tasks.workunit.client.0.smithi098.stdout:1/776: chown d9/d33/d19/d35/d68/d2f/lde 349879 1 2024-09-13T02:53:03.331 INFO:tasks.workunit.client.0.smithi098.stdout:1/777: dread - d9/d33/d19/d35/d68/d4d/dbc/f113 zero size 2024-09-13T02:53:03.334 INFO:tasks.workunit.client.0.smithi098.stdout:0/648: creat dd/d1f/d85/d9d/dc2/fd5 x:0 0 0 2024-09-13T02:53:03.342 INFO:tasks.workunit.client.0.smithi098.stdout:4/654: write d6/d22/d3d/d41/d58/faa [661847,100545] 0 2024-09-13T02:53:03.342 INFO:tasks.workunit.client.0.smithi098.stdout:9/740: write d2/d6/d36/fea [3420820,130891] 0 2024-09-13T02:53:03.344 INFO:tasks.workunit.client.0.smithi098.stdout:4/655: chown d6/d10/ddc 3950 1 2024-09-13T02:53:03.345 INFO:tasks.workunit.client.0.smithi098.stdout:3/646: dwrite d7/d9/fa [0,4194304] 0 2024-09-13T02:53:03.347 INFO:tasks.workunit.client.0.smithi098.stdout:3/647: stat d7/d9/d15/d2d/db8/d52/c4e 0 2024-09-13T02:53:03.361 INFO:tasks.workunit.client.0.smithi098.stdout:1/778: mknod d9/d33/d29/d58/c116 0 2024-09-13T02:53:03.362 INFO:tasks.workunit.client.0.smithi098.stdout:1/779: readlink d9/d33/d19/d35/d68/d4d/dbc/d6b/l103 0 2024-09-13T02:53:03.363 INFO:tasks.workunit.client.0.smithi098.stdout:2/700: creat d1/fe5 x:0 0 0 2024-09-13T02:53:03.365 INFO:tasks.workunit.client.0.smithi098.stdout:2/701: write d1/d1f/d35/d63/d72/f9d [1600353,90620] 0 2024-09-13T02:53:03.367 INFO:tasks.workunit.client.0.smithi098.stdout:7/772: unlink d6/d24/d2a/d5a/d42/c82 0 2024-09-13T02:53:03.368 INFO:tasks.workunit.client.0.smithi098.stdout:4/656: mkdir d6/d54/d6a/dde 0 2024-09-13T02:53:03.374 INFO:tasks.workunit.client.0.smithi098.stdout:3/648: unlink d7/d9/d15/d26/c91 0 2024-09-13T02:53:03.379 INFO:tasks.workunit.client.0.smithi098.stdout:0/649: rename dd/d1f/c38 to dd/df/d1d/d26/d28/cd6 0 2024-09-13T02:53:03.393 INFO:tasks.workunit.client.0.smithi098.stdout:2/702: rename d1/d1a/d9/d1e/c8d to d1/d1f/d35/d63/d72/d88/da8/ce6 0 2024-09-13T02:53:03.397 INFO:tasks.workunit.client.0.smithi098.stdout:7/773: write d6/d24/d2a/d5a/d4c/fac [570846,58874] 0 2024-09-13T02:53:03.398 INFO:tasks.workunit.client.0.smithi098.stdout:4/657: write d6/d22/d3d/d64/f6d [301587,19841] 0 2024-09-13T02:53:03.398 INFO:tasks.workunit.client.0.smithi098.stdout:9/741: truncate d2/d6/d36/fea 1336958 0 2024-09-13T02:53:03.399 INFO:tasks.workunit.client.0.smithi098.stdout:4/658: stat d6/d54/f9b 0 2024-09-13T02:53:03.400 INFO:tasks.workunit.client.0.smithi098.stdout:0/650: dread dd/df/d1d/d26/d28/d32/f49 [0,4194304] 0 2024-09-13T02:53:03.402 INFO:tasks.workunit.client.0.smithi098.stdout:3/649: mkdir d7/d9/dd0 0 2024-09-13T02:53:03.403 INFO:tasks.workunit.client.0.smithi098.stdout:2/703: creat d1/d1f/d27/fe7 x:0 0 0 2024-09-13T02:53:03.403 INFO:tasks.workunit.client.0.smithi098.stdout:3/650: chown d7/d9/d15/d26/f84 1 1 2024-09-13T02:53:03.405 INFO:tasks.workunit.client.0.smithi098.stdout:3/651: chown d7/d9/d15/l7b 3665 1 2024-09-13T02:53:03.407 INFO:tasks.workunit.client.0.smithi098.stdout:7/774: creat d6/d24/d2a/d5a/d8e/dbd/ffe x:0 0 0 2024-09-13T02:53:03.407 INFO:tasks.workunit.client.0.smithi098.stdout:4/659: rmdir d6/d3e 39 2024-09-13T02:53:03.408 INFO:tasks.workunit.client.0.smithi098.stdout:0/651: readlink dd/df/l5a 0 2024-09-13T02:53:03.409 INFO:tasks.workunit.client.0.smithi098.stdout:2/704: fsync d1/d1f/f42 0 2024-09-13T02:53:03.412 INFO:tasks.workunit.client.0.smithi098.stdout:1/780: getdents d9/d33/d19/d35 0 2024-09-13T02:53:03.414 INFO:tasks.workunit.client.0.smithi098.stdout:0/652: dread dd/df/fcd [0,4194304] 0 2024-09-13T02:53:03.414 INFO:tasks.workunit.client.0.smithi098.stdout:7/775: symlink d6/d24/d2a/d57/lff 0 2024-09-13T02:53:03.424 INFO:tasks.workunit.client.0.smithi098.stdout:2/705: rmdir d1/d1f/d35/d63/d72/d88 39 2024-09-13T02:53:03.425 INFO:tasks.workunit.client.0.smithi098.stdout:7/776: dwrite d6/d24/d2a/f31 [4194304,4194304] 0 2024-09-13T02:53:03.432 INFO:tasks.workunit.client.0.smithi098.stdout:4/660: dwrite d6/d22/d3d/d41/f5b [0,4194304] 0 2024-09-13T02:53:03.442 INFO:tasks.workunit.client.0.smithi098.stdout:2/706: chown d1/d1a/d9/d1e/ddd/ldf 398499147 1 2024-09-13T02:53:03.444 INFO:tasks.workunit.client.0.smithi098.stdout:7/777: mkdir d6/d24/d46/d100 0 2024-09-13T02:53:03.448 INFO:tasks.workunit.client.0.smithi098.stdout:1/781: rename d9/d33/d19/c7f to d9/d33/d19/d35/d68/d2f/dbf/c117 0 2024-09-13T02:53:03.449 INFO:tasks.workunit.client.0.smithi098.stdout:1/782: fsync d9/d33/d19/d35/d68/d2f/f10b 0 2024-09-13T02:53:03.450 INFO:tasks.workunit.client.0.smithi098.stdout:0/653: write dd/df/d1d/d26/d28/f2e [4518922,107097] 0 2024-09-13T02:53:03.452 INFO:tasks.workunit.client.0.smithi098.stdout:9/742: link d2/d6/d2b/d4d/d4f/d6c/dd4/cbb d2/d6/d36/da7/c108 0 2024-09-13T02:53:03.454 INFO:tasks.workunit.client.0.smithi098.stdout:4/661: fdatasync d6/d22/d3d/d41/f5b 0 2024-09-13T02:53:03.454 INFO:tasks.workunit.client.0.smithi098.stdout:7/778: symlink d6/d24/d2a/d5a/d8e/df0/l101 0 2024-09-13T02:53:03.459 INFO:tasks.workunit.client.0.smithi098.stdout:1/783: rename d9/d33/d19/d35/de1/d111 to d9/d33/d19/d35/d68/d4d/db5/d118 0 2024-09-13T02:53:03.461 INFO:tasks.workunit.client.0.smithi098.stdout:0/654: mkdir dd/db9/dd7 0 2024-09-13T02:53:03.463 INFO:tasks.workunit.client.0.smithi098.stdout:0/655: read dd/df/d1d/da7/fb5 [90893,5371] 0 2024-09-13T02:53:03.463 INFO:tasks.workunit.client.0.smithi098.stdout:4/662: unlink d6/d37/lbe 0 2024-09-13T02:53:03.467 INFO:tasks.workunit.client.0.smithi098.stdout:7/779: rmdir d6/d24/d2a/d5a/d4c 39 2024-09-13T02:53:03.471 INFO:tasks.workunit.client.0.smithi098.stdout:1/784: mkdir d9/db6/d119 0 2024-09-13T02:53:03.475 INFO:tasks.workunit.client.0.smithi098.stdout:9/743: write d2/d6/fa8 [495931,56712] 0 2024-09-13T02:53:03.476 INFO:tasks.workunit.client.0.smithi098.stdout:9/744: chown d2/d6/d2b/c55 56962 1 2024-09-13T02:53:03.477 INFO:tasks.workunit.client.0.smithi098.stdout:4/663: creat d6/d22/fdf x:0 0 0 2024-09-13T02:53:03.477 INFO:tasks.workunit.client.0.smithi098.stdout:9/745: chown d2/d6/d2b/d4d/fd5 226003 1 2024-09-13T02:53:03.478 INFO:tasks.workunit.client.0.smithi098.stdout:9/746: fdatasync d2/d6/d2b/f9e 0 2024-09-13T02:53:03.480 INFO:tasks.workunit.client.0.smithi098.stdout:9/747: write d2/d6/d2b/d4d/d56/db9/ddf/fe1 [865529,129509] 0 2024-09-13T02:53:03.481 INFO:tasks.workunit.client.0.smithi098.stdout:1/785: fsync d9/d33/de6/d61/db1/fc4 0 2024-09-13T02:53:03.490 INFO:tasks.workunit.client.0.smithi098.stdout:1/786: readlink d9/d33/d19/lc2 0 2024-09-13T02:53:03.491 INFO:tasks.workunit.client.0.smithi098.stdout:9/748: mkdir d2/d6/d2b/d4d/d4f/d6c/dd4/dac/d109 0 2024-09-13T02:53:03.492 INFO:tasks.workunit.client.0.smithi098.stdout:0/656: link dd/df/d1d/d26/d28/l8b dd/df/d1d/d26/d28/d32/d8d/ld8 0 2024-09-13T02:53:03.494 INFO:tasks.workunit.client.0.smithi098.stdout:4/664: symlink d6/d3e/d46/dd2/le0 0 2024-09-13T02:53:03.494 INFO:tasks.workunit.client.0.smithi098.stdout:4/665: chown d6 0 1 2024-09-13T02:53:03.498 INFO:tasks.workunit.client.0.smithi098.stdout:1/787: rename d9/d33/d19/d35/d68/d2f/dbf/f9d to d9/d33/d87/f11a 0 2024-09-13T02:53:03.499 INFO:tasks.workunit.client.0.smithi098.stdout:1/788: fsync d9/d33/d19/d35/d63/ff8 0 2024-09-13T02:53:03.506 INFO:tasks.workunit.client.0.smithi098.stdout:9/749: rename d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/la4 to d2/d6/d2b/d4d/d56/db9/l10a 0 2024-09-13T02:53:03.508 INFO:tasks.workunit.client.0.smithi098.stdout:7/780: write d6/d24/d2a/d5a/d4c/fd8 [498466,42784] 0 2024-09-13T02:53:03.509 INFO:tasks.workunit.client.0.smithi098.stdout:1/789: write d9/d33/d19/d35/d68/d4d/dbc/d6b/fb2 [2411430,50302] 0 2024-09-13T02:53:03.512 INFO:tasks.workunit.client.0.smithi098.stdout:0/657: creat dd/fd9 x:0 0 0 2024-09-13T02:53:03.513 INFO:tasks.workunit.client.0.smithi098.stdout:9/750: dwrite d2/d6/d2b/f31 [0,4194304] 0 2024-09-13T02:53:03.514 INFO:tasks.workunit.client.0.smithi098.stdout:4/666: creat d6/d3e/fe1 x:0 0 0 2024-09-13T02:53:03.517 INFO:tasks.workunit.client.0.smithi098.stdout:7/781: read d6/d24/d2a/d5a/f4d [348534,40243] 0 2024-09-13T02:53:03.517 INFO:tasks.workunit.client.0.smithi098.stdout:9/751: read d2/d6/d2b/d4d/f8c [203652,2368] 0 2024-09-13T02:53:03.517 INFO:tasks.workunit.client.0.smithi098.stdout:0/658: read fa [1424548,110870] 0 2024-09-13T02:53:03.519 INFO:tasks.workunit.client.0.smithi098.stdout:9/752: chown d2/d6/d2b/d4d/d56/db9/ddf/fe1 4 1 2024-09-13T02:53:03.520 INFO:tasks.workunit.client.0.smithi098.stdout:4/667: symlink d6/d22/d3d/d41/d58/le2 0 2024-09-13T02:53:03.523 INFO:tasks.workunit.client.0.smithi098.stdout:4/668: write d6/d22/fdf [803788,121205] 0 2024-09-13T02:53:03.529 INFO:tasks.workunit.client.0.smithi098.stdout:0/659: dwrite dd/fc4 [4194304,4194304] 0 2024-09-13T02:53:03.529 INFO:tasks.workunit.client.0.smithi098.stdout:7/782: creat d6/d24/dc5/de3/df2/f102 x:0 0 0 2024-09-13T02:53:03.533 INFO:tasks.workunit.client.0.smithi098.stdout:4/669: symlink d6/d10/ddc/le3 0 2024-09-13T02:53:03.533 INFO:tasks.workunit.client.0.smithi098.stdout:9/753: dwrite d2/d6/d2b/d4d/d56/db9/ddf/fe1 [0,4194304] 0 2024-09-13T02:53:03.535 INFO:tasks.workunit.client.0.smithi098.stdout:4/670: chown d6/d10/d21/l3a 2227958 1 2024-09-13T02:53:03.539 INFO:tasks.workunit.client.0.smithi098.stdout:0/660: rename dd/df/d1d/d26/d37/d53 to dd/df/d1d/d26/d28/d32/dda 0 2024-09-13T02:53:03.544 INFO:tasks.workunit.client.0.smithi098.stdout:9/754: truncate d2/d6/d2b/d4d/d4f/d6c/dd4/d43/f50 2994442 0 2024-09-13T02:53:03.545 INFO:tasks.workunit.client.0.smithi098.stdout:7/783: getdents d6/d24/d46 0 2024-09-13T02:53:03.548 INFO:tasks.workunit.client.0.smithi098.stdout:0/661: rename dd/fc4 to dd/df/d1d/d40/d46/fdb 0 2024-09-13T02:53:03.552 INFO:tasks.workunit.client.0.smithi098.stdout:4/671: creat d6/d3e/fe4 x:0 0 0 2024-09-13T02:53:03.560 INFO:tasks.workunit.client.0.smithi098.stdout:4/672: link d6/d10/d21/c43 d6/db/ce5 0 2024-09-13T02:53:03.560 INFO:tasks.workunit.client.0.smithi098.stdout:0/662: dwrite dd/f2d [0,4194304] 0 2024-09-13T02:53:03.561 INFO:tasks.workunit.client.0.smithi098.stdout:7/784: dwrite d6/d24/d2a/d5a/f22 [4194304,4194304] 0 2024-09-13T02:53:03.562 INFO:tasks.workunit.client.0.smithi098.stdout:7/785: stat d6/d24 0 2024-09-13T02:53:03.563 INFO:tasks.workunit.client.0.smithi098.stdout:0/663: chown dd/df/d1d/d40/d46/l84 553 1 2024-09-13T02:53:03.567 INFO:tasks.workunit.client.0.smithi098.stdout:7/786: truncate d6/d1e/fcb 1328062 0 2024-09-13T02:53:03.572 INFO:tasks.workunit.client.0.smithi098.stdout:0/664: truncate dd/f10 706253 0 2024-09-13T02:53:03.575 INFO:tasks.workunit.client.0.smithi098.stdout:4/673: rename d6/d10/f80 to d6/d22/d3d/d41/d74/fe6 0 2024-09-13T02:53:03.577 INFO:tasks.workunit.client.0.smithi098.stdout:4/674: truncate d6/d22/d3d/d41/fb2 548590 0 2024-09-13T02:53:03.578 INFO:tasks.workunit.client.0.smithi098.stdout:0/665: creat dd/d1f/d85/fdc x:0 0 0 2024-09-13T02:53:03.584 INFO:tasks.workunit.client.0.smithi098.stdout:0/666: readlink dd/df/d1d/d26/d28/d32/d67/d82/lc1 0 2024-09-13T02:53:03.586 INFO:tasks.workunit.client.0.smithi098.stdout:4/675: dread d6/d22/d3d/f49 [0,4194304] 0 2024-09-13T02:53:03.587 INFO:tasks.workunit.client.0.smithi098.stdout:7/787: link d6/d24/d2a/d5a/d86/db1/dc2/df8/ffc d6/d24/dc5/de3/df2/f103 0 2024-09-13T02:53:03.589 INFO:tasks.workunit.client.0.smithi098.stdout:0/667: fdatasync dd/df/d1d/d26/d28/d5d/f69 0 2024-09-13T02:53:03.590 INFO:tasks.workunit.client.0.smithi098.stdout:0/668: dread - dd/fd9 zero size 2024-09-13T02:53:03.595 INFO:tasks.workunit.client.0.smithi098.stdout:4/676: getdents d6/d22/d3d/d41/d74/ddb 0 2024-09-13T02:53:03.595 INFO:tasks.workunit.client.0.smithi098.stdout:0/669: creat dd/d95/fdd x:0 0 0 2024-09-13T02:53:03.599 INFO:tasks.workunit.client.0.smithi098.stdout:0/670: creat dd/d1f/d85/d9d/fde x:0 0 0 2024-09-13T02:53:03.602 INFO:tasks.workunit.client.0.smithi098.stdout:7/788: getdents d6/d1e 0 2024-09-13T02:53:03.605 INFO:tasks.workunit.client.0.smithi098.stdout:0/671: mknod dd/df/cdf 0 2024-09-13T02:53:03.606 INFO:tasks.workunit.client.0.smithi098.stdout:4/677: getdents d6/d3e/d46/dd2 0 2024-09-13T02:53:03.607 INFO:tasks.workunit.client.0.smithi098.stdout:4/678: readlink d6/d22/d3d/d41/d58/da9/lae 0 2024-09-13T02:53:03.609 INFO:tasks.workunit.client.0.smithi098.stdout:7/789: link d6/c16 d6/d24/d63/c104 0 2024-09-13T02:53:03.610 INFO:tasks.workunit.client.0.smithi098.stdout:4/679: read d6/d37/f39 [1822267,72992] 0 2024-09-13T02:53:03.618 INFO:tasks.workunit.client.0.smithi098.stdout:7/790: mkdir d6/d24/d2a/dda/dbb/d105 0 2024-09-13T02:53:03.618 INFO:tasks.workunit.client.0.smithi098.stdout:4/680: dwrite d6/d3e/fe1 [0,4194304] 0 2024-09-13T02:53:03.621 INFO:tasks.workunit.client.0.smithi098.stdout:0/672: dwrite dd/df/d1d/d40/f61 [0,4194304] 0 2024-09-13T02:53:03.629 INFO:tasks.workunit.client.0.smithi098.stdout:7/791: creat d6/d24/dc5/de3/f106 x:0 0 0 2024-09-13T02:53:03.631 INFO:tasks.workunit.client.0.smithi098.stdout:4/681: dwrite d6/d10/fce [4194304,4194304] 0 2024-09-13T02:53:03.636 INFO:tasks.workunit.client.0.smithi098.stdout:4/682: read d6/d22/d3d/d64/fa6 [3667710,36729] 0 2024-09-13T02:53:03.638 INFO:tasks.workunit.client.0.smithi098.stdout:4/683: write d6/d22/d3d/d64/fb4 [4576430,70267] 0 2024-09-13T02:53:03.643 INFO:tasks.workunit.client.0.smithi098.stdout:7/792: write d6/d24/d2a/d5a/d86/f4e [5142567,68125] 0 2024-09-13T02:53:03.645 INFO:tasks.workunit.client.0.smithi098.stdout:0/673: write dd/df/d1d/f63 [1174046,45664] 0 2024-09-13T02:53:03.649 INFO:tasks.workunit.client.0.smithi098.stdout:0/674: rmdir dd/d1f/d85 39 2024-09-13T02:53:03.653 INFO:tasks.workunit.client.0.smithi098.stdout:4/684: dwrite d6/d10/f1f [0,4194304] 0 2024-09-13T02:53:03.653 INFO:tasks.workunit.client.0.smithi098.stdout:0/675: mknod dd/df/d1d/d40/d46/d6b/ce0 0 2024-09-13T02:53:03.658 INFO:tasks.workunit.client.0.smithi098.stdout:0/676: write dd/df/fcd [2033673,21364] 0 2024-09-13T02:53:03.664 INFO:tasks.workunit.client.0.smithi098.stdout:4/685: dwrite d6/d54/f7b [0,4194304] 0 2024-09-13T02:53:03.665 INFO:tasks.workunit.client.0.smithi098.stdout:7/793: dread d6/d24/d2a/d5a/f22 [0,4194304] 0 2024-09-13T02:53:03.667 INFO:tasks.workunit.client.0.smithi098.stdout:0/677: dread dd/df/d1d/f63 [0,4194304] 0 2024-09-13T02:53:03.667 INFO:tasks.workunit.client.0.smithi098.stdout:7/794: chown d6/d24/d2a/d57/f9d 6663 1 2024-09-13T02:53:03.670 INFO:tasks.workunit.client.0.smithi098.stdout:4/686: unlink d6/d22/d3d/d4d/fa0 0 2024-09-13T02:53:03.672 INFO:tasks.workunit.client.0.smithi098.stdout:0/678: dread fa [0,4194304] 0 2024-09-13T02:53:03.676 INFO:tasks.workunit.client.0.smithi098.stdout:7/795: mknod d6/d24/d2a/d57/d88/da4/c107 0 2024-09-13T02:53:03.677 INFO:tasks.workunit.client.0.smithi098.stdout:0/679: readlink dd/df/d1d/d26/d28/l8b 0 2024-09-13T02:53:03.682 INFO:tasks.workunit.client.0.smithi098.stdout:7/796: dread - d6/d24/d2a/d5a/d42/d45/f94 zero size 2024-09-13T02:53:03.685 INFO:tasks.workunit.client.0.smithi098.stdout:7/797: truncate d6/fdb 600032 0 2024-09-13T02:53:03.685 INFO:tasks.workunit.client.0.smithi098.stdout:0/680: dwrite dd/df/d1d/d26/d28/d32/f4d [0,4194304] 0 2024-09-13T02:53:03.692 INFO:tasks.workunit.client.0.smithi098.stdout:0/681: dread - dd/df/d1d/d40/d46/fc3 zero size 2024-09-13T02:53:03.692 INFO:tasks.workunit.client.0.smithi098.stdout:0/682: write dd/df/fcd [37496,130156] 0 2024-09-13T02:53:03.696 INFO:tasks.workunit.client.0.smithi098.stdout:0/683: rename dd/df/d1d/d26/d28/d32/da1/fc8 to dd/df/d1d/d26/d28/fe1 0 2024-09-13T02:53:03.697 INFO:tasks.workunit.client.0.smithi098.stdout:0/684: dread - dd/df/d1d/d40/d46/d6b/f8f zero size 2024-09-13T02:53:03.699 INFO:tasks.workunit.client.0.smithi098.stdout:0/685: mknod dd/db9/dd7/ce2 0 2024-09-13T02:53:03.703 INFO:tasks.workunit.client.0.smithi098.stdout:4/687: dread d6/d22/f63 [0,4194304] 0 2024-09-13T02:53:03.704 INFO:tasks.workunit.client.0.smithi098.stdout:7/798: truncate d6/d24/d63/fd2 3682995 0 2024-09-13T02:53:03.707 INFO:tasks.workunit.client.0.smithi098.stdout:4/688: fsync d6/db/f2f 0 2024-09-13T02:53:03.709 INFO:tasks.workunit.client.0.smithi098.stdout:0/686: dwrite dd/d95/fdd [0,4194304] 0 2024-09-13T02:53:03.728 INFO:tasks.workunit.client.0.smithi098.stdout:7/799: dwrite d6/d24/d2a/d5a/d86/db1/dc2/df8/ffc [0,4194304] 0 2024-09-13T02:53:03.731 INFO:tasks.workunit.client.0.smithi098.stdout:7/800: mkdir d6/d24/dc5/de3/de6/d108 0 2024-09-13T02:53:03.732 INFO:tasks.workunit.client.0.smithi098.stdout:7/801: chown d6/dab/fe1 6215 1 2024-09-13T02:53:03.735 INFO:tasks.workunit.client.0.smithi098.stdout:7/802: truncate d6/d24/d63/fc1 200067 0 2024-09-13T02:53:03.736 INFO:tasks.workunit.client.0.smithi098.stdout:0/687: dread dd/df/d1d/d26/d28/f72 [0,4194304] 0 2024-09-13T02:53:03.739 INFO:tasks.workunit.client.0.smithi098.stdout:7/803: symlink d6/d24/dc5/de3/de6/d108/l109 0 2024-09-13T02:53:03.741 INFO:tasks.workunit.client.0.smithi098.stdout:0/688: dread dd/df/d1d/d40/d46/fdb [4194304,4194304] 0 2024-09-13T02:53:03.742 INFO:tasks.workunit.client.0.smithi098.stdout:0/689: chown dd/l35 286769862 1 2024-09-13T02:53:03.745 INFO:tasks.workunit.client.0.smithi098.stdout:0/690: read f4 [5320004,114636] 0 2024-09-13T02:53:03.750 INFO:tasks.workunit.client.0.smithi098.stdout:0/691: rename dd/df/d1d/d26/d37/fa0 to dd/df/d1d/d26/d28/d32/fe3 0 2024-09-13T02:53:03.756 INFO:tasks.workunit.client.0.smithi098.stdout:7/804: dread d6/d1e/fa2 [0,4194304] 0 2024-09-13T02:53:03.757 INFO:tasks.workunit.client.0.smithi098.stdout:7/805: readlink d6/d24/l59 0 2024-09-13T02:53:03.759 INFO:tasks.workunit.client.0.smithi098.stdout:0/692: rename dd/df/d1d/d26/d28/d32/d67/d81 to dd/d1f/d85/d9d/dc2/de4 0 2024-09-13T02:53:03.774 INFO:tasks.workunit.client.0.smithi098.stdout:7/806: dread d6/d1e/fb4 [0,4194304] 0 2024-09-13T02:53:03.775 INFO:tasks.workunit.client.0.smithi098.stdout:0/693: dwrite dd/df/d1d/d40/d46/d6b/f8f [0,4194304] 0 2024-09-13T02:53:03.776 INFO:tasks.workunit.client.0.smithi098.stdout:0/694: chown dd/d1f/d85/fab 1 1 2024-09-13T02:53:03.784 INFO:tasks.workunit.client.0.smithi098.stdout:7/807: dwrite d6/f11 [4194304,4194304] 0 2024-09-13T02:53:03.786 INFO:tasks.workunit.client.0.smithi098.stdout:0/695: rename dd/df/d1d/d40/d46/d6b/f70 to dd/df/d1d/d26/d28/d32/fe5 0 2024-09-13T02:53:03.788 INFO:tasks.workunit.client.0.smithi098.stdout:7/808: creat d6/d24/d46/f10a x:0 0 0 2024-09-13T02:53:03.792 INFO:tasks.workunit.client.0.smithi098.stdout:0/696: rename dd/f86 to dd/d1f/d85/d9d/dc2/de4/dc7/fe6 0 2024-09-13T02:53:03.793 INFO:tasks.workunit.client.0.smithi098.stdout:7/809: readlink d6/d24/d2a/d5a/d8e/df0/l101 0 2024-09-13T02:53:03.796 INFO:tasks.workunit.client.0.smithi098.stdout:0/697: creat dd/d1f/d85/d9d/dc2/de4/fe7 x:0 0 0 2024-09-13T02:53:03.797 INFO:tasks.workunit.client.0.smithi098.stdout:7/810: rmdir d6/d24/d2a/d5a/d8e/dbd 39 2024-09-13T02:53:03.797 INFO:tasks.workunit.client.0.smithi098.stdout:7/811: stat d6/d24/d46 0 2024-09-13T02:53:03.799 INFO:tasks.workunit.client.0.smithi098.stdout:0/698: mkdir dd/d1f/d85/d9d/dc2/de4/dc7/de8 0 2024-09-13T02:53:03.802 INFO:tasks.workunit.client.0.smithi098.stdout:0/699: creat dd/d1f/d85/d9d/dc2/de4/dc7/de8/fe9 x:0 0 0 2024-09-13T02:53:03.805 INFO:tasks.workunit.client.0.smithi098.stdout:0/700: mkdir dd/df/d1d/d26/d37/dea 0 2024-09-13T02:53:03.807 INFO:tasks.workunit.client.0.smithi098.stdout:0/701: rmdir dd/db9/dd7 39 2024-09-13T02:53:03.813 INFO:tasks.workunit.client.0.smithi098.stdout:7/812: write d6/f10 [2369324,117851] 0 2024-09-13T02:53:03.813 INFO:tasks.workunit.client.0.smithi098.stdout:0/702: link f4 dd/d1f/d85/d9d/dc9/feb 0 2024-09-13T02:53:03.813 INFO:tasks.workunit.client.0.smithi098.stdout:6/597: sync 2024-09-13T02:53:03.815 INFO:tasks.workunit.client.0.smithi098.stdout:0/703: creat dd/d1f/d85/d9d/fec x:0 0 0 2024-09-13T02:53:03.823 INFO:tasks.workunit.client.0.smithi098.stdout:7/813: dwrite d6/d24/d2a/d5a/d8e/dbd/ffe [0,4194304] 0 2024-09-13T02:53:03.829 INFO:tasks.workunit.client.0.smithi098.stdout:7/814: dread d6/d1e/f36 [4194304,4194304] 0 2024-09-13T02:53:03.830 INFO:tasks.workunit.client.0.smithi098.stdout:6/598: getdents d5/d13/d2b/d93 0 2024-09-13T02:53:03.835 INFO:tasks.workunit.client.0.smithi098.stdout:6/599: truncate d5/d18/f25 2175117 0 2024-09-13T02:53:03.839 INFO:tasks.workunit.client.0.smithi098.stdout:6/600: chown d5/d13/d2b/d5b/cbf 705 1 2024-09-13T02:53:03.841 INFO:tasks.workunit.client.0.smithi098.stdout:6/601: creat d5/d13/d2b/d79/fd2 x:0 0 0 2024-09-13T02:53:03.842 INFO:tasks.workunit.client.0.smithi098.stdout:0/704: dread dd/d1f/d85/d9d/dc9/feb [0,4194304] 0 2024-09-13T02:53:03.847 INFO:tasks.workunit.client.0.smithi098.stdout:6/602: creat d5/d13/d2b/fd3 x:0 0 0 2024-09-13T02:53:03.850 INFO:tasks.workunit.client.0.smithi098.stdout:7/815: truncate d6/d1e/fb4 3864674 0 2024-09-13T02:53:03.871 INFO:tasks.workunit.client.0.smithi098.stdout:6/603: dwrite d5/d18/f4c [0,4194304] 0 2024-09-13T02:53:03.873 INFO:tasks.workunit.client.0.smithi098.stdout:7/816: getdents d6/d24/d2a/d5a/d86 0 2024-09-13T02:53:03.873 INFO:tasks.workunit.client.0.smithi098.stdout:0/705: dwrite f4 [0,4194304] 0 2024-09-13T02:53:03.877 INFO:tasks.workunit.client.0.smithi098.stdout:7/817: mkdir d6/d1e/d10b 0 2024-09-13T02:53:03.882 INFO:tasks.workunit.client.0.smithi098.stdout:6/604: dwrite d5/d13/d2b/d3a/d41/f95 [0,4194304] 0 2024-09-13T02:53:03.891 INFO:tasks.workunit.client.0.smithi098.stdout:0/706: getdents dd/d1f/d85 0 2024-09-13T02:53:03.892 INFO:tasks.workunit.client.0.smithi098.stdout:0/707: chown dd/df/fb2 21824 1 2024-09-13T02:53:03.896 INFO:tasks.workunit.client.0.smithi098.stdout:0/708: dread dd/d95/f9c [4194304,4194304] 0 2024-09-13T02:53:03.900 INFO:tasks.workunit.client.0.smithi098.stdout:6/605: dread d5/d18/f45 [0,4194304] 0 2024-09-13T02:53:03.900 INFO:tasks.workunit.client.0.smithi098.stdout:0/709: creat dd/df/d1d/d26/d28/d32/d67/d71/dbd/fed x:0 0 0 2024-09-13T02:53:03.903 INFO:tasks.workunit.client.0.smithi098.stdout:0/710: dread - dd/df/d1d/d40/fac zero size 2024-09-13T02:53:03.904 INFO:tasks.workunit.client.0.smithi098.stdout:0/711: readlink dd/df/d1d/d26/d28/d5d/l90 0 2024-09-13T02:53:03.905 INFO:tasks.workunit.client.0.smithi098.stdout:0/712: stat dd/df/d1d/cce 0 2024-09-13T02:53:03.911 INFO:tasks.workunit.client.0.smithi098.stdout:0/713: symlink dd/d1f/d85/d9d/dc9/lee 0 2024-09-13T02:53:03.912 INFO:tasks.workunit.client.0.smithi098.stdout:7/818: dread d6/d24/d2a/d5a/f4d [0,4194304] 0 2024-09-13T02:53:03.916 INFO:tasks.workunit.client.0.smithi098.stdout:0/714: unlink dd/df/d1d/d26/d28/d5d/l90 0 2024-09-13T02:53:03.918 INFO:tasks.workunit.client.0.smithi098.stdout:7/819: dread d6/d24/d2a/d5a/d4c/f60 [0,4194304] 0 2024-09-13T02:53:03.920 INFO:tasks.workunit.client.0.smithi098.stdout:8/631: sync 2024-09-13T02:53:03.920 INFO:tasks.workunit.client.0.smithi098.stdout:6/606: dwrite d5/d18/f25 [0,4194304] 0 2024-09-13T02:53:03.926 INFO:tasks.workunit.client.0.smithi098.stdout:0/715: dwrite dd/d1f/d85/fab [4194304,4194304] 0 2024-09-13T02:53:03.929 INFO:tasks.workunit.client.0.smithi098.stdout:8/632: symlink d2/d2f/d78/d46/d74/d86/lc8 0 2024-09-13T02:53:03.930 INFO:tasks.workunit.client.0.smithi098.stdout:6/607: mknod d5/cd4 0 2024-09-13T02:53:03.935 INFO:tasks.workunit.client.0.smithi098.stdout:7/820: rename d6/d24/d2a/d5a/f2b to d6/d24/d2a/d5a/d86/f10c 0 2024-09-13T02:53:03.936 INFO:tasks.workunit.client.0.smithi098.stdout:7/821: chown d6/d24/d2a/d57/d88/cb0 37485475 1 2024-09-13T02:53:03.941 INFO:tasks.workunit.client.0.smithi098.stdout:0/716: dwrite dd/df/d1d/d40/d46/fdb [0,4194304] 0 2024-09-13T02:53:03.949 INFO:tasks.workunit.client.0.smithi098.stdout:0/717: read dd/df/d1d/da7/fb5 [114569,18766] 0 2024-09-13T02:53:03.951 INFO:tasks.workunit.client.0.smithi098.stdout:6/608: getdents d5/d13/d2b/d3a/d5a 0 2024-09-13T02:53:03.953 INFO:tasks.workunit.client.0.smithi098.stdout:0/718: creat dd/df/d1d/d26/d37/fef x:0 0 0 2024-09-13T02:53:03.958 INFO:tasks.workunit.client.0.smithi098.stdout:6/609: dwrite d5/d13/d2b/d3a/d14/d6b/d8f/fb6 [0,4194304] 0 2024-09-13T02:53:03.964 INFO:tasks.workunit.client.0.smithi098.stdout:6/610: fsync d5/d18/f45 0 2024-09-13T02:53:03.967 INFO:tasks.workunit.client.0.smithi098.stdout:8/633: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:53:03.969 INFO:tasks.workunit.client.0.smithi098.stdout:7/822: creat d6/d24/d2a/d5a/d86/d65/d9a/f10d x:0 0 0 2024-09-13T02:53:03.971 INFO:tasks.workunit.client.0.smithi098.stdout:6/611: chown d5/f31 36 1 2024-09-13T02:53:03.972 INFO:tasks.workunit.client.0.smithi098.stdout:0/719: dwrite dd/df/d1d/f43 [0,4194304] 0 2024-09-13T02:53:03.979 INFO:tasks.workunit.client.0.smithi098.stdout:0/720: mkdir dd/df/d1d/d26/d28/d32/d67/d82/df0 0 2024-09-13T02:53:03.980 INFO:tasks.workunit.client.0.smithi098.stdout:0/721: dread - dd/d1f/d85/d9d/fec zero size 2024-09-13T02:53:03.981 INFO:tasks.workunit.client.0.smithi098.stdout:6/612: write d5/f15 [9263882,111753] 0 2024-09-13T02:53:03.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:03 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:03.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:03 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:03.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:03 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:03.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:03 smithi098 ceph-mon[27886]: pgmap v31: 65 pgs: 65 active+clean; 3.3 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 70 MiB/s rd, 167 MiB/s wr, 415 op/s 2024-09-13T02:53:03.987 INFO:tasks.workunit.client.0.smithi098.stdout:8/634: creat d2/d28/d43/fc9 x:0 0 0 2024-09-13T02:53:03.991 INFO:tasks.workunit.client.0.smithi098.stdout:0/722: dwrite dd/d95/fdd [0,4194304] 0 2024-09-13T02:53:03.994 INFO:tasks.workunit.client.0.smithi098.stdout:6/613: dwrite d5/d18/f25 [0,4194304] 0 2024-09-13T02:53:04.000 INFO:tasks.workunit.client.0.smithi098.stdout:0/723: rename dd/fa4 to dd/df/d1d/d26/d37/ff1 0 2024-09-13T02:53:04.002 INFO:tasks.workunit.client.0.smithi098.stdout:6/614: unlink d5/d36/c42 0 2024-09-13T02:53:04.003 INFO:tasks.workunit.client.0.smithi098.stdout:7/823: write d6/d24/d2a/d5a/d42/d45/d73/f98 [411329,95607] 0 2024-09-13T02:53:04.007 INFO:tasks.workunit.client.0.smithi098.stdout:0/724: creat dd/df/d1d/d26/d28/ff2 x:0 0 0 2024-09-13T02:53:04.010 INFO:tasks.workunit.client.0.smithi098.stdout:8/635: creat d2/d28/d43/fca x:0 0 0 2024-09-13T02:53:04.010 INFO:tasks.workunit.client.0.smithi098.stdout:6/615: symlink d5/d18/dcf/ld5 0 2024-09-13T02:53:04.012 INFO:tasks.workunit.client.0.smithi098.stdout:6/616: read d5/f33 [14873,107809] 0 2024-09-13T02:53:04.014 INFO:tasks.workunit.client.0.smithi098.stdout:0/725: rmdir dd/df/d1d/d26/d28/d32 39 2024-09-13T02:53:04.079 INFO:tasks.workunit.client.0.smithi098.stdout:6/617: creat d5/d13/d2b/d3a/d41/d7e/fd6 x:0 0 0 2024-09-13T02:53:04.139 INFO:tasks.workunit.client.0.smithi098.stdout:8/636: write d2/dd/d4d/f57 [1696480,98857] 0 2024-09-13T02:53:04.140 INFO:tasks.workunit.client.0.smithi098.stdout:8/637: read - d2/d2f/d78/d46/da2/fb6 zero size 2024-09-13T02:53:04.140 INFO:tasks.workunit.client.0.smithi098.stdout:6/618: unlink d5/d13/d2b/d3a/d41/d6c/d7c/lba 0 2024-09-13T02:53:04.141 INFO:tasks.workunit.client.0.smithi098.stdout:6/619: stat d5/d13/d2b/d3a/d14/l4a 0 2024-09-13T02:53:04.146 INFO:tasks.workunit.client.0.smithi098.stdout:7/824: link d6/d24/d2a/d5a/d86/cbf d6/d24/dc5/de3/ddf/c10e 0 2024-09-13T02:53:04.149 INFO:tasks.workunit.client.0.smithi098.stdout:6/620: read - d5/d18/d50/fa4 zero size 2024-09-13T02:53:04.150 INFO:tasks.workunit.client.0.smithi098.stdout:6/621: chown d5/d13/d2b/f69 116 1 2024-09-13T02:53:04.158 INFO:tasks.workunit.client.0.smithi098.stdout:0/726: link dd/df/d1d/d26/d28/d32/d67/d82/lc1 dd/df/d1d/d40/d9b/lf3 0 2024-09-13T02:53:04.166 INFO:tasks.workunit.client.0.smithi098.stdout:7/825: write d6/d1e/f36 [5566791,111352] 0 2024-09-13T02:53:04.169 INFO:tasks.workunit.client.0.smithi098.stdout:6/622: creat d5/d13/d2b/d3a/fd7 x:0 0 0 2024-09-13T02:53:04.171 INFO:tasks.workunit.client.0.smithi098.stdout:0/727: creat dd/df/d1d/d26/d28/d32/d67/d82/df0/ff4 x:0 0 0 2024-09-13T02:53:04.173 INFO:tasks.workunit.client.0.smithi098.stdout:7/826: creat d6/d24/d2a/d5a/d42/d45/d73/f10f x:0 0 0 2024-09-13T02:53:04.178 INFO:tasks.workunit.client.0.smithi098.stdout:0/728: rmdir dd/df/d1d/d26/d28/d32/d67/d71 39 2024-09-13T02:53:04.180 INFO:tasks.workunit.client.0.smithi098.stdout:7/827: dwrite d6/d24/d2a/d57/faa [0,4194304] 0 2024-09-13T02:53:04.182 INFO:tasks.workunit.client.0.smithi098.stdout:6/623: rename d5/d6f/cc8 to d5/d18/d50/cd8 0 2024-09-13T02:53:04.185 INFO:tasks.workunit.client.0.smithi098.stdout:0/729: mkdir dd/d1f/d85/df5 0 2024-09-13T02:53:04.192 INFO:tasks.workunit.client.0.smithi098.stdout:7/828: mkdir d6/df9/d110 0 2024-09-13T02:53:04.198 INFO:tasks.workunit.client.0.smithi098.stdout:6/624: mkdir d5/d13/d2b/d3a/d14/dd9 0 2024-09-13T02:53:04.200 INFO:tasks.workunit.client.0.smithi098.stdout:7/829: readlink d6/d24/d2a/d5a/d42/lcc 0 2024-09-13T02:53:04.213 INFO:tasks.workunit.client.0.smithi098.stdout:6/625: dwrite d5/d13/d2b/f2d [0,4194304] 0 2024-09-13T02:53:04.215 INFO:tasks.workunit.client.0.smithi098.stdout:6/626: chown d5/l27 39841 1 2024-09-13T02:53:04.216 INFO:tasks.workunit.client.0.smithi098.stdout:7/830: dwrite d6/d24/d2a/d5a/f22 [4194304,4194304] 0 2024-09-13T02:53:04.222 INFO:tasks.workunit.client.0.smithi098.stdout:0/730: dread dd/df/d1d/d26/d28/d32/fe5 [0,4194304] 0 2024-09-13T02:53:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:03 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:03 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:03 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:03 smithi142 ceph-mon[33443]: pgmap v31: 65 pgs: 65 active+clean; 3.3 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 70 MiB/s rd, 167 MiB/s wr, 415 op/s 2024-09-13T02:53:04.262 INFO:tasks.workunit.client.0.smithi098.stdout:6/627: fsync d5/d13/d2b/d3a/d14/d94/d97/da3/fac 0 2024-09-13T02:53:04.284 INFO:tasks.workunit.client.0.smithi098.stdout:6/628: dread d5/d13/d2b/d3a/d41/f4b [0,4194304] 0 2024-09-13T02:53:04.293 INFO:tasks.workunit.client.0.smithi098.stdout:6/629: dwrite d5/d13/d2b/d3a/d14/d6b/d8f/fbc [0,4194304] 0 2024-09-13T02:53:04.296 INFO:tasks.workunit.client.0.smithi098.stdout:6/630: fdatasync d5/d13/f28 0 2024-09-13T02:53:04.297 INFO:tasks.workunit.client.0.smithi098.stdout:6/631: readlink d5/d13/d2b/l58 0 2024-09-13T02:53:04.311 INFO:tasks.workunit.client.0.smithi098.stdout:6/632: dread d5/d13/f28 [0,4194304] 0 2024-09-13T02:53:04.313 INFO:tasks.workunit.client.0.smithi098.stdout:6/633: rmdir d5/d13/d2b/d3a/d5a/da8 39 2024-09-13T02:53:04.315 INFO:tasks.workunit.client.0.smithi098.stdout:6/634: mknod d5/d13/d2b/d5b/cda 0 2024-09-13T02:53:04.316 INFO:tasks.workunit.client.0.smithi098.stdout:6/635: readlink d5/d13/d2b/d3a/d5a/l71 0 2024-09-13T02:53:04.323 INFO:tasks.workunit.client.0.smithi098.stdout:6/636: dwrite d5/d13/d2b/fd3 [0,4194304] 0 2024-09-13T02:53:04.333 INFO:tasks.workunit.client.0.smithi098.stdout:6/637: link d5/d36/f6e d5/d36/d8c/fdb 0 2024-09-13T02:53:04.339 INFO:tasks.workunit.client.0.smithi098.stdout:6/638: dwrite d5/d13/d2b/d79/fb9 [0,4194304] 0 2024-09-13T02:53:04.384 INFO:tasks.workunit.client.0.smithi098.stdout:7/831: write d6/d24/d2a/d5a/d4c/f6a [3391155,39564] 0 2024-09-13T02:53:04.387 INFO:tasks.workunit.client.0.smithi098.stdout:7/832: chown d6/d24/d2a/d5a/d8e/dbd/ffe 541256 1 2024-09-13T02:53:04.390 INFO:tasks.workunit.client.0.smithi098.stdout:0/731: dwrite dd/df/d1d/d26/d28/d32/f49 [0,4194304] 0 2024-09-13T02:53:04.393 INFO:tasks.workunit.client.0.smithi098.stdout:0/732: creat dd/df/d1d/d40/ff6 x:0 0 0 2024-09-13T02:53:04.394 INFO:tasks.workunit.client.0.smithi098.stdout:0/733: readlink dd/d1f/d85/d9d/dc9/lee 0 2024-09-13T02:53:04.395 INFO:tasks.workunit.client.0.smithi098.stdout:7/833: unlink d6/d24/d2a/d5a/d86/f10c 0 2024-09-13T02:53:04.395 INFO:tasks.workunit.client.0.smithi098.stdout:0/734: chown dd/df/d1d/d40/d46/d6b/fb1 255443061 1 2024-09-13T02:53:04.399 INFO:tasks.workunit.client.0.smithi098.stdout:0/735: creat dd/df/d1d/d26/d28/d32/d67/d82/ff7 x:0 0 0 2024-09-13T02:53:04.402 INFO:tasks.workunit.client.0.smithi098.stdout:0/736: chown dd/df/d1d/d26/c7c 937197 1 2024-09-13T02:53:04.403 INFO:tasks.workunit.client.0.smithi098.stdout:0/737: fsync dd/df/d1d/d40/d46/f47 0 2024-09-13T02:53:04.405 INFO:tasks.workunit.client.0.smithi098.stdout:0/738: truncate dd/df/d1d/d26/d28/f2e 4748111 0 2024-09-13T02:53:04.408 INFO:tasks.workunit.client.0.smithi098.stdout:0/739: rename dd/df/d1d/d40/d9b/lb8 to dd/df/d1d/d40/d46/lf8 0 2024-09-13T02:53:04.411 INFO:tasks.workunit.client.0.smithi098.stdout:8/638: mkdir d2/dd/dcb 0 2024-09-13T02:53:04.414 INFO:tasks.workunit.client.0.smithi098.stdout:0/740: link dd/df/d1d/d40/d46/d6b/f8f dd/df/d1d/d40/d46/ff9 0 2024-09-13T02:53:04.424 INFO:tasks.workunit.client.0.smithi098.stdout:8/639: dread d2/d28/fa3 [0,4194304] 0 2024-09-13T02:53:04.429 INFO:tasks.workunit.client.0.smithi098.stdout:6/639: dwrite d5/f1e [0,4194304] 0 2024-09-13T02:53:04.433 INFO:tasks.workunit.client.0.smithi098.stdout:6/640: mknod d5/d13/d2b/d5b/cdc 0 2024-09-13T02:53:04.436 INFO:tasks.workunit.client.0.smithi098.stdout:6/641: rmdir d5/d13/d2b/d3a/d41/d55 39 2024-09-13T02:53:04.437 INFO:tasks.workunit.client.0.smithi098.stdout:6/642: chown d5/f1b 1729550 1 2024-09-13T02:53:04.440 INFO:tasks.workunit.client.0.smithi098.stdout:6/643: truncate d5/d13/f28 398490 0 2024-09-13T02:53:04.441 INFO:tasks.workunit.client.0.smithi098.stdout:6/644: fsync d5/d13/d2b/d79/fd2 0 2024-09-13T02:53:04.446 INFO:tasks.workunit.client.0.smithi098.stdout:6/645: creat d5/d13/fdd x:0 0 0 2024-09-13T02:53:04.447 INFO:tasks.workunit.client.0.smithi098.stdout:6/646: write d5/d13/d2b/d3a/d41/d7e/fd6 [535919,18508] 0 2024-09-13T02:53:04.448 INFO:tasks.workunit.client.0.smithi098.stdout:0/741: truncate dd/df/fcd 4086327 0 2024-09-13T02:53:04.449 INFO:tasks.workunit.client.0.smithi098.stdout:8/640: write d2/dd/d4d/f67 [3037297,11276] 0 2024-09-13T02:53:04.450 INFO:tasks.workunit.client.0.smithi098.stdout:0/742: chown dd/df/d1d/d40/f6c 412162 1 2024-09-13T02:53:04.450 INFO:tasks.workunit.client.0.smithi098.stdout:8/641: chown d2/f1b 1 1 2024-09-13T02:53:04.451 INFO:tasks.workunit.client.0.smithi098.stdout:6/647: mknod d5/d13/d67/cde 0 2024-09-13T02:53:04.451 INFO:tasks.workunit.client.0.smithi098.stdout:0/743: fdatasync dd/df/d1d/da7/fc6 0 2024-09-13T02:53:04.453 INFO:tasks.workunit.client.0.smithi098.stdout:8/642: write d2/f1a [2787669,23991] 0 2024-09-13T02:53:04.454 INFO:tasks.workunit.client.0.smithi098.stdout:6/648: chown d5/d13/d2b/d3a/d14/d6b/l9c 86167 1 2024-09-13T02:53:04.456 INFO:tasks.workunit.client.0.smithi098.stdout:8/643: mkdir d2/dd/d11/d1d/dcc 0 2024-09-13T02:53:04.461 INFO:tasks.workunit.client.0.smithi098.stdout:6/649: rename d5/d18/l44 to d5/d36/d8c/ldf 0 2024-09-13T02:53:04.465 INFO:tasks.workunit.client.0.smithi098.stdout:0/744: rename dd/d1f/d85/d9d/dc2/de4/f91 to dd/df/d1d/d26/d28/d32/d67/d71/dbd/ffa 0 2024-09-13T02:53:04.466 INFO:tasks.workunit.client.0.smithi098.stdout:0/745: truncate dd/d1f/d85/d9d/dc2/fd5 128897 0 2024-09-13T02:53:04.466 INFO:tasks.workunit.client.0.smithi098.stdout:8/644: mkdir d2/d2f/d78/d5d/dcd 0 2024-09-13T02:53:04.469 INFO:tasks.workunit.client.0.smithi098.stdout:0/746: creat dd/df/d1d/d40/d46/d6b/ffb x:0 0 0 2024-09-13T02:53:04.472 INFO:tasks.workunit.client.0.smithi098.stdout:0/747: mkdir dd/d1f/d85/dfc 0 2024-09-13T02:53:04.472 INFO:tasks.workunit.client.0.smithi098.stdout:6/650: getdents d5/d36/d8c/dbe 0 2024-09-13T02:53:04.473 INFO:tasks.workunit.client.0.smithi098.stdout:8/645: creat d2/dd/d2e/fce x:0 0 0 2024-09-13T02:53:04.482 INFO:tasks.workunit.client.0.smithi098.stdout:5/650: sync 2024-09-13T02:53:04.493 INFO:tasks.workunit.client.0.smithi098.stdout:8/646: dread d2/d28/d43/f7f [0,4194304] 0 2024-09-13T02:53:04.579 INFO:tasks.workunit.client.0.smithi098.stdout:8/647: fsync d2/dd/d11/d1d/f3a 0 2024-09-13T02:53:04.580 INFO:tasks.workunit.client.0.smithi098.stdout:8/648: dread - d2/d2f/d78/d46/d47/fb4 zero size 2024-09-13T02:53:04.581 INFO:tasks.workunit.client.0.smithi098.stdout:8/649: chown d2/dd/d11/d1d/f3e 92035 1 2024-09-13T02:53:04.583 INFO:tasks.workunit.client.0.smithi098.stdout:8/650: read d2/d2f/d78/f50 [1086194,41179] 0 2024-09-13T02:53:04.589 INFO:tasks.workunit.client.0.smithi098.stdout:8/651: rename d2/d2f/d78/d46/d74/l8a to d2/d2f/d78/dae/lcf 0 2024-09-13T02:53:04.592 INFO:tasks.workunit.client.0.smithi098.stdout:5/651: dread d0/d38/d3f/fc [0,4194304] 0 2024-09-13T02:53:04.593 INFO:tasks.workunit.client.0.smithi098.stdout:5/652: chown d0/d38/d3f/d81/d4d 18758961 1 2024-09-13T02:53:04.595 INFO:tasks.workunit.client.0.smithi098.stdout:6/651: write d5/d13/d2b/d93/f9e [971773,53998] 0 2024-09-13T02:53:04.598 INFO:tasks.workunit.client.0.smithi098.stdout:5/653: mknod d0/d15/da4/db1/ce5 0 2024-09-13T02:53:04.604 INFO:tasks.workunit.client.0.smithi098.stdout:6/652: rename d5/d13/d2b/d3a/d14/d6b/l7a to d5/d13/d2b/d3a/d41/d7e/le0 0 2024-09-13T02:53:04.607 INFO:tasks.workunit.client.0.smithi098.stdout:5/654: chown d0/d38/d3f/d81/d4d/d82/ccf 249931 1 2024-09-13T02:53:04.613 INFO:tasks.workunit.client.0.smithi098.stdout:6/653: symlink d5/d13/d2b/d93/le1 0 2024-09-13T02:53:04.614 INFO:tasks.workunit.client.0.smithi098.stdout:8/652: dwrite d2/dd/d11/d2c/f7c [0,4194304] 0 2024-09-13T02:53:04.615 INFO:tasks.workunit.client.0.smithi098.stdout:8/653: readlink d2/d2f/d78/d46/d47/d6e/l81 0 2024-09-13T02:53:04.617 INFO:tasks.workunit.client.0.smithi098.stdout:6/654: write d5/d13/d2b/d3a/d14/d6b/d8f/fbc [2108526,101278] 0 2024-09-13T02:53:04.626 INFO:tasks.workunit.client.0.smithi098.stdout:6/655: symlink d5/d13/d2b/d3a/d14/d94/d97/da3/le2 0 2024-09-13T02:53:04.629 INFO:tasks.workunit.client.0.smithi098.stdout:6/656: mkdir d5/d13/d2b/d3a/d41/d6c/d7c/de3 0 2024-09-13T02:53:04.631 INFO:tasks.workunit.client.0.smithi098.stdout:4/689: sync 2024-09-13T02:53:04.631 INFO:tasks.workunit.client.0.smithi098.stdout:3/652: sync 2024-09-13T02:53:04.632 INFO:tasks.workunit.client.0.smithi098.stdout:1/790: sync 2024-09-13T02:53:04.632 INFO:tasks.workunit.client.0.smithi098.stdout:2/707: sync 2024-09-13T02:53:04.632 INFO:tasks.workunit.client.0.smithi098.stdout:9/755: sync 2024-09-13T02:53:04.634 INFO:tasks.workunit.client.0.smithi098.stdout:3/653: stat d7/d9/d15/d80/da0 0 2024-09-13T02:53:04.634 INFO:tasks.workunit.client.0.smithi098.stdout:9/756: readlink d2/d6/d2b/d4d/d4f/l94 0 2024-09-13T02:53:04.634 INFO:tasks.workunit.client.0.smithi098.stdout:2/708: chown d1/d1a/d9/d1e/ddd/f8c 892556981 1 2024-09-13T02:53:04.634 INFO:tasks.workunit.client.0.smithi098.stdout:5/655: truncate d0/d15/d17/d1c/f9d 81952 0 2024-09-13T02:53:04.635 INFO:tasks.workunit.client.0.smithi098.stdout:4/690: chown d6/d22/d3d/d41/d74/fc4 2313884 1 2024-09-13T02:53:04.637 INFO:tasks.workunit.client.0.smithi098.stdout:8/654: write d2/d2f/d78/d5d/f95 [125020,27824] 0 2024-09-13T02:53:04.639 INFO:tasks.workunit.client.0.smithi098.stdout:3/654: mknod d7/d9/d15/d5d/cd1 0 2024-09-13T02:53:04.644 INFO:tasks.workunit.client.0.smithi098.stdout:6/657: truncate d5/f1e 5806816 0 2024-09-13T02:53:04.645 INFO:tasks.workunit.client.0.smithi098.stdout:9/757: dwrite d2/d6/d2b/d4d/d4f/d6c/dd4/dac/dd9/fe7 [0,4194304] 0 2024-09-13T02:53:04.648 INFO:tasks.workunit.client.0.smithi098.stdout:4/691: mkdir d6/d3e/d73/de7 0 2024-09-13T02:53:04.658 INFO:tasks.workunit.client.0.smithi098.stdout:3/655: truncate d7/d9/d15/f63 347611 0 2024-09-13T02:53:04.659 INFO:tasks.workunit.client.0.smithi098.stdout:8/655: dread d2/d2f/d78/d5d/f95 [0,4194304] 0 2024-09-13T02:53:04.660 INFO:tasks.workunit.client.0.smithi098.stdout:6/658: creat d5/d36/d8c/dbe/fe4 x:0 0 0 2024-09-13T02:53:04.661 INFO:tasks.workunit.client.0.smithi098.stdout:2/709: dwrite d1/d1f/d35/f4b [0,4194304] 0 2024-09-13T02:53:04.662 INFO:tasks.workunit.client.0.smithi098.stdout:5/656: truncate d0/d15/d17/daa/fb8 829276 0 2024-09-13T02:53:04.662 INFO:tasks.workunit.client.0.smithi098.stdout:2/710: fsync d1/f97 0 2024-09-13T02:53:04.664 INFO:tasks.workunit.client.0.smithi098.stdout:2/711: fsync d1/d1f/d35/d63/f65 0 2024-09-13T02:53:04.668 INFO:tasks.workunit.client.0.smithi098.stdout:1/791: rmdir d9/d33/d19/d35/d63/dd1 0 2024-09-13T02:53:04.669 INFO:tasks.workunit.client.0.smithi098.stdout:1/792: chown d9/d33/de6/f6d 45474638 1 2024-09-13T02:53:04.673 INFO:tasks.workunit.client.0.smithi098.stdout:5/657: dread d0/d38/d3f/d81/d4d/d82/f93 [0,4194304] 0 2024-09-13T02:53:04.674 INFO:tasks.workunit.client.0.smithi098.stdout:5/658: chown d0/d38/d3f/fc5 26634559 1 2024-09-13T02:53:04.675 INFO:tasks.workunit.client.0.smithi098.stdout:5/659: chown d0/d29/l7f 247 1 2024-09-13T02:53:04.677 INFO:tasks.workunit.client.0.smithi098.stdout:6/659: mkdir d5/d13/d2b/d3a/d14/d94/de5 0 2024-09-13T02:53:04.681 INFO:tasks.workunit.client.0.smithi098.stdout:9/758: mknod d2/d6/d2b/c10b 0 2024-09-13T02:53:04.688 INFO:tasks.workunit.client.0.smithi098.stdout:1/793: creat d9/d33/de6/d61/f11b x:0 0 0 2024-09-13T02:53:04.689 INFO:tasks.workunit.client.0.smithi098.stdout:3/656: rmdir d7/d9/d15/d2d/d34 39 2024-09-13T02:53:04.695 INFO:tasks.workunit.client.0.smithi098.stdout:9/759: symlink d2/d6/d2b/d4d/d4f/d6c/dd4/dac/dd9/l10c 0 2024-09-13T02:53:04.696 INFO:tasks.workunit.client.0.smithi098.stdout:2/712: rename d1/d1a/d9/la3 to d1/d1f/d35/d63/d72/d88/da8/le8 0 2024-09-13T02:53:04.697 INFO:tasks.workunit.client.0.smithi098.stdout:2/713: chown d1/d1f/d30/f34 43 1 2024-09-13T02:53:04.697 INFO:tasks.workunit.client.0.smithi098.stdout:4/692: creat d6/d22/d3d/d41/fe8 x:0 0 0 2024-09-13T02:53:04.699 INFO:tasks.workunit.client.0.smithi098.stdout:1/794: truncate d9/d33/d19/d35/d63/f69 3647822 0 2024-09-13T02:53:04.700 INFO:tasks.workunit.client.0.smithi098.stdout:3/657: mkdir d7/d9/d15/d2d/d5b/dd2 0 2024-09-13T02:53:04.703 INFO:tasks.workunit.client.0.smithi098.stdout:6/660: unlink d5/c7 0 2024-09-13T02:53:04.706 INFO:tasks.workunit.client.0.smithi098.stdout:4/693: write d6/d22/d3d/d41/d74/d98/fa8 [1225396,113810] 0 2024-09-13T02:53:04.706 INFO:tasks.workunit.client.0.smithi098.stdout:8/656: creat d2/dd/d2e/fd0 x:0 0 0 2024-09-13T02:53:04.708 INFO:tasks.workunit.client.0.smithi098.stdout:5/660: link d0/d15/d17/d1c/d3d/c5d d0/d15/d17/d1c/ce6 0 2024-09-13T02:53:04.709 INFO:tasks.workunit.client.0.smithi098.stdout:2/714: dread d1/d1a/d9/d1e/ddd/f8c [0,4194304] 0 2024-09-13T02:53:04.712 INFO:tasks.workunit.client.0.smithi098.stdout:4/694: mknod d6/d37/ce9 0 2024-09-13T02:53:04.721 INFO:tasks.workunit.client.0.smithi098.stdout:2/715: dread - d1/d1f/d35/d63/f9a zero size 2024-09-13T02:53:04.721 INFO:tasks.workunit.client.0.smithi098.stdout:3/658: dread d7/d9/d15/d2d/db8/d52/f3b [0,4194304] 0 2024-09-13T02:53:04.723 INFO:tasks.workunit.client.0.smithi098.stdout:9/760: creat d2/d6/d36/d8d/dc8/f10d x:0 0 0 2024-09-13T02:53:04.727 INFO:tasks.workunit.client.0.smithi098.stdout:2/716: dwrite d1/d1a/d9/d1e/d5a/f5f [0,4194304] 0 2024-09-13T02:53:04.728 INFO:tasks.workunit.client.0.smithi098.stdout:2/717: stat d1/d1a/d9/d1e/ddd 0 2024-09-13T02:53:04.729 INFO:tasks.workunit.client.0.smithi098.stdout:1/795: rename d9/d33/d19/d35/d68/d4d/dbc to d9/d33/d29/d11c 0 2024-09-13T02:53:04.735 INFO:tasks.workunit.client.0.smithi098.stdout:5/661: mknod d0/d15/d17/ce7 0 2024-09-13T02:53:04.741 INFO:tasks.workunit.client.0.smithi098.stdout:9/761: truncate d2/db1/dc5/fda 342921 0 2024-09-13T02:53:04.741 INFO:tasks.workunit.client.0.smithi098.stdout:8/657: write d2/dd/d11/d1d/f45 [118684,28244] 0 2024-09-13T02:53:04.741 INFO:tasks.workunit.client.0.smithi098.stdout:2/718: readlink d1/d1f/d35/d63/d23/l84 0 2024-09-13T02:53:04.743 INFO:tasks.workunit.client.0.smithi098.stdout:6/661: dwrite d5/f33 [0,4194304] 0 2024-09-13T02:53:04.753 INFO:tasks.workunit.client.0.smithi098.stdout:4/695: write d6/d22/d3d/d41/d58/f69 [527231,126803] 0 2024-09-13T02:53:04.755 INFO:tasks.workunit.client.0.smithi098.stdout:2/719: creat d1/d1a/d9/d1e/fe9 x:0 0 0 2024-09-13T02:53:04.757 INFO:tasks.workunit.client.0.smithi098.stdout:9/762: write d2/d6/d36/f4e [5192365,64875] 0 2024-09-13T02:53:04.761 INFO:tasks.workunit.client.0.smithi098.stdout:3/659: getdents d7/d9/d15/d2d 0 2024-09-13T02:53:04.766 INFO:tasks.workunit.client.0.smithi098.stdout:5/662: getdents d0/d38/d3f/d1a 0 2024-09-13T02:53:04.770 INFO:tasks.workunit.client.0.smithi098.stdout:6/662: dwrite d5/fc [0,4194304] 0 2024-09-13T02:53:04.772 INFO:tasks.workunit.client.0.smithi098.stdout:3/660: rename d7/d9/d25/d64/d6f/fa5 to d7/d9/d15/d2d/db8/d51/fd3 0 2024-09-13T02:53:04.775 INFO:tasks.workunit.client.0.smithi098.stdout:5/663: unlink d0/d38/d3f/f11 0 2024-09-13T02:53:04.777 INFO:tasks.workunit.client.0.smithi098.stdout:4/696: link d6/l9e d6/d3e/d46/lea 0 2024-09-13T02:53:04.779 INFO:tasks.workunit.client.0.smithi098.stdout:2/720: dread d1/d1f/d39/f21 [0,4194304] 0 2024-09-13T02:53:04.780 INFO:tasks.workunit.client.0.smithi098.stdout:6/663: rename d5/f22 to d5/d13/d67/d85/fe6 0 2024-09-13T02:53:04.781 INFO:tasks.workunit.client.0.smithi098.stdout:3/661: fdatasync d7/d9/d15/d26/f6e 0 2024-09-13T02:53:04.782 INFO:tasks.workunit.client.0.smithi098.stdout:3/662: stat d7/d9/d15/d2d/c35 0 2024-09-13T02:53:04.785 INFO:tasks.workunit.client.0.smithi098.stdout:6/664: dread d5/fc [0,4194304] 0 2024-09-13T02:53:04.786 INFO:tasks.workunit.client.0.smithi098.stdout:6/665: fsync d5/d6f/fae 0 2024-09-13T02:53:04.788 INFO:tasks.workunit.client.0.smithi098.stdout:2/721: creat d1/d1f/d35/d63/d72/d88/fea x:0 0 0 2024-09-13T02:53:04.791 INFO:tasks.workunit.client.0.smithi098.stdout:3/663: mkdir d7/d9/d15/d80/da0/dd4 0 2024-09-13T02:53:04.795 INFO:tasks.workunit.client.0.smithi098.stdout:6/666: symlink d5/d18/d50/le7 0 2024-09-13T02:53:04.795 INFO:tasks.workunit.client.0.smithi098.stdout:9/763: write d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/f105 [8661607,68708] 0 2024-09-13T02:53:04.797 INFO:tasks.workunit.client.0.smithi098.stdout:6/667: truncate d5/d6f/fae 835499 0 2024-09-13T02:53:04.800 INFO:tasks.workunit.client.0.smithi098.stdout:3/664: mkdir d7/d9/d25/d64/dd5 0 2024-09-13T02:53:04.802 INFO:tasks.workunit.client.0.smithi098.stdout:9/764: creat d2/d6/d2b/d4d/d4f/d6c/dd4/dac/f10e x:0 0 0 2024-09-13T02:53:04.805 INFO:tasks.workunit.client.0.smithi098.stdout:4/697: dread d6/d22/d3d/d41/d74/fc4 [0,4194304] 0 2024-09-13T02:53:04.805 INFO:tasks.workunit.client.0.smithi098.stdout:3/665: truncate d7/d9/d15/d2d/db8/d52/f55 1609798 0 2024-09-13T02:53:04.806 INFO:tasks.workunit.client.0.smithi098.stdout:4/698: truncate d6/d37/d7a/f89 4273029 0 2024-09-13T02:53:04.814 INFO:tasks.workunit.client.0.smithi098.stdout:3/666: mkdir d7/d9/d15/d2d/d34/dd6 0 2024-09-13T02:53:04.817 INFO:tasks.workunit.client.0.smithi098.stdout:6/668: getdents d5/d13/d2b/d3a 0 2024-09-13T02:53:04.817 INFO:tasks.workunit.client.0.smithi098.stdout:2/722: dwrite d1/d1f/d35/d63/d23/f81 [0,4194304] 0 2024-09-13T02:53:04.818 INFO:tasks.workunit.client.0.smithi098.stdout:6/669: fsync d5/d18/f25 0 2024-09-13T02:53:04.820 INFO:tasks.workunit.client.0.smithi098.stdout:6/670: write d5/d13/d2b/d3a/f86 [4035504,74898] 0 2024-09-13T02:53:04.821 INFO:tasks.workunit.client.0.smithi098.stdout:4/699: dread d6/d3e/d68/f38 [0,4194304] 0 2024-09-13T02:53:04.823 INFO:tasks.workunit.client.0.smithi098.stdout:3/667: fdatasync d7/d9/d15/d5d/fa8 0 2024-09-13T02:53:04.824 INFO:tasks.workunit.client.0.smithi098.stdout:3/668: fsync d7/d9/d15/d2d/db8/d51/d9c/fce 0 2024-09-13T02:53:04.827 INFO:tasks.workunit.client.0.smithi098.stdout:4/700: truncate d6/d3e/d68/f36 2024719 0 2024-09-13T02:53:04.829 INFO:tasks.workunit.client.0.smithi098.stdout:2/723: symlink d1/d1a/leb 0 2024-09-13T02:53:04.833 INFO:tasks.workunit.client.0.smithi098.stdout:4/701: read d6/d3e/d46/f86 [72948,17664] 0 2024-09-13T02:53:04.833 INFO:tasks.workunit.client.0.smithi098.stdout:4/702: fdatasync d6/d8d/fd0 0 2024-09-13T02:53:04.834 INFO:tasks.workunit.client.0.smithi098.stdout:4/703: fdatasync d6/d22/fdf 0 2024-09-13T02:53:04.835 INFO:tasks.workunit.client.0.smithi098.stdout:3/669: mknod d7/d9/d25/cd7 0 2024-09-13T02:53:04.838 INFO:tasks.workunit.client.0.smithi098.stdout:4/704: fsync d6/d54/d6a/fba 0 2024-09-13T02:53:04.839 INFO:tasks.workunit.client.0.smithi098.stdout:3/670: creat d7/d9/d15/d5d/da1/fd8 x:0 0 0 2024-09-13T02:53:04.840 INFO:tasks.workunit.client.0.smithi098.stdout:6/671: getdents d5/d13/d51 0 2024-09-13T02:53:04.841 INFO:tasks.workunit.client.0.smithi098.stdout:3/671: truncate d7/fbf 954087 0 2024-09-13T02:53:04.842 INFO:tasks.workunit.client.0.smithi098.stdout:3/672: fdatasync d7/d9/d15/d26/f2a 0 2024-09-13T02:53:04.843 INFO:tasks.workunit.client.0.smithi098.stdout:4/705: creat d6/d22/d3d/dc8/dd5/feb x:0 0 0 2024-09-13T02:53:04.843 INFO:tasks.workunit.client.0.smithi098.stdout:4/706: chown d6/d3e 0 1 2024-09-13T02:53:04.844 INFO:tasks.workunit.client.0.smithi098.stdout:6/672: mknod d5/d13/d51/ce8 0 2024-09-13T02:53:04.844 INFO:tasks.workunit.client.0.smithi098.stdout:6/673: readlink d5/d36/l75 0 2024-09-13T02:53:04.846 INFO:tasks.workunit.client.0.smithi098.stdout:6/674: readlink d5/d13/d2b/d3a/d41/d6c/l8b 0 2024-09-13T02:53:04.851 INFO:tasks.workunit.client.0.smithi098.stdout:6/675: truncate d5/d13/d2b/d3a/d14/f3b 286264 0 2024-09-13T02:53:04.853 INFO:tasks.workunit.client.0.smithi098.stdout:6/676: write d5/d18/f1f [3777276,67591] 0 2024-09-13T02:53:04.854 INFO:tasks.workunit.client.0.smithi098.stdout:4/707: dwrite d6/d22/d3d/d6c/fd4 [4194304,4194304] 0 2024-09-13T02:53:04.855 INFO:tasks.workunit.client.0.smithi098.stdout:3/673: rmdir d7/d9/dd0 0 2024-09-13T02:53:04.857 INFO:tasks.workunit.client.0.smithi098.stdout:3/674: fdatasync d7/d9/d25/d64/d6f/f83 0 2024-09-13T02:53:04.858 INFO:tasks.workunit.client.0.smithi098.stdout:2/724: dread d1/d1a/d9/d1e/ddd/d7f/f85 [0,4194304] 0 2024-09-13T02:53:04.866 INFO:tasks.workunit.client.0.smithi098.stdout:3/675: dwrite d7/d9/d15/d5d/fba [0,4194304] 0 2024-09-13T02:53:04.880 INFO:tasks.workunit.client.0.smithi098.stdout:6/677: fdatasync d5/d36/f6e 0 2024-09-13T02:53:04.880 INFO:tasks.workunit.client.0.smithi098.stdout:6/678: fsync d5/d6f/fae 0 2024-09-13T02:53:04.884 INFO:tasks.workunit.client.0.smithi098.stdout:3/676: mkdir d7/d9/d15/d2d/db8/d7c/dd9 0 2024-09-13T02:53:04.892 INFO:tasks.workunit.client.0.smithi098.stdout:6/679: creat d5/d13/d2b/d79/fe9 x:0 0 0 2024-09-13T02:53:04.893 INFO:tasks.workunit.client.0.smithi098.stdout:6/680: chown d5/d13/d51/f60 5602517 1 2024-09-13T02:53:04.894 INFO:tasks.workunit.client.0.smithi098.stdout:6/681: fsync d5/d13/d2b/d3a/d41/f95 0 2024-09-13T02:53:04.896 INFO:tasks.workunit.client.0.smithi098.stdout:2/725: link d1/d1f/d35/c98 d1/d1a/d9/d1e/ddd/cec 0 2024-09-13T02:53:04.897 INFO:tasks.workunit.client.0.smithi098.stdout:2/726: readlink d1/d1f/d35/d63/l16 0 2024-09-13T02:53:04.901 INFO:tasks.workunit.client.0.smithi098.stdout:4/708: getdents d6/d22/d3d/d41/d74/d98 0 2024-09-13T02:53:04.903 INFO:tasks.workunit.client.0.smithi098.stdout:4/709: write d6/d22/d3d/d41/d58/faa [1071902,120236] 0 2024-09-13T02:53:04.904 INFO:tasks.workunit.client.0.smithi098.stdout:2/727: fdatasync d1/d1f/d39/f8e 0 2024-09-13T02:53:04.918 INFO:tasks.workunit.client.0.smithi098.stdout:3/677: write d7/d9/d15/d2d/d78/d7e/fb5 [1476147,54585] 0 2024-09-13T02:53:04.930 INFO:tasks.workunit.client.0.smithi098.stdout:2/728: write d1/d1f/d35/d63/f3f [821557,12100] 0 2024-09-13T02:53:04.932 INFO:tasks.workunit.client.0.smithi098.stdout:2/729: mknod d1/d1f/d35/d63/ced 0 2024-09-13T02:53:04.989 INFO:tasks.workunit.client.0.smithi098.stdout:3/678: write d7/d9/f31 [3759554,9764] 0 2024-09-13T02:53:04.993 INFO:tasks.workunit.client.0.smithi098.stdout:3/679: read f4 [1062648,54587] 0 2024-09-13T02:53:04.994 INFO:tasks.workunit.client.0.smithi098.stdout:3/680: chown d7/d9/d15/d2d/d5b/dd2 1926177 1 2024-09-13T02:53:04.996 INFO:tasks.workunit.client.0.smithi098.stdout:2/730: dread d1/d1a/d9/d1e/ddd/d59/d9e/d9f/fa9 [0,4194304] 0 2024-09-13T02:53:04.997 INFO:tasks.workunit.client.0.smithi098.stdout:3/681: read d7/d9/f31 [1987434,87645] 0 2024-09-13T02:53:04.998 INFO:tasks.workunit.client.0.smithi098.stdout:2/731: chown d1/d1a/d9/d1e/ddd/d59/d9e/d9f/de0 1704 1 2024-09-13T02:53:04.999 INFO:tasks.workunit.client.0.smithi098.stdout:3/682: chown d7/d9/d15/d2d/db8/c48 42940618 1 2024-09-13T02:53:05.000 INFO:tasks.workunit.client.0.smithi098.stdout:3/683: write d7/d9/d15/d26/f84 [642818,25898] 0 2024-09-13T02:53:05.003 INFO:tasks.workunit.client.0.smithi098.stdout:3/684: read d7/d9/f31 [681379,109415] 0 2024-09-13T02:53:05.006 INFO:tasks.workunit.client.0.smithi098.stdout:2/732: dwrite d1/d1a/d9/d1e/ddd/d59/d9e/d9f/fbf [0,4194304] 0 2024-09-13T02:53:05.011 INFO:tasks.workunit.client.0.smithi098.stdout:3/685: creat d7/d9/fda x:0 0 0 2024-09-13T02:53:05.014 INFO:tasks.workunit.client.0.smithi098.stdout:2/733: dread d1/d1f/d35/d63/f3f [0,4194304] 0 2024-09-13T02:53:05.016 INFO:tasks.workunit.client.0.smithi098.stdout:3/686: rename d7/d9/d15/d2d/db8/db7 to d7/d9/d15/d2d/db8/d51/ddb 0 2024-09-13T02:53:05.017 INFO:tasks.workunit.client.0.smithi098.stdout:2/734: creat d1/d1a/d9/d1e/ddd/d7f/fee x:0 0 0 2024-09-13T02:53:05.018 INFO:tasks.workunit.client.0.smithi098.stdout:3/687: chown d7/d9/d15/d2d/d5b/d70/d90/lbc 6310215 1 2024-09-13T02:53:05.019 INFO:tasks.workunit.client.0.smithi098.stdout:3/688: chown d7/d9/d4c/f79 28204721 1 2024-09-13T02:53:05.020 INFO:tasks.workunit.client.0.smithi098.stdout:3/689: fdatasync d7/d9/d15/d2d/d78/d7e/fb5 0 2024-09-13T02:53:05.021 INFO:tasks.workunit.client.0.smithi098.stdout:3/690: chown d7/d9/d15/f85 61439634 1 2024-09-13T02:53:05.022 INFO:tasks.workunit.client.0.smithi098.stdout:2/735: rename d1/d1f/d35/d63/d72/d88 to d1/d1f/d30/def 0 2024-09-13T02:53:05.025 INFO:tasks.workunit.client.0.smithi098.stdout:3/691: rename d7/d9/d15/d2d/d5b/d70/d90/cb0 to d7/d9/d15/d2d/db8/d51/d9c/cdc 0 2024-09-13T02:53:05.026 INFO:tasks.workunit.client.0.smithi098.stdout:3/692: readlink d7/d9/d15/d2d/lad 0 2024-09-13T02:53:05.026 INFO:tasks.workunit.client.0.smithi098.stdout:2/736: read d1/d1f/d39/fba [20033,14696] 0 2024-09-13T02:53:05.028 INFO:tasks.workunit.client.0.smithi098.stdout:2/737: mkdir d1/d1f/d30/def/df0 0 2024-09-13T02:53:05.031 INFO:tasks.workunit.client.0.smithi098.stdout:2/738: mkdir d1/d1a/d9/d1e/ddd/df1 0 2024-09-13T02:53:05.033 INFO:tasks.workunit.client.0.smithi098.stdout:2/739: rmdir d1 39 2024-09-13T02:53:05.039 INFO:tasks.workunit.client.0.smithi098.stdout:3/693: truncate d7/d9/d25/f71 3379290 0 2024-09-13T02:53:05.040 INFO:tasks.workunit.client.0.smithi098.stdout:2/740: dwrite d1/d1f/d35/d63/f65 [0,4194304] 0 2024-09-13T02:53:05.043 INFO:tasks.workunit.client.0.smithi098.stdout:3/694: creat d7/d9/d15/d2d/fdd x:0 0 0 2024-09-13T02:53:05.047 INFO:tasks.workunit.client.0.smithi098.stdout:2/741: mknod d1/d1a/d9/d1e/ddd/df1/cf2 0 2024-09-13T02:53:05.053 INFO:tasks.workunit.client.0.smithi098.stdout:2/742: rename d1/d1f/f66 to d1/d1a/d9/d1e/ddd/d59/d9e/d9f/de0/ff3 0 2024-09-13T02:53:05.069 INFO:tasks.workunit.client.0.smithi098.stdout:3/695: unlink d7/d9/d15/d2d/db8/d51/fd3 0 2024-09-13T02:53:05.070 INFO:tasks.workunit.client.0.smithi098.stdout:3/696: write d7/d9/d15/d2d/db8/d51/d9c/fce [750678,48417] 0 2024-09-13T02:53:05.071 INFO:tasks.workunit.client.0.smithi098.stdout:2/743: rename d1/d1f/d39/c1b to d1/d1f/d35/d63/cf4 0 2024-09-13T02:53:05.075 INFO:tasks.workunit.client.0.smithi098.stdout:2/744: creat d1/d1f/d30/def/ff5 x:0 0 0 2024-09-13T02:53:05.077 INFO:tasks.workunit.client.0.smithi098.stdout:3/697: dwrite d7/d9/d15/d2d/db8/d51/d9c/fce [0,4194304] 0 2024-09-13T02:53:05.081 INFO:tasks.workunit.client.0.smithi098.stdout:3/698: symlink d7/d9/d15/d80/da0/lde 0 2024-09-13T02:53:05.082 INFO:tasks.workunit.client.0.smithi098.stdout:3/699: fsync d7/d9/d25/d2b/f3e 0 2024-09-13T02:53:05.084 INFO:tasks.workunit.client.0.smithi098.stdout:2/745: rename d1/d1a/d9/d1e/ddd to d1/d1f/d39/df6 0 2024-09-13T02:53:05.100 INFO:tasks.workunit.client.0.smithi098.stdout:2/746: write d1/d1f/d39/df6/d59/fd0 [534179,51770] 0 2024-09-13T02:53:05.100 INFO:tasks.workunit.client.0.smithi098.stdout:3/700: getdents d7/d9/d15/d2d/d34 0 2024-09-13T02:53:05.103 INFO:tasks.workunit.client.0.smithi098.stdout:3/701: mknod d7/d9/d15/d2d/db8/d51/ddb/cdf 0 2024-09-13T02:53:05.103 INFO:tasks.workunit.client.0.smithi098.stdout:3/702: chown d7/l3f 7268 1 2024-09-13T02:53:05.104 INFO:tasks.workunit.client.0.smithi098.stdout:3/703: chown d7/f3d 1 1 2024-09-13T02:53:05.106 INFO:tasks.workunit.client.0.smithi098.stdout:3/704: creat d7/d9/d25/d64/fe0 x:0 0 0 2024-09-13T02:53:05.168 INFO:tasks.workunit.client.0.smithi098.stdout:7/834: sync 2024-09-13T02:53:05.172 INFO:tasks.workunit.client.0.smithi098.stdout:7/835: symlink d6/d24/d2a/d5a/d86/db1/dc2/l111 0 2024-09-13T02:53:05.181 INFO:tasks.workunit.client.0.smithi098.stdout:7/836: write d6/d47/fb7 [100530,71575] 0 2024-09-13T02:53:05.184 INFO:tasks.workunit.client.0.smithi098.stdout:7/837: mkdir d6/df9/d110/d112 0 2024-09-13T02:53:05.190 INFO:tasks.workunit.client.0.smithi098.stdout:7/838: link d6/d1e/f62 d6/d24/dc5/de3/de6/d108/f113 0 2024-09-13T02:53:05.194 INFO:tasks.workunit.client.0.smithi098.stdout:7/839: symlink d6/d24/dc5/de3/dcf/ded/l114 0 2024-09-13T02:53:05.206 INFO:tasks.workunit.client.0.smithi098.stdout:7/840: dread d6/d24/d2a/d57/d88/f54 [0,4194304] 0 2024-09-13T02:53:05.207 INFO:tasks.workunit.client.0.smithi098.stdout:7/841: fdatasync d6/d24/d2a/d5a/d42/d45/d73/f10f 0 2024-09-13T02:53:05.218 INFO:tasks.workunit.client.0.smithi098.stdout:7/842: getdents d6/d24/d2a/d5a/d42 0 2024-09-13T02:53:05.259 INFO:tasks.workunit.client.0.smithi098.stdout:7/843: symlink d6/d24/dc5/de3/de6/d108/l115 0 2024-09-13T02:53:05.263 INFO:tasks.workunit.client.0.smithi098.stdout:7/844: link d6/d24/dc5/de3/de6/d108/l109 d6/d24/d46/d100/l116 0 2024-09-13T02:53:05.272 INFO:tasks.workunit.client.0.smithi098.stdout:7/845: write d6/d24/d2a/d5a/d86/d65/f8f [1284378,110692] 0 2024-09-13T02:53:05.276 INFO:tasks.workunit.client.0.smithi098.stdout:7/846: rename d6/d24/d2a/d5a/d4c/fac to d6/d24/d2a/d5a/d86/db1/dc2/f117 0 2024-09-13T02:53:05.277 INFO:tasks.workunit.client.0.smithi098.stdout:7/847: creat d6/d24/dc5/de3/f118 x:0 0 0 2024-09-13T02:53:05.278 INFO:tasks.workunit.client.0.smithi098.stdout:7/848: chown d6/d24/d2a/dda/dbb 7613 1 2024-09-13T02:53:05.283 INFO:tasks.workunit.client.0.smithi098.stdout:7/849: getdents d6/d24/dc5/de3/ddf 0 2024-09-13T02:53:05.285 INFO:tasks.workunit.client.0.smithi098.stdout:7/850: symlink d6/d24/d2a/d5a/d86/db1/l119 0 2024-09-13T02:53:05.287 INFO:tasks.workunit.client.0.smithi098.stdout:7/851: creat d6/d24/d2a/d5a/d86/f11a x:0 0 0 2024-09-13T02:53:05.324 INFO:tasks.workunit.client.0.smithi098.stdout:7/852: getdents d6/d24/d2a/d5a/d86/d65 0 2024-09-13T02:53:05.328 INFO:tasks.workunit.client.0.smithi098.stdout:7/853: mknod d6/d24/d2a/d5a/d4c/da5/c11b 0 2024-09-13T02:53:05.331 INFO:tasks.workunit.client.0.smithi098.stdout:7/854: mkdir d6/d24/d2a/dda/d11c 0 2024-09-13T02:53:05.334 INFO:tasks.workunit.client.0.smithi098.stdout:7/855: mkdir d6/d24/d2a/d5a/d8e/df0/d11d 0 2024-09-13T02:53:05.337 INFO:tasks.workunit.client.0.smithi098.stdout:7/856: creat d6/d24/d2a/d5a/d86/d65/f11e x:0 0 0 2024-09-13T02:53:05.338 INFO:tasks.workunit.client.0.smithi098.stdout:7/857: write d6/fca [789008,104931] 0 2024-09-13T02:53:05.344 INFO:tasks.workunit.client.0.smithi098.stdout:7/858: rmdir d6/d24 39 2024-09-13T02:53:05.349 INFO:tasks.workunit.client.0.smithi098.stdout:7/859: rename d6/d1e/c53 to d6/df9/d110/c11f 0 2024-09-13T02:53:05.350 INFO:tasks.workunit.client.0.smithi098.stdout:7/860: fdatasync d6/d1e/f36 0 2024-09-13T02:53:05.363 INFO:tasks.workunit.client.0.smithi098.stdout:7/861: dwrite d6/d24/d46/fec [0,4194304] 0 2024-09-13T02:53:05.366 INFO:tasks.workunit.client.0.smithi098.stdout:7/862: creat d6/d24/dc5/de3/f120 x:0 0 0 2024-09-13T02:53:05.369 INFO:tasks.workunit.client.0.smithi098.stdout:7/863: dread - d6/d24/dc5/fdc zero size 2024-09-13T02:53:05.370 INFO:tasks.workunit.client.0.smithi098.stdout:7/864: stat d6/d24/d2a/d5a/f38 0 2024-09-13T02:53:05.374 INFO:tasks.workunit.client.0.smithi098.stdout:7/865: unlink d6/d24/f28 0 2024-09-13T02:53:05.465 INFO:tasks.workunit.client.0.smithi098.stdout:0/748: sync 2024-09-13T02:53:05.477 INFO:tasks.workunit.client.0.smithi098.stdout:7/866: creat d6/d24/d2a/d5a/d42/d45/d73/f121 x:0 0 0 2024-09-13T02:53:05.482 INFO:tasks.workunit.client.0.smithi098.stdout:0/749: dread dd/d1f/f25 [4194304,4194304] 0 2024-09-13T02:53:05.538 INFO:tasks.workunit.client.0.smithi098.stdout:0/750: unlink dd/df/faa 0 2024-09-13T02:53:05.540 INFO:tasks.workunit.client.0.smithi098.stdout:7/867: dwrite d6/d24/d2a/d5a/f4d [0,4194304] 0 2024-09-13T02:53:05.543 INFO:tasks.workunit.client.0.smithi098.stdout:0/751: creat dd/df/d1d/d26/d28/d32/d8d/ffd x:0 0 0 2024-09-13T02:53:05.559 INFO:tasks.workunit.client.0.smithi098.stdout:0/752: dwrite dd/df/d1d/f63 [0,4194304] 0 2024-09-13T02:53:05.570 INFO:tasks.workunit.client.0.smithi098.stdout:0/753: link dd/df/d1d/d40/d46/fad dd/d1f/d85/ffe 0 2024-09-13T02:53:05.571 INFO:tasks.workunit.client.0.smithi098.stdout:0/754: chown dd/df/cdf 9 1 2024-09-13T02:53:05.572 INFO:tasks.workunit.client.0.smithi098.stdout:7/868: dwrite d6/d24/d2a/f3a [0,4194304] 0 2024-09-13T02:53:05.572 INFO:tasks.workunit.client.0.smithi098.stdout:0/755: chown dd/df/d1d/d40 745 1 2024-09-13T02:53:05.578 INFO:tasks.workunit.client.0.smithi098.stdout:7/869: rename d6/d24/d2a/d5a/d42/d45/d73/fe9 to d6/df9/d110/f122 0 2024-09-13T02:53:05.579 INFO:tasks.workunit.client.0.smithi098.stdout:0/756: creat dd/df/d1d/d26/d28/fff x:0 0 0 2024-09-13T02:53:05.580 INFO:tasks.workunit.client.0.smithi098.stdout:7/870: dread - d6/d24/d2a/d5a/d42/fb6 zero size 2024-09-13T02:53:05.581 INFO:tasks.workunit.client.0.smithi098.stdout:7/871: chown d6/d24/d2a/d5a/d8e/df0/d11d 125546 1 2024-09-13T02:53:05.581 INFO:tasks.workunit.client.0.smithi098.stdout:1/796: sync 2024-09-13T02:53:05.581 INFO:tasks.workunit.client.0.smithi098.stdout:8/658: sync 2024-09-13T02:53:05.584 INFO:tasks.workunit.client.0.smithi098.stdout:1/797: readlink d9/d33/d19/d35/d68/d4d/l53 0 2024-09-13T02:53:05.586 INFO:tasks.workunit.client.0.smithi098.stdout:7/872: symlink d6/d24/d2a/d5a/d42/dde/l123 0 2024-09-13T02:53:05.587 INFO:tasks.workunit.client.0.smithi098.stdout:7/873: chown d6/dab/fe1 23019510 1 2024-09-13T02:53:05.588 INFO:tasks.workunit.client.0.smithi098.stdout:0/757: dwrite dd/df/d1d/d26/d28/ff2 [0,4194304] 0 2024-09-13T02:53:05.590 INFO:tasks.workunit.client.0.smithi098.stdout:1/798: symlink d9/d33/de6/d61/ddb/l11d 0 2024-09-13T02:53:05.594 INFO:tasks.workunit.client.0.smithi098.stdout:8/659: creat d2/dd/fd1 x:0 0 0 2024-09-13T02:53:05.595 INFO:tasks.workunit.client.0.smithi098.stdout:7/874: mkdir d6/d24/d2a/d57/d124 0 2024-09-13T02:53:05.599 INFO:tasks.workunit.client.0.smithi098.stdout:8/660: mkdir d2/d2f/d78/d46/d74/d86/dd2 0 2024-09-13T02:53:05.602 INFO:tasks.workunit.client.0.smithi098.stdout:8/661: dread - d2/dd/fa5 zero size 2024-09-13T02:53:05.606 INFO:tasks.workunit.client.0.smithi098.stdout:0/758: write dd/df/d1d/d40/d46/ff9 [3876512,115564] 0 2024-09-13T02:53:05.610 INFO:tasks.workunit.client.0.smithi098.stdout:8/662: creat d2/d2f/fd3 x:0 0 0 2024-09-13T02:53:05.614 INFO:tasks.workunit.client.0.smithi098.stdout:7/875: dwrite d6/d24/d46/fc4 [0,4194304] 0 2024-09-13T02:53:05.614 INFO:tasks.workunit.client.0.smithi098.stdout:0/759: unlink dd/df/c2a 0 2024-09-13T02:53:05.616 INFO:tasks.workunit.client.0.smithi098.stdout:1/799: dread d9/d33/d19/d35/d68/d2f/f48 [0,4194304] 0 2024-09-13T02:53:05.619 INFO:tasks.workunit.client.0.smithi098.stdout:7/876: fdatasync d6/d1e/faf 0 2024-09-13T02:53:05.622 INFO:tasks.workunit.client.0.smithi098.stdout:1/800: fdatasync d9/f1c 0 2024-09-13T02:53:05.624 INFO:tasks.workunit.client.0.smithi098.stdout:8/663: creat d2/d2f/d78/d46/d5c/fd4 x:0 0 0 2024-09-13T02:53:05.630 INFO:tasks.workunit.client.0.smithi098.stdout:1/801: creat d9/d33/d19/d35/d68/d4d/db5/df3/f11e x:0 0 0 2024-09-13T02:53:05.631 INFO:tasks.workunit.client.0.smithi098.stdout:8/664: mknod d2/dd/d11/d44/cd5 0 2024-09-13T02:53:05.633 INFO:tasks.workunit.client.0.smithi098.stdout:0/760: creat dd/f100 x:0 0 0 2024-09-13T02:53:05.635 INFO:tasks.workunit.client.0.smithi098.stdout:0/761: dread dd/d1f/d85/d9d/dc2/fd5 [0,4194304] 0 2024-09-13T02:53:05.639 INFO:tasks.workunit.client.0.smithi098.stdout:7/877: write d6/d1e/f1f [1103636,2060] 0 2024-09-13T02:53:05.641 INFO:tasks.workunit.client.0.smithi098.stdout:7/878: read - d6/d24/d2a/d5a/d86/d65/d9a/f10d zero size 2024-09-13T02:53:05.644 INFO:tasks.workunit.client.0.smithi098.stdout:1/802: link d9/d33/d19/d46/c4c d9/d33/d87/c11f 0 2024-09-13T02:53:05.651 INFO:tasks.workunit.client.0.smithi098.stdout:8/665: dread d2/dd/d11/f4c [0,4194304] 0 2024-09-13T02:53:05.653 INFO:tasks.workunit.client.0.smithi098.stdout:1/803: dwrite d9/d33/d19/d35/d68/f101 [0,4194304] 0 2024-09-13T02:53:05.657 INFO:tasks.workunit.client.0.smithi098.stdout:8/666: mkdir d2/d2f/d78/d46/d47/d6e/d68/dd6 0 2024-09-13T02:53:05.661 INFO:tasks.workunit.client.0.smithi098.stdout:7/879: dwrite d6/d24/d2a/d5a/d86/f8d [0,4194304] 0 2024-09-13T02:53:05.661 INFO:tasks.workunit.client.0.smithi098.stdout:1/804: creat d9/d33/f120 x:0 0 0 2024-09-13T02:53:05.663 INFO:tasks.workunit.client.0.smithi098.stdout:8/667: symlink d2/d2f/ld7 0 2024-09-13T02:53:05.663 INFO:tasks.workunit.client.0.smithi098.stdout:1/805: stat d9/d33/d19/d35/d68/d4d/db5/dd3 0 2024-09-13T02:53:05.663 INFO:tasks.workunit.client.0.smithi098.stdout:7/880: rmdir d6/d24/dc5/de3/dcf 39 2024-09-13T02:53:05.671 INFO:tasks.workunit.client.0.smithi098.stdout:7/881: unlink d6/d24/d2a/d57/ff3 0 2024-09-13T02:53:05.671 INFO:tasks.workunit.client.0.smithi098.stdout:7/882: readlink l2 0 2024-09-13T02:53:05.673 INFO:tasks.workunit.client.0.smithi098.stdout:7/883: write d6/d24/d2a/d5a/d4c/fd8 [955188,130839] 0 2024-09-13T02:53:05.676 INFO:tasks.workunit.client.0.smithi098.stdout:7/884: fsync d6/d24/d46/f5c 0 2024-09-13T02:53:05.683 INFO:tasks.workunit.client.0.smithi098.stdout:8/668: write d2/dd/d4d/d96/f85 [1461882,36901] 0 2024-09-13T02:53:05.685 INFO:tasks.workunit.client.0.smithi098.stdout:7/885: dwrite d6/d24/d2a/d5a/d42/fb6 [0,4194304] 0 2024-09-13T02:53:05.687 INFO:tasks.workunit.client.0.smithi098.stdout:1/806: write d9/d33/d87/f11a [637404,5774] 0 2024-09-13T02:53:05.688 INFO:tasks.workunit.client.0.smithi098.stdout:8/669: mkdir d2/d28/d43/d88/dd8 0 2024-09-13T02:53:05.695 INFO:tasks.workunit.client.0.smithi098.stdout:8/670: dwrite d2/dd/d11/d2c/f7c [0,4194304] 0 2024-09-13T02:53:05.698 INFO:tasks.workunit.client.0.smithi098.stdout:7/886: write d6/fc [2366364,112112] 0 2024-09-13T02:53:05.701 INFO:tasks.workunit.client.0.smithi098.stdout:7/887: creat d6/d24/d2a/d5a/d86/d65/d9a/f125 x:0 0 0 2024-09-13T02:53:05.703 INFO:tasks.workunit.client.0.smithi098.stdout:7/888: mknod d6/df6/c126 0 2024-09-13T02:53:05.706 INFO:tasks.workunit.client.0.smithi098.stdout:7/889: creat d6/d24/dc5/f127 x:0 0 0 2024-09-13T02:53:05.708 INFO:tasks.workunit.client.0.smithi098.stdout:7/890: readlink d6/d1e/l84 0 2024-09-13T02:53:05.709 INFO:tasks.workunit.client.0.smithi098.stdout:8/671: truncate d2/dd/d11/f18 3135928 0 2024-09-13T02:53:05.715 INFO:tasks.workunit.client.0.smithi098.stdout:8/672: rename d2/fbe to d2/d2f/d78/d5d/dcd/fd9 0 2024-09-13T02:53:05.718 INFO:tasks.workunit.client.0.smithi098.stdout:8/673: dread d2/d2f/d78/d5d/f95 [0,4194304] 0 2024-09-13T02:53:05.721 INFO:tasks.workunit.client.0.smithi098.stdout:1/807: dread d9/d33/f67 [0,4194304] 0 2024-09-13T02:53:05.722 INFO:tasks.workunit.client.0.smithi098.stdout:7/891: link d6/d24/dc5/de3/ddf/c10e d6/df9/c128 0 2024-09-13T02:53:05.722 INFO:tasks.workunit.client.0.smithi098.stdout:1/808: chown d9/d33/d19/d35/d63/f89 0 1 2024-09-13T02:53:05.731 INFO:tasks.workunit.client.0.smithi098.stdout:5/664: sync 2024-09-13T02:53:05.731 INFO:tasks.workunit.client.0.smithi098.stdout:9/765: sync 2024-09-13T02:53:05.731 INFO:tasks.workunit.client.0.smithi098.stdout:8/674: creat d2/d28/fda x:0 0 0 2024-09-13T02:53:05.736 INFO:tasks.workunit.client.0.smithi098.stdout:1/809: dwrite d9/f84 [0,4194304] 0 2024-09-13T02:53:05.736 INFO:tasks.workunit.client.0.smithi098.stdout:5/665: rmdir d0/d38/d3f/d1a/d27 39 2024-09-13T02:53:05.742 INFO:tasks.workunit.client.0.smithi098.stdout:7/892: dwrite d6/d1e/f62 [0,4194304] 0 2024-09-13T02:53:05.745 INFO:tasks.workunit.client.0.smithi098.stdout:1/810: rmdir d9 39 2024-09-13T02:53:05.748 INFO:tasks.workunit.client.0.smithi098.stdout:9/766: symlink d2/d6/d36/da7/l10f 0 2024-09-13T02:53:05.749 INFO:tasks.workunit.client.0.smithi098.stdout:8/675: mknod d2/dd/dcb/cdb 0 2024-09-13T02:53:05.750 INFO:tasks.workunit.client.0.smithi098.stdout:9/767: readlink d2/d6/d2b/d4d/d4f/d6c/dd4/dac/laf 0 2024-09-13T02:53:05.753 INFO:tasks.workunit.client.0.smithi098.stdout:9/768: fsync d2/d6/f29 0 2024-09-13T02:53:05.754 INFO:tasks.workunit.client.0.smithi098.stdout:9/769: readlink d2/d6/d2b/d4d/l6d 0 2024-09-13T02:53:05.756 INFO:tasks.workunit.client.0.smithi098.stdout:5/666: mknod d0/d57/ce8 0 2024-09-13T02:53:05.758 INFO:tasks.workunit.client.0.smithi098.stdout:1/811: mkdir d9/d33/d19/d35/d10a/d114/d121 0 2024-09-13T02:53:05.759 INFO:tasks.workunit.client.0.smithi098.stdout:9/770: chown d2/d6/d2b/d4d/d4f/fa9 39296 1 2024-09-13T02:53:05.812 INFO:tasks.workunit.client.0.smithi098.stdout:7/893: getdents d6/d24/d2a/d5a/d86 0 2024-09-13T02:53:05.812 INFO:tasks.workunit.client.0.smithi098.stdout:9/771: rmdir d2/d6/d36/d6a 39 2024-09-13T02:53:05.812 INFO:tasks.workunit.client.0.smithi098.stdout:5/667: fsync d0/d15/d17/d1c/f96 0 2024-09-13T02:53:05.813 INFO:tasks.workunit.client.0.smithi098.stdout:1/812: symlink d9/d33/d19/d35/d68/d4d/db5/de2/l122 0 2024-09-13T02:53:05.823 INFO:tasks.workunit.client.0.smithi098.stdout:5/668: mknod d0/d15/d17/ce9 0 2024-09-13T02:53:05.829 INFO:tasks.workunit.client.0.smithi098.stdout:5/669: read d0/d38/f55 [55929,51558] 0 2024-09-13T02:53:05.829 INFO:tasks.workunit.client.0.smithi098.stdout:9/772: dread d2/d6/d2b/d4d/d56/db9/ddf/fe1 [0,4194304] 0 2024-09-13T02:53:05.830 INFO:tasks.workunit.client.0.smithi098.stdout:1/813: getdents d9/d33/d19/d35/d68/d4d/db5/df3 0 2024-09-13T02:53:05.833 INFO:tasks.workunit.client.0.smithi098.stdout:1/814: mknod d9/d33/d29/d11c/d23/da7/d51/d8f/c123 0 2024-09-13T02:53:05.837 INFO:tasks.workunit.client.0.smithi098.stdout:1/815: symlink d9/d33/d19/d35/l124 0 2024-09-13T02:53:05.837 INFO:tasks.workunit.client.0.smithi098.stdout:1/816: fdatasync d9/d33/d29/d58/f82 0 2024-09-13T02:53:05.841 INFO:tasks.workunit.client.0.smithi098.stdout:5/670: getdents d0/d15/da4 0 2024-09-13T02:53:05.841 INFO:tasks.workunit.client.0.smithi098.stdout:1/817: dread d9/d33/de6/d61/db1/fd4 [0,4194304] 0 2024-09-13T02:53:05.847 INFO:tasks.workunit.client.0.smithi098.stdout:5/671: dwrite d0/d15/f8d [0,4194304] 0 2024-09-13T02:53:05.851 INFO:tasks.workunit.client.0.smithi098.stdout:5/672: getdents d0/d15/d50/dd3 0 2024-09-13T02:53:05.853 INFO:tasks.workunit.client.0.smithi098.stdout:5/673: write d0/d38/d3f/d81/d9e/dd4/fd7 [925501,34065] 0 2024-09-13T02:53:05.861 INFO:tasks.workunit.client.0.smithi098.stdout:1/818: dwrite d9/d33/d19/d35/d68/d4d/db5/fc0 [0,4194304] 0 2024-09-13T02:53:05.868 INFO:tasks.workunit.client.0.smithi098.stdout:1/819: mkdir d9/d33/d29/d11c/d23/da7/d125 0 2024-09-13T02:53:05.870 INFO:tasks.workunit.client.0.smithi098.stdout:1/820: chown d9/d33/de6/c99 7 1 2024-09-13T02:53:05.875 INFO:tasks.workunit.client.0.smithi098.stdout:5/674: dwrite d0/d38/d3f/d81/d4d/d82/f93 [0,4194304] 0 2024-09-13T02:53:05.877 INFO:tasks.workunit.client.0.smithi098.stdout:5/675: mknod d0/d15/d17/d1c/cea 0 2024-09-13T02:53:05.881 INFO:tasks.workunit.client.0.smithi098.stdout:5/676: fsync d0/d15/d50/f9f 0 2024-09-13T02:53:05.883 INFO:tasks.workunit.client.0.smithi098.stdout:1/821: dwrite d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fef [0,4194304] 0 2024-09-13T02:53:05.891 INFO:tasks.workunit.client.0.smithi098.stdout:1/822: link d9/d33/d19/d46/lf4 d9/d33/d19/d35/d63/l126 0 2024-09-13T02:53:05.894 INFO:tasks.workunit.client.0.smithi098.stdout:1/823: symlink d9/d33/d19/d35/d68/d4d/l127 0 2024-09-13T02:53:05.897 INFO:tasks.workunit.client.0.smithi098.stdout:1/824: stat d9/d33/de6/l97 0 2024-09-13T02:53:05.902 INFO:tasks.workunit.client.0.smithi098.stdout:1/825: truncate d9/d33/de6/d61/db1/fd4 765713 0 2024-09-13T02:53:05.909 INFO:tasks.workunit.client.0.smithi098.stdout:1/826: dwrite d9/d33/d19/d64/fbb [0,4194304] 0 2024-09-13T02:53:05.916 INFO:tasks.workunit.client.0.smithi098.stdout:1/827: unlink d9/d33/d29/d11c/d23/da7/d51/d8f/l76 0 2024-09-13T02:53:05.921 INFO:tasks.workunit.client.0.smithi098.stdout:1/828: mkdir d9/d33/d19/d35/d10a/d114/d121/d128 0 2024-09-13T02:53:05.923 INFO:tasks.workunit.client.0.smithi098.stdout:1/829: chown d9/d33/d19/d35/d68/d4d/db5/db8/fbe 1635 1 2024-09-13T02:53:05.923 INFO:tasks.workunit.client.0.smithi098.stdout:1/830: chown d9/c11 1020 1 2024-09-13T02:53:05.930 INFO:tasks.workunit.client.0.smithi098.stdout:1/831: rename d9/d33/de6/l97 to d9/d33/d19/d35/d68/d4d/db5/db8/l129 0 2024-09-13T02:53:05.934 INFO:tasks.workunit.client.0.smithi098.stdout:1/832: rename d9/d33/d19/d35/d68/d4d/db5/de2/l122 to d9/d33/d19/d35/d68/d4d/db5/de2/l12a 0 2024-09-13T02:53:05.935 INFO:tasks.workunit.client.0.smithi098.stdout:1/833: mknod d9/d33/d19/d35/de1/c12b 0 2024-09-13T02:53:05.937 INFO:tasks.workunit.client.0.smithi098.stdout:1/834: readlink d9/d33/d19/l39 0 2024-09-13T02:53:06.002 INFO:tasks.workunit.client.0.smithi098.stdout:6/682: sync 2024-09-13T02:53:06.012 INFO:tasks.workunit.client.0.smithi098.stdout:6/683: getdents d5/d13/d2b/d5b 0 2024-09-13T02:53:06.026 INFO:tasks.workunit.client.0.smithi098.stdout:6/684: write d5/f1b [698352,20495] 0 2024-09-13T02:53:06.028 INFO:tasks.workunit.client.0.smithi098.stdout:6/685: read d5/d36/f8e [3669809,86951] 0 2024-09-13T02:53:06.029 INFO:tasks.workunit.client.0.smithi098.stdout:6/686: fsync d5/d13/d2b/d3a/f11 0 2024-09-13T02:53:06.030 INFO:tasks.workunit.client.0.smithi098.stdout:6/687: fdatasync d5/d13/d2b/d3a/fa2 0 2024-09-13T02:53:06.033 INFO:tasks.workunit.client.0.smithi098.stdout:6/688: creat d5/d13/d67/d85/fea x:0 0 0 2024-09-13T02:53:06.034 INFO:tasks.workunit.client.0.smithi098.stdout:6/689: stat d5/d13/d2b/d3a/c8d 0 2024-09-13T02:53:06.037 INFO:tasks.workunit.client.0.smithi098.stdout:6/690: rmdir d5/d13/d51 39 2024-09-13T02:53:06.044 INFO:tasks.workunit.client.0.smithi098.stdout:6/691: link d5/d18/d50/fc9 d5/d13/d2b/d3a/d14/d94/de5/feb 0 2024-09-13T02:53:06.046 INFO:tasks.workunit.client.0.smithi098.stdout:6/692: mknod d5/d6f/cec 0 2024-09-13T02:53:06.049 INFO:tasks.workunit.client.0.smithi098.stdout:6/693: write d5/d13/d2b/d3a/d41/d55/dad/fc5 [550227,75138] 0 2024-09-13T02:53:06.053 INFO:tasks.workunit.client.0.smithi098.stdout:6/694: creat d5/d13/d2b/d3a/d41/d55/fed x:0 0 0 2024-09-13T02:53:06.056 INFO:tasks.workunit.client.0.smithi098.stdout:6/695: fdatasync d5/d13/d2b/d3a/d41/d7e/f7d 0 2024-09-13T02:53:06.066 INFO:tasks.workunit.client.0.smithi098.stdout:2/747: sync 2024-09-13T02:53:06.066 INFO:tasks.workunit.client.0.smithi098.stdout:4/710: sync 2024-09-13T02:53:06.066 INFO:tasks.workunit.client.0.smithi098.stdout:3/705: sync 2024-09-13T02:53:06.066 INFO:tasks.workunit.client.0.smithi098.stdout:0/762: sync 2024-09-13T02:53:06.067 INFO:tasks.workunit.client.0.smithi098.stdout:2/748: chown d1/d1f/d35/d63/f3f 145044178 1 2024-09-13T02:53:06.072 INFO:tasks.workunit.client.0.smithi098.stdout:0/763: rename dd/df/d1d/d26/d28/d32/c60 to dd/df/d1d/da7/c101 0 2024-09-13T02:53:06.074 INFO:tasks.workunit.client.0.smithi098.stdout:6/696: write d5/f31 [2292115,127470] 0 2024-09-13T02:53:06.075 INFO:tasks.workunit.client.0.smithi098.stdout:3/706: truncate d7/d9/d15/f63 418686 0 2024-09-13T02:53:06.077 INFO:tasks.workunit.client.0.smithi098.stdout:4/711: dwrite d6/d22/fdf [0,4194304] 0 2024-09-13T02:53:06.077 INFO:tasks.workunit.client.0.smithi098.stdout:6/697: chown d5/d36/f6e 42762 1 2024-09-13T02:53:06.079 INFO:tasks.workunit.client.0.smithi098.stdout:4/712: chown d6/d22/d3d/d41/d74/d98 73 1 2024-09-13T02:53:06.084 INFO:tasks.workunit.client.0.smithi098.stdout:6/698: rmdir d5 39 2024-09-13T02:53:06.087 INFO:tasks.workunit.client.0.smithi098.stdout:2/749: dread d1/da7/fb5 [0,4194304] 0 2024-09-13T02:53:06.092 INFO:tasks.workunit.client.0.smithi098.stdout:0/764: creat dd/df/d1d/d26/d28/d32/d67/f102 x:0 0 0 2024-09-13T02:53:06.094 INFO:tasks.workunit.client.0.smithi098.stdout:3/707: creat d7/d9/d15/d2d/db8/fe1 x:0 0 0 2024-09-13T02:53:06.097 INFO:tasks.workunit.client.0.smithi098.stdout:4/713: mkdir d6/d10/d21/dec 0 2024-09-13T02:53:06.103 INFO:tasks.workunit.client.0.smithi098.stdout:6/699: mknod d5/d13/cee 0 2024-09-13T02:53:06.107 INFO:tasks.workunit.client.0.smithi098.stdout:6/700: read d5/d13/d2b/d3a/d14/d94/d97/da3/fac [1240954,54373] 0 2024-09-13T02:53:06.108 INFO:tasks.workunit.client.0.smithi098.stdout:2/750: dread d1/d1a/d9/d1e/f47 [4194304,4194304] 0 2024-09-13T02:53:06.108 INFO:tasks.workunit.client.0.smithi098.stdout:6/701: chown d5/d13/fc1 230 1 2024-09-13T02:53:06.108 INFO:tasks.workunit.client.0.smithi098.stdout:0/765: rename dd/df/d1d/d26/d28/d32/f98 to dd/db9/dd7/f103 0 2024-09-13T02:53:06.112 INFO:tasks.workunit.client.0.smithi098.stdout:4/714: link l4 d6/d22/d3d/led 0 2024-09-13T02:53:06.114 INFO:tasks.workunit.client.0.smithi098.stdout:6/702: chown d5/d13/d2b/d3a/d5a/da8 21 1 2024-09-13T02:53:06.114 INFO:tasks.workunit.client.0.smithi098.stdout:3/708: dread d7/d9/d15/d2d/db8/d51/f69 [0,4194304] 0 2024-09-13T02:53:06.115 INFO:tasks.workunit.client.0.smithi098.stdout:0/766: symlink dd/df/d1d/d26/d37/l104 0 2024-09-13T02:53:06.116 INFO:tasks.workunit.client.0.smithi098.stdout:3/709: write d7/d9/d25/d64/d6f/f83 [98157,51341] 0 2024-09-13T02:53:06.119 INFO:tasks.workunit.client.0.smithi098.stdout:4/715: mkdir d6/d3e/d46/dd2/dee 0 2024-09-13T02:53:06.123 INFO:tasks.workunit.client.0.smithi098.stdout:0/767: dwrite dd/df/d1d/d26/d37/fef [0,4194304] 0 2024-09-13T02:53:06.125 INFO:tasks.workunit.client.0.smithi098.stdout:2/751: rmdir d1/da7/db8/de3 0 2024-09-13T02:53:06.133 INFO:tasks.workunit.client.0.smithi098.stdout:4/716: rename d6/d22/d3d/d41/d58/c60 to d6/d22/d3d/d64/d6f/cef 0 2024-09-13T02:53:06.135 INFO:tasks.workunit.client.0.smithi098.stdout:4/717: write d6/d22/d3d/d41/fb2 [151705,82440] 0 2024-09-13T02:53:06.136 INFO:tasks.workunit.client.0.smithi098.stdout:0/768: creat dd/d1f/d85/d9d/dc2/de4/dc7/f105 x:0 0 0 2024-09-13T02:53:06.138 INFO:tasks.workunit.client.0.smithi098.stdout:3/710: dread d7/d9/d15/d5d/dc3/f60 [0,4194304] 0 2024-09-13T02:53:06.144 INFO:tasks.workunit.client.0.smithi098.stdout:0/769: chown dd/d1f/d85/d9d/dc2/de4/ca2 2 1 2024-09-13T02:53:06.145 INFO:tasks.workunit.client.0.smithi098.stdout:6/703: link d5/d13/d2b/d3a/l3d d5/d13/lef 0 2024-09-13T02:53:06.147 INFO:tasks.workunit.client.0.smithi098.stdout:4/718: dwrite d6/d22/d3d/d64/fa6 [0,4194304] 0 2024-09-13T02:53:06.148 INFO:tasks.workunit.client.0.smithi098.stdout:6/704: truncate d5/d13/d2b/d79/fd2 194356 0 2024-09-13T02:53:06.149 INFO:tasks.workunit.client.0.smithi098.stdout:2/752: creat d1/ff7 x:0 0 0 2024-09-13T02:53:06.151 INFO:tasks.workunit.client.0.smithi098.stdout:0/770: read dd/d1f/d85/d9d/dc2/fd5 [78061,110566] 0 2024-09-13T02:53:06.151 INFO:tasks.workunit.client.0.smithi098.stdout:0/771: stat dd/l35 0 2024-09-13T02:53:06.152 INFO:tasks.workunit.client.0.smithi098.stdout:3/711: mknod d7/d9/d25/d64/dd5/ce2 0 2024-09-13T02:53:06.153 INFO:tasks.workunit.client.0.smithi098.stdout:0/772: stat dd/df/d1d/d40/f61 0 2024-09-13T02:53:06.153 INFO:tasks.workunit.client.0.smithi098.stdout:3/712: fdatasync d7/fbf 0 2024-09-13T02:53:06.156 INFO:tasks.workunit.client.0.smithi098.stdout:6/705: rename d5/d13/d2b/d3a/d14/d94/d97/da3 to d5/d13/d2b/d79/df0 0 2024-09-13T02:53:06.160 INFO:tasks.workunit.client.0.smithi098.stdout:0/773: read - dd/df/d1d/d40/d46/fad zero size 2024-09-13T02:53:06.162 INFO:tasks.workunit.client.0.smithi098.stdout:6/706: fdatasync d5/d18/f2a 0 2024-09-13T02:53:06.177 INFO:tasks.workunit.client.0.smithi098.stdout:6/707: mkdir d5/d18/d50/df1 0 2024-09-13T02:53:06.180 INFO:tasks.workunit.client.0.smithi098.stdout:2/753: link d1/d1f/d39/l6f d1/d1f/d39/df6/d7f/lf8 0 2024-09-13T02:53:06.182 INFO:tasks.workunit.client.0.smithi098.stdout:4/719: getdents d6/d22/d3d/d4d 0 2024-09-13T02:53:06.185 INFO:tasks.workunit.client.0.smithi098.stdout:3/713: dwrite d7/d9/d15/d2d/db8/d51/d9c/fb2 [0,4194304] 0 2024-09-13T02:53:06.187 INFO:tasks.workunit.client.0.smithi098.stdout:0/774: symlink dd/db9/l106 0 2024-09-13T02:53:06.191 INFO:tasks.workunit.client.0.smithi098.stdout:4/720: symlink d6/d22/d3d/d6c/d91/lf0 0 2024-09-13T02:53:06.199 INFO:tasks.workunit.client.0.smithi098.stdout:2/754: creat d1/d1f/d39/df6/d59/d9e/d9f/dc1/ff9 x:0 0 0 2024-09-13T02:53:06.201 INFO:tasks.workunit.client.0.smithi098.stdout:2/755: write d1/d1f/d39/df6/d7f/fee [521195,8391] 0 2024-09-13T02:53:06.201 INFO:tasks.workunit.client.0.smithi098.stdout:6/708: link d5/d6f/cec d5/d18/cf2 0 2024-09-13T02:53:06.210 INFO:tasks.workunit.client.0.smithi098.stdout:4/721: write d6/db/f29 [3294740,68049] 0 2024-09-13T02:53:06.212 INFO:tasks.workunit.client.0.smithi098.stdout:6/709: fdatasync d5/d36/f6e 0 2024-09-13T02:53:06.213 INFO:tasks.workunit.client.0.smithi098.stdout:3/714: write d7/d9/d15/d2d/db8/d52/f55 [494983,100373] 0 2024-09-13T02:53:06.215 INFO:tasks.workunit.client.0.smithi098.stdout:2/756: unlink d1/d1f/d39/df6/f69 0 2024-09-13T02:53:06.224 INFO:tasks.workunit.client.0.smithi098.stdout:4/722: dread d6/d22/d3d/d41/d58/f78 [0,4194304] 0 2024-09-13T02:53:06.253 INFO:tasks.workunit.client.0.smithi098.stdout:0/775: getdents dd/df/d1d/d40/d46/d6b 0 2024-09-13T02:53:06.256 INFO:tasks.workunit.client.0.smithi098.stdout:3/715: symlink d7/d9/d15/d2d/db8/le3 0 2024-09-13T02:53:06.257 INFO:tasks.workunit.client.0.smithi098.stdout:3/716: stat d7/d9/d15/f7d 0 2024-09-13T02:53:06.258 INFO:tasks.workunit.client.0.smithi098.stdout:3/717: readlink d7/d9/d15/d80/da0/lde 0 2024-09-13T02:53:06.263 INFO:tasks.workunit.client.0.smithi098.stdout:3/718: fsync d7/d9/d15/f49 0 2024-09-13T02:53:06.266 INFO:tasks.workunit.client.0.smithi098.stdout:6/710: link d5/d13/d2b/d5b/f89 d5/d13/d2b/d3a/d5a/da8/ff3 0 2024-09-13T02:53:06.273 INFO:tasks.workunit.client.0.smithi098.stdout:0/776: creat dd/f107 x:0 0 0 2024-09-13T02:53:06.275 INFO:tasks.workunit.client.0.smithi098.stdout:6/711: mkdir d5/d13/d2b/d3a/d41/df4 0 2024-09-13T02:53:06.279 INFO:tasks.workunit.client.0.smithi098.stdout:6/712: unlink d5/d13/d51/l9f 0 2024-09-13T02:53:06.280 INFO:tasks.workunit.client.0.smithi098.stdout:0/777: link dd/df/d1d/d26/d37/c48 dd/df/d1d/d40/d46/c108 0 2024-09-13T02:53:06.297 INFO:tasks.workunit.client.0.smithi098.stdout:4/723: dwrite d6/db/f40 [0,4194304] 0 2024-09-13T02:53:06.302 INFO:tasks.workunit.client.0.smithi098.stdout:3/719: dwrite d7/d9/d15/d2d/db8/d52/f3b [0,4194304] 0 2024-09-13T02:53:06.307 INFO:tasks.workunit.client.0.smithi098.stdout:4/724: mknod d6/d54/d6a/dde/cf1 0 2024-09-13T02:53:06.308 INFO:tasks.workunit.client.0.smithi098.stdout:6/713: write d5/d13/d2b/d79/df0/fac [4048638,89781] 0 2024-09-13T02:53:06.308 INFO:tasks.workunit.client.0.smithi098.stdout:3/720: read d7/d9/d15/d26/f2a [218917,82881] 0 2024-09-13T02:53:06.313 INFO:tasks.workunit.client.0.smithi098.stdout:6/714: chown d5/l88 130343 1 2024-09-13T02:53:06.315 INFO:tasks.workunit.client.0.smithi098.stdout:0/778: dwrite dd/d1f/f25 [4194304,4194304] 0 2024-09-13T02:53:06.317 INFO:tasks.workunit.client.0.smithi098.stdout:6/715: dread - d5/d13/d2b/d3a/d14/d94/fc2 zero size 2024-09-13T02:53:06.321 INFO:tasks.workunit.client.0.smithi098.stdout:6/716: mknod d5/d13/d2b/d3a/d41/d55/dce/cf5 0 2024-09-13T02:53:06.325 INFO:tasks.workunit.client.0.smithi098.stdout:6/717: rename d5/d18/d50/cd8 to d5/d18/d50/df1/cf6 0 2024-09-13T02:53:06.328 INFO:tasks.workunit.client.0.smithi098.stdout:6/718: rmdir d5/d6f 39 2024-09-13T02:53:06.331 INFO:tasks.workunit.client.0.smithi098.stdout:4/725: write d6/d3e/d46/f86 [235398,52318] 0 2024-09-13T02:53:06.332 INFO:tasks.workunit.client.0.smithi098.stdout:3/721: truncate d7/d9/d15/d2d/db8/d51/d9c/fce 3518261 0 2024-09-13T02:53:06.333 INFO:tasks.workunit.client.0.smithi098.stdout:6/719: truncate d5/d13/f1c 954145 0 2024-09-13T02:53:06.337 INFO:tasks.workunit.client.0.smithi098.stdout:4/726: fsync d6/d22/d3d/d41/d74/fc4 0 2024-09-13T02:53:06.340 INFO:tasks.workunit.client.0.smithi098.stdout:0/779: dwrite dd/df/d1d/d26/d28/d5d/f66 [0,4194304] 0 2024-09-13T02:53:06.343 INFO:tasks.workunit.client.0.smithi098.stdout:6/720: dwrite d5/d13/d2b/d79/fb9 [4194304,4194304] 0 2024-09-13T02:53:06.344 INFO:tasks.workunit.client.0.smithi098.stdout:0/780: write dd/df/d1d/d40/d46/d6b/f8f [455245,73705] 0 2024-09-13T02:53:06.349 INFO:tasks.workunit.client.0.smithi098.stdout:3/722: getdents d7/d9/d15/d80/da0/dd4 0 2024-09-13T02:53:06.356 INFO:tasks.workunit.client.0.smithi098.stdout:4/727: creat d6/d22/d3d/ff2 x:0 0 0 2024-09-13T02:53:06.356 INFO:tasks.workunit.client.0.smithi098.stdout:4/728: dread - d6/d22/d3d/d41/fe8 zero size 2024-09-13T02:53:06.358 INFO:tasks.workunit.client.0.smithi098.stdout:6/721: unlink d5/d13/d2b/d3a/d5a/cb7 0 2024-09-13T02:53:06.360 INFO:tasks.workunit.client.0.smithi098.stdout:0/781: mkdir dd/df/d1d/d40/d46/d6b/d109 0 2024-09-13T02:53:06.362 INFO:tasks.workunit.client.0.smithi098.stdout:3/723: rmdir d7/d9/d15/d2d/db8 39 2024-09-13T02:53:06.365 INFO:tasks.workunit.client.0.smithi098.stdout:0/782: fsync dd/df/d1d/d26/d28/d32/fe3 0 2024-09-13T02:53:06.366 INFO:tasks.workunit.client.0.smithi098.stdout:3/724: creat d7/d9/d25/d2b/fe4 x:0 0 0 2024-09-13T02:53:06.368 INFO:tasks.workunit.client.0.smithi098.stdout:6/722: creat d5/d6f/ff7 x:0 0 0 2024-09-13T02:53:06.374 INFO:tasks.workunit.client.0.smithi098.stdout:3/725: dread d7/d9/d15/d2d/db8/d51/f69 [0,4194304] 0 2024-09-13T02:53:06.374 INFO:tasks.workunit.client.0.smithi098.stdout:0/783: link dd/df/d1d/d26/d28/d32/c55 dd/df/d1d/d26/d37/dea/c10a 0 2024-09-13T02:53:06.376 INFO:tasks.workunit.client.0.smithi098.stdout:3/726: truncate d7/d9/d15/d80/fc8 389312 0 2024-09-13T02:53:06.381 INFO:tasks.workunit.client.0.smithi098.stdout:3/727: write d7/d9/d15/d2d/d34/f61 [2519105,14553] 0 2024-09-13T02:53:06.381 INFO:tasks.workunit.client.0.smithi098.stdout:4/729: truncate d6/d22/d3d/d41/d74/d98/fa8 1017237 0 2024-09-13T02:53:06.383 INFO:tasks.workunit.client.0.smithi098.stdout:0/784: creat dd/df/d1d/d26/d28/f10b x:0 0 0 2024-09-13T02:53:06.383 INFO:tasks.workunit.client.0.smithi098.stdout:3/728: write d7/d9/d15/d2d/d34/f5a [3074245,4077] 0 2024-09-13T02:53:06.387 INFO:tasks.workunit.client.0.smithi098.stdout:6/723: dread d5/f15 [4194304,4194304] 0 2024-09-13T02:53:06.388 INFO:tasks.workunit.client.0.smithi098.stdout:3/729: unlink d7/d9/d15/d2d/d34/f5a 0 2024-09-13T02:53:06.391 INFO:tasks.workunit.client.0.smithi098.stdout:3/730: symlink d7/d9/le5 0 2024-09-13T02:53:06.394 INFO:tasks.workunit.client.0.smithi098.stdout:6/724: creat d5/d13/d2b/d3a/d41/d6c/ff8 x:0 0 0 2024-09-13T02:53:06.396 INFO:tasks.workunit.client.0.smithi098.stdout:3/731: rename d7/d9/d25/d64/l9b to d7/d9/d15/d2d/d34/le6 0 2024-09-13T02:53:06.398 INFO:tasks.workunit.client.0.smithi098.stdout:6/725: mknod d5/d6f/cf9 0 2024-09-13T02:53:06.400 INFO:tasks.workunit.client.0.smithi098.stdout:4/730: dread d6/d10/d21/f2b [0,4194304] 0 2024-09-13T02:53:06.405 INFO:tasks.workunit.client.0.smithi098.stdout:3/732: dwrite d7/d9/d25/d2b/fa2 [0,4194304] 0 2024-09-13T02:53:06.416 INFO:tasks.workunit.client.0.smithi098.stdout:3/733: dwrite d7/d9/d15/d2d/db8/d51/fc4 [0,4194304] 0 2024-09-13T02:53:06.427 INFO:tasks.workunit.client.0.smithi098.stdout:4/731: dread d6/d22/d3d/d64/fb4 [0,4194304] 0 2024-09-13T02:53:06.432 INFO:tasks.workunit.client.0.smithi098.stdout:4/732: dread d6/d22/d3d/d64/fb4 [0,4194304] 0 2024-09-13T02:53:06.433 INFO:tasks.workunit.client.0.smithi098.stdout:3/734: link d7/c7f d7/d9/d15/d80/da0/dd4/ce7 0 2024-09-13T02:53:06.438 INFO:tasks.workunit.client.0.smithi098.stdout:6/726: dwrite d5/d13/d67/f6a [0,4194304] 0 2024-09-13T02:53:06.439 INFO:tasks.workunit.client.0.smithi098.stdout:3/735: fsync d7/d9/d4c/f81 0 2024-09-13T02:53:06.450 INFO:tasks.workunit.client.0.smithi098.stdout:3/736: chown d7/d9/d15/d2d/db8/f44 1429864 1 2024-09-13T02:53:06.454 INFO:tasks.workunit.client.0.smithi098.stdout:3/737: unlink d7/d9/d15/d2d/db8/c5c 0 2024-09-13T02:53:06.457 INFO:tasks.workunit.client.0.smithi098.stdout:4/733: dwrite d6/f61 [0,4194304] 0 2024-09-13T02:53:06.459 INFO:tasks.workunit.client.0.smithi098.stdout:4/734: write d6/d3e/fe4 [745079,27318] 0 2024-09-13T02:53:06.461 INFO:tasks.workunit.client.0.smithi098.stdout:3/738: truncate d7/d9/d15/d5d/da1/fae 690187 0 2024-09-13T02:53:06.461 INFO:tasks.workunit.client.0.smithi098.stdout:8/676: sync 2024-09-13T02:53:06.461 INFO:tasks.workunit.client.0.smithi098.stdout:7/894: sync 2024-09-13T02:53:06.464 INFO:tasks.workunit.client.0.smithi098.stdout:7/895: chown d6/d24/d2a/d5a/d42/fb6 58 1 2024-09-13T02:53:06.464 INFO:tasks.workunit.client.0.smithi098.stdout:3/739: read - d7/d9/d15/d2d/db8/f6c zero size 2024-09-13T02:53:06.465 INFO:tasks.workunit.client.0.smithi098.stdout:7/896: write d6/d1e/f62 [2506444,56841] 0 2024-09-13T02:53:06.466 INFO:tasks.workunit.client.0.smithi098.stdout:7/897: chown d6/d1e/l7a 7410 1 2024-09-13T02:53:06.470 INFO:tasks.workunit.client.0.smithi098.stdout:3/740: write d7/d9/f31 [827756,54143] 0 2024-09-13T02:53:06.470 INFO:tasks.workunit.client.0.smithi098.stdout:8/677: dread d2/d2f/d78/d5d/fb2 [0,4194304] 0 2024-09-13T02:53:06.475 INFO:tasks.workunit.client.0.smithi098.stdout:7/898: dread - d6/df9/d110/f122 zero size 2024-09-13T02:53:06.484 INFO:tasks.workunit.client.0.smithi098.stdout:8/678: unlink d2/d28/d43/d9f/fba 0 2024-09-13T02:53:06.490 INFO:tasks.workunit.client.0.smithi098.stdout:7/899: dread d6/d24/d2a/dda/fd0 [0,4194304] 0 2024-09-13T02:53:06.496 INFO:tasks.workunit.client.0.smithi098.stdout:8/679: symlink d2/dd/d11/d1d/dcc/ldc 0 2024-09-13T02:53:06.499 INFO:tasks.workunit.client.0.smithi098.stdout:7/900: creat d6/d24/dc5/de3/dcf/ded/f129 x:0 0 0 2024-09-13T02:53:06.499 INFO:tasks.workunit.client.0.smithi098.stdout:3/741: getdents d7/d9/d15/d2d/d78 0 2024-09-13T02:53:06.501 INFO:tasks.workunit.client.0.smithi098.stdout:7/901: mknod d6/d24/d2a/d5a/c12a 0 2024-09-13T02:53:06.503 INFO:tasks.workunit.client.0.smithi098.stdout:7/902: fdatasync d6/d24/d2a/d5a/d4c/f6a 0 2024-09-13T02:53:06.504 INFO:tasks.workunit.client.0.smithi098.stdout:3/742: rename d7/d9/d15/d2d/ccd to d7/d9/d15/d80/da0/ce8 0 2024-09-13T02:53:06.510 INFO:tasks.workunit.client.0.smithi098.stdout:3/743: creat d7/d9/d15/d80/da0/dd4/fe9 x:0 0 0 2024-09-13T02:53:06.519 INFO:tasks.workunit.client.0.smithi098.stdout:7/903: dread d6/d24/d2a/d5a/fc8 [0,4194304] 0 2024-09-13T02:53:06.651 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:06 smithi098 ceph-mon[27886]: pgmap v32: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 70 MiB/s rd, 180 MiB/s wr, 443 op/s 2024-09-13T02:53:06.699 INFO:tasks.workunit.client.0.smithi098.stdout:3/744: mknod d7/d9/d15/d2d/cea 0 2024-09-13T02:53:06.699 INFO:tasks.workunit.client.0.smithi098.stdout:3/745: dread - d7/d9/d15/d2d/db8/fc1 zero size 2024-09-13T02:53:06.704 INFO:tasks.workunit.client.0.smithi098.stdout:3/746: creat d7/d9/d15/d5d/dc3/feb x:0 0 0 2024-09-13T02:53:06.711 INFO:tasks.workunit.client.0.smithi098.stdout:3/747: truncate d7/d9/d15/d26/f84 4866996 0 2024-09-13T02:53:06.716 INFO:tasks.workunit.client.0.smithi098.stdout:3/748: mkdir d7/d9/d15/d5d/da1/dec 0 2024-09-13T02:53:06.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:06 smithi142 ceph-mon[33443]: pgmap v32: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 70 MiB/s rd, 180 MiB/s wr, 443 op/s 2024-09-13T02:53:07.021 INFO:tasks.workunit.client.0.smithi098.stdout:9/773: sync 2024-09-13T02:53:07.021 INFO:tasks.workunit.client.0.smithi098.stdout:1/835: sync 2024-09-13T02:53:07.021 INFO:tasks.workunit.client.0.smithi098.stdout:5/677: sync 2024-09-13T02:53:07.024 INFO:tasks.workunit.client.0.smithi098.stdout:9/774: creat d2/d6/d36/d8d/dc8/f110 x:0 0 0 2024-09-13T02:53:07.025 INFO:tasks.workunit.client.0.smithi098.stdout:1/836: truncate d9/d33/d29/d11c/f88 3737900 0 2024-09-13T02:53:07.026 INFO:tasks.workunit.client.0.smithi098.stdout:9/775: write d2/d6/d36/f4e [5076784,94983] 0 2024-09-13T02:53:07.027 INFO:tasks.workunit.client.0.smithi098.stdout:1/837: fsync d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fd9 0 2024-09-13T02:53:07.027 INFO:tasks.workunit.client.0.smithi098.stdout:9/776: chown d2/d6/d2b/d4d/fd5 26637 1 2024-09-13T02:53:07.032 INFO:tasks.workunit.client.0.smithi098.stdout:9/777: fdatasync d2/d6/d2b/d4d/d4f/d6c/fe3 0 2024-09-13T02:53:07.040 INFO:tasks.workunit.client.0.smithi098.stdout:5/678: dwrite d0/d7c/fa3 [0,4194304] 0 2024-09-13T02:53:07.041 INFO:tasks.workunit.client.0.smithi098.stdout:1/838: getdents d9/d33/d87 0 2024-09-13T02:53:07.046 INFO:tasks.workunit.client.0.smithi098.stdout:9/778: mknod d2/d6/d2b/d66/de0/d102/c111 0 2024-09-13T02:53:07.049 INFO:tasks.workunit.client.0.smithi098.stdout:5/679: rmdir d0/d29 39 2024-09-13T02:53:07.053 INFO:tasks.workunit.client.0.smithi098.stdout:9/779: read - d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/fb3 zero size 2024-09-13T02:53:07.056 INFO:tasks.workunit.client.0.smithi098.stdout:1/839: unlink d9/d33/d29/d11c/d23/c26 0 2024-09-13T02:53:07.059 INFO:tasks.workunit.client.0.smithi098.stdout:1/840: creat d9/d33/d19/d102/f12c x:0 0 0 2024-09-13T02:53:07.063 INFO:tasks.workunit.client.0.smithi098.stdout:5/680: link d0/d29/c79 d0/d38/d3f/d81/d4d/ceb 0 2024-09-13T02:53:07.063 INFO:tasks.workunit.client.0.smithi098.stdout:9/780: write d2/db1/fe8 [926764,41042] 0 2024-09-13T02:53:07.065 INFO:tasks.workunit.client.0.smithi098.stdout:5/681: fsync d0/d15/f80 0 2024-09-13T02:53:07.071 INFO:tasks.workunit.client.0.smithi098.stdout:5/682: mknod d0/d38/cec 0 2024-09-13T02:53:07.075 INFO:tasks.workunit.client.0.smithi098.stdout:1/841: dread d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fd9 [0,4194304] 0 2024-09-13T02:53:07.076 INFO:tasks.workunit.client.0.smithi098.stdout:9/781: link d2/d6/d36/d6a/f7d d2/d6/d2b/d4d/d56/dbc/f112 0 2024-09-13T02:53:07.079 INFO:tasks.workunit.client.0.smithi098.stdout:9/782: symlink d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/l113 0 2024-09-13T02:53:07.079 INFO:tasks.workunit.client.0.smithi098.stdout:5/683: dread d0/d38/d3f/d81/d4d/f52 [0,4194304] 0 2024-09-13T02:53:07.082 INFO:tasks.workunit.client.0.smithi098.stdout:1/842: dwrite f1 [0,4194304] 0 2024-09-13T02:53:07.084 INFO:tasks.workunit.client.0.smithi098.stdout:9/783: unlink d2/d6/c95 0 2024-09-13T02:53:07.087 INFO:tasks.workunit.client.0.smithi098.stdout:1/843: truncate d9/f38 5186565 0 2024-09-13T02:53:07.087 INFO:tasks.workunit.client.0.smithi098.stdout:1/844: readlink d9/d33/d19/d35/l9e 0 2024-09-13T02:53:07.089 INFO:tasks.workunit.client.0.smithi098.stdout:1/845: chown d9/d33/d29/d11c/d23/d30/c8b 28679 1 2024-09-13T02:53:07.090 INFO:tasks.workunit.client.0.smithi098.stdout:9/784: creat d2/d6/d36/d8d/f114 x:0 0 0 2024-09-13T02:53:07.094 INFO:tasks.workunit.client.0.smithi098.stdout:1/846: creat d9/d33/d19/d35/d68/d4d/db5/dd3/f12d x:0 0 0 2024-09-13T02:53:07.095 INFO:tasks.workunit.client.0.smithi098.stdout:5/684: dread d0/ff [0,4194304] 0 2024-09-13T02:53:07.099 INFO:tasks.workunit.client.0.smithi098.stdout:5/685: symlink d0/d38/d3f/d81/d9e/led 0 2024-09-13T02:53:07.102 INFO:tasks.workunit.client.0.smithi098.stdout:9/785: link d2/d6/d2b/ld2 d2/d6/d91/l115 0 2024-09-13T02:53:07.104 INFO:tasks.workunit.client.0.smithi098.stdout:5/686: unlink d0/f4e 0 2024-09-13T02:53:07.106 INFO:tasks.workunit.client.0.smithi098.stdout:9/786: rmdir d2/d6/d2b/d4d/d4f/d6c/dd4/d43 39 2024-09-13T02:53:07.107 INFO:tasks.workunit.client.0.smithi098.stdout:9/787: chown d2/d6/d2b/d4d/c51 174660 1 2024-09-13T02:53:07.111 INFO:tasks.workunit.client.0.smithi098.stdout:7/904: sync 2024-09-13T02:53:07.111 INFO:tasks.workunit.client.0.smithi098.stdout:6/727: sync 2024-09-13T02:53:07.111 INFO:tasks.workunit.client.0.smithi098.stdout:0/785: sync 2024-09-13T02:53:07.111 INFO:tasks.workunit.client.0.smithi098.stdout:4/735: sync 2024-09-13T02:53:07.112 INFO:tasks.workunit.client.0.smithi098.stdout:2/757: sync 2024-09-13T02:53:07.112 INFO:tasks.workunit.client.0.smithi098.stdout:8/680: sync 2024-09-13T02:53:07.112 INFO:tasks.workunit.client.0.smithi098.stdout:3/749: sync 2024-09-13T02:53:07.125 INFO:tasks.workunit.client.0.smithi098.stdout:4/736: mknod d6/d54/d6a/dde/cf3 0 2024-09-13T02:53:07.127 INFO:tasks.workunit.client.0.smithi098.stdout:1/847: dwrite d9/d33/f67 [0,4194304] 0 2024-09-13T02:53:07.128 INFO:tasks.workunit.client.0.smithi098.stdout:1/848: readlink d9/d33/d19/d35/d68/l105 0 2024-09-13T02:53:07.129 INFO:tasks.workunit.client.0.smithi098.stdout:2/758: unlink d1/da7/fd4 0 2024-09-13T02:53:07.130 INFO:tasks.workunit.client.0.smithi098.stdout:5/687: write d0/d38/d3f/d81/f33 [1565348,90562] 0 2024-09-13T02:53:07.133 INFO:tasks.workunit.client.0.smithi098.stdout:8/681: fdatasync d2/d2f/d78/d46/d47/d6e/f8c 0 2024-09-13T02:53:07.136 INFO:tasks.workunit.client.0.smithi098.stdout:0/786: mkdir dd/d1f/d85/d9d/dc2/de4/dc7/d10c 0 2024-09-13T02:53:07.137 INFO:tasks.workunit.client.0.smithi098.stdout:7/905: write d6/f41 [4318891,1508] 0 2024-09-13T02:53:07.137 INFO:tasks.workunit.client.0.smithi098.stdout:9/788: dwrite d2/d6/d2b/d4d/d4f/d6c/f85 [0,4194304] 0 2024-09-13T02:53:07.140 INFO:tasks.workunit.client.0.smithi098.stdout:9/789: stat d2/d6/d36/f5b 0 2024-09-13T02:53:07.141 INFO:tasks.workunit.client.0.smithi098.stdout:9/790: stat d2/d6/d2b/d66/de0/d102 0 2024-09-13T02:53:07.142 INFO:tasks.workunit.client.0.smithi098.stdout:7/906: truncate d6/d24/d2a/d5a/d86/d65/d9a/f125 37765 0 2024-09-13T02:53:07.144 INFO:tasks.workunit.client.0.smithi098.stdout:9/791: chown d2/d6/d2b/d4d/d56/dbc 8293004 1 2024-09-13T02:53:07.144 INFO:tasks.workunit.client.0.smithi098.stdout:7/907: chown d6/d24/d2a/d57/d88/l9e 1 1 2024-09-13T02:53:07.145 INFO:tasks.workunit.client.0.smithi098.stdout:3/750: unlink d7/d9/l56 0 2024-09-13T02:53:07.147 INFO:tasks.workunit.client.0.smithi098.stdout:9/792: dread d2/d6/d2b/d4d/d4f/d6c/dd4/f86 [0,4194304] 0 2024-09-13T02:53:07.153 INFO:tasks.workunit.client.0.smithi098.stdout:4/737: dread d6/db/fb8 [0,4194304] 0 2024-09-13T02:53:07.163 INFO:tasks.workunit.client.0.smithi098.stdout:4/738: creat d6/d22/d3d/d64/d6f/ff4 x:0 0 0 2024-09-13T02:53:07.164 INFO:tasks.workunit.client.0.smithi098.stdout:6/728: truncate d5/f31 1522805 0 2024-09-13T02:53:07.168 INFO:tasks.workunit.client.0.smithi098.stdout:4/739: dread d6/d3e/fe4 [0,4194304] 0 2024-09-13T02:53:07.171 INFO:tasks.workunit.client.0.smithi098.stdout:9/793: mknod d2/d6/d36/d8d/dc8/df8/c116 0 2024-09-13T02:53:07.174 INFO:tasks.workunit.client.0.smithi098.stdout:5/688: rename d0/d57/c5c to d0/d38/d3f/d81/d4d/d82/d9a/cee 0 2024-09-13T02:53:07.176 INFO:tasks.workunit.client.0.smithi098.stdout:1/849: dwrite d9/d33/d19/d35/d68/d2f/f49 [0,4194304] 0 2024-09-13T02:53:07.177 INFO:tasks.workunit.client.0.smithi098.stdout:6/729: unlink d5/d6f/cf9 0 2024-09-13T02:53:07.178 INFO:tasks.workunit.client.0.smithi098.stdout:2/759: link d1/d1f/d39/df6/ldf d1/da7/de4/lfa 0 2024-09-13T02:53:07.179 INFO:tasks.workunit.client.0.smithi098.stdout:0/787: dwrite dd/df/d1d/d26/d28/d5d/f69 [0,4194304] 0 2024-09-13T02:53:07.179 INFO:tasks.workunit.client.0.smithi098.stdout:8/682: dread d2/f9 [4194304,4194304] 0 2024-09-13T02:53:07.183 INFO:tasks.workunit.client.0.smithi098.stdout:7/908: creat d6/f12b x:0 0 0 2024-09-13T02:53:07.184 INFO:tasks.workunit.client.0.smithi098.stdout:8/683: write d2/dd/d11/d1d/f45 [856776,80291] 0 2024-09-13T02:53:07.185 INFO:tasks.workunit.client.0.smithi098.stdout:1/850: chown d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/f112 446372 1 2024-09-13T02:53:07.191 INFO:tasks.workunit.client.0.smithi098.stdout:2/760: dwrite d1/d1f/d39/fd8 [0,4194304] 0 2024-09-13T02:53:07.195 INFO:tasks.workunit.client.0.smithi098.stdout:0/788: fsync dd/df/d1d/d40/f61 0 2024-09-13T02:53:07.197 INFO:tasks.workunit.client.0.smithi098.stdout:7/909: mknod d6/d24/d2a/d5a/d42/d45/d73/c12c 0 2024-09-13T02:53:07.199 INFO:tasks.workunit.client.0.smithi098.stdout:8/684: mknod d2/dd/d4d/cdd 0 2024-09-13T02:53:07.202 INFO:tasks.workunit.client.0.smithi098.stdout:1/851: mknod d9/d33/d29/d11c/d23/c12e 0 2024-09-13T02:53:07.207 INFO:tasks.workunit.client.0.smithi098.stdout:6/730: symlink d5/d13/d2b/d3a/d41/d6c/lfa 0 2024-09-13T02:53:07.209 INFO:tasks.workunit.client.0.smithi098.stdout:2/761: rename d1/d1f/d39/df6/d59/fd0 to d1/d1f/d27/ffb 0 2024-09-13T02:53:07.210 INFO:tasks.workunit.client.0.smithi098.stdout:3/751: truncate d7/d9/d15/d2d/d5b/f9e 1973571 0 2024-09-13T02:53:07.215 INFO:tasks.workunit.client.0.smithi098.stdout:1/852: symlink d9/d33/de6/d61/ddb/l12f 0 2024-09-13T02:53:07.217 INFO:tasks.workunit.client.0.smithi098.stdout:1/853: dread - d9/f25 zero size 2024-09-13T02:53:07.217 INFO:tasks.workunit.client.0.smithi098.stdout:2/762: dwrite d1/d1f/d39/df6/d59/d9e/d9f/dc1/ff9 [0,4194304] 0 2024-09-13T02:53:07.218 INFO:tasks.workunit.client.0.smithi098.stdout:2/763: chown d1/f48 4 1 2024-09-13T02:53:07.227 INFO:tasks.workunit.client.0.smithi098.stdout:3/752: creat d7/d9/d25/d2b/fed x:0 0 0 2024-09-13T02:53:07.227 INFO:tasks.workunit.client.0.smithi098.stdout:0/789: creat dd/d1f/d85/dfc/f10d x:0 0 0 2024-09-13T02:53:07.230 INFO:tasks.workunit.client.0.smithi098.stdout:3/753: truncate d7/d9/d25/d2b/fe4 12433 0 2024-09-13T02:53:07.233 INFO:tasks.workunit.client.0.smithi098.stdout:6/731: chown d5/f31 11204 1 2024-09-13T02:53:07.236 INFO:tasks.workunit.client.0.smithi098.stdout:9/794: getdents d2/d6/d2b/d4d/d4f/d6c 0 2024-09-13T02:53:07.237 INFO:tasks.workunit.client.0.smithi098.stdout:5/689: write d0/d38/d3f/d1a/f86 [547934,33986] 0 2024-09-13T02:53:07.237 INFO:tasks.workunit.client.0.smithi098.stdout:1/854: rmdir d9/db6 39 2024-09-13T02:53:07.239 INFO:tasks.workunit.client.0.smithi098.stdout:2/764: dread - d1/d1f/d39/df6/d59/fcd zero size 2024-09-13T02:53:07.240 INFO:tasks.workunit.client.0.smithi098.stdout:1/855: write d9/d33/d19/d35/fac [278729,68806] 0 2024-09-13T02:53:07.240 INFO:tasks.workunit.client.0.smithi098.stdout:5/690: truncate d0/d15/d69/fd2 4702695 0 2024-09-13T02:53:07.249 INFO:tasks.workunit.client.0.smithi098.stdout:6/732: dread d5/d18/f1f [0,4194304] 0 2024-09-13T02:53:07.249 INFO:tasks.workunit.client.0.smithi098.stdout:7/910: dwrite d6/d24/d2a/d5a/f1d [0,4194304] 0 2024-09-13T02:53:07.261 INFO:tasks.workunit.client.0.smithi098.stdout:0/790: truncate dd/df/d1d/f2f 1655986 0 2024-09-13T02:53:07.266 INFO:tasks.workunit.client.0.smithi098.stdout:8/685: creat d2/dd/fde x:0 0 0 2024-09-13T02:53:07.276 INFO:tasks.workunit.client.0.smithi098.stdout:1/856: symlink d9/d33/d29/d11c/d23/d30/l130 0 2024-09-13T02:53:07.278 INFO:tasks.workunit.client.0.smithi098.stdout:5/691: truncate d0/d15/d17/daa/fcc 735030 0 2024-09-13T02:53:07.279 INFO:tasks.workunit.client.0.smithi098.stdout:7/911: mknod d6/d24/dc5/de3/dcf/c12d 0 2024-09-13T02:53:07.282 INFO:tasks.workunit.client.0.smithi098.stdout:3/754: mknod d7/d9/d15/cee 0 2024-09-13T02:53:07.284 INFO:tasks.workunit.client.0.smithi098.stdout:8/686: symlink d2/dd/d11/d1d/ldf 0 2024-09-13T02:53:07.285 INFO:tasks.workunit.client.0.smithi098.stdout:8/687: chown d2/d28/d43/d9f 442199 1 2024-09-13T02:53:07.287 INFO:tasks.workunit.client.0.smithi098.stdout:2/765: write d1/d1f/d35/d63/d23/f81 [2053690,22021] 0 2024-09-13T02:53:07.288 INFO:tasks.workunit.client.0.smithi098.stdout:1/857: mkdir d9/d33/d19/d35/d68/d4d/db5/dcb/d131 0 2024-09-13T02:53:07.290 INFO:tasks.workunit.client.0.smithi098.stdout:5/692: creat d0/d15/d17/d1c/dd6/fef x:0 0 0 2024-09-13T02:53:07.292 INFO:tasks.workunit.client.0.smithi098.stdout:6/733: getdents d5/d13/d2b/d3a/d41/d6c/d7c/de3 0 2024-09-13T02:53:07.294 INFO:tasks.workunit.client.0.smithi098.stdout:6/734: dread - d5/d13/d2b/d3a/d41/d6c/fcd zero size 2024-09-13T02:53:07.294 INFO:tasks.workunit.client.0.smithi098.stdout:9/795: truncate d2/d6/d2b/d4d/d56/dbc/fe2 679967 0 2024-09-13T02:53:07.295 INFO:tasks.workunit.client.0.smithi098.stdout:6/735: chown d5/d13/d2b/f48 73874168 1 2024-09-13T02:53:07.296 INFO:tasks.workunit.client.0.smithi098.stdout:6/736: read - d5/d13/d2b/d3a/d41/d55/fed zero size 2024-09-13T02:53:07.297 INFO:tasks.workunit.client.0.smithi098.stdout:8/688: fsync d2/d28/fbd 0 2024-09-13T02:53:07.299 INFO:tasks.workunit.client.0.smithi098.stdout:2/766: chown d1/d1f/d35/d63/d72/f75 134 1 2024-09-13T02:53:07.301 INFO:tasks.workunit.client.0.smithi098.stdout:1/858: mkdir d9/d33/d29/d11c/d23/da7/d132 0 2024-09-13T02:53:07.302 INFO:tasks.workunit.client.0.smithi098.stdout:1/859: fdatasync d9/d33/d19/d35/d68/d2f/f10b 0 2024-09-13T02:53:07.307 INFO:tasks.workunit.client.0.smithi098.stdout:5/693: fsync d0/d38/d3f/f73 0 2024-09-13T02:53:07.310 INFO:tasks.workunit.client.0.smithi098.stdout:3/755: truncate d7/d9/d15/d26/f6e 1195809 0 2024-09-13T02:53:07.311 INFO:tasks.workunit.client.0.smithi098.stdout:0/791: link dd/df/d1d/d26/d28/l8b dd/df/d1d/d26/d37/dea/l10e 0 2024-09-13T02:53:07.312 INFO:tasks.workunit.client.0.smithi098.stdout:3/756: write d7/d9/d25/d2b/fe4 [499888,69305] 0 2024-09-13T02:53:07.313 INFO:tasks.workunit.client.0.smithi098.stdout:3/757: rename d7 to d7/d9/d25/d2b/def 22 2024-09-13T02:53:07.313 INFO:tasks.workunit.client.0.smithi098.stdout:8/689: mknod d2/d2f/d78/d46/d74/d86/da8/ce0 0 2024-09-13T02:53:07.317 INFO:tasks.workunit.client.0.smithi098.stdout:2/767: unlink d1/d1f/d36/c44 0 2024-09-13T02:53:07.319 INFO:tasks.workunit.client.0.smithi098.stdout:6/737: write d5/d13/d51/f56 [962148,20434] 0 2024-09-13T02:53:07.320 INFO:tasks.workunit.client.0.smithi098.stdout:1/860: symlink d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/l133 0 2024-09-13T02:53:07.322 INFO:tasks.workunit.client.0.smithi098.stdout:9/796: unlink d2/d6/cb 0 2024-09-13T02:53:07.434 INFO:tasks.workunit.client.0.smithi098.stdout:0/792: creat dd/d1f/d85/d9d/f10f x:0 0 0 2024-09-13T02:53:07.500 INFO:tasks.workunit.client.0.smithi098.stdout:7/912: getdents d6/d24/dc5/de3/dcf/ded 0 2024-09-13T02:53:07.500 INFO:tasks.workunit.client.0.smithi098.stdout:7/913: dread - d6/f78 zero size 2024-09-13T02:53:07.503 INFO:tasks.workunit.client.0.smithi098.stdout:5/694: unlink d0/d38/d3f/d1a/f67 0 2024-09-13T02:53:07.505 INFO:tasks.workunit.client.0.smithi098.stdout:5/695: truncate d0/d38/d3f/d81/f33 2127366 0 2024-09-13T02:53:07.506 INFO:tasks.workunit.client.0.smithi098.stdout:8/690: write d2/dd/d11/d2c/d9b/fa9 [511788,117016] 0 2024-09-13T02:53:07.507 INFO:tasks.workunit.client.0.smithi098.stdout:9/797: fsync d2/d6/d2b/d4d/d4f/d6c/dd4/f45 0 2024-09-13T02:53:07.510 INFO:tasks.workunit.client.0.smithi098.stdout:0/793: mknod dd/d1f/d85/c110 0 2024-09-13T02:53:07.515 INFO:tasks.workunit.client.0.smithi098.stdout:7/914: rmdir d6/d24/d46 39 2024-09-13T02:53:07.515 INFO:tasks.workunit.client.0.smithi098.stdout:0/794: dwrite dd/fd9 [0,4194304] 0 2024-09-13T02:53:07.517 INFO:tasks.workunit.client.0.smithi098.stdout:7/915: chown d6/d24/d2a/d5a/d42/fb8 64487359 1 2024-09-13T02:53:07.517 INFO:tasks.workunit.client.0.smithi098.stdout:1/861: mkdir d9/d33/d19/d134 0 2024-09-13T02:53:07.520 INFO:tasks.workunit.client.0.smithi098.stdout:5/696: symlink d0/d15/d17/d1c/d3d/lf0 0 2024-09-13T02:53:07.521 INFO:tasks.workunit.client.0.smithi098.stdout:8/691: creat d2/dd/d4d/fe1 x:0 0 0 2024-09-13T02:53:07.535 INFO:tasks.workunit.client.0.smithi098.stdout:7/916: stat d6/c16 0 2024-09-13T02:53:07.540 INFO:tasks.workunit.client.0.smithi098.stdout:0/795: rename dd/df/fb2 to dd/df/d1d/d40/d46/d6b/d109/f111 0 2024-09-13T02:53:07.541 INFO:tasks.workunit.client.0.smithi098.stdout:7/917: dwrite d6/f12b [0,4194304] 0 2024-09-13T02:53:07.541 INFO:tasks.workunit.client.0.smithi098.stdout:1/862: mknod d9/d33/d19/d35/d68/d4d/db5/db8/c135 0 2024-09-13T02:53:07.543 INFO:tasks.workunit.client.0.smithi098.stdout:5/697: truncate d0/d15/d50/f8c 11476812 0 2024-09-13T02:53:07.545 INFO:tasks.workunit.client.0.smithi098.stdout:4/740: sync 2024-09-13T02:53:07.546 INFO:tasks.workunit.client.0.smithi098.stdout:8/692: rmdir d2/d28/d43 39 2024-09-13T02:53:07.550 INFO:tasks.workunit.client.0.smithi098.stdout:3/758: link d7/c7f d7/d9/d25/d64/dd5/cf0 0 2024-09-13T02:53:07.556 INFO:tasks.workunit.client.0.smithi098.stdout:3/759: dread d7/d9/d25/d64/f68 [0,4194304] 0 2024-09-13T02:53:07.557 INFO:tasks.workunit.client.0.smithi098.stdout:0/796: mkdir dd/df/d1d/d40/d9b/d112 0 2024-09-13T02:53:07.561 INFO:tasks.workunit.client.0.smithi098.stdout:1/863: symlink d9/d33/d19/d35/d10a/d114/l136 0 2024-09-13T02:53:07.566 INFO:tasks.workunit.client.0.smithi098.stdout:4/741: chown d6/d10/d21/ca4 121559027 1 2024-09-13T02:53:07.570 INFO:tasks.workunit.client.0.smithi098.stdout:2/768: sync 2024-09-13T02:53:07.572 INFO:tasks.workunit.client.0.smithi098.stdout:0/797: mkdir dd/df/d1d/d26/d28/d32/d8d/d113 0 2024-09-13T02:53:07.577 INFO:tasks.workunit.client.0.smithi098.stdout:5/698: dwrite d0/d38/f55 [0,4194304] 0 2024-09-13T02:53:07.578 INFO:tasks.workunit.client.0.smithi098.stdout:5/699: readlink d0/d38/d3f/l53 0 2024-09-13T02:53:07.579 INFO:tasks.workunit.client.0.smithi098.stdout:4/742: fsync d6/d22/f28 0 2024-09-13T02:53:07.579 INFO:tasks.workunit.client.0.smithi098.stdout:7/918: write d6/d24/d46/f5c [2534320,72845] 0 2024-09-13T02:53:07.584 INFO:tasks.workunit.client.0.smithi098.stdout:8/693: write d2/dd/d11/d2c/f76 [17401,59875] 0 2024-09-13T02:53:07.584 INFO:tasks.workunit.client.0.smithi098.stdout:2/769: truncate d1/d1f/d35/d63/d72/f9b 379456 0 2024-09-13T02:53:07.587 INFO:tasks.workunit.client.0.smithi098.stdout:1/864: mknod d9/d33/d29/d11c/d23/da7/d125/c137 0 2024-09-13T02:53:07.593 INFO:tasks.workunit.client.0.smithi098.stdout:8/694: fdatasync d2/d28/d43/fc9 0 2024-09-13T02:53:07.594 INFO:tasks.workunit.client.0.smithi098.stdout:2/770: unlink d1/d1f/d39/df6/fd9 0 2024-09-13T02:53:07.595 INFO:tasks.workunit.client.0.smithi098.stdout:0/798: creat dd/df/d1d/d26/d37/dea/f114 x:0 0 0 2024-09-13T02:53:07.602 INFO:tasks.workunit.client.0.smithi098.stdout:9/798: rename d2/d6/d2b/d4d/d4f/d6c/dd4/cbb to d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/c117 0 2024-09-13T02:53:07.602 INFO:tasks.workunit.client.0.smithi098.stdout:7/919: write d6/d24/d2a/d5a/d86/fba [504401,31485] 0 2024-09-13T02:53:07.604 INFO:tasks.workunit.client.0.smithi098.stdout:3/760: getdents d7/d9 0 2024-09-13T02:53:07.608 INFO:tasks.workunit.client.0.smithi098.stdout:0/799: mknod dd/d95/c115 0 2024-09-13T02:53:07.610 INFO:tasks.workunit.client.0.smithi098.stdout:5/700: truncate d0/d15/da4/fb5 376085 0 2024-09-13T02:53:07.613 INFO:tasks.workunit.client.0.smithi098.stdout:7/920: creat d6/d24/d46/f12e x:0 0 0 2024-09-13T02:53:07.614 INFO:tasks.workunit.client.0.smithi098.stdout:3/761: unlink d7/d9/d15/fa3 0 2024-09-13T02:53:07.618 INFO:tasks.workunit.client.0.smithi098.stdout:1/865: creat d9/d33/d19/d35/d68/d2f/f138 x:0 0 0 2024-09-13T02:53:07.618 INFO:tasks.workunit.client.0.smithi098.stdout:8/695: dread d2/dd/d11/f97 [0,4194304] 0 2024-09-13T02:53:07.619 INFO:tasks.workunit.client.0.smithi098.stdout:0/800: chown dd/df/d1d/d26/d37/c41 0 1 2024-09-13T02:53:07.620 INFO:tasks.workunit.client.0.smithi098.stdout:9/799: mkdir d2/d6/d36/d8d/d107/d118 0 2024-09-13T02:53:07.621 INFO:tasks.workunit.client.0.smithi098.stdout:5/701: dread - d0/d38/d3f/f73 zero size 2024-09-13T02:53:07.624 INFO:tasks.workunit.client.0.smithi098.stdout:3/762: chown d7/d9/d15/d26/lc0 18327 1 2024-09-13T02:53:07.626 INFO:tasks.workunit.client.0.smithi098.stdout:3/763: read d7/d9/d25/d2b/f3e [6572,51307] 0 2024-09-13T02:53:07.629 INFO:tasks.workunit.client.0.smithi098.stdout:8/696: creat d2/d2f/d78/d46/d47/d6e/d68/fe2 x:0 0 0 2024-09-13T02:53:07.633 INFO:tasks.workunit.client.0.smithi098.stdout:5/702: write d0/d38/d3f/fdb [287768,34545] 0 2024-09-13T02:53:07.635 INFO:tasks.workunit.client.0.smithi098.stdout:5/703: chown d0/d38/d3f/d81/d4d/f52 64892073 1 2024-09-13T02:53:07.637 INFO:tasks.workunit.client.0.smithi098.stdout:2/771: getdents d1/d1a/d9 0 2024-09-13T02:53:07.638 INFO:tasks.workunit.client.0.smithi098.stdout:1/866: creat d9/d33/d19/d35/d68/d4d/db5/dff/f139 x:0 0 0 2024-09-13T02:53:07.639 INFO:tasks.workunit.client.0.smithi098.stdout:1/867: write d9/d33/d87/fc3 [2071253,50253] 0 2024-09-13T02:53:07.643 INFO:tasks.workunit.client.0.smithi098.stdout:9/800: creat d2/db1/dc5/f119 x:0 0 0 2024-09-13T02:53:07.646 INFO:tasks.workunit.client.0.smithi098.stdout:5/704: symlink d0/d38/d3f/lf1 0 2024-09-13T02:53:07.647 INFO:tasks.workunit.client.0.smithi098.stdout:7/921: creat d6/f12f x:0 0 0 2024-09-13T02:53:07.650 INFO:tasks.workunit.client.0.smithi098.stdout:7/922: chown d6/d24/d2a/d5a/d42/d45/f94 1 1 2024-09-13T02:53:07.656 INFO:tasks.workunit.client.0.smithi098.stdout:0/801: dwrite dd/df/fcd [0,4194304] 0 2024-09-13T02:53:07.658 INFO:tasks.workunit.client.0.smithi098.stdout:8/697: dwrite d2/dd/d11/d2c/d9b/fad [0,4194304] 0 2024-09-13T02:53:07.660 INFO:tasks.workunit.client.0.smithi098.stdout:5/705: truncate d0/d15/d17/d1c/fa2 1013514 0 2024-09-13T02:53:07.661 INFO:tasks.workunit.client.0.smithi098.stdout:0/802: dread dd/df/d1d/da7/fb5 [0,4194304] 0 2024-09-13T02:53:07.671 INFO:tasks.workunit.client.0.smithi098.stdout:3/764: link d7/d9/d25/d64/dd5/cf0 d7/d9/d25/d64/dd5/cf1 0 2024-09-13T02:53:07.672 INFO:tasks.workunit.client.0.smithi098.stdout:3/765: chown d7/d9/d15/c4d 0 1 2024-09-13T02:53:07.672 INFO:tasks.workunit.client.0.smithi098.stdout:9/801: dwrite d2/d6/d36/d6a/f6b [4194304,4194304] 0 2024-09-13T02:53:07.681 INFO:tasks.workunit.client.0.smithi098.stdout:2/772: dwrite d1/d1f/d35/d63/f37 [8388608,4194304] 0 2024-09-13T02:53:07.685 INFO:tasks.workunit.client.0.smithi098.stdout:1/868: creat d9/db6/d119/f13a x:0 0 0 2024-09-13T02:53:07.686 INFO:tasks.workunit.client.0.smithi098.stdout:3/766: chown d7/d9/d15/d2d/lad 49 1 2024-09-13T02:53:07.688 INFO:tasks.workunit.client.0.smithi098.stdout:7/923: rename d6/d24/dc5/de3/df2/f102 to d6/d1e/dd4/f130 0 2024-09-13T02:53:07.697 INFO:tasks.workunit.client.0.smithi098.stdout:1/869: dread d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fd9 [0,4194304] 0 2024-09-13T02:53:07.701 INFO:tasks.workunit.client.0.smithi098.stdout:3/767: dwrite d7/d9/d15/d2d/db8/d51/d9c/fb2 [0,4194304] 0 2024-09-13T02:53:07.705 INFO:tasks.workunit.client.0.smithi098.stdout:0/803: link dd/df/d1d/d26/d28/d32/d67/f102 dd/d1f/d85/d9d/dc9/f116 0 2024-09-13T02:53:07.706 INFO:tasks.workunit.client.0.smithi098.stdout:9/802: write d2/d6/f42 [443518,59903] 0 2024-09-13T02:53:07.707 INFO:tasks.workunit.client.0.smithi098.stdout:7/924: dwrite d6/d24/d2a/d5a/d86/d65/d9a/f10d [0,4194304] 0 2024-09-13T02:53:07.710 INFO:tasks.workunit.client.0.smithi098.stdout:8/698: dwrite d2/f9 [4194304,4194304] 0 2024-09-13T02:53:07.713 INFO:tasks.workunit.client.0.smithi098.stdout:9/803: write d2/d6/fa8 [90654,78909] 0 2024-09-13T02:53:07.715 INFO:tasks.workunit.client.0.smithi098.stdout:7/925: chown d6/f10 45 1 2024-09-13T02:53:07.715 INFO:tasks.workunit.client.0.smithi098.stdout:5/706: dwrite d0/d38/d3f/d81/f95 [0,4194304] 0 2024-09-13T02:53:07.721 INFO:tasks.workunit.client.0.smithi098.stdout:5/707: chown d0/d38/d3f/d81/d4d/d82/ccf 588719 1 2024-09-13T02:53:07.723 INFO:tasks.workunit.client.0.smithi098.stdout:9/804: fsync d2/d6/d2b/d4d/d56/dbc/f106 0 2024-09-13T02:53:07.725 INFO:tasks.workunit.client.0.smithi098.stdout:2/773: dwrite d1/d1f/d30/def/f96 [0,4194304] 0 2024-09-13T02:53:07.725 INFO:tasks.workunit.client.0.smithi098.stdout:1/870: dread d9/d33/d29/d11c/d6b/fe5 [0,4194304] 0 2024-09-13T02:53:07.725 INFO:tasks.workunit.client.0.smithi098.stdout:0/804: rename dd/df/d1d/d26/d37 to dd/df/d1d/d26/d28/d32/dda/d117 0 2024-09-13T02:53:07.728 INFO:tasks.workunit.client.0.smithi098.stdout:9/805: chown d2/d6/d2b/d4d/d56/c6f 351648 1 2024-09-13T02:53:07.731 INFO:tasks.workunit.client.0.smithi098.stdout:8/699: mkdir d2/d2f/d78/d5d/de3 0 2024-09-13T02:53:07.731 INFO:tasks.workunit.client.0.smithi098.stdout:2/774: chown d1/d1f/d30/cc6 7135455 1 2024-09-13T02:53:07.735 INFO:tasks.workunit.client.0.smithi098.stdout:1/871: readlink d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/l133 0 2024-09-13T02:53:07.736 INFO:tasks.workunit.client.0.smithi098.stdout:5/708: symlink d0/d15/d17/d1c/lf2 0 2024-09-13T02:53:07.737 INFO:tasks.workunit.client.0.smithi098.stdout:6/738: sync 2024-09-13T02:53:07.739 INFO:tasks.workunit.client.0.smithi098.stdout:9/806: chown d2/d6/d2b/d4d/d4f/d6c/dd4/d43/f83 9927 1 2024-09-13T02:53:07.740 INFO:tasks.workunit.client.0.smithi098.stdout:9/807: stat d2/d6/f42 0 2024-09-13T02:53:07.742 INFO:tasks.workunit.client.0.smithi098.stdout:0/805: dwrite dd/df/d1d/d26/d28/d32/d67/d82/df0/ff4 [0,4194304] 0 2024-09-13T02:53:07.744 INFO:tasks.workunit.client.0.smithi098.stdout:9/808: readlink d2/d6/d2b/d4d/d4f/d6c/dd4/lff 0 2024-09-13T02:53:07.745 INFO:tasks.workunit.client.0.smithi098.stdout:0/806: write f4 [7364755,87567] 0 2024-09-13T02:53:07.746 INFO:tasks.workunit.client.0.smithi098.stdout:2/775: mknod d1/d1f/d35/d63/cfc 0 2024-09-13T02:53:07.749 INFO:tasks.workunit.client.0.smithi098.stdout:2/776: write d1/d1f/d35/f4b [3073245,75780] 0 2024-09-13T02:53:07.752 INFO:tasks.workunit.client.0.smithi098.stdout:9/809: fdatasync d2/d6/d2b/d4d/d56/db9/ddf/fe1 0 2024-09-13T02:53:07.753 INFO:tasks.workunit.client.0.smithi098.stdout:0/807: mknod dd/d1f/d85/d9d/c118 0 2024-09-13T02:53:07.754 INFO:tasks.workunit.client.0.smithi098.stdout:9/810: write d2/d6/d2b/d4d/fe6 [1053451,75697] 0 2024-09-13T02:53:07.763 INFO:tasks.workunit.client.0.smithi098.stdout:3/768: dread d7/d9/d15/d2d/d34/f61 [0,4194304] 0 2024-09-13T02:53:07.765 INFO:tasks.workunit.client.0.smithi098.stdout:7/926: dread d6/d24/d2a/d5a/d42/fb6 [0,4194304] 0 2024-09-13T02:53:07.766 INFO:tasks.workunit.client.0.smithi098.stdout:0/808: mknod dd/df/d1d/d26/d28/d32/d67/d71/c119 0 2024-09-13T02:53:07.766 INFO:tasks.workunit.client.0.smithi098.stdout:8/700: write d2/d2f/d78/f64 [1932922,56223] 0 2024-09-13T02:53:07.768 INFO:tasks.workunit.client.0.smithi098.stdout:1/872: write d9/d33/d19/d35/d68/d4d/db5/dcb/f10c [468408,56819] 0 2024-09-13T02:53:07.769 INFO:tasks.workunit.client.0.smithi098.stdout:5/709: link d0/d38/d3f/d1a/f97 d0/d15/d69/ff3 0 2024-09-13T02:53:07.774 INFO:tasks.workunit.client.0.smithi098.stdout:9/811: unlink d2/f57 0 2024-09-13T02:53:07.776 INFO:tasks.workunit.client.0.smithi098.stdout:9/812: dread d2/d6/d2b/d4d/d4f/fa9 [0,4194304] 0 2024-09-13T02:53:07.778 INFO:tasks.workunit.client.0.smithi098.stdout:2/777: write d1/d1f/d39/df6/d7f/fae [414014,108067] 0 2024-09-13T02:53:07.779 INFO:tasks.workunit.client.0.smithi098.stdout:7/927: read d6/d24/d2a/d5a/d42/fb8 [397195,49220] 0 2024-09-13T02:53:07.780 INFO:tasks.workunit.client.0.smithi098.stdout:7/928: chown d6/d24/d2a/d57/l5b 42792 1 2024-09-13T02:53:07.782 INFO:tasks.workunit.client.0.smithi098.stdout:0/809: creat dd/df/d1d/d26/d28/d32/d67/d71/dbd/f11a x:0 0 0 2024-09-13T02:53:07.783 INFO:tasks.workunit.client.0.smithi098.stdout:5/710: creat d0/d15/d69/ff4 x:0 0 0 2024-09-13T02:53:07.784 INFO:tasks.workunit.client.0.smithi098.stdout:0/810: write dd/df/d1d/d26/d28/d32/dda/d117/ff1 [598019,1008] 0 2024-09-13T02:53:07.784 INFO:tasks.workunit.client.0.smithi098.stdout:1/873: mkdir d9/d33/d19/d35/d68/d4d/db5/d13b 0 2024-09-13T02:53:07.787 INFO:tasks.workunit.client.0.smithi098.stdout:0/811: dread dd/df/d1d/da7/fb5 [0,4194304] 0 2024-09-13T02:53:07.787 INFO:tasks.workunit.client.0.smithi098.stdout:9/813: mkdir d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/d11a 0 2024-09-13T02:53:07.788 INFO:tasks.workunit.client.0.smithi098.stdout:0/812: fdatasync dd/d1f/f25 0 2024-09-13T02:53:07.789 INFO:tasks.workunit.client.0.smithi098.stdout:0/813: dread - dd/df/d1d/d26/d28/d32/d67/d71/f52 zero size 2024-09-13T02:53:07.789 INFO:tasks.workunit.client.0.smithi098.stdout:8/701: fdatasync d2/dd/d11/f16 0 2024-09-13T02:53:07.792 INFO:tasks.workunit.client.0.smithi098.stdout:8/702: readlink d2/dd/lc5 0 2024-09-13T02:53:07.792 INFO:tasks.workunit.client.0.smithi098.stdout:7/929: creat d6/d24/d2a/d5a/d86/db1/f131 x:0 0 0 2024-09-13T02:53:07.796 INFO:tasks.workunit.client.0.smithi098.stdout:5/711: creat d0/d15/d17/d1c/ff5 x:0 0 0 2024-09-13T02:53:07.798 INFO:tasks.workunit.client.0.smithi098.stdout:1/874: unlink d9/d33/d87/f11a 0 2024-09-13T02:53:07.799 INFO:tasks.workunit.client.0.smithi098.stdout:3/769: truncate d7/d9/d15/d26/f84 3845526 0 2024-09-13T02:53:07.804 INFO:tasks.workunit.client.0.smithi098.stdout:7/930: truncate d6/d24/fee 3591756 0 2024-09-13T02:53:07.805 INFO:tasks.workunit.client.0.smithi098.stdout:5/712: chown d0/d38/d3f/d81/d4d/d82/d9a/lb3 710709085 1 2024-09-13T02:53:07.805 INFO:tasks.workunit.client.0.smithi098.stdout:7/931: chown d6/d24/d2a/d5a/d86/lb5 90394 1 2024-09-13T02:53:07.806 INFO:tasks.workunit.client.0.smithi098.stdout:5/713: readlink d0/d15/d17/d1c/lf2 0 2024-09-13T02:53:07.807 INFO:tasks.workunit.client.0.smithi098.stdout:1/875: mknod d9/d33/d19/d35/d68/d4d/db5/d118/c13c 0 2024-09-13T02:53:07.811 INFO:tasks.workunit.client.0.smithi098.stdout:9/814: truncate d2/d6/d36/d8d/f30 4599966 0 2024-09-13T02:53:07.814 INFO:tasks.workunit.client.0.smithi098.stdout:0/814: creat dd/df/d1d/d26/d28/f11b x:0 0 0 2024-09-13T02:53:07.816 INFO:tasks.workunit.client.0.smithi098.stdout:7/932: link d6/d47/fb7 d6/d24/d2a/dda/f132 0 2024-09-13T02:53:07.818 INFO:tasks.workunit.client.0.smithi098.stdout:7/933: dread - d6/d24/d2a/d5a/d42/d45/d73/f10f zero size 2024-09-13T02:53:07.819 INFO:tasks.workunit.client.0.smithi098.stdout:7/934: readlink d6/d47/la0 0 2024-09-13T02:53:07.822 INFO:tasks.workunit.client.0.smithi098.stdout:3/770: dread d7/d9/d15/d2d/d5b/f46 [0,4194304] 0 2024-09-13T02:53:07.825 INFO:tasks.workunit.client.0.smithi098.stdout:9/815: link d2/d6/d2b/f9e d2/d6/d2b/d66/de0/d102/f11b 0 2024-09-13T02:53:07.826 INFO:tasks.workunit.client.0.smithi098.stdout:9/816: dread - d2/d6/d2b/d4d/d56/dbc/f106 zero size 2024-09-13T02:53:07.827 INFO:tasks.workunit.client.0.smithi098.stdout:5/714: creat d0/d38/d3f/d81/d4d/d82/ff6 x:0 0 0 2024-09-13T02:53:07.828 INFO:tasks.workunit.client.0.smithi098.stdout:7/935: creat d6/d24/dc5/de3/df2/f133 x:0 0 0 2024-09-13T02:53:07.829 INFO:tasks.workunit.client.0.smithi098.stdout:5/715: truncate d0/d15/d17/daa/fcd 1795856 0 2024-09-13T02:53:07.830 INFO:tasks.workunit.client.0.smithi098.stdout:0/815: creat dd/df/d1d/d26/d28/d32/d8d/d113/f11c x:0 0 0 2024-09-13T02:53:07.835 INFO:tasks.workunit.client.0.smithi098.stdout:9/817: creat d2/db1/dcb/f11c x:0 0 0 2024-09-13T02:53:07.836 INFO:tasks.workunit.client.0.smithi098.stdout:3/771: dread d7/d9/d15/d2d/db8/f44 [0,4194304] 0 2024-09-13T02:53:07.837 INFO:tasks.workunit.client.0.smithi098.stdout:7/936: creat d6/d24/d2a/d5a/d86/db1/dc2/f134 x:0 0 0 2024-09-13T02:53:07.838 INFO:tasks.workunit.client.0.smithi098.stdout:7/937: write d6/f11 [1864482,53457] 0 2024-09-13T02:53:07.840 INFO:tasks.workunit.client.0.smithi098.stdout:7/938: write d6/d24/d2a/d5a/d86/d65/d9a/f10d [4773305,45] 0 2024-09-13T02:53:07.840 INFO:tasks.workunit.client.0.smithi098.stdout:5/716: creat d0/d15/d17/d1c/d3d/ff7 x:0 0 0 2024-09-13T02:53:07.842 INFO:tasks.workunit.client.0.smithi098.stdout:0/816: mknod dd/df/d1d/d40/d46/c11d 0 2024-09-13T02:53:07.845 INFO:tasks.workunit.client.0.smithi098.stdout:1/876: truncate d9/d33/d29/d11c/d6b/fb2 3085728 0 2024-09-13T02:53:07.847 INFO:tasks.workunit.client.0.smithi098.stdout:9/818: write d2/d6/d2b/fa1 [1348155,47283] 0 2024-09-13T02:53:07.849 INFO:tasks.workunit.client.0.smithi098.stdout:7/939: dwrite d6/d24/dc5/f127 [0,4194304] 0 2024-09-13T02:53:07.851 INFO:tasks.workunit.client.0.smithi098.stdout:3/772: symlink d7/d9/d15/d2d/d78/d7e/d8e/lf2 0 2024-09-13T02:53:07.858 INFO:tasks.workunit.client.0.smithi098.stdout:0/817: creat dd/df/d1d/d26/d28/d32/dda/d117/dea/f11e x:0 0 0 2024-09-13T02:53:07.862 INFO:tasks.workunit.client.0.smithi098.stdout:1/877: symlink d9/d33/d29/d11c/d23/l13d 0 2024-09-13T02:53:07.873 INFO:tasks.workunit.client.0.smithi098.stdout:1/878: creat d9/d33/d29/d11c/d23/da7/f13e x:0 0 0 2024-09-13T02:53:07.873 INFO:tasks.workunit.client.0.smithi098.stdout:1/879: chown d9/d33/d19/d35/d10a/d114/d121 221692 1 2024-09-13T02:53:07.874 INFO:tasks.workunit.client.0.smithi098.stdout:7/940: mkdir d6/d24/d2a/dda/d11c/d135 0 2024-09-13T02:53:07.876 INFO:tasks.workunit.client.0.smithi098.stdout:9/819: mknod d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/df1/dfb/c11d 0 2024-09-13T02:53:07.885 INFO:tasks.workunit.client.0.smithi098.stdout:9/820: creat d2/d6/d2b/d66/de0/de9/f11e x:0 0 0 2024-09-13T02:53:07.885 INFO:tasks.workunit.client.0.smithi098.stdout:1/880: rmdir d9/d33/d19/d35/d10a/d114/d121/d128 0 2024-09-13T02:53:07.887 INFO:tasks.workunit.client.0.smithi098.stdout:0/818: write dd/df/d1d/d40/d46/d6b/fb1 [358755,98205] 0 2024-09-13T02:53:07.889 INFO:tasks.workunit.client.0.smithi098.stdout:0/819: readlink dd/df/lbc 0 2024-09-13T02:53:07.892 INFO:tasks.workunit.client.0.smithi098.stdout:1/881: creat d9/d33/d19/d35/d68/d4d/f13f x:0 0 0 2024-09-13T02:53:07.893 INFO:tasks.workunit.client.0.smithi098.stdout:5/717: dwrite d0/d38/d3f/d1a/f97 [0,4194304] 0 2024-09-13T02:53:07.897 INFO:tasks.workunit.client.0.smithi098.stdout:4/743: sync 2024-09-13T02:53:07.900 INFO:tasks.workunit.client.0.smithi098.stdout:1/882: unlink d9/d33/d19/d64/fbb 0 2024-09-13T02:53:07.901 INFO:tasks.workunit.client.0.smithi098.stdout:7/941: dwrite d6/d24/d46/f64 [0,4194304] 0 2024-09-13T02:53:07.904 INFO:tasks.workunit.client.0.smithi098.stdout:9/821: getdents d2/d6/d36/d8d/dc8 0 2024-09-13T02:53:07.908 INFO:tasks.workunit.client.0.smithi098.stdout:0/820: mknod dd/d1f/d85/df5/c11f 0 2024-09-13T02:53:07.911 INFO:tasks.workunit.client.0.smithi098.stdout:4/744: mkdir d6/d22/d3d/dc8/dd5/df5 0 2024-09-13T02:53:07.916 INFO:tasks.workunit.client.0.smithi098.stdout:7/942: rmdir d6/d24/d2a 39 2024-09-13T02:53:07.920 INFO:tasks.workunit.client.0.smithi098.stdout:9/822: creat d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/f11f x:0 0 0 2024-09-13T02:53:07.923 INFO:tasks.workunit.client.0.smithi098.stdout:7/943: dwrite d6/d1e/f36 [0,4194304] 0 2024-09-13T02:53:07.926 INFO:tasks.workunit.client.0.smithi098.stdout:0/821: write dd/df/d1d/d40/d46/fad [259189,91073] 0 2024-09-13T02:53:07.929 INFO:tasks.workunit.client.0.smithi098.stdout:1/883: dwrite d9/d33/f6f [0,4194304] 0 2024-09-13T02:53:07.930 INFO:tasks.workunit.client.0.smithi098.stdout:4/745: getdents d6/d8d/db9 0 2024-09-13T02:53:07.935 INFO:tasks.workunit.client.0.smithi098.stdout:5/718: dwrite d0/d15/d50/f8c [0,4194304] 0 2024-09-13T02:53:07.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/719: chown d0/d15/d17/d1c/f99 116 1 2024-09-13T02:53:07.945 INFO:tasks.workunit.client.0.smithi098.stdout:5/720: stat d0/d38/d3f/d1a/c3b 0 2024-09-13T02:53:07.945 INFO:tasks.workunit.client.0.smithi098.stdout:5/721: fsync d0/d15/f3c 0 2024-09-13T02:53:07.947 INFO:tasks.workunit.client.0.smithi098.stdout:0/822: rename dd/df/d1d/d26/d28/d32/d67/d71/c8c to dd/d1f/c120 0 2024-09-13T02:53:07.948 INFO:tasks.workunit.client.0.smithi098.stdout:7/944: getdents d6/d24/d2a/dda/dbb 0 2024-09-13T02:53:07.950 INFO:tasks.workunit.client.0.smithi098.stdout:5/722: symlink d0/d38/d3f/d81/d9e/lf8 0 2024-09-13T02:53:07.952 INFO:tasks.workunit.client.0.smithi098.stdout:4/746: rename d6/d10/ccf to d6/d22/d3d/d41/d74/d98/cf6 0 2024-09-13T02:53:07.953 INFO:tasks.workunit.client.0.smithi098.stdout:4/747: write d6/d22/d3d/d64/f6d [2709053,28931] 0 2024-09-13T02:53:07.958 INFO:tasks.workunit.client.0.smithi098.stdout:7/945: truncate d6/f15 1727967 0 2024-09-13T02:53:07.961 INFO:tasks.workunit.client.0.smithi098.stdout:9/823: dread d2/d6/d2b/d4d/d4f/d6c/dd4/d43/f50 [0,4194304] 0 2024-09-13T02:53:07.965 INFO:tasks.workunit.client.0.smithi098.stdout:4/748: symlink d6/d3e/d73/de7/lf7 0 2024-09-13T02:53:07.968 INFO:tasks.workunit.client.0.smithi098.stdout:9/824: dread d2/d6/d2b/d4d/d4f/d6c/f85 [0,4194304] 0 2024-09-13T02:53:07.969 INFO:tasks.workunit.client.0.smithi098.stdout:1/884: dwrite d9/d33/d19/d35/d68/d4d/db5/db8/fc8 [0,4194304] 0 2024-09-13T02:53:07.975 INFO:tasks.workunit.client.0.smithi098.stdout:7/946: write d6/d24/d2a/d5a/d4c/f60 [1840656,71272] 0 2024-09-13T02:53:07.977 INFO:tasks.workunit.client.0.smithi098.stdout:9/825: truncate d2/d6/d36/f5f 1410187 0 2024-09-13T02:53:07.978 INFO:tasks.workunit.client.0.smithi098.stdout:5/723: dwrite d0/d15/d17/d1c/f74 [0,4194304] 0 2024-09-13T02:53:07.979 INFO:tasks.workunit.client.0.smithi098.stdout:1/885: mkdir d9/d33/d19/d35/d140 0 2024-09-13T02:53:07.979 INFO:tasks.workunit.client.0.smithi098.stdout:5/724: readlink d0/la8 0 2024-09-13T02:53:07.985 INFO:tasks.workunit.client.0.smithi098.stdout:1/886: rmdir d9/d33/d19/d35/d10a 39 2024-09-13T02:53:07.986 INFO:tasks.workunit.client.0.smithi098.stdout:5/725: dread - d0/d15/d17/d1c/f96 zero size 2024-09-13T02:53:07.988 INFO:tasks.workunit.client.0.smithi098.stdout:5/726: chown d0/d15/d17/d1c/dd6 724275 1 2024-09-13T02:53:07.990 INFO:tasks.workunit.client.0.smithi098.stdout:4/749: rename d6/l77 to d6/d22/d3d/d41/lf8 0 2024-09-13T02:53:07.990 INFO:tasks.workunit.client.0.smithi098.stdout:9/826: dwrite d2/d6/d36/f82 [0,4194304] 0 2024-09-13T02:53:07.996 INFO:tasks.workunit.client.0.smithi098.stdout:7/947: rename d6/d24/d2a/d57/lff to d6/d24/dc5/de3/dcf/ded/l136 0 2024-09-13T02:53:07.997 INFO:tasks.workunit.client.0.smithi098.stdout:4/750: mkdir d6/db/df9 0 2024-09-13T02:53:08.001 INFO:tasks.workunit.client.0.smithi098.stdout:9/827: symlink d2/d6/d36/d8d/dc8/df8/l120 0 2024-09-13T02:53:08.009 INFO:tasks.workunit.client.0.smithi098.stdout:4/751: truncate d6/d10/f9d 1312461 0 2024-09-13T02:53:08.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/752: creat d6/ffa x:0 0 0 2024-09-13T02:53:08.017 INFO:tasks.workunit.client.0.smithi098.stdout:4/753: rmdir d6/d3e 39 2024-09-13T02:53:08.018 INFO:tasks.workunit.client.0.smithi098.stdout:4/754: write d6/d22/f63 [1185593,101608] 0 2024-09-13T02:53:08.026 INFO:tasks.workunit.client.0.smithi098.stdout:1/887: dwrite d9/d33/de6/d61/db1/fd4 [0,4194304] 0 2024-09-13T02:53:08.033 INFO:tasks.workunit.client.0.smithi098.stdout:7/948: write d6/f19 [1085290,339] 0 2024-09-13T02:53:08.035 INFO:tasks.workunit.client.0.smithi098.stdout:7/949: chown d6/df9/d110 64740 1 2024-09-13T02:53:08.036 INFO:tasks.workunit.client.0.smithi098.stdout:5/727: dwrite d0/d57/f94 [0,4194304] 0 2024-09-13T02:53:08.037 INFO:tasks.workunit.client.0.smithi098.stdout:9/828: write d2/d6/d2b/d4d/d4f/d6c/fe3 [792318,110158] 0 2024-09-13T02:53:08.038 INFO:tasks.workunit.client.0.smithi098.stdout:7/950: chown d6/d24/d2a/lea 3232445 1 2024-09-13T02:53:08.040 INFO:tasks.workunit.client.0.smithi098.stdout:7/951: write d6/d24/dc5/de3/df2/f103 [4512855,20138] 0 2024-09-13T02:53:08.044 INFO:tasks.workunit.client.0.smithi098.stdout:9/829: unlink d2/d6/l68 0 2024-09-13T02:53:08.046 INFO:tasks.workunit.client.0.smithi098.stdout:9/830: chown d2/c87 1505309712 1 2024-09-13T02:53:08.051 INFO:tasks.workunit.client.0.smithi098.stdout:9/831: read d2/d6/d2b/d4d/d4f/d6c/dd4/dac/fb5 [3380447,83038] 0 2024-09-13T02:53:08.053 INFO:tasks.workunit.client.0.smithi098.stdout:9/832: stat d2/d6/d36/d8d/dc8/f10d 0 2024-09-13T02:53:08.055 INFO:tasks.workunit.client.0.smithi098.stdout:9/833: stat d2/d6/d2b/d4d/d4f/d6c/f85 0 2024-09-13T02:53:08.059 INFO:tasks.workunit.client.0.smithi098.stdout:4/755: dwrite d6/d3e/d68/fad [0,4194304] 0 2024-09-13T02:53:08.059 INFO:tasks.workunit.client.0.smithi098.stdout:9/834: dread - d2/d6/d2b/d4d/d4f/d6c/dd4/dac/f10e zero size 2024-09-13T02:53:08.063 INFO:tasks.workunit.client.0.smithi098.stdout:4/756: write d6/d22/d3d/d64/d6f/ff4 [919225,112710] 0 2024-09-13T02:53:08.068 INFO:tasks.workunit.client.0.smithi098.stdout:1/888: dwrite d9/d33/d29/d11c/d6b/fe5 [0,4194304] 0 2024-09-13T02:53:08.068 INFO:tasks.workunit.client.0.smithi098.stdout:4/757: truncate d6/d3e/d46/dd2/fd9 2482764 0 2024-09-13T02:53:08.072 INFO:tasks.workunit.client.0.smithi098.stdout:1/889: chown d9/d33/d19/d35/d68/d2f/dbf/cae 2076 1 2024-09-13T02:53:08.074 INFO:tasks.workunit.client.0.smithi098.stdout:9/835: fdatasync d2/d6/d2b/d4d/d56/dbc/fe2 0 2024-09-13T02:53:08.075 INFO:tasks.workunit.client.0.smithi098.stdout:7/952: write d6/d24/d63/f72 [656886,37480] 0 2024-09-13T02:53:08.079 INFO:tasks.workunit.client.0.smithi098.stdout:5/728: dwrite d0/d15/f87 [0,4194304] 0 2024-09-13T02:53:08.079 INFO:tasks.workunit.client.0.smithi098.stdout:7/953: fsync d6/d24/d46/fec 0 2024-09-13T02:53:08.090 INFO:tasks.workunit.client.0.smithi098.stdout:9/836: rmdir d2/d6/d2b/d4d/d4f/d6c 39 2024-09-13T02:53:08.091 INFO:tasks.workunit.client.0.smithi098.stdout:7/954: readlink d6/d24/dc5/de3/dcf/ded/l136 0 2024-09-13T02:53:08.094 INFO:tasks.workunit.client.0.smithi098.stdout:5/729: mkdir d0/d15/d17/d1c/d3d/df9 0 2024-09-13T02:53:08.094 INFO:tasks.workunit.client.0.smithi098.stdout:7/955: write d6/d24/d2a/d5a/d42/fb6 [421861,57812] 0 2024-09-13T02:53:08.097 INFO:tasks.workunit.client.0.smithi098.stdout:5/730: read d0/d15/f8d [348966,24726] 0 2024-09-13T02:53:08.106 INFO:tasks.workunit.client.0.smithi098.stdout:5/731: mkdir d0/d15/d69/dfa 0 2024-09-13T02:53:08.108 INFO:tasks.workunit.client.0.smithi098.stdout:1/890: dwrite d9/d33/f22 [0,4194304] 0 2024-09-13T02:53:08.112 INFO:tasks.workunit.client.0.smithi098.stdout:7/956: truncate d6/f41 1083900 0 2024-09-13T02:53:08.117 INFO:tasks.workunit.client.0.smithi098.stdout:5/732: unlink d0/d15/d50/l54 0 2024-09-13T02:53:08.119 INFO:tasks.workunit.client.0.smithi098.stdout:7/957: creat d6/d24/d2a/df7/f137 x:0 0 0 2024-09-13T02:53:08.123 INFO:tasks.workunit.client.0.smithi098.stdout:7/958: read d6/d24/d2a/d5a/d4c/f6a [2807964,43157] 0 2024-09-13T02:53:08.127 INFO:tasks.workunit.client.0.smithi098.stdout:7/959: truncate d6/d24/d2a/d5a/d42/d45/d73/f121 120907 0 2024-09-13T02:53:08.129 INFO:tasks.workunit.client.0.smithi098.stdout:9/837: dread d2/d6/d2b/f5c [0,4194304] 0 2024-09-13T02:53:08.130 INFO:tasks.workunit.client.0.smithi098.stdout:7/960: chown d6/d24/dc5/de3/cd1 36 1 2024-09-13T02:53:08.136 INFO:tasks.workunit.client.0.smithi098.stdout:9/838: link d2/d6/d2b/d4d/fef d2/d6/d2b/d4d/d56/f121 0 2024-09-13T02:53:08.143 INFO:tasks.workunit.client.0.smithi098.stdout:5/733: rmdir d0 39 2024-09-13T02:53:08.144 INFO:tasks.workunit.client.0.smithi098.stdout:1/891: dread d9/d33/d29/d11c/d23/da7/d51/f98 [0,4194304] 0 2024-09-13T02:53:08.145 INFO:tasks.workunit.client.0.smithi098.stdout:1/892: stat d9/d33/d29/d11c/d23/lc9 0 2024-09-13T02:53:08.146 INFO:tasks.workunit.client.0.smithi098.stdout:1/893: read d9/d33/d29/d58/f82 [3249695,20730] 0 2024-09-13T02:53:08.147 INFO:tasks.workunit.client.0.smithi098.stdout:5/734: readlink d0/d15/d17/l31 0 2024-09-13T02:53:08.153 INFO:tasks.workunit.client.0.smithi098.stdout:7/961: dwrite d6/d47/f7e [0,4194304] 0 2024-09-13T02:53:08.158 INFO:tasks.workunit.client.0.smithi098.stdout:5/735: dwrite d0/d15/d17/f26 [4194304,4194304] 0 2024-09-13T02:53:08.161 INFO:tasks.workunit.client.0.smithi098.stdout:9/839: dwrite d2/d6/f29 [0,4194304] 0 2024-09-13T02:53:08.276 INFO:tasks.workunit.client.0.smithi098.stdout:7/962: truncate d6/d24/d2a/d5a/d86/f7d 1016748 0 2024-09-13T02:53:08.279 INFO:tasks.workunit.client.0.smithi098.stdout:7/963: write d6/d24/d2a/d5a/d86/d65/f11e [101409,44671] 0 2024-09-13T02:53:08.281 INFO:tasks.workunit.client.0.smithi098.stdout:1/894: dwrite d9/d33/d19/d35/d68/d4d/db5/db8/fbe [0,4194304] 0 2024-09-13T02:53:08.281 INFO:tasks.workunit.client.0.smithi098.stdout:9/840: readlink d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/lf0 0 2024-09-13T02:53:08.283 INFO:tasks.workunit.client.0.smithi098.stdout:7/964: dread - d6/d24/d2a/d5a/d86/f11a zero size 2024-09-13T02:53:08.283 INFO:tasks.workunit.client.0.smithi098.stdout:7/965: readlink d6/l18 0 2024-09-13T02:53:08.290 INFO:tasks.workunit.client.0.smithi098.stdout:9/841: dwrite d2/d6/d2b/d4d/d4f/d6c/f79 [0,4194304] 0 2024-09-13T02:53:08.312 INFO:tasks.workunit.client.0.smithi098.stdout:7/966: dread d6/d1e/f62 [0,4194304] 0 2024-09-13T02:53:08.330 INFO:tasks.workunit.client.0.smithi098.stdout:5/736: rename d0/d38/d3f/d1a/d27/f6b to d0/d15/d17/d1c/dd6/ffb 0 2024-09-13T02:53:08.332 INFO:tasks.workunit.client.0.smithi098.stdout:1/895: creat d9/d33/d19/d35/d68/d4d/db5/dff/f141 x:0 0 0 2024-09-13T02:53:08.337 INFO:tasks.workunit.client.0.smithi098.stdout:9/842: readlink d2/l74 0 2024-09-13T02:53:08.338 INFO:tasks.workunit.client.0.smithi098.stdout:7/967: readlink d6/d24/dc5/de3/de6/d108/l109 0 2024-09-13T02:53:08.340 INFO:tasks.workunit.client.0.smithi098.stdout:5/737: write d0/d38/d3f/fc5 [654228,30018] 0 2024-09-13T02:53:08.341 INFO:tasks.workunit.client.0.smithi098.stdout:5/738: fsync d0/d15/d17/d1c/d3d/ff7 0 2024-09-13T02:53:08.346 INFO:tasks.workunit.client.0.smithi098.stdout:7/968: unlink d6/c32 0 2024-09-13T02:53:08.350 INFO:tasks.workunit.client.0.smithi098.stdout:9/843: fdatasync d2/d6/d36/d6a/f7d 0 2024-09-13T02:53:08.359 INFO:tasks.workunit.client.0.smithi098.stdout:7/969: creat d6/d24/d2a/d57/dce/f138 x:0 0 0 2024-09-13T02:53:08.359 INFO:tasks.workunit.client.0.smithi098.stdout:7/970: chown d6/d24/d2a/d57/l5b 947701 1 2024-09-13T02:53:08.363 INFO:tasks.workunit.client.0.smithi098.stdout:7/971: creat d6/d24/d2a/d5a/d4c/da5/f139 x:0 0 0 2024-09-13T02:53:08.365 INFO:tasks.workunit.client.0.smithi098.stdout:7/972: mknod d6/d24/dc5/de3/df2/c13a 0 2024-09-13T02:53:08.378 INFO:tasks.workunit.client.0.smithi098.stdout:5/739: write d0/d15/da4/db1/fbc [596862,81226] 0 2024-09-13T02:53:08.380 INFO:tasks.workunit.client.0.smithi098.stdout:1/896: dwrite d9/d33/d19/d35/d68/d2f/dbf/f85 [0,4194304] 0 2024-09-13T02:53:08.381 INFO:tasks.workunit.client.0.smithi098.stdout:9/844: truncate d2/d6/d36/d6a/f6b 2963372 0 2024-09-13T02:53:08.386 INFO:tasks.workunit.client.0.smithi098.stdout:1/897: mknod d9/d33/d19/d35/d140/c142 0 2024-09-13T02:53:08.390 INFO:tasks.workunit.client.0.smithi098.stdout:7/973: dwrite d6/ff [0,4194304] 0 2024-09-13T02:53:08.395 INFO:tasks.workunit.client.0.smithi098.stdout:1/898: rmdir d9/d33/d19/d35/d10a/d114 39 2024-09-13T02:53:08.395 INFO:tasks.workunit.client.0.smithi098.stdout:5/740: write d0/d15/d17/daa/dab/fc6 [1724891,33251] 0 2024-09-13T02:53:08.398 INFO:tasks.workunit.client.0.smithi098.stdout:9/845: truncate d2/d6/d36/d6a/f6b 3840474 0 2024-09-13T02:53:08.401 INFO:tasks.workunit.client.0.smithi098.stdout:7/974: mknod d6/d24/d2a/d5a/d8e/df0/d11d/c13b 0 2024-09-13T02:53:08.402 INFO:tasks.workunit.client.0.smithi098.stdout:1/899: mknod d9/d33/d19/d35/d68/d2f/dbf/c143 0 2024-09-13T02:53:08.403 INFO:tasks.workunit.client.0.smithi098.stdout:1/900: stat d9/d33/d19/d35/d68/d2f/dbf 0 2024-09-13T02:53:08.405 INFO:tasks.workunit.client.0.smithi098.stdout:9/846: mkdir d2/d6/d36/da7/d122 0 2024-09-13T02:53:08.410 INFO:tasks.workunit.client.0.smithi098.stdout:7/975: link d6/d24/d2a/d57/d88/c67 d6/d24/d2a/d5a/d42/dde/c13c 0 2024-09-13T02:53:08.414 INFO:tasks.workunit.client.0.smithi098.stdout:7/976: creat d6/d1e/dd4/f13d x:0 0 0 2024-09-13T02:53:08.421 INFO:tasks.workunit.client.0.smithi098.stdout:7/977: getdents d6/d24/d2a/d5a/d4c/da5 0 2024-09-13T02:53:08.423 INFO:tasks.workunit.client.0.smithi098.stdout:7/978: mknod d6/d24/d2a/d5a/d86/db1/dc2/c13e 0 2024-09-13T02:53:08.428 INFO:tasks.workunit.client.0.smithi098.stdout:9/847: truncate d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/f105 8935943 0 2024-09-13T02:53:08.428 INFO:tasks.workunit.client.0.smithi098.stdout:1/901: dwrite d9/d33/d19/f50 [0,4194304] 0 2024-09-13T02:53:08.430 INFO:tasks.workunit.client.0.smithi098.stdout:7/979: creat d6/d24/d2a/d5a/d42/d45/f13f x:0 0 0 2024-09-13T02:53:08.430 INFO:tasks.workunit.client.0.smithi098.stdout:1/902: chown d9/d33/d19/d35/d140/c142 21 1 2024-09-13T02:53:08.431 INFO:tasks.workunit.client.0.smithi098.stdout:9/848: unlink d2/d6/d2b/d4d/d56/c59 0 2024-09-13T02:53:08.433 INFO:tasks.workunit.client.0.smithi098.stdout:7/980: symlink d6/df6/l140 0 2024-09-13T02:53:08.436 INFO:tasks.workunit.client.0.smithi098.stdout:9/849: creat d2/d6/d36/da7/de5/f123 x:0 0 0 2024-09-13T02:53:08.437 INFO:tasks.workunit.client.0.smithi098.stdout:1/903: read d9/d33/d19/d35/d63/f77 [1699843,44308] 0 2024-09-13T02:53:08.440 INFO:tasks.workunit.client.0.smithi098.stdout:1/904: read - d9/fd6 zero size 2024-09-13T02:53:08.443 INFO:tasks.workunit.client.0.smithi098.stdout:1/905: symlink d9/d33/d19/d35/d68/d4d/l144 0 2024-09-13T02:53:08.445 INFO:tasks.workunit.client.0.smithi098.stdout:1/906: creat d9/d33/d29/d11c/d23/d30/f145 x:0 0 0 2024-09-13T02:53:08.446 INFO:tasks.workunit.client.0.smithi098.stdout:1/907: chown d9/d33/d29/c8a 70367188 1 2024-09-13T02:53:08.450 INFO:tasks.workunit.client.0.smithi098.stdout:1/908: unlink d9/d33/d19/d35/d63/dcd/ld5 0 2024-09-13T02:53:08.454 INFO:tasks.workunit.client.0.smithi098.stdout:1/909: truncate d9/d33/d29/d11c/d23/da7/fb4 3421618 0 2024-09-13T02:53:08.456 INFO:tasks.workunit.client.0.smithi098.stdout:7/981: write d6/fdb [137648,105553] 0 2024-09-13T02:53:08.464 INFO:tasks.workunit.client.0.smithi098.stdout:7/982: link d6/d24/d2a/d5a/d86/l87 d6/d24/d2a/df7/l141 0 2024-09-13T02:53:08.466 INFO:tasks.workunit.client.0.smithi098.stdout:7/983: chown d6/d1e/c39 1377064483 1 2024-09-13T02:53:08.473 INFO:tasks.workunit.client.0.smithi098.stdout:1/910: write d9/d33/d29/d11c/d23/da7/d51/f98 [1706182,57463] 0 2024-09-13T02:53:08.479 INFO:tasks.workunit.client.0.smithi098.stdout:7/984: truncate d6/d24/d2a/d5a/d4c/f60 1465708 0 2024-09-13T02:53:08.479 INFO:tasks.workunit.client.0.smithi098.stdout:2/778: sync 2024-09-13T02:53:08.480 INFO:tasks.workunit.client.0.smithi098.stdout:6/739: sync 2024-09-13T02:53:08.481 INFO:tasks.workunit.client.0.smithi098.stdout:2/779: chown d1/d1f/d35/lda 30302549 1 2024-09-13T02:53:08.485 INFO:tasks.workunit.client.0.smithi098.stdout:7/985: dwrite d6/d47/f7e [0,4194304] 0 2024-09-13T02:53:08.489 INFO:tasks.workunit.client.0.smithi098.stdout:1/911: dread f1 [0,4194304] 0 2024-09-13T02:53:08.492 INFO:tasks.workunit.client.0.smithi098.stdout:1/912: truncate d9/d33/d19/d35/d68/d2f/f10b 945452 0 2024-09-13T02:53:08.493 INFO:tasks.workunit.client.0.smithi098.stdout:7/986: rename d6/d24/d2a/d57/l68 to d6/d24/dc5/de3/dcf/ded/l142 0 2024-09-13T02:53:08.494 INFO:tasks.workunit.client.0.smithi098.stdout:6/740: symlink d5/d13/d2b/d3a/d41/d6c/lfb 0 2024-09-13T02:53:08.498 INFO:tasks.workunit.client.0.smithi098.stdout:7/987: dread d6/d24/d2a/dda/f132 [0,4194304] 0 2024-09-13T02:53:08.499 INFO:tasks.workunit.client.0.smithi098.stdout:7/988: chown d6/d24/d2a/d57/d88 42663 1 2024-09-13T02:53:08.504 INFO:tasks.workunit.client.0.smithi098.stdout:7/989: creat d6/d24/d2a/d5a/d4c/f143 x:0 0 0 2024-09-13T02:53:08.505 INFO:tasks.workunit.client.0.smithi098.stdout:7/990: write d6/fca [4199798,58855] 0 2024-09-13T02:53:08.514 INFO:tasks.workunit.client.0.smithi098.stdout:7/991: getdents d6/d24/d2a/d5a/d42/d45 0 2024-09-13T02:53:08.516 INFO:tasks.workunit.client.0.smithi098.stdout:1/913: dread d9/d33/de6/d61/db1/fd0 [0,4194304] 0 2024-09-13T02:53:08.517 INFO:tasks.workunit.client.0.smithi098.stdout:7/992: mknod d6/d24/d2a/d5a/c144 0 2024-09-13T02:53:08.522 INFO:tasks.workunit.client.0.smithi098.stdout:1/914: dwrite d9/d33/d87/fc3 [0,4194304] 0 2024-09-13T02:53:08.526 INFO:tasks.workunit.client.0.smithi098.stdout:1/915: rmdir d9/d33/d19/d35/d68/d4d/db5/dcb 39 2024-09-13T02:53:08.533 INFO:tasks.workunit.client.0.smithi098.stdout:7/993: dread d6/d24/d2a/d5a/d42/f8b [0,4194304] 0 2024-09-13T02:53:08.534 INFO:tasks.workunit.client.0.smithi098.stdout:7/994: write d6/d1e/f36 [9176801,83035] 0 2024-09-13T02:53:08.547 INFO:tasks.workunit.client.0.smithi098.stdout:1/916: write d9/fd6 [349535,14035] 0 2024-09-13T02:53:08.548 INFO:tasks.workunit.client.0.smithi098.stdout:1/917: chown d9/d33/d19/d35/d68/c94 85590995 1 2024-09-13T02:53:08.548 INFO:tasks.workunit.client.0.smithi098.stdout:1/918: chown d9/d33/d19/d134 14 1 2024-09-13T02:53:08.552 INFO:tasks.workunit.client.0.smithi098.stdout:1/919: mkdir d9/d33/d29/d11c/d146 0 2024-09-13T02:53:08.553 INFO:tasks.workunit.client.0.smithi098.stdout:7/995: dwrite d6/d24/d63/fd2 [0,4194304] 0 2024-09-13T02:53:08.554 INFO:tasks.workunit.client.0.smithi098.stdout:1/920: write d9/d33/d19/d35/d68/d2f/f138 [232585,97773] 0 2024-09-13T02:53:08.556 INFO:tasks.workunit.client.0.smithi098.stdout:7/996: write d6/d24/d46/f12e [903717,28119] 0 2024-09-13T02:53:08.557 INFO:tasks.workunit.client.0.smithi098.stdout:7/997: dread - d6/df9/d110/f122 zero size 2024-09-13T02:53:08.558 INFO:tasks.workunit.client.0.smithi098.stdout:1/921: creat d9/db6/d119/f147 x:0 0 0 2024-09-13T02:53:08.569 INFO:tasks.workunit.client.0.smithi098.stdout:1/922: write d9/d33/d29/d11c/d23/da7/f5e [3923083,105895] 0 2024-09-13T02:53:08.573 INFO:tasks.workunit.client.0.smithi098.stdout:7/998: dread d6/f11 [4194304,4194304] 0 2024-09-13T02:53:08.574 INFO:tasks.workunit.client.0.smithi098.stdout:1/923: mknod d9/d33/d19/d35/d10a/d114/d121/c148 0 2024-09-13T02:53:08.575 INFO:tasks.workunit.client.0.smithi098.stdout:1/924: chown d9/f25 3711 1 2024-09-13T02:53:08.576 INFO:tasks.workunit.client.0.smithi098.stdout:1/925: chown d9/d33/d29/d11c/d6b/c7d 0 1 2024-09-13T02:53:08.577 INFO:tasks.workunit.client.0.smithi098.stdout:7/999: mknod d6/d24/d2a/d5a/d42/c145 0 2024-09-13T02:53:08.579 INFO:tasks.workunit.client.0.smithi098.stdout:1/926: rename d9/d33/d29/d11c/c80 to d9/d33/d19/d102/c149 0 2024-09-13T02:53:08.580 INFO:tasks.workunit.client.0.smithi098.stdout:1/927: fsync d9/d33/d19/d35/d68/d4d/db5/db8/fbe 0 2024-09-13T02:53:08.583 INFO:tasks.workunit.client.0.smithi098.stdout:1/928: creat d9/d33/d19/d35/d63/f14a x:0 0 0 2024-09-13T02:53:08.583 INFO:tasks.workunit.client.0.smithi098.stdout:1/929: readlink d9/d33/d29/d58/la0 0 2024-09-13T02:53:08.587 INFO:tasks.workunit.client.0.smithi098.stdout:1/930: symlink d9/d33/d19/d35/d68/d4d/db5/db8/l14b 0 2024-09-13T02:53:08.593 INFO:tasks.workunit.client.0.smithi098.stdout:1/931: dread d9/d33/d19/d35/d68/d4d/db5/dcb/f10c [0,4194304] 0 2024-09-13T02:53:08.600 INFO:tasks.workunit.client.0.smithi098.stdout:1/932: dwrite d9/d33/d19/d35/d68/d4d/db5/dcb/f10c [0,4194304] 0 2024-09-13T02:53:08.602 INFO:tasks.workunit.client.0.smithi098.stdout:1/933: chown d9/d33/d19/d35/d10a/d114/d121/c148 6416842 1 2024-09-13T02:53:08.604 INFO:tasks.workunit.client.0.smithi098.stdout:1/934: mkdir d9/d33/d19/d35/d63/d14c 0 2024-09-13T02:53:08.606 INFO:tasks.workunit.client.0.smithi098.stdout:1/935: rmdir d9/d33/de6/d61/db1 39 2024-09-13T02:53:08.608 INFO:tasks.workunit.client.0.smithi098.stdout:1/936: fdatasync d9/d33/d29/d11c/d23/d30/f145 0 2024-09-13T02:53:08.613 INFO:tasks.workunit.client.0.smithi098.stdout:1/937: mkdir d9/d33/de6/d61/db1/d14d 0 2024-09-13T02:53:08.617 INFO:tasks.workunit.client.0.smithi098.stdout:1/938: mkdir d9/d33/d19/d35/d68/d4d/db5/dff/d14e 0 2024-09-13T02:53:08.715 INFO:tasks.workunit.client.0.smithi098.stdout:8/703: sync 2024-09-13T02:53:08.715 INFO:tasks.workunit.client.0.smithi098.stdout:3/773: sync 2024-09-13T02:53:08.728 INFO:tasks.workunit.client.0.smithi098.stdout:3/774: write d7/d9/d15/d2d/d5b/f94 [213814,62408] 0 2024-09-13T02:53:08.729 INFO:tasks.workunit.client.0.smithi098.stdout:8/704: write d2/dd/d11/f18 [788133,22215] 0 2024-09-13T02:53:08.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:08 smithi098 ceph-mon[27886]: pgmap v33: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 48 MiB/s rd, 119 MiB/s wr, 300 op/s 2024-09-13T02:53:08.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:08 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:08.742 INFO:tasks.workunit.client.0.smithi098.stdout:8/705: creat d2/d28/d43/d88/dd8/fe4 x:0 0 0 2024-09-13T02:53:08.744 INFO:tasks.workunit.client.0.smithi098.stdout:3/775: dread d7/d9/d15/d26/f2a [0,4194304] 0 2024-09-13T02:53:08.748 INFO:tasks.workunit.client.0.smithi098.stdout:3/776: creat d7/d9/d15/d2d/d5b/d70/d90/ff3 x:0 0 0 2024-09-13T02:53:08.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:08 smithi142 ceph-mon[33443]: pgmap v33: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 48 MiB/s rd, 119 MiB/s wr, 300 op/s 2024-09-13T02:53:08.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:08 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:08.752 INFO:tasks.workunit.client.0.smithi098.stdout:3/777: symlink d7/d9/lf4 0 2024-09-13T02:53:08.754 INFO:tasks.workunit.client.0.smithi098.stdout:8/706: write d2/dd/d2e/fc4 [1283969,72982] 0 2024-09-13T02:53:08.764 INFO:tasks.workunit.client.0.smithi098.stdout:8/707: creat d2/fe5 x:0 0 0 2024-09-13T02:53:08.765 INFO:tasks.workunit.client.0.smithi098.stdout:8/708: stat d2/dd/dcb 0 2024-09-13T02:53:08.765 INFO:tasks.workunit.client.0.smithi098.stdout:8/709: readlink d2/d2f/d78/l8b 0 2024-09-13T02:53:08.766 INFO:tasks.workunit.client.0.smithi098.stdout:3/778: mknod d7/d9/d15/d2d/db8/d51/d9c/cf5 0 2024-09-13T02:53:08.770 INFO:tasks.workunit.client.0.smithi098.stdout:8/710: creat d2/d2f/d78/d5d/dcd/fe6 x:0 0 0 2024-09-13T02:53:08.771 INFO:tasks.workunit.client.0.smithi098.stdout:3/779: dread - d7/d9/d15/d2d/d34/fcb zero size 2024-09-13T02:53:08.771 INFO:tasks.workunit.client.0.smithi098.stdout:8/711: chown d2/d2f/d78/d46/d47/c59 340430 1 2024-09-13T02:53:08.779 INFO:tasks.workunit.client.0.smithi098.stdout:3/780: dwrite d7/d9/d15/d80/da0/dd4/fe9 [0,4194304] 0 2024-09-13T02:53:08.781 INFO:tasks.workunit.client.0.smithi098.stdout:8/712: write d2/d2f/d78/d5d/f79 [4156732,114627] 0 2024-09-13T02:53:08.785 INFO:tasks.workunit.client.0.smithi098.stdout:3/781: chown d7/d9/d15/d2d/cb9 88707262 1 2024-09-13T02:53:08.795 INFO:tasks.workunit.client.0.smithi098.stdout:3/782: rename d7/l3f to d7/d9/d25/lf6 0 2024-09-13T02:53:08.795 INFO:tasks.workunit.client.0.smithi098.stdout:8/713: dwrite d2/dd/fa5 [0,4194304] 0 2024-09-13T02:53:08.797 INFO:tasks.workunit.client.0.smithi098.stdout:3/783: dread - d7/d9/d15/d2d/d78/fa7 zero size 2024-09-13T02:53:08.798 INFO:tasks.workunit.client.0.smithi098.stdout:3/784: chown d7/d9/d15/d2d/d5b/d70 1363 1 2024-09-13T02:53:08.801 INFO:tasks.workunit.client.0.smithi098.stdout:8/714: mkdir d2/d2f/d78/d46/d74/d86/da8/de7 0 2024-09-13T02:53:08.802 INFO:tasks.workunit.client.0.smithi098.stdout:8/715: write d2/d28/d43/d88/dd8/fe4 [34170,18521] 0 2024-09-13T02:53:08.803 INFO:tasks.workunit.client.0.smithi098.stdout:8/716: read - d2/d28/d43/fc9 zero size 2024-09-13T02:53:08.809 INFO:tasks.workunit.client.0.smithi098.stdout:8/717: mknod d2/d2f/d78/d46/d74/d86/da8/de7/ce8 0 2024-09-13T02:53:08.812 INFO:tasks.workunit.client.0.smithi098.stdout:3/785: getdents d7/d9/d15/d2d/db8/d51 0 2024-09-13T02:53:08.815 INFO:tasks.workunit.client.0.smithi098.stdout:8/718: symlink d2/le9 0 2024-09-13T02:53:08.816 INFO:tasks.workunit.client.0.smithi098.stdout:3/786: mknod d7/d9/d15/d80/da0/cf7 0 2024-09-13T02:53:08.817 INFO:tasks.workunit.client.0.smithi098.stdout:3/787: write d7/d9/d15/d2d/db8/fe1 [16057,44262] 0 2024-09-13T02:53:08.818 INFO:tasks.workunit.client.0.smithi098.stdout:8/719: unlink d2/dd/d4d/f67 0 2024-09-13T02:53:08.820 INFO:tasks.workunit.client.0.smithi098.stdout:8/720: chown d2/dd/d4d/d96/f58 475452 1 2024-09-13T02:53:08.825 INFO:tasks.workunit.client.0.smithi098.stdout:3/788: getdents d7/d9/d25/d64/dd5 0 2024-09-13T02:53:08.826 INFO:tasks.workunit.client.0.smithi098.stdout:8/721: dwrite d2/d2f/d78/d46/d47/fb4 [0,4194304] 0 2024-09-13T02:53:08.827 INFO:tasks.workunit.client.0.smithi098.stdout:3/789: dread - d7/d9/d15/d2d/d5b/d70/d90/ff3 zero size 2024-09-13T02:53:08.831 INFO:tasks.workunit.client.0.smithi098.stdout:8/722: unlink d2/dd/d4d/f57 0 2024-09-13T02:53:08.832 INFO:tasks.workunit.client.0.smithi098.stdout:8/723: read d2/dd/f35 [237835,65777] 0 2024-09-13T02:53:08.833 INFO:tasks.workunit.client.0.smithi098.stdout:8/724: chown d2/d2f/d78/d5d/de3 0 1 2024-09-13T02:53:08.834 INFO:tasks.workunit.client.0.smithi098.stdout:3/790: rmdir d7/d9/d4c 39 2024-09-13T02:53:08.842 INFO:tasks.workunit.client.0.smithi098.stdout:3/791: creat d7/d9/d15/d80/ff8 x:0 0 0 2024-09-13T02:53:08.847 INFO:tasks.workunit.client.0.smithi098.stdout:8/725: dwrite d2/d2f/d78/f4f [4194304,4194304] 0 2024-09-13T02:53:08.849 INFO:tasks.workunit.client.0.smithi098.stdout:3/792: rmdir d7/d9/d15 39 2024-09-13T02:53:08.851 INFO:tasks.workunit.client.0.smithi098.stdout:8/726: truncate d2/dd/d11/d44/f63 2288024 0 2024-09-13T02:53:08.855 INFO:tasks.workunit.client.0.smithi098.stdout:8/727: write d2/d28/d43/f7f [2970252,113929] 0 2024-09-13T02:53:08.858 INFO:tasks.workunit.client.0.smithi098.stdout:8/728: creat d2/dd/d11/d2c/d9b/fea x:0 0 0 2024-09-13T02:53:08.860 INFO:tasks.workunit.client.0.smithi098.stdout:8/729: write d2/dd/d11/d1d/f3e [1925184,109642] 0 2024-09-13T02:53:08.861 INFO:tasks.workunit.client.0.smithi098.stdout:3/793: write d7/d9/d15/f85 [225117,110794] 0 2024-09-13T02:53:08.866 INFO:tasks.workunit.client.0.smithi098.stdout:8/730: rename d2/d2f/d78/d46/d74/d86/fbb to d2/d2f/d78/d46/d74/feb 0 2024-09-13T02:53:08.868 INFO:tasks.workunit.client.0.smithi098.stdout:3/794: unlink d7/d9/d15/d2d/c95 0 2024-09-13T02:53:08.875 INFO:tasks.workunit.client.0.smithi098.stdout:3/795: getdents d7/d9/d15/d2d/db8/d51/ddb 0 2024-09-13T02:53:08.876 INFO:tasks.workunit.client.0.smithi098.stdout:3/796: readlink d7/d9/d15/d2d/db8/d52/l59 0 2024-09-13T02:53:08.878 INFO:tasks.workunit.client.0.smithi098.stdout:8/731: chown d2/dd/d11/d44/f63 0 1 2024-09-13T02:53:08.880 INFO:tasks.workunit.client.0.smithi098.stdout:3/797: unlink d7/d9/d15/d2d/db8/f6c 0 2024-09-13T02:53:08.883 INFO:tasks.workunit.client.0.smithi098.stdout:3/798: mkdir d7/d9/d15/d2d/d78/d7e/d8e/df9 0 2024-09-13T02:53:08.885 INFO:tasks.workunit.client.0.smithi098.stdout:3/799: unlink d7/c76 0 2024-09-13T02:53:08.889 INFO:tasks.workunit.client.0.smithi098.stdout:3/800: creat d7/d9/d15/d2d/db8/ffa x:0 0 0 2024-09-13T02:53:08.899 INFO:tasks.workunit.client.0.smithi098.stdout:3/801: getdents d7/d9/d15/d2d/d78/d7e/d8e 0 2024-09-13T02:53:08.912 INFO:tasks.workunit.client.0.smithi098.stdout:3/802: write d7/d9/d15/d2d/d5b/f46 [1623797,73584] 0 2024-09-13T02:53:08.922 INFO:tasks.workunit.client.0.smithi098.stdout:3/803: rename d7/d9/d15/d2d/d78/lbe to d7/d9/d25/lfb 0 2024-09-13T02:53:08.927 INFO:tasks.workunit.client.0.smithi098.stdout:3/804: creat d7/d9/d15/d26/ffc x:0 0 0 2024-09-13T02:53:08.929 INFO:tasks.workunit.client.0.smithi098.stdout:3/805: write d7/d9/d15/d5d/dc3/feb [818173,99002] 0 2024-09-13T02:53:08.931 INFO:tasks.workunit.client.0.smithi098.stdout:3/806: mknod d7/d9/d25/d64/d6f/cfd 0 2024-09-13T02:53:08.935 INFO:tasks.workunit.client.0.smithi098.stdout:3/807: truncate d7/d9/d25/d2b/f40 392939 0 2024-09-13T02:53:08.942 INFO:tasks.workunit.client.0.smithi098.stdout:3/808: dwrite d7/d9/d15/d80/ff8 [0,4194304] 0 2024-09-13T02:53:08.968 INFO:tasks.workunit.client.0.smithi098.stdout:3/809: dread d7/d9/d15/d5d/f65 [4194304,4194304] 0 2024-09-13T02:53:08.971 INFO:tasks.workunit.client.0.smithi098.stdout:3/810: fdatasync d7/d9/d15/d5d/da1/fae 0 2024-09-13T02:53:08.972 INFO:tasks.workunit.client.0.smithi098.stdout:3/811: chown d7/d9/d15/d2d/d34/f97 3 1 2024-09-13T02:53:09.371 INFO:tasks.workunit.client.0.smithi098.stdout:4/758: sync 2024-09-13T02:53:09.371 INFO:tasks.workunit.client.0.smithi098.stdout:5/741: sync 2024-09-13T02:53:09.371 INFO:tasks.workunit.client.0.smithi098.stdout:0/823: sync 2024-09-13T02:53:09.372 INFO:tasks.workunit.client.0.smithi098.stdout:4/759: symlink d6/d10/lfb 0 2024-09-13T02:53:09.374 INFO:tasks.workunit.client.0.smithi098.stdout:5/742: mknod d0/d15/d50/dd3/cfc 0 2024-09-13T02:53:09.375 INFO:tasks.workunit.client.0.smithi098.stdout:0/824: fsync dd/df/d1d/d26/d28/f72 0 2024-09-13T02:53:09.376 INFO:tasks.workunit.client.0.smithi098.stdout:0/825: readlink dd/df/d1d/d26/d28/l6d 0 2024-09-13T02:53:09.376 INFO:tasks.workunit.client.0.smithi098.stdout:4/760: mkdir d6/d3e/d73/dfc 0 2024-09-13T02:53:09.380 INFO:tasks.workunit.client.0.smithi098.stdout:5/743: mkdir d0/d38/d3f/d81/d9e/dd4/dfd 0 2024-09-13T02:53:09.384 INFO:tasks.workunit.client.0.smithi098.stdout:5/744: unlink d0/d38/d3f/d81/d4d/l5a 0 2024-09-13T02:53:09.388 INFO:tasks.workunit.client.0.smithi098.stdout:4/761: rename d6/d37/ce9 to d6/d10/d21/cfd 0 2024-09-13T02:53:09.389 INFO:tasks.workunit.client.0.smithi098.stdout:0/826: link dd/df/d1d/da7/fb5 dd/db9/f121 0 2024-09-13T02:53:09.392 INFO:tasks.workunit.client.0.smithi098.stdout:5/745: dread d0/d38/d3f/f5b [0,4194304] 0 2024-09-13T02:53:09.393 INFO:tasks.workunit.client.0.smithi098.stdout:0/827: symlink dd/d1f/d85/d9d/dc2/de4/l122 0 2024-09-13T02:53:09.393 INFO:tasks.workunit.client.0.smithi098.stdout:5/746: readlink d0/d7c/l8a 0 2024-09-13T02:53:09.394 INFO:tasks.workunit.client.0.smithi098.stdout:4/762: dwrite d6/db/f29 [0,4194304] 0 2024-09-13T02:53:09.395 INFO:tasks.workunit.client.0.smithi098.stdout:0/828: write dd/df/d1d/f63 [5235685,3205] 0 2024-09-13T02:53:09.396 INFO:tasks.workunit.client.0.smithi098.stdout:0/829: chown dd/db9/dd7/ce2 325 1 2024-09-13T02:53:09.401 INFO:tasks.workunit.client.0.smithi098.stdout:4/763: dread d6/d22/d3d/d64/d6f/ff4 [0,4194304] 0 2024-09-13T02:53:09.408 INFO:tasks.workunit.client.0.smithi098.stdout:0/830: mknod dd/d1f/d85/d9d/dc2/de4/dc7/de8/c123 0 2024-09-13T02:53:09.410 INFO:tasks.workunit.client.0.smithi098.stdout:0/831: chown dd/df/d1d/d26/d28/d32/dda/d117/ff1 43489 1 2024-09-13T02:53:09.412 INFO:tasks.workunit.client.0.smithi098.stdout:0/832: symlink dd/d1f/d85/d9d/dc9/l124 0 2024-09-13T02:53:09.414 INFO:tasks.workunit.client.0.smithi098.stdout:0/833: creat dd/df/d1d/d40/d46/f125 x:0 0 0 2024-09-13T02:53:09.415 INFO:tasks.workunit.client.0.smithi098.stdout:4/764: dread d6/d10/f9d [0,4194304] 0 2024-09-13T02:53:09.416 INFO:tasks.workunit.client.0.smithi098.stdout:4/765: stat d6/db/lab 0 2024-09-13T02:53:09.419 INFO:tasks.workunit.client.0.smithi098.stdout:5/747: dwrite d0/d15/d17/d1c/f9d [0,4194304] 0 2024-09-13T02:53:09.422 INFO:tasks.workunit.client.0.smithi098.stdout:4/766: mknod d6/d54/cfe 0 2024-09-13T02:53:09.428 INFO:tasks.workunit.client.0.smithi098.stdout:5/748: link d0/d15/d69/ff3 d0/d15/d50/dd3/de1/ffe 0 2024-09-13T02:53:09.429 INFO:tasks.workunit.client.0.smithi098.stdout:4/767: symlink d6/d22/d3d/d41/d74/ddb/lff 0 2024-09-13T02:53:09.433 INFO:tasks.workunit.client.0.smithi098.stdout:5/749: unlink d0/d38/d3f/fc 0 2024-09-13T02:53:09.433 INFO:tasks.workunit.client.0.smithi098.stdout:0/834: dwrite dd/f10 [0,4194304] 0 2024-09-13T02:53:09.434 INFO:tasks.workunit.client.0.smithi098.stdout:4/768: dread d6/d22/d3d/d41/d58/da9/fc2 [0,4194304] 0 2024-09-13T02:53:09.441 INFO:tasks.workunit.client.0.smithi098.stdout:0/835: dread dd/df/d1d/d26/d28/d32/d67/d71/f5e [0,4194304] 0 2024-09-13T02:53:09.446 INFO:tasks.workunit.client.0.smithi098.stdout:5/750: creat d0/d57/fff x:0 0 0 2024-09-13T02:53:09.450 INFO:tasks.workunit.client.0.smithi098.stdout:4/769: dwrite d6/d22/d3d/d41/d74/fc4 [0,4194304] 0 2024-09-13T02:53:09.451 INFO:tasks.workunit.client.0.smithi098.stdout:5/751: readlink d0/d38/d3f/d1a/l66 0 2024-09-13T02:53:09.454 INFO:tasks.workunit.client.0.smithi098.stdout:0/836: write dd/d1f/d85/d9d/dc2/de4/dc7/de8/fe9 [156418,53178] 0 2024-09-13T02:53:09.455 INFO:tasks.workunit.client.0.smithi098.stdout:5/752: stat d0/d38/d3f/d81/d4d/ceb 0 2024-09-13T02:53:09.458 INFO:tasks.workunit.client.0.smithi098.stdout:4/770: creat d6/d3e/f100 x:0 0 0 2024-09-13T02:53:09.461 INFO:tasks.workunit.client.0.smithi098.stdout:0/837: creat dd/df/d1d/d40/d46/d6b/f126 x:0 0 0 2024-09-13T02:53:09.464 INFO:tasks.workunit.client.0.smithi098.stdout:5/753: truncate d0/d38/d3f/d1a/f97 1106543 0 2024-09-13T02:53:09.465 INFO:tasks.workunit.client.0.smithi098.stdout:0/838: rename dd/d1f/cba to dd/d1f/c127 0 2024-09-13T02:53:09.467 INFO:tasks.workunit.client.0.smithi098.stdout:6/741: sync 2024-09-13T02:53:09.467 INFO:tasks.workunit.client.0.smithi098.stdout:9/850: sync 2024-09-13T02:53:09.467 INFO:tasks.workunit.client.0.smithi098.stdout:1/939: sync 2024-09-13T02:53:09.467 INFO:tasks.workunit.client.0.smithi098.stdout:8/732: sync 2024-09-13T02:53:09.467 INFO:tasks.workunit.client.0.smithi098.stdout:2/780: sync 2024-09-13T02:53:09.467 INFO:tasks.workunit.client.0.smithi098.stdout:3/812: sync 2024-09-13T02:53:09.468 INFO:tasks.workunit.client.0.smithi098.stdout:5/754: creat d0/d38/d3f/d81/d4d/f100 x:0 0 0 2024-09-13T02:53:09.470 INFO:tasks.workunit.client.0.smithi098.stdout:4/771: dwrite d6/db/fb8 [0,4194304] 0 2024-09-13T02:53:09.470 INFO:tasks.workunit.client.0.smithi098.stdout:1/940: write d9/fd6 [942477,101290] 0 2024-09-13T02:53:09.470 INFO:tasks.workunit.client.0.smithi098.stdout:8/733: chown d2/d2f/d78/d5d 748848 1 2024-09-13T02:53:09.473 INFO:tasks.workunit.client.0.smithi098.stdout:9/851: write d2/d6/d36/da7/de5/f123 [777029,55771] 0 2024-09-13T02:53:09.473 INFO:tasks.workunit.client.0.smithi098.stdout:2/781: write d1/d1f/d30/def/ff5 [710421,111047] 0 2024-09-13T02:53:09.477 INFO:tasks.workunit.client.0.smithi098.stdout:8/734: fdatasync d2/dd/d11/d1d/f3a 0 2024-09-13T02:53:09.479 INFO:tasks.workunit.client.0.smithi098.stdout:6/742: write d5/d13/d2b/d3a/d14/d6b/d8f/fbc [1189814,96047] 0 2024-09-13T02:53:09.479 INFO:tasks.workunit.client.0.smithi098.stdout:0/839: write dd/df/d1d/d26/d28/d32/da1/fa9 [604216,36199] 0 2024-09-13T02:53:09.483 INFO:tasks.workunit.client.0.smithi098.stdout:0/840: fdatasync dd/df/d1d/d40/d46/d6b/f8f 0 2024-09-13T02:53:09.485 INFO:tasks.workunit.client.0.smithi098.stdout:5/755: dwrite d0/d38/d3f/d81/d4d/d82/f93 [0,4194304] 0 2024-09-13T02:53:09.486 INFO:tasks.workunit.client.0.smithi098.stdout:0/841: stat dd/df/d1d/d26/d28/d32/dda/d117/dea 0 2024-09-13T02:53:09.489 INFO:tasks.workunit.client.0.smithi098.stdout:0/842: write dd/df/d1d/d26/d28/d32/dda/d117/dea/f11e [445339,88248] 0 2024-09-13T02:53:09.490 INFO:tasks.workunit.client.0.smithi098.stdout:8/735: mkdir d2/d28/d43/d88/d99/dec 0 2024-09-13T02:53:09.491 INFO:tasks.workunit.client.0.smithi098.stdout:6/743: creat d5/d13/d2b/d5b/ffc x:0 0 0 2024-09-13T02:53:09.493 INFO:tasks.workunit.client.0.smithi098.stdout:0/843: dread dd/df/d1d/d40/d46/fad [0,4194304] 0 2024-09-13T02:53:09.493 INFO:tasks.workunit.client.0.smithi098.stdout:2/782: read d1/d1f/d35/f74 [3105883,99872] 0 2024-09-13T02:53:09.493 INFO:tasks.workunit.client.0.smithi098.stdout:6/744: chown d5/d13/d2b/d3a/d41/d55/l74 27602623 1 2024-09-13T02:53:09.496 INFO:tasks.workunit.client.0.smithi098.stdout:9/852: rename d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/df1/lf4 to d2/d6/d2b/d4d/d4f/d6c/dd4/de4/l124 0 2024-09-13T02:53:09.498 INFO:tasks.workunit.client.0.smithi098.stdout:4/772: rmdir d6/db/df9 0 2024-09-13T02:53:09.498 INFO:tasks.workunit.client.0.smithi098.stdout:1/941: write d9/d33/d29/d11c/d23/da7/d51/d8f/fcc [594151,125216] 0 2024-09-13T02:53:09.500 INFO:tasks.workunit.client.0.smithi098.stdout:5/756: chown d0/d15/d17/d1c/d3d/c5d 11183677 1 2024-09-13T02:53:09.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/736: creat d2/dd/d4d/fed x:0 0 0 2024-09-13T02:53:09.503 INFO:tasks.workunit.client.0.smithi098.stdout:0/844: creat dd/d1f/d85/df5/f128 x:0 0 0 2024-09-13T02:53:09.506 INFO:tasks.workunit.client.0.smithi098.stdout:9/853: rmdir d2/d6/d2b/d66/de0/d102 39 2024-09-13T02:53:09.509 INFO:tasks.workunit.client.0.smithi098.stdout:4/773: creat d6/d3e/d46/f101 x:0 0 0 2024-09-13T02:53:09.510 INFO:tasks.workunit.client.0.smithi098.stdout:1/942: unlink d9/d33/de6/d61/ddb/ffa 0 2024-09-13T02:53:09.513 INFO:tasks.workunit.client.0.smithi098.stdout:5/757: fdatasync d0/d15/d17/f2e 0 2024-09-13T02:53:09.515 INFO:tasks.workunit.client.0.smithi098.stdout:1/943: dread d9/d33/d29/d11c/d6b/fb2 [0,4194304] 0 2024-09-13T02:53:09.516 INFO:tasks.workunit.client.0.smithi098.stdout:1/944: write d9/d33/d19/d35/d68/f101 [4031359,14825] 0 2024-09-13T02:53:09.516 INFO:tasks.workunit.client.0.smithi098.stdout:8/737: symlink d2/dd/d11/d2c/d9b/lee 0 2024-09-13T02:53:09.518 INFO:tasks.workunit.client.0.smithi098.stdout:1/945: rename d9/d33/d19/d35/d10a/d114 to d9/d33/d19/d35/d10a/d114/d14f 22 2024-09-13T02:53:09.518 INFO:tasks.workunit.client.0.smithi098.stdout:0/845: symlink dd/df/d1d/da7/l129 0 2024-09-13T02:53:09.523 INFO:tasks.workunit.client.0.smithi098.stdout:8/738: dwrite d2/d28/f80 [0,4194304] 0 2024-09-13T02:53:09.528 INFO:tasks.workunit.client.0.smithi098.stdout:2/783: creat d1/d1f/d35/d63/d72/ffd x:0 0 0 2024-09-13T02:53:09.529 INFO:tasks.workunit.client.0.smithi098.stdout:6/745: dwrite d5/d13/d2b/d3a/d41/d7e/f7d [4194304,4194304] 0 2024-09-13T02:53:09.531 INFO:tasks.workunit.client.0.smithi098.stdout:6/746: truncate d5/d18/f25 4796978 0 2024-09-13T02:53:09.532 INFO:tasks.workunit.client.0.smithi098.stdout:1/946: unlink d9/d33/d29/d11c/d23/da7/ce9 0 2024-09-13T02:53:09.534 INFO:tasks.workunit.client.0.smithi098.stdout:1/947: truncate d9/d33/d19/d35/fac 4426063 0 2024-09-13T02:53:09.538 INFO:tasks.workunit.client.0.smithi098.stdout:5/758: getdents d0/d15/d69/dfa 0 2024-09-13T02:53:09.540 INFO:tasks.workunit.client.0.smithi098.stdout:9/854: dwrite d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/fcd [4194304,4194304] 0 2024-09-13T02:53:09.541 INFO:tasks.workunit.client.0.smithi098.stdout:9/855: stat d2/d6/d2b/d4d/d56/c6f 0 2024-09-13T02:53:09.543 INFO:tasks.workunit.client.0.smithi098.stdout:2/784: rename d1/l46 to d1/d1f/d30/def/df0/lfe 0 2024-09-13T02:53:09.544 INFO:tasks.workunit.client.0.smithi098.stdout:9/856: write d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/f11f [979365,20846] 0 2024-09-13T02:53:09.547 INFO:tasks.workunit.client.0.smithi098.stdout:1/948: creat d9/d33/d19/d35/d68/d4d/f150 x:0 0 0 2024-09-13T02:53:09.549 INFO:tasks.workunit.client.0.smithi098.stdout:5/759: unlink d0/d15/d17/daa/fcd 0 2024-09-13T02:53:09.554 INFO:tasks.workunit.client.0.smithi098.stdout:2/785: mkdir d1/d1f/d39/df6/d59/d9e/d9f/dc1/dff 0 2024-09-13T02:53:09.557 INFO:tasks.workunit.client.0.smithi098.stdout:9/857: fsync d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/fa6 0 2024-09-13T02:53:09.562 INFO:tasks.workunit.client.0.smithi098.stdout:5/760: rename d0/cb to d0/d38/d3f/d81/d4d/c101 0 2024-09-13T02:53:09.563 INFO:tasks.workunit.client.0.smithi098.stdout:8/739: write d2/d2f/d78/d46/da2/fb6 [957440,40250] 0 2024-09-13T02:53:09.564 INFO:tasks.workunit.client.0.smithi098.stdout:9/858: dread d2/d6/d2b/d4d/d4f/d6c/dd4/f5a [0,4194304] 0 2024-09-13T02:53:09.565 INFO:tasks.workunit.client.0.smithi098.stdout:6/747: creat d5/ffd x:0 0 0 2024-09-13T02:53:09.566 INFO:tasks.workunit.client.0.smithi098.stdout:0/846: dread dd/df/d1d/d26/d28/d32/fb0 [0,4194304] 0 2024-09-13T02:53:09.569 INFO:tasks.workunit.client.0.smithi098.stdout:2/786: truncate d1/d1a/d9/d1e/d5a/fac 952038 0 2024-09-13T02:53:09.572 INFO:tasks.workunit.client.0.smithi098.stdout:9/859: dwrite d2/d6/d2b/d4d/d56/db9/ddf/fe1 [0,4194304] 0 2024-09-13T02:53:09.573 INFO:tasks.workunit.client.0.smithi098.stdout:9/860: stat d2/d6/d36/da7 0 2024-09-13T02:53:09.575 INFO:tasks.workunit.client.0.smithi098.stdout:5/761: readlink d0/d38/d3f/d1a/d27/ldd 0 2024-09-13T02:53:09.576 INFO:tasks.workunit.client.0.smithi098.stdout:5/762: chown d0/d15/l48 7484823 1 2024-09-13T02:53:09.578 INFO:tasks.workunit.client.0.smithi098.stdout:1/949: write d9/d33/d19/d46/f4a [3932541,33341] 0 2024-09-13T02:53:09.579 INFO:tasks.workunit.client.0.smithi098.stdout:8/740: truncate d2/d28/d43/fca 257755 0 2024-09-13T02:53:09.579 INFO:tasks.workunit.client.0.smithi098.stdout:6/748: readlink d5/d13/d2b/d3a/l3d 0 2024-09-13T02:53:09.582 INFO:tasks.workunit.client.0.smithi098.stdout:0/847: chown dd/df/d1d/d26/d28/d32/d67/cbb 13 1 2024-09-13T02:53:09.585 INFO:tasks.workunit.client.0.smithi098.stdout:9/861: symlink d2/d6/d2b/d4d/d4f/d6c/dce/l125 0 2024-09-13T02:53:09.586 INFO:tasks.workunit.client.0.smithi098.stdout:5/763: rmdir d0/d15/d17/daa 39 2024-09-13T02:53:09.590 INFO:tasks.workunit.client.0.smithi098.stdout:0/848: mkdir dd/d1f/d85/d9d/dc9/d12a 0 2024-09-13T02:53:09.591 INFO:tasks.workunit.client.0.smithi098.stdout:2/787: dread d1/d1a/d9/d1e/d5a/fac [0,4194304] 0 2024-09-13T02:53:09.594 INFO:tasks.workunit.client.0.smithi098.stdout:1/950: mknod d9/d33/d29/d11c/d146/c151 0 2024-09-13T02:53:09.597 INFO:tasks.workunit.client.0.smithi098.stdout:0/849: creat dd/df/d1d/d26/d28/d32/d8d/f12b x:0 0 0 2024-09-13T02:53:09.600 INFO:tasks.workunit.client.0.smithi098.stdout:0/850: write dd/df/d1d/d40/d46/d6b/f126 [192159,98054] 0 2024-09-13T02:53:09.602 INFO:tasks.workunit.client.0.smithi098.stdout:1/951: symlink d9/d33/d29/d11c/d23/l152 0 2024-09-13T02:53:09.605 INFO:tasks.workunit.client.0.smithi098.stdout:0/851: mknod dd/df/d1d/d40/d46/d6b/d109/c12c 0 2024-09-13T02:53:09.607 INFO:tasks.workunit.client.0.smithi098.stdout:8/741: dwrite d2/d2f/f31 [0,4194304] 0 2024-09-13T02:53:09.607 INFO:tasks.workunit.client.0.smithi098.stdout:9/862: getdents d2/d6/d2b/d4d/d56/db9 0 2024-09-13T02:53:09.609 INFO:tasks.workunit.client.0.smithi098.stdout:1/952: rmdir d9/d33/d29/d11c/d23 39 2024-09-13T02:53:09.610 INFO:tasks.workunit.client.0.smithi098.stdout:5/764: dwrite d0/d15/d17/d1c/f99 [0,4194304] 0 2024-09-13T02:53:09.612 INFO:tasks.workunit.client.0.smithi098.stdout:1/953: dread - d9/d33/d29/d11c/fba zero size 2024-09-13T02:53:09.614 INFO:tasks.workunit.client.0.smithi098.stdout:2/788: dread d1/d1a/fc0 [0,4194304] 0 2024-09-13T02:53:09.616 INFO:tasks.workunit.client.0.smithi098.stdout:9/863: unlink d2/d6/d2b/d66/fb2 0 2024-09-13T02:53:09.619 INFO:tasks.workunit.client.0.smithi098.stdout:8/742: creat d2/d2f/d78/d46/d74/d86/da8/fef x:0 0 0 2024-09-13T02:53:09.626 INFO:tasks.workunit.client.0.smithi098.stdout:5/765: dwrite d0/d15/f8d [0,4194304] 0 2024-09-13T02:53:09.628 INFO:tasks.workunit.client.0.smithi098.stdout:2/789: mkdir d1/d1f/d39/d100 0 2024-09-13T02:53:09.631 INFO:tasks.workunit.client.0.smithi098.stdout:9/864: symlink d2/d6/d36/d8d/l126 0 2024-09-13T02:53:09.633 INFO:tasks.workunit.client.0.smithi098.stdout:5/766: rmdir d0/d15/d50/dd3 39 2024-09-13T02:53:09.635 INFO:tasks.workunit.client.0.smithi098.stdout:2/790: unlink d1/d1f/d35/d63/d23/l84 0 2024-09-13T02:53:09.635 INFO:tasks.workunit.client.0.smithi098.stdout:9/865: dread d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/f11f [0,4194304] 0 2024-09-13T02:53:09.637 INFO:tasks.workunit.client.0.smithi098.stdout:0/852: write dd/df/d1d/d26/d28/d32/d67/f102 [115323,88187] 0 2024-09-13T02:53:09.638 INFO:tasks.workunit.client.0.smithi098.stdout:1/954: write d9/f55 [52405,22539] 0 2024-09-13T02:53:09.639 INFO:tasks.workunit.client.0.smithi098.stdout:5/767: fdatasync d0/d15/d17/daa/dab/fc6 0 2024-09-13T02:53:09.642 INFO:tasks.workunit.client.0.smithi098.stdout:9/866: unlink d2/d6/d2b/d4d/d56/fbd 0 2024-09-13T02:53:09.644 INFO:tasks.workunit.client.0.smithi098.stdout:5/768: dread d0/d15/d17/d1c/f99 [0,4194304] 0 2024-09-13T02:53:09.645 INFO:tasks.workunit.client.0.smithi098.stdout:8/743: write d2/f1a [3887147,76871] 0 2024-09-13T02:53:09.646 INFO:tasks.workunit.client.0.smithi098.stdout:8/744: chown d2/d2f/d78/d46/d5c/fd4 0 1 2024-09-13T02:53:09.653 INFO:tasks.workunit.client.0.smithi098.stdout:2/791: dwrite d1/d1f/d30/def/fcb [0,4194304] 0 2024-09-13T02:53:09.655 INFO:tasks.workunit.client.0.smithi098.stdout:9/867: write d2/d6/d2b/d4d/d56/f99 [711372,5107] 0 2024-09-13T02:53:09.656 INFO:tasks.workunit.client.0.smithi098.stdout:9/868: write d2/d6/fa8 [1337912,40565] 0 2024-09-13T02:53:09.659 INFO:tasks.workunit.client.0.smithi098.stdout:0/853: creat dd/d1f/d85/d9d/dc9/d12a/f12d x:0 0 0 2024-09-13T02:53:09.661 INFO:tasks.workunit.client.0.smithi098.stdout:0/854: write dd/fd9 [2433988,126911] 0 2024-09-13T02:53:09.665 INFO:tasks.workunit.client.0.smithi098.stdout:5/769: dwrite d0/d15/f9b [0,4194304] 0 2024-09-13T02:53:09.668 INFO:tasks.workunit.client.0.smithi098.stdout:8/745: dread d2/dd/d11/fc3 [0,4194304] 0 2024-09-13T02:53:09.681 INFO:tasks.workunit.client.0.smithi098.stdout:9/869: write d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/fb3 [294833,68672] 0 2024-09-13T02:53:09.686 INFO:tasks.workunit.client.0.smithi098.stdout:0/855: write dd/df/d1d/d26/d28/d32/f74 [1452302,47094] 0 2024-09-13T02:53:09.687 INFO:tasks.workunit.client.0.smithi098.stdout:8/746: mknod d2/dd/d11/d1d/dcc/cf0 0 2024-09-13T02:53:09.688 INFO:tasks.workunit.client.0.smithi098.stdout:1/955: link d9/l1b d9/d33/d29/d11c/d23/l153 0 2024-09-13T02:53:09.689 INFO:tasks.workunit.client.0.smithi098.stdout:8/747: chown d2/dd/d2e/fc4 38096 1 2024-09-13T02:53:09.691 INFO:tasks.workunit.client.0.smithi098.stdout:0/856: fsync dd/df/d1d/d26/d28/d32/d67/d71/fd3 0 2024-09-13T02:53:09.692 INFO:tasks.workunit.client.0.smithi098.stdout:0/857: chown dd/d1f/d85/d9d/c118 7 1 2024-09-13T02:53:09.693 INFO:tasks.workunit.client.0.smithi098.stdout:0/858: read - dd/df/d1d/d26/d28/fff zero size 2024-09-13T02:53:09.693 INFO:tasks.workunit.client.0.smithi098.stdout:5/770: rename d0/d15/da4 to d0/d38/d102 0 2024-09-13T02:53:09.697 INFO:tasks.workunit.client.0.smithi098.stdout:8/748: symlink d2/d2f/d78/lf1 0 2024-09-13T02:53:09.697 INFO:tasks.workunit.client.0.smithi098.stdout:2/792: link d1/d1f/d35/d63/caa d1/d1f/d39/df6/d59/d9e/d9f/dc1/c101 0 2024-09-13T02:53:09.699 INFO:tasks.workunit.client.0.smithi098.stdout:5/771: dwrite d0/d38/f55 [0,4194304] 0 2024-09-13T02:53:09.702 INFO:tasks.workunit.client.0.smithi098.stdout:9/870: rename d2/d6/d2b/d4d/d4f/d6c/dd4/dac to d2/d6/d91/d127 0 2024-09-13T02:53:09.706 INFO:tasks.workunit.client.0.smithi098.stdout:0/859: mkdir dd/df/d1d/d26/d28/d32/dda/d117/dea/d12e 0 2024-09-13T02:53:09.710 INFO:tasks.workunit.client.0.smithi098.stdout:9/871: mknod d2/d6/d91/d127/dd9/c128 0 2024-09-13T02:53:09.716 INFO:tasks.workunit.client.0.smithi098.stdout:2/793: creat d1/d1f/d39/f102 x:0 0 0 2024-09-13T02:53:09.717 INFO:tasks.workunit.client.0.smithi098.stdout:5/772: creat d0/d38/d102/dde/f103 x:0 0 0 2024-09-13T02:53:09.718 INFO:tasks.workunit.client.0.smithi098.stdout:5/773: readlink d0/d15/d17/d1c/lf2 0 2024-09-13T02:53:09.720 INFO:tasks.workunit.client.0.smithi098.stdout:2/794: fsync d1/d1f/d27/f61 0 2024-09-13T02:53:09.723 INFO:tasks.workunit.client.0.smithi098.stdout:5/774: unlink d0/d29/f2c 0 2024-09-13T02:53:09.724 INFO:tasks.workunit.client.0.smithi098.stdout:5/775: write d0/d38/d102/db1/fbc [956074,78581] 0 2024-09-13T02:53:09.726 INFO:tasks.workunit.client.0.smithi098.stdout:2/795: stat d1/d1f/d35/c98 0 2024-09-13T02:53:09.728 INFO:tasks.workunit.client.0.smithi098.stdout:9/872: getdents d2/d6/d91/d127 0 2024-09-13T02:53:09.729 INFO:tasks.workunit.client.0.smithi098.stdout:8/749: write d2/d2f/f38 [947051,50964] 0 2024-09-13T02:53:09.729 INFO:tasks.workunit.client.0.smithi098.stdout:9/873: write d2/d6/f29 [2503072,20498] 0 2024-09-13T02:53:09.731 INFO:tasks.workunit.client.0.smithi098.stdout:2/796: symlink d1/d1f/d39/df6/d59/d9e/d9f/l103 0 2024-09-13T02:53:09.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:09 smithi098 ceph-mon[27886]: Standby manager daemon smithi098.ukgenf restarted 2024-09-13T02:53:09.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:09 smithi098 ceph-mon[27886]: Standby manager daemon smithi098.ukgenf started 2024-09-13T02:53:09.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:09 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.ukgenf/crt"}]: dispatch 2024-09-13T02:53:09.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:09 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:53:09.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:09 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.ukgenf/key"}]: dispatch 2024-09-13T02:53:09.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:09 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:53:09.734 INFO:tasks.workunit.client.0.smithi098.stdout:5/776: mknod d0/d38/d3f/d81/d4d/d82/c104 0 2024-09-13T02:53:09.737 INFO:tasks.workunit.client.0.smithi098.stdout:0/860: dwrite dd/d1f/d85/d9d/dc2/de4/f87 [0,4194304] 0 2024-09-13T02:53:09.739 INFO:tasks.workunit.client.0.smithi098.stdout:8/750: dwrite d2/d28/f80 [0,4194304] 0 2024-09-13T02:53:09.739 INFO:tasks.workunit.client.0.smithi098.stdout:9/874: fdatasync d2/d6/d2b/d4d/d4f/d6c/dd4/f3e 0 2024-09-13T02:53:09.740 INFO:tasks.workunit.client.0.smithi098.stdout:8/751: stat d2/d2f/d78/d46/d47/c59 0 2024-09-13T02:53:09.741 INFO:tasks.workunit.client.0.smithi098.stdout:8/752: fsync d2/dd/fd1 0 2024-09-13T02:53:09.742 INFO:tasks.workunit.client.0.smithi098.stdout:9/875: read - d2/d6/d2b/d4d/d56/dbc/f106 zero size 2024-09-13T02:53:09.743 INFO:tasks.workunit.client.0.smithi098.stdout:9/876: read - d2/d6/d36/d8d/dc8/f10d zero size 2024-09-13T02:53:09.747 INFO:tasks.workunit.client.0.smithi098.stdout:0/861: symlink dd/d1f/d85/d9d/dc2/de4/dc7/l12f 0 2024-09-13T02:53:09.750 INFO:tasks.workunit.client.0.smithi098.stdout:2/797: symlink d1/d1a/l104 0 2024-09-13T02:53:09.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:09 smithi142 ceph-mon[33443]: Standby manager daemon smithi098.ukgenf restarted 2024-09-13T02:53:09.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:09 smithi142 ceph-mon[33443]: Standby manager daemon smithi098.ukgenf started 2024-09-13T02:53:09.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:09 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.ukgenf/crt"}]: dispatch 2024-09-13T02:53:09.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:09 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:53:09.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:09 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi098.ukgenf/key"}]: dispatch 2024-09-13T02:53:09.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:09 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:53:09.754 INFO:tasks.workunit.client.0.smithi098.stdout:9/877: mknod d2/d6/d2b/d4d/d56/db9/ddf/c129 0 2024-09-13T02:53:09.755 INFO:tasks.workunit.client.0.smithi098.stdout:9/878: chown d2/d6/d91/d127/dd9/l10c 16060 1 2024-09-13T02:53:09.757 INFO:tasks.workunit.client.0.smithi098.stdout:0/862: truncate dd/db9/f121 358684 0 2024-09-13T02:53:09.758 INFO:tasks.workunit.client.0.smithi098.stdout:0/863: chown dd/df/d1d/d26/d28/d32/d67/d71/ca3 432812 1 2024-09-13T02:53:09.761 INFO:tasks.workunit.client.0.smithi098.stdout:9/879: rename d2/d6/d2b/d4d/d56/db9/ddf/fe1 to d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/d11a/f12a 0 2024-09-13T02:53:09.761 INFO:tasks.workunit.client.0.smithi098.stdout:2/798: link d1/d1a/d9/d1e/cc9 d1/da7/c105 0 2024-09-13T02:53:09.762 INFO:tasks.workunit.client.0.smithi098.stdout:2/799: readlink d1/d1f/d36/l50 0 2024-09-13T02:53:09.763 INFO:tasks.workunit.client.0.smithi098.stdout:2/800: chown d1/d1f/d35/d63/d23/f28 0 1 2024-09-13T02:53:09.763 INFO:tasks.workunit.client.0.smithi098.stdout:2/801: stat d1/d1f/d39/df6/f8c 0 2024-09-13T02:53:09.767 INFO:tasks.workunit.client.0.smithi098.stdout:0/864: link dd/df/la6 dd/l130 0 2024-09-13T02:53:09.768 INFO:tasks.workunit.client.0.smithi098.stdout:0/865: stat dd/df/d1d/f63 0 2024-09-13T02:53:09.769 INFO:tasks.workunit.client.0.smithi098.stdout:0/866: read dd/df/d1d/d40/d46/f5b [1876215,104132] 0 2024-09-13T02:53:09.770 INFO:tasks.workunit.client.0.smithi098.stdout:5/777: write d0/d57/fce [2483416,11879] 0 2024-09-13T02:53:09.773 INFO:tasks.workunit.client.0.smithi098.stdout:0/867: chown dd/df/c7b 7 1 2024-09-13T02:53:09.777 INFO:tasks.workunit.client.0.smithi098.stdout:8/753: dwrite d2/dd/f21 [0,4194304] 0 2024-09-13T02:53:09.781 INFO:tasks.workunit.client.0.smithi098.stdout:9/880: write d2/d6/d2b/d4d/fd5 [579421,36813] 0 2024-09-13T02:53:09.782 INFO:tasks.workunit.client.0.smithi098.stdout:5/778: dwrite d0/d15/d17/d1c/dd6/fef [0,4194304] 0 2024-09-13T02:53:09.782 INFO:tasks.workunit.client.0.smithi098.stdout:0/868: mkdir dd/d1f/d85/d9d/dc2/de4/d131 0 2024-09-13T02:53:09.783 INFO:tasks.workunit.client.0.smithi098.stdout:2/802: write d1/d1f/d35/f83 [502233,130107] 0 2024-09-13T02:53:09.789 INFO:tasks.workunit.client.0.smithi098.stdout:8/754: truncate d2/dd/d11/d44/f72 1513587 0 2024-09-13T02:53:09.791 INFO:tasks.workunit.client.0.smithi098.stdout:9/881: mknod d2/d6/d2b/d66/c12b 0 2024-09-13T02:53:09.794 INFO:tasks.workunit.client.0.smithi098.stdout:5/779: creat d0/d38/d3f/d81/d9e/dd4/f105 x:0 0 0 2024-09-13T02:53:09.796 INFO:tasks.workunit.client.0.smithi098.stdout:2/803: symlink d1/d1f/d35/d63/d23/l106 0 2024-09-13T02:53:09.797 INFO:tasks.workunit.client.0.smithi098.stdout:8/755: mkdir d2/d28/d43/d88/df2 0 2024-09-13T02:53:09.798 INFO:tasks.workunit.client.0.smithi098.stdout:2/804: readlink d1/d1f/d35/lda 0 2024-09-13T02:53:09.799 INFO:tasks.workunit.client.0.smithi098.stdout:5/780: read d0/d15/d17/f2e [498970,95971] 0 2024-09-13T02:53:09.800 INFO:tasks.workunit.client.0.smithi098.stdout:9/882: dwrite d2/d6/d2b/d4d/d56/dbc/f106 [0,4194304] 0 2024-09-13T02:53:09.806 INFO:tasks.workunit.client.0.smithi098.stdout:9/883: mkdir d2/d6/d2b/d4d/d4f/d6c/dce/d12c 0 2024-09-13T02:53:09.810 INFO:tasks.workunit.client.0.smithi098.stdout:8/756: dwrite d2/dd/d2e/f3d [0,4194304] 0 2024-09-13T02:53:09.812 INFO:tasks.workunit.client.0.smithi098.stdout:0/869: dwrite dd/df/d1d/d26/d28/d32/da1/fbe [0,4194304] 0 2024-09-13T02:53:09.819 INFO:tasks.workunit.client.0.smithi098.stdout:0/870: dread dd/f10 [0,4194304] 0 2024-09-13T02:53:09.840 INFO:tasks.workunit.client.0.smithi098.stdout:8/757: dread d2/d2f/d78/d5d/dcd/fd9 [0,4194304] 0 2024-09-13T02:53:09.889 INFO:tasks.workunit.client.0.smithi098.stdout:5/781: rename d0/d15/f3a to d0/d15/d17/d1c/d3d/df9/f106 0 2024-09-13T02:53:09.890 INFO:tasks.workunit.client.0.smithi098.stdout:5/782: chown d0/d38/d3f/d81 2 1 2024-09-13T02:53:09.891 INFO:tasks.workunit.client.0.smithi098.stdout:5/783: write d0/d38/d102/db1/fbc [1371879,3787] 0 2024-09-13T02:53:09.896 INFO:tasks.workunit.client.0.smithi098.stdout:5/784: dwrite d0/d57/f94 [0,4194304] 0 2024-09-13T02:53:09.903 INFO:tasks.workunit.client.0.smithi098.stdout:0/871: stat dd/df/d1d/d26/d28/d32/lcc 0 2024-09-13T02:53:09.903 INFO:tasks.workunit.client.0.smithi098.stdout:3/813: sync 2024-09-13T02:53:09.904 INFO:tasks.workunit.client.0.smithi098.stdout:8/758: truncate d2/dd/d11/d1d/f3a 2871603 0 2024-09-13T02:53:09.906 INFO:tasks.workunit.client.0.smithi098.stdout:9/884: dread d2/d6/d36/f58 [0,4194304] 0 2024-09-13T02:53:09.915 INFO:tasks.workunit.client.0.smithi098.stdout:8/759: rmdir d2/dd/d2e 39 2024-09-13T02:53:09.915 INFO:tasks.workunit.client.0.smithi098.stdout:8/760: fdatasync d2/dd/d4d/fe1 0 2024-09-13T02:53:09.916 INFO:tasks.workunit.client.0.smithi098.stdout:3/814: symlink d7/d9/d15/d2d/db8/d52/lfe 0 2024-09-13T02:53:09.918 INFO:tasks.workunit.client.0.smithi098.stdout:8/761: truncate d2/d2f/d78/d46/d47/d6e/d68/fe2 435309 0 2024-09-13T02:53:09.920 INFO:tasks.workunit.client.0.smithi098.stdout:8/762: read d2/d28/fbd [3725901,99259] 0 2024-09-13T02:53:09.921 INFO:tasks.workunit.client.0.smithi098.stdout:8/763: chown d2/d2f/d78/f50 0 1 2024-09-13T02:53:09.921 INFO:tasks.workunit.client.0.smithi098.stdout:5/785: symlink d0/d15/d17/l107 0 2024-09-13T02:53:09.926 INFO:tasks.workunit.client.0.smithi098.stdout:9/885: truncate d2/d6/d36/fea 125716 0 2024-09-13T02:53:09.928 INFO:tasks.workunit.client.0.smithi098.stdout:5/786: unlink d0/d15/d50/f8c 0 2024-09-13T02:53:09.930 INFO:tasks.workunit.client.0.smithi098.stdout:3/815: symlink d7/d9/d15/d5d/da1/dec/lff 0 2024-09-13T02:53:09.931 INFO:tasks.workunit.client.0.smithi098.stdout:0/872: dread dd/df/d1d/d26/d28/d5d/f69 [0,4194304] 0 2024-09-13T02:53:09.939 INFO:tasks.workunit.client.0.smithi098.stdout:8/764: dwrite d2/f60 [0,4194304] 0 2024-09-13T02:53:09.941 INFO:tasks.workunit.client.0.smithi098.stdout:3/816: truncate d7/d9/d15/f7d 575172 0 2024-09-13T02:53:09.945 INFO:tasks.workunit.client.0.smithi098.stdout:0/873: dread dd/df/d1d/d26/d28/d5d/f66 [0,4194304] 0 2024-09-13T02:53:09.949 INFO:tasks.workunit.client.0.smithi098.stdout:8/765: write d2/d2f/d78/d46/d47/d6e/fc7 [901347,86646] 0 2024-09-13T02:53:09.952 INFO:tasks.workunit.client.0.smithi098.stdout:0/874: mknod dd/d95/c132 0 2024-09-13T02:53:09.953 INFO:tasks.workunit.client.0.smithi098.stdout:5/787: creat d0/d15/d50/f108 x:0 0 0 2024-09-13T02:53:09.954 INFO:tasks.workunit.client.0.smithi098.stdout:5/788: chown d0/d57/ce8 219610 1 2024-09-13T02:53:09.954 INFO:tasks.workunit.client.0.smithi098.stdout:5/789: readlink d0/d7c/l8a 0 2024-09-13T02:53:09.955 INFO:tasks.workunit.client.0.smithi098.stdout:5/790: chown d0/d38/d3f/f9 1984543 1 2024-09-13T02:53:09.956 INFO:tasks.workunit.client.0.smithi098.stdout:9/886: creat d2/d6/d36/da7/de5/f12d x:0 0 0 2024-09-13T02:53:09.959 INFO:tasks.workunit.client.0.smithi098.stdout:3/817: creat d7/d9/d15/d2d/f100 x:0 0 0 2024-09-13T02:53:09.961 INFO:tasks.workunit.client.0.smithi098.stdout:8/766: creat d2/d2f/d78/d46/d74/d86/dd2/ff3 x:0 0 0 2024-09-13T02:53:09.962 INFO:tasks.workunit.client.0.smithi098.stdout:5/791: chown d0/d15/d50/dd3/cfc 2960 1 2024-09-13T02:53:09.969 INFO:tasks.workunit.client.0.smithi098.stdout:9/887: readlink d2/d6/d36/d8d/l60 0 2024-09-13T02:53:09.969 INFO:tasks.workunit.client.0.smithi098.stdout:0/875: write dd/df/d1d/d40/d46/fad [384727,69691] 0 2024-09-13T02:53:09.971 INFO:tasks.workunit.client.0.smithi098.stdout:0/876: write dd/d1f/d85/dfc/f10d [522201,85570] 0 2024-09-13T02:53:09.976 INFO:tasks.workunit.client.0.smithi098.stdout:9/888: stat d2/d6/d36/c52 0 2024-09-13T02:53:09.976 INFO:tasks.workunit.client.0.smithi098.stdout:9/889: chown d2/d6/d36/da7/l10f 382289 1 2024-09-13T02:53:09.977 INFO:tasks.workunit.client.0.smithi098.stdout:9/890: stat d2/d6/d2b/c55 0 2024-09-13T02:53:10.049 INFO:tasks.workunit.client.0.smithi098.stdout:0/877: write dd/df/d1d/d40/d46/f5b [2656500,602] 0 2024-09-13T02:53:10.049 INFO:tasks.workunit.client.0.smithi098.stdout:3/818: write d7/f43 [1524448,34458] 0 2024-09-13T02:53:10.052 INFO:tasks.workunit.client.0.smithi098.stdout:0/878: write dd/d95/f9c [4111131,82654] 0 2024-09-13T02:53:10.053 INFO:tasks.workunit.client.0.smithi098.stdout:9/891: mknod d2/d6/d2b/d4d/d4f/d6c/dd4/de4/c12e 0 2024-09-13T02:53:10.056 INFO:tasks.workunit.client.0.smithi098.stdout:5/792: dwrite d0/d38/d3f/d81/d4d/d82/d9a/fc4 [0,4194304] 0 2024-09-13T02:53:10.059 INFO:tasks.workunit.client.0.smithi098.stdout:5/793: fdatasync d0/d15/d17/d1c/f9d 0 2024-09-13T02:53:10.065 INFO:tasks.workunit.client.0.smithi098.stdout:3/819: truncate d7/d9/d15/d2d/db8/d51/f66 2377401 0 2024-09-13T02:53:10.070 INFO:tasks.workunit.client.0.smithi098.stdout:9/892: dread - d2/d6/d36/da7/de5/ff7 zero size 2024-09-13T02:53:10.076 INFO:tasks.workunit.client.0.smithi098.stdout:5/794: dread d0/d15/f87 [0,4194304] 0 2024-09-13T02:53:10.079 INFO:tasks.workunit.client.0.smithi098.stdout:3/820: read d7/d9/d4c/f81 [3215134,113381] 0 2024-09-13T02:53:10.083 INFO:tasks.workunit.client.0.smithi098.stdout:5/795: creat d0/d15/d17/daa/f109 x:0 0 0 2024-09-13T02:53:10.083 INFO:tasks.workunit.client.0.smithi098.stdout:9/893: creat d2/d6/d91/d127/d109/f12f x:0 0 0 2024-09-13T02:53:10.085 INFO:tasks.workunit.client.0.smithi098.stdout:0/879: link dd/df/d1d/d40/d46/c108 dd/d1f/d85/d9d/dc2/de4/d131/c133 0 2024-09-13T02:53:10.087 INFO:tasks.workunit.client.0.smithi098.stdout:5/796: read d0/d38/d3f/fac [54543,108240] 0 2024-09-13T02:53:10.088 INFO:tasks.workunit.client.0.smithi098.stdout:3/821: mkdir d7/d9/d15/d26/d101 0 2024-09-13T02:53:10.089 INFO:tasks.workunit.client.0.smithi098.stdout:3/822: chown d7/d9/d15/d2d/db8/f44 2598416 1 2024-09-13T02:53:10.090 INFO:tasks.workunit.client.0.smithi098.stdout:9/894: symlink d2/d6/d2b/d66/de0/d102/l130 0 2024-09-13T02:53:10.093 INFO:tasks.workunit.client.0.smithi098.stdout:9/895: symlink d2/d6/d2b/d4d/d56/dbc/l131 0 2024-09-13T02:53:10.094 INFO:tasks.workunit.client.0.smithi098.stdout:5/797: creat d0/d38/f10a x:0 0 0 2024-09-13T02:53:10.096 INFO:tasks.workunit.client.0.smithi098.stdout:3/823: getdents d7/d9/d15/d80/da0/dd4 0 2024-09-13T02:53:10.098 INFO:tasks.workunit.client.0.smithi098.stdout:3/824: chown d7/d9/d25/cc2 6 1 2024-09-13T02:53:10.105 INFO:tasks.workunit.client.0.smithi098.stdout:3/825: rename d7/d9/le5 to d7/d9/d15/d2d/d34/dd6/l102 0 2024-09-13T02:53:10.109 INFO:tasks.workunit.client.0.smithi098.stdout:3/826: mkdir d7/d9/d15/d5d/da1/dec/d103 0 2024-09-13T02:53:10.109 INFO:tasks.workunit.client.0.smithi098.stdout:9/896: write d2/db1/dc5/fdc [90300,72496] 0 2024-09-13T02:53:10.115 INFO:tasks.workunit.client.0.smithi098.stdout:5/798: dwrite d0/d15/d17/daa/fcc [0,4194304] 0 2024-09-13T02:53:10.119 INFO:tasks.workunit.client.0.smithi098.stdout:3/827: write d7/d9/d4c/fc6 [471561,35772] 0 2024-09-13T02:53:10.120 INFO:tasks.workunit.client.0.smithi098.stdout:9/897: write d2/d6/d2b/d66/de0/d102/f11b [269784,38513] 0 2024-09-13T02:53:10.125 INFO:tasks.workunit.client.0.smithi098.stdout:3/828: chown d7/d9/d25/c87 805819377 1 2024-09-13T02:53:10.125 INFO:tasks.workunit.client.0.smithi098.stdout:3/829: chown d7/d9/d25/d64 46644 1 2024-09-13T02:53:10.126 INFO:tasks.workunit.client.0.smithi098.stdout:5/799: getdents d0/d15/d17/daa/dab 0 2024-09-13T02:53:10.127 INFO:tasks.workunit.client.0.smithi098.stdout:9/898: creat d2/d6/d2b/d4d/d4f/f132 x:0 0 0 2024-09-13T02:53:10.128 INFO:tasks.workunit.client.0.smithi098.stdout:3/830: mknod d7/d9/c104 0 2024-09-13T02:53:10.129 INFO:tasks.workunit.client.0.smithi098.stdout:5/800: mknod d0/d15/d69/c10b 0 2024-09-13T02:53:10.130 INFO:tasks.workunit.client.0.smithi098.stdout:3/831: mkdir d7/d9/d15/d2d/d78/d105 0 2024-09-13T02:53:10.134 INFO:tasks.workunit.client.0.smithi098.stdout:5/801: fdatasync d0/d38/d3f/d1a/f34 0 2024-09-13T02:53:10.136 INFO:tasks.workunit.client.0.smithi098.stdout:9/899: dread d2/f32 [4194304,4194304] 0 2024-09-13T02:53:10.136 INFO:tasks.workunit.client.0.smithi098.stdout:5/802: mknod d0/d38/d3f/d1a/d27/c10c 0 2024-09-13T02:53:10.139 INFO:tasks.workunit.client.0.smithi098.stdout:9/900: symlink d2/d6/d91/d127/d109/l133 0 2024-09-13T02:53:10.142 INFO:tasks.workunit.client.0.smithi098.stdout:5/803: mknod d0/c10d 0 2024-09-13T02:53:10.143 INFO:tasks.workunit.client.0.smithi098.stdout:9/901: symlink d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/l134 0 2024-09-13T02:53:10.144 INFO:tasks.workunit.client.0.smithi098.stdout:9/902: write d2/d6/fa8 [1385972,53122] 0 2024-09-13T02:53:10.149 INFO:tasks.workunit.client.0.smithi098.stdout:9/903: symlink d2/d6/d2b/d4d/d56/db9/l135 0 2024-09-13T02:53:10.149 INFO:tasks.workunit.client.0.smithi098.stdout:9/904: fsync d2/d6/d2b/d4d/d4f/f132 0 2024-09-13T02:53:10.150 INFO:tasks.workunit.client.0.smithi098.stdout:5/804: unlink d0/d38/d102/fdf 0 2024-09-13T02:53:10.153 INFO:tasks.workunit.client.0.smithi098.stdout:5/805: mknod d0/d7c/c10e 0 2024-09-13T02:53:10.155 INFO:tasks.workunit.client.0.smithi098.stdout:5/806: mknod d0/c10f 0 2024-09-13T02:53:10.155 INFO:tasks.workunit.client.0.smithi098.stdout:9/905: dread d2/d6/f35 [0,4194304] 0 2024-09-13T02:53:10.156 INFO:tasks.workunit.client.0.smithi098.stdout:5/807: fsync d0/d15/d17/d1c/f6c 0 2024-09-13T02:53:10.159 INFO:tasks.workunit.client.0.smithi098.stdout:9/906: mkdir d2/d6/d36/d8d/dc8/d136 0 2024-09-13T02:53:10.160 INFO:tasks.workunit.client.0.smithi098.stdout:9/907: chown d2/d6/d2b/d4d/d4f/d6c/dd4/de4/c12e 60734020 1 2024-09-13T02:53:10.161 INFO:tasks.workunit.client.0.smithi098.stdout:9/908: stat d2/d6/d2b/d4d/d56/db9/feb 0 2024-09-13T02:53:10.162 INFO:tasks.workunit.client.0.smithi098.stdout:9/909: dread - d2/d6/d2b/d4d/d56/f121 zero size 2024-09-13T02:53:10.166 INFO:tasks.workunit.client.0.smithi098.stdout:9/910: unlink d2/d6/d2b/d4d/d4f/d6c/dd4/c3f 0 2024-09-13T02:53:10.177 INFO:tasks.workunit.client.0.smithi098.stdout:9/911: dwrite d2/d6/d36/d8d/dc8/f100 [0,4194304] 0 2024-09-13T02:53:10.177 INFO:tasks.workunit.client.0.smithi098.stdout:9/912: fsync d2/d6/d2b/d4d/fe6 0 2024-09-13T02:53:10.181 INFO:tasks.workunit.client.0.smithi098.stdout:9/913: creat d2/d6/d2b/d4d/d56/db9/ddf/f137 x:0 0 0 2024-09-13T02:53:10.185 INFO:tasks.workunit.client.0.smithi098.stdout:9/914: creat d2/d6/d2b/d4d/dcf/f138 x:0 0 0 2024-09-13T02:53:10.190 INFO:tasks.workunit.client.0.smithi098.stdout:9/915: link d2/d6/d2b/c10b d2/d6/d2b/d4d/d4f/c139 0 2024-09-13T02:53:10.195 INFO:tasks.workunit.client.0.smithi098.stdout:9/916: rename d2/d6/d2b/d4d/d4f/d6c/dd4/f62 to d2/d6/d2b/d4d/d56/db9/f13a 0 2024-09-13T02:53:10.196 INFO:tasks.workunit.client.0.smithi098.stdout:9/917: symlink d2/d6/d36/d8d/dc8/l13b 0 2024-09-13T02:53:10.198 INFO:tasks.workunit.client.0.smithi098.stdout:9/918: chown d2/d6/d2b/d4d/d4f/d6c/dd4/l41 0 1 2024-09-13T02:53:10.203 INFO:tasks.workunit.client.0.smithi098.stdout:9/919: dread d2/d6/d2b/d4d/f8c [0,4194304] 0 2024-09-13T02:53:10.209 INFO:tasks.workunit.client.0.smithi098.stdout:9/920: creat d2/d6/d2b/d66/de0/f13c x:0 0 0 2024-09-13T02:53:10.210 INFO:tasks.workunit.client.0.smithi098.stdout:9/921: creat d2/db1/dcb/f13d x:0 0 0 2024-09-13T02:53:10.213 INFO:tasks.workunit.client.0.smithi098.stdout:9/922: unlink d2/d6/d2b/d4d/d4f/d6c/dd4/f45 0 2024-09-13T02:53:10.390 INFO:tasks.workunit.client.0.smithi098.stdout:1/956: sync 2024-09-13T02:53:10.390 INFO:tasks.workunit.client.0.smithi098.stdout:4/774: sync 2024-09-13T02:53:10.390 INFO:tasks.workunit.client.0.smithi098.stdout:6/749: sync 2024-09-13T02:53:10.396 INFO:tasks.workunit.client.0.smithi098.stdout:4/775: dwrite d6/d3e/f100 [0,4194304] 0 2024-09-13T02:53:10.470 INFO:tasks.workunit.client.0.smithi098.stdout:2/805: sync 2024-09-13T02:53:10.537 INFO:tasks.workunit.client.0.smithi098.stdout:6/750: write d5/d13/d2b/d3a/d5a/da8/ff3 [1170663,83814] 0 2024-09-13T02:53:10.538 INFO:tasks.workunit.client.0.smithi098.stdout:1/957: truncate d9/d33/f2b 3174770 0 2024-09-13T02:53:10.540 INFO:tasks.workunit.client.0.smithi098.stdout:2/806: creat d1/d1f/f107 x:0 0 0 2024-09-13T02:53:10.541 INFO:tasks.workunit.client.0.smithi098.stdout:4/776: write d6/d10/d21/f3b [1255000,20731] 0 2024-09-13T02:53:10.541 INFO:tasks.workunit.client.0.smithi098.stdout:6/751: creat d5/d13/d2b/ffe x:0 0 0 2024-09-13T02:53:10.542 INFO:tasks.workunit.client.0.smithi098.stdout:2/807: stat d1/d1a/d9/d1e/d5a 0 2024-09-13T02:53:10.545 INFO:tasks.workunit.client.0.smithi098.stdout:1/958: mknod d9/d33/d19/d35/d10a/d114/c154 0 2024-09-13T02:53:10.545 INFO:tasks.workunit.client.0.smithi098.stdout:1/959: fsync d9/d33/d29/d58/f5c 0 2024-09-13T02:53:10.547 INFO:tasks.workunit.client.0.smithi098.stdout:2/808: dread d1/d1f/d39/f49 [0,4194304] 0 2024-09-13T02:53:10.547 INFO:tasks.workunit.client.0.smithi098.stdout:6/752: unlink d5/d36/l75 0 2024-09-13T02:53:10.548 INFO:tasks.workunit.client.0.smithi098.stdout:4/777: symlink d6/d3e/d73/dfc/l102 0 2024-09-13T02:53:10.548 INFO:tasks.workunit.client.0.smithi098.stdout:2/809: read - d1/d1f/d39/df6/d59/fcd zero size 2024-09-13T02:53:10.553 INFO:tasks.workunit.client.0.smithi098.stdout:1/960: rename d9/d33/d19/d35/d68/l3c to d9/d33/d19/d35/d140/l155 0 2024-09-13T02:53:10.558 INFO:tasks.workunit.client.0.smithi098.stdout:1/961: fsync d9/d33/d19/d35/f95 0 2024-09-13T02:53:10.560 INFO:tasks.workunit.client.0.smithi098.stdout:6/753: write d5/d13/d2b/fd3 [2245145,46350] 0 2024-09-13T02:53:10.570 INFO:tasks.workunit.client.0.smithi098.stdout:2/810: dwrite d1/d1f/d39/f49 [0,4194304] 0 2024-09-13T02:53:10.573 INFO:tasks.workunit.client.0.smithi098.stdout:1/962: dread d9/d33/d19/d35/d68/f101 [0,4194304] 0 2024-09-13T02:53:10.574 INFO:tasks.workunit.client.0.smithi098.stdout:1/963: chown d9/d33/d19/d35/d68/d4d/l144 102385538 1 2024-09-13T02:53:10.578 INFO:tasks.workunit.client.0.smithi098.stdout:2/811: link d1/d1f/d30/fa1 d1/d1f/d39/df6/d59/d9e/dde/f108 0 2024-09-13T02:53:10.582 INFO:tasks.workunit.client.0.smithi098.stdout:2/812: fdatasync d1/d1f/d35/d63/d72/f9d 0 2024-09-13T02:53:10.584 INFO:tasks.workunit.client.0.smithi098.stdout:2/813: mkdir d1/da7/d109 0 2024-09-13T02:53:10.586 INFO:tasks.workunit.client.0.smithi098.stdout:2/814: mknod d1/d1f/d30/def/df0/c10a 0 2024-09-13T02:53:10.589 INFO:tasks.workunit.client.0.smithi098.stdout:2/815: readlink d1/d1f/d39/df6/ldf 0 2024-09-13T02:53:10.589 INFO:tasks.workunit.client.0.smithi098.stdout:1/964: write d9/d33/d19/d35/d63/f89 [5231413,99877] 0 2024-09-13T02:53:10.593 INFO:tasks.workunit.client.0.smithi098.stdout:1/965: mknod d9/d33/d19/d35/d68/d4d/db5/df3/c156 0 2024-09-13T02:53:10.597 INFO:tasks.workunit.client.0.smithi098.stdout:2/816: write d1/f8f [1419580,12618] 0 2024-09-13T02:53:10.600 INFO:tasks.workunit.client.0.smithi098.stdout:2/817: mkdir d1/d1f/d30/def/d10b 0 2024-09-13T02:53:10.600 INFO:tasks.workunit.client.0.smithi098.stdout:1/966: dread d9/d33/de6/d61/db1/fc4 [0,4194304] 0 2024-09-13T02:53:10.600 INFO:tasks.workunit.client.0.smithi098.stdout:2/818: chown d1/d1a/l104 862620960 1 2024-09-13T02:53:10.602 INFO:tasks.workunit.client.0.smithi098.stdout:2/819: chown d1/d1a/f7 738 1 2024-09-13T02:53:10.604 INFO:tasks.workunit.client.0.smithi098.stdout:1/967: mknod d9/d33/d19/d35/d68/d4d/db5/de2/c157 0 2024-09-13T02:53:10.607 INFO:tasks.workunit.client.0.smithi098.stdout:1/968: symlink d9/d33/d29/d11c/d23/d30/l158 0 2024-09-13T02:53:10.609 INFO:tasks.workunit.client.0.smithi098.stdout:2/820: dread d1/d1f/d39/f21 [0,4194304] 0 2024-09-13T02:53:10.610 INFO:tasks.workunit.client.0.smithi098.stdout:2/821: chown d1/d1f/d39/df6/d59/d9e/ccf 25025944 1 2024-09-13T02:53:10.611 INFO:tasks.workunit.client.0.smithi098.stdout:1/969: getdents d9/d33/de6 0 2024-09-13T02:53:10.616 INFO:tasks.workunit.client.0.smithi098.stdout:2/822: truncate d1/d1a/f3a 2206393 0 2024-09-13T02:53:10.617 INFO:tasks.workunit.client.0.smithi098.stdout:2/823: write d1/f8f [3630584,130332] 0 2024-09-13T02:53:10.623 INFO:tasks.workunit.client.0.smithi098.stdout:8/767: sync 2024-09-13T02:53:10.624 INFO:tasks.workunit.client.0.smithi098.stdout:8/768: chown d2/dd/d11/d44/cd5 8 1 2024-09-13T02:53:10.624 INFO:tasks.workunit.client.0.smithi098.stdout:2/824: creat d1/d1f/d35/d63/f10c x:0 0 0 2024-09-13T02:53:10.631 INFO:tasks.workunit.client.0.smithi098.stdout:1/970: dwrite d9/d33/d29/d11c/f88 [0,4194304] 0 2024-09-13T02:53:10.635 INFO:tasks.workunit.client.0.smithi098.stdout:8/769: truncate d2/dd/d4d/d96/f52 190406 0 2024-09-13T02:53:10.645 INFO:tasks.workunit.client.0.smithi098.stdout:8/770: creat d2/d2f/d78/ff4 x:0 0 0 2024-09-13T02:53:10.646 INFO:tasks.workunit.client.0.smithi098.stdout:2/825: write d1/d1f/d35/d63/d72/f9b [1024671,8496] 0 2024-09-13T02:53:10.651 INFO:tasks.workunit.client.0.smithi098.stdout:8/771: creat d2/d2f/d78/d46/da2/ff5 x:0 0 0 2024-09-13T02:53:10.652 INFO:tasks.workunit.client.0.smithi098.stdout:2/826: mkdir d1/d1f/d30/def/df0/d10d 0 2024-09-13T02:53:10.653 INFO:tasks.workunit.client.0.smithi098.stdout:1/971: truncate d9/d33/d19/d35/d68/d4d/db5/db8/fbe 650697 0 2024-09-13T02:53:10.654 INFO:tasks.workunit.client.0.smithi098.stdout:8/772: symlink d2/dd/d11/d1d/lf6 0 2024-09-13T02:53:10.655 INFO:tasks.workunit.client.0.smithi098.stdout:2/827: fdatasync d1/d1a/d9/d1e/d5a/f5f 0 2024-09-13T02:53:10.656 INFO:tasks.workunit.client.0.smithi098.stdout:1/972: unlink d9/d33/d19/d35/d68/d4d/db5/d118/c13c 0 2024-09-13T02:53:10.661 INFO:tasks.workunit.client.0.smithi098.stdout:8/773: creat d2/d2f/d78/d46/d74/d86/dd2/ff7 x:0 0 0 2024-09-13T02:53:10.661 INFO:tasks.workunit.client.0.smithi098.stdout:8/774: mknod d2/d28/d43/d88/d99/cf8 0 2024-09-13T02:53:10.663 INFO:tasks.workunit.client.0.smithi098.stdout:1/973: dwrite d9/d33/d29/d58/f5c [0,4194304] 0 2024-09-13T02:53:10.674 INFO:tasks.workunit.client.0.smithi098.stdout:2/828: write d1/d1f/d39/f21 [1228722,125371] 0 2024-09-13T02:53:10.678 INFO:tasks.workunit.client.0.smithi098.stdout:1/974: link d9/d33/de6/d61/ddb/le4 d9/d33/d19/d35/d63/dcd/l159 0 2024-09-13T02:53:10.680 INFO:tasks.workunit.client.0.smithi098.stdout:1/975: rename d9/d33/d19/d35/d68 to d9/d33/d19/d35/d68/d4d/db5/df3/d15a 22 2024-09-13T02:53:10.682 INFO:tasks.workunit.client.0.smithi098.stdout:8/775: dread d2/dd/d11/d2c/d9b/fad [0,4194304] 0 2024-09-13T02:53:10.684 INFO:tasks.workunit.client.0.smithi098.stdout:1/976: dread d9/d33/d29/d11c/f88 [0,4194304] 0 2024-09-13T02:53:10.686 INFO:tasks.workunit.client.0.smithi098.stdout:8/776: chown d2/c51 48 1 2024-09-13T02:53:10.686 INFO:tasks.workunit.client.0.smithi098.stdout:2/829: write d1/d1f/d39/df6/f8c [1463008,40349] 0 2024-09-13T02:53:10.689 INFO:tasks.workunit.client.0.smithi098.stdout:2/830: chown d1/d1a/d9/d1e/d5a/f60 109617850 1 2024-09-13T02:53:10.690 INFO:tasks.workunit.client.0.smithi098.stdout:8/777: rename d2/d2f/d78/f4f to d2/d2f/d78/d46/d74/d86/ff9 0 2024-09-13T02:53:10.693 INFO:tasks.workunit.client.0.smithi098.stdout:2/831: symlink d1/d1f/d35/d63/d23/l10e 0 2024-09-13T02:53:10.694 INFO:tasks.workunit.client.0.smithi098.stdout:1/977: dread f1 [0,4194304] 0 2024-09-13T02:53:10.697 INFO:tasks.workunit.client.0.smithi098.stdout:2/832: truncate d1/d1f/d30/def/fea 316563 0 2024-09-13T02:53:10.700 INFO:tasks.workunit.client.0.smithi098.stdout:8/778: getdents d2/d2f/d78/d46/d5c 0 2024-09-13T02:53:10.701 INFO:tasks.workunit.client.0.smithi098.stdout:8/779: fdatasync d2/dd/f21 0 2024-09-13T02:53:10.705 INFO:tasks.workunit.client.0.smithi098.stdout:8/780: symlink d2/d2f/d78/d46/d5c/lfa 0 2024-09-13T02:53:10.707 INFO:tasks.workunit.client.0.smithi098.stdout:1/978: write d9/d33/d19/d35/d68/d4d/db5/dd3/ffc [959826,106828] 0 2024-09-13T02:53:10.710 INFO:tasks.workunit.client.0.smithi098.stdout:8/781: unlink d2/dd/d11/d1d/c30 0 2024-09-13T02:53:10.712 INFO:tasks.workunit.client.0.smithi098.stdout:8/782: mkdir d2/dd/d4d/d96/dfb 0 2024-09-13T02:53:10.715 INFO:tasks.workunit.client.0.smithi098.stdout:1/979: link d9/d33/d19/d35/de1/c12b d9/d33/d19/d35/d68/c15b 0 2024-09-13T02:53:10.715 INFO:tasks.workunit.client.0.smithi098.stdout:1/980: chown d9/d33/d19/d35/d68/c94 1848 1 2024-09-13T02:53:10.716 INFO:tasks.workunit.client.0.smithi098.stdout:8/783: symlink d2/d2f/d78/d46/lfc 0 2024-09-13T02:53:10.717 INFO:tasks.workunit.client.0.smithi098.stdout:2/833: dread d1/d1f/d39/df6/d59/fa2 [0,4194304] 0 2024-09-13T02:53:10.718 INFO:tasks.workunit.client.0.smithi098.stdout:8/784: symlink d2/d28/d43/d88/lfd 0 2024-09-13T02:53:10.719 INFO:tasks.workunit.client.0.smithi098.stdout:1/981: mkdir d9/d33/d19/d35/d68/d4d/d15c 0 2024-09-13T02:53:10.721 INFO:tasks.workunit.client.0.smithi098.stdout:2/834: rmdir d1/d1f/d39 39 2024-09-13T02:53:10.722 INFO:tasks.workunit.client.0.smithi098.stdout:2/835: write d1/d1f/d30/def/fcb [2411850,130211] 0 2024-09-13T02:53:10.724 INFO:tasks.workunit.client.0.smithi098.stdout:1/982: stat d9/d33/d29/d11c/fdc 0 2024-09-13T02:53:10.725 INFO:tasks.workunit.client.0.smithi098.stdout:8/785: dwrite d2/dd/d11/d2c/f7c [0,4194304] 0 2024-09-13T02:53:10.726 INFO:tasks.workunit.client.0.smithi098.stdout:8/786: chown d2/d2f/d78/d46/d74/d86/f8e 1943 1 2024-09-13T02:53:10.728 INFO:tasks.workunit.client.0.smithi098.stdout:2/836: creat d1/da7/f10f x:0 0 0 2024-09-13T02:53:10.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:10 smithi098 ceph-mon[27886]: mgrmap e26: smithi142.jutrvi(active, since 61s), standbys: smithi098.ukgenf 2024-09-13T02:53:10.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:10 smithi098 ceph-mon[27886]: pgmap v34: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 67 MiB/s rd, 160 MiB/s wr, 425 op/s 2024-09-13T02:53:10.735 INFO:tasks.workunit.client.0.smithi098.stdout:8/787: rename d2/d2f/d78/d46/d47/d6e/d68 to d2/d2f/d78/d46/d74/dfe 0 2024-09-13T02:53:10.736 INFO:tasks.workunit.client.0.smithi098.stdout:8/788: fdatasync d2/fe5 0 2024-09-13T02:53:10.736 INFO:tasks.workunit.client.0.smithi098.stdout:0/880: sync 2024-09-13T02:53:10.736 INFO:tasks.workunit.client.0.smithi098.stdout:3/832: sync 2024-09-13T02:53:10.737 INFO:tasks.workunit.client.0.smithi098.stdout:0/881: fdatasync dd/df/d1d/d26/d28/d32/fe3 0 2024-09-13T02:53:10.743 INFO:tasks.workunit.client.0.smithi098.stdout:2/837: symlink d1/l110 0 2024-09-13T02:53:10.744 INFO:tasks.workunit.client.0.smithi098.stdout:2/838: stat d1/d1a/d9/d1e 0 2024-09-13T02:53:10.748 INFO:tasks.workunit.client.0.smithi098.stdout:3/833: mknod d7/d9/d15/d2d/db8/d51/d9c/c106 0 2024-09-13T02:53:10.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:10 smithi142 ceph-mon[33443]: mgrmap e26: smithi142.jutrvi(active, since 61s), standbys: smithi098.ukgenf 2024-09-13T02:53:10.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:10 smithi142 ceph-mon[33443]: pgmap v34: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 67 MiB/s rd, 160 MiB/s wr, 425 op/s 2024-09-13T02:53:10.752 INFO:tasks.workunit.client.0.smithi098.stdout:8/789: write d2/d2f/d78/d46/d74/d86/da8/fef [864006,30246] 0 2024-09-13T02:53:10.753 INFO:tasks.workunit.client.0.smithi098.stdout:3/834: mkdir d7/d9/d15/d80/d107 0 2024-09-13T02:53:10.755 INFO:tasks.workunit.client.0.smithi098.stdout:0/882: unlink dd/df/d1d/d40/d46/c108 0 2024-09-13T02:53:10.757 INFO:tasks.workunit.client.0.smithi098.stdout:1/983: getdents d9/d33/d19/d35/d68/d4d 0 2024-09-13T02:53:10.759 INFO:tasks.workunit.client.0.smithi098.stdout:2/839: mkdir d1/d1f/d35/d111 0 2024-09-13T02:53:10.759 INFO:tasks.workunit.client.0.smithi098.stdout:2/840: readlink d1/d1a/d9/l8a 0 2024-09-13T02:53:10.762 INFO:tasks.workunit.client.0.smithi098.stdout:0/883: mkdir dd/df/d1d/d26/d28/d32/dda/d117/d134 0 2024-09-13T02:53:10.762 INFO:tasks.workunit.client.0.smithi098.stdout:0/884: write dd/fd9 [3328774,81055] 0 2024-09-13T02:53:10.763 INFO:tasks.workunit.client.0.smithi098.stdout:1/984: rename d9/d33/d19/d35/d68/d4d/db5/dcb/f10c to d9/d33/d19/d35/d10a/d114/f15d 0 2024-09-13T02:53:10.770 INFO:tasks.workunit.client.0.smithi098.stdout:6/754: sync 2024-09-13T02:53:10.770 INFO:tasks.workunit.client.0.smithi098.stdout:4/778: sync 2024-09-13T02:53:10.770 INFO:tasks.workunit.client.0.smithi098.stdout:5/808: sync 2024-09-13T02:53:10.770 INFO:tasks.workunit.client.0.smithi098.stdout:9/923: sync 2024-09-13T02:53:10.772 INFO:tasks.workunit.client.0.smithi098.stdout:9/924: chown d2/d6/d2b/d66/de0/d102/f11b 1341 1 2024-09-13T02:53:10.773 INFO:tasks.workunit.client.0.smithi098.stdout:3/835: write d7/f8c [1818349,7527] 0 2024-09-13T02:53:10.775 INFO:tasks.workunit.client.0.smithi098.stdout:1/985: unlink d9/d33/de6/d61/ddb/l11d 0 2024-09-13T02:53:10.776 INFO:tasks.workunit.client.0.smithi098.stdout:8/790: write d2/d2f/d78/d5d/f73 [26695,65916] 0 2024-09-13T02:53:10.779 INFO:tasks.workunit.client.0.smithi098.stdout:2/841: symlink d1/d1f/d39/df6/l112 0 2024-09-13T02:53:10.779 INFO:tasks.workunit.client.0.smithi098.stdout:1/986: write d9/d33/d19/d35/d68/d4d/db5/dd3/d8e/fef [3436434,30079] 0 2024-09-13T02:53:10.783 INFO:tasks.workunit.client.0.smithi098.stdout:6/755: chown d5/d13/d2b/d3a/d14/d6b/c8a 22980 1 2024-09-13T02:53:10.783 INFO:tasks.workunit.client.0.smithi098.stdout:9/925: dwrite d2/d6/d2b/d4d/d4f/d6c/f85 [0,4194304] 0 2024-09-13T02:53:10.783 INFO:tasks.workunit.client.0.smithi098.stdout:5/809: symlink d0/d38/d102/db1/l110 0 2024-09-13T02:53:10.785 INFO:tasks.workunit.client.0.smithi098.stdout:4/779: truncate d6/d54/fa7 1691798 0 2024-09-13T02:53:10.786 INFO:tasks.workunit.client.0.smithi098.stdout:0/885: dread dd/df/d1d/f34 [0,4194304] 0 2024-09-13T02:53:10.789 INFO:tasks.workunit.client.0.smithi098.stdout:3/836: mkdir d7/d9/d15/d5d/da1/dec/d108 0 2024-09-13T02:53:10.791 INFO:tasks.workunit.client.0.smithi098.stdout:2/842: mkdir d1/d1f/d39/df6/d59/d9e/d9f/dc1/d113 0 2024-09-13T02:53:10.792 INFO:tasks.workunit.client.0.smithi098.stdout:1/987: unlink d9/d33/d19/d35/d68/d4d/db5/df3/c156 0 2024-09-13T02:53:10.797 INFO:tasks.workunit.client.0.smithi098.stdout:5/810: mkdir d0/d38/d3f/d81/d4d/d82/d9a/d111 0 2024-09-13T02:53:10.799 INFO:tasks.workunit.client.0.smithi098.stdout:5/811: readlink d0/l46 0 2024-09-13T02:53:10.799 INFO:tasks.workunit.client.0.smithi098.stdout:5/812: dread - d0/d38/d3f/d81/d4d/d82/ff6 zero size 2024-09-13T02:53:10.800 INFO:tasks.workunit.client.0.smithi098.stdout:5/813: write d0/d15/d17/f26 [2434243,116714] 0 2024-09-13T02:53:10.803 INFO:tasks.workunit.client.0.smithi098.stdout:4/780: dread d6/d3e/fe4 [0,4194304] 0 2024-09-13T02:53:10.816 INFO:tasks.workunit.client.0.smithi098.stdout:5/814: write d0/d57/fce [1880009,117291] 0 2024-09-13T02:53:10.818 INFO:tasks.workunit.client.0.smithi098.stdout:4/781: dread d6/db/f2f [4194304,4194304] 0 2024-09-13T02:53:10.820 INFO:tasks.workunit.client.0.smithi098.stdout:0/886: dwrite dd/df/d1d/d26/d28/d32/d67/d71/f5e [0,4194304] 0 2024-09-13T02:53:10.821 INFO:tasks.workunit.client.0.smithi098.stdout:6/756: rename d5/d13/d2b/fb0 to d5/d13/fff 0 2024-09-13T02:53:10.825 INFO:tasks.workunit.client.0.smithi098.stdout:8/791: getdents d2/d2f/d78/d46/d74/d86/da8/de7 0 2024-09-13T02:53:10.828 INFO:tasks.workunit.client.0.smithi098.stdout:3/837: rmdir d7/d9/d15/d2d/db8/d7c/dd9 0 2024-09-13T02:53:10.830 INFO:tasks.workunit.client.0.smithi098.stdout:5/815: unlink d0/d38/d3f/d81/d4d/d82/ff6 0 2024-09-13T02:53:10.835 INFO:tasks.workunit.client.0.smithi098.stdout:1/988: creat d9/f15e x:0 0 0 2024-09-13T02:53:10.839 INFO:tasks.workunit.client.0.smithi098.stdout:9/926: getdents d2/d6/d2b/d4d/d56/dbc 0 2024-09-13T02:53:10.840 INFO:tasks.workunit.client.0.smithi098.stdout:9/927: chown d2/d6/d2b/c5e 1 1 2024-09-13T02:53:10.841 INFO:tasks.workunit.client.0.smithi098.stdout:3/838: dread d7/d9/d15/f49 [0,4194304] 0 2024-09-13T02:53:10.847 INFO:tasks.workunit.client.0.smithi098.stdout:2/843: getdents d1/d1f/d39/df6/d7f 0 2024-09-13T02:53:10.851 INFO:tasks.workunit.client.0.smithi098.stdout:0/887: symlink dd/l135 0 2024-09-13T02:53:10.853 INFO:tasks.workunit.client.0.smithi098.stdout:8/792: creat d2/d28/d43/d88/d99/dec/fff x:0 0 0 2024-09-13T02:53:10.857 INFO:tasks.workunit.client.0.smithi098.stdout:3/839: read d7/d9/d15/d2d/d5b/f9e [1107166,71123] 0 2024-09-13T02:53:10.859 INFO:tasks.workunit.client.0.smithi098.stdout:3/840: write d7/d9/d15/d2d/db8/d52/f55 [2269328,75922] 0 2024-09-13T02:53:10.860 INFO:tasks.workunit.client.0.smithi098.stdout:2/844: unlink d1/d1f/d27/fe7 0 2024-09-13T02:53:10.860 INFO:tasks.workunit.client.0.smithi098.stdout:3/841: truncate d7/d9/d15/d5d/fa8 5128264 0 2024-09-13T02:53:10.863 INFO:tasks.workunit.client.0.smithi098.stdout:1/989: unlink d9/d33/d19/d35/d68/c15b 0 2024-09-13T02:53:10.864 INFO:tasks.workunit.client.0.smithi098.stdout:1/990: readlink d9/d33/d19/d102/l10e 0 2024-09-13T02:53:10.864 INFO:tasks.workunit.client.0.smithi098.stdout:0/888: truncate dd/d95/fdd 2962728 0 2024-09-13T02:53:10.867 INFO:tasks.workunit.client.0.smithi098.stdout:9/928: dwrite d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/fa6 [0,4194304] 0 2024-09-13T02:53:10.871 INFO:tasks.workunit.client.0.smithi098.stdout:2/845: creat d1/da7/db8/f114 x:0 0 0 2024-09-13T02:53:10.874 INFO:tasks.workunit.client.0.smithi098.stdout:6/757: link d5/d13/d2b/d3a/d14/f29 d5/d18/d50/f100 0 2024-09-13T02:53:10.875 INFO:tasks.workunit.client.0.smithi098.stdout:6/758: dread - d5/d13/d2b/d3a/d41/d55/fed zero size 2024-09-13T02:53:10.876 INFO:tasks.workunit.client.0.smithi098.stdout:3/842: dread d7/d9/d15/d2d/d78/d7e/fb5 [0,4194304] 0 2024-09-13T02:53:10.876 INFO:tasks.workunit.client.0.smithi098.stdout:8/793: rename d2/dd/d4d/cb8 to d2/d28/d43/d88/d99/c100 0 2024-09-13T02:53:10.879 INFO:tasks.workunit.client.0.smithi098.stdout:5/816: getdents d0 0 2024-09-13T02:53:10.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/929: creat d2/d6/d36/d8d/dc8/f13e x:0 0 0 2024-09-13T02:53:10.884 INFO:tasks.workunit.client.0.smithi098.stdout:4/782: getdents d6/d22/d3d/d41/d58 0 2024-09-13T02:53:10.889 INFO:tasks.workunit.client.0.smithi098.stdout:6/759: symlink d5/d13/d2b/d3a/d41/d7e/l101 0 2024-09-13T02:53:10.891 INFO:tasks.workunit.client.0.smithi098.stdout:8/794: rmdir d2/dd/d11/d1d 39 2024-09-13T02:53:10.892 INFO:tasks.workunit.client.0.smithi098.stdout:3/843: creat d7/d9/d15/d2d/d78/d7e/f109 x:0 0 0 2024-09-13T02:53:10.894 INFO:tasks.workunit.client.0.smithi098.stdout:3/844: write d7/d9/d25/d2b/fed [425781,66624] 0 2024-09-13T02:53:10.896 INFO:tasks.workunit.client.0.smithi098.stdout:5/817: write d0/d15/f87 [1114334,55289] 0 2024-09-13T02:53:10.897 INFO:tasks.workunit.client.0.smithi098.stdout:9/930: mknod d2/d6/d2b/d66/de0/de9/c13f 0 2024-09-13T02:53:10.903 INFO:tasks.workunit.client.0.smithi098.stdout:1/991: rename d9/d33/d19/d102/c149 to d9/d33/d19/d35/d68/d4d/db5/dff/c15f 0 2024-09-13T02:53:10.903 INFO:tasks.workunit.client.0.smithi098.stdout:5/818: dread d0/d38/d3f/f5b [0,4194304] 0 2024-09-13T02:53:10.904 INFO:tasks.workunit.client.0.smithi098.stdout:6/760: fdatasync d5/d13/d51/f60 0 2024-09-13T02:53:10.905 INFO:tasks.workunit.client.0.smithi098.stdout:9/931: dwrite d2/d6/d2b/fa1 [0,4194304] 0 2024-09-13T02:53:10.906 INFO:tasks.workunit.client.0.smithi098.stdout:6/761: chown d5/d13/d67 15070 1 2024-09-13T02:53:10.907 INFO:tasks.workunit.client.0.smithi098.stdout:5/819: chown d0/d29/fd5 0 1 2024-09-13T02:53:10.909 INFO:tasks.workunit.client.0.smithi098.stdout:8/795: mkdir d2/dd/d11/d2c/d101 0 2024-09-13T02:53:10.913 INFO:tasks.workunit.client.0.smithi098.stdout:8/796: readlink d2/d28/la6 0 2024-09-13T02:53:10.919 INFO:tasks.workunit.client.0.smithi098.stdout:1/992: rmdir d9/d33/d29/d11c/d6b 39 2024-09-13T02:53:10.923 INFO:tasks.workunit.client.0.smithi098.stdout:8/797: readlink d2/dd/d11/d1d/l1e 0 2024-09-13T02:53:10.926 INFO:tasks.workunit.client.0.smithi098.stdout:6/762: truncate d5/d13/d51/f54 490814 0 2024-09-13T02:53:10.926 INFO:tasks.workunit.client.0.smithi098.stdout:0/889: dwrite dd/df/d1d/d40/d46/d6b/d109/f111 [0,4194304] 0 2024-09-13T02:53:10.930 INFO:tasks.workunit.client.0.smithi098.stdout:9/932: dwrite d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/fb3 [0,4194304] 0 2024-09-13T02:53:10.933 INFO:tasks.workunit.client.0.smithi098.stdout:2/846: dwrite d1/d1f/d39/df6/d59/d9e/d9f/de0/ff3 [0,4194304] 0 2024-09-13T02:53:10.933 INFO:tasks.workunit.client.0.smithi098.stdout:4/783: rename d6/d37/f72 to d6/d22/d3d/d41/f103 0 2024-09-13T02:53:10.933 INFO:tasks.workunit.client.0.smithi098.stdout:6/763: chown d5/d13/d2b/d3a 24 1 2024-09-13T02:53:10.936 INFO:tasks.workunit.client.0.smithi098.stdout:3/845: dwrite d7/d9/d4c/f81 [4194304,4194304] 0 2024-09-13T02:53:10.939 INFO:tasks.workunit.client.0.smithi098.stdout:2/847: chown d1/d1f/d30/fce 3 1 2024-09-13T02:53:10.940 INFO:tasks.workunit.client.0.smithi098.stdout:3/846: chown d7/d9/d15/f49 496144 1 2024-09-13T02:53:10.942 INFO:tasks.workunit.client.0.smithi098.stdout:8/798: creat d2/d2f/d78/d46/d74/d86/dd2/f102 x:0 0 0 2024-09-13T02:53:10.944 INFO:tasks.workunit.client.0.smithi098.stdout:3/847: write d7/d9/d15/d2d/db8/d51/fc4 [2705205,58173] 0 2024-09-13T02:53:10.946 INFO:tasks.workunit.client.0.smithi098.stdout:0/890: mknod dd/df/d1d/d26/d28/d32/dda/c136 0 2024-09-13T02:53:10.954 INFO:tasks.workunit.client.0.smithi098.stdout:6/764: rename d5/d36/d8c/dbe to d5/d13/d2b/d5b/d102 0 2024-09-13T02:53:10.965 INFO:tasks.workunit.client.0.smithi098.stdout:3/848: creat d7/d9/d4c/f10a x:0 0 0 2024-09-13T02:53:10.966 INFO:tasks.workunit.client.0.smithi098.stdout:4/784: mknod d6/d22/d3d/d64/c104 0 2024-09-13T02:53:10.967 INFO:tasks.workunit.client.0.smithi098.stdout:9/933: write d2/d6/d2b/d4d/d4f/d6c/fa5 [4313976,113661] 0 2024-09-13T02:53:10.969 INFO:tasks.workunit.client.0.smithi098.stdout:1/993: dwrite d9/f38 [4194304,4194304] 0 2024-09-13T02:53:10.979 INFO:tasks.workunit.client.0.smithi098.stdout:6/765: mknod d5/d13/d2b/d3a/d41/d6c/d7c/c103 0 2024-09-13T02:53:10.981 INFO:tasks.workunit.client.0.smithi098.stdout:2/848: write d1/d1f/f42 [4637563,103665] 0 2024-09-13T02:53:10.982 INFO:tasks.workunit.client.0.smithi098.stdout:2/849: chown d1/f8 3980 1 2024-09-13T02:53:10.983 INFO:tasks.workunit.client.0.smithi098.stdout:2/850: readlink d1/d1f/d35/d63/d23/l10e 0 2024-09-13T02:53:10.984 INFO:tasks.workunit.client.0.smithi098.stdout:2/851: chown d1/d1f/f107 1978030 1 2024-09-13T02:53:10.986 INFO:tasks.workunit.client.0.smithi098.stdout:2/852: read d1/d1a/f3a [1119000,94400] 0 2024-09-13T02:53:10.990 INFO:tasks.workunit.client.0.smithi098.stdout:0/891: link dd/df/d1d/d26/d28/d32/d8d/ffd dd/df/d1d/d26/d28/d32/f137 0 2024-09-13T02:53:10.990 INFO:tasks.workunit.client.0.smithi098.stdout:0/892: chown dd 4444 1 2024-09-13T02:53:10.992 INFO:tasks.workunit.client.0.smithi098.stdout:4/785: mknod d6/d22/d3d/d41/d74/d98/c105 0 2024-09-13T02:53:10.992 INFO:tasks.workunit.client.0.smithi098.stdout:0/893: truncate dd/d1f/d85/d9d/dc9/d12a/f12d 569308 0 2024-09-13T02:53:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:6/766: rmdir d5/d36/d8c 39 2024-09-13T02:53:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:3/849: write d7/d9/d15/d2d/d5b/f9e [26231,84153] 0 2024-09-13T02:53:10.999 INFO:tasks.workunit.client.0.smithi098.stdout:0/894: rmdir dd/d1f/d85/d9d/dc2/de4/dc7 39 2024-09-13T02:53:11.002 INFO:tasks.workunit.client.0.smithi098.stdout:1/994: mkdir d9/d33/de6/d61/d160 0 2024-09-13T02:53:11.003 INFO:tasks.workunit.client.0.smithi098.stdout:8/799: getdents d2/d2f/d78 0 2024-09-13T02:53:11.006 INFO:tasks.workunit.client.0.smithi098.stdout:2/853: creat d1/da7/de4/f115 x:0 0 0 2024-09-13T02:53:11.008 INFO:tasks.workunit.client.0.smithi098.stdout:3/850: creat d7/d9/d25/d64/dd5/f10b x:0 0 0 2024-09-13T02:53:11.010 INFO:tasks.workunit.client.0.smithi098.stdout:8/800: fsync d2/d2f/d78/d46/d74/f94 0 2024-09-13T02:53:11.011 INFO:tasks.workunit.client.0.smithi098.stdout:9/934: dwrite d2/d6/d2b/d4d/d56/f121 [0,4194304] 0 2024-09-13T02:53:11.015 INFO:tasks.workunit.client.0.smithi098.stdout:6/767: link d5/d13/d51/f56 d5/d13/d2b/d3a/f104 0 2024-09-13T02:53:11.019 INFO:tasks.workunit.client.0.smithi098.stdout:2/854: chown d1/d1f/d35/d63/lb2 6218286 1 2024-09-13T02:53:11.019 INFO:tasks.workunit.client.0.smithi098.stdout:3/851: dwrite d7/d9/d15/d2d/d5b/f94 [0,4194304] 0 2024-09-13T02:53:11.022 INFO:tasks.workunit.client.0.smithi098.stdout:0/895: rename dd/d1f/c127 to dd/df/d1d/d26/d28/d32/d67/d82/c138 0 2024-09-13T02:53:11.029 INFO:tasks.workunit.client.0.smithi098.stdout:0/896: dwrite dd/df/d1d/d26/d28/d32/dda/d117/fef [0,4194304] 0 2024-09-13T02:53:11.033 INFO:tasks.workunit.client.0.smithi098.stdout:8/801: dwrite d2/d2f/d78/d46/d74/d86/ff9 [0,4194304] 0 2024-09-13T02:53:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:9/935: rename d2/d6/d91/d127/d109 to d2/dfc/d140 0 2024-09-13T02:53:11.041 INFO:tasks.workunit.client.0.smithi098.stdout:6/768: fsync d5/d18/d50/f100 0 2024-09-13T02:53:11.042 INFO:tasks.workunit.client.0.smithi098.stdout:3/852: fsync d7/d9/d15/d26/f84 0 2024-09-13T02:53:11.042 INFO:tasks.workunit.client.0.smithi098.stdout:6/769: read d5/fc [4823209,119531] 0 2024-09-13T02:53:11.044 INFO:tasks.workunit.client.0.smithi098.stdout:6/770: chown d5/d13/d2b/d5b/f89 21475566 1 2024-09-13T02:53:11.045 INFO:tasks.workunit.client.0.smithi098.stdout:1/995: link d9/d33/d19/d35/ff5 d9/d33/f161 0 2024-09-13T02:53:11.052 INFO:tasks.workunit.client.0.smithi098.stdout:1/996: readlink d9/d33/d19/d35/d140/l155 0 2024-09-13T02:53:11.059 INFO:tasks.workunit.client.0.smithi098.stdout:8/802: rename d2/dd/d11/d2c/f7c to d2/d2f/d78/d46/f103 0 2024-09-13T02:53:11.066 INFO:tasks.workunit.client.0.smithi098.stdout:1/997: getdents d9/d33/d19/d35/d140 0 2024-09-13T02:53:11.066 INFO:tasks.workunit.client.0.smithi098.stdout:2/855: write d1/d1f/d35/d63/d72/f9d [4533099,107731] 0 2024-09-13T02:53:11.067 INFO:tasks.workunit.client.0.smithi098.stdout:8/803: truncate d2/d2f/d78/d5d/f98 641784 0 2024-09-13T02:53:11.068 INFO:tasks.workunit.client.0.smithi098.stdout:2/856: write d1/d1f/f107 [137542,2124] 0 2024-09-13T02:53:11.074 INFO:tasks.workunit.client.0.smithi098.stdout:8/804: dwrite d2/dd/fd1 [0,4194304] 0 2024-09-13T02:53:11.080 INFO:tasks.workunit.client.0.smithi098.stdout:1/998: creat d9/f162 x:0 0 0 2024-09-13T02:53:11.082 INFO:tasks.workunit.client.0.smithi098.stdout:8/805: mkdir d2/d28/d43/d88/d104 0 2024-09-13T02:53:11.083 INFO:tasks.workunit.client.0.smithi098.stdout:1/999: mkdir d9/d33/d19/d35/d68/d4d/d163 0 2024-09-13T02:53:11.083 INFO:tasks.workunit.client.0.smithi098.stdout:8/806: stat d2/d2f/d78/d46/d74/d86/da8/fef 0 2024-09-13T02:53:11.089 INFO:tasks.workunit.client.0.smithi098.stdout:0/897: write dd/df/d1d/f2f [1791621,32047] 0 2024-09-13T02:53:11.090 INFO:tasks.workunit.client.0.smithi098.stdout:9/936: dwrite d2/d6/d2b/d66/f78 [0,4194304] 0 2024-09-13T02:53:11.092 INFO:tasks.workunit.client.0.smithi098.stdout:6/771: write d5/d13/d2b/f2d [1176970,128365] 0 2024-09-13T02:53:11.096 INFO:tasks.workunit.client.0.smithi098.stdout:9/937: dread d2/d6/d36/f9f [0,4194304] 0 2024-09-13T02:53:11.097 INFO:tasks.workunit.client.0.smithi098.stdout:0/898: creat dd/db9/f139 x:0 0 0 2024-09-13T02:53:11.106 INFO:tasks.workunit.client.0.smithi098.stdout:3/853: truncate d7/d9/d4c/f81 4793662 0 2024-09-13T02:53:11.107 INFO:tasks.workunit.client.0.smithi098.stdout:3/854: fdatasync d7/d9/d15/d2d/d5b/f94 0 2024-09-13T02:53:11.109 INFO:tasks.workunit.client.0.smithi098.stdout:3/855: dread - d7/d9/d25/d64/dd5/f10b zero size 2024-09-13T02:53:11.109 INFO:tasks.workunit.client.0.smithi098.stdout:0/899: symlink dd/df/d1d/d26/d28/d32/dda/l13a 0 2024-09-13T02:53:11.109 INFO:tasks.workunit.client.0.smithi098.stdout:9/938: creat d2/d6/d36/d8d/dc8/d136/f141 x:0 0 0 2024-09-13T02:53:11.113 INFO:tasks.workunit.client.0.smithi098.stdout:8/807: rename d2/d2f/d78/d46/f103 to d2/d28/d43/d88/d99/dec/f105 0 2024-09-13T02:53:11.114 INFO:tasks.workunit.client.0.smithi098.stdout:0/900: write dd/d1f/d85/d9d/dc2/de4/f87 [579589,111807] 0 2024-09-13T02:53:11.114 INFO:tasks.workunit.client.0.smithi098.stdout:8/808: readlink d2/d28/d43/d88/lfd 0 2024-09-13T02:53:11.117 INFO:tasks.workunit.client.0.smithi098.stdout:6/772: dread d5/d13/d2b/f48 [0,4194304] 0 2024-09-13T02:53:11.118 INFO:tasks.workunit.client.0.smithi098.stdout:8/809: chown d2/dd/d4d/cdd 7031 1 2024-09-13T02:53:11.119 INFO:tasks.workunit.client.0.smithi098.stdout:6/773: chown d5/d36/f6e 10848 1 2024-09-13T02:53:11.121 INFO:tasks.workunit.client.0.smithi098.stdout:3/856: dwrite d7/d9/d25/d64/d6f/f83 [0,4194304] 0 2024-09-13T02:53:11.123 INFO:tasks.workunit.client.0.smithi098.stdout:0/901: rmdir dd/d1f/d85/df5 39 2024-09-13T02:53:11.137 INFO:tasks.workunit.client.0.smithi098.stdout:8/810: creat d2/d2f/d78/dae/f106 x:0 0 0 2024-09-13T02:53:11.140 INFO:tasks.workunit.client.0.smithi098.stdout:3/857: mkdir d7/d9/d15/d5d/da1/dec/d103/d10c 0 2024-09-13T02:53:11.147 INFO:tasks.workunit.client.0.smithi098.stdout:9/939: dread d2/f32 [0,4194304] 0 2024-09-13T02:53:11.149 INFO:tasks.workunit.client.0.smithi098.stdout:2/857: dwrite d1/fe5 [0,4194304] 0 2024-09-13T02:53:11.158 INFO:tasks.workunit.client.0.smithi098.stdout:6/774: creat d5/d36/f105 x:0 0 0 2024-09-13T02:53:11.164 INFO:tasks.workunit.client.0.smithi098.stdout:2/858: dwrite d1/d1f/d35/f4b [4194304,4194304] 0 2024-09-13T02:53:11.173 INFO:tasks.workunit.client.0.smithi098.stdout:6/775: dread d5/d13/d2b/d3a/f104 [0,4194304] 0 2024-09-13T02:53:11.175 INFO:tasks.workunit.client.0.smithi098.stdout:8/811: dread d2/d2f/f31 [0,4194304] 0 2024-09-13T02:53:11.177 INFO:tasks.workunit.client.0.smithi098.stdout:0/902: getdents dd/df/d1d/d40/d46/d6b/d109 0 2024-09-13T02:53:11.189 INFO:tasks.workunit.client.0.smithi098.stdout:8/812: creat d2/d2f/d78/dae/f107 x:0 0 0 2024-09-13T02:53:11.192 INFO:tasks.workunit.client.0.smithi098.stdout:0/903: rmdir dd/d1f/d85/d9d/dc2/de4/d131 39 2024-09-13T02:53:11.193 INFO:tasks.workunit.client.0.smithi098.stdout:6/776: dread d5/d18/f45 [0,4194304] 0 2024-09-13T02:53:11.195 INFO:tasks.workunit.client.0.smithi098.stdout:3/858: dwrite d7/d9/d15/d2d/d34/f97 [0,4194304] 0 2024-09-13T02:53:11.201 INFO:tasks.workunit.client.0.smithi098.stdout:9/940: getdents d2/d6/d36 0 2024-09-13T02:53:11.204 INFO:tasks.workunit.client.0.smithi098.stdout:2/859: dwrite d1/d1f/d39/df6/d7f/fd1 [0,4194304] 0 2024-09-13T02:53:11.204 INFO:tasks.workunit.client.0.smithi098.stdout:0/904: symlink dd/df/d1d/d26/d28/d32/d67/d71/dbd/l13b 0 2024-09-13T02:53:11.207 INFO:tasks.workunit.client.0.smithi098.stdout:0/905: chown dd/df/d1d/d26/d28/d32/dda/d117/dea/f11e 17 1 2024-09-13T02:53:11.207 INFO:tasks.workunit.client.0.smithi098.stdout:3/859: symlink d7/d9/d15/d80/da0/dd4/l10d 0 2024-09-13T02:53:11.209 INFO:tasks.workunit.client.0.smithi098.stdout:8/813: creat d2/d2f/d78/d5d/de3/f108 x:0 0 0 2024-09-13T02:53:11.213 INFO:tasks.workunit.client.0.smithi098.stdout:2/860: mkdir d1/d1f/d39/df6/d116 0 2024-09-13T02:53:11.215 INFO:tasks.workunit.client.0.smithi098.stdout:6/777: write d5/d13/d51/f60 [4969715,80246] 0 2024-09-13T02:53:11.217 INFO:tasks.workunit.client.0.smithi098.stdout:8/814: rename d2/dd/d11/d1d/lf6 to d2/d2f/d78/d46/d74/d86/l109 0 2024-09-13T02:53:11.218 INFO:tasks.workunit.client.0.smithi098.stdout:2/861: creat d1/da7/de4/f117 x:0 0 0 2024-09-13T02:53:11.219 INFO:tasks.workunit.client.0.smithi098.stdout:3/860: mknod d7/d9/d15/c10e 0 2024-09-13T02:53:11.220 INFO:tasks.workunit.client.0.smithi098.stdout:6/778: read d5/d13/d2b/d3a/fa2 [3229320,26943] 0 2024-09-13T02:53:11.221 INFO:tasks.workunit.client.0.smithi098.stdout:0/906: link dd/df/d1d/d26/d28/d32/fe3 dd/d1f/d85/d9d/dc2/de4/d131/f13c 0 2024-09-13T02:53:11.221 INFO:tasks.workunit.client.0.smithi098.stdout:6/779: read - d5/d13/d2b/d3a/d41/d55/fed zero size 2024-09-13T02:53:11.223 INFO:tasks.workunit.client.0.smithi098.stdout:6/780: readlink d5/d13/d2b/d3a/d41/l9b 0 2024-09-13T02:53:11.224 INFO:tasks.workunit.client.0.smithi098.stdout:6/781: dread - d5/d13/d2b/d3a/d41/d6c/fcd zero size 2024-09-13T02:53:11.226 INFO:tasks.workunit.client.0.smithi098.stdout:9/941: write d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/fee [573617,48373] 0 2024-09-13T02:53:11.227 INFO:tasks.workunit.client.0.smithi098.stdout:8/815: read - d2/dd/d2e/fce zero size 2024-09-13T02:53:11.228 INFO:tasks.workunit.client.0.smithi098.stdout:0/907: creat dd/d1f/d85/dfc/f13d x:0 0 0 2024-09-13T02:53:11.234 INFO:tasks.workunit.client.0.smithi098.stdout:9/942: fdatasync d2/d6/d2b/d4d/d56/db9/ffa 0 2024-09-13T02:53:11.236 INFO:tasks.workunit.client.0.smithi098.stdout:2/862: write d1/d1f/d36/f52 [2882290,33095] 0 2024-09-13T02:53:11.237 INFO:tasks.workunit.client.0.smithi098.stdout:3/861: write d7/d9/d15/d5d/da1/fae [1465708,47123] 0 2024-09-13T02:53:11.247 INFO:tasks.workunit.client.0.smithi098.stdout:9/943: write d2/d6/d2b/d4d/d4f/d6c/dd4/f5a [445072,43801] 0 2024-09-13T02:53:11.248 INFO:tasks.workunit.client.0.smithi098.stdout:0/908: dread dd/d1f/f25 [0,4194304] 0 2024-09-13T02:53:11.251 INFO:tasks.workunit.client.0.smithi098.stdout:6/782: dread d5/d18/f3c [0,4194304] 0 2024-09-13T02:53:11.278 INFO:tasks.workunit.client.0.smithi098.stdout:9/944: mknod d2/d6/d2b/d66/de0/de9/c142 0 2024-09-13T02:53:11.279 INFO:tasks.workunit.client.0.smithi098.stdout:0/909: creat dd/df/d1d/d40/d46/d6b/f13e x:0 0 0 2024-09-13T02:53:11.281 INFO:tasks.workunit.client.0.smithi098.stdout:2/863: creat d1/d1f/f118 x:0 0 0 2024-09-13T02:53:11.282 INFO:tasks.workunit.client.0.smithi098.stdout:6/783: mknod d5/d36/d8c/c106 0 2024-09-13T02:53:11.284 INFO:tasks.workunit.client.0.smithi098.stdout:0/910: rename dd/df/d1d/d26/d28/d32/d8d/d113 to dd/d1f/d85/d9d/dc2/d13f 0 2024-09-13T02:53:11.286 INFO:tasks.workunit.client.0.smithi098.stdout:9/945: symlink d2/d6/l143 0 2024-09-13T02:53:11.288 INFO:tasks.workunit.client.0.smithi098.stdout:6/784: mknod d5/d13/d2b/d3a/d5a/da8/c107 0 2024-09-13T02:53:11.290 INFO:tasks.workunit.client.0.smithi098.stdout:9/946: rmdir d2/d6/d2b/d4d/d56/db9/ddf 39 2024-09-13T02:53:11.292 INFO:tasks.workunit.client.0.smithi098.stdout:6/785: creat d5/d6f/f108 x:0 0 0 2024-09-13T02:53:11.294 INFO:tasks.workunit.client.0.smithi098.stdout:9/947: mkdir d2/d6/d2b/d4d/d4f/d6c/d144 0 2024-09-13T02:53:11.296 INFO:tasks.workunit.client.0.smithi098.stdout:2/864: rmdir d1/d1f/d39/df6/d59/d9e/d9f/dc1/dff 0 2024-09-13T02:53:11.299 INFO:tasks.workunit.client.0.smithi098.stdout:6/786: dwrite d5/d13/d2b/d3a/d41/d7e/f7d [0,4194304] 0 2024-09-13T02:53:11.303 INFO:tasks.workunit.client.0.smithi098.stdout:9/948: rename d2/d6/d36/c52 to d2/d6/d2b/d4d/d4f/d6c/c145 0 2024-09-13T02:53:11.308 INFO:tasks.workunit.client.0.smithi098.stdout:2/865: symlink d1/d1f/d30/def/df0/l119 0 2024-09-13T02:53:11.309 INFO:tasks.workunit.client.0.smithi098.stdout:2/866: chown d1/d1f/d35/f45 8397 1 2024-09-13T02:53:11.309 INFO:tasks.workunit.client.0.smithi098.stdout:3/862: write d7/d9/d15/f63 [400857,60397] 0 2024-09-13T02:53:11.316 INFO:tasks.workunit.client.0.smithi098.stdout:3/863: dwrite d7/d9/d15/d2d/d5b/f46 [0,4194304] 0 2024-09-13T02:53:11.320 INFO:tasks.workunit.client.0.smithi098.stdout:0/911: getdents dd/d1f/d85/d9d/dc2 0 2024-09-13T02:53:11.324 INFO:tasks.workunit.client.0.smithi098.stdout:3/864: creat d7/d9/d15/d2d/d78/d7e/f10f x:0 0 0 2024-09-13T02:53:11.326 INFO:tasks.workunit.client.0.smithi098.stdout:0/912: mkdir dd/db9/dd7/d140 0 2024-09-13T02:53:11.327 INFO:tasks.workunit.client.0.smithi098.stdout:9/949: truncate d2/d6/d2b/d4d/fe6 185533 0 2024-09-13T02:53:11.328 INFO:tasks.workunit.client.0.smithi098.stdout:6/787: getdents d5/d13/d2b/d3a/d14/d6b/d9a/da5 0 2024-09-13T02:53:11.330 INFO:tasks.workunit.client.0.smithi098.stdout:3/865: symlink d7/d9/d15/d2d/d78/l110 0 2024-09-13T02:53:11.333 INFO:tasks.workunit.client.0.smithi098.stdout:0/913: creat dd/df/d1d/da7/f141 x:0 0 0 2024-09-13T02:53:11.335 INFO:tasks.workunit.client.0.smithi098.stdout:9/950: unlink d2/db1/dc5/fda 0 2024-09-13T02:53:11.335 INFO:tasks.workunit.client.0.smithi098.stdout:2/867: rmdir d1 39 2024-09-13T02:53:11.338 INFO:tasks.workunit.client.0.smithi098.stdout:3/866: rmdir d7/d9/d15/d80/da0 39 2024-09-13T02:53:11.342 INFO:tasks.workunit.client.0.smithi098.stdout:0/914: dread dd/df/d1d/da7/fb5 [0,4194304] 0 2024-09-13T02:53:11.343 INFO:tasks.workunit.client.0.smithi098.stdout:0/915: fsync dd/df/d1d/d40/d46/fad 0 2024-09-13T02:53:11.351 INFO:tasks.workunit.client.0.smithi098.stdout:6/788: dwrite d5/d18/f2a [0,4194304] 0 2024-09-13T02:53:11.353 INFO:tasks.workunit.client.0.smithi098.stdout:3/867: write d7/d9/d15/d2d/d78/f98 [367543,3404] 0 2024-09-13T02:53:11.355 INFO:tasks.workunit.client.0.smithi098.stdout:0/916: read - dd/d1f/d85/d9d/dc2/de4/fe7 zero size 2024-09-13T02:53:11.356 INFO:tasks.workunit.client.0.smithi098.stdout:9/951: readlink d2/d6/d36/da7/lae 0 2024-09-13T02:53:11.356 INFO:tasks.workunit.client.0.smithi098.stdout:0/917: stat dd/fb4 0 2024-09-13T02:53:11.362 INFO:tasks.workunit.client.0.smithi098.stdout:2/868: rename d1/d1f/d35/d63/lb2 to d1/l11a 0 2024-09-13T02:53:11.363 INFO:tasks.workunit.client.0.smithi098.stdout:0/918: creat dd/df/d1d/d26/d28/d32/d67/d71/dbd/f142 x:0 0 0 2024-09-13T02:53:11.364 INFO:tasks.workunit.client.0.smithi098.stdout:0/919: read - dd/df/d1d/d26/d28/fe1 zero size 2024-09-13T02:53:11.366 INFO:tasks.workunit.client.0.smithi098.stdout:0/920: mkdir dd/d1f/d85/d9d/dc9/d143 0 2024-09-13T02:53:11.369 INFO:tasks.workunit.client.0.smithi098.stdout:3/868: truncate d7/d9/d15/d2d/d5b/f46 816120 0 2024-09-13T02:53:11.369 INFO:tasks.workunit.client.0.smithi098.stdout:0/921: fdatasync dd/df/d1d/d26/d28/d32/dda/d117/dea/f114 0 2024-09-13T02:53:11.371 INFO:tasks.workunit.client.0.smithi098.stdout:9/952: dwrite d2/d6/d2b/d4d/d56/dbc/fe2 [0,4194304] 0 2024-09-13T02:53:11.372 INFO:tasks.workunit.client.0.smithi098.stdout:2/869: dread d1/d1f/d35/d63/f3f [0,4194304] 0 2024-09-13T02:53:11.380 INFO:tasks.workunit.client.0.smithi098.stdout:9/953: creat d2/d6/d2b/d4d/d56/dbc/f146 x:0 0 0 2024-09-13T02:53:11.380 INFO:tasks.workunit.client.0.smithi098.stdout:6/789: dread d5/d36/f8e [0,4194304] 0 2024-09-13T02:53:11.385 INFO:tasks.workunit.client.0.smithi098.stdout:9/954: mknod d2/db1/dc5/c147 0 2024-09-13T02:53:11.387 INFO:tasks.workunit.client.0.smithi098.stdout:6/790: unlink d5/d13/d2b/d3a/f104 0 2024-09-13T02:53:11.388 INFO:tasks.workunit.client.0.smithi098.stdout:0/922: getdents dd/df/d1d/d26/d28/d32/d67 0 2024-09-13T02:53:11.391 INFO:tasks.workunit.client.0.smithi098.stdout:9/955: rename d2/d6/d2b/d4d/d4f/d6c/f81 to d2/d6/d36/d6a/f148 0 2024-09-13T02:53:11.396 INFO:tasks.workunit.client.0.smithi098.stdout:9/956: symlink d2/d6/d36/d8d/dc8/d136/l149 0 2024-09-13T02:53:11.397 INFO:tasks.workunit.client.0.smithi098.stdout:9/957: fdatasync d2/d6/d2b/d4d/d56/f99 0 2024-09-13T02:53:11.400 INFO:tasks.workunit.client.0.smithi098.stdout:0/923: truncate dd/d1f/d85/d9d/dc9/f116 100671 0 2024-09-13T02:53:11.401 INFO:tasks.workunit.client.0.smithi098.stdout:0/924: dread - dd/d1f/d85/d9d/dc2/de4/fe7 zero size 2024-09-13T02:53:11.401 INFO:tasks.workunit.client.0.smithi098.stdout:0/925: dread - dd/df/d1d/da7/f141 zero size 2024-09-13T02:53:11.407 INFO:tasks.workunit.client.0.smithi098.stdout:0/926: rename dd/df/d1d/d40/d9b/d112 to dd/d1f/d85/df5/d144 0 2024-09-13T02:53:11.410 INFO:tasks.workunit.client.0.smithi098.stdout:0/927: dread dd/df/d1d/d26/d28/d5d/f66 [0,4194304] 0 2024-09-13T02:53:11.427 INFO:tasks.workunit.client.0.smithi098.stdout:3/869: dread d7/d9/d15/d26/f84 [0,4194304] 0 2024-09-13T02:53:11.430 INFO:tasks.workunit.client.0.smithi098.stdout:3/870: creat d7/d9/d15/d2d/db8/d51/f111 x:0 0 0 2024-09-13T02:53:11.435 INFO:tasks.workunit.client.0.smithi098.stdout:3/871: mkdir d7/d9/d25/d112 0 2024-09-13T02:53:11.435 INFO:tasks.workunit.client.0.smithi098.stdout:0/928: dread dd/d95/fdd [0,4194304] 0 2024-09-13T02:53:11.438 INFO:tasks.workunit.client.0.smithi098.stdout:3/872: unlink d7/d9/d15/d2d/d78/d7e/la9 0 2024-09-13T02:53:11.439 INFO:tasks.workunit.client.0.smithi098.stdout:3/873: readlink d7/d9/d15/d2d/lad 0 2024-09-13T02:53:11.439 INFO:tasks.workunit.client.0.smithi098.stdout:0/929: symlink dd/d1f/d85/d9d/dc9/d12a/l145 0 2024-09-13T02:53:11.440 INFO:tasks.workunit.client.0.smithi098.stdout:3/874: chown d7/d9/d15/d2d/db8/d52/f3b 397010339 1 2024-09-13T02:53:11.441 INFO:tasks.workunit.client.0.smithi098.stdout:3/875: readlink d7/d9/d15/d80/da0/lde 0 2024-09-13T02:53:11.444 INFO:tasks.workunit.client.0.smithi098.stdout:3/876: getdents d7/d9/d15/d2d/db8/d7c 0 2024-09-13T02:53:11.445 INFO:tasks.workunit.client.0.smithi098.stdout:3/877: chown d7/d9/cd 1022754941 1 2024-09-13T02:53:11.448 INFO:tasks.workunit.client.0.smithi098.stdout:3/878: rename d7/d9/d25/d112 to d7/d9/d15/d2d/d34/d113 0 2024-09-13T02:53:11.450 INFO:tasks.workunit.client.0.smithi098.stdout:3/879: dread - d7/d9/fda zero size 2024-09-13T02:53:11.452 INFO:tasks.workunit.client.0.smithi098.stdout:3/880: mknod d7/d9/d15/d2d/d5b/d70/d90/c114 0 2024-09-13T02:53:11.454 INFO:tasks.workunit.client.0.smithi098.stdout:3/881: read d7/f3d [3921438,109853] 0 2024-09-13T02:53:11.467 INFO:tasks.workunit.client.0.smithi098.stdout:3/882: dread d7/d9/d15/f23 [0,4194304] 0 2024-09-13T02:53:11.470 INFO:tasks.workunit.client.0.smithi098.stdout:3/883: rename d7/d9/d15/d5d/lc5 to d7/d9/d15/l115 0 2024-09-13T02:53:11.472 INFO:tasks.workunit.client.0.smithi098.stdout:3/884: mkdir d7/d9/d15/d5d/da1/d116 0 2024-09-13T02:53:11.474 INFO:tasks.workunit.client.0.smithi098.stdout:3/885: fsync d7/d9/d15/d5d/fba 0 2024-09-13T02:53:11.477 INFO:tasks.workunit.client.0.smithi098.stdout:3/886: fdatasync d7/d9/d15/d2d/db8/d52/f28 0 2024-09-13T02:53:11.484 INFO:tasks.workunit.client.0.smithi098.stdout:3/887: write d7/d9/d15/d2d/db8/d52/f8a [4269470,121858] 0 2024-09-13T02:53:11.484 INFO:tasks.workunit.client.0.smithi098.stdout:3/888: readlink d7/d9/d15/d2d/db8/d52/l59 0 2024-09-13T02:53:11.492 INFO:tasks.workunit.client.0.smithi098.stdout:3/889: dwrite d7/d9/d15/f49 [0,4194304] 0 2024-09-13T02:53:11.495 INFO:tasks.workunit.client.0.smithi098.stdout:3/890: symlink d7/d9/d25/d64/d6f/l117 0 2024-09-13T02:53:11.498 INFO:tasks.workunit.client.0.smithi098.stdout:3/891: readlink d7/d9/d15/d2d/d34/le6 0 2024-09-13T02:53:11.500 INFO:tasks.workunit.client.0.smithi098.stdout:3/892: creat d7/d9/d15/d5d/da1/f118 x:0 0 0 2024-09-13T02:53:11.503 INFO:tasks.workunit.client.0.smithi098.stdout:3/893: creat d7/d9/d15/d5d/da1/dec/f119 x:0 0 0 2024-09-13T02:53:11.505 INFO:tasks.workunit.client.0.smithi098.stdout:3/894: truncate d7/d9/d15/f82 2822108 0 2024-09-13T02:53:11.517 INFO:tasks.workunit.client.0.smithi098.stdout:3/895: dwrite d7/d9/d15/d2d/d78/fa7 [0,4194304] 0 2024-09-13T02:53:11.518 INFO:tasks.workunit.client.0.smithi098.stdout:3/896: write d7/d9/d15/d2d/d5b/f94 [4069954,8903] 0 2024-09-13T02:53:11.527 INFO:tasks.workunit.client.0.smithi098.stdout:3/897: write d7/d9/d15/d26/f84 [2576260,57252] 0 2024-09-13T02:53:11.528 INFO:tasks.workunit.client.0.smithi098.stdout:3/898: chown d7/d9/d15/d2d/d78/d7e 1 1 2024-09-13T02:53:11.536 INFO:tasks.workunit.client.0.smithi098.stdout:3/899: dwrite d7/d9/d25/d2b/fb1 [0,4194304] 0 2024-09-13T02:53:11.537 INFO:tasks.workunit.client.0.smithi098.stdout:3/900: dread - d7/d9/d15/d2d/d34/f99 zero size 2024-09-13T02:53:11.538 INFO:tasks.workunit.client.0.smithi098.stdout:3/901: stat d7/d9/d15/d2d/d34/f97 0 2024-09-13T02:53:11.544 INFO:tasks.workunit.client.0.smithi098.stdout:3/902: dwrite d7/d9/d25/d64/dd5/f10b [0,4194304] 0 2024-09-13T02:53:11.570 INFO:tasks.workunit.client.0.smithi098.stdout:3/903: dread d7/f3d [4194304,4194304] 0 2024-09-13T02:53:11.573 INFO:tasks.workunit.client.0.smithi098.stdout:3/904: unlink d7/d9/d15/d2d/d78/d7e/f109 0 2024-09-13T02:53:11.574 INFO:tasks.workunit.client.0.smithi098.stdout:3/905: chown d7/d9/d15/d80/da0/lde 24553162 1 2024-09-13T02:53:11.575 INFO:tasks.workunit.client.0.smithi098.stdout:3/906: truncate d7/d9/d15/d2d/d78/d7e/f10f 655719 0 2024-09-13T02:53:11.590 INFO:tasks.workunit.client.0.smithi098.stdout:3/907: write d7/d9/d15/d26/f6e [710283,82077] 0 2024-09-13T02:53:11.594 INFO:tasks.workunit.client.0.smithi098.stdout:3/908: mknod d7/d9/d25/d2b/c11a 0 2024-09-13T02:53:11.596 INFO:tasks.workunit.client.0.smithi098.stdout:3/909: dread d7/d9/d15/f7d [0,4194304] 0 2024-09-13T02:53:11.597 INFO:tasks.workunit.client.0.smithi098.stdout:3/910: read d7/d9/d25/d2b/fb1 [2584657,42541] 0 2024-09-13T02:53:11.600 INFO:tasks.workunit.client.0.smithi098.stdout:3/911: mknod d7/d9/d25/d64/dd5/c11b 0 2024-09-13T02:53:11.603 INFO:tasks.workunit.client.0.smithi098.stdout:3/912: symlink d7/d9/d25/d64/dd5/l11c 0 2024-09-13T02:53:11.612 INFO:tasks.workunit.client.0.smithi098.stdout:3/913: dwrite d7/f3d [4194304,4194304] 0 2024-09-13T02:53:11.617 INFO:tasks.workunit.client.0.smithi098.stdout:3/914: creat d7/d9/d15/d2d/db8/f11d x:0 0 0 2024-09-13T02:53:11.618 INFO:tasks.workunit.client.0.smithi098.stdout:3/915: read d7/f43 [3202232,19915] 0 2024-09-13T02:53:11.619 INFO:tasks.workunit.client.0.smithi098.stdout:5/820: sync 2024-09-13T02:53:11.620 INFO:tasks.workunit.client.0.smithi098.stdout:5/821: chown d0/d38/d3f/fc5 3980 1 2024-09-13T02:53:11.623 INFO:tasks.workunit.client.0.smithi098.stdout:5/822: creat d0/d38/d3f/d1a/d27/f112 x:0 0 0 2024-09-13T02:53:11.624 INFO:tasks.workunit.client.0.smithi098.stdout:3/916: link d7/d9/d15/d5d/da1/fd8 d7/d9/d15/f11e 0 2024-09-13T02:53:11.626 INFO:tasks.workunit.client.0.smithi098.stdout:5/823: truncate d0/d29/fd5 605969 0 2024-09-13T02:53:11.629 INFO:tasks.workunit.client.0.smithi098.stdout:5/824: mkdir d0/d15/d50/dd3/d113 0 2024-09-13T02:53:11.630 INFO:tasks.workunit.client.0.smithi098.stdout:3/917: creat d7/d9/d15/d5d/da1/d116/f11f x:0 0 0 2024-09-13T02:53:11.630 INFO:tasks.workunit.client.0.smithi098.stdout:3/918: fsync d7/d9/d15/d80/fc8 0 2024-09-13T02:53:11.634 INFO:tasks.workunit.client.0.smithi098.stdout:3/919: mknod d7/d9/d15/d2d/d5b/d70/d90/c120 0 2024-09-13T02:53:11.636 INFO:tasks.workunit.client.0.smithi098.stdout:5/825: dwrite d0/d38/d3f/f84 [0,4194304] 0 2024-09-13T02:53:11.641 INFO:tasks.workunit.client.0.smithi098.stdout:3/920: getdents d7/d9/d15/d5d/da1 0 2024-09-13T02:53:11.643 INFO:tasks.workunit.client.0.smithi098.stdout:3/921: truncate d7/d9/d25/d64/d6f/f83 5024671 0 2024-09-13T02:53:11.646 INFO:tasks.workunit.client.0.smithi098.stdout:3/922: chown d7/d9/d25/lfb 252205 1 2024-09-13T02:53:11.648 INFO:tasks.workunit.client.0.smithi098.stdout:3/923: truncate d7/d9/d15/d2d/f100 717128 0 2024-09-13T02:53:11.651 INFO:tasks.workunit.client.0.smithi098.stdout:3/924: chown d7/d9/d15/d2d/f6b 48898196 1 2024-09-13T02:53:11.661 INFO:tasks.workunit.client.0.smithi098.stdout:5/826: dread d0/d38/d3f/d81/d4d/d82/f93 [0,4194304] 0 2024-09-13T02:53:11.665 INFO:tasks.workunit.client.0.smithi098.stdout:3/925: dwrite d7/fbf [0,4194304] 0 2024-09-13T02:53:11.669 INFO:tasks.workunit.client.0.smithi098.stdout:5/827: dwrite d0/d15/f87 [0,4194304] 0 2024-09-13T02:53:11.674 INFO:tasks.workunit.client.0.smithi098.stdout:3/926: dwrite d7/d9/d4c/f10a [0,4194304] 0 2024-09-13T02:53:11.676 INFO:tasks.workunit.client.0.smithi098.stdout:5/828: mknod d0/d15/d50/dd3/d113/c114 0 2024-09-13T02:53:11.683 INFO:tasks.workunit.client.0.smithi098.stdout:3/927: dread d7/d9/d15/d2d/d34/f97 [0,4194304] 0 2024-09-13T02:53:11.684 INFO:tasks.workunit.client.0.smithi098.stdout:5/829: rename d0/d15/d17/d1c/d3d/l92 to d0/d15/d69/dfa/l115 0 2024-09-13T02:53:11.699 INFO:tasks.workunit.client.0.smithi098.stdout:3/928: write d7/d9/d25/d2b/f75 [1637206,119186] 0 2024-09-13T02:53:11.703 INFO:tasks.workunit.client.0.smithi098.stdout:3/929: rename d7/d9/d15/d2d/db8/f44 to d7/d9/d15/d2d/db8/d51/d9c/f121 0 2024-09-13T02:53:11.718 INFO:tasks.workunit.client.0.smithi098.stdout:3/930: dread d7/d9/d15/d80/ff8 [0,4194304] 0 2024-09-13T02:53:11.719 INFO:tasks.workunit.client.0.smithi098.stdout:3/931: write d7/d9/d15/d26/f2a [1107244,94586] 0 2024-09-13T02:53:11.722 INFO:tasks.workunit.client.0.smithi098.stdout:3/932: mknod d7/d9/d25/c122 0 2024-09-13T02:53:11.723 INFO:tasks.workunit.client.0.smithi098.stdout:3/933: write d7/d9/d15/d5d/dc3/feb [1246600,89959] 0 2024-09-13T02:53:11.736 INFO:tasks.workunit.client.0.smithi098.stdout:3/934: dread d7/d9/d25/d2b/f2c [0,4194304] 0 2024-09-13T02:53:11.740 INFO:tasks.workunit.client.0.smithi098.stdout:3/935: mknod d7/d9/d15/d2d/d78/d7e/d8e/df9/c123 0 2024-09-13T02:53:11.742 INFO:tasks.workunit.client.0.smithi098.stdout:3/936: dread d7/d9/d15/d80/fc8 [0,4194304] 0 2024-09-13T02:53:11.743 INFO:tasks.workunit.client.0.smithi098.stdout:3/937: fdatasync d7/d9/d15/d2d/db8/d52/f3b 0 2024-09-13T02:53:11.743 INFO:tasks.workunit.client.0.smithi098.stdout:3/938: chown d7/d9/d15/d2d/cb9 19657 1 2024-09-13T02:53:11.744 INFO:tasks.workunit.client.0.smithi098.stdout:3/939: fsync d7/f8c 0 2024-09-13T02:53:11.747 INFO:tasks.workunit.client.0.smithi098.stdout:3/940: unlink d7/d9/d15/d2d/d34/f97 0 2024-09-13T02:53:11.756 INFO:tasks.workunit.client.0.smithi098.stdout:3/941: write d7/d9/d15/d2d/d34/f99 [18969,88886] 0 2024-09-13T02:53:11.757 INFO:tasks.workunit.client.0.smithi098.stdout:3/942: chown d7/d9/d15/d2d/d5b/d70 135 1 2024-09-13T02:53:11.760 INFO:tasks.workunit.client.0.smithi098.stdout:3/943: read d7/d9/d15/d2d/d78/fac [3736586,30826] 0 2024-09-13T02:53:11.762 INFO:tasks.workunit.client.0.smithi098.stdout:3/944: rmdir d7/d9/d15/d80/da0/dd4 39 2024-09-13T02:53:11.769 INFO:tasks.workunit.client.0.smithi098.stdout:3/945: dwrite d7/d9/d25/d2b/fa2 [0,4194304] 0 2024-09-13T02:53:11.782 INFO:tasks.workunit.client.0.smithi098.stdout:3/946: dwrite d7/d9/d15/d2d/f6b [0,4194304] 0 2024-09-13T02:53:11.789 INFO:tasks.workunit.client.0.smithi098.stdout:3/947: dwrite d7/d9/d15/f49 [0,4194304] 0 2024-09-13T02:53:11.794 INFO:tasks.workunit.client.0.smithi098.stdout:3/948: creat d7/d9/d15/d5d/f124 x:0 0 0 2024-09-13T02:53:11.799 INFO:tasks.workunit.client.0.smithi098.stdout:3/949: creat d7/d9/d15/d2d/f125 x:0 0 0 2024-09-13T02:53:11.801 INFO:tasks.workunit.client.0.smithi098.stdout:3/950: mknod d7/d9/c126 0 2024-09-13T02:53:11.816 INFO:tasks.workunit.client.0.smithi098.stdout:3/951: dread d7/f8c [0,4194304] 0 2024-09-13T02:53:11.819 INFO:tasks.workunit.client.0.smithi098.stdout:3/952: truncate d7/d9/d15/f23 1863992 0 2024-09-13T02:53:11.821 INFO:tasks.workunit.client.0.smithi098.stdout:3/953: read d7/d9/d15/f82 [1719138,34664] 0 2024-09-13T02:53:11.827 INFO:tasks.workunit.client.0.smithi098.stdout:3/954: getdents d7 0 2024-09-13T02:53:11.827 INFO:tasks.workunit.client.0.smithi098.stdout:3/955: readlink d7/l9d 0 2024-09-13T02:53:11.828 INFO:tasks.workunit.client.0.smithi098.stdout:3/956: chown d7/d9/d15/d2d/cea 99074586 1 2024-09-13T02:53:11.837 INFO:tasks.workunit.client.0.smithi098.stdout:3/957: getdents d7/d9/d15/d80/da0 0 2024-09-13T02:53:11.847 INFO:tasks.workunit.client.0.smithi098.stdout:3/958: dread d7/d9/d15/d5d/f65 [4194304,4194304] 0 2024-09-13T02:53:11.847 INFO:tasks.workunit.client.0.smithi098.stdout:3/959: fdatasync d7/d9/d15/d80/fc8 0 2024-09-13T02:53:11.850 INFO:tasks.workunit.client.0.smithi098.stdout:3/960: rename d7/d9/d15/d2d/db8/d51/d9c/caf to d7/d9/d15/d26/d101/c127 0 2024-09-13T02:53:11.854 INFO:tasks.workunit.client.0.smithi098.stdout:3/961: dread d7/d9/d15/d2d/d78/f98 [0,4194304] 0 2024-09-13T02:53:11.858 INFO:tasks.workunit.client.0.smithi098.stdout:3/962: link d7/d9/d25/lf6 d7/d9/l128 0 2024-09-13T02:53:11.876 INFO:tasks.workunit.client.0.smithi098.stdout:3/963: write d7/d9/d15/d5d/fa8 [1011612,77749] 0 2024-09-13T02:53:11.876 INFO:tasks.workunit.client.0.smithi098.stdout:3/964: readlink d7/d9/d25/lfb 0 2024-09-13T02:53:11.878 INFO:tasks.workunit.client.0.smithi098.stdout:3/965: readlink d7/d9/d15/d2d/d78/d7e/lc9 0 2024-09-13T02:53:11.880 INFO:tasks.workunit.client.0.smithi098.stdout:3/966: fsync d7/d9/d15/f23 0 2024-09-13T02:53:11.882 INFO:tasks.workunit.client.0.smithi098.stdout:3/967: readlink d7/d9/l128 0 2024-09-13T02:53:11.883 INFO:tasks.workunit.client.0.smithi098.stdout:3/968: fsync d7/d9/d15/d2d/db8/d51/f66 0 2024-09-13T02:53:11.885 INFO:tasks.workunit.client.0.smithi098.stdout:3/969: mknod d7/d9/d15/d2d/d5b/d70/d90/c129 0 2024-09-13T02:53:11.887 INFO:tasks.workunit.client.0.smithi098.stdout:3/970: chown d7/d9/d15/d2d/c6d 143 1 2024-09-13T02:53:11.892 INFO:tasks.workunit.client.0.smithi098.stdout:3/971: rename d7/d9/d15/d2d/db8/d51/d9c/fce to d7/d9/d15/d2d/d5b/d70/d90/f12a 0 2024-09-13T02:53:11.893 INFO:tasks.workunit.client.0.smithi098.stdout:3/972: rename d7/d9/d15/d2d/l74 to d7/l12b 0 2024-09-13T02:53:11.961 INFO:tasks.workunit.client.0.smithi098.stdout:4/786: sync 2024-09-13T02:53:11.964 INFO:tasks.workunit.client.0.smithi098.stdout:3/973: creat d7/d9/d15/d26/f12c x:0 0 0 2024-09-13T02:53:11.966 INFO:tasks.workunit.client.0.smithi098.stdout:4/787: unlink d6/d22/d3d/d41/d74/lc6 0 2024-09-13T02:53:11.969 INFO:tasks.workunit.client.0.smithi098.stdout:4/788: truncate d6/d37/f39 4989912 0 2024-09-13T02:53:11.971 INFO:tasks.workunit.client.0.smithi098.stdout:3/974: dwrite d7/d9/d15/d2d/db8/d51/d9c/fb2 [4194304,4194304] 0 2024-09-13T02:53:11.972 INFO:tasks.workunit.client.0.smithi098.stdout:4/789: truncate d6/d10/d21/f32 693372 0 2024-09-13T02:53:11.974 INFO:tasks.workunit.client.0.smithi098.stdout:4/790: write d6/d22/d3d/d41/fe8 [297283,118483] 0 2024-09-13T02:53:11.974 INFO:tasks.workunit.client.0.smithi098.stdout:3/975: mknod d7/d9/d15/d5d/da1/dec/d108/c12d 0 2024-09-13T02:53:11.977 INFO:tasks.workunit.client.0.smithi098.stdout:4/791: creat d6/d10/ddc/f106 x:0 0 0 2024-09-13T02:53:11.983 INFO:tasks.workunit.client.0.smithi098.stdout:3/976: dwrite d7/d9/d15/d2d/d5b/f46 [0,4194304] 0 2024-09-13T02:53:11.989 INFO:tasks.workunit.client.0.smithi098.stdout:4/792: mkdir d6/d3e/d46/d107 0 2024-09-13T02:53:11.996 INFO:tasks.workunit.client.0.smithi098.stdout:3/977: link d7/d9/d15/d5d/cd1 d7/d9/d15/d2d/d78/d7e/c12e 0 2024-09-13T02:53:11.999 INFO:tasks.workunit.client.0.smithi098.stdout:3/978: unlink d7/d9/d15/d2d/db8/d52/f55 0 2024-09-13T02:53:12.011 INFO:tasks.workunit.client.0.smithi098.stdout:3/979: link d7/d9/d15/d2d/d78/d7e/c92 d7/d9/d15/d80/d107/c12f 0 2024-09-13T02:53:12.013 INFO:tasks.workunit.client.0.smithi098.stdout:3/980: creat d7/d9/d15/d2d/d78/d7e/d8e/df9/f130 x:0 0 0 2024-09-13T02:53:12.032 INFO:tasks.workunit.client.0.smithi098.stdout:4/793: dwrite d6/db/f2f [0,4194304] 0 2024-09-13T02:53:12.040 INFO:tasks.workunit.client.0.smithi098.stdout:4/794: read d6/d10/d21/f3b [357978,126312] 0 2024-09-13T02:53:12.040 INFO:tasks.workunit.client.0.smithi098.stdout:3/981: write d7/d9/d15/d5d/da1/fd8 [75090,89148] 0 2024-09-13T02:53:12.042 INFO:tasks.workunit.client.0.smithi098.stdout:3/982: rename d7/d9/d15/d2d to d7/d9/d15/d2d/d5b/dd2/d131 22 2024-09-13T02:53:12.044 INFO:tasks.workunit.client.0.smithi098.stdout:3/983: dread d7/d9/d15/d80/fc8 [0,4194304] 0 2024-09-13T02:53:12.045 INFO:tasks.workunit.client.0.smithi098.stdout:3/984: stat d7/d9/d15/f82 0 2024-09-13T02:53:12.046 INFO:tasks.workunit.client.0.smithi098.stdout:3/985: chown d7/d9/d15/d5d/da1/fae 5756692 1 2024-09-13T02:53:12.049 INFO:tasks.workunit.client.0.smithi098.stdout:3/986: write d7/d9/d15/d2d/d78/f98 [1501406,50554] 0 2024-09-13T02:53:12.058 INFO:tasks.workunit.client.0.smithi098.stdout:3/987: dwrite d7/f43 [4194304,4194304] 0 2024-09-13T02:53:12.069 INFO:tasks.workunit.client.0.smithi098.stdout:4/795: write d6/d3e/d46/dd2/fcd [293341,122326] 0 2024-09-13T02:53:12.088 INFO:tasks.workunit.client.0.smithi098.stdout:3/988: truncate d7/d9/d4c/f10a 2847626 0 2024-09-13T02:53:12.092 INFO:tasks.workunit.client.0.smithi098.stdout:3/989: fdatasync d7/d9/d15/d5d/dc3/f60 0 2024-09-13T02:53:12.096 INFO:tasks.workunit.client.0.smithi098.stdout:3/990: mkdir d7/d9/d15/d2d/d5b/d70/d90/d132 0 2024-09-13T02:53:12.096 INFO:tasks.workunit.client.0.smithi098.stdout:3/991: readlink d7/l9d 0 2024-09-13T02:53:12.097 INFO:tasks.workunit.client.0.smithi098.stdout:3/992: stat d7/d9/d15/d2d/d78/l110 0 2024-09-13T02:53:12.102 INFO:tasks.workunit.client.0.smithi098.stdout:3/993: mkdir d7/d9/d15/d2d/d78/d7e/d8e/df9/d133 0 2024-09-13T02:53:12.103 INFO:tasks.workunit.client.0.smithi098.stdout:3/994: stat d7/d9/d15/d2d/c6d 0 2024-09-13T02:53:12.108 INFO:tasks.workunit.client.0.smithi098.stdout:3/995: unlink d7/d9/d15/d2d/d5b/f9e 0 2024-09-13T02:53:12.109 INFO:tasks.workunit.client.0.smithi098.stdout:3/996: chown d7/d9/d25/lfb 159251771 1 2024-09-13T02:53:12.129 INFO:tasks.workunit.client.0.smithi098.stdout:3/997: write d7/d9/f86 [1577340,76813] 0 2024-09-13T02:53:12.130 INFO:tasks.workunit.client.0.smithi098.stdout:3/998: fdatasync d7/d9/d15/d26/f2a 0 2024-09-13T02:53:12.134 INFO:tasks.workunit.client.0.smithi098.stdout:3/999: creat d7/d9/d15/d5d/da1/dec/d103/d10c/f134 x:0 0 0 2024-09-13T02:53:12.383 INFO:tasks.workunit.client.0.smithi098.stdout:8/816: sync 2024-09-13T02:53:12.413 INFO:tasks.workunit.client.0.smithi098.stdout:8/817: write d2/d28/fbd [1878807,46187] 0 2024-09-13T02:53:12.416 INFO:tasks.workunit.client.0.smithi098.stdout:8/818: mkdir d2/d2f/d78/d5d/dcd/d10a 0 2024-09-13T02:53:12.416 INFO:tasks.workunit.client.0.smithi098.stdout:8/819: read d2/dd/d11/d2c/d9b/fa9 [554220,22550] 0 2024-09-13T02:53:12.419 INFO:tasks.workunit.client.0.smithi098.stdout:8/820: mknod d2/d2f/d78/d46/d74/dfe/c10b 0 2024-09-13T02:53:12.423 INFO:tasks.workunit.client.0.smithi098.stdout:8/821: link d2/d28/d43/d88/d99/c100 d2/d28/d43/d88/d99/dec/c10c 0 2024-09-13T02:53:12.438 INFO:tasks.workunit.client.0.smithi098.stdout:8/822: dread d2/dd/d4d/d96/f7e [0,4194304] 0 2024-09-13T02:53:12.443 INFO:tasks.workunit.client.0.smithi098.stdout:8/823: link d2/d2f/d78/d46/d74/feb d2/d28/d43/f10d 0 2024-09-13T02:53:12.445 INFO:tasks.workunit.client.0.smithi098.stdout:8/824: symlink d2/d28/d43/l10e 0 2024-09-13T02:53:12.447 INFO:tasks.workunit.client.0.smithi098.stdout:8/825: unlink d2/dd/lac 0 2024-09-13T02:53:12.453 INFO:tasks.workunit.client.0.smithi098.stdout:8/826: dwrite d2/d2f/d78/dae/f106 [0,4194304] 0 2024-09-13T02:53:12.495 INFO:tasks.workunit.client.0.smithi098.stdout:2/870: sync 2024-09-13T02:53:12.497 INFO:tasks.workunit.client.0.smithi098.stdout:2/871: unlink d1/d1f/d35/d63/f10c 0 2024-09-13T02:53:12.500 INFO:tasks.workunit.client.0.smithi098.stdout:2/872: creat d1/f11b x:0 0 0 2024-09-13T02:53:12.503 INFO:tasks.workunit.client.0.smithi098.stdout:2/873: rename d1/d1f/d30/def/df0/d10d to d1/da7/d109/d11c 0 2024-09-13T02:53:12.508 INFO:tasks.workunit.client.0.smithi098.stdout:2/874: fdatasync d1/d1a/d9/d1e/d5a/f70 0 2024-09-13T02:53:12.518 INFO:tasks.workunit.client.0.smithi098.stdout:2/875: write d1/fa6 [438705,50599] 0 2024-09-13T02:53:12.520 INFO:tasks.workunit.client.0.smithi098.stdout:2/876: write d1/d1f/d27/ffb [1148542,82585] 0 2024-09-13T02:53:12.526 INFO:tasks.workunit.client.0.smithi098.stdout:2/877: dwrite d1/d1f/d35/f83 [0,4194304] 0 2024-09-13T02:53:12.529 INFO:tasks.workunit.client.0.smithi098.stdout:2/878: read d1/d1a/d9/d1e/f47 [6514514,24908] 0 2024-09-13T02:53:12.530 INFO:tasks.workunit.client.0.smithi098.stdout:2/879: rmdir d1/d1f 39 2024-09-13T02:53:12.534 INFO:tasks.workunit.client.0.smithi098.stdout:2/880: fdatasync d1/d1f/d35/f74 0 2024-09-13T02:53:12.537 INFO:tasks.workunit.client.0.smithi098.stdout:2/881: mkdir d1/d1f/d30/def/d10b/d11d 0 2024-09-13T02:53:12.543 INFO:tasks.workunit.client.0.smithi098.stdout:2/882: rename d1/d1f/d27/f9c to d1/d1f/d35/d63/f11e 0 2024-09-13T02:53:12.544 INFO:tasks.workunit.client.0.smithi098.stdout:2/883: chown d1/d1f/d39/df6/l112 110676 1 2024-09-13T02:53:12.552 INFO:tasks.workunit.client.0.smithi098.stdout:2/884: dread d1/d1a/d9/d1e/d5a/f60 [0,4194304] 0 2024-09-13T02:53:12.558 INFO:tasks.workunit.client.0.smithi098.stdout:2/885: dwrite d1/fa6 [0,4194304] 0 2024-09-13T02:53:12.558 INFO:tasks.workunit.client.0.smithi098.stdout:2/886: fdatasync d1/d1f/d39/f102 0 2024-09-13T02:53:12.573 INFO:tasks.workunit.client.0.smithi098.stdout:2/887: write d1/f7b [1839245,44971] 0 2024-09-13T02:53:12.589 INFO:tasks.workunit.client.0.smithi098.stdout:2/888: dread d1/d1a/d9/f5c [0,4194304] 0 2024-09-13T02:53:12.592 INFO:tasks.workunit.client.0.smithi098.stdout:2/889: symlink d1/d1f/d35/d63/d72/l11f 0 2024-09-13T02:53:12.594 INFO:tasks.workunit.client.0.smithi098.stdout:2/890: creat d1/da7/d109/f120 x:0 0 0 2024-09-13T02:53:12.595 INFO:tasks.workunit.client.0.smithi098.stdout:2/891: stat d1/d1f/d30/def/da8/le8 0 2024-09-13T02:53:12.597 INFO:tasks.workunit.client.0.smithi098.stdout:2/892: unlink d1/d1a/d9/d1e/d5a/fac 0 2024-09-13T02:53:12.601 INFO:tasks.workunit.client.0.smithi098.stdout:2/893: mkdir d1/d1f/d39/df6/d59/d9e/d9f/dc1/d113/d121 0 2024-09-13T02:53:12.615 INFO:tasks.workunit.client.0.smithi098.stdout:2/894: dwrite d1/d1a/d9/fdb [0,4194304] 0 2024-09-13T02:53:12.622 INFO:tasks.workunit.client.0.smithi098.stdout:2/895: dwrite d1/d1f/d35/f4b [0,4194304] 0 2024-09-13T02:53:12.626 INFO:tasks.workunit.client.0.smithi098.stdout:2/896: dread - d1/d1f/d39/df6/d59/d9e/dde/f108 zero size 2024-09-13T02:53:12.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:12 smithi098 ceph-mon[27886]: pgmap v35: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 35 MiB/s rd, 89 MiB/s wr, 251 op/s 2024-09-13T02:53:12.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:12 smithi142 ceph-mon[33443]: pgmap v35: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 35 MiB/s rd, 89 MiB/s wr, 251 op/s 2024-09-13T02:53:12.843 INFO:tasks.workunit.client.0.smithi098.stdout:6/791: sync 2024-09-13T02:53:12.844 INFO:tasks.workunit.client.0.smithi098.stdout:0/930: sync 2024-09-13T02:53:12.845 INFO:tasks.workunit.client.0.smithi098.stdout:6/792: write d5/d13/d2b/d5b/ffc [380425,41730] 0 2024-09-13T02:53:12.849 INFO:tasks.workunit.client.0.smithi098.stdout:6/793: dread d5/d13/d2b/d3a/d41/d7e/f7d [0,4194304] 0 2024-09-13T02:53:12.850 INFO:tasks.workunit.client.0.smithi098.stdout:0/931: rename dd/df/d1d/d26/d28/d32/d8d/f12b to dd/df/d1d/d26/d28/d32/dda/d117/f146 0 2024-09-13T02:53:12.855 INFO:tasks.workunit.client.0.smithi098.stdout:0/932: truncate dd/df/d1d/f64 900726 0 2024-09-13T02:53:12.858 INFO:tasks.workunit.client.0.smithi098.stdout:0/933: creat dd/d1f/d85/d9d/dc2/f147 x:0 0 0 2024-09-13T02:53:12.860 INFO:tasks.workunit.client.0.smithi098.stdout:6/794: creat d5/f109 x:0 0 0 2024-09-13T02:53:12.860 INFO:tasks.workunit.client.0.smithi098.stdout:9/958: sync 2024-09-13T02:53:12.860 INFO:tasks.workunit.client.0.smithi098.stdout:5/830: sync 2024-09-13T02:53:12.861 INFO:tasks.workunit.client.0.smithi098.stdout:9/959: write d2/d6/d2b/d66/de0/d102/f11b [1462820,85442] 0 2024-09-13T02:53:12.863 INFO:tasks.workunit.client.0.smithi098.stdout:6/795: fsync d5/d13/d2b/d5b/d102/fe4 0 2024-09-13T02:53:12.866 INFO:tasks.workunit.client.0.smithi098.stdout:5/831: creat d0/d15/d17/d1c/d3d/f116 x:0 0 0 2024-09-13T02:53:12.871 INFO:tasks.workunit.client.0.smithi098.stdout:9/960: rename d2/d6/d2b/d4d/d56/db9/feb to d2/d6/d36/d8d/dc8/f14a 0 2024-09-13T02:53:12.873 INFO:tasks.workunit.client.0.smithi098.stdout:6/796: read - d5/d13/d2b/d79/fe9 zero size 2024-09-13T02:53:12.873 INFO:tasks.workunit.client.0.smithi098.stdout:0/934: write dd/fb4 [490885,91598] 0 2024-09-13T02:53:12.876 INFO:tasks.workunit.client.0.smithi098.stdout:9/961: mknod d2/d6/d36/d6a/c14b 0 2024-09-13T02:53:12.877 INFO:tasks.workunit.client.0.smithi098.stdout:9/962: write d2/d6/d2b/d4d/d4f/d6c/f79 [751429,55436] 0 2024-09-13T02:53:12.881 INFO:tasks.workunit.client.0.smithi098.stdout:0/935: truncate dd/df/d1d/d40/d46/fdb 843128 0 2024-09-13T02:53:12.884 INFO:tasks.workunit.client.0.smithi098.stdout:6/797: fdatasync d5/d13/f1c 0 2024-09-13T02:53:12.886 INFO:tasks.workunit.client.0.smithi098.stdout:9/963: fsync d2/db1/fe8 0 2024-09-13T02:53:12.887 INFO:tasks.workunit.client.0.smithi098.stdout:5/832: dwrite d0/f4b [0,4194304] 0 2024-09-13T02:53:12.893 INFO:tasks.workunit.client.0.smithi098.stdout:9/964: dread d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/da0/dc6/f11f [0,4194304] 0 2024-09-13T02:53:12.897 INFO:tasks.workunit.client.0.smithi098.stdout:5/833: symlink d0/d15/d17/daa/l117 0 2024-09-13T02:53:12.902 INFO:tasks.workunit.client.0.smithi098.stdout:9/965: creat d2/d6/d91/f14c x:0 0 0 2024-09-13T02:53:12.902 INFO:tasks.workunit.client.0.smithi098.stdout:2/897: sync 2024-09-13T02:53:12.903 INFO:tasks.workunit.client.0.smithi098.stdout:4/796: sync 2024-09-13T02:53:12.903 INFO:tasks.workunit.client.0.smithi098.stdout:8/827: sync 2024-09-13T02:53:12.905 INFO:tasks.workunit.client.0.smithi098.stdout:8/828: fsync d2/d28/d43/d88/dd8/fe4 0 2024-09-13T02:53:12.906 INFO:tasks.workunit.client.0.smithi098.stdout:2/898: mkdir d1/da7/d122 0 2024-09-13T02:53:12.908 INFO:tasks.workunit.client.0.smithi098.stdout:6/798: dwrite f3 [0,4194304] 0 2024-09-13T02:53:12.908 INFO:tasks.workunit.client.0.smithi098.stdout:9/966: rmdir d2/d6/d2b/d66 39 2024-09-13T02:53:12.916 INFO:tasks.workunit.client.0.smithi098.stdout:0/936: dread dd/df/d1d/d26/d28/d32/d67/d71/dbd/ffa [0,4194304] 0 2024-09-13T02:53:12.916 INFO:tasks.workunit.client.0.smithi098.stdout:2/899: dwrite d1/d1f/f107 [0,4194304] 0 2024-09-13T02:53:12.920 INFO:tasks.workunit.client.0.smithi098.stdout:2/900: write d1/d1f/d30/def/ff5 [1068894,523] 0 2024-09-13T02:53:12.920 INFO:tasks.workunit.client.0.smithi098.stdout:0/937: chown dd/df/d1d/d26/d28/d32/d67/d71/f52 0 1 2024-09-13T02:53:12.921 INFO:tasks.workunit.client.0.smithi098.stdout:5/834: getdents d0/d15 0 2024-09-13T02:53:12.929 INFO:tasks.workunit.client.0.smithi098.stdout:9/967: mknod d2/d6/d2b/d4d/d56/db9/c14d 0 2024-09-13T02:53:12.931 INFO:tasks.workunit.client.0.smithi098.stdout:9/968: write d2/d6/d91/d127/f10e [948844,43291] 0 2024-09-13T02:53:12.934 INFO:tasks.workunit.client.0.smithi098.stdout:6/799: creat d5/d13/d2b/d3a/d14/d6b/d9a/da5/db8/f10a x:0 0 0 2024-09-13T02:53:12.938 INFO:tasks.workunit.client.0.smithi098.stdout:0/938: symlink dd/db9/dd7/d140/l148 0 2024-09-13T02:53:12.941 INFO:tasks.workunit.client.0.smithi098.stdout:6/800: dwrite d5/ffd [0,4194304] 0 2024-09-13T02:53:12.941 INFO:tasks.workunit.client.0.smithi098.stdout:0/939: dread dd/df/d1d/da7/fb5 [0,4194304] 0 2024-09-13T02:53:12.943 INFO:tasks.workunit.client.0.smithi098.stdout:6/801: write d5/d13/d2b/d3a/fa2 [4637369,32797] 0 2024-09-13T02:53:12.943 INFO:tasks.workunit.client.0.smithi098.stdout:4/797: dread d6/d22/d3d/d41/f5b [0,4194304] 0 2024-09-13T02:53:12.949 INFO:tasks.workunit.client.0.smithi098.stdout:8/829: getdents d2/d2f/d78/d46/da2 0 2024-09-13T02:53:12.951 INFO:tasks.workunit.client.0.smithi098.stdout:2/901: dwrite d1/d1f/d35/f71 [0,4194304] 0 2024-09-13T02:53:12.953 INFO:tasks.workunit.client.0.smithi098.stdout:5/835: link d0/d38/d3f/d81/d4d/d82/d9a/fca d0/d15/d17/d1c/d3d/f118 0 2024-09-13T02:53:12.955 INFO:tasks.workunit.client.0.smithi098.stdout:0/940: read - dd/df/d1d/d40/d46/d6b/ffb zero size 2024-09-13T02:53:12.957 INFO:tasks.workunit.client.0.smithi098.stdout:4/798: creat d6/d22/d3d/d41/d58/f108 x:0 0 0 2024-09-13T02:53:12.957 INFO:tasks.workunit.client.0.smithi098.stdout:0/941: chown dd/df/d1d/d40/d46/f125 107716263 1 2024-09-13T02:53:12.961 INFO:tasks.workunit.client.0.smithi098.stdout:5/836: dwrite d0/d15/d17/d1c/f74 [0,4194304] 0 2024-09-13T02:53:12.976 INFO:tasks.workunit.client.0.smithi098.stdout:6/802: dwrite d5/d13/d2b/d79/df0/fac [0,4194304] 0 2024-09-13T02:53:12.983 INFO:tasks.workunit.client.0.smithi098.stdout:2/902: dwrite d1/f48 [0,4194304] 0 2024-09-13T02:53:12.996 INFO:tasks.workunit.client.0.smithi098.stdout:9/969: getdents d2/d6/d2b/d4d/dcf 0 2024-09-13T02:53:13.002 INFO:tasks.workunit.client.0.smithi098.stdout:5/837: mkdir d0/d15/d50/dd3/de1/d119 0 2024-09-13T02:53:13.005 INFO:tasks.workunit.client.0.smithi098.stdout:4/799: creat d6/d22/d3d/d64/f109 x:0 0 0 2024-09-13T02:53:13.007 INFO:tasks.workunit.client.0.smithi098.stdout:6/803: mknod d5/d13/d2b/d3a/d14/c10b 0 2024-09-13T02:53:13.007 INFO:tasks.workunit.client.0.smithi098.stdout:0/942: link dd/d1f/d85/fab dd/df/d1d/d40/d46/d6b/d109/f149 0 2024-09-13T02:53:13.009 INFO:tasks.workunit.client.0.smithi098.stdout:8/830: link d2/d2f/d78/c9d d2/dd/dcb/c10f 0 2024-09-13T02:53:13.010 INFO:tasks.workunit.client.0.smithi098.stdout:5/838: dwrite d0/d15/d50/f108 [0,4194304] 0 2024-09-13T02:53:13.012 INFO:tasks.workunit.client.0.smithi098.stdout:9/970: dread d2/d6/d2b/d4d/fe6 [0,4194304] 0 2024-09-13T02:53:13.013 INFO:tasks.workunit.client.0.smithi098.stdout:0/943: mknod dd/d1f/d85/d9d/dc2/d13f/c14a 0 2024-09-13T02:53:13.013 INFO:tasks.workunit.client.0.smithi098.stdout:0/944: chown dd/df/d1d/d40/d46/fad 1 1 2024-09-13T02:53:13.017 INFO:tasks.workunit.client.0.smithi098.stdout:6/804: creat d5/d13/d2b/d3a/d14/d6b/d9a/da5/f10c x:0 0 0 2024-09-13T02:53:13.017 INFO:tasks.workunit.client.0.smithi098.stdout:6/805: chown d5/f33 7711 1 2024-09-13T02:53:13.020 INFO:tasks.workunit.client.0.smithi098.stdout:9/971: chown d2/d6/d2b/d66/de0/de9/f11e 57202 1 2024-09-13T02:53:13.022 INFO:tasks.workunit.client.0.smithi098.stdout:5/839: mknod d0/d38/d102/c11a 0 2024-09-13T02:53:13.024 INFO:tasks.workunit.client.0.smithi098.stdout:6/806: truncate d5/d36/f6e 557888 0 2024-09-13T02:53:13.029 INFO:tasks.workunit.client.0.smithi098.stdout:5/840: dwrite d0/d15/f87 [0,4194304] 0 2024-09-13T02:53:13.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/972: mkdir d2/d6/d36/d8d/d107/d14e 0 2024-09-13T02:53:13.030 INFO:tasks.workunit.client.0.smithi098.stdout:9/973: readlink d2/d6/d2b/d4d/d56/db9/lf5 0 2024-09-13T02:53:13.034 INFO:tasks.workunit.client.0.smithi098.stdout:4/800: dread d6/d22/d3d/d41/d74/fc4 [0,4194304] 0 2024-09-13T02:53:13.050 INFO:tasks.workunit.client.0.smithi098.stdout:9/974: dread d2/d6/d2b/d4d/d4f/d6c/f85 [0,4194304] 0 2024-09-13T02:53:13.076 INFO:tasks.workunit.client.0.smithi098.stdout:6/807: creat d5/d13/d2b/d3a/f10d x:0 0 0 2024-09-13T02:53:13.079 INFO:tasks.workunit.client.0.smithi098.stdout:5/841: chown d0/d38/d3f/d1a/c85 1 1 2024-09-13T02:53:13.079 INFO:tasks.workunit.client.0.smithi098.stdout:9/975: read d2/d6/d2b/d4d/d56/f121 [307632,41291] 0 2024-09-13T02:53:13.083 INFO:tasks.workunit.client.0.smithi098.stdout:4/801: creat d6/d22/d3d/d41/d74/ddb/f10a x:0 0 0 2024-09-13T02:53:13.090 INFO:tasks.workunit.client.0.smithi098.stdout:9/976: fsync d2/d6/d2b/d4d/d56/db9/fc9 0 2024-09-13T02:53:13.092 INFO:tasks.workunit.client.0.smithi098.stdout:5/842: stat d0/d38/d3f/d81/d4d/d82/d9a/fca 0 2024-09-13T02:53:13.092 INFO:tasks.workunit.client.0.smithi098.stdout:6/808: dread d5/d13/d2b/f2d [0,4194304] 0 2024-09-13T02:53:13.094 INFO:tasks.workunit.client.0.smithi098.stdout:5/843: read d0/d15/d17/daa/fb8 [13351,30166] 0 2024-09-13T02:53:13.094 INFO:tasks.workunit.client.0.smithi098.stdout:4/802: mknod d6/d22/d3d/d41/d74/ddb/c10b 0 2024-09-13T02:53:13.100 INFO:tasks.workunit.client.0.smithi098.stdout:9/977: creat d2/d6/d2b/d66/de0/de9/f14f x:0 0 0 2024-09-13T02:53:13.101 INFO:tasks.workunit.client.0.smithi098.stdout:8/831: write d2/d2f/d78/d5d/fb2 [164406,128482] 0 2024-09-13T02:53:13.106 INFO:tasks.workunit.client.0.smithi098.stdout:5/844: fdatasync d0/d38/d3f/d81/d4d/d82/d9a/fca 0 2024-09-13T02:53:13.110 INFO:tasks.workunit.client.0.smithi098.stdout:4/803: truncate d6/d10/d21/f25 3277166 0 2024-09-13T02:53:13.110 INFO:tasks.workunit.client.0.smithi098.stdout:4/804: chown d6/d37/l4b 22994 1 2024-09-13T02:53:13.112 INFO:tasks.workunit.client.0.smithi098.stdout:9/978: stat d2/d6/d36/fea 0 2024-09-13T02:53:13.113 INFO:tasks.workunit.client.0.smithi098.stdout:9/979: write d2/d6/f42 [4356984,40166] 0 2024-09-13T02:53:13.119 INFO:tasks.workunit.client.0.smithi098.stdout:0/945: write dd/df/d1d/d40/d46/fdb [1126426,50881] 0 2024-09-13T02:53:13.121 INFO:tasks.workunit.client.0.smithi098.stdout:4/805: mkdir d6/d3e/d73/dfc/d10c 0 2024-09-13T02:53:13.127 INFO:tasks.workunit.client.0.smithi098.stdout:4/806: dwrite d6/d22/d3d/d64/f109 [0,4194304] 0 2024-09-13T02:53:13.139 INFO:tasks.workunit.client.0.smithi098.stdout:9/980: unlink d2/d6/d36/c8e 0 2024-09-13T02:53:13.150 INFO:tasks.workunit.client.0.smithi098.stdout:4/807: mkdir d6/d3e/d10d 0 2024-09-13T02:53:13.156 INFO:tasks.workunit.client.0.smithi098.stdout:4/808: unlink d6/d54/f7b 0 2024-09-13T02:53:13.176 INFO:tasks.workunit.client.0.smithi098.stdout:6/809: write f4 [3335370,35363] 0 2024-09-13T02:53:13.183 INFO:tasks.workunit.client.0.smithi098.stdout:0/946: write dd/df/d1d/d26/d28/d32/f4d [3225611,12082] 0 2024-09-13T02:53:13.183 INFO:tasks.workunit.client.0.smithi098.stdout:8/832: dwrite d2/d2f/d78/d46/d5c/fd4 [0,4194304] 0 2024-09-13T02:53:13.186 INFO:tasks.workunit.client.0.smithi098.stdout:5/845: dwrite d0/d15/d17/d1c/d3d/f47 [0,4194304] 0 2024-09-13T02:53:13.188 INFO:tasks.workunit.client.0.smithi098.stdout:0/947: mknod dd/db9/dd7/c14b 0 2024-09-13T02:53:13.191 INFO:tasks.workunit.client.0.smithi098.stdout:0/948: read fc [1630535,42091] 0 2024-09-13T02:53:13.192 INFO:tasks.workunit.client.0.smithi098.stdout:5/846: read d0/d38/d3f/f9 [1898476,49424] 0 2024-09-13T02:53:13.193 INFO:tasks.workunit.client.0.smithi098.stdout:8/833: dwrite d2/d2f/d78/dae/f107 [0,4194304] 0 2024-09-13T02:53:13.195 INFO:tasks.workunit.client.0.smithi098.stdout:8/834: write d2/d2f/d78/dae/f107 [3423055,1492] 0 2024-09-13T02:53:13.198 INFO:tasks.workunit.client.0.smithi098.stdout:6/810: write d5/d13/f1c [787923,101385] 0 2024-09-13T02:53:13.200 INFO:tasks.workunit.client.0.smithi098.stdout:5/847: creat d0/d15/d17/daa/f11b x:0 0 0 2024-09-13T02:53:13.202 INFO:tasks.workunit.client.0.smithi098.stdout:8/835: fdatasync d2/f6 0 2024-09-13T02:53:13.203 INFO:tasks.workunit.client.0.smithi098.stdout:4/809: dwrite d6/d3e/fe4 [0,4194304] 0 2024-09-13T02:53:13.206 INFO:tasks.workunit.client.0.smithi098.stdout:5/848: rmdir d0/d7c 39 2024-09-13T02:53:13.206 INFO:tasks.workunit.client.0.smithi098.stdout:6/811: write d5/d13/d2b/d3a/d41/d7e/f7d [4964487,65874] 0 2024-09-13T02:53:13.208 INFO:tasks.workunit.client.0.smithi098.stdout:4/810: mkdir d6/d37/d7a/d10e 0 2024-09-13T02:53:13.208 INFO:tasks.workunit.client.0.smithi098.stdout:4/811: dread - d6/d22/d3d/d4d/fbb zero size 2024-09-13T02:53:13.210 INFO:tasks.workunit.client.0.smithi098.stdout:8/836: unlink d2/d28/d43/fca 0 2024-09-13T02:53:13.211 INFO:tasks.workunit.client.0.smithi098.stdout:5/849: mkdir d0/d38/d3f/d1a/d27/d11c 0 2024-09-13T02:53:13.211 INFO:tasks.workunit.client.0.smithi098.stdout:8/837: chown d2/d2f/d78/d46/d74/dfe 14895 1 2024-09-13T02:53:13.212 INFO:tasks.workunit.client.0.smithi098.stdout:6/812: symlink d5/d13/d2b/d93/l10e 0 2024-09-13T02:53:13.213 INFO:tasks.workunit.client.0.smithi098.stdout:5/850: chown d0/d15/d17/d1c/dd6/cda 584866718 1 2024-09-13T02:53:13.214 INFO:tasks.workunit.client.0.smithi098.stdout:6/813: chown d5/d13/d2b/c98 1475738905 1 2024-09-13T02:53:13.214 INFO:tasks.workunit.client.0.smithi098.stdout:4/812: dread d6/d3e/fe4 [0,4194304] 0 2024-09-13T02:53:13.220 INFO:tasks.workunit.client.0.smithi098.stdout:4/813: mknod d6/db/c10f 0 2024-09-13T02:53:13.221 INFO:tasks.workunit.client.0.smithi098.stdout:8/838: getdents d2/d2f 0 2024-09-13T02:53:13.225 INFO:tasks.workunit.client.0.smithi098.stdout:6/814: mknod d5/d36/c10f 0 2024-09-13T02:53:13.227 INFO:tasks.workunit.client.0.smithi098.stdout:8/839: dwrite d2/f1a [0,4194304] 0 2024-09-13T02:53:13.229 INFO:tasks.workunit.client.0.smithi098.stdout:8/840: write d2/d2f/d78/d5d/dcd/fe6 [400239,106233] 0 2024-09-13T02:53:13.229 INFO:tasks.workunit.client.0.smithi098.stdout:4/814: creat d6/d22/d3d/f110 x:0 0 0 2024-09-13T02:53:13.231 INFO:tasks.workunit.client.0.smithi098.stdout:8/841: chown d2/d2f/d78/ca4 10214 1 2024-09-13T02:53:13.231 INFO:tasks.workunit.client.0.smithi098.stdout:4/815: stat d6/d10/d21 0 2024-09-13T02:53:13.232 INFO:tasks.workunit.client.0.smithi098.stdout:8/842: chown d2/dd/d11/f16 392258 1 2024-09-13T02:53:13.233 INFO:tasks.workunit.client.0.smithi098.stdout:8/843: chown d2/d28/d43/d88/df2 7 1 2024-09-13T02:53:13.235 INFO:tasks.workunit.client.0.smithi098.stdout:5/851: link d0/d15/l48 d0/d15/d17/daa/l11d 0 2024-09-13T02:53:13.236 INFO:tasks.workunit.client.0.smithi098.stdout:5/852: chown d0/d15/d17/d1c/f2d 15566173 1 2024-09-13T02:53:13.236 INFO:tasks.workunit.client.0.smithi098.stdout:8/844: dread d2/d2f/d78/d5d/dcd/fe6 [0,4194304] 0 2024-09-13T02:53:13.237 INFO:tasks.workunit.client.0.smithi098.stdout:8/845: readlink d2/d2f/d78/d46/d47/lb3 0 2024-09-13T02:53:13.238 INFO:tasks.workunit.client.0.smithi098.stdout:8/846: fsync d2/dd/fde 0 2024-09-13T02:53:13.242 INFO:tasks.workunit.client.0.smithi098.stdout:6/815: mknod d5/d13/d2b/d3a/d14/d94/de5/c110 0 2024-09-13T02:53:13.243 INFO:tasks.workunit.client.0.smithi098.stdout:4/816: mkdir d6/d3e/d46/dd2/dee/d111 0 2024-09-13T02:53:13.247 INFO:tasks.workunit.client.0.smithi098.stdout:6/816: creat d5/d13/d2b/d3a/d14/d94/f111 x:0 0 0 2024-09-13T02:53:13.247 INFO:tasks.workunit.client.0.smithi098.stdout:4/817: symlink d6/d22/l112 0 2024-09-13T02:53:13.248 INFO:tasks.workunit.client.0.smithi098.stdout:4/818: chown d6/d10/l2c 27678397 1 2024-09-13T02:53:13.249 INFO:tasks.workunit.client.0.smithi098.stdout:5/853: rename d0/d38/d3f/d81/d9e/lf8 to d0/d57/l11e 0 2024-09-13T02:53:13.255 INFO:tasks.workunit.client.0.smithi098.stdout:5/854: chown d0/d38/d3f/d81/d9e 49 1 2024-09-13T02:53:13.258 INFO:tasks.workunit.client.0.smithi098.stdout:6/817: dwrite d5/d13/d2b/d3a/d14/d6b/d9a/da5/db8/f10a [0,4194304] 0 2024-09-13T02:53:13.261 INFO:tasks.workunit.client.0.smithi098.stdout:8/847: dread d2/d2f/d78/f4b [0,4194304] 0 2024-09-13T02:53:13.294 INFO:tasks.workunit.client.0.smithi098.stdout:4/819: mknod d6/d22/d3d/d64/c113 0 2024-09-13T02:53:13.296 INFO:tasks.workunit.client.0.smithi098.stdout:5/855: rename d0/d38/d3f/d81/d4d/c65 to d0/d38/d3f/d81/d9e/c11f 0 2024-09-13T02:53:13.297 INFO:tasks.workunit.client.0.smithi098.stdout:6/818: creat d5/d13/d2b/f112 x:0 0 0 2024-09-13T02:53:13.301 INFO:tasks.workunit.client.0.smithi098.stdout:6/819: stat d5/d13/d2b/d3a/d5a/cb1 0 2024-09-13T02:53:13.302 INFO:tasks.workunit.client.0.smithi098.stdout:6/820: dread - d5/d13/d2b/d3a/f10d zero size 2024-09-13T02:53:13.304 INFO:tasks.workunit.client.0.smithi098.stdout:4/820: creat d6/d10/d21/dec/f114 x:0 0 0 2024-09-13T02:53:13.306 INFO:tasks.workunit.client.0.smithi098.stdout:8/848: creat d2/dd/d2e/f110 x:0 0 0 2024-09-13T02:53:13.308 INFO:tasks.workunit.client.0.smithi098.stdout:4/821: fsync d6/d54/d6a/fba 0 2024-09-13T02:53:13.310 INFO:tasks.workunit.client.0.smithi098.stdout:8/849: unlink d2/d28/d43/l10e 0 2024-09-13T02:53:13.311 INFO:tasks.workunit.client.0.smithi098.stdout:6/821: truncate d5/d36/f6e 1413799 0 2024-09-13T02:53:13.315 INFO:tasks.workunit.client.0.smithi098.stdout:6/822: unlink d5/d13/d2b/d3a/d41/d6c/d7c/c103 0 2024-09-13T02:53:13.328 INFO:tasks.workunit.client.0.smithi098.stdout:4/822: dread d6/d22/f63 [0,4194304] 0 2024-09-13T02:53:13.328 INFO:tasks.workunit.client.0.smithi098.stdout:4/823: symlink d6/d3e/d73/dfc/l115 0 2024-09-13T02:53:13.330 INFO:tasks.workunit.client.0.smithi098.stdout:4/824: mkdir d6/d22/d3d/d41/d74/d116 0 2024-09-13T02:53:13.350 INFO:tasks.workunit.client.0.smithi098.stdout:5/856: dwrite d0/d15/d69/fd2 [0,4194304] 0 2024-09-13T02:53:13.351 INFO:tasks.workunit.client.0.smithi098.stdout:5/857: chown d0/d38/d3f/c25 7929 1 2024-09-13T02:53:13.358 INFO:tasks.workunit.client.0.smithi098.stdout:8/850: dwrite d2/d2f/fd3 [0,4194304] 0 2024-09-13T02:53:13.362 INFO:tasks.workunit.client.0.smithi098.stdout:5/858: rename d0/d57/ca5 to d0/d15/d69/c120 0 2024-09-13T02:53:13.366 INFO:tasks.workunit.client.0.smithi098.stdout:8/851: symlink d2/d2f/d78/d46/d74/d86/da8/l111 0 2024-09-13T02:53:13.367 INFO:tasks.workunit.client.0.smithi098.stdout:6/823: dwrite d5/d13/d2b/d3a/d14/d94/fc2 [0,4194304] 0 2024-09-13T02:53:13.371 INFO:tasks.workunit.client.0.smithi098.stdout:5/859: mknod d0/d38/d102/c121 0 2024-09-13T02:53:13.372 INFO:tasks.workunit.client.0.smithi098.stdout:4/825: dwrite d6/d3e/d46/f86 [0,4194304] 0 2024-09-13T02:53:13.377 INFO:tasks.workunit.client.0.smithi098.stdout:5/860: creat d0/d38/d3f/d81/f122 x:0 0 0 2024-09-13T02:53:13.379 INFO:tasks.workunit.client.0.smithi098.stdout:4/826: readlink d6/d10/d21/l96 0 2024-09-13T02:53:13.381 INFO:tasks.workunit.client.0.smithi098.stdout:5/861: mknod d0/d15/d50/dd3/c123 0 2024-09-13T02:53:13.383 INFO:tasks.workunit.client.0.smithi098.stdout:6/824: creat d5/d36/f113 x:0 0 0 2024-09-13T02:53:13.387 INFO:tasks.workunit.client.0.smithi098.stdout:4/827: creat d6/d54/d6a/f117 x:0 0 0 2024-09-13T02:53:13.391 INFO:tasks.workunit.client.0.smithi098.stdout:6/825: creat d5/d36/d8c/f114 x:0 0 0 2024-09-13T02:53:13.393 INFO:tasks.workunit.client.0.smithi098.stdout:8/852: dwrite d2/f1b [0,4194304] 0 2024-09-13T02:53:13.393 INFO:tasks.workunit.client.0.smithi098.stdout:4/828: symlink d6/d10/d21/l118 0 2024-09-13T02:53:13.395 INFO:tasks.workunit.client.0.smithi098.stdout:5/862: getdents d0/d38/d3f/d81/d4d/d82/d9a 0 2024-09-13T02:53:13.399 INFO:tasks.workunit.client.0.smithi098.stdout:4/829: rmdir d6/d22/d3d/d41/d58/da9 39 2024-09-13T02:53:13.404 INFO:tasks.workunit.client.0.smithi098.stdout:8/853: dread d2/f1a [0,4194304] 0 2024-09-13T02:53:13.405 INFO:tasks.workunit.client.0.smithi098.stdout:5/863: mkdir d0/d38/d3f/d81/d9e/dd4/d124 0 2024-09-13T02:53:13.406 INFO:tasks.workunit.client.0.smithi098.stdout:6/826: dwrite d5/d13/d2b/d3a/d41/d6c/fcd [0,4194304] 0 2024-09-13T02:53:13.411 INFO:tasks.workunit.client.0.smithi098.stdout:6/827: mknod d5/d13/d2b/d79/df0/c115 0 2024-09-13T02:53:13.417 INFO:tasks.workunit.client.0.smithi098.stdout:8/854: creat d2/d28/f112 x:0 0 0 2024-09-13T02:53:13.422 INFO:tasks.workunit.client.0.smithi098.stdout:4/830: dread d6/d10/f1f [0,4194304] 0 2024-09-13T02:53:13.425 INFO:tasks.workunit.client.0.smithi098.stdout:6/828: dread d5/d13/d67/d85/fe6 [0,4194304] 0 2024-09-13T02:53:13.429 INFO:tasks.workunit.client.0.smithi098.stdout:8/855: write d2/d2f/d78/d46/fbc [987564,125248] 0 2024-09-13T02:53:13.432 INFO:tasks.workunit.client.0.smithi098.stdout:4/831: dread d6/d22/d3d/d41/d58/f78 [0,4194304] 0 2024-09-13T02:53:13.442 INFO:tasks.workunit.client.0.smithi098.stdout:4/832: write d6/d22/d3d/d41/d58/da9/fc2 [322362,38904] 0 2024-09-13T02:53:13.446 INFO:tasks.workunit.client.0.smithi098.stdout:4/833: truncate d6/d3e/d68/f36 714125 0 2024-09-13T02:53:13.447 INFO:tasks.workunit.client.0.smithi098.stdout:4/834: write d6/d22/d3d/f110 [475060,21683] 0 2024-09-13T02:53:13.451 INFO:tasks.workunit.client.0.smithi098.stdout:4/835: dread d6/d3e/fe4 [0,4194304] 0 2024-09-13T02:53:13.453 INFO:tasks.workunit.client.0.smithi098.stdout:4/836: rename d6/d22/d3d/d41/d74/d98/cbd to d6/d37/c119 0 2024-09-13T02:53:13.458 INFO:tasks.workunit.client.0.smithi098.stdout:4/837: unlink d6/db/c4e 0 2024-09-13T02:53:13.459 INFO:tasks.workunit.client.0.smithi098.stdout:4/838: chown d6/db/c10f 654815 1 2024-09-13T02:53:13.462 INFO:tasks.workunit.client.0.smithi098.stdout:4/839: link d6/d54/d6a/f117 d6/db/f11a 0 2024-09-13T02:53:13.466 INFO:tasks.workunit.client.0.smithi098.stdout:4/840: creat d6/d22/d3d/d41/d58/da9/f11b x:0 0 0 2024-09-13T02:53:13.478 INFO:tasks.workunit.client.0.smithi098.stdout:4/841: creat d6/d22/d3d/d41/f11c x:0 0 0 2024-09-13T02:53:13.480 INFO:tasks.workunit.client.0.smithi098.stdout:4/842: rmdir d6/d22/d3d/d41/d58/da9 39 2024-09-13T02:53:13.487 INFO:tasks.workunit.client.0.smithi098.stdout:4/843: creat d6/d3e/d46/dd2/dee/f11d x:0 0 0 2024-09-13T02:53:13.495 INFO:tasks.workunit.client.0.smithi098.stdout:4/844: link d6/d3e/d46/f86 d6/d8d/f11e 0 2024-09-13T02:53:13.498 INFO:tasks.workunit.client.0.smithi098.stdout:4/845: rename d6/d22/d3d/d6c/la5 to d6/d22/d3d/dc8/dd5/df5/l11f 0 2024-09-13T02:53:13.500 INFO:tasks.workunit.client.0.smithi098.stdout:4/846: rename d6/d54/f88 to d6/d8d/f120 0 2024-09-13T02:53:13.502 INFO:tasks.workunit.client.0.smithi098.stdout:4/847: creat d6/d22/d3d/d41/f121 x:0 0 0 2024-09-13T02:53:13.505 INFO:tasks.workunit.client.0.smithi098.stdout:4/848: rename d6/d3e/d68/l34 to d6/d3e/d46/dd2/dee/l122 0 2024-09-13T02:53:13.507 INFO:tasks.workunit.client.0.smithi098.stdout:4/849: mknod d6/d3e/d73/dfc/d10c/c123 0 2024-09-13T02:53:13.519 INFO:tasks.workunit.client.0.smithi098.stdout:2/903: sync 2024-09-13T02:53:13.522 INFO:tasks.workunit.client.0.smithi098.stdout:4/850: write d6/d10/f9d [752631,82689] 0 2024-09-13T02:53:13.525 INFO:tasks.workunit.client.0.smithi098.stdout:4/851: rename d6/d22/d3d/d41/d74 to d6/d37/d124 0 2024-09-13T02:53:13.526 INFO:tasks.workunit.client.0.smithi098.stdout:4/852: fsync d6/d22/d3d/d64/f109 0 2024-09-13T02:53:13.527 INFO:tasks.workunit.client.0.smithi098.stdout:4/853: stat d6/d22 0 2024-09-13T02:53:13.532 INFO:tasks.workunit.client.0.smithi098.stdout:2/904: write d1/d1f/d30/def/f96 [3496370,53659] 0 2024-09-13T02:53:13.538 INFO:tasks.workunit.client.0.smithi098.stdout:2/905: dwrite d1/d1f/d39/fd8 [0,4194304] 0 2024-09-13T02:53:13.543 INFO:tasks.workunit.client.0.smithi098.stdout:4/854: dread d6/d54/f9b [0,4194304] 0 2024-09-13T02:53:13.546 INFO:tasks.workunit.client.0.smithi098.stdout:4/855: fsync d6/d22/d3d/d41/d58/da9/fc2 0 2024-09-13T02:53:13.550 INFO:tasks.workunit.client.0.smithi098.stdout:2/906: write d1/d1f/d39/fba [634824,125465] 0 2024-09-13T02:53:13.553 INFO:tasks.workunit.client.0.smithi098.stdout:4/856: rename d6/d10/d21/ld8 to d6/d37/d83/l125 0 2024-09-13T02:53:13.561 INFO:tasks.workunit.client.0.smithi098.stdout:4/857: dwrite d6/d22/d3d/d41/d58/da9/fc2 [0,4194304] 0 2024-09-13T02:53:13.564 INFO:tasks.workunit.client.0.smithi098.stdout:2/907: write d1/d1f/d35/f74 [2441500,59962] 0 2024-09-13T02:53:13.569 INFO:tasks.workunit.client.0.smithi098.stdout:4/858: write d6/db/f11a [855387,96082] 0 2024-09-13T02:53:13.572 INFO:tasks.workunit.client.0.smithi098.stdout:2/908: dwrite d1/d1f/d39/f21 [0,4194304] 0 2024-09-13T02:53:13.575 INFO:tasks.workunit.client.0.smithi098.stdout:4/859: mkdir d6/d22/d3d/d41/d126 0 2024-09-13T02:53:13.576 INFO:tasks.workunit.client.0.smithi098.stdout:4/860: readlink d6/d10/l26 0 2024-09-13T02:53:13.578 INFO:tasks.workunit.client.0.smithi098.stdout:2/909: creat d1/d1f/d30/def/d10b/d11d/f123 x:0 0 0 2024-09-13T02:53:13.580 INFO:tasks.workunit.client.0.smithi098.stdout:2/910: read d1/d1f/d35/d63/d72/f9b [653537,100692] 0 2024-09-13T02:53:13.582 INFO:tasks.workunit.client.0.smithi098.stdout:2/911: write d1/d1f/f42 [1694632,87405] 0 2024-09-13T02:53:13.583 INFO:tasks.workunit.client.0.smithi098.stdout:2/912: chown d1/d1f/d35/f71 167239 1 2024-09-13T02:53:13.583 INFO:tasks.workunit.client.0.smithi098.stdout:2/913: stat d1/d1f/l79 0 2024-09-13T02:53:13.601 INFO:tasks.workunit.client.0.smithi098.stdout:4/861: dread d6/d10/d21/f65 [0,4194304] 0 2024-09-13T02:53:13.601 INFO:tasks.workunit.client.0.smithi098.stdout:2/914: dwrite d1/d1f/d39/df6/d7f/f85 [0,4194304] 0 2024-09-13T02:53:13.604 INFO:tasks.workunit.client.0.smithi098.stdout:2/915: chown d1/da7/c105 589 1 2024-09-13T02:53:13.605 INFO:tasks.workunit.client.0.smithi098.stdout:4/862: creat d6/d37/d124/f127 x:0 0 0 2024-09-13T02:53:13.613 INFO:tasks.workunit.client.0.smithi098.stdout:4/863: write d6/d37/d7a/f89 [4865868,82821] 0 2024-09-13T02:53:13.614 INFO:tasks.workunit.client.0.smithi098.stdout:2/916: truncate d1/d1f/d39/df6/d59/fa2 132121 0 2024-09-13T02:53:13.616 INFO:tasks.workunit.client.0.smithi098.stdout:4/864: fsync d6/d3e/d46/f86 0 2024-09-13T02:53:13.617 INFO:tasks.workunit.client.0.smithi098.stdout:4/865: rename d6/d22/d3d to d6/d22/d3d/d41/d126/d128 22 2024-09-13T02:53:13.618 INFO:tasks.workunit.client.0.smithi098.stdout:4/866: stat d6/f61 0 2024-09-13T02:53:13.633 INFO:tasks.workunit.client.0.smithi098.stdout:2/917: dread d1/d1a/d9/d1e/f47 [0,4194304] 0 2024-09-13T02:53:13.637 INFO:tasks.workunit.client.0.smithi098.stdout:2/918: symlink d1/d1f/d39/df6/d59/d9e/d9f/l124 0 2024-09-13T02:53:13.639 INFO:tasks.workunit.client.0.smithi098.stdout:2/919: unlink d1/d1f/d30/def/fcb 0 2024-09-13T02:53:13.641 INFO:tasks.workunit.client.0.smithi098.stdout:4/867: dread d6/d37/f39 [0,4194304] 0 2024-09-13T02:53:13.648 INFO:tasks.workunit.client.0.smithi098.stdout:4/868: link d6/d22/d3d/f49 d6/d8d/db9/f129 0 2024-09-13T02:53:13.649 INFO:tasks.workunit.client.0.smithi098.stdout:2/920: write d1/d1a/d9/d1e/d5a/f5f [5113727,2674] 0 2024-09-13T02:53:13.650 INFO:tasks.workunit.client.0.smithi098.stdout:4/869: write d6/db/fb8 [4478129,93626] 0 2024-09-13T02:53:13.653 INFO:tasks.workunit.client.0.smithi098.stdout:4/870: creat d6/d3e/d46/dd2/f12a x:0 0 0 2024-09-13T02:53:13.654 INFO:tasks.workunit.client.0.smithi098.stdout:2/921: fsync d1/d1a/fc8 0 2024-09-13T02:53:13.655 INFO:tasks.workunit.client.0.smithi098.stdout:2/922: readlink d1/d1f/d27/lb3 0 2024-09-13T02:53:13.666 INFO:tasks.workunit.client.0.smithi098.stdout:4/871: write d6/d22/d3d/d4d/fbb [767616,80252] 0 2024-09-13T02:53:13.666 INFO:tasks.workunit.client.0.smithi098.stdout:4/872: chown d6/d10/l47 208 1 2024-09-13T02:53:13.673 INFO:tasks.workunit.client.0.smithi098.stdout:2/923: dwrite d1/d1f/d35/d63/f6c [0,4194304] 0 2024-09-13T02:53:13.675 INFO:tasks.workunit.client.0.smithi098.stdout:2/924: chown d1/f8 32941359 1 2024-09-13T02:53:13.677 INFO:tasks.workunit.client.0.smithi098.stdout:4/873: dwrite d6/d22/d3d/d6c/d91/fb1 [0,4194304] 0 2024-09-13T02:53:13.679 INFO:tasks.workunit.client.0.smithi098.stdout:2/925: chown d1/d1f/d35/d63/f9a 22548 1 2024-09-13T02:53:13.682 INFO:tasks.workunit.client.0.smithi098.stdout:4/874: creat d6/d22/d3d/f12b x:0 0 0 2024-09-13T02:53:13.682 INFO:tasks.workunit.client.0.smithi098.stdout:2/926: mkdir d1/d1f/d35/d63/d23/d125 0 2024-09-13T02:53:13.687 INFO:tasks.workunit.client.0.smithi098.stdout:4/875: unlink d6/d3e/d73/dfc/l102 0 2024-09-13T02:53:13.687 INFO:tasks.workunit.client.0.smithi098.stdout:2/927: fsync d1/d1a/d9/d1e/fe9 0 2024-09-13T02:53:13.701 INFO:tasks.workunit.client.0.smithi098.stdout:2/928: write d1/d1a/f7 [3225780,91223] 0 2024-09-13T02:53:13.705 INFO:tasks.workunit.client.0.smithi098.stdout:2/929: mkdir d1/da7/d122/d126 0 2024-09-13T02:53:13.706 INFO:tasks.workunit.client.0.smithi098.stdout:2/930: readlink d1/d1a/leb 0 2024-09-13T02:53:13.707 INFO:tasks.workunit.client.0.smithi098.stdout:4/876: dwrite d6/d3e/d46/dd2/fd9 [0,4194304] 0 2024-09-13T02:53:13.709 INFO:tasks.workunit.client.0.smithi098.stdout:4/877: rmdir d6/d10/ddc 39 2024-09-13T02:53:13.716 INFO:tasks.workunit.client.0.smithi098.stdout:2/931: rename d1/d1f/d35/d63/f37 to d1/d1f/d39/df6/d59/d9e/f127 0 2024-09-13T02:53:13.723 INFO:tasks.workunit.client.0.smithi098.stdout:2/932: dread d1/d1f/d35/d63/d72/f9b [0,4194304] 0 2024-09-13T02:53:13.728 INFO:tasks.workunit.client.0.smithi098.stdout:4/878: dwrite d6/d54/fc9 [0,4194304] 0 2024-09-13T02:53:13.731 INFO:tasks.workunit.client.0.smithi098.stdout:2/933: rename d1/d1f/d30/fa1 to d1/d1f/d35/d63/d72/f128 0 2024-09-13T02:53:13.732 INFO:tasks.workunit.client.0.smithi098.stdout:4/879: mkdir d6/d54/d12c 0 2024-09-13T02:53:13.737 INFO:tasks.workunit.client.0.smithi098.stdout:4/880: stat d6/d37/d124/d98/cf6 0 2024-09-13T02:53:13.740 INFO:tasks.workunit.client.0.smithi098.stdout:4/881: mkdir d6/d22/d3d/d6c/d91/d12d 0 2024-09-13T02:53:13.741 INFO:tasks.workunit.client.0.smithi098.stdout:2/934: rename d1/da7/fb5 to d1/f129 0 2024-09-13T02:53:13.747 INFO:tasks.workunit.client.0.smithi098.stdout:2/935: rename d1/d1f/d35/d63/d72/l11f to d1/d1f/d39/df6/d7f/l12a 0 2024-09-13T02:53:13.751 INFO:tasks.workunit.client.0.smithi098.stdout:4/882: getdents d6/d3e/d73 0 2024-09-13T02:53:13.753 INFO:tasks.workunit.client.0.smithi098.stdout:2/936: mknod d1/da7/d122/d126/c12b 0 2024-09-13T02:53:13.758 INFO:tasks.workunit.client.0.smithi098.stdout:4/883: write d6/d10/d21/f65 [5151608,53841] 0 2024-09-13T02:53:13.759 INFO:tasks.workunit.client.0.smithi098.stdout:2/937: write d1/d1f/d39/f8e [1331865,24671] 0 2024-09-13T02:53:13.759 INFO:tasks.workunit.client.0.smithi098.stdout:2/938: read - d1/d1f/f118 zero size 2024-09-13T02:53:13.761 INFO:tasks.workunit.client.0.smithi098.stdout:4/884: fdatasync d6/d54/f9f 0 2024-09-13T02:53:13.762 INFO:tasks.workunit.client.0.smithi098.stdout:4/885: stat d6/d22/d3d/d6c/d91/fb1 0 2024-09-13T02:53:13.762 INFO:tasks.workunit.client.0.smithi098.stdout:2/939: creat d1/da7/db8/f12c x:0 0 0 2024-09-13T02:53:13.763 INFO:tasks.workunit.client.0.smithi098.stdout:2/940: stat d1/fe5 0 2024-09-13T02:53:13.769 INFO:tasks.workunit.client.0.smithi098.stdout:2/941: stat d1/d1f/d35/d63/c38 0 2024-09-13T02:53:13.771 INFO:tasks.workunit.client.0.smithi098.stdout:2/942: mknod d1/d1f/d30/c12d 0 2024-09-13T02:53:13.773 INFO:tasks.workunit.client.0.smithi098.stdout:2/943: chown d1/d1f/d27/cc4 305 1 2024-09-13T02:53:13.775 INFO:tasks.workunit.client.0.smithi098.stdout:4/886: dwrite d6/d37/d7a/fa1 [0,4194304] 0 2024-09-13T02:53:13.778 INFO:tasks.workunit.client.0.smithi098.stdout:4/887: dread d6/d22/d3d/d4d/fbb [0,4194304] 0 2024-09-13T02:53:13.779 INFO:tasks.workunit.client.0.smithi098.stdout:4/888: chown d6/d3e/d73/dfc/l115 349 1 2024-09-13T02:53:13.788 INFO:tasks.workunit.client.0.smithi098.stdout:4/889: dwrite d6/d10/ddc/f106 [0,4194304] 0 2024-09-13T02:53:13.810 INFO:tasks.workunit.client.0.smithi098.stdout:4/890: dread d6/d22/d3d/d64/d6f/fd6 [0,4194304] 0 2024-09-13T02:53:13.985 INFO:tasks.workunit.client.0.smithi098.stdout:9/981: sync 2024-09-13T02:53:13.985 INFO:tasks.workunit.client.0.smithi098.stdout:9/982: fdatasync d2/d6/d2b/d66/f78 0 2024-09-13T02:53:13.991 INFO:tasks.workunit.client.0.smithi098.stdout:9/983: dwrite d2/d6/d2b/d66/de0/f13c [0,4194304] 0 2024-09-13T02:53:13.992 INFO:tasks.workunit.client.0.smithi098.stdout:9/984: stat d2/d6/d2b/d4d/d4f/d6c/dd4/d43/cc3 0 2024-09-13T02:53:13.993 INFO:tasks.workunit.client.0.smithi098.stdout:9/985: dread - d2/db1/dcb/f13d zero size 2024-09-13T02:53:14.018 INFO:tasks.workunit.client.0.smithi098.stdout:9/986: dwrite d2/d6/d2b/d4d/d56/f93 [0,4194304] 0 2024-09-13T02:53:14.019 INFO:tasks.workunit.client.0.smithi098.stdout:9/987: chown d2/d6/d36/d8d/dc8/d136 44905 1 2024-09-13T02:53:14.025 INFO:tasks.workunit.client.0.smithi098.stdout:9/988: rmdir d2/d6/d2b/d4d/d4f/d6c/d144 0 2024-09-13T02:53:14.182 INFO:tasks.workunit.client.0.smithi098.stdout:9/989: dwrite d2/f98 [0,4194304] 0 2024-09-13T02:53:14.190 INFO:tasks.workunit.client.0.smithi098.stdout:9/990: creat d2/d6/d91/d127/dbe/f150 x:0 0 0 2024-09-13T02:53:14.202 INFO:tasks.workunit.client.0.smithi098.stdout:9/991: creat d2/d6/d2b/d4d/d56/f151 x:0 0 0 2024-09-13T02:53:14.205 INFO:tasks.workunit.client.0.smithi098.stdout:9/992: rmdir d2/db1/dc5 39 2024-09-13T02:53:14.213 INFO:tasks.workunit.client.0.smithi098.stdout:9/993: creat d2/d6/d2b/d4d/d4f/d6c/dd4/d43/d90/f152 x:0 0 0 2024-09-13T02:53:14.215 INFO:tasks.workunit.client.0.smithi098.stdout:9/994: read d2/d6/d2b/d4d/d4f/d6c/dd4/f86 [211344,91563] 0 2024-09-13T02:53:14.215 INFO:tasks.workunit.client.0.smithi098.stdout:9/995: chown d2/db1 577885 1 2024-09-13T02:53:14.215 INFO:tasks.workunit.client.0.smithi098.stdout:0/949: sync 2024-09-13T02:53:14.223 INFO:tasks.workunit.client.0.smithi098.stdout:9/996: dwrite d2/d6/d2b/d4d/d4f/d6c/dd4/f5a [0,4194304] 0 2024-09-13T02:53:14.228 INFO:tasks.workunit.client.0.smithi098.stdout:0/950: mknod dd/df/d1d/da7/c14c 0 2024-09-13T02:53:14.230 INFO:tasks.workunit.client.0.smithi098.stdout:0/951: chown dd/df/d1d/da7/c14c 86760 1 2024-09-13T02:53:14.235 INFO:tasks.workunit.client.0.smithi098.stdout:9/997: rename d2/d6/d2b/d4d/d4f/l8a to d2/d6/d36/d8d/l153 0 2024-09-13T02:53:14.237 INFO:tasks.workunit.client.0.smithi098.stdout:9/998: rename d2/d6/d2b to d2/d6/d2b/d4d/d56/dbc/d154 22 2024-09-13T02:53:14.264 INFO:tasks.workunit.client.0.smithi098.stdout:4/891: sync 2024-09-13T02:53:14.264 INFO:tasks.workunit.client.0.smithi098.stdout:2/944: sync 2024-09-13T02:53:14.264 INFO:tasks.workunit.client.0.smithi098.stdout:8/856: sync 2024-09-13T02:53:14.264 INFO:tasks.workunit.client.0.smithi098.stdout:6/829: sync 2024-09-13T02:53:14.264 INFO:tasks.workunit.client.0.smithi098.stdout:5/864: sync 2024-09-13T02:53:14.265 INFO:tasks.workunit.client.0.smithi098.stdout:4/892: readlink d6/d37/l75 0 2024-09-13T02:53:14.267 INFO:tasks.workunit.client.0.smithi098.stdout:9/999: dread d2/d6/d2b/d4d/d4f/d6c/dd4/d43/f50 [0,4194304] 0 2024-09-13T02:53:14.293 INFO:tasks.workunit.client.0.smithi098.stdout:0/952: dwrite dd/df/d1d/d26/d28/d32/f49 [0,4194304] 0 2024-09-13T02:53:14.295 INFO:tasks.workunit.client.0.smithi098.stdout:0/953: fdatasync dd/df/d1d/d40/d46/d6b/d109/f111 0 2024-09-13T02:53:14.297 INFO:tasks.workunit.client.0.smithi098.stdout:0/954: dread - dd/d1f/d85/d9d/dc2/de4/fe7 zero size 2024-09-13T02:53:14.301 INFO:tasks.workunit.client.0.smithi098.stdout:8/857: fsync d2/dd/d4d/d96/f7e 0 2024-09-13T02:53:14.304 INFO:tasks.workunit.client.0.smithi098.stdout:6/830: rename d5/d13/d2b/d3a/l3d to d5/d13/d2b/d3a/d41/d55/l116 0 2024-09-13T02:53:14.305 INFO:tasks.workunit.client.0.smithi098.stdout:0/955: dwrite dd/df/d1d/d26/d28/d32/dda/d117/dea/f114 [0,4194304] 0 2024-09-13T02:53:14.306 INFO:tasks.workunit.client.0.smithi098.stdout:4/893: creat d6/d22/d3d/dc8/dd5/f12e x:0 0 0 2024-09-13T02:53:14.311 INFO:tasks.workunit.client.0.smithi098.stdout:2/945: mkdir d1/d1f/d39/d12e 0 2024-09-13T02:53:14.313 INFO:tasks.workunit.client.0.smithi098.stdout:5/865: truncate d0/d7c/fa3 306473 0 2024-09-13T02:53:14.313 INFO:tasks.workunit.client.0.smithi098.stdout:8/858: dwrite d2/d2f/d78/d5d/f95 [0,4194304] 0 2024-09-13T02:53:14.319 INFO:tasks.workunit.client.0.smithi098.stdout:4/894: chown d6/d10/d21/l9c 9 1 2024-09-13T02:53:14.320 INFO:tasks.workunit.client.0.smithi098.stdout:4/895: chown d6/d22/d3d/f110 21 1 2024-09-13T02:53:14.321 INFO:tasks.workunit.client.0.smithi098.stdout:4/896: write d6/d3e/f100 [3825235,100891] 0 2024-09-13T02:53:14.323 INFO:tasks.workunit.client.0.smithi098.stdout:0/956: mkdir dd/d1f/d85/d9d/dc9/d12a/d14d 0 2024-09-13T02:53:14.334 INFO:tasks.workunit.client.0.smithi098.stdout:2/946: dread d1/d1f/d39/df6/d7f/fee [0,4194304] 0 2024-09-13T02:53:14.336 INFO:tasks.workunit.client.0.smithi098.stdout:0/957: chown dd/d1f/d85/d9d/dc2/de4/dc7/de8/fe9 27517862 1 2024-09-13T02:53:14.336 INFO:tasks.workunit.client.0.smithi098.stdout:5/866: mknod d0/d38/d3f/d81/d9e/dd4/dfd/c125 0 2024-09-13T02:53:14.337 INFO:tasks.workunit.client.0.smithi098.stdout:5/867: readlink d0/d38/d3f/d81/d9e/led 0 2024-09-13T02:53:14.338 INFO:tasks.workunit.client.0.smithi098.stdout:4/897: dwrite d6/d3e/d46/dd2/fcd [0,4194304] 0 2024-09-13T02:53:14.340 INFO:tasks.workunit.client.0.smithi098.stdout:8/859: rename d2/f23 to d2/d2f/d78/d46/d74/dfe/f113 0 2024-09-13T02:53:14.346 INFO:tasks.workunit.client.0.smithi098.stdout:5/868: dread d0/d38/d3f/f5b [0,4194304] 0 2024-09-13T02:53:14.350 INFO:tasks.workunit.client.0.smithi098.stdout:0/958: creat dd/db9/dd7/d140/f14e x:0 0 0 2024-09-13T02:53:14.351 INFO:tasks.workunit.client.0.smithi098.stdout:0/959: readlink dd/df/d1d/d40/l68 0 2024-09-13T02:53:14.356 INFO:tasks.workunit.client.0.smithi098.stdout:4/898: mkdir d6/d3e/d73/dfc/d10c/d12f 0 2024-09-13T02:53:14.358 INFO:tasks.workunit.client.0.smithi098.stdout:6/831: getdents d5/d18/dcf 0 2024-09-13T02:53:14.359 INFO:tasks.workunit.client.0.smithi098.stdout:5/869: dread d0/d15/d17/d1c/dd6/fef [0,4194304] 0 2024-09-13T02:53:14.365 INFO:tasks.workunit.client.0.smithi098.stdout:2/947: truncate d1/d1f/d35/d63/d72/f128 992349 0 2024-09-13T02:53:14.365 INFO:tasks.workunit.client.0.smithi098.stdout:6/832: dwrite d5/d36/f105 [0,4194304] 0 2024-09-13T02:53:14.373 INFO:tasks.workunit.client.0.smithi098.stdout:2/948: dread d1/d1f/d30/def/ff5 [0,4194304] 0 2024-09-13T02:53:14.374 INFO:tasks.workunit.client.0.smithi098.stdout:2/949: chown d1/d1f/d36 7 1 2024-09-13T02:53:14.381 INFO:tasks.workunit.client.0.smithi098.stdout:8/860: fdatasync d2/dd/d11/d1d/f3a 0 2024-09-13T02:53:14.381 INFO:tasks.workunit.client.0.smithi098.stdout:8/861: stat d2/dd/c92 0 2024-09-13T02:53:14.394 INFO:tasks.workunit.client.0.smithi098.stdout:5/870: symlink d0/d38/d3f/d1a/l126 0 2024-09-13T02:53:14.395 INFO:tasks.workunit.client.0.smithi098.stdout:5/871: read - d0/d15/d17/d1c/d3d/f118 zero size 2024-09-13T02:53:14.398 INFO:tasks.workunit.client.0.smithi098.stdout:2/950: mkdir d1/d12f 0 2024-09-13T02:53:14.399 INFO:tasks.workunit.client.0.smithi098.stdout:0/960: write dd/d1f/f25 [4040362,36871] 0 2024-09-13T02:53:14.401 INFO:tasks.workunit.client.0.smithi098.stdout:5/872: symlink d0/d38/d3f/d81/d4d/d82/d9a/l127 0 2024-09-13T02:53:14.402 INFO:tasks.workunit.client.0.smithi098.stdout:5/873: readlink d0/d38/d3f/d81/d4d/lb0 0 2024-09-13T02:53:14.403 INFO:tasks.workunit.client.0.smithi098.stdout:5/874: chown d0/d38/d102/c11a 42313674 1 2024-09-13T02:53:14.403 INFO:tasks.workunit.client.0.smithi098.stdout:2/951: mknod d1/da7/de4/c130 0 2024-09-13T02:53:14.404 INFO:tasks.workunit.client.0.smithi098.stdout:4/899: write d6/d22/d3d/d64/d6f/ff4 [1620968,78022] 0 2024-09-13T02:53:14.407 INFO:tasks.workunit.client.0.smithi098.stdout:0/961: fdatasync dd/f45 0 2024-09-13T02:53:14.413 INFO:tasks.workunit.client.0.smithi098.stdout:8/862: link d2/dd/d11/d44/c9e d2/d2f/d78/d46/d74/dfe/c114 0 2024-09-13T02:53:14.415 INFO:tasks.workunit.client.0.smithi098.stdout:6/833: dwrite d5/d18/d50/fc9 [0,4194304] 0 2024-09-13T02:53:14.421 INFO:tasks.workunit.client.0.smithi098.stdout:2/952: symlink d1/d1f/d39/l131 0 2024-09-13T02:53:14.422 INFO:tasks.workunit.client.0.smithi098.stdout:2/953: chown d1/d1f/d30/def/da8 134 1 2024-09-13T02:53:14.429 INFO:tasks.workunit.client.0.smithi098.stdout:8/863: fdatasync d2/dd/f25 0 2024-09-13T02:53:14.431 INFO:tasks.workunit.client.0.smithi098.stdout:4/900: creat d6/d3e/d46/dd2/dee/d111/f130 x:0 0 0 2024-09-13T02:53:14.435 INFO:tasks.workunit.client.0.smithi098.stdout:4/901: write d6/d22/d3d/d41/d58/da9/f11b [58494,71057] 0 2024-09-13T02:53:14.435 INFO:tasks.workunit.client.0.smithi098.stdout:5/875: dwrite d0/d15/d17/daa/fb8 [0,4194304] 0 2024-09-13T02:53:14.438 INFO:tasks.workunit.client.0.smithi098.stdout:8/864: mkdir d2/d2f/d115 0 2024-09-13T02:53:14.441 INFO:tasks.workunit.client.0.smithi098.stdout:5/876: mkdir d0/d15/d17/d1c/d128 0 2024-09-13T02:53:14.443 INFO:tasks.workunit.client.0.smithi098.stdout:4/902: symlink d6/d22/d3d/d6c/d91/l131 0 2024-09-13T02:53:14.450 INFO:tasks.workunit.client.0.smithi098.stdout:0/962: rename dd/df/d1d/c83 to dd/d1f/c14f 0 2024-09-13T02:53:14.452 INFO:tasks.workunit.client.0.smithi098.stdout:2/954: dwrite d1/d1f/d39/df6/d59/d9e/d9f/dc1/ff9 [0,4194304] 0 2024-09-13T02:53:14.462 INFO:tasks.workunit.client.0.smithi098.stdout:6/834: dread d5/f33 [0,4194304] 0 2024-09-13T02:53:14.462 INFO:tasks.workunit.client.0.smithi098.stdout:2/955: dwrite d1/fa6 [0,4194304] 0 2024-09-13T02:53:14.464 INFO:tasks.workunit.client.0.smithi098.stdout:0/963: creat dd/d1f/d85/d9d/dc2/de4/f150 x:0 0 0 2024-09-13T02:53:14.467 INFO:tasks.workunit.client.0.smithi098.stdout:8/865: mknod d2/d2f/d78/dae/c116 0 2024-09-13T02:53:14.468 INFO:tasks.workunit.client.0.smithi098.stdout:6/835: fsync d5/d13/d2b/d5b/f63 0 2024-09-13T02:53:14.470 INFO:tasks.workunit.client.0.smithi098.stdout:6/836: chown d5/ca 41468002 1 2024-09-13T02:53:14.472 INFO:tasks.workunit.client.0.smithi098.stdout:0/964: dwrite dd/df/d1d/da7/f141 [0,4194304] 0 2024-09-13T02:53:14.475 INFO:tasks.workunit.client.0.smithi098.stdout:8/866: creat d2/d2f/d78/d46/d74/d86/da8/f117 x:0 0 0 2024-09-13T02:53:14.476 INFO:tasks.workunit.client.0.smithi098.stdout:8/867: stat d2/d2f/d78/d46/d74/d86 0 2024-09-13T02:53:14.479 INFO:tasks.workunit.client.0.smithi098.stdout:2/956: creat d1/d1f/d35/d63/d72/f132 x:0 0 0 2024-09-13T02:53:14.480 INFO:tasks.workunit.client.0.smithi098.stdout:0/965: mkdir dd/df/d1d/d40/d46/d6b/d151 0 2024-09-13T02:53:14.481 INFO:tasks.workunit.client.0.smithi098.stdout:0/966: chown dd/df/d1d/d26/d28/f11b 20 1 2024-09-13T02:53:14.482 INFO:tasks.workunit.client.0.smithi098.stdout:0/967: chown dd/df/d1d/d26/d28/d32 459 1 2024-09-13T02:53:14.483 INFO:tasks.workunit.client.0.smithi098.stdout:2/957: rename d1/f11b to d1/d1a/d9/f133 0 2024-09-13T02:53:14.485 INFO:tasks.workunit.client.0.smithi098.stdout:0/968: creat dd/df/d1d/d40/f152 x:0 0 0 2024-09-13T02:53:14.487 INFO:tasks.workunit.client.0.smithi098.stdout:0/969: dread - dd/df/d1d/d26/d28/d32/d67/d71/dbd/fed zero size 2024-09-13T02:53:14.489 INFO:tasks.workunit.client.0.smithi098.stdout:0/970: symlink dd/d1f/d85/d9d/dc2/de4/dc7/l153 0 2024-09-13T02:53:14.496 INFO:tasks.workunit.client.0.smithi098.stdout:8/868: dread d2/dd/d4d/d96/f7e [0,4194304] 0 2024-09-13T02:53:14.498 INFO:tasks.workunit.client.0.smithi098.stdout:5/877: dread d0/d15/d17/f26 [0,4194304] 0 2024-09-13T02:53:14.499 INFO:tasks.workunit.client.0.smithi098.stdout:5/878: chown d0/d15/d17/daa/l117 10462280 1 2024-09-13T02:53:14.500 INFO:tasks.workunit.client.0.smithi098.stdout:0/971: mkdir dd/df/d1d/d26/d28/d32/d8d/d154 0 2024-09-13T02:53:14.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/869: mkdir d2/d28/d43/d88/df2/d118 0 2024-09-13T02:53:14.505 INFO:tasks.workunit.client.0.smithi098.stdout:0/972: unlink dd/d1f/d85/d9d/dc2/d13f/c14a 0 2024-09-13T02:53:14.507 INFO:tasks.workunit.client.0.smithi098.stdout:8/870: symlink d2/d28/d43/d88/d99/l119 0 2024-09-13T02:53:14.509 INFO:tasks.workunit.client.0.smithi098.stdout:0/973: truncate dd/df/d1d/d26/d28/f72 3383932 0 2024-09-13T02:53:14.514 INFO:tasks.workunit.client.0.smithi098.stdout:0/974: fdatasync dd/df/d1d/d26/d28/f72 0 2024-09-13T02:53:14.516 INFO:tasks.workunit.client.0.smithi098.stdout:8/871: dwrite d2/d2f/d78/d5d/de3/f108 [0,4194304] 0 2024-09-13T02:53:14.528 INFO:tasks.workunit.client.0.smithi098.stdout:5/879: write d0/d7c/fa3 [1179801,48624] 0 2024-09-13T02:53:14.535 INFO:tasks.workunit.client.0.smithi098.stdout:5/880: mknod d0/d7c/c129 0 2024-09-13T02:53:14.541 INFO:tasks.workunit.client.0.smithi098.stdout:8/872: truncate d2/dd/fd1 1838005 0 2024-09-13T02:53:14.541 INFO:tasks.workunit.client.0.smithi098.stdout:0/975: dwrite dd/df/d1d/d40/d46/d6b/fb1 [0,4194304] 0 2024-09-13T02:53:14.544 INFO:tasks.workunit.client.0.smithi098.stdout:5/881: dwrite d0/d15/d17/d1c/d3d/f47 [4194304,4194304] 0 2024-09-13T02:53:14.545 INFO:tasks.workunit.client.0.smithi098.stdout:0/976: chown dd/df/d1d/d26/d28/d32/d67/d82/df0 1524 1 2024-09-13T02:53:14.546 INFO:tasks.workunit.client.0.smithi098.stdout:0/977: chown dd/d1f/d85/dfc 498 1 2024-09-13T02:53:14.550 INFO:tasks.workunit.client.0.smithi098.stdout:8/873: unlink d2/d2f/d78/dae/f106 0 2024-09-13T02:53:14.553 INFO:tasks.workunit.client.0.smithi098.stdout:5/882: readlink d0/d15/d50/l6e 0 2024-09-13T02:53:14.554 INFO:tasks.workunit.client.0.smithi098.stdout:2/958: dwrite d1/d1a/d9/d1e/f47 [8388608,4194304] 0 2024-09-13T02:53:14.555 INFO:tasks.workunit.client.0.smithi098.stdout:5/883: chown d0/d15/d17/daa/dab/fc6 1484510285 1 2024-09-13T02:53:14.556 INFO:tasks.workunit.client.0.smithi098.stdout:2/959: stat d1/da7/d122/d126 0 2024-09-13T02:53:14.557 INFO:tasks.workunit.client.0.smithi098.stdout:0/978: rmdir dd/db9 39 2024-09-13T02:53:14.567 INFO:tasks.workunit.client.0.smithi098.stdout:2/960: chown d1/d1a/d9/fdb 920139 1 2024-09-13T02:53:14.573 INFO:tasks.workunit.client.0.smithi098.stdout:5/884: creat d0/d38/d3f/d1a/d27/d11c/f12a x:0 0 0 2024-09-13T02:53:14.573 INFO:tasks.workunit.client.0.smithi098.stdout:5/885: fsync d0/d15/d17/daa/dab/fc6 0 2024-09-13T02:53:14.576 INFO:tasks.workunit.client.0.smithi098.stdout:8/874: creat d2/d2f/d78/d46/f11a x:0 0 0 2024-09-13T02:53:14.577 INFO:tasks.workunit.client.0.smithi098.stdout:0/979: write dd/df/d1d/d26/d28/f11b [257471,54985] 0 2024-09-13T02:53:14.578 INFO:tasks.workunit.client.0.smithi098.stdout:2/961: mkdir d1/d1a/d9/d134 0 2024-09-13T02:53:14.580 INFO:tasks.workunit.client.0.smithi098.stdout:2/962: dread - d1/da7/db8/f114 zero size 2024-09-13T02:53:14.581 INFO:tasks.workunit.client.0.smithi098.stdout:2/963: fdatasync d1/da7/de4/f117 0 2024-09-13T02:53:14.583 INFO:tasks.workunit.client.0.smithi098.stdout:2/964: write d1/d1f/d39/f21 [3872998,84871] 0 2024-09-13T02:53:14.591 INFO:tasks.workunit.client.0.smithi098.stdout:2/965: rename d1/d1f/d39/df6/d7f/lb1 to d1/da7/db8/l135 0 2024-09-13T02:53:14.592 INFO:tasks.workunit.client.0.smithi098.stdout:8/875: dread d2/dd/d11/d44/f63 [0,4194304] 0 2024-09-13T02:53:14.593 INFO:tasks.workunit.client.0.smithi098.stdout:2/966: readlink d1/d1f/d35/lda 0 2024-09-13T02:53:14.593 INFO:tasks.workunit.client.0.smithi098.stdout:0/980: truncate dd/db9/dd7/f103 670001 0 2024-09-13T02:53:14.595 INFO:tasks.workunit.client.0.smithi098.stdout:5/886: dwrite d0/d15/f80 [0,4194304] 0 2024-09-13T02:53:14.596 INFO:tasks.workunit.client.0.smithi098.stdout:2/967: rmdir d1/d1f/d30 39 2024-09-13T02:53:14.603 INFO:tasks.workunit.client.0.smithi098.stdout:5/887: mknod d0/d15/d17/d1c/c12b 0 2024-09-13T02:53:14.606 INFO:tasks.workunit.client.0.smithi098.stdout:0/981: rename dd/df/c1e to dd/d1f/d85/d9d/dc9/c155 0 2024-09-13T02:53:14.607 INFO:tasks.workunit.client.0.smithi098.stdout:8/876: creat d2/d2f/d78/d5d/f11b x:0 0 0 2024-09-13T02:53:14.609 INFO:tasks.workunit.client.0.smithi098.stdout:5/888: creat d0/d15/d17/d1c/d3d/f12c x:0 0 0 2024-09-13T02:53:14.613 INFO:tasks.workunit.client.0.smithi098.stdout:2/968: rmdir d1/d1f/d39/df6/d59/d9e/d9f/dc1/d113/d121 0 2024-09-13T02:53:14.615 INFO:tasks.workunit.client.0.smithi098.stdout:8/877: dwrite d2/d2f/d78/d46/d74/d86/dd2/ff7 [0,4194304] 0 2024-09-13T02:53:14.624 INFO:tasks.workunit.client.0.smithi098.stdout:8/878: dwrite d2/dd/fde [0,4194304] 0 2024-09-13T02:53:14.631 INFO:tasks.workunit.client.0.smithi098.stdout:0/982: dwrite dd/df/d1d/d40/d9b/fd0 [0,4194304] 0 2024-09-13T02:53:14.690 INFO:tasks.workunit.client.0.smithi098.stdout:5/889: write d0/d38/d3f/d1a/f98 [763985,109118] 0 2024-09-13T02:53:14.694 INFO:tasks.workunit.client.0.smithi098.stdout:2/969: dwrite d1/d1f/d39/df6/d7f/fae [0,4194304] 0 2024-09-13T02:53:14.701 INFO:tasks.workunit.client.0.smithi098.stdout:2/970: mknod d1/c136 0 2024-09-13T02:53:14.704 INFO:tasks.workunit.client.0.smithi098.stdout:0/983: dwrite dd/df/d1d/d26/d28/d32/f137 [0,4194304] 0 2024-09-13T02:53:14.707 INFO:tasks.workunit.client.0.smithi098.stdout:2/971: unlink d1/d1f/d36/l50 0 2024-09-13T02:53:14.710 INFO:tasks.workunit.client.0.smithi098.stdout:5/890: dwrite d0/d29/fd5 [0,4194304] 0 2024-09-13T02:53:14.713 INFO:tasks.workunit.client.0.smithi098.stdout:5/891: read - d0/d57/fff zero size 2024-09-13T02:53:14.713 INFO:tasks.workunit.client.0.smithi098.stdout:2/972: creat d1/d1f/d39/df6/d116/f137 x:0 0 0 2024-09-13T02:53:14.715 INFO:tasks.workunit.client.0.smithi098.stdout:5/892: dread - d0/d38/d3f/d1a/d27/f112 zero size 2024-09-13T02:53:14.716 INFO:tasks.workunit.client.0.smithi098.stdout:0/984: dwrite dd/df/d1d/d40/d46/d6b/d109/f111 [0,4194304] 0 2024-09-13T02:53:14.717 INFO:tasks.workunit.client.0.smithi098.stdout:0/985: chown dd/fd9 11066730 1 2024-09-13T02:53:14.730 INFO:tasks.workunit.client.0.smithi098.stdout:0/986: write dd/df/d1d/d26/d28/d32/dda/d117/f146 [132270,124879] 0 2024-09-13T02:53:14.732 INFO:tasks.workunit.client.0.smithi098.stdout:0/987: fsync dd/d1f/d85/d9d/fd1 0 2024-09-13T02:53:14.733 INFO:tasks.workunit.client.0.smithi098.stdout:2/973: dwrite d1/d1f/d27/f61 [0,4194304] 0 2024-09-13T02:53:14.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:14 smithi098 ceph-mon[27886]: pgmap v36: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 43 MiB/s rd, 102 MiB/s wr, 323 op/s 2024-09-13T02:53:14.737 INFO:tasks.workunit.client.0.smithi098.stdout:2/974: rename d1/d1f/d35/d63/d23/c7e to d1/da7/c138 0 2024-09-13T02:53:14.749 INFO:tasks.workunit.client.0.smithi098.stdout:5/893: write d0/d38/d102/fb5 [85744,33658] 0 2024-09-13T02:53:14.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:14 smithi142 ceph-mon[33443]: pgmap v36: 65 pgs: 65 active+clean; 3.3 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 43 MiB/s rd, 102 MiB/s wr, 323 op/s 2024-09-13T02:53:14.752 INFO:tasks.workunit.client.0.smithi098.stdout:5/894: creat d0/d29/f12d x:0 0 0 2024-09-13T02:53:14.757 INFO:tasks.workunit.client.0.smithi098.stdout:2/975: dwrite d1/d1a/d9/d1e/d5a/f86 [0,4194304] 0 2024-09-13T02:53:14.761 INFO:tasks.workunit.client.0.smithi098.stdout:2/976: symlink d1/da7/d122/d126/l139 0 2024-09-13T02:53:14.768 INFO:tasks.workunit.client.0.smithi098.stdout:2/977: getdents d1/da7/db8 0 2024-09-13T02:53:14.769 INFO:tasks.workunit.client.0.smithi098.stdout:5/895: dwrite d0/d15/d17/d1c/f96 [0,4194304] 0 2024-09-13T02:53:14.772 INFO:tasks.workunit.client.0.smithi098.stdout:5/896: creat d0/d7c/f12e x:0 0 0 2024-09-13T02:53:14.773 INFO:tasks.workunit.client.0.smithi098.stdout:2/978: creat d1/d1f/d30/def/df0/f13a x:0 0 0 2024-09-13T02:53:14.775 INFO:tasks.workunit.client.0.smithi098.stdout:5/897: creat d0/d38/d3f/d1a/d27/f12f x:0 0 0 2024-09-13T02:53:14.776 INFO:tasks.workunit.client.0.smithi098.stdout:2/979: rmdir d1/d1f/d39/df6/d59 39 2024-09-13T02:53:14.778 INFO:tasks.workunit.client.0.smithi098.stdout:5/898: read - d0/d15/d69/ff4 zero size 2024-09-13T02:53:14.779 INFO:tasks.workunit.client.0.smithi098.stdout:5/899: dread - d0/d15/d17/daa/f109 zero size 2024-09-13T02:53:14.784 INFO:tasks.workunit.client.0.smithi098.stdout:2/980: dread d1/d1f/d35/d63/d72/f78 [0,4194304] 0 2024-09-13T02:53:14.790 INFO:tasks.workunit.client.0.smithi098.stdout:2/981: dwrite d1/d1f/d35/d63/d72/ffd [0,4194304] 0 2024-09-13T02:53:14.800 INFO:tasks.workunit.client.0.smithi098.stdout:5/900: truncate d0/d38/f55 2548713 0 2024-09-13T02:53:14.800 INFO:tasks.workunit.client.0.smithi098.stdout:2/982: link d1/d1f/d39/df6/d7f/lf8 d1/d1f/d39/d12e/l13b 0 2024-09-13T02:53:14.803 INFO:tasks.workunit.client.0.smithi098.stdout:2/983: creat d1/d1f/d39/df6/d7f/f13c x:0 0 0 2024-09-13T02:53:14.804 INFO:tasks.workunit.client.0.smithi098.stdout:5/901: symlink d0/d15/d17/d1c/d128/l130 0 2024-09-13T02:53:14.809 INFO:tasks.workunit.client.0.smithi098.stdout:2/984: rename d1/d1f/d30/fce to d1/d1a/d9/d1e/d5a/f13d 0 2024-09-13T02:53:14.811 INFO:tasks.workunit.client.0.smithi098.stdout:5/902: dwrite d0/f4b [4194304,4194304] 0 2024-09-13T02:53:14.815 INFO:tasks.workunit.client.0.smithi098.stdout:5/903: creat d0/d38/d3f/d81/d9e/dd4/dfd/f131 x:0 0 0 2024-09-13T02:53:14.816 INFO:tasks.workunit.client.0.smithi098.stdout:5/904: chown d0/d15/d17/d1c/d3d/lc8 12214860 1 2024-09-13T02:53:14.820 INFO:tasks.workunit.client.0.smithi098.stdout:5/905: creat d0/d15/f132 x:0 0 0 2024-09-13T02:53:14.825 INFO:tasks.workunit.client.0.smithi098.stdout:5/906: truncate d0/d29/f3e 637585 0 2024-09-13T02:53:14.843 INFO:tasks.workunit.client.0.smithi098.stdout:5/907: dwrite d0/d15/d17/d1c/d3d/f12c [0,4194304] 0 2024-09-13T02:53:14.846 INFO:tasks.workunit.client.0.smithi098.stdout:5/908: truncate d0/d7c/fa0 1122657 0 2024-09-13T02:53:14.848 INFO:tasks.workunit.client.0.smithi098.stdout:5/909: chown d0/d29/f12d 15 1 2024-09-13T02:53:14.852 INFO:tasks.workunit.client.0.smithi098.stdout:5/910: creat d0/d15/d17/d1c/d3d/df9/f133 x:0 0 0 2024-09-13T02:53:14.854 INFO:tasks.workunit.client.0.smithi098.stdout:5/911: creat d0/d15/d17/d1c/dd6/f134 x:0 0 0 2024-09-13T02:53:14.856 INFO:tasks.workunit.client.0.smithi098.stdout:5/912: mkdir d0/d38/d3f/d81/d9e/dd4/dfd/d135 0 2024-09-13T02:53:14.858 INFO:tasks.workunit.client.0.smithi098.stdout:5/913: write d0/d15/d17/d1c/d3d/df9/f106 [2258487,81722] 0 2024-09-13T02:53:14.863 INFO:tasks.workunit.client.0.smithi098.stdout:5/914: dread d0/d38/d3f/fdb [0,4194304] 0 2024-09-13T02:53:14.868 INFO:tasks.workunit.client.0.smithi098.stdout:5/915: link d0/d57/fff d0/d15/d17/daa/f136 0 2024-09-13T02:53:14.870 INFO:tasks.workunit.client.0.smithi098.stdout:5/916: chown d0/d38/d3f/d1a/f86 5 1 2024-09-13T02:53:14.876 INFO:tasks.workunit.client.0.smithi098.stdout:5/917: dwrite d0/d15/f87 [0,4194304] 0 2024-09-13T02:53:14.884 INFO:tasks.workunit.client.0.smithi098.stdout:5/918: dwrite d0/d15/d17/daa/fb8 [0,4194304] 0 2024-09-13T02:53:14.887 INFO:tasks.workunit.client.0.smithi098.stdout:5/919: unlink d0/d29/fe3 0 2024-09-13T02:53:14.890 INFO:tasks.workunit.client.0.smithi098.stdout:5/920: mknod d0/d38/d3f/d81/d4d/d82/d9a/d111/c137 0 2024-09-13T02:53:14.947 INFO:tasks.workunit.client.0.smithi098.stdout:5/921: dwrite d0/d38/d3f/d81/f33 [0,4194304] 0 2024-09-13T02:53:14.948 INFO:tasks.workunit.client.0.smithi098.stdout:5/922: chown d0/d29/f12d 48082 1 2024-09-13T02:53:14.955 INFO:tasks.workunit.client.0.smithi098.stdout:5/923: dwrite d0/d15/d17/f26 [0,4194304] 0 2024-09-13T02:53:15.404 INFO:tasks.workunit.client.0.smithi098.stdout:4/903: sync 2024-09-13T02:53:15.405 INFO:tasks.workunit.client.0.smithi098.stdout:4/904: readlink d6/d22/d3d/d41/l62 0 2024-09-13T02:53:15.407 INFO:tasks.workunit.client.0.smithi098.stdout:4/905: mkdir d6/d3e/d46/dd2/dee/d111/d132 0 2024-09-13T02:53:15.409 INFO:tasks.workunit.client.0.smithi098.stdout:4/906: mknod d6/d22/d3d/d64/c133 0 2024-09-13T02:53:15.412 INFO:tasks.workunit.client.0.smithi098.stdout:4/907: creat d6/d22/d3d/d4d/f134 x:0 0 0 2024-09-13T02:53:15.417 INFO:tasks.workunit.client.0.smithi098.stdout:4/908: link d6/d54/ld3 d6/d3e/d73/dfc/d10c/l135 0 2024-09-13T02:53:15.419 INFO:tasks.workunit.client.0.smithi098.stdout:4/909: dread - d6/d22/d3d/d6c/d91/fbf zero size 2024-09-13T02:53:15.429 INFO:tasks.workunit.client.0.smithi098.stdout:4/910: dwrite d6/ffa [0,4194304] 0 2024-09-13T02:53:15.432 INFO:tasks.workunit.client.0.smithi098.stdout:4/911: mkdir d6/db/d136 0 2024-09-13T02:53:15.437 INFO:tasks.workunit.client.0.smithi098.stdout:4/912: getdents d6/d22/d3d/d41/d58/da9 0 2024-09-13T02:53:15.442 INFO:tasks.workunit.client.0.smithi098.stdout:4/913: write d6/d3e/d68/fad [1483714,97696] 0 2024-09-13T02:53:15.455 INFO:tasks.workunit.client.0.smithi098.stdout:4/914: dwrite d6/d37/d83/fcc [0,4194304] 0 2024-09-13T02:53:15.456 INFO:tasks.workunit.client.0.smithi098.stdout:4/915: dread - d6/d22/d3d/d41/d58/f108 zero size 2024-09-13T02:53:15.461 INFO:tasks.workunit.client.0.smithi098.stdout:4/916: creat d6/d22/d3d/d41/d58/da9/f137 x:0 0 0 2024-09-13T02:53:15.466 INFO:tasks.workunit.client.0.smithi098.stdout:4/917: link d6/d22/d3d/d64/cb5 d6/d22/d3d/d6c/d91/c138 0 2024-09-13T02:53:15.467 INFO:tasks.workunit.client.0.smithi098.stdout:4/918: write d6/d22/d3d/d41/d58/da9/fc2 [1610474,4025] 0 2024-09-13T02:53:15.468 INFO:tasks.workunit.client.0.smithi098.stdout:8/879: sync 2024-09-13T02:53:15.469 INFO:tasks.workunit.client.0.smithi098.stdout:6/837: sync 2024-09-13T02:53:15.469 INFO:tasks.workunit.client.0.smithi098.stdout:5/924: sync 2024-09-13T02:53:15.469 INFO:tasks.workunit.client.0.smithi098.stdout:0/988: sync 2024-09-13T02:53:15.469 INFO:tasks.workunit.client.0.smithi098.stdout:2/985: sync 2024-09-13T02:53:15.471 INFO:tasks.workunit.client.0.smithi098.stdout:5/925: write d0/d15/d17/d1c/f99 [3501159,73947] 0 2024-09-13T02:53:15.472 INFO:tasks.workunit.client.0.smithi098.stdout:4/919: truncate d6/d22/d3d/d64/fb4 3640410 0 2024-09-13T02:53:15.473 INFO:tasks.workunit.client.0.smithi098.stdout:2/986: mknod d1/d1f/d27/c13e 0 2024-09-13T02:53:15.473 INFO:tasks.workunit.client.0.smithi098.stdout:5/926: fdatasync d0/d15/d17/daa/f109 0 2024-09-13T02:53:15.474 INFO:tasks.workunit.client.0.smithi098.stdout:5/927: read d0/d15/f87 [2224595,58668] 0 2024-09-13T02:53:15.477 INFO:tasks.workunit.client.0.smithi098.stdout:0/989: creat dd/d1f/d85/d9d/dc2/de4/dc7/f156 x:0 0 0 2024-09-13T02:53:15.481 INFO:tasks.workunit.client.0.smithi098.stdout:5/928: chown d0/d15/d50/dd3/cfc 14675 1 2024-09-13T02:53:15.482 INFO:tasks.workunit.client.0.smithi098.stdout:5/929: write d0/d57/fce [3170923,106525] 0 2024-09-13T02:53:15.488 INFO:tasks.workunit.client.0.smithi098.stdout:0/990: truncate dd/df/d1d/d40/d46/d6b/ffb 320965 0 2024-09-13T02:53:15.488 INFO:tasks.workunit.client.0.smithi098.stdout:0/991: chown dd/db9 1 1 2024-09-13T02:53:15.492 INFO:tasks.workunit.client.0.smithi098.stdout:5/930: rmdir d0/d15/d17/d1c 39 2024-09-13T02:53:15.493 INFO:tasks.workunit.client.0.smithi098.stdout:8/880: link d2/d2f/d78/d46/d74/d86/lc8 d2/d2f/d78/d46/d74/d86/dd2/l11c 0 2024-09-13T02:53:15.494 INFO:tasks.workunit.client.0.smithi098.stdout:4/920: dwrite d6/d22/d3d/ff2 [0,4194304] 0 2024-09-13T02:53:15.496 INFO:tasks.workunit.client.0.smithi098.stdout:0/992: dread dd/df/d1d/d40/d46/d6b/fb1 [0,4194304] 0 2024-09-13T02:53:15.499 INFO:tasks.workunit.client.0.smithi098.stdout:6/838: getdents d5/d13/d2b/d3a/d5a/da8 0 2024-09-13T02:53:15.502 INFO:tasks.workunit.client.0.smithi098.stdout:5/931: dwrite d0/d38/d3f/d1a/f98 [0,4194304] 0 2024-09-13T02:53:15.502 INFO:tasks.workunit.client.0.smithi098.stdout:6/839: chown d5/d13/d2b/d3a/d41/d55/l74 331 1 2024-09-13T02:53:15.502 INFO:tasks.workunit.client.0.smithi098.stdout:4/921: readlink l4 0 2024-09-13T02:53:15.504 INFO:tasks.workunit.client.0.smithi098.stdout:2/987: link d1/d1a/d9/l8a d1/da7/d109/d11c/l13f 0 2024-09-13T02:53:15.506 INFO:tasks.workunit.client.0.smithi098.stdout:8/881: fsync d2/dd/d11/d1d/f24 0 2024-09-13T02:53:15.508 INFO:tasks.workunit.client.0.smithi098.stdout:8/882: write d2/d2f/d78/d46/fbc [225616,48766] 0 2024-09-13T02:53:15.515 INFO:tasks.workunit.client.0.smithi098.stdout:0/993: write dd/f2d [2890954,27853] 0 2024-09-13T02:53:15.518 INFO:tasks.workunit.client.0.smithi098.stdout:2/988: readlink d1/d1a/d9/d1e/l20 0 2024-09-13T02:53:15.521 INFO:tasks.workunit.client.0.smithi098.stdout:8/883: mkdir d2/d2f/d78/d46/d74/d86/dd2/d11d 0 2024-09-13T02:53:15.527 INFO:tasks.workunit.client.0.smithi098.stdout:5/932: rename d0/d38/d3f/d81/d4d/d82/ldc to d0/d15/d69/dfa/l138 0 2024-09-13T02:53:15.533 INFO:tasks.workunit.client.0.smithi098.stdout:6/840: dread d5/d13/d2b/d3a/d41/f95 [0,4194304] 0 2024-09-13T02:53:15.538 INFO:tasks.workunit.client.0.smithi098.stdout:2/989: dwrite d1/ff7 [0,4194304] 0 2024-09-13T02:53:15.539 INFO:tasks.workunit.client.0.smithi098.stdout:5/933: mknod d0/d38/d102/dde/c139 0 2024-09-13T02:53:15.539 INFO:tasks.workunit.client.0.smithi098.stdout:5/934: write d0/d29/f12d [785955,113096] 0 2024-09-13T02:53:15.542 INFO:tasks.workunit.client.0.smithi098.stdout:6/841: creat d5/d6f/f117 x:0 0 0 2024-09-13T02:53:15.547 INFO:tasks.workunit.client.0.smithi098.stdout:4/922: getdents d6/d10/d21 0 2024-09-13T02:53:15.548 INFO:tasks.workunit.client.0.smithi098.stdout:0/994: rmdir dd/d1f/d85/df5/d144 0 2024-09-13T02:53:15.549 INFO:tasks.workunit.client.0.smithi098.stdout:0/995: chown dd/df/d1d/d40/d9b 58 1 2024-09-13T02:53:15.550 INFO:tasks.workunit.client.0.smithi098.stdout:0/996: write dd/fb4 [1577225,54378] 0 2024-09-13T02:53:15.551 INFO:tasks.workunit.client.0.smithi098.stdout:2/990: symlink d1/da7/l140 0 2024-09-13T02:53:15.552 INFO:tasks.workunit.client.0.smithi098.stdout:2/991: readlink d1/d1a/d9/d1e/d5a/l5b 0 2024-09-13T02:53:15.553 INFO:tasks.workunit.client.0.smithi098.stdout:8/884: write d2/d2f/d78/d46/d74/dfe/f113 [2149010,49504] 0 2024-09-13T02:53:15.557 INFO:tasks.workunit.client.0.smithi098.stdout:6/842: mknod d5/d13/d2b/d5b/d102/c118 0 2024-09-13T02:53:15.561 INFO:tasks.workunit.client.0.smithi098.stdout:8/885: symlink d2/d2f/d78/d46/d5c/l11e 0 2024-09-13T02:53:15.566 INFO:tasks.workunit.client.0.smithi098.stdout:5/935: creat d0/d38/f13a x:0 0 0 2024-09-13T02:53:15.567 INFO:tasks.workunit.client.0.smithi098.stdout:0/997: write dd/f45 [4227393,17385] 0 2024-09-13T02:53:15.569 INFO:tasks.workunit.client.0.smithi098.stdout:8/886: symlink d2/l11f 0 2024-09-13T02:53:15.571 INFO:tasks.workunit.client.0.smithi098.stdout:6/843: creat d5/d13/f119 x:0 0 0 2024-09-13T02:53:15.571 INFO:tasks.workunit.client.0.smithi098.stdout:4/923: truncate d6/d22/d3d/d41/d58/da9/fc2 603213 0 2024-09-13T02:53:15.573 INFO:tasks.workunit.client.0.smithi098.stdout:0/998: creat dd/d1f/d85/d9d/f157 x:0 0 0 2024-09-13T02:53:15.580 INFO:tasks.workunit.client.0.smithi098.stdout:0/999: creat dd/df/d1d/d26/d28/d32/dda/d117/dea/f158 x:0 0 0 2024-09-13T02:53:15.584 INFO:tasks.workunit.client.0.smithi098.stdout:4/924: mknod d6/d10/c139 0 2024-09-13T02:53:15.584 INFO:tasks.workunit.client.0.smithi098.stdout:6/844: write d5/d13/d2b/d5b/f63 [224189,65166] 0 2024-09-13T02:53:15.585 INFO:tasks.workunit.client.0.smithi098.stdout:4/925: truncate d6/d3e/fe4 4246518 0 2024-09-13T02:53:15.585 INFO:tasks.workunit.client.0.smithi098.stdout:4/926: chown d6/d22/d3d 13895837 1 2024-09-13T02:53:15.588 INFO:tasks.workunit.client.0.smithi098.stdout:8/887: getdents d2/d2f/d78/d46/d74/d86 0 2024-09-13T02:53:15.591 INFO:tasks.workunit.client.0.smithi098.stdout:5/936: dwrite d0/d15/d17/d1c/dd6/ffb [0,4194304] 0 2024-09-13T02:53:15.592 INFO:tasks.workunit.client.0.smithi098.stdout:4/927: symlink d6/d8d/l13a 0 2024-09-13T02:53:15.597 INFO:tasks.workunit.client.0.smithi098.stdout:8/888: dwrite d2/dd/d11/f18 [0,4194304] 0 2024-09-13T02:53:15.598 INFO:tasks.workunit.client.0.smithi098.stdout:5/937: fdatasync d0/d57/fff 0 2024-09-13T02:53:15.599 INFO:tasks.workunit.client.0.smithi098.stdout:8/889: read - d2/fe5 zero size 2024-09-13T02:53:15.601 INFO:tasks.workunit.client.0.smithi098.stdout:6/845: dread d5/d13/d2b/d3a/d41/d6c/fcd [0,4194304] 0 2024-09-13T02:53:15.608 INFO:tasks.workunit.client.0.smithi098.stdout:5/938: rename d0/d15/d17/d1c/dd6/ffb to d0/d38/d3f/d81/f13b 0 2024-09-13T02:53:15.608 INFO:tasks.workunit.client.0.smithi098.stdout:6/846: read d5/d13/d2b/f2d [3103469,42790] 0 2024-09-13T02:53:15.612 INFO:tasks.workunit.client.0.smithi098.stdout:5/939: mknod d0/d38/d3f/d81/d4d/c13c 0 2024-09-13T02:53:15.615 INFO:tasks.workunit.client.0.smithi098.stdout:5/940: creat d0/d15/d50/dd3/f13d x:0 0 0 2024-09-13T02:53:15.616 INFO:tasks.workunit.client.0.smithi098.stdout:6/847: dwrite d5/d13/d2b/d3a/d14/d94/fc2 [0,4194304] 0 2024-09-13T02:53:15.618 INFO:tasks.workunit.client.0.smithi098.stdout:4/928: dread d6/d22/d3d/d6c/d91/fb1 [0,4194304] 0 2024-09-13T02:53:15.620 INFO:tasks.workunit.client.0.smithi098.stdout:8/890: dread d2/d2f/d78/d46/d5c/fd4 [0,4194304] 0 2024-09-13T02:53:15.622 INFO:tasks.workunit.client.0.smithi098.stdout:4/929: mkdir d6/d22/d3d/dc8/dd5/df5/d13b 0 2024-09-13T02:53:15.623 INFO:tasks.workunit.client.0.smithi098.stdout:6/848: mknod d5/d36/d8c/dc3/c11a 0 2024-09-13T02:53:15.625 INFO:tasks.workunit.client.0.smithi098.stdout:8/891: fsync d2/dd/d4d/fed 0 2024-09-13T02:53:15.630 INFO:tasks.workunit.client.0.smithi098.stdout:6/849: dwrite d5/d13/d2b/d5b/f89 [0,4194304] 0 2024-09-13T02:53:15.635 INFO:tasks.workunit.client.0.smithi098.stdout:8/892: rename d2/d2f/d78/d5d/f98 to d2/dd/d4d/d96/dfb/f120 0 2024-09-13T02:53:15.639 INFO:tasks.workunit.client.0.smithi098.stdout:6/850: dwrite d5/d13/d2b/d3a/d14/d94/fc2 [0,4194304] 0 2024-09-13T02:53:15.641 INFO:tasks.workunit.client.0.smithi098.stdout:6/851: chown d5/d13/d2b/d79/df0/c115 4 1 2024-09-13T02:53:15.642 INFO:tasks.workunit.client.0.smithi098.stdout:8/893: creat d2/dd/d11/d2c/d101/f121 x:0 0 0 2024-09-13T02:53:15.644 INFO:tasks.workunit.client.0.smithi098.stdout:5/941: dwrite d0/d15/d17/d1c/dd6/fef [4194304,4194304] 0 2024-09-13T02:53:15.644 INFO:tasks.workunit.client.0.smithi098.stdout:4/930: write d6/d54/d6a/fba [950951,103601] 0 2024-09-13T02:53:15.648 INFO:tasks.workunit.client.0.smithi098.stdout:5/942: read d0/d38/d3f/d81/f33 [897625,83491] 0 2024-09-13T02:53:15.650 INFO:tasks.workunit.client.0.smithi098.stdout:8/894: symlink d2/d28/d43/d88/dd8/l122 0 2024-09-13T02:53:15.653 INFO:tasks.workunit.client.0.smithi098.stdout:5/943: fsync d0/d38/d3f/d81/d9e/dd4/f105 0 2024-09-13T02:53:15.654 INFO:tasks.workunit.client.0.smithi098.stdout:5/944: write d0/d15/d17/daa/f11b [253785,46233] 0 2024-09-13T02:53:15.656 INFO:tasks.workunit.client.0.smithi098.stdout:6/852: creat d5/d13/d2b/d3a/d41/d6c/d7c/de3/f11b x:0 0 0 2024-09-13T02:53:15.661 INFO:tasks.workunit.client.0.smithi098.stdout:5/945: mknod d0/d38/d102/db1/c13e 0 2024-09-13T02:53:15.664 INFO:tasks.workunit.client.0.smithi098.stdout:6/853: getdents d5/d13/d2b/d3a/d41/d7e 0 2024-09-13T02:53:15.670 INFO:tasks.workunit.client.0.smithi098.stdout:5/946: link d0/d15/d50/ca7 d0/d38/d3f/d81/d9e/dd4/dfd/d135/c13f 0 2024-09-13T02:53:15.673 INFO:tasks.workunit.client.0.smithi098.stdout:5/947: truncate d0/d38/d3f/d81/d4d/d82/d9a/fca 786226 0 2024-09-13T02:53:15.678 INFO:tasks.workunit.client.0.smithi098.stdout:8/895: dwrite d2/dd/d2e/fd0 [0,4194304] 0 2024-09-13T02:53:15.680 INFO:tasks.workunit.client.0.smithi098.stdout:4/931: dread d6/d37/d124/fe6 [0,4194304] 0 2024-09-13T02:53:15.680 INFO:tasks.workunit.client.0.smithi098.stdout:6/854: write d5/d13/fc1 [1011872,117796] 0 2024-09-13T02:53:15.687 INFO:tasks.workunit.client.0.smithi098.stdout:6/855: creat d5/d13/d2b/d93/f11c x:0 0 0 2024-09-13T02:53:15.688 INFO:tasks.workunit.client.0.smithi098.stdout:8/896: write d2/dd/d11/d1d/f3a [1142704,433] 0 2024-09-13T02:53:15.691 INFO:tasks.workunit.client.0.smithi098.stdout:6/856: mkdir d5/d13/d67/d85/d11d 0 2024-09-13T02:53:15.695 INFO:tasks.workunit.client.0.smithi098.stdout:6/857: rmdir d5/d36/d8c 39 2024-09-13T02:53:15.696 INFO:tasks.workunit.client.0.smithi098.stdout:4/932: link d6/l8b d6/d3e/d73/dfc/l13c 0 2024-09-13T02:53:15.697 INFO:tasks.workunit.client.0.smithi098.stdout:6/858: readlink d5/d13/d2b/d3a/d41/d55/lc6 0 2024-09-13T02:53:15.699 INFO:tasks.workunit.client.0.smithi098.stdout:6/859: creat d5/d18/f11e x:0 0 0 2024-09-13T02:53:15.701 INFO:tasks.workunit.client.0.smithi098.stdout:6/860: stat d5/d13/d2b/d3a/d41/d6c/d7c/dc7 0 2024-09-13T02:53:15.701 INFO:tasks.workunit.client.0.smithi098.stdout:8/897: write d2/f9 [4601482,129331] 0 2024-09-13T02:53:15.703 INFO:tasks.workunit.client.0.smithi098.stdout:4/933: dwrite d6/d10/d21/dec/f114 [0,4194304] 0 2024-09-13T02:53:15.712 INFO:tasks.workunit.client.0.smithi098.stdout:6/861: write d5/d13/d2b/d79/fe9 [72909,76462] 0 2024-09-13T02:53:15.713 INFO:tasks.workunit.client.0.smithi098.stdout:4/934: mknod d6/d22/d3d/dc8/dd5/df5/c13d 0 2024-09-13T02:53:15.717 INFO:tasks.workunit.client.0.smithi098.stdout:6/862: mkdir d5/d36/d8c/dc3/d11f 0 2024-09-13T02:53:15.721 INFO:tasks.workunit.client.0.smithi098.stdout:8/898: dread d2/dd/d4d/d96/f85 [0,4194304] 0 2024-09-13T02:53:15.785 INFO:tasks.workunit.client.0.smithi098.stdout:4/935: getdents d6/d22/d3d 0 2024-09-13T02:53:15.788 INFO:tasks.workunit.client.0.smithi098.stdout:6/863: dwrite d5/d13/d67/d85/fe6 [4194304,4194304] 0 2024-09-13T02:53:15.788 INFO:tasks.workunit.client.0.smithi098.stdout:4/936: creat d6/d37/d124/d116/f13e x:0 0 0 2024-09-13T02:53:15.872 INFO:tasks.workunit.client.0.smithi098.stdout:6/864: read - d5/d18/d50/fa4 zero size 2024-09-13T02:53:15.872 INFO:tasks.workunit.client.0.smithi098.stdout:4/937: write d6/d37/d124/f127 [96830,18002] 0 2024-09-13T02:53:15.873 INFO:tasks.workunit.client.0.smithi098.stdout:4/938: fdatasync d6/d22/d3d/d64/fa6 0 2024-09-13T02:53:15.873 INFO:tasks.workunit.client.0.smithi098.stdout:4/939: readlink d6/d22/d3d/l52 0 2024-09-13T02:53:15.875 INFO:tasks.workunit.client.0.smithi098.stdout:4/940: write d6/d37/d124/d116/f13e [301412,29193] 0 2024-09-13T02:53:15.876 INFO:tasks.workunit.client.0.smithi098.stdout:6/865: getdents d5/d18/d50/df1 0 2024-09-13T02:53:15.877 INFO:tasks.workunit.client.0.smithi098.stdout:4/941: fdatasync d6/d10/d21/f2b 0 2024-09-13T02:53:15.877 INFO:tasks.workunit.client.0.smithi098.stdout:4/942: chown d6/c8a 7731 1 2024-09-13T02:53:15.878 INFO:tasks.workunit.client.0.smithi098.stdout:4/943: readlink d6/d22/d3d/d4d/l6e 0 2024-09-13T02:53:15.884 INFO:tasks.workunit.client.0.smithi098.stdout:8/899: dread d2/dd/d11/d2c/d9b/fad [0,4194304] 0 2024-09-13T02:53:15.884 INFO:tasks.workunit.client.0.smithi098.stdout:8/900: chown d2/dd/d11/d1d/f3e 1746 1 2024-09-13T02:53:16.014 INFO:tasks.workunit.client.0.smithi098.stdout:6/866: mknod d5/d13/d2b/d3a/d14/d6b/c120 0 2024-09-13T02:53:16.014 INFO:tasks.workunit.client.0.smithi098.stdout:8/901: write d2/dd/f5a [3866745,76890] 0 2024-09-13T02:53:16.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/902: write d2/d2f/d78/d5d/f73 [692577,38416] 0 2024-09-13T02:53:16.017 INFO:tasks.workunit.client.0.smithi098.stdout:4/944: getdents d6/d54 0 2024-09-13T02:53:16.020 INFO:tasks.workunit.client.0.smithi098.stdout:6/867: mkdir d5/d13/d2b/d5b/d102/dcb/d121 0 2024-09-13T02:53:16.021 INFO:tasks.workunit.client.0.smithi098.stdout:8/903: dread d2/d2f/d78/d46/d74/d86/dd2/ff7 [0,4194304] 0 2024-09-13T02:53:16.021 INFO:tasks.workunit.client.0.smithi098.stdout:4/945: creat d6/d37/f13f x:0 0 0 2024-09-13T02:53:16.023 INFO:tasks.workunit.client.0.smithi098.stdout:4/946: truncate d6/d10/d21/f3b 1954063 0 2024-09-13T02:53:16.029 INFO:tasks.workunit.client.0.smithi098.stdout:8/904: creat d2/dd/f123 x:0 0 0 2024-09-13T02:53:16.031 INFO:tasks.workunit.client.0.smithi098.stdout:8/905: mknod d2/d28/d43/d88/d99/dec/c124 0 2024-09-13T02:53:16.035 INFO:tasks.workunit.client.0.smithi098.stdout:6/868: write d5/d6f/fae [965736,85117] 0 2024-09-13T02:53:16.037 INFO:tasks.workunit.client.0.smithi098.stdout:4/947: write d6/d22/d3d/d41/fb2 [681696,122100] 0 2024-09-13T02:53:16.038 INFO:tasks.workunit.client.0.smithi098.stdout:4/948: truncate d6/d3e/d46/dd2/f12a 949864 0 2024-09-13T02:53:16.042 INFO:tasks.workunit.client.0.smithi098.stdout:4/949: symlink d6/d22/d3d/d41/l140 0 2024-09-13T02:53:16.043 INFO:tasks.workunit.client.0.smithi098.stdout:4/950: readlink d6/d10/d21/l30 0 2024-09-13T02:53:16.045 INFO:tasks.workunit.client.0.smithi098.stdout:8/906: dread d2/d28/fbd [0,4194304] 0 2024-09-13T02:53:16.048 INFO:tasks.workunit.client.0.smithi098.stdout:8/907: truncate d2/d2f/d78/f50 1239275 0 2024-09-13T02:53:16.065 INFO:tasks.workunit.client.0.smithi098.stdout:4/951: dwrite d6/d22/d3d/d64/f6d [4194304,4194304] 0 2024-09-13T02:53:16.073 INFO:tasks.workunit.client.0.smithi098.stdout:4/952: write d6/d37/d124/fe6 [1008839,12381] 0 2024-09-13T02:53:16.088 INFO:tasks.workunit.client.0.smithi098.stdout:8/908: write d2/d2f/d78/d5d/dcd/fe6 [58104,4488] 0 2024-09-13T02:53:16.096 INFO:tasks.workunit.client.0.smithi098.stdout:8/909: creat d2/dd/d2e/f125 x:0 0 0 2024-09-13T02:53:16.100 INFO:tasks.workunit.client.0.smithi098.stdout:8/910: creat d2/d28/d43/d88/dd8/f126 x:0 0 0 2024-09-13T02:53:16.101 INFO:tasks.workunit.client.0.smithi098.stdout:4/953: dread d6/d54/fc9 [0,4194304] 0 2024-09-13T02:53:16.103 INFO:tasks.workunit.client.0.smithi098.stdout:8/911: fsync d2/d2f/d78/d46/d47/fb4 0 2024-09-13T02:53:16.104 INFO:tasks.workunit.client.0.smithi098.stdout:8/912: chown d2/d2f/d78/d46/d5c 51 1 2024-09-13T02:53:16.104 INFO:tasks.workunit.client.0.smithi098.stdout:4/954: mkdir d6/d3e/d68/d141 0 2024-09-13T02:53:16.105 INFO:tasks.workunit.client.0.smithi098.stdout:8/913: chown d2/d2f/d78/d46/d74/dfe/c10b 41780865 1 2024-09-13T02:53:16.106 INFO:tasks.workunit.client.0.smithi098.stdout:8/914: read d2/dd/f21 [2058437,38467] 0 2024-09-13T02:53:16.109 INFO:tasks.workunit.client.0.smithi098.stdout:4/955: symlink d6/d37/d83/l142 0 2024-09-13T02:53:16.110 INFO:tasks.workunit.client.0.smithi098.stdout:8/915: creat d2/dd/d11/d2c/d101/f127 x:0 0 0 2024-09-13T02:53:16.116 INFO:tasks.workunit.client.0.smithi098.stdout:8/916: dwrite d2/dd/f21 [4194304,4194304] 0 2024-09-13T02:53:16.118 INFO:tasks.workunit.client.0.smithi098.stdout:8/917: chown d2/f6 1764 1 2024-09-13T02:53:16.118 INFO:tasks.workunit.client.0.smithi098.stdout:4/956: dwrite d6/d22/d3d/d6c/d91/fb1 [0,4194304] 0 2024-09-13T02:53:16.121 INFO:tasks.workunit.client.0.smithi098.stdout:4/957: symlink d6/d8d/db9/l143 0 2024-09-13T02:53:16.125 INFO:tasks.workunit.client.0.smithi098.stdout:4/958: truncate d6/d37/f39 3732745 0 2024-09-13T02:53:16.129 INFO:tasks.workunit.client.0.smithi098.stdout:2/992: sync 2024-09-13T02:53:16.131 INFO:tasks.workunit.client.0.smithi098.stdout:2/993: mkdir d1/da7/de4/d141 0 2024-09-13T02:53:16.131 INFO:tasks.workunit.client.0.smithi098.stdout:2/994: stat d1/d1f/d39/f21 0 2024-09-13T02:53:16.133 INFO:tasks.workunit.client.0.smithi098.stdout:2/995: symlink d1/da7/l142 0 2024-09-13T02:53:16.135 INFO:tasks.workunit.client.0.smithi098.stdout:2/996: creat d1/d1f/d30/def/f143 x:0 0 0 2024-09-13T02:53:16.140 INFO:tasks.workunit.client.0.smithi098.stdout:2/997: dread d1/d1f/d35/d63/f65 [8388608,4194304] 0 2024-09-13T02:53:16.147 INFO:tasks.workunit.client.0.smithi098.stdout:4/959: dwrite d6/d10/d21/f2b [4194304,4194304] 0 2024-09-13T02:53:16.154 INFO:tasks.workunit.client.0.smithi098.stdout:2/998: dread d1/d1f/d39/fd8 [0,4194304] 0 2024-09-13T02:53:16.241 INFO:tasks.workunit.client.0.smithi098.stdout:4/960: getdents d6/d3e/d46 0 2024-09-13T02:53:16.243 INFO:tasks.workunit.client.0.smithi098.stdout:2/999: dwrite d1/d1f/d30/def/df0/f13a [0,4194304] 0 2024-09-13T02:53:16.254 INFO:tasks.workunit.client.0.smithi098.stdout:4/961: dwrite d6/d22/d3d/d41/d58/da9/fc2 [0,4194304] 0 2024-09-13T02:53:16.255 INFO:tasks.workunit.client.0.smithi098.stdout:4/962: dread - d6/d3e/d46/dd2/dee/d111/f130 zero size 2024-09-13T02:53:16.257 INFO:tasks.workunit.client.0.smithi098.stdout:4/963: symlink d6/d3e/d10d/l144 0 2024-09-13T02:53:16.261 INFO:tasks.workunit.client.0.smithi098.stdout:4/964: rename d6/d8d/db9/l143 to d6/d22/d3d/dc8/dd5/df5/l145 0 2024-09-13T02:53:16.270 INFO:tasks.workunit.client.0.smithi098.stdout:4/965: dwrite d6/d3e/f100 [0,4194304] 0 2024-09-13T02:53:16.298 INFO:tasks.workunit.client.0.smithi098.stdout:4/966: dread d6/d10/ddc/f106 [0,4194304] 0 2024-09-13T02:53:16.299 INFO:tasks.workunit.client.0.smithi098.stdout:4/967: read d6/d3e/f100 [1756696,35673] 0 2024-09-13T02:53:16.304 INFO:tasks.workunit.client.0.smithi098.stdout:4/968: creat d6/d3e/d68/f146 x:0 0 0 2024-09-13T02:53:16.309 INFO:tasks.workunit.client.0.smithi098.stdout:4/969: creat d6/d54/d6a/f147 x:0 0 0 2024-09-13T02:53:16.315 INFO:tasks.workunit.client.0.smithi098.stdout:4/970: mknod d6/c148 0 2024-09-13T02:53:16.315 INFO:tasks.workunit.client.0.smithi098.stdout:4/971: stat d6/db/f2f 0 2024-09-13T02:53:16.322 INFO:tasks.workunit.client.0.smithi098.stdout:5/948: sync 2024-09-13T02:53:16.327 INFO:tasks.workunit.client.0.smithi098.stdout:5/949: fdatasync d0/d57/f91 0 2024-09-13T02:53:16.331 INFO:tasks.workunit.client.0.smithi098.stdout:5/950: dread d0/d38/d3f/f5b [0,4194304] 0 2024-09-13T02:53:16.347 INFO:tasks.workunit.client.0.smithi098.stdout:5/951: dread d0/d15/d17/d1c/f9d [0,4194304] 0 2024-09-13T02:53:16.356 INFO:tasks.workunit.client.0.smithi098.stdout:4/972: write d6/d22/d3d/d6c/d91/fbf [596663,32728] 0 2024-09-13T02:53:16.365 INFO:tasks.workunit.client.0.smithi098.stdout:5/952: write d0/d38/d3f/d1a/f97 [710387,59414] 0 2024-09-13T02:53:16.366 INFO:tasks.workunit.client.0.smithi098.stdout:4/973: write d6/d22/fdf [1930773,41693] 0 2024-09-13T02:53:16.374 INFO:tasks.workunit.client.0.smithi098.stdout:5/953: link d0/d15/f132 d0/d38/d3f/d81/d4d/f140 0 2024-09-13T02:53:16.375 INFO:tasks.workunit.client.0.smithi098.stdout:5/954: stat d0/d38/d3f/d81/f13b 0 2024-09-13T02:53:16.375 INFO:tasks.workunit.client.0.smithi098.stdout:4/974: creat d6/d3e/d73/dfc/d10c/d12f/f149 x:0 0 0 2024-09-13T02:53:16.379 INFO:tasks.workunit.client.0.smithi098.stdout:5/955: symlink d0/d15/d50/l141 0 2024-09-13T02:53:16.381 INFO:tasks.workunit.client.0.smithi098.stdout:4/975: link d6/d22/d3d/d6c/d91/fb1 d6/d37/d124/ddb/f14a 0 2024-09-13T02:53:16.385 INFO:tasks.workunit.client.0.smithi098.stdout:5/956: dwrite d0/d15/d50/dd3/f13d [0,4194304] 0 2024-09-13T02:53:16.386 INFO:tasks.workunit.client.0.smithi098.stdout:4/976: truncate d6/d22/d3d/d4d/f57 1952281 0 2024-09-13T02:53:16.387 INFO:tasks.workunit.client.0.smithi098.stdout:4/977: chown d6/d37/d124/f127 20516 1 2024-09-13T02:53:16.393 INFO:tasks.workunit.client.0.smithi098.stdout:4/978: mkdir d6/d37/d124/ddb/d14b 0 2024-09-13T02:53:16.402 INFO:tasks.workunit.client.0.smithi098.stdout:5/957: write d0/d38/d3f/d81/f33 [1961071,78065] 0 2024-09-13T02:53:16.403 INFO:tasks.workunit.client.0.smithi098.stdout:5/958: fdatasync d0/d15/d17/d1c/f96 0 2024-09-13T02:53:16.405 INFO:tasks.workunit.client.0.smithi098.stdout:4/979: link d6/d37/l50 d6/db/l14c 0 2024-09-13T02:53:16.406 INFO:tasks.workunit.client.0.smithi098.stdout:5/959: truncate d0/d15/d17/d1c/ff5 95740 0 2024-09-13T02:53:16.408 INFO:tasks.workunit.client.0.smithi098.stdout:4/980: creat d6/d3e/d46/dd2/dee/f14d x:0 0 0 2024-09-13T02:53:16.413 INFO:tasks.workunit.client.0.smithi098.stdout:4/981: truncate d6/db/f40 1524156 0 2024-09-13T02:53:16.413 INFO:tasks.workunit.client.0.smithi098.stdout:5/960: dread d0/d29/f3e [0,4194304] 0 2024-09-13T02:53:16.415 INFO:tasks.workunit.client.0.smithi098.stdout:4/982: creat d6/d37/f14e x:0 0 0 2024-09-13T02:53:16.419 INFO:tasks.workunit.client.0.smithi098.stdout:4/983: creat d6/d37/d7a/d10e/f14f x:0 0 0 2024-09-13T02:53:16.420 INFO:tasks.workunit.client.0.smithi098.stdout:4/984: stat d6/db/c35 0 2024-09-13T02:53:16.425 INFO:tasks.workunit.client.0.smithi098.stdout:4/985: mknod d6/d3e/d73/dfc/d10c/d12f/c150 0 2024-09-13T02:53:16.428 INFO:tasks.workunit.client.0.smithi098.stdout:4/986: fdatasync d6/d22/d3d/d4d/fbb 0 2024-09-13T02:53:16.429 INFO:tasks.workunit.client.0.smithi098.stdout:5/961: dwrite d0/d15/d50/f6d [4194304,4194304] 0 2024-09-13T02:53:16.430 INFO:tasks.workunit.client.0.smithi098.stdout:6/869: sync 2024-09-13T02:53:16.432 INFO:tasks.workunit.client.0.smithi098.stdout:6/870: write d5/d13/d2b/d5b/ffc [1429109,39004] 0 2024-09-13T02:53:16.433 INFO:tasks.workunit.client.0.smithi098.stdout:5/962: creat d0/d15/d17/d1c/dd6/f142 x:0 0 0 2024-09-13T02:53:16.434 INFO:tasks.workunit.client.0.smithi098.stdout:5/963: chown d0/d38/d3f/d81/f33 39910 1 2024-09-13T02:53:16.436 INFO:tasks.workunit.client.0.smithi098.stdout:6/871: read - d5/d6f/ff7 zero size 2024-09-13T02:53:16.437 INFO:tasks.workunit.client.0.smithi098.stdout:5/964: mknod d0/d38/d3f/d81/d9e/dd4/c143 0 2024-09-13T02:53:16.439 INFO:tasks.workunit.client.0.smithi098.stdout:6/872: mknod d5/d13/d2b/d79/c122 0 2024-09-13T02:53:16.442 INFO:tasks.workunit.client.0.smithi098.stdout:6/873: fsync d5/d36/d8c/fdb 0 2024-09-13T02:53:16.443 INFO:tasks.workunit.client.0.smithi098.stdout:6/874: write d5/d13/d2b/d5b/f89 [466558,122370] 0 2024-09-13T02:53:16.445 INFO:tasks.workunit.client.0.smithi098.stdout:6/875: chown d5/d13/d2b/d3a/d41/d55/la6 11895490 1 2024-09-13T02:53:16.446 INFO:tasks.workunit.client.0.smithi098.stdout:6/876: chown d5/d13/d2b/c84 26 1 2024-09-13T02:53:16.448 INFO:tasks.workunit.client.0.smithi098.stdout:6/877: creat d5/d13/d2b/d5b/f123 x:0 0 0 2024-09-13T02:53:16.453 INFO:tasks.workunit.client.0.smithi098.stdout:6/878: dwrite d5/ffd [0,4194304] 0 2024-09-13T02:53:16.458 INFO:tasks.workunit.client.0.smithi098.stdout:6/879: fsync d5/d13/d2b/d3a/f37 0 2024-09-13T02:53:16.463 INFO:tasks.workunit.client.0.smithi098.stdout:6/880: fsync d5/d13/d2b/d3a/d14/d6b/d8f/fb6 0 2024-09-13T02:53:16.464 INFO:tasks.workunit.client.0.smithi098.stdout:6/881: chown d5/d13/d2b/d3a/d41/d55/lc6 314 1 2024-09-13T02:53:16.465 INFO:tasks.workunit.client.0.smithi098.stdout:6/882: readlink d5/d13/d2b/d3a/d41/d6c/lfb 0 2024-09-13T02:53:16.466 INFO:tasks.workunit.client.0.smithi098.stdout:6/883: chown d5/d13/d67/cde 9396 1 2024-09-13T02:53:16.472 INFO:tasks.workunit.client.0.smithi098.stdout:6/884: dwrite d5/d13/d2b/d3a/d14/d94/f111 [0,4194304] 0 2024-09-13T02:53:16.478 INFO:tasks.workunit.client.0.smithi098.stdout:6/885: write d5/d18/d50/fa4 [434592,99605] 0 2024-09-13T02:53:16.480 INFO:tasks.workunit.client.0.smithi098.stdout:6/886: write d5/d13/d2b/d5b/ffc [1984560,60340] 0 2024-09-13T02:53:16.500 INFO:tasks.workunit.client.0.smithi098.stdout:6/887: dread d5/d18/d50/fc9 [0,4194304] 0 2024-09-13T02:53:16.503 INFO:tasks.workunit.client.0.smithi098.stdout:6/888: rename d5/d13/d2b/d5b/f63 to d5/d13/d51/f124 0 2024-09-13T02:53:16.511 INFO:tasks.workunit.client.0.smithi098.stdout:6/889: write d5/d13/d2b/d3a/d41/d55/dad/fc5 [8664448,102491] 0 2024-09-13T02:53:16.513 INFO:tasks.workunit.client.0.smithi098.stdout:6/890: creat d5/d18/d50/df1/f125 x:0 0 0 2024-09-13T02:53:16.514 INFO:tasks.workunit.client.0.smithi098.stdout:6/891: fdatasync d5/d13/d67/d85/fea 0 2024-09-13T02:53:16.519 INFO:tasks.workunit.client.0.smithi098.stdout:6/892: mknod d5/d13/d2b/d3a/d41/d6c/c126 0 2024-09-13T02:53:16.525 INFO:tasks.workunit.client.0.smithi098.stdout:6/893: write d5/d13/d2b/d3a/f86 [4287757,65537] 0 2024-09-13T02:53:16.527 INFO:tasks.workunit.client.0.smithi098.stdout:6/894: mkdir d5/d13/d67/d85/d127 0 2024-09-13T02:53:16.530 INFO:tasks.workunit.client.0.smithi098.stdout:6/895: rmdir d5/d13 39 2024-09-13T02:53:16.532 INFO:tasks.workunit.client.0.smithi098.stdout:6/896: symlink d5/d18/d50/l128 0 2024-09-13T02:53:16.535 INFO:tasks.workunit.client.0.smithi098.stdout:6/897: rmdir d5/d13/d2b/d5b/d102 39 2024-09-13T02:53:16.538 INFO:tasks.workunit.client.0.smithi098.stdout:6/898: symlink d5/d13/d2b/d5b/l129 0 2024-09-13T02:53:16.540 INFO:tasks.workunit.client.0.smithi098.stdout:6/899: fsync d5/d13/d2b/ffe 0 2024-09-13T02:53:16.543 INFO:tasks.workunit.client.0.smithi098.stdout:6/900: symlink d5/d13/d2b/d3a/d14/d6b/d9a/da5/l12a 0 2024-09-13T02:53:16.550 INFO:tasks.workunit.client.0.smithi098.stdout:6/901: dwrite d5/d13/d51/f124 [0,4194304] 0 2024-09-13T02:53:16.558 INFO:tasks.workunit.client.0.smithi098.stdout:6/902: truncate d5/d18/d50/fa4 367869 0 2024-09-13T02:53:16.560 INFO:tasks.workunit.client.0.smithi098.stdout:6/903: truncate d5/d13/d2b/f112 275698 0 2024-09-13T02:53:16.564 INFO:tasks.workunit.client.0.smithi098.stdout:6/904: getdents d5/d36/d8c 0 2024-09-13T02:53:16.566 INFO:tasks.workunit.client.0.smithi098.stdout:6/905: symlink d5/d13/d2b/d3a/d41/d6c/d7c/l12b 0 2024-09-13T02:53:16.569 INFO:tasks.workunit.client.0.smithi098.stdout:6/906: mkdir d5/d13/d2b/d3a/d41/d12c 0 2024-09-13T02:53:16.576 INFO:tasks.workunit.client.0.smithi098.stdout:6/907: write d5/d13/d2b/d3a/d14/d6b/d8f/fb6 [1923083,86754] 0 2024-09-13T02:53:16.576 INFO:tasks.workunit.client.0.smithi098.stdout:6/908: readlink d5/d13/d2b/d3a/d14/d94/l96 0 2024-09-13T02:53:16.583 INFO:tasks.workunit.client.0.smithi098.stdout:6/909: dwrite d5/f15 [8388608,4194304] 0 2024-09-13T02:53:16.585 INFO:tasks.workunit.client.0.smithi098.stdout:6/910: write d5/d13/d2b/d3a/d14/d6b/d8f/fb6 [545339,55009] 0 2024-09-13T02:53:16.589 INFO:tasks.workunit.client.0.smithi098.stdout:6/911: creat d5/d13/d67/d85/f12d x:0 0 0 2024-09-13T02:53:16.592 INFO:tasks.workunit.client.0.smithi098.stdout:6/912: creat d5/d13/d2b/d3a/d14/d6b/d8f/f12e x:0 0 0 2024-09-13T02:53:16.592 INFO:tasks.workunit.client.0.smithi098.stdout:6/913: chown d5/d13/d67/d85 0 1 2024-09-13T02:53:16.594 INFO:tasks.workunit.client.0.smithi098.stdout:6/914: truncate d5/d13/d2b/d3a/d41/f4b 2900522 0 2024-09-13T02:53:16.595 INFO:tasks.workunit.client.0.smithi098.stdout:6/915: fsync d5/d6f/ff7 0 2024-09-13T02:53:16.600 INFO:tasks.workunit.client.0.smithi098.stdout:6/916: dwrite f3 [0,4194304] 0 2024-09-13T02:53:16.601 INFO:tasks.workunit.client.0.smithi098.stdout:6/917: stat d5/d6f/fae 0 2024-09-13T02:53:16.617 INFO:tasks.workunit.client.0.smithi098.stdout:6/918: dwrite d5/d13/d2b/d3a/f37 [0,4194304] 0 2024-09-13T02:53:16.618 INFO:tasks.workunit.client.0.smithi098.stdout:6/919: chown d5/d6f/ff7 95 1 2024-09-13T02:53:16.621 INFO:tasks.workunit.client.0.smithi098.stdout:6/920: symlink d5/d13/d2b/d3a/d5a/da8/l12f 0 2024-09-13T02:53:16.624 INFO:tasks.workunit.client.0.smithi098.stdout:6/921: rename d5/d13/d2b/d3a/d14/c3e to d5/d13/d2b/d3a/d41/df4/c130 0 2024-09-13T02:53:16.626 INFO:tasks.workunit.client.0.smithi098.stdout:6/922: mknod d5/d13/d67/c131 0 2024-09-13T02:53:16.628 INFO:tasks.workunit.client.0.smithi098.stdout:6/923: mknod d5/d13/c132 0 2024-09-13T02:53:16.637 INFO:tasks.workunit.client.0.smithi098.stdout:8/918: sync 2024-09-13T02:53:16.640 INFO:tasks.workunit.client.0.smithi098.stdout:8/919: symlink d2/d2f/d78/d5d/dcd/d10a/l128 0 2024-09-13T02:53:16.649 INFO:tasks.workunit.client.0.smithi098.stdout:8/920: write d2/d2f/d78/d46/da2/fb6 [68096,111151] 0 2024-09-13T02:53:16.652 INFO:tasks.workunit.client.0.smithi098.stdout:8/921: mknod d2/d28/c129 0 2024-09-13T02:53:16.652 INFO:tasks.workunit.client.0.smithi098.stdout:8/922: readlink d2/dd/d11/d1d/dcc/ldc 0 2024-09-13T02:53:16.655 INFO:tasks.workunit.client.0.smithi098.stdout:8/923: creat d2/d28/d43/d88/dd8/f12a x:0 0 0 2024-09-13T02:53:16.664 INFO:tasks.workunit.client.0.smithi098.stdout:8/924: dwrite d2/d2f/d78/f64 [0,4194304] 0 2024-09-13T02:53:16.666 INFO:tasks.workunit.client.0.smithi098.stdout:8/925: fdatasync d2/f4e 0 2024-09-13T02:53:16.668 INFO:tasks.workunit.client.0.smithi098.stdout:8/926: rmdir d2/dd/dcb 39 2024-09-13T02:53:16.671 INFO:tasks.workunit.client.0.smithi098.stdout:8/927: creat d2/d2f/d78/d46/d47/d6e/f12b x:0 0 0 2024-09-13T02:53:16.673 INFO:tasks.workunit.client.0.smithi098.stdout:8/928: creat d2/dd/d4d/d96/dfb/f12c x:0 0 0 2024-09-13T02:53:16.675 INFO:tasks.workunit.client.0.smithi098.stdout:8/929: mknod d2/d2f/d78/d46/d5c/c12d 0 2024-09-13T02:53:16.678 INFO:tasks.workunit.client.0.smithi098.stdout:8/930: truncate d2/d2f/d78/d46/d74/f94 1698528 0 2024-09-13T02:53:16.680 INFO:tasks.workunit.client.0.smithi098.stdout:8/931: write d2/d2f/d78/d46/d5c/fd4 [905887,41767] 0 2024-09-13T02:53:16.686 INFO:tasks.workunit.client.0.smithi098.stdout:8/932: dwrite d2/d2f/d78/d46/fbc [0,4194304] 0 2024-09-13T02:53:16.694 INFO:tasks.workunit.client.0.smithi098.stdout:8/933: getdents d2/d2f/d78/d5d 0 2024-09-13T02:53:16.697 INFO:tasks.workunit.client.0.smithi098.stdout:8/934: symlink d2/dd/d11/d2c/l12e 0 2024-09-13T02:53:16.701 INFO:tasks.workunit.client.0.smithi098.stdout:8/935: symlink d2/d2f/d78/d46/d74/d86/l12f 0 2024-09-13T02:53:16.704 INFO:tasks.workunit.client.0.smithi098.stdout:8/936: unlink d2/d2f/d78/d46/d74/d86/f8e 0 2024-09-13T02:53:16.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:16 smithi098 ceph-mon[27886]: pgmap v37: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 47 MiB/s rd, 111 MiB/s wr, 318 op/s 2024-09-13T02:53:16.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:16 smithi142 ceph-mon[33443]: pgmap v37: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 47 MiB/s rd, 111 MiB/s wr, 318 op/s 2024-09-13T02:53:17.024 INFO:tasks.workunit.client.0.smithi098.stdout:5/965: sync 2024-09-13T02:53:17.024 INFO:tasks.workunit.client.0.smithi098.stdout:4/987: sync 2024-09-13T02:53:17.024 INFO:tasks.workunit.client.0.smithi098.stdout:6/924: sync 2024-09-13T02:53:17.024 INFO:tasks.workunit.client.0.smithi098.stdout:8/937: sync 2024-09-13T02:53:17.028 INFO:tasks.workunit.client.0.smithi098.stdout:4/988: unlink d6/d37/d83/l142 0 2024-09-13T02:53:17.028 INFO:tasks.workunit.client.0.smithi098.stdout:4/989: chown d6/d3e/d46/dd2/dee 38 1 2024-09-13T02:53:17.029 INFO:tasks.workunit.client.0.smithi098.stdout:8/938: symlink d2/dd/d11/d1d/l130 0 2024-09-13T02:53:17.033 INFO:tasks.workunit.client.0.smithi098.stdout:6/925: creat d5/d13/d2b/d3a/d14/dd9/f133 x:0 0 0 2024-09-13T02:53:17.035 INFO:tasks.workunit.client.0.smithi098.stdout:6/926: readlink d5/d13/d2b/d3a/d41/d6c/d7c/l12b 0 2024-09-13T02:53:17.036 INFO:tasks.workunit.client.0.smithi098.stdout:8/939: dwrite d2/d28/f112 [0,4194304] 0 2024-09-13T02:53:17.038 INFO:tasks.workunit.client.0.smithi098.stdout:8/940: creat d2/d2f/d78/d46/d47/f131 x:0 0 0 2024-09-13T02:53:17.039 INFO:tasks.workunit.client.0.smithi098.stdout:6/927: mknod d5/d13/d2b/d3a/d41/c134 0 2024-09-13T02:53:17.041 INFO:tasks.workunit.client.0.smithi098.stdout:8/941: write d2/dd/d11/d1d/f3e [3373220,19161] 0 2024-09-13T02:53:17.044 INFO:tasks.workunit.client.0.smithi098.stdout:6/928: creat d5/d13/d2b/d3a/d14/d6b/d9a/da5/db8/f135 x:0 0 0 2024-09-13T02:53:17.045 INFO:tasks.workunit.client.0.smithi098.stdout:8/942: truncate d2/dd/d11/d44/f63 2893159 0 2024-09-13T02:53:17.065 INFO:tasks.workunit.client.0.smithi098.stdout:5/966: dwrite d0/d15/f30 [0,4194304] 0 2024-09-13T02:53:17.072 INFO:tasks.workunit.client.0.smithi098.stdout:5/967: creat d0/d15/d17/daa/f144 x:0 0 0 2024-09-13T02:53:17.078 INFO:tasks.workunit.client.0.smithi098.stdout:6/929: dread d5/d13/d2b/d3a/d41/d55/f92 [0,4194304] 0 2024-09-13T02:53:17.082 INFO:tasks.workunit.client.0.smithi098.stdout:5/968: link d0/d38/d3f/d81/d4d/ceb d0/d38/dc3/c145 0 2024-09-13T02:53:17.083 INFO:tasks.workunit.client.0.smithi098.stdout:6/930: mknod d5/d13/d2b/d3a/d41/d6c/c136 0 2024-09-13T02:53:17.084 INFO:tasks.workunit.client.0.smithi098.stdout:5/969: mknod d0/d7c/c146 0 2024-09-13T02:53:17.086 INFO:tasks.workunit.client.0.smithi098.stdout:6/931: mknod d5/d18/dcf/c137 0 2024-09-13T02:53:17.087 INFO:tasks.workunit.client.0.smithi098.stdout:6/932: truncate d5/f109 981148 0 2024-09-13T02:53:17.089 INFO:tasks.workunit.client.0.smithi098.stdout:8/943: dread d2/d2f/d78/d46/d74/d86/ff9 [4194304,4194304] 0 2024-09-13T02:53:17.090 INFO:tasks.workunit.client.0.smithi098.stdout:5/970: read d0/d57/f94 [579673,126053] 0 2024-09-13T02:53:17.092 INFO:tasks.workunit.client.0.smithi098.stdout:8/944: dread - d2/d28/d43/fc9 zero size 2024-09-13T02:53:17.093 INFO:tasks.workunit.client.0.smithi098.stdout:5/971: write d0/d15/d17/d1c/dd6/fef [2461281,56151] 0 2024-09-13T02:53:17.094 INFO:tasks.workunit.client.0.smithi098.stdout:8/945: dread d2/dd/f35 [0,4194304] 0 2024-09-13T02:53:17.101 INFO:tasks.workunit.client.0.smithi098.stdout:6/933: dread d5/d13/d2b/d5b/ffc [0,4194304] 0 2024-09-13T02:53:17.103 INFO:tasks.workunit.client.0.smithi098.stdout:5/972: dwrite d0/d15/d17/daa/fb8 [0,4194304] 0 2024-09-13T02:53:17.104 INFO:tasks.workunit.client.0.smithi098.stdout:8/946: dread d2/d28/d43/d88/dd8/fe4 [0,4194304] 0 2024-09-13T02:53:17.106 INFO:tasks.workunit.client.0.smithi098.stdout:5/973: dread - d0/d38/d3f/f73 zero size 2024-09-13T02:53:17.109 INFO:tasks.workunit.client.0.smithi098.stdout:8/947: truncate d2/d2f/d78/d5d/f79 961603 0 2024-09-13T02:53:17.109 INFO:tasks.workunit.client.0.smithi098.stdout:8/948: read - d2/fe5 zero size 2024-09-13T02:53:17.114 INFO:tasks.workunit.client.0.smithi098.stdout:8/949: creat d2/d2f/d78/d46/d74/d86/da8/f132 x:0 0 0 2024-09-13T02:53:17.118 INFO:tasks.workunit.client.0.smithi098.stdout:8/950: mkdir d2/d2f/d78/d46/d74/d133 0 2024-09-13T02:53:17.120 INFO:tasks.workunit.client.0.smithi098.stdout:6/934: dwrite d5/d13/d2b/d79/fd2 [0,4194304] 0 2024-09-13T02:53:17.121 INFO:tasks.workunit.client.0.smithi098.stdout:6/935: readlink d5/d13/d2b/d3a/d41/d6c/d7c/l12b 0 2024-09-13T02:53:17.123 INFO:tasks.workunit.client.0.smithi098.stdout:8/951: symlink d2/d2f/d78/d46/d5c/l134 0 2024-09-13T02:53:17.127 INFO:tasks.workunit.client.0.smithi098.stdout:6/936: creat d5/d6f/f138 x:0 0 0 2024-09-13T02:53:17.128 INFO:tasks.workunit.client.0.smithi098.stdout:5/974: truncate d0/d15/d17/d1c/f99 2105492 0 2024-09-13T02:53:17.128 INFO:tasks.workunit.client.0.smithi098.stdout:8/952: rmdir d2/dd/d11/d1d 39 2024-09-13T02:53:17.132 INFO:tasks.workunit.client.0.smithi098.stdout:8/953: chown d2/dd/d11/d1d/f45 1 1 2024-09-13T02:53:17.136 INFO:tasks.workunit.client.0.smithi098.stdout:5/975: rmdir d0/d38/d3f/d81/d9e/dd4/dfd 39 2024-09-13T02:53:17.142 INFO:tasks.workunit.client.0.smithi098.stdout:5/976: truncate d0/d38/d3f/d81/d4d/d82/d9a/fb2 846107 0 2024-09-13T02:53:17.144 INFO:tasks.workunit.client.0.smithi098.stdout:5/977: read d0/d29/fe0 [1130690,73218] 0 2024-09-13T02:53:17.146 INFO:tasks.workunit.client.0.smithi098.stdout:5/978: dread - d0/d15/d17/daa/f144 zero size 2024-09-13T02:53:17.147 INFO:tasks.workunit.client.0.smithi098.stdout:6/937: dwrite d5/d13/d2b/d3a/d41/d55/fed [0,4194304] 0 2024-09-13T02:53:17.159 INFO:tasks.workunit.client.0.smithi098.stdout:8/954: dwrite d2/d2f/d78/f50 [0,4194304] 0 2024-09-13T02:53:17.169 INFO:tasks.workunit.client.0.smithi098.stdout:5/979: getdents d0/d29 0 2024-09-13T02:53:17.170 INFO:tasks.workunit.client.0.smithi098.stdout:6/938: getdents d5/d13/d2b/d3a/d41/d55 0 2024-09-13T02:53:17.172 INFO:tasks.workunit.client.0.smithi098.stdout:5/980: fsync d0/ff 0 2024-09-13T02:53:17.173 INFO:tasks.workunit.client.0.smithi098.stdout:8/955: dread d2/d2f/d78/d46/d74/f94 [0,4194304] 0 2024-09-13T02:53:17.177 INFO:tasks.workunit.client.0.smithi098.stdout:6/939: dread d5/d18/d50/f100 [0,4194304] 0 2024-09-13T02:53:17.177 INFO:tasks.workunit.client.0.smithi098.stdout:6/940: readlink d5/l88 0 2024-09-13T02:53:17.180 INFO:tasks.workunit.client.0.smithi098.stdout:5/981: mknod d0/d15/d50/dd3/c147 0 2024-09-13T02:53:17.181 INFO:tasks.workunit.client.0.smithi098.stdout:8/956: fsync d2/dd/d4d/fed 0 2024-09-13T02:53:17.183 INFO:tasks.workunit.client.0.smithi098.stdout:6/941: dwrite d5/d13/d2b/d5b/f123 [0,4194304] 0 2024-09-13T02:53:17.187 INFO:tasks.workunit.client.0.smithi098.stdout:8/957: rmdir d2/d28/d43/d88/d99/dec 39 2024-09-13T02:53:17.187 INFO:tasks.workunit.client.0.smithi098.stdout:8/958: readlink d2/d2f/d78/lf1 0 2024-09-13T02:53:17.188 INFO:tasks.workunit.client.0.smithi098.stdout:8/959: write d2/dd/d11/d1d/f3a [958810,15375] 0 2024-09-13T02:53:17.190 INFO:tasks.workunit.client.0.smithi098.stdout:8/960: write d2/d2f/d78/d46/f11a [998878,37212] 0 2024-09-13T02:53:17.190 INFO:tasks.workunit.client.0.smithi098.stdout:6/942: rename d5/d36/c10f to d5/d18/d50/c139 0 2024-09-13T02:53:17.191 INFO:tasks.workunit.client.0.smithi098.stdout:8/961: chown d2/dd/d2e/f110 21556 1 2024-09-13T02:53:17.193 INFO:tasks.workunit.client.0.smithi098.stdout:6/943: write d5/d13/d2b/f2d [26671,129336] 0 2024-09-13T02:53:17.196 INFO:tasks.workunit.client.0.smithi098.stdout:5/982: truncate d0/d57/fce 3746791 0 2024-09-13T02:53:17.198 INFO:tasks.workunit.client.0.smithi098.stdout:8/962: dwrite d2/dd/f21 [4194304,4194304] 0 2024-09-13T02:53:17.198 INFO:tasks.workunit.client.0.smithi098.stdout:6/944: dread d5/d13/fc1 [0,4194304] 0 2024-09-13T02:53:17.200 INFO:tasks.workunit.client.0.smithi098.stdout:5/983: write d0/d38/d3f/d81/d4d/d82/f93 [4515053,11550] 0 2024-09-13T02:53:17.201 INFO:tasks.workunit.client.0.smithi098.stdout:5/984: fdatasync d0/d15/d50/f108 0 2024-09-13T02:53:17.202 INFO:tasks.workunit.client.0.smithi098.stdout:5/985: readlink d0/d15/d50/l141 0 2024-09-13T02:53:17.205 INFO:tasks.workunit.client.0.smithi098.stdout:5/986: creat d0/d38/d3f/d1a/d27/f148 x:0 0 0 2024-09-13T02:53:17.205 INFO:tasks.workunit.client.0.smithi098.stdout:8/963: dwrite d2/f9 [4194304,4194304] 0 2024-09-13T02:53:17.206 INFO:tasks.workunit.client.0.smithi098.stdout:5/987: chown d0/d15/d17/l23 239426 1 2024-09-13T02:53:17.209 INFO:tasks.workunit.client.0.smithi098.stdout:8/964: unlink d2/d2f/d78/d46/d74/dfe/c10b 0 2024-09-13T02:53:17.209 INFO:tasks.workunit.client.0.smithi098.stdout:8/965: dread - d2/dd/d2e/f110 zero size 2024-09-13T02:53:17.229 INFO:tasks.workunit.client.0.smithi098.stdout:8/966: rename d2/d2f/d78/d46/fbc to d2/dd/d11/d2c/f135 0 2024-09-13T02:53:17.230 INFO:tasks.workunit.client.0.smithi098.stdout:8/967: readlink d2/dd/l40 0 2024-09-13T02:53:17.230 INFO:tasks.workunit.client.0.smithi098.stdout:8/968: stat d2/d28/d43/f7f 0 2024-09-13T02:53:17.235 INFO:tasks.workunit.client.0.smithi098.stdout:5/988: dread d0/d15/d69/ff3 [0,4194304] 0 2024-09-13T02:53:17.236 INFO:tasks.workunit.client.0.smithi098.stdout:5/989: chown d0/d15/d17/d1c/dd6/f142 2766 1 2024-09-13T02:53:17.241 INFO:tasks.workunit.client.0.smithi098.stdout:5/990: creat d0/d15/d50/dd3/de1/d119/f149 x:0 0 0 2024-09-13T02:53:17.245 INFO:tasks.workunit.client.0.smithi098.stdout:8/969: write d2/d2f/d78/d46/d74/d86/dd2/f102 [824980,4164] 0 2024-09-13T02:53:17.248 INFO:tasks.workunit.client.0.smithi098.stdout:8/970: dread d2/dd/d4d/d96/f52 [0,4194304] 0 2024-09-13T02:53:17.250 INFO:tasks.workunit.client.0.smithi098.stdout:8/971: unlink d2/d28/d43/d88/d99/lc2 0 2024-09-13T02:53:17.254 INFO:tasks.workunit.client.0.smithi098.stdout:8/972: dread d2/d2f/d78/d46/d5c/fd4 [0,4194304] 0 2024-09-13T02:53:17.256 INFO:tasks.workunit.client.0.smithi098.stdout:8/973: mkdir d2/d2f/d78/d46/d74/dfe/d136 0 2024-09-13T02:53:17.258 INFO:tasks.workunit.client.0.smithi098.stdout:8/974: creat d2/d28/d43/d9f/f137 x:0 0 0 2024-09-13T02:53:17.405 INFO:tasks.workunit.client.0.smithi098.stdout:8/975: getdents d2/d2f/d78/d46/d74 0 2024-09-13T02:53:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:8/976: rename d2/d2f/d78/d46/d74/d86/dd2 to d2/dd/d11/d44/d138 0 2024-09-13T02:53:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:8/977: creat d2/d2f/d78/d46/d74/d86/da8/f139 x:0 0 0 2024-09-13T02:53:17.420 INFO:tasks.workunit.client.0.smithi098.stdout:4/990: sync 2024-09-13T02:53:17.421 INFO:tasks.workunit.client.0.smithi098.stdout:4/991: write d6/d10/d21/f65 [5063837,56002] 0 2024-09-13T02:53:17.421 INFO:tasks.workunit.client.0.smithi098.stdout:4/992: chown d6/d3e/d10d 52 1 2024-09-13T02:53:17.422 INFO:tasks.workunit.client.0.smithi098.stdout:4/993: write d6/d22/d3d/d64/fa6 [1920599,122101] 0 2024-09-13T02:53:17.436 INFO:tasks.workunit.client.0.smithi098.stdout:4/994: write d6/d8d/fd0 [7623,125985] 0 2024-09-13T02:53:17.437 INFO:tasks.workunit.client.0.smithi098.stdout:4/995: fdatasync d6/d3e/d46/dd2/fcd 0 2024-09-13T02:53:17.437 INFO:tasks.workunit.client.0.smithi098.stdout:8/978: dwrite d2/d2f/d78/f4b [0,4194304] 0 2024-09-13T02:53:17.439 INFO:tasks.workunit.client.0.smithi098.stdout:4/996: truncate d6/d22/d3d/f110 646750 0 2024-09-13T02:53:17.447 INFO:tasks.workunit.client.0.smithi098.stdout:4/997: dwrite d6/d3e/d73/dfc/d10c/d12f/f149 [0,4194304] 0 2024-09-13T02:53:17.449 INFO:tasks.workunit.client.0.smithi098.stdout:6/945: sync 2024-09-13T02:53:17.450 INFO:tasks.workunit.client.0.smithi098.stdout:4/998: mknod d6/d10/ddc/c151 0 2024-09-13T02:53:17.453 INFO:tasks.workunit.client.0.smithi098.stdout:6/946: creat d5/d13/d2b/f13a x:0 0 0 2024-09-13T02:53:17.454 INFO:tasks.workunit.client.0.smithi098.stdout:6/947: chown d5/d13/d2b/d79/df0/le2 47 1 2024-09-13T02:53:17.458 INFO:tasks.workunit.client.0.smithi098.stdout:6/948: mknod d5/d13/d51/c13b 0 2024-09-13T02:53:17.459 INFO:tasks.workunit.client.0.smithi098.stdout:6/949: chown d5/d13/d2b/d3a/d14/f29 72181 1 2024-09-13T02:53:17.460 INFO:tasks.workunit.client.0.smithi098.stdout:8/979: dread d2/dd/d11/f4c [4194304,4194304] 0 2024-09-13T02:53:17.463 INFO:tasks.workunit.client.0.smithi098.stdout:6/950: dread d5/f15 [8388608,4194304] 0 2024-09-13T02:53:17.467 INFO:tasks.workunit.client.0.smithi098.stdout:6/951: truncate d5/d13/d2b/d3a/d41/f95 899585 0 2024-09-13T02:53:17.468 INFO:tasks.workunit.client.0.smithi098.stdout:6/952: chown d5/d13/d2b/d93/l10e 242488 1 2024-09-13T02:53:17.469 INFO:tasks.workunit.client.0.smithi098.stdout:4/999: dwrite d6/d22/d3d/d64/d6f/fd6 [0,4194304] 0 2024-09-13T02:53:17.471 INFO:tasks.workunit.client.0.smithi098.stdout:6/953: write d5/d13/d2b/d5b/f89 [1088227,66836] 0 2024-09-13T02:53:17.475 INFO:tasks.workunit.client.0.smithi098.stdout:6/954: mknod d5/d13/d67/d85/d127/c13c 0 2024-09-13T02:53:17.479 INFO:tasks.workunit.client.0.smithi098.stdout:6/955: creat d5/d13/d2b/d3a/f13d x:0 0 0 2024-09-13T02:53:17.484 INFO:tasks.workunit.client.0.smithi098.stdout:6/956: symlink d5/d13/d2b/d3a/d41/d6c/d7c/de3/l13e 0 2024-09-13T02:53:17.492 INFO:tasks.workunit.client.0.smithi098.stdout:6/957: dwrite d5/d13/fc1 [0,4194304] 0 2024-09-13T02:53:17.671 INFO:tasks.workunit.client.0.smithi098.stdout:5/991: sync 2024-09-13T02:53:17.675 INFO:tasks.workunit.client.0.smithi098.stdout:5/992: link d0/d38/l83 d0/d38/d3f/d1a/l14a 0 2024-09-13T02:53:17.679 INFO:tasks.workunit.client.0.smithi098.stdout:5/993: creat d0/d38/d3f/d81/d9e/dd4/dfd/d135/f14b x:0 0 0 2024-09-13T02:53:17.681 INFO:tasks.workunit.client.0.smithi098.stdout:5/994: mkdir d0/d15/d69/dfa/d14c 0 2024-09-13T02:53:17.682 INFO:tasks.workunit.client.0.smithi098.stdout:5/995: fsync d0/d38/d3f/fc5 0 2024-09-13T02:53:17.686 INFO:tasks.workunit.client.0.smithi098.stdout:5/996: getdents d0/d15/d17/d1c/d128 0 2024-09-13T02:53:17.687 INFO:tasks.workunit.client.0.smithi098.stdout:5/997: fsync d0/d15/d69/ff3 0 2024-09-13T02:53:17.694 INFO:tasks.workunit.client.0.smithi098.stdout:5/998: write d0/d15/d17/d1c/d3d/ff7 [765239,114698] 0 2024-09-13T02:53:17.696 INFO:tasks.workunit.client.0.smithi098.stdout:5/999: fsync d0/d38/d3f/f73 0 2024-09-13T02:53:17.888 INFO:tasks.workunit.client.0.smithi098.stdout:8/980: sync 2024-09-13T02:53:17.888 INFO:tasks.workunit.client.0.smithi098.stdout:6/958: sync 2024-09-13T02:53:17.888 INFO:tasks.workunit.client.0.smithi098.stdout:8/981: write d2/d28/fbd [3734559,114737] 0 2024-09-13T02:53:17.904 INFO:tasks.workunit.client.0.smithi098.stdout:8/982: dwrite d2/d2f/d78/d5d/dcd/fd9 [4194304,4194304] 0 2024-09-13T02:53:17.908 INFO:tasks.workunit.client.0.smithi098.stdout:6/959: dread d5/d13/d2b/d3a/d14/d6b/d9a/da5/db8/f10a [0,4194304] 0 2024-09-13T02:53:17.911 INFO:tasks.workunit.client.0.smithi098.stdout:8/983: creat d2/f13a x:0 0 0 2024-09-13T02:53:17.914 INFO:tasks.workunit.client.0.smithi098.stdout:6/960: rmdir d5/d13/d2b/d3a/d41/d6c/d7c/dc7 0 2024-09-13T02:53:17.915 INFO:tasks.workunit.client.0.smithi098.stdout:6/961: read d5/d13/f28 [318092,98274] 0 2024-09-13T02:53:17.931 INFO:tasks.workunit.client.0.smithi098.stdout:6/962: dwrite d5/d18/f3c [4194304,4194304] 0 2024-09-13T02:53:17.942 INFO:tasks.workunit.client.0.smithi098.stdout:6/963: write d5/d13/d2b/d3a/d41/f95 [213636,43850] 0 2024-09-13T02:53:17.944 INFO:tasks.workunit.client.0.smithi098.stdout:6/964: symlink d5/d36/d8c/l13f 0 2024-09-13T02:53:17.946 INFO:tasks.workunit.client.0.smithi098.stdout:6/965: mkdir d5/d13/d2b/d3a/d41/d6c/d7c/de3/d140 0 2024-09-13T02:53:17.949 INFO:tasks.workunit.client.0.smithi098.stdout:6/966: unlink d5/d13/d2b/d3a/d41/d55/lc6 0 2024-09-13T02:53:17.950 INFO:tasks.workunit.client.0.smithi098.stdout:6/967: truncate d5/d6f/fae 1291178 0 2024-09-13T02:53:17.950 INFO:tasks.workunit.client.0.smithi098.stdout:6/968: readlink d5/d13/d2b/d3a/d41/l9b 0 2024-09-13T02:53:17.952 INFO:tasks.workunit.client.0.smithi098.stdout:6/969: mkdir d5/d13/d67/d85/d141 0 2024-09-13T02:53:17.953 INFO:tasks.workunit.client.0.smithi098.stdout:6/970: write d5/d13/d2b/d3a/d41/d7e/f7d [3829691,34263] 0 2024-09-13T02:53:17.956 INFO:tasks.workunit.client.0.smithi098.stdout:6/971: mkdir d5/d13/d2b/d3a/d14/d94/de5/d142 0 2024-09-13T02:53:17.964 INFO:tasks.workunit.client.0.smithi098.stdout:6/972: write d5/d18/f25 [341842,123196] 0 2024-09-13T02:53:17.967 INFO:tasks.workunit.client.0.smithi098.stdout:6/973: unlink d5/d13/d2b/d3a/d41/d55/dce/cf5 0 2024-09-13T02:53:17.969 INFO:tasks.workunit.client.0.smithi098.stdout:6/974: write d5/d13/d2b/d93/f11c [25072,85584] 0 2024-09-13T02:53:17.974 INFO:tasks.workunit.client.0.smithi098.stdout:6/975: rename d5/d13/d2b/d3a/f37 to d5/d13/d2b/d3a/d41/df4/f143 0 2024-09-13T02:53:17.979 INFO:tasks.workunit.client.0.smithi098.stdout:6/976: mkdir d5/d13/d2b/d3a/d41/d6c/d7c/de3/d144 0 2024-09-13T02:53:17.981 INFO:tasks.workunit.client.0.smithi098.stdout:6/977: chown d5/d13/d2b/d3a/d41/d55/l116 4027988 1 2024-09-13T02:53:17.984 INFO:tasks.workunit.client.0.smithi098.stdout:6/978: creat d5/d13/d2b/d3a/d14/d94/de5/d142/f145 x:0 0 0 2024-09-13T02:53:18.003 INFO:tasks.workunit.client.0.smithi098.stdout:6/979: dwrite d5/d13/fff [0,4194304] 0 2024-09-13T02:53:18.003 INFO:tasks.workunit.client.0.smithi098.stdout:6/980: chown d5/d13/f119 488 1 2024-09-13T02:53:18.004 INFO:tasks.workunit.client.0.smithi098.stdout:6/981: dread - d5/d13/d2b/d3a/d14/d6b/d9a/da5/f10c zero size 2024-09-13T02:53:18.016 INFO:tasks.workunit.client.0.smithi098.stdout:6/982: dwrite d5/d13/d2b/fd3 [0,4194304] 0 2024-09-13T02:53:18.028 INFO:tasks.workunit.client.0.smithi098.stdout:6/983: truncate d5/d13/d2b/d3a/d41/f4b 2090762 0 2024-09-13T02:53:18.031 INFO:tasks.workunit.client.0.smithi098.stdout:6/984: unlink d5/d13/d2b/d93/l10e 0 2024-09-13T02:53:18.037 INFO:tasks.workunit.client.0.smithi098.stdout:6/985: getdents d5/d13/d2b/d3a/d14/d94/de5 0 2024-09-13T02:53:18.056 INFO:tasks.workunit.client.0.smithi098.stdout:6/986: write d5/d6f/f108 [993129,27912] 0 2024-09-13T02:53:18.093 INFO:tasks.workunit.client.0.smithi098.stdout:6/987: dread d5/d13/d2b/d5b/f89 [0,4194304] 0 2024-09-13T02:53:18.094 INFO:tasks.workunit.client.0.smithi098.stdout:6/988: chown d5/d13/l78 2045330 1 2024-09-13T02:53:18.231 INFO:tasks.workunit.client.0.smithi098.stdout:8/984: sync 2024-09-13T02:53:18.234 INFO:tasks.workunit.client.0.smithi098.stdout:8/985: rename d2/dd/d11/l12 to d2/dd/d11/d44/d138/d11d/l13b 0 2024-09-13T02:53:18.236 INFO:tasks.workunit.client.0.smithi098.stdout:8/986: mkdir d2/dd/d11/d2c/d101/d13c 0 2024-09-13T02:53:18.238 INFO:tasks.workunit.client.0.smithi098.stdout:8/987: mknod d2/d2f/d78/d46/d74/d86/da8/de7/c13d 0 2024-09-13T02:53:18.351 INFO:tasks.workunit.client.0.smithi098.stdout:6/989: sync 2024-09-13T02:53:18.353 INFO:tasks.workunit.client.0.smithi098.stdout:6/990: rmdir d5/d13/d67/d85/d127 39 2024-09-13T02:53:18.357 INFO:tasks.workunit.client.0.smithi098.stdout:6/991: rmdir d5/d13/d67 39 2024-09-13T02:53:18.360 INFO:tasks.workunit.client.0.smithi098.stdout:6/992: symlink d5/d13/d2b/d3a/d14/d6b/d8f/l146 0 2024-09-13T02:53:18.364 INFO:tasks.workunit.client.0.smithi098.stdout:6/993: mknod d5/d13/d2b/d3a/d14/dd9/c147 0 2024-09-13T02:53:18.383 INFO:tasks.workunit.client.0.smithi098.stdout:8/988: sync 2024-09-13T02:53:18.398 INFO:tasks.workunit.client.0.smithi098.stdout:6/994: truncate d5/d13/d2b/d5b/d102/fe4 1021781 0 2024-09-13T02:53:18.402 INFO:tasks.workunit.client.0.smithi098.stdout:6/995: dread d5/d13/d2b/d79/fe9 [0,4194304] 0 2024-09-13T02:53:18.407 INFO:tasks.workunit.client.0.smithi098.stdout:8/989: dread d2/d28/d43/f7f [0,4194304] 0 2024-09-13T02:53:18.409 INFO:tasks.workunit.client.0.smithi098.stdout:8/990: chown d2/f7d 110931466 1 2024-09-13T02:53:18.416 INFO:tasks.workunit.client.0.smithi098.stdout:8/991: link d2/d2f/d78/d46/d74/d86/c87 d2/d2f/d78/dae/c13e 0 2024-09-13T02:53:18.422 INFO:tasks.workunit.client.0.smithi098.stdout:8/992: dwrite d2/fe5 [0,4194304] 0 2024-09-13T02:53:18.427 INFO:tasks.workunit.client.0.smithi098.stdout:8/993: creat d2/d2f/d78/d46/f13f x:0 0 0 2024-09-13T02:53:18.428 INFO:tasks.workunit.client.0.smithi098.stdout:8/994: chown d2/d2f/d78/d46/d47/d6e/l81 15185 1 2024-09-13T02:53:18.429 INFO:tasks.workunit.client.0.smithi098.stdout:8/995: write d2/dd/d4d/d96/f7e [2229606,28756] 0 2024-09-13T02:53:18.430 INFO:tasks.workunit.client.0.smithi098.stdout:8/996: write d2/d28/f112 [4056173,107938] 0 2024-09-13T02:53:18.433 INFO:tasks.workunit.client.0.smithi098.stdout:8/997: creat d2/d28/d43/d88/df2/f140 x:0 0 0 2024-09-13T02:53:18.436 INFO:tasks.workunit.client.0.smithi098.stdout:6/996: write d5/d13/d2b/d3a/d14/f3b [819078,64563] 0 2024-09-13T02:53:18.438 INFO:tasks.workunit.client.0.smithi098.stdout:6/997: dread - d5/d13/d2b/d3a/f10d zero size 2024-09-13T02:53:18.440 INFO:tasks.workunit.client.0.smithi098.stdout:8/998: rmdir d2/d28/d43/d88/df2/d118 0 2024-09-13T02:53:18.441 INFO:tasks.workunit.client.0.smithi098.stdout:8/999: write d2/dd/d11/f18 [4510346,100740] 0 2024-09-13T02:53:18.454 INFO:tasks.workunit.client.0.smithi098.stdout:6/998: dread f4 [0,4194304] 0 2024-09-13T02:53:18.458 INFO:tasks.workunit.client.0.smithi098.stdout:6/999: mknod d5/d13/d2b/d3a/d41/d6c/d7c/de3/d144/c148 0 2024-09-13T02:53:18.461 INFO:tasks.workunit.client.0.smithi098.stderr:+ rm -rf -- ./tmp.41XZbfSbFh 2024-09-13T02:53:18.622 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:18 smithi098 ceph-mon[27886]: pgmap v38: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 38 MiB/s rd, 79 MiB/s wr, 258 op/s 2024-09-13T02:53:18.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:18 smithi142 ceph-mon[33443]: pgmap v38: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 38 MiB/s rd, 79 MiB/s wr, 258 op/s 2024-09-13T02:53:20.730 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:20 smithi098 ceph-mon[27886]: pgmap v39: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 112 MiB/s wr, 366 op/s 2024-09-13T02:53:20.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:20 smithi142 ceph-mon[33443]: pgmap v39: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 112 MiB/s wr, 366 op/s 2024-09-13T02:53:21.207 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T02:53:21.208 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T02:53:22.663 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:22.663 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:22.663 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:22 smithi098 ceph-mon[27886]: pgmap v40: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 31 MiB/s rd, 71 MiB/s wr, 241 op/s 2024-09-13T02:53:22.664 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:22.664 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:22 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:22.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.661+0000 7ff198283700 1 -- 172.21.15.98:0/3893116927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1900ff130 msgr2=0x7ff1900ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:22.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.661+0000 7ff198283700 1 --2- 172.21.15.98:0/3893116927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1900ff130 0x7ff1900ff540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009910 tx=0x7ff18c009c20 comp rx=0 tx=0).stop 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.661+0000 7ff198283700 1 -- 172.21.15.98:0/3893116927 shutdown_connections 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.661+0000 7ff198283700 1 --2- 172.21.15.98:0/3893116927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1901003d0 0x7ff190100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.661+0000 7ff198283700 1 --2- 172.21.15.98:0/3893116927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1900ff130 0x7ff1900ff540 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.661+0000 7ff198283700 1 -- 172.21.15.98:0/3893116927 >> 172.21.15.98:0/3893116927 conn(0x7ff1900fa780 msgr2=0x7ff1900fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.661+0000 7ff198283700 1 -- 172.21.15.98:0/3893116927 shutdown_connections 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.661+0000 7ff198283700 1 -- 172.21.15.98:0/3893116927 wait complete. 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff198283700 1 Processor -- start 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff198283700 1 -- start start 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff198283700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1900ff130 0x7ff190193840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff198283700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1901003d0 0x7ff190193d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff198283700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1901943a0 con 0x7ff1901003d0 2024-09-13T02:53:22.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff198283700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1901944e0 con 0x7ff1900ff130 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff19581e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1901003d0 0x7ff190193d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff19581e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1901003d0 0x7ff190193d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51806/0 (socket says 172.21.15.98:51806) 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff19581e700 1 -- 172.21.15.98:0/1984124736 learned_addr learned my addr 172.21.15.98:0/1984124736 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.662+0000 7ff19601f700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1900ff130 0x7ff190193840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.663+0000 7ff19601f700 1 -- 172.21.15.98:0/1984124736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1901003d0 msgr2=0x7ff190193d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.663+0000 7ff19601f700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1901003d0 0x7ff190193d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.663+0000 7ff19601f700 1 -- 172.21.15.98:0/1984124736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0095f0 con 0x7ff1900ff130 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.663+0000 7ff19601f700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1900ff130 0x7ff190193840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.663+0000 7ff1877fe700 1 -- 172.21.15.98:0/1984124736 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff18c01d070 con 0x7ff1900ff130 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.663+0000 7ff1877fe700 1 -- 172.21.15.98:0/1984124736 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff18c005dc0 con 0x7ff1900ff130 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.663+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff190198f30 con 0x7ff1900ff130 2024-09-13T02:53:22.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.663+0000 7ff1877fe700 1 -- 172.21.15.98:0/1984124736 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff18c017400 con 0x7ff1900ff130 2024-09-13T02:53:22.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.663+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1901992e0 con 0x7ff1900ff130 2024-09-13T02:53:22.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.665+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff190106ae0 con 0x7ff1900ff130 2024-09-13T02:53:22.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.666+0000 7ff1877fe700 1 -- 172.21.15.98:0/1984124736 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 92508+0+0 (secure 0 0 0) 0x7ff18c00fa40 con 0x7ff1900ff130 2024-09-13T02:53:22.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.666+0000 7ff1877fe700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff17c070630 0x7ff17c072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:22.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.666+0000 7ff1877fe700 1 -- 172.21.15.98:0/1984124736 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff18c08f5d0 con 0x7ff1900ff130 2024-09-13T02:53:22.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.666+0000 7ff19581e700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff17c070630 0x7ff17c072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:22.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.667+0000 7ff19581e700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff17c070630 0x7ff17c072ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff180009d20 tx=0x7ff180009260 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:22.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.671+0000 7ff1877fe700 1 -- 172.21.15.98:0/1984124736 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff18c05c6c0 con 0x7ff1900ff130 2024-09-13T02:53:22.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:22 smithi142 ceph-mon[33443]: pgmap v40: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 31 MiB/s rd, 71 MiB/s wr, 241 op/s 2024-09-13T02:53:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:22 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:23.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:22.999+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff190104d20 con 0x7ff17c070630 2024-09-13T02:53:23.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.001+0000 7ff1877fe700 1 -- 172.21.15.98:0/1984124736 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7ff190104d20 con 0x7ff17c070630 2024-09-13T02:53:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff17c070630 msgr2=0x7ff17c072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff17c070630 0x7ff17c072ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff180009d20 tx=0x7ff180009260 comp rx=0 tx=0).stop 2024-09-13T02:53:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1900ff130 msgr2=0x7ff190193840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1900ff130 0x7ff190193840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c00f690 comp rx=0 tx=0).stop 2024-09-13T02:53:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 shutdown_connections 2024-09-13T02:53:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff17c070630 0x7ff17c072ae0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1900ff130 0x7ff190193840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 --2- 172.21.15.98:0/1984124736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1901003d0 0x7ff190193d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 >> 172.21.15.98:0/1984124736 conn(0x7ff1900fa780 msgr2=0x7ff190103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 shutdown_connections 2024-09-13T02:53:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.003+0000 7ff198283700 1 -- 172.21.15.98:0/1984124736 wait complete. 2024-09-13T02:53:23.019 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.144+0000 7fdd37ed2700 1 -- 172.21.15.98:0/2627685230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fee50 msgr2=0x7fdd30101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.144+0000 7fdd37ed2700 1 --2- 172.21.15.98:0/2627685230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fee50 0x7fdd30101580 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009910 tx=0x7fdd20009c20 comp rx=0 tx=0).stop 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.144+0000 7fdd37ed2700 1 -- 172.21.15.98:0/2627685230 shutdown_connections 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.144+0000 7fdd37ed2700 1 --2- 172.21.15.98:0/2627685230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fee50 0x7fdd30101580 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.144+0000 7fdd37ed2700 1 --2- 172.21.15.98:0/2627685230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300fe500 0x7fdd300fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.144+0000 7fdd37ed2700 1 -- 172.21.15.98:0/2627685230 >> 172.21.15.98:0/2627685230 conn(0x7fdd300f9f10 msgr2=0x7fdd300fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.144+0000 7fdd37ed2700 1 -- 172.21.15.98:0/2627685230 shutdown_connections 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.144+0000 7fdd37ed2700 1 -- 172.21.15.98:0/2627685230 wait complete. 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd37ed2700 1 Processor -- start 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd37ed2700 1 -- start start 2024-09-13T02:53:23.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd37ed2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fe500 0x7fdd30195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:23.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd37ed2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300fee50 0x7fdd30196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:23.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd37ed2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd30196690 con 0x7fdd300fe500 2024-09-13T02:53:23.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd37ed2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd301967d0 con 0x7fdd300fee50 2024-09-13T02:53:23.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd35c6e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fe500 0x7fdd30195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:23.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd35c6e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fe500 0x7fdd30195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51824/0 (socket says 172.21.15.98:51824) 2024-09-13T02:53:23.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd35c6e700 1 -- 172.21.15.98:0/1684382937 learned_addr learned my addr 172.21.15.98:0/1684382937 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:23.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.145+0000 7fdd3546d700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300fee50 0x7fdd30196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:23.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.146+0000 7fdd35c6e700 1 -- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300fee50 msgr2=0x7fdd30196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:23.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.146+0000 7fdd35c6e700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300fee50 0x7fdd30196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.146+0000 7fdd35c6e700 1 -- 172.21.15.98:0/1684382937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200095f0 con 0x7fdd300fe500 2024-09-13T02:53:23.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.146+0000 7fdd35c6e700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fe500 0x7fdd30195b30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c8a0 tx=0x7fdd2c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:23.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.146+0000 7fdd26ffd700 1 -- 172.21.15.98:0/1684382937 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd2c0078e0 con 0x7fdd300fe500 2024-09-13T02:53:23.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.146+0000 7fdd26ffd700 1 -- 172.21.15.98:0/1684382937 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd2c00f450 con 0x7fdd300fe500 2024-09-13T02:53:23.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.146+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3019b280 con 0x7fdd300fe500 2024-09-13T02:53:23.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.146+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3019b7d0 con 0x7fdd300fe500 2024-09-13T02:53:23.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.146+0000 7fdd26ffd700 1 -- 172.21.15.98:0/1684382937 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd2c00e5e0 con 0x7fdd300fe500 2024-09-13T02:53:23.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.147+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd30108d10 con 0x7fdd300fe500 2024-09-13T02:53:23.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.148+0000 7fdd26ffd700 1 -- 172.21.15.98:0/1684382937 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 92508+0+0 (secure 0 0 0) 0x7fdd2c00f5c0 con 0x7fdd300fe500 2024-09-13T02:53:23.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.149+0000 7fdd26ffd700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fdd1c06e440 0x7fdd1c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:23.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.149+0000 7fdd26ffd700 1 -- 172.21.15.98:0/1684382937 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fdd2c08e1a0 con 0x7fdd300fe500 2024-09-13T02:53:23.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.149+0000 7fdd3546d700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fdd1c06e440 0x7fdd1c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:23.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.150+0000 7fdd3546d700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fdd1c06e440 0x7fdd1c0708f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdd20005090 tx=0x7fdd2000b540 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:23.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.157+0000 7fdd26ffd700 1 -- 172.21.15.98:0/1684382937 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fdd2c05b330 con 0x7fdd300fe500 2024-09-13T02:53:23.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.517+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd3019bed0 con 0x7fdd1c06e440 2024-09-13T02:53:23.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.518+0000 7fdd26ffd700 1 -- 172.21.15.98:0/1684382937 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fdd3019bed0 con 0x7fdd1c06e440 2024-09-13T02:53:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fdd1c06e440 msgr2=0x7fdd1c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fdd1c06e440 0x7fdd1c0708f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdd20005090 tx=0x7fdd2000b540 comp rx=0 tx=0).stop 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fe500 msgr2=0x7fdd30195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fe500 0x7fdd30195b30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c8a0 tx=0x7fdd2c00cbb0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 shutdown_connections 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7fdd1c06e440 0x7fdd1c0708f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd300fe500 0x7fdd30195b30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 --2- 172.21.15.98:0/1684382937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300fee50 0x7fdd30196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 >> 172.21.15.98:0/1684382937 conn(0x7fdd300f9f10 msgr2=0x7fdd301047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 shutdown_connections 2024-09-13T02:53:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.520+0000 7fdd37ed2700 1 -- 172.21.15.98:0/1684382937 wait complete. 2024-09-13T02:53:23.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.658+0000 7ff8d8a94700 1 -- 172.21.15.98:0/1425739939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 msgr2=0x7ff8d4103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:23.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.658+0000 7ff8d8a94700 1 --2- 172.21.15.98:0/1425739939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 0x7ff8d4103b40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009910 tx=0x7ff8c8009c20 comp rx=0 tx=0).stop 2024-09-13T02:53:23.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.659+0000 7ff8d8a94700 1 -- 172.21.15.98:0/1425739939 shutdown_connections 2024-09-13T02:53:23.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.659+0000 7ff8d8a94700 1 --2- 172.21.15.98:0/1425739939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 0x7ff8d4103b40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.659+0000 7ff8d8a94700 1 --2- 172.21.15.98:0/1425739939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d4102430 0x7ff8d4102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.659+0000 7ff8d8a94700 1 -- 172.21.15.98:0/1425739939 >> 172.21.15.98:0/1425739939 conn(0x7ff8d40fda80 msgr2=0x7ff8d40ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:23.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.659+0000 7ff8d8a94700 1 -- 172.21.15.98:0/1425739939 shutdown_connections 2024-09-13T02:53:23.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.659+0000 7ff8d8a94700 1 -- 172.21.15.98:0/1425739939 wait complete. 2024-09-13T02:53:23.661 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:23 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:23.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.659+0000 7ff8d8a94700 1 Processor -- start 2024-09-13T02:53:23.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.659+0000 7ff8d8a94700 1 -- start start 2024-09-13T02:53:23.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d8a94700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d4102430 0x7ff8d4197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:23.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d8a94700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 0x7ff8d41981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:23.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d8a94700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d41987d0 con 0x7ff8d41036d0 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d8a94700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4198940 con 0x7ff8d4102430 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 0x7ff8d41981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 0x7ff8d41981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51832/0 (socket says 172.21.15.98:51832) 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d1d9b700 1 -- 172.21.15.98:0/2486422353 learned_addr learned my addr 172.21.15.98:0/2486422353 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d1d9b700 1 -- 172.21.15.98:0/2486422353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d4102430 msgr2=0x7ff8d4197c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d1d9b700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d4102430 0x7ff8d4197c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d1d9b700 1 -- 172.21.15.98:0/2486422353 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80095f0 con 0x7ff8d41036d0 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.660+0000 7ff8d1d9b700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 0x7ff8d41981d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8000c00 tx=0x7ff8c800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.661+0000 7ff8c37fe700 1 -- 172.21.15.98:0/2486422353 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c801d070 con 0x7ff8d41036d0 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.661+0000 7ff8c37fe700 1 -- 172.21.15.98:0/2486422353 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff8c8005dc0 con 0x7ff8d41036d0 2024-09-13T02:53:23.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.661+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d419d370 con 0x7ff8d41036d0 2024-09-13T02:53:23.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.661+0000 7ff8c37fe700 1 -- 172.21.15.98:0/2486422353 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c80226a0 con 0x7ff8d41036d0 2024-09-13T02:53:23.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.661+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d419d860 con 0x7ff8d41036d0 2024-09-13T02:53:23.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.662+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d410af10 con 0x7ff8d41036d0 2024-09-13T02:53:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.662+0000 7ff8c37fe700 1 -- 172.21.15.98:0/2486422353 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 92508+0+0 (secure 0 0 0) 0x7ff8c8003680 con 0x7ff8d41036d0 2024-09-13T02:53:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.663+0000 7ff8c37fe700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff8bc06e440 0x7ff8bc0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.663+0000 7ff8c37fe700 1 -- 172.21.15.98:0/2486422353 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff8c808f5e0 con 0x7ff8d41036d0 2024-09-13T02:53:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.663+0000 7ff8d259c700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff8bc06e440 0x7ff8bc0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:23.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.664+0000 7ff8d259c700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff8bc06e440 0x7ff8bc0708f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4198b70 tx=0x7ff8c4009260 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:23.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:23.671+0000 7ff8c37fe700 1 -- 172.21.15.98:0/2486422353 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff8c8058cc0 con 0x7ff8d41036d0 2024-09-13T02:53:23.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:23 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:24.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.006+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8d4108020 con 0x7ff8bc06e440 2024-09-13T02:53:24.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.017+0000 7ff8c37fe700 1 -- 172.21.15.98:0/2486422353 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7ff8d4108020 con 0x7ff8bc06e440 2024-09-13T02:53:24.018 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:53:24.018 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (7m) 2s ago 8m 24.6M - 0.25.0 c8568f914cd2 babcc5d689b7 2024-09-13T02:53:24.018 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (9m) 2s ago 9m 7746k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (8m) 69s ago 8m 7306k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (9m) 2s ago 9m 6660k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (8m) 69s ago 8m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (7m) 2s ago 8m 86.8M - 9.4.7 954c08fa6188 6b3b619a7e20 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (3m) 2s ago 3m 263M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (3m) 2s ago 3m 253M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (3m) 69s ago 3m 12.9M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (3m) 69s ago 3m 16.0M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (25s) 2s ago 10m 113M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (93s) 69s ago 7m 479M - 19.1.1-322-g7741f7f9 19dc8d659727 0ffcd7ff6f2c 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (10m) 2s ago 10m 53.2M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (7m) 69s ago 7m 38.4M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:53:24.019 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (8m) 2s ago 8m 16.1M - 1.5.0 0da6a335fe13 5c48ece10527 2024-09-13T02:53:24.020 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (8m) 69s ago 8m 15.0M - 1.5.0 0da6a335fe13 b2fc832c8f17 2024-09-13T02:53:24.020 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (7m) 2s ago 7m 209M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:53:24.020 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (6m) 2s ago 6m 210M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:53:24.020 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (6m) 2s ago 6m 180M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:53:24.020 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (5m) 69s ago 5m 83.8M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:53:24.020 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (5m) 69s ago 5m 79.2M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:53:24.020 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (4m) 69s ago 4m 73.8M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:53:24.020 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (56s) 2s ago 8m 54.0M - 2.43.0 a07b618ecd1d 4d4863e3378a 2024-09-13T02:53:24.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.020+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff8bc06e440 msgr2=0x7ff8bc0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:24.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.020+0000 7ff8d8a94700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff8bc06e440 0x7ff8bc0708f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4198b70 tx=0x7ff8c4009260 comp rx=0 tx=0).stop 2024-09-13T02:53:24.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.020+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 msgr2=0x7ff8d41981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:24.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.020+0000 7ff8d8a94700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 0x7ff8d41981d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8000c00 tx=0x7ff8c800f740 comp rx=0 tx=0).stop 2024-09-13T02:53:24.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.020+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 shutdown_connections 2024-09-13T02:53:24.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.020+0000 7ff8d8a94700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7ff8bc06e440 0x7ff8bc0708f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.020+0000 7ff8d8a94700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d4102430 0x7ff8d4197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.020+0000 7ff8d8a94700 1 --2- 172.21.15.98:0/2486422353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41036d0 0x7ff8d41981d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.020+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 >> 172.21.15.98:0/2486422353 conn(0x7ff8d40fda80 msgr2=0x7ff8d4106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:24.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.021+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 shutdown_connections 2024-09-13T02:53:24.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.021+0000 7ff8d8a94700 1 -- 172.21.15.98:0/2486422353 wait complete. 2024-09-13T02:53:24.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.183+0000 7f894e3ee700 1 -- 172.21.15.98:0/518082495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948100ce0 msgr2=0x7f89481030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:24.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.183+0000 7f894e3ee700 1 --2- 172.21.15.98:0/518082495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948100ce0 0x7f89481030c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8938009910 tx=0x7f8938009c20 comp rx=0 tx=0).stop 2024-09-13T02:53:24.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.184+0000 7f894e3ee700 1 -- 172.21.15.98:0/518082495 shutdown_connections 2024-09-13T02:53:24.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.184+0000 7f894e3ee700 1 --2- 172.21.15.98:0/518082495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8948103600 0x7f89481059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.184+0000 7f894e3ee700 1 --2- 172.21.15.98:0/518082495 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948100ce0 0x7f89481030c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.184+0000 7f894e3ee700 1 -- 172.21.15.98:0/518082495 >> 172.21.15.98:0/518082495 conn(0x7f89480fa700 msgr2=0x7f89480fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.184+0000 7f894e3ee700 1 -- 172.21.15.98:0/518082495 shutdown_connections 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.184+0000 7f894e3ee700 1 -- 172.21.15.98:0/518082495 wait complete. 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.185+0000 7f894e3ee700 1 Processor -- start 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.185+0000 7f894e3ee700 1 -- start start 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.185+0000 7f894e3ee700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8948100ce0 0x7f8948100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.185+0000 7f894e3ee700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948103600 0x7f89480fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.185+0000 7f894e3ee700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480ff1d0 con 0x7f8948103600 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.185+0000 7f894e3ee700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89480ff310 con 0x7f8948100ce0 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.185+0000 7f89477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948103600 0x7f89480fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:24.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.185+0000 7f89477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948103600 0x7f89480fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51852/0 (socket says 172.21.15.98:51852) 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.185+0000 7f89477fe700 1 -- 172.21.15.98:0/1615582792 learned_addr learned my addr 172.21.15.98:0/1615582792 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f8947fff700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8948100ce0 0x7f8948100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f89477fe700 1 -- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8948100ce0 msgr2=0x7f8948100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f89477fe700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8948100ce0 0x7f8948100640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f89477fe700 1 -- 172.21.15.98:0/1615582792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380095f0 con 0x7f8948103600 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f89477fe700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948103600 0x7f89480fec90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f893c00e920 tx=0x7f893c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f89457fa700 1 -- 172.21.15.98:0/1615582792 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f893c00c9d0 con 0x7f8948103600 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89480ff5f0 con 0x7f8948103600 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894819db10 con 0x7f8948103600 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f89457fa700 1 -- 172.21.15.98:0/1615582792 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f893c010430 con 0x7f8948103600 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.186+0000 7f89457fa700 1 -- 172.21.15.98:0/1615582792 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f893c018650 con 0x7f8948103600 2024-09-13T02:53:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.187+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8934005320 con 0x7f8948103600 2024-09-13T02:53:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.188+0000 7f89457fa700 1 -- 172.21.15.98:0/1615582792 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 26) v1 ==== 92508+0+0 (secure 0 0 0) 0x7f893c00cb30 con 0x7f8948103600 2024-09-13T02:53:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.188+0000 7f89457fa700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f893006e440 0x7f89300708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.189+0000 7f89457fa700 1 -- 172.21.15.98:0/1615582792 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f893c014070 con 0x7f8948103600 2024-09-13T02:53:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.189+0000 7f8947fff700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f893006e440 0x7f89300708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.189+0000 7f8947fff700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f893006e440 0x7f89300708f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8938009fd0 tx=0x7f8938005940 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:24.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.196+0000 7f89457fa700 1 -- 172.21.15.98:0/1615582792 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f893c0539d0 con 0x7f8948103600 2024-09-13T02:53:24.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:24 smithi098 ceph-mon[27886]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:24.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:24 smithi098 ceph-mon[27886]: pgmap v41: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 31 MiB/s rd, 71 MiB/s wr, 251 op/s 2024-09-13T02:53:24.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:24 smithi098 ceph-mon[27886]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:24.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.649+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8934005cc0 con 0x7f8948103600 2024-09-13T02:53:24.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.650+0000 7f89457fa700 1 -- 172.21.15.98:0/1615582792 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f893c05b4e0 con 0x7f8948103600 2024-09-13T02:53:24.652 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:53:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:53:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T02:53:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:53:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:53:24.654 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:53:24.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f893006e440 msgr2=0x7f89300708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f893006e440 0x7f89300708f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8938009fd0 tx=0x7f8938005940 comp rx=0 tx=0).stop 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948103600 msgr2=0x7f89480fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948103600 0x7f89480fec90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f893c00e920 tx=0x7f893c00ec30 comp rx=0 tx=0).stop 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 shutdown_connections 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f893006e440 0x7f89300708f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8948100ce0 0x7f8948100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 --2- 172.21.15.98:0/1615582792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8948103600 0x7f89480fec90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 >> 172.21.15.98:0/1615582792 conn(0x7f89480fa700 msgr2=0x7f89480fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 shutdown_connections 2024-09-13T02:53:24.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.653+0000 7f894e3ee700 1 -- 172.21.15.98:0/1615582792 wait complete. 2024-09-13T02:53:24.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:24 smithi142 ceph-mon[33443]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:24.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:24 smithi142 ceph-mon[33443]: pgmap v41: 65 pgs: 65 active+clean; 2.6 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 31 MiB/s rd, 71 MiB/s wr, 251 op/s 2024-09-13T02:53:24.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:24 smithi142 ceph-mon[33443]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:24.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.787+0000 7f6e01765700 1 -- 172.21.15.98:0/944701748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dfc100d60 msgr2=0x7f6dfc103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:24.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.787+0000 7f6e01765700 1 --2- 172.21.15.98:0/944701748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dfc100d60 0x7f6dfc103140 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009910 tx=0x7f6dec009c20 comp rx=0 tx=0).stop 2024-09-13T02:53:24.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.788+0000 7f6e01765700 1 -- 172.21.15.98:0/944701748 shutdown_connections 2024-09-13T02:53:24.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.788+0000 7f6e01765700 1 --2- 172.21.15.98:0/944701748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc103680 0x7f6dfc105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.788+0000 7f6e01765700 1 --2- 172.21.15.98:0/944701748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dfc100d60 0x7f6dfc103140 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.788+0000 7f6e01765700 1 -- 172.21.15.98:0/944701748 >> 172.21.15.98:0/944701748 conn(0x7f6dfc0fa780 msgr2=0x7f6dfc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.788+0000 7f6e01765700 1 -- 172.21.15.98:0/944701748 shutdown_connections 2024-09-13T02:53:24.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.788+0000 7f6e01765700 1 -- 172.21.15.98:0/944701748 wait complete. 2024-09-13T02:53:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.788+0000 7f6e01765700 1 Processor -- start 2024-09-13T02:53:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6e01765700 1 -- start start 2024-09-13T02:53:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6e01765700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc100d60 0x7f6dfc195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6e01765700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dfc103680 0x7f6dfc195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6e01765700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc196610 con 0x7f6dfc103680 2024-09-13T02:53:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6e01765700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc196750 con 0x7f6dfc100d60 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6dfaffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc100d60 0x7f6dfc195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6dfaffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc100d60 0x7f6dfc195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.98:50622/0 (socket says 172.21.15.98:50622) 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6dfaffd700 1 -- 172.21.15.98:0/208899858 learned_addr learned my addr 172.21.15.98:0/208899858 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6dfa7fc700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dfc103680 0x7f6dfc195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6dfaffd700 1 -- 172.21.15.98:0/208899858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dfc103680 msgr2=0x7f6dfc195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6dfaffd700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dfc103680 0x7f6dfc195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6dfaffd700 1 -- 172.21.15.98:0/208899858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec0095f0 con 0x7f6dfc100d60 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.789+0000 7f6dfaffd700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc100d60 0x7f6dfc195ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6dec000c00 tx=0x7f6dec00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.790+0000 7f6de3fff700 1 -- 172.21.15.98:0/208899858 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dec01d070 con 0x7f6dfc100d60 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.790+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc19b1a0 con 0x7f6dfc100d60 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.790+0000 7f6de3fff700 1 -- 172.21.15.98:0/208899858 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6dec005dc0 con 0x7f6dfc100d60 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.790+0000 7f6de3fff700 1 -- 172.21.15.98:0/208899858 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dec022470 con 0x7f6dfc100d60 2024-09-13T02:53:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.790+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc19b690 con 0x7f6dfc100d60 2024-09-13T02:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.791+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc18fbc0 con 0x7f6dfc100d60 2024-09-13T02:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.791+0000 7f6de3fff700 1 -- 172.21.15.98:0/208899858 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 92508+0+0 (secure 0 0 0) 0x7f6dec00fa70 con 0x7f6dfc100d60 2024-09-13T02:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.792+0000 7f6de3fff700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f6de406e440 0x7f6de40708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:24.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.792+0000 7f6de3fff700 1 -- 172.21.15.98:0/208899858 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f6dec08f690 con 0x7f6dfc100d60 2024-09-13T02:53:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.792+0000 7f6dfa7fc700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f6de406e440 0x7f6de40708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:24.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.792+0000 7f6dfa7fc700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f6de406e440 0x7f6de40708f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009c60 tx=0x7f6df0009260 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:24.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:24.797+0000 7f6de3fff700 1 -- 172.21.15.98:0/208899858 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f6dec05c820 con 0x7f6dfc100d60 2024-09-13T02:53:25.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.088+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 --> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dfc061190 con 0x7f6de406e440 2024-09-13T02:53:25.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.090+0000 7f6de3fff700 1 -- 172.21.15.98:0/208899858 <== mgr.24363 v2:172.21.15.142:6828/4116480224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f6dfc061190 con 0x7f6de406e440 2024-09-13T02:53:25.091 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:53:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:53:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:53:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T02:53:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:53:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr" 2024-09-13T02:53:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:53:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T02:53:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T02:53:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:53:25.092 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f6de406e440 msgr2=0x7f6de40708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f6de406e440 0x7f6de40708f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009c60 tx=0x7f6df0009260 comp rx=0 tx=0).stop 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc100d60 msgr2=0x7f6dfc195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc100d60 0x7f6dfc195ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6dec000c00 tx=0x7f6dec00f690 comp rx=0 tx=0).stop 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 shutdown_connections 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:6828/4116480224,v1:172.21.15.142:6829/4116480224] conn(0x7f6de406e440 0x7f6de40708f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dfc100d60 0x7f6dfc195ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 --2- 172.21.15.98:0/208899858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dfc103680 0x7f6dfc195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 >> 172.21.15.98:0/208899858 conn(0x7f6dfc0fa780 msgr2=0x7f6dfc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 shutdown_connections 2024-09-13T02:53:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:25.092+0000 7f6e01765700 1 -- 172.21.15.98:0/208899858 wait complete. 2024-09-13T02:53:25.634 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:25 smithi142 ceph-mon[33443]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:25.634 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:25 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1615582792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:25.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:25 smithi098 ceph-mon[27886]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:25.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:25 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1615582792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:26.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:26.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:26.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:26.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:53:26.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:26.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:26.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr fail", "who": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr fail", "who": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd='[{"prefix": "mgr fail", "who": "smithi142.jutrvi"}]': finished 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: mgrmap e27: smithi098.ukgenf(active, starting, since 0.00645634s) 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:53:26.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: Manager daemon smithi098.ukgenf is now available 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:53:26.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/trash_purge_schedule"}]: dispatch 2024-09-13T02:53:26.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:26.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:26.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.24363 172.21.15.142:0/3372137986' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr fail", "who": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "mgr fail", "who": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.24363 ' entity='mgr.smithi142.jutrvi' cmd='[{"prefix": "mgr fail", "who": "smithi142.jutrvi"}]': finished 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: mgrmap e27: smithi098.ukgenf(active, starting, since 0.00645634s) 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T02:53:26.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:53:26.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: Manager daemon smithi098.ukgenf is now available 2024-09-13T02:53:26.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:26.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:26.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:53:26.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/trash_purge_schedule"}]: dispatch 2024-09-13T02:53:27.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:27 smithi142 ceph-mon[33443]: mgrmap e28: smithi098.ukgenf(active, since 1.01002s) 2024-09-13T02:53:27.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:27 smithi142 ceph-mon[33443]: pgmap v3: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-09-13T02:53:27.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:27 smithi098 ceph-mon[27886]: mgrmap e28: smithi098.ukgenf(active, since 1.01002s) 2024-09-13T02:53:27.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:27 smithi098 ceph-mon[27886]: pgmap v3: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-09-13T02:53:28.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:28 smithi142 ceph-mon[33443]: pgmap v4: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-09-13T02:53:28.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:28 smithi142 ceph-mon[33443]: mgrmap e29: smithi098.ukgenf(active, since 2s) 2024-09-13T02:53:28.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:28 smithi098 ceph-mon[27886]: pgmap v4: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-09-13T02:53:28.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:28 smithi098 ceph-mon[27886]: mgrmap e29: smithi098.ukgenf(active, since 2s) 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:29 smithi098 ceph-mon[27886]: [13/Sep/2024:02:53:27] ENGINE Bus STARTING 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:29 smithi098 ceph-mon[27886]: [13/Sep/2024:02:53:27] ENGINE Serving on http://172.21.15.98:8765 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:29 smithi098 ceph-mon[27886]: [13/Sep/2024:02:53:28] ENGINE Serving on https://172.21.15.98:7150 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:29 smithi098 ceph-mon[27886]: [13/Sep/2024:02:53:28] ENGINE Bus STARTED 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:29 smithi098 ceph-mon[27886]: [13/Sep/2024:02:53:28] ENGINE Error in HTTPServer.serve 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Traceback (most recent call last): 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._run(expiration_interval) 2024-09-13T02:53:29.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s = self.context.wrap_socket( 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: return self.sslsocket_class._create( 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self.do_handshake() 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._sslobj.do_handshake() 2024-09-13T02:53:29.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:29 smithi142 ceph-mon[33443]: [13/Sep/2024:02:53:27] ENGINE Bus STARTING 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:29 smithi142 ceph-mon[33443]: [13/Sep/2024:02:53:27] ENGINE Serving on http://172.21.15.98:8765 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:29 smithi142 ceph-mon[33443]: [13/Sep/2024:02:53:28] ENGINE Serving on https://172.21.15.98:7150 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:29 smithi142 ceph-mon[33443]: [13/Sep/2024:02:53:28] ENGINE Bus STARTED 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:29 smithi142 ceph-mon[33443]: [13/Sep/2024:02:53:28] ENGINE Error in HTTPServer.serve 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Traceback (most recent call last): 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self._run(expiration_interval) 2024-09-13T02:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: s = self.context.wrap_socket( 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: return self.sslsocket_class._create( 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self.do_handshake() 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self._sslobj.do_handshake() 2024-09-13T02:53:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:53:30.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:30 smithi098 ceph-mon[27886]: pgmap v5: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-09-13T02:53:30.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:30 smithi098 ceph-mon[27886]: mgrmap e30: smithi098.ukgenf(active, since 4s) 2024-09-13T02:53:30.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:30 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:30.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:30 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:30.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:30 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:30.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:30 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:31.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:30 smithi142 ceph-mon[33443]: pgmap v5: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-09-13T02:53:31.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:30 smithi142 ceph-mon[33443]: mgrmap e30: smithi098.ukgenf(active, since 4s) 2024-09-13T02:53:31.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:30 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:31.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:30 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:31.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:30 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:31.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:30 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:31 smithi098 ceph-mon[27886]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:53:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:31 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/2593412715' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:53:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:31 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/2593412715' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:53:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:31 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/2593412715' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:53:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:31 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/2593412715' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:53:32.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:31 smithi142 ceph-mon[33443]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:53:32.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:31 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/2593412715' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:53:32.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:31 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/2593412715' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:53:32.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:31 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/2593412715' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:53:32.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:31 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/2593412715' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:53:32.960 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:32 smithi142 ceph-mon[33443]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 2.2 KiB/s wr, 8 op/s 2024-09-13T02:53:32.960 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:32 smithi142 ceph-mon[33443]: mgrmap e31: smithi098.ukgenf(active, since 6s), standbys: smithi142.jutrvi 2024-09-13T02:53:32.960 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:32 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi142.jutrvi", "id": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:53:32.961 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:32 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:32.961 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:32 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:32.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:32 smithi098 ceph-mon[27886]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 2.2 KiB/s wr, 8 op/s 2024-09-13T02:53:32.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:32 smithi098 ceph-mon[27886]: mgrmap e31: smithi098.ukgenf(active, since 6s), standbys: smithi142.jutrvi 2024-09-13T02:53:32.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:32 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi142.jutrvi", "id": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:53:32.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:32 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:32.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:32 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:34.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:34 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:34 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:34 smithi098 ceph-mon[27886]: pgmap v7: 65 pgs: 65 active+clean; 1.2 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-09-13T02:53:34.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:34 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:34.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:34 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:34.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:34 smithi142 ceph-mon[33443]: pgmap v7: 65 pgs: 65 active+clean; 1.2 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-09-13T02:53:36.786 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:36 smithi098 ceph-mon[27886]: pgmap v8: 65 pgs: 65 active+clean; 1.2 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 832 KiB/s rd, 927 KiB/s wr, 90 op/s 2024-09-13T02:53:37.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:36 smithi142 ceph-mon[33443]: pgmap v8: 65 pgs: 65 active+clean; 1.2 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 832 KiB/s rd, 927 KiB/s wr, 90 op/s 2024-09-13T02:53:38.073 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T02:53:38.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: pgmap v9: 65 pgs: 65 active+clean; 624 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 136 op/s 2024-09-13T02:53:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:53:38.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:38 smithi098 ceph-mon[27886]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: pgmap v9: 65 pgs: 65 active+clean; 624 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 136 op/s 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:53:38.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:38 smithi142 ceph-mon[33443]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:53:39.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:39 smithi098 ceph-mon[27886]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:53:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:39 smithi098 ceph-mon[27886]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:53:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:39 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:39 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:39 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:39 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:39 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:39 smithi098 ceph-mon[27886]: Reconfiguring prometheus.smithi098 (dependencies changed)... 2024-09-13T02:53:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:39 smithi098 ceph-mon[27886]: Reconfiguring daemon prometheus.smithi098 on smithi098 2024-09-13T02:53:39.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:39 smithi142 ceph-mon[33443]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:53:39.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:39 smithi142 ceph-mon[33443]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:53:39.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:39 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:39 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:39 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:39 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:39 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:53:39.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:39 smithi142 ceph-mon[33443]: Reconfiguring prometheus.smithi098 (dependencies changed)... 2024-09-13T02:53:39.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:39 smithi142 ceph-mon[33443]: Reconfiguring daemon prometheus.smithi098 on smithi098 2024-09-13T02:53:40.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:40 smithi098 ceph-mon[27886]: pgmap v10: 65 pgs: 65 active+clean; 624 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-09-13T02:53:40.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:40 smithi142 ceph-mon[33443]: pgmap v10: 65 pgs: 65 active+clean; 624 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-09-13T02:53:41.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:41 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:41.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:41 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:42.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:42 smithi098 ceph-mon[27886]: pgmap v11: 65 pgs: 65 active+clean; 598 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-09-13T02:53:42.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:42 smithi142 ceph-mon[33443]: pgmap v11: 65 pgs: 65 active+clean; 598 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 128 op/s 2024-09-13T02:53:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:44 smithi098 ceph-mon[27886]: pgmap v12: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-09-13T02:53:45.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:44 smithi142 ceph-mon[33443]: pgmap v12: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-09-13T02:53:46.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:46 smithi098 ceph-mon[27886]: pgmap v13: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 112 op/s 2024-09-13T02:53:47.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:46 smithi142 ceph-mon[33443]: pgmap v13: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 112 op/s 2024-09-13T02:53:48.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:48 smithi098 ceph-mon[27886]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 157 op/s 2024-09-13T02:53:48.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:48 smithi142 ceph-mon[33443]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 157 op/s 2024-09-13T02:53:50.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:50 smithi098 ceph-mon[27886]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-09-13T02:53:51.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:50 smithi142 ceph-mon[33443]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-09-13T02:53:52.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:52 smithi098 ceph-mon[27886]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-09-13T02:53:53.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:52 smithi142 ceph-mon[33443]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-09-13T02:53:54.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:54 smithi098 ceph-mon[27886]: pgmap v17: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-09-13T02:53:55.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:54 smithi142 ceph-mon[33443]: pgmap v17: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-09-13T02:53:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.237+0000 7f9ad6d48700 1 -- 172.21.15.98:0/235411236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 msgr2=0x7f9ad00ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.237+0000 7f9ad6d48700 1 --2- 172.21.15.98:0/235411236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 0x7f9ad00ff4b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009910 tx=0x7f9abc009c20 comp rx=0 tx=0).stop 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.237+0000 7f9ad6d48700 1 -- 172.21.15.98:0/235411236 shutdown_connections 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.237+0000 7f9ad6d48700 1 --2- 172.21.15.98:0/235411236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 0x7f9ad00ff4b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.237+0000 7f9ad6d48700 1 --2- 172.21.15.98:0/235411236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad0100750 0x7f9ad0100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.237+0000 7f9ad6d48700 1 -- 172.21.15.98:0/235411236 >> 172.21.15.98:0/235411236 conn(0x7f9ad00f9f10 msgr2=0x7f9ad00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.237+0000 7f9ad6d48700 1 -- 172.21.15.98:0/235411236 shutdown_connections 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.237+0000 7f9ad6d48700 1 -- 172.21.15.98:0/235411236 wait complete. 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.237+0000 7f9ad6d48700 1 Processor -- start 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9ad6d48700 1 -- start start 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9ad6d48700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad0100750 0x7f9ad00fef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9ad6d48700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 0x7f9ad019a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9ad6d48700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad019ae80 con 0x7f9ad01010a0 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9ad6d48700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad019afc0 con 0x7f9ad0100750 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9acffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 0x7f9ad019a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9acffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 0x7f9ad019a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56560/0 (socket says 172.21.15.98:56560) 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9acffff700 1 -- 172.21.15.98:0/579944683 learned_addr learned my addr 172.21.15.98:0/579944683 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9ad4ae4700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad0100750 0x7f9ad00fef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9acffff700 1 -- 172.21.15.98:0/579944683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad0100750 msgr2=0x7f9ad00fef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9acffff700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad0100750 0x7f9ad00fef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9acffff700 1 -- 172.21.15.98:0/579944683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0095f0 con 0x7f9ad01010a0 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.238+0000 7f9acffff700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 0x7f9ad019a860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9abc006010 tx=0x7f9abc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.239+0000 7f9acdffb700 1 -- 172.21.15.98:0/579944683 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9abc01d070 con 0x7f9ad01010a0 2024-09-13T02:53:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.239+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad019b240 con 0x7f9ad01010a0 2024-09-13T02:53:55.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.239+0000 7f9acdffb700 1 -- 172.21.15.98:0/579944683 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9abc00f460 con 0x7f9ad01010a0 2024-09-13T02:53:55.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.239+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad019b730 con 0x7f9ad01010a0 2024-09-13T02:53:55.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.239+0000 7f9acdffb700 1 -- 172.21.15.98:0/579944683 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9abc02b610 con 0x7f9ad01010a0 2024-09-13T02:53:55.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.240+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad0107ca0 con 0x7f9ad01010a0 2024-09-13T02:53:55.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.241+0000 7f9acdffb700 1 -- 172.21.15.98:0/579944683 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f9abc00fab0 con 0x7f9ad01010a0 2024-09-13T02:53:55.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.242+0000 7f9acdffb700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9ac006e440 0x7f9ac00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:55.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.242+0000 7f9acdffb700 1 -- 172.21.15.98:0/579944683 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9abc08fbb0 con 0x7f9ad01010a0 2024-09-13T02:53:55.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.242+0000 7f9ad4ae4700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9ac006e440 0x7f9ac00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.243+0000 7f9ad4ae4700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9ac006e440 0x7f9ac00708f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006fd0 tx=0x7f9ac4008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:55.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.246+0000 7f9acdffb700 1 -- 172.21.15.98:0/579944683 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f9abc05cd30 con 0x7f9ad01010a0 2024-09-13T02:53:55.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.596+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ad019be80 con 0x7f9ac006e440 2024-09-13T02:53:55.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.598+0000 7f9acdffb700 1 -- 172.21.15.98:0/579944683 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f9ad019be80 con 0x7f9ac006e440 2024-09-13T02:53:55.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9ac006e440 msgr2=0x7f9ac00708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:55.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9ac006e440 0x7f9ac00708f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006fd0 tx=0x7f9ac4008040 comp rx=0 tx=0).stop 2024-09-13T02:53:55.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 msgr2=0x7f9ad019a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:55.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 0x7f9ad019a860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9abc006010 tx=0x7f9abc00be20 comp rx=0 tx=0).stop 2024-09-13T02:53:55.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 shutdown_connections 2024-09-13T02:53:55.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9ac006e440 0x7f9ac00708f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:55.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ad0100750 0x7f9ad00fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:55.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 --2- 172.21.15.98:0/579944683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ad01010a0 0x7f9ad019a860 secure :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9abc006010 tx=0x7f9abc00be20 comp rx=0 tx=0).stop 2024-09-13T02:53:55.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 >> 172.21.15.98:0/579944683 conn(0x7f9ad00f9f10 msgr2=0x7f9ad0103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:55.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 shutdown_connections 2024-09-13T02:53:55.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.602+0000 7f9ad6d48700 1 -- 172.21.15.98:0/579944683 wait complete. 2024-09-13T02:53:55.619 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:53:55.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.756+0000 7f24a3515700 1 -- 172.21.15.98:0/3943135880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c100240 msgr2=0x7f249c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:55.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.756+0000 7f24a3515700 1 --2- 172.21.15.98:0/3943135880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c100240 0x7f249c100650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2498009910 tx=0x7f2498009c20 comp rx=0 tx=0).stop 2024-09-13T02:53:55.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.756+0000 7f24a3515700 1 -- 172.21.15.98:0/3943135880 shutdown_connections 2024-09-13T02:53:55.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.756+0000 7f24a3515700 1 --2- 172.21.15.98:0/3943135880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f249c101440 0x7f249c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:55.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.756+0000 7f24a3515700 1 --2- 172.21.15.98:0/3943135880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c100240 0x7f249c100650 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:55.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.756+0000 7f24a3515700 1 -- 172.21.15.98:0/3943135880 >> 172.21.15.98:0/3943135880 conn(0x7f249c0fb7f0 msgr2=0x7f249c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:55.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a3515700 1 -- 172.21.15.98:0/3943135880 shutdown_connections 2024-09-13T02:53:55.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a3515700 1 -- 172.21.15.98:0/3943135880 wait complete. 2024-09-13T02:53:55.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a3515700 1 Processor -- start 2024-09-13T02:53:55.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a3515700 1 -- start start 2024-09-13T02:53:55.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a3515700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f249c100240 0x7f249c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:55.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a3515700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c101440 0x7f249c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:55.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a3515700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c073680 con 0x7f249c101440 2024-09-13T02:53:55.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a3515700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0737c0 con 0x7f249c100240 2024-09-13T02:53:55.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a0ab0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c101440 0x7f249c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:55.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a0ab0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c101440 0x7f249c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56582/0 (socket says 172.21.15.98:56582) 2024-09-13T02:53:55.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.757+0000 7f24a0ab0700 1 -- 172.21.15.98:0/94005220 learned_addr learned my addr 172.21.15.98:0/94005220 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:55.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24a12b1700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f249c100240 0x7f249c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:55.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24a0ab0700 1 -- 172.21.15.98:0/94005220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f249c100240 msgr2=0x7f249c074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:55.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24a0ab0700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f249c100240 0x7f249c074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:55.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24a0ab0700 1 -- 172.21.15.98:0/94005220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24980095f0 con 0x7f249c101440 2024-09-13T02:53:55.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24a0ab0700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c101440 0x7f249c073140 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f248c00e920 tx=0x7f248c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:55.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24927fc700 1 -- 172.21.15.98:0/94005220 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248c009790 con 0x7f249c101440 2024-09-13T02:53:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24927fc700 1 -- 172.21.15.98:0/94005220 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f248c00cba0 con 0x7f249c101440 2024-09-13T02:53:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c073aa0 con 0x7f249c101440 2024-09-13T02:53:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c19db10 con 0x7f249c101440 2024-09-13T02:53:55.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.758+0000 7f24927fc700 1 -- 172.21.15.98:0/94005220 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248c018630 con 0x7f249c101440 2024-09-13T02:53:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.759+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c108d90 con 0x7f249c101440 2024-09-13T02:53:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.760+0000 7f24927fc700 1 -- 172.21.15.98:0/94005220 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f248c00cd10 con 0x7f249c101440 2024-09-13T02:53:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.761+0000 7f24927fc700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f248806e440 0x7f24880708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.761+0000 7f24927fc700 1 -- 172.21.15.98:0/94005220 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f248c014070 con 0x7f249c101440 2024-09-13T02:53:55.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.761+0000 7f24a12b1700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f248806e440 0x7f24880708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:55.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.761+0000 7f24a12b1700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f248806e440 0x7f24880708f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2498009fd0 tx=0x7f2498005940 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:55.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:55.767+0000 7f24927fc700 1 -- 172.21.15.98:0/94005220 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f248c0539d0 con 0x7f249c101440 2024-09-13T02:53:56.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.092+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f249c105d90 con 0x7f248806e440 2024-09-13T02:53:56.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.093+0000 7f24927fc700 1 -- 172.21.15.98:0/94005220 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f249c105d90 con 0x7f248806e440 2024-09-13T02:53:56.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f248806e440 msgr2=0x7f24880708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:56.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f248806e440 0x7f24880708f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2498009fd0 tx=0x7f2498005940 comp rx=0 tx=0).stop 2024-09-13T02:53:56.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c101440 msgr2=0x7f249c073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:56.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c101440 0x7f249c073140 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f248c00e920 tx=0x7f248c00ece0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 shutdown_connections 2024-09-13T02:53:56.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f248806e440 0x7f24880708f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f249c100240 0x7f249c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 --2- 172.21.15.98:0/94005220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c101440 0x7f249c073140 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 >> 172.21.15.98:0/94005220 conn(0x7f249c0fb7f0 msgr2=0x7f249c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:56.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 shutdown_connections 2024-09-13T02:53:56.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.096+0000 7f24a3515700 1 -- 172.21.15.98:0/94005220 wait complete. 2024-09-13T02:53:56.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.235+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/1021091374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54105730 msgr2=0x7f7e54107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:56.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.235+0000 7f7e5ac0c700 1 --2- 172.21.15.98:0/1021091374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54105730 0x7f7e54107b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009910 tx=0x7f7e40009c20 comp rx=0 tx=0).stop 2024-09-13T02:53:56.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.235+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/1021091374 shutdown_connections 2024-09-13T02:53:56.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.235+0000 7f7e5ac0c700 1 --2- 172.21.15.98:0/1021091374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54105730 0x7f7e54107b10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.235+0000 7f7e5ac0c700 1 --2- 172.21.15.98:0/1021091374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e54069250 0x7f7e541051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.235+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/1021091374 >> 172.21.15.98:0/1021091374 conn(0x7f7e540fa780 msgr2=0x7f7e540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:56.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.236+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/1021091374 shutdown_connections 2024-09-13T02:53:56.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.236+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/1021091374 wait complete. 2024-09-13T02:53:56.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.236+0000 7f7e5ac0c700 1 Processor -- start 2024-09-13T02:53:56.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.236+0000 7f7e5ac0c700 1 -- start start 2024-09-13T02:53:56.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.236+0000 7f7e5ac0c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54069250 0x7f7e54197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.236+0000 7f7e5ac0c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e54105730 0x7f7e54198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.236+0000 7f7e5ac0c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54198890 con 0x7f7e54069250 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.236+0000 7f7e5ac0c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5419d2a0 con 0x7f7e54105730 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.236+0000 7f7e589a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54069250 0x7f7e54197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e589a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54069250 0x7f7e54197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56612/0 (socket says 172.21.15.98:56612) 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e589a8700 1 -- 172.21.15.98:0/223516700 learned_addr learned my addr 172.21.15.98:0/223516700 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e53fff700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e54105730 0x7f7e54198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e589a8700 1 -- 172.21.15.98:0/223516700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e54105730 msgr2=0x7f7e54198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e589a8700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e54105730 0x7f7e54198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e589a8700 1 -- 172.21.15.98:0/223516700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e400095f0 con 0x7f7e54069250 2024-09-13T02:53:56.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e589a8700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54069250 0x7f7e54197d30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800d8d0 tx=0x7f7e4800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:56.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e51ffb700 1 -- 172.21.15.98:0/223516700 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4800f860 con 0x7f7e54069250 2024-09-13T02:53:56.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e51ffb700 1 -- 172.21.15.98:0/223516700 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e4800fe70 con 0x7f7e54069250 2024-09-13T02:53:56.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.237+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5419d4a0 con 0x7f7e54069250 2024-09-13T02:53:56.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.238+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5419d9c0 con 0x7f7e54069250 2024-09-13T02:53:56.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.238+0000 7f7e51ffb700 1 -- 172.21.15.98:0/223516700 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4800f860 con 0x7f7e54069250 2024-09-13T02:53:56.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.239+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e54191e10 con 0x7f7e54069250 2024-09-13T02:53:56.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.239+0000 7f7e51ffb700 1 -- 172.21.15.98:0/223516700 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f7e4800f9c0 con 0x7f7e54069250 2024-09-13T02:53:56.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.240+0000 7f7e51ffb700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f7e4406e490 0x7f7e44070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:56.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.240+0000 7f7e51ffb700 1 -- 172.21.15.98:0/223516700 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7e4808dee0 con 0x7f7e54069250 2024-09-13T02:53:56.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.240+0000 7f7e53fff700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f7e4406e490 0x7f7e44070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:56.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.242+0000 7f7e53fff700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f7e4406e490 0x7f7e44070940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006010 tx=0x7f7e4000b540 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:56.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.245+0000 7f7e51ffb700 1 -- 172.21.15.98:0/223516700 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f7e480573e0 con 0x7f7e54069250 2024-09-13T02:53:56.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.586+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e54061190 con 0x7f7e4406e490 2024-09-13T02:53:56.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.601+0000 7f7e51ffb700 1 -- 172.21.15.98:0/223516700 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f7e54061190 con 0x7f7e4406e490 2024-09-13T02:53:56.603 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:53:56.603 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (8m) 24s ago 9m 24.6M - 0.25.0 c8568f914cd2 babcc5d689b7 2024-09-13T02:53:56.603 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (9m) 24s ago 9m 7780k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:53:56.603 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (8m) 26s ago 8m 7407k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:53:56.603 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (9m) 24s ago 9m 6660k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:53:56.603 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (8m) 26s ago 8m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:53:56.603 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (7m) 24s ago 9m 87.2M - 9.4.7 954c08fa6188 6b3b619a7e20 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (3m) 24s ago 3m 278M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (4m) 24s ago 4m 256M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (3m) 26s ago 3m 13.7M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (4m) 26s ago 4m 16.8M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (58s) 24s ago 10m 475M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (2m) 26s ago 8m 126M - 19.1.1-322-g7741f7f9 19dc8d659727 0ffcd7ff6f2c 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (10m) 24s ago 10m 56.2M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (8m) 26s ago 8m 41.9M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (9m) 24s ago 9m 16.0M - 1.5.0 0da6a335fe13 5c48ece10527 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (8m) 26s ago 8m 15.0M - 1.5.0 0da6a335fe13 b2fc832c8f17 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (7m) 24s ago 7m 189M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (7m) 24s ago 7m 199M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:53:56.604 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (6m) 24s ago 6m 157M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:53:56.605 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (6m) 26s ago 6m 219M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:53:56.605 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (5m) 26s ago 5m 187M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:53:56.605 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (5m) 26s ago 5m 184M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:53:56.605 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (88s) 24s ago 8m 63.0M - 2.43.0 a07b618ecd1d 4d4863e3378a 2024-09-13T02:53:56.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f7e4406e490 msgr2=0x7f7e44070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:56.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f7e4406e490 0x7f7e44070940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006010 tx=0x7f7e4000b540 comp rx=0 tx=0).stop 2024-09-13T02:53:56.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54069250 msgr2=0x7f7e54197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:56.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54069250 0x7f7e54197d30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800d8d0 tx=0x7f7e4800dbe0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 shutdown_connections 2024-09-13T02:53:56.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f7e4406e490 0x7f7e44070940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e54069250 0x7f7e54197d30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 --2- 172.21.15.98:0/223516700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e54105730 0x7f7e54198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 >> 172.21.15.98:0/223516700 conn(0x7f7e540fa780 msgr2=0x7f7e540fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:56.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 shutdown_connections 2024-09-13T02:53:56.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.604+0000 7f7e5ac0c700 1 -- 172.21.15.98:0/223516700 wait complete. 2024-09-13T02:53:56.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.740+0000 7f544483c700 1 -- 172.21.15.98:0/1376158087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54401003d0 msgr2=0x7f5440100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:56.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.740+0000 7f544483c700 1 --2- 172.21.15.98:0/1376158087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54401003d0 0x7f5440100840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5434009870 tx=0x7f5434009b80 comp rx=0 tx=0).stop 2024-09-13T02:53:56.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.741+0000 7f544483c700 1 -- 172.21.15.98:0/1376158087 shutdown_connections 2024-09-13T02:53:56.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.741+0000 7f544483c700 1 --2- 172.21.15.98:0/1376158087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54401003d0 0x7f5440100840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.741+0000 7f544483c700 1 --2- 172.21.15.98:0/1376158087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54400ff130 0x7f54400ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.741+0000 7f544483c700 1 -- 172.21.15.98:0/1376158087 >> 172.21.15.98:0/1376158087 conn(0x7f54400fa780 msgr2=0x7f54400fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:56.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.741+0000 7f544483c700 1 -- 172.21.15.98:0/1376158087 shutdown_connections 2024-09-13T02:53:56.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.741+0000 7f544483c700 1 -- 172.21.15.98:0/1376158087 wait complete. 2024-09-13T02:53:56.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f544483c700 1 Processor -- start 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f544483c700 1 -- start start 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f544483c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54400ff130 0x7f5440193810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f544483c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54401003d0 0x7f5440193d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f544483c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440194370 con 0x7f54400ff130 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f544483c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54401944b0 con 0x7f54401003d0 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f543e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54400ff130 0x7f5440193810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f543e59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54400ff130 0x7f5440193810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56636/0 (socket says 172.21.15.98:56636) 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f543e59c700 1 -- 172.21.15.98:0/2593569524 learned_addr learned my addr 172.21.15.98:0/2593569524 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.742+0000 7f543dd9b700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54401003d0 0x7f5440193d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.743+0000 7f543e59c700 1 -- 172.21.15.98:0/2593569524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54401003d0 msgr2=0x7f5440193d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.743+0000 7f543e59c700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54401003d0 0x7f5440193d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:56.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.743+0000 7f543e59c700 1 -- 172.21.15.98:0/2593569524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5434009520 con 0x7f54400ff130 2024-09-13T02:53:56.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.743+0000 7f543e59c700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54400ff130 0x7f5440193810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f543000e940 tx=0x7f543000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:56.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.743+0000 7f542f7fe700 1 -- 172.21.15.98:0/2593569524 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5430004a00 con 0x7f54400ff130 2024-09-13T02:53:56.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.743+0000 7f542f7fe700 1 -- 172.21.15.98:0/2593569524 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f543000cc70 con 0x7f54400ff130 2024-09-13T02:53:56.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.743+0000 7f542f7fe700 1 -- 172.21.15.98:0/2593569524 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54300055b0 con 0x7f54400ff130 2024-09-13T02:53:56.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.743+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5440198f60 con 0x7f54400ff130 2024-09-13T02:53:56.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.744+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5440199420 con 0x7f54400ff130 2024-09-13T02:53:56.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.745+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5440106ae0 con 0x7f54400ff130 2024-09-13T02:53:56.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.745+0000 7f542f7fe700 1 -- 172.21.15.98:0/2593569524 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f543000c7c0 con 0x7f54400ff130 2024-09-13T02:53:56.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.746+0000 7f542f7fe700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5428072840 0x7f5428074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:56.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.746+0000 7f542f7fe700 1 -- 172.21.15.98:0/2593569524 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5430014070 con 0x7f54400ff130 2024-09-13T02:53:56.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.747+0000 7f543dd9b700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5428072840 0x7f5428074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:56.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.747+0000 7f543dd9b700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5428072840 0x7f5428074cf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f543400b6f0 tx=0x7f5434019040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:56.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:56.753+0000 7f542f7fe700 1 -- 172.21.15.98:0/2593569524 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f543005b560 con 0x7f54400ff130 2024-09-13T02:53:56.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:56 smithi098 ceph-mon[27886]: pgmap v18: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 91 op/s 2024-09-13T02:53:56.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:56 smithi098 ceph-mon[27886]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:56.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:56 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:57.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:56 smithi142 ceph-mon[33443]: pgmap v18: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 91 op/s 2024-09-13T02:53:57.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:56 smithi142 ceph-mon[33443]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:57.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:56 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:57.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.202+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5440199ae0 con 0x7f54400ff130 2024-09-13T02:53:57.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.202+0000 7f542f7fe700 1 -- 172.21.15.98:0/2593569524 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f543005b0f0 con 0x7f54400ff130 2024-09-13T02:53:57.204 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:53:57.204 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:53:57.204 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:53:57.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:53:57.205 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:53:57.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.204+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5428072840 msgr2=0x7f5428074cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:57.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.204+0000 7f544483c700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5428072840 0x7f5428074cf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f543400b6f0 tx=0x7f5434019040 comp rx=0 tx=0).stop 2024-09-13T02:53:57.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.205+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54400ff130 msgr2=0x7f5440193810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:57.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.205+0000 7f544483c700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54400ff130 0x7f5440193810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f543000e940 tx=0x7f543000ec50 comp rx=0 tx=0).stop 2024-09-13T02:53:57.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.205+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 shutdown_connections 2024-09-13T02:53:57.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.205+0000 7f544483c700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5428072840 0x7f5428074cf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:57.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.205+0000 7f544483c700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54400ff130 0x7f5440193810 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:57.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.205+0000 7f544483c700 1 --2- 172.21.15.98:0/2593569524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54401003d0 0x7f5440193d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:57.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.205+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 >> 172.21.15.98:0/2593569524 conn(0x7f54400fa780 msgr2=0x7f5440103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:57.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.205+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 shutdown_connections 2024-09-13T02:53:57.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.205+0000 7f544483c700 1 -- 172.21.15.98:0/2593569524 wait complete. 2024-09-13T02:53:57.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.349+0000 7fa2da7e3700 1 -- 172.21.15.98:0/1384504791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 msgr2=0x7fa2d4105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:57.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.349+0000 7fa2da7e3700 1 --2- 172.21.15.98:0/1384504791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 0x7fa2d4105a60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009910 tx=0x7fa2bc009c20 comp rx=0 tx=0).stop 2024-09-13T02:53:57.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.349+0000 7fa2da7e3700 1 -- 172.21.15.98:0/1384504791 shutdown_connections 2024-09-13T02:53:57.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.349+0000 7fa2da7e3700 1 --2- 172.21.15.98:0/1384504791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 0x7fa2d4105a60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:57.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.349+0000 7fa2da7e3700 1 --2- 172.21.15.98:0/1384504791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4100d60 0x7fa2d4103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:57.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.349+0000 7fa2da7e3700 1 -- 172.21.15.98:0/1384504791 >> 172.21.15.98:0/1384504791 conn(0x7fa2d40fa780 msgr2=0x7fa2d40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:57.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.350+0000 7fa2da7e3700 1 -- 172.21.15.98:0/1384504791 shutdown_connections 2024-09-13T02:53:57.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.350+0000 7fa2da7e3700 1 -- 172.21.15.98:0/1384504791 wait complete. 2024-09-13T02:53:57.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.350+0000 7fa2da7e3700 1 Processor -- start 2024-09-13T02:53:57.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.350+0000 7fa2da7e3700 1 -- start start 2024-09-13T02:53:57.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.350+0000 7fa2da7e3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4100d60 0x7fa2d41006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.350+0000 7fa2da7e3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 0x7fa2d40fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.350+0000 7fa2da7e3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40ff250 con 0x7fa2d4103680 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.350+0000 7fa2da7e3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40ff390 con 0x7fa2d4100d60 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2cbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 0x7fa2d40fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2cbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 0x7fa2d40fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56658/0 (socket says 172.21.15.98:56658) 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2d3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4100d60 0x7fa2d41006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2cbfff700 1 -- 172.21.15.98:0/2422509559 learned_addr learned my addr 172.21.15.98:0/2422509559 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2cbfff700 1 -- 172.21.15.98:0/2422509559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4100d60 msgr2=0x7fa2d41006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2cbfff700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4100d60 0x7fa2d41006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2cbfff700 1 -- 172.21.15.98:0/2422509559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc0095f0 con 0x7fa2d4103680 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2d3fff700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4100d60 0x7fa2d41006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2cbfff700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 0x7fa2d40fed10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc000c00 tx=0x7fa2bc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:57.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2d1ffb700 1 -- 172.21.15.98:0/2422509559 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2bc01d070 con 0x7fa2d4103680 2024-09-13T02:53:57.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2d1ffb700 1 -- 172.21.15.98:0/2422509559 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2bc005dc0 con 0x7fa2d4103680 2024-09-13T02:53:57.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d40ff610 con 0x7fa2d4103680 2024-09-13T02:53:57.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.351+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d40ffb00 con 0x7fa2d4103680 2024-09-13T02:53:57.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.352+0000 7fa2d1ffb700 1 -- 172.21.15.98:0/2422509559 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2bc0226a0 con 0x7fa2d4103680 2024-09-13T02:53:57.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.353+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d418fbe0 con 0x7fa2d4103680 2024-09-13T02:53:57.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.354+0000 7fa2d1ffb700 1 -- 172.21.15.98:0/2422509559 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fa2bc00faf0 con 0x7fa2d4103680 2024-09-13T02:53:57.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.354+0000 7fa2d1ffb700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fa2c006e440 0x7fa2c00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:57.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.354+0000 7fa2d1ffb700 1 -- 172.21.15.98:0/2422509559 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa2bc08f6d0 con 0x7fa2d4103680 2024-09-13T02:53:57.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.354+0000 7fa2d3fff700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fa2c006e440 0x7fa2c00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:57.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.355+0000 7fa2d3fff700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fa2c006e440 0x7fa2c00708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4069000 tx=0x7fa2c4009260 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:57.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.360+0000 7fa2d1ffb700 1 -- 172.21.15.98:0/2422509559 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fa2bc05c780 con 0x7fa2d4103680 2024-09-13T02:53:57.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.681+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2d4061190 con 0x7fa2c006e440 2024-09-13T02:53:57.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.683+0000 7fa2d1ffb700 1 -- 172.21.15.98:0/2422509559 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fa2d4061190 con 0x7fa2c006e440 2024-09-13T02:53:57.684 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:53:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:53:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:53:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T02:53:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:53:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr" 2024-09-13T02:53:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:53:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T02:53:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "", 2024-09-13T02:53:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:53:57.685 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:53:57.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fa2c006e440 msgr2=0x7fa2c00708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fa2c006e440 0x7fa2c00708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4069000 tx=0x7fa2c4009260 comp rx=0 tx=0).stop 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 msgr2=0x7fa2d40fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 0x7fa2d40fed10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc000c00 tx=0x7fa2bc00f690 comp rx=0 tx=0).stop 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 shutdown_connections 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fa2c006e440 0x7fa2c00708f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4100d60 0x7fa2d41006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 --2- 172.21.15.98:0/2422509559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2d4103680 0x7fa2d40fed10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 >> 172.21.15.98:0/2422509559 conn(0x7fa2d40fa780 msgr2=0x7fa2d40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 shutdown_connections 2024-09-13T02:53:57.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:53:57.685+0000 7fa2da7e3700 1 -- 172.21.15.98:0/2422509559 wait complete. 2024-09-13T02:53:57.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:57 smithi098 ceph-mon[27886]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:57.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:57 smithi098 ceph-mon[27886]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:57 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/2593569524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:58.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:57 smithi142 ceph-mon[33443]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:58.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:57 smithi142 ceph-mon[33443]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:58.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:57 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/2593569524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:58.929 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:58 smithi142 ceph-mon[33443]: pgmap v19: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 135 op/s 2024-09-13T02:53:58.929 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:53:58 smithi142 ceph-mon[33443]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:58.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:58 smithi098 ceph-mon[27886]: pgmap v19: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 135 op/s 2024-09-13T02:53:58.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:53:58 smithi098 ceph-mon[27886]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:00.964 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:00 smithi098 ceph-mon[27886]: pgmap v20: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 90 op/s 2024-09-13T02:54:01.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:00 smithi142 ceph-mon[33443]: pgmap v20: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 90 op/s 2024-09-13T02:54:02.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:02 smithi098 ceph-mon[27886]: pgmap v21: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 100 op/s 2024-09-13T02:54:03.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:02 smithi142 ceph-mon[33443]: pgmap v21: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 100 op/s 2024-09-13T02:54:04.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:04 smithi098 ceph-mon[27886]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 131 op/s 2024-09-13T02:54:05.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:04 smithi142 ceph-mon[33443]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 131 op/s 2024-09-13T02:54:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:06 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:06 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:06 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:54:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:06 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:54:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:06 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:06 smithi142 ceph-mon[33443]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 100 op/s 2024-09-13T02:54:06.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:06 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:06.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:06 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:06.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:06 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:54:06.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:06 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:54:06.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:06 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:06.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:06 smithi098 ceph-mon[27886]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 100 op/s 2024-09-13T02:54:07.412 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:07 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:54:07.412 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:07 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:54:07.412 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:07 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:07.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:07 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:54:07.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:07 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:54:07.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:07 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:08.482 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:08 smithi142 ceph-mon[33443]: Upgrade: Updating mgr.smithi142.jutrvi 2024-09-13T02:54:08.482 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:08 smithi142 ceph-mon[33443]: Deploying daemon mgr.smithi142.jutrvi on smithi142 2024-09-13T02:54:08.482 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:08 smithi142 ceph-mon[33443]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 149 op/s 2024-09-13T02:54:08.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:08 smithi098 ceph-mon[27886]: Upgrade: Updating mgr.smithi142.jutrvi 2024-09-13T02:54:08.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:08 smithi098 ceph-mon[27886]: Deploying daemon mgr.smithi142.jutrvi on smithi142 2024-09-13T02:54:08.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:08 smithi098 ceph-mon[27886]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 149 op/s 2024-09-13T02:54:10.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:10 smithi142 ceph-mon[33443]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-13T02:54:10.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:10 smithi098 ceph-mon[27886]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-13T02:54:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:11.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:12.928 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:12 smithi098 ceph-mon[27886]: pgmap v26: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 116 op/s 2024-09-13T02:54:13.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:12 smithi142 ceph-mon[33443]: pgmap v26: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 116 op/s 2024-09-13T02:54:14.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:14 smithi142 ceph-mon[33443]: pgmap v27: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 166 op/s 2024-09-13T02:54:14.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:14 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:14.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:14 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:14.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:14 smithi098 ceph-mon[27886]: pgmap v27: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 166 op/s 2024-09-13T02:54:14.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:14 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:14.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:14 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:15 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:15 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:15 smithi098 ceph-mon[27886]: pgmap v28: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 120 op/s 2024-09-13T02:54:16.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:15 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:16.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:15 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:16.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:15 smithi142 ceph-mon[33443]: pgmap v28: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 120 op/s 2024-09-13T02:54:16.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:16 smithi098 ceph-mon[27886]: Standby manager daemon smithi142.jutrvi restarted 2024-09-13T02:54:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:16 smithi098 ceph-mon[27886]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:54:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:16 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/3580683356' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:54:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:16 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/3580683356' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:54:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:16 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/3580683356' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:54:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:16 smithi098 ceph-mon[27886]: from='mgr.? 172.21.15.142:0/3580683356' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:54:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:16 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:16 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:16 smithi142 ceph-mon[33443]: Standby manager daemon smithi142.jutrvi restarted 2024-09-13T02:54:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:16 smithi142 ceph-mon[33443]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:54:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:16 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/3580683356' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:54:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:16 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/3580683356' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:54:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:16 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/3580683356' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:54:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:16 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/3580683356' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:54:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:16 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:16 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:17.916 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:17 smithi142 ceph-mon[33443]: mgrmap e32: smithi098.ukgenf(active, since 51s), standbys: smithi142.jutrvi 2024-09-13T02:54:17.916 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:17 smithi142 ceph-mon[33443]: pgmap v29: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 376 op/s 2024-09-13T02:54:18.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:17 smithi098 ceph-mon[27886]: mgrmap e32: smithi098.ukgenf(active, since 51s), standbys: smithi142.jutrvi 2024-09-13T02:54:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:17 smithi098 ceph-mon[27886]: pgmap v29: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 376 op/s 2024-09-13T02:54:19.712 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.712 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.712 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: Upgrade: Setting container_image for all mgr 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.ukgenf"}]: dispatch 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.ukgenf"}]': finished 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.jutrvi"}]: dispatch 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.jutrvi"}]': finished 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.713 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: Upgrade: Setting container_image for all rgw 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: Upgrade: Setting container_image for all iscsi 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: Upgrade: Setting container_image for all nfs 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.714 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.715 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: Upgrade: Setting container_image for all nvmeof 2024-09-13T02:54:19.715 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:19 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: Upgrade: Setting container_image for all mgr 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.ukgenf"}]: dispatch 2024-09-13T02:54:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi098.ukgenf"}]': finished 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.jutrvi"}]: dispatch 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.jutrvi"}]': finished 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: Upgrade: Setting container_image for all rgw 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: Upgrade: Setting container_image for all iscsi 2024-09-13T02:54:19.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: Upgrade: Setting container_image for all nfs 2024-09-13T02:54:19.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:19.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:19.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: Upgrade: Setting container_image for all nvmeof 2024-09-13T02:54:19.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:19 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:20.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:20 smithi098 ceph-mon[27886]: pgmap v30: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 327 op/s 2024-09-13T02:54:20.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:20 smithi142 ceph-mon[33443]: pgmap v30: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 327 op/s 2024-09-13T02:54:21.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:21 smithi098 ceph-mon[27886]: Upgrade: Updating node-exporter.smithi098 (1/2) 2024-09-13T02:54:21.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:21 smithi098 ceph-mon[27886]: Deploying daemon node-exporter.smithi098 on smithi098 2024-09-13T02:54:21.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:21 smithi142 ceph-mon[33443]: Upgrade: Updating node-exporter.smithi098 (1/2) 2024-09-13T02:54:21.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:21 smithi142 ceph-mon[33443]: Deploying daemon node-exporter.smithi098 on smithi098 2024-09-13T02:54:22.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:22 smithi098 ceph-mon[27886]: pgmap v31: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 327 op/s 2024-09-13T02:54:22.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:22 smithi142 ceph-mon[33443]: pgmap v31: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 327 op/s 2024-09-13T02:54:24.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:24 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:24.920 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:24 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:24.921 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:24 smithi142 ceph-mon[33443]: pgmap v32: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 451 op/s 2024-09-13T02:54:24.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:24 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:24 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:24 smithi098 ceph-mon[27886]: pgmap v32: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 451 op/s 2024-09-13T02:54:26.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:26 smithi098 ceph-mon[27886]: Upgrade: Updating node-exporter.smithi142 (2/2) 2024-09-13T02:54:26.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:26 smithi098 ceph-mon[27886]: Deploying daemon node-exporter.smithi142 on smithi142 2024-09-13T02:54:26.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:26 smithi098 ceph-mon[27886]: pgmap v33: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 391 op/s 2024-09-13T02:54:26.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:26 smithi142 ceph-mon[33443]: Upgrade: Updating node-exporter.smithi142 (2/2) 2024-09-13T02:54:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:26 smithi142 ceph-mon[33443]: Deploying daemon node-exporter.smithi142 on smithi142 2024-09-13T02:54:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:26 smithi142 ceph-mon[33443]: pgmap v33: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 391 op/s 2024-09-13T02:54:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:27.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.854+0000 7fc2e63ba700 1 -- 172.21.15.98:0/1194638139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2e0100710 msgr2=0x7fc2e0100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:27.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.854+0000 7fc2e63ba700 1 --2- 172.21.15.98:0/1194638139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2e0100710 0x7fc2e0100b20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009910 tx=0x7fc2d0009c20 comp rx=0 tx=0).stop 2024-09-13T02:54:27.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.854+0000 7fc2e63ba700 1 -- 172.21.15.98:0/1194638139 shutdown_connections 2024-09-13T02:54:27.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.854+0000 7fc2e63ba700 1 --2- 172.21.15.98:0/1194638139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e0101060 0x7fc2e00ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:27.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.854+0000 7fc2e63ba700 1 --2- 172.21.15.98:0/1194638139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2e0100710 0x7fc2e0100b20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:27.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.854+0000 7fc2e63ba700 1 -- 172.21.15.98:0/1194638139 >> 172.21.15.98:0/1194638139 conn(0x7fc2e00f9f10 msgr2=0x7fc2e00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:27.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.854+0000 7fc2e63ba700 1 -- 172.21.15.98:0/1194638139 shutdown_connections 2024-09-13T02:54:27.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.854+0000 7fc2e63ba700 1 -- 172.21.15.98:0/1194638139 wait complete. 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.855+0000 7fc2e63ba700 1 Processor -- start 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.855+0000 7fc2e63ba700 1 -- start start 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2e63ba700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e0100710 0x7fc2e0195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2e63ba700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2e0101060 0x7fc2e0196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2e63ba700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0196660 con 0x7fc2e0101060 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2e63ba700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01967a0 con 0x7fc2e0100710 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2df7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2e0101060 0x7fc2e0196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2df7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2e0101060 0x7fc2e0196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34466/0 (socket says 172.21.15.98:34466) 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2dffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e0100710 0x7fc2e0195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2df7fe700 1 -- 172.21.15.98:0/3198629173 learned_addr learned my addr 172.21.15.98:0/3198629173 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:54:27.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2dffff700 1 -- 172.21.15.98:0/3198629173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2e0101060 msgr2=0x7fc2e0196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:27.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.856+0000 7fc2dffff700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2e0101060 0x7fc2e0196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:27.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.857+0000 7fc2dffff700 1 -- 172.21.15.98:0/3198629173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00095f0 con 0x7fc2e0100710 2024-09-13T02:54:27.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.857+0000 7fc2dffff700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e0100710 0x7fc2e0195b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009910 tx=0x7fc2d000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:27.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.857+0000 7fc2dd7fa700 1 -- 172.21.15.98:0/3198629173 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d001d070 con 0x7fc2e0100710 2024-09-13T02:54:27.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.857+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e019b1f0 con 0x7fc2e0100710 2024-09-13T02:54:27.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.857+0000 7fc2dd7fa700 1 -- 172.21.15.98:0/3198629173 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc2d000f460 con 0x7fc2e0100710 2024-09-13T02:54:27.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.857+0000 7fc2dd7fa700 1 -- 172.21.15.98:0/3198629173 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d0021620 con 0x7fc2e0100710 2024-09-13T02:54:27.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.857+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e019b6e0 con 0x7fc2e0100710 2024-09-13T02:54:27.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.858+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e0108d00 con 0x7fc2e0100710 2024-09-13T02:54:27.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.859+0000 7fc2dd7fa700 1 -- 172.21.15.98:0/3198629173 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 32) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fc2d0003a60 con 0x7fc2e0100710 2024-09-13T02:54:27.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.859+0000 7fc2dd7fa700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc2c806e440 0x7fc2c80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:27.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.859+0000 7fc2dd7fa700 1 -- 172.21.15.98:0/3198629173 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc2d008f490 con 0x7fc2e0100710 2024-09-13T02:54:27.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.859+0000 7fc2df7fe700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc2c806e440 0x7fc2c80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:27.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.860+0000 7fc2df7fe700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc2c806e440 0x7fc2c80708f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4007c90 tx=0x7fc2d4007480 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:27.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:27.864+0000 7fc2dd7fa700 1 -- 172.21.15.98:0/3198629173 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fc2d005c460 con 0x7fc2e0100710 2024-09-13T02:54:28.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.199+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2e019bd20 con 0x7fc2c806e440 2024-09-13T02:54:28.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.201+0000 7fc2dd7fa700 1 -- 172.21.15.98:0/3198629173 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fc2e019bd20 con 0x7fc2c806e440 2024-09-13T02:54:28.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.204+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc2c806e440 msgr2=0x7fc2c80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:28.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.204+0000 7fc2e63ba700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc2c806e440 0x7fc2c80708f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4007c90 tx=0x7fc2d4007480 comp rx=0 tx=0).stop 2024-09-13T02:54:28.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.205+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e0100710 msgr2=0x7fc2e0195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:28.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.205+0000 7fc2e63ba700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e0100710 0x7fc2e0195b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009910 tx=0x7fc2d000bd70 comp rx=0 tx=0).stop 2024-09-13T02:54:28.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.205+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 shutdown_connections 2024-09-13T02:54:28.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.205+0000 7fc2e63ba700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc2c806e440 0x7fc2c80708f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.205+0000 7fc2e63ba700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2e0100710 0x7fc2e0195b00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.205+0000 7fc2e63ba700 1 --2- 172.21.15.98:0/3198629173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2e0101060 0x7fc2e0196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.205+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 >> 172.21.15.98:0/3198629173 conn(0x7fc2e00f9f10 msgr2=0x7fc2e0103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:28.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.205+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 shutdown_connections 2024-09-13T02:54:28.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.205+0000 7fc2e63ba700 1 -- 172.21.15.98:0/3198629173 wait complete. 2024-09-13T02:54:28.220 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:54:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.336+0000 7fbc535d0700 1 -- 172.21.15.98:0/834603114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c0ff130 msgr2=0x7fbc4c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.336+0000 7fbc535d0700 1 --2- 172.21.15.98:0/834603114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c0ff130 0x7fbc4c0ff540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009910 tx=0x7fbc48009c20 comp rx=0 tx=0).stop 2024-09-13T02:54:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.336+0000 7fbc535d0700 1 -- 172.21.15.98:0/834603114 shutdown_connections 2024-09-13T02:54:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.336+0000 7fbc535d0700 1 --2- 172.21.15.98:0/834603114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4c1003d0 0x7fbc4c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.336+0000 7fbc535d0700 1 --2- 172.21.15.98:0/834603114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c0ff130 0x7fbc4c0ff540 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.336+0000 7fbc535d0700 1 -- 172.21.15.98:0/834603114 >> 172.21.15.98:0/834603114 conn(0x7fbc4c0fa780 msgr2=0x7fbc4c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.336+0000 7fbc535d0700 1 -- 172.21.15.98:0/834603114 shutdown_connections 2024-09-13T02:54:28.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.336+0000 7fbc535d0700 1 -- 172.21.15.98:0/834603114 wait complete. 2024-09-13T02:54:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.337+0000 7fbc535d0700 1 Processor -- start 2024-09-13T02:54:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.337+0000 7fbc535d0700 1 -- start start 2024-09-13T02:54:28.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.337+0000 7fbc535d0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4c0ff130 0x7fbc4c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.337+0000 7fbc535d0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c1003d0 0x7fbc4c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc535d0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c19ade0 con 0x7fbc4c1003d0 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc535d0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c19af20 con 0x7fbc4c0ff130 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc50b6b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c1003d0 0x7fbc4c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc5136c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4c0ff130 0x7fbc4c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc50b6b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c1003d0 0x7fbc4c19a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34486/0 (socket says 172.21.15.98:34486) 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc50b6b700 1 -- 172.21.15.98:0/650461689 learned_addr learned my addr 172.21.15.98:0/650461689 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc5136c700 1 -- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c1003d0 msgr2=0x7fbc4c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc5136c700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c1003d0 0x7fbc4c19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc5136c700 1 -- 172.21.15.98:0/650461689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc480095f0 con 0x7fbc4c0ff130 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc50b6b700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c1003d0 0x7fbc4c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:54:28.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.338+0000 7fbc5136c700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4c0ff130 0x7fbc4c0690a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbc48006010 tx=0x7fbc4800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:28.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.339+0000 7fbc427fc700 1 -- 172.21.15.98:0/650461689 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc4801d070 con 0x7fbc4c0ff130 2024-09-13T02:54:28.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.339+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4c19b1a0 con 0x7fbc4c0ff130 2024-09-13T02:54:28.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.339+0000 7fbc427fc700 1 -- 172.21.15.98:0/650461689 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbc48005dc0 con 0x7fbc4c0ff130 2024-09-13T02:54:28.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.339+0000 7fbc427fc700 1 -- 172.21.15.98:0/650461689 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc48017400 con 0x7fbc4c0ff130 2024-09-13T02:54:28.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.339+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c19b690 con 0x7fbc4c0ff130 2024-09-13T02:54:28.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.340+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c107c10 con 0x7fbc4c0ff130 2024-09-13T02:54:28.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.340+0000 7fbc427fc700 1 -- 172.21.15.98:0/650461689 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 32) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fbc48003810 con 0x7fbc4c0ff130 2024-09-13T02:54:28.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.341+0000 7fbc427fc700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbc3806e440 0x7fbc380708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:28.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.341+0000 7fbc427fc700 1 -- 172.21.15.98:0/650461689 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fbc4808f790 con 0x7fbc4c0ff130 2024-09-13T02:54:28.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.341+0000 7fbc50b6b700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbc3806e440 0x7fbc380708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:28.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.342+0000 7fbc50b6b700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbc3806e440 0x7fbc380708f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c069620 tx=0x7fbc3c009260 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:28.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.346+0000 7fbc427fc700 1 -- 172.21.15.98:0/650461689 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fbc4805c720 con 0x7fbc4c0ff130 2024-09-13T02:54:28.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.693+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc4c104d20 con 0x7fbc3806e440 2024-09-13T02:54:28.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.694+0000 7fbc427fc700 1 -- 172.21.15.98:0/650461689 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fbc4c104d20 con 0x7fbc3806e440 2024-09-13T02:54:28.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.696+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbc3806e440 msgr2=0x7fbc380708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:28.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.696+0000 7fbc535d0700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbc3806e440 0x7fbc380708f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c069620 tx=0x7fbc3c009260 comp rx=0 tx=0).stop 2024-09-13T02:54:28.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.696+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4c0ff130 msgr2=0x7fbc4c0690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:28.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.696+0000 7fbc535d0700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4c0ff130 0x7fbc4c0690a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbc48006010 tx=0x7fbc4800f690 comp rx=0 tx=0).stop 2024-09-13T02:54:28.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.696+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 shutdown_connections 2024-09-13T02:54:28.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.696+0000 7fbc535d0700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbc3806e440 0x7fbc380708f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.696+0000 7fbc535d0700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4c0ff130 0x7fbc4c0690a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.696+0000 7fbc535d0700 1 --2- 172.21.15.98:0/650461689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc4c1003d0 0x7fbc4c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.696+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 >> 172.21.15.98:0/650461689 conn(0x7fbc4c0fa780 msgr2=0x7fbc4c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:28.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.697+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 shutdown_connections 2024-09-13T02:54:28.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.697+0000 7fbc535d0700 1 -- 172.21.15.98:0/650461689 wait complete. 2024-09-13T02:54:28.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:28 smithi098 ceph-mon[27886]: pgmap v34: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 495 op/s 2024-09-13T02:54:28.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:28 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:28.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:28 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:28.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:28 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:28.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.868+0000 7f08e86bf700 1 -- 172.21.15.98:0/2754192520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 msgr2=0x7f08e00731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:28.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.868+0000 7f08e86bf700 1 --2- 172.21.15.98:0/2754192520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 0x7f08e00731e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009910 tx=0x7f08d0009c20 comp rx=0 tx=0).stop 2024-09-13T02:54:28.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.870+0000 7f08e86bf700 1 -- 172.21.15.98:0/2754192520 shutdown_connections 2024-09-13T02:54:28.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.870+0000 7f08e86bf700 1 --2- 172.21.15.98:0/2754192520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08e00737b0 0x7f08e0073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.870+0000 7f08e86bf700 1 --2- 172.21.15.98:0/2754192520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 0x7f08e00731e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.870+0000 7f08e86bf700 1 -- 172.21.15.98:0/2754192520 >> 172.21.15.98:0/2754192520 conn(0x7f08e00fb7e0 msgr2=0x7f08e00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:28.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.871+0000 7f08e86bf700 1 -- 172.21.15.98:0/2754192520 shutdown_connections 2024-09-13T02:54:28.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.872+0000 7f08e86bf700 1 -- 172.21.15.98:0/2754192520 wait complete. 2024-09-13T02:54:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.872+0000 7f08e86bf700 1 Processor -- start 2024-09-13T02:54:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.872+0000 7f08e86bf700 1 -- start start 2024-09-13T02:54:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.873+0000 7f08e86bf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08e00737b0 0x7f08e01043f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.873+0000 7f08e86bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 0x7f08e0104930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.873+0000 7f08e86bf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0104f50 con 0x7f08e0074d80 2024-09-13T02:54:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.873+0000 7f08e86bf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0105090 con 0x7f08e00737b0 2024-09-13T02:54:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.873+0000 7f08e5c5a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 0x7f08e0104930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.873+0000 7f08e5c5a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 0x7f08e0104930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34504/0 (socket says 172.21.15.98:34504) 2024-09-13T02:54:28.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.873+0000 7f08e5c5a700 1 -- 172.21.15.98:0/1993119445 learned_addr learned my addr 172.21.15.98:0/1993119445 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:54:28.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.874+0000 7f08e5c5a700 1 -- 172.21.15.98:0/1993119445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08e00737b0 msgr2=0x7f08e01043f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:28.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.874+0000 7f08e5c5a700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08e00737b0 0x7f08e01043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:28.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.874+0000 7f08e5c5a700 1 -- 172.21.15.98:0/1993119445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00095f0 con 0x7f08e0074d80 2024-09-13T02:54:28.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.874+0000 7f08e5c5a700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 0x7f08e0104930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00ef10 tx=0x7f08dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:28.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.876+0000 7f08d77fe700 1 -- 172.21.15.98:0/1993119445 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08dc00ca50 con 0x7f08e0074d80 2024-09-13T02:54:28.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.876+0000 7f08d77fe700 1 -- 172.21.15.98:0/1993119445 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08dc00f040 con 0x7f08e0074d80 2024-09-13T02:54:28.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.876+0000 7f08d77fe700 1 -- 172.21.15.98:0/1993119445 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08dc0146b0 con 0x7f08e0074d80 2024-09-13T02:54:28.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.876+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e0109ae0 con 0x7f08e0074d80 2024-09-13T02:54:28.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.876+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e010a030 con 0x7f08e0074d80 2024-09-13T02:54:28.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.879+0000 7f08d77fe700 1 -- 172.21.15.98:0/1993119445 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f08dc014920 con 0x7f08e0074d80 2024-09-13T02:54:28.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.879+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc005320 con 0x7f08e0074d80 2024-09-13T02:54:28.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.880+0000 7f08d77fe700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f08c806e480 0x7f08c8070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:28.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.880+0000 7f08d77fe700 1 -- 172.21.15.98:0/1993119445 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f08dc08e690 con 0x7f08e0074d80 2024-09-13T02:54:28.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.880+0000 7f08e645b700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f08c806e480 0x7f08c8070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:28.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.881+0000 7f08e645b700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f08c806e480 0x7f08c8070930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08d00098e0 tx=0x7f08d000b5a0 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:28.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:28.885+0000 7f08d77fe700 1 -- 172.21.15.98:0/1993119445 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f08dc05c780 con 0x7f08e0074d80 2024-09-13T02:54:29.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:28 smithi142 ceph-mon[33443]: pgmap v34: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 495 op/s 2024-09-13T02:54:29.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:28 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:29.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:28 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:29.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:28 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:29.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.216+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08cc000bf0 con 0x7f08c806e480 2024-09-13T02:54:29.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.233+0000 7f08d77fe700 1 -- 172.21.15.98:0/1993119445 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f08cc000bf0 con 0x7f08c806e480 2024-09-13T02:54:29.235 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:54:29.235 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (8m) 12s ago 9m 24.6M - 0.25.0 c8568f914cd2 babcc5d689b7 2024-09-13T02:54:29.235 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (10m) 12s ago 10m 7838k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:54:29.235 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (9m) 15s ago 9m 7465k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (10m) 12s ago 10m 6660k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (9m) 15s ago 9m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (8m) 12s ago 9m 85.6M - 9.4.7 954c08fa6188 6b3b619a7e20 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (4m) 12s ago 4m 234M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (4m) 12s ago 4m 227M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (4m) 15s ago 4m 14.1M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (4m) 15s ago 4m 17.1M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (90s) 12s ago 11m 491M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (19s) 15s ago 9m 63.2M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (11m) 12s ago 11m 56.3M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:54:29.236 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (8m) 15s ago 8m 40.2M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:54:29.237 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 starting - - - - 2024-09-13T02:54:29.237 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 starting - - - - 2024-09-13T02:54:29.237 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (8m) 12s ago 8m 190M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:54:29.237 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (7m) 12s ago 7m 197M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:54:29.237 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (7m) 12s ago 7m 163M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:54:29.237 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (6m) 15s ago 6m 218M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:54:29.237 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (6m) 15s ago 6m 195M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:54:29.237 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (5m) 15s ago 5m 175M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:54:29.237 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (25s) 12s ago 9m 54.7M - 2.43.0 a07b618ecd1d 8315d016dd1b 2024-09-13T02:54:29.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.236+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f08c806e480 msgr2=0x7f08c8070930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:29.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.236+0000 7f08e86bf700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f08c806e480 0x7f08c8070930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f08d00098e0 tx=0x7f08d000b5a0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.236+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 msgr2=0x7f08e0104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:29.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.236+0000 7f08e86bf700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 0x7f08e0104930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00ef10 tx=0x7f08dc00c3a0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.236+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 shutdown_connections 2024-09-13T02:54:29.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.236+0000 7f08e86bf700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f08c806e480 0x7f08c8070930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.236+0000 7f08e86bf700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08e00737b0 0x7f08e01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.236+0000 7f08e86bf700 1 --2- 172.21.15.98:0/1993119445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08e0074d80 0x7f08e0104930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.236+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 >> 172.21.15.98:0/1993119445 conn(0x7f08e00fb7e0 msgr2=0x7f08e0101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:29.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.237+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 shutdown_connections 2024-09-13T02:54:29.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.237+0000 7f08e86bf700 1 -- 172.21.15.98:0/1993119445 wait complete. 2024-09-13T02:54:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.369+0000 7fdc7a41d700 1 -- 172.21.15.98:0/4230899594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 msgr2=0x7fdc740fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.369+0000 7fdc7a41d700 1 --2- 172.21.15.98:0/4230899594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 0x7fdc740fe320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009910 tx=0x7fdc5c009c20 comp rx=0 tx=0).stop 2024-09-13T02:54:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.369+0000 7fdc7a41d700 1 -- 172.21.15.98:0/4230899594 shutdown_connections 2024-09-13T02:54:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.369+0000 7fdc7a41d700 1 --2- 172.21.15.98:0/4230899594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 0x7fdc740fe320 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.369+0000 7fdc7a41d700 1 --2- 172.21.15.98:0/4230899594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc741018a0 0x7fdc74101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.369+0000 7fdc7a41d700 1 -- 172.21.15.98:0/4230899594 >> 172.21.15.98:0/4230899594 conn(0x7fdc740f9f10 msgr2=0x7fdc740fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:29.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.369+0000 7fdc7a41d700 1 -- 172.21.15.98:0/4230899594 shutdown_connections 2024-09-13T02:54:29.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.369+0000 7fdc7a41d700 1 -- 172.21.15.98:0/4230899594 wait complete. 2024-09-13T02:54:29.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc7a41d700 1 Processor -- start 2024-09-13T02:54:29.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc7a41d700 1 -- start start 2024-09-13T02:54:29.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc7a41d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc741018a0 0x7fdc74195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:29.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc7a41d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 0x7fdc74196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc7a41d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74196640 con 0x7fdc741021f0 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc7a41d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74196780 con 0x7fdc741018a0 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc6bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 0x7fdc74196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc6bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 0x7fdc74196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34526/0 (socket says 172.21.15.98:34526) 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc73fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc741018a0 0x7fdc74195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.370+0000 7fdc6bfff700 1 -- 172.21.15.98:0/1358045688 learned_addr learned my addr 172.21.15.98:0/1358045688 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.371+0000 7fdc6bfff700 1 -- 172.21.15.98:0/1358045688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc741018a0 msgr2=0x7fdc74195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.371+0000 7fdc6bfff700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc741018a0 0x7fdc74195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.371+0000 7fdc6bfff700 1 -- 172.21.15.98:0/1358045688 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0095f0 con 0x7fdc741021f0 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.371+0000 7fdc73fff700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc741018a0 0x7fdc74195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.371+0000 7fdc6bfff700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 0x7fdc74196020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c000c00 tx=0x7fdc5c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.371+0000 7fdc71ffb700 1 -- 172.21.15.98:0/1358045688 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc5c01d070 con 0x7fdc741021f0 2024-09-13T02:54:29.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.371+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7419b1d0 con 0x7fdc741021f0 2024-09-13T02:54:29.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.371+0000 7fdc71ffb700 1 -- 172.21.15.98:0/1358045688 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc5c005dc0 con 0x7fdc741021f0 2024-09-13T02:54:29.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.371+0000 7fdc71ffb700 1 -- 172.21.15.98:0/1358045688 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc5c022470 con 0x7fdc741021f0 2024-09-13T02:54:29.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.372+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7419b6c0 con 0x7fdc741021f0 2024-09-13T02:54:29.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.373+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc74108d10 con 0x7fdc741021f0 2024-09-13T02:54:29.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.373+0000 7fdc71ffb700 1 -- 172.21.15.98:0/1358045688 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 32) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fdc5c003810 con 0x7fdc741021f0 2024-09-13T02:54:29.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.374+0000 7fdc71ffb700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdc6006e440 0x7fdc600708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:29.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.374+0000 7fdc73fff700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdc6006e440 0x7fdc600708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:29.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.374+0000 7fdc71ffb700 1 -- 172.21.15.98:0/1358045688 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdc5c08f3e0 con 0x7fdc741021f0 2024-09-13T02:54:29.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.374+0000 7fdc73fff700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdc6006e440 0x7fdc600708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc64011490 tx=0x7fdc64009260 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:29.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.382+0000 7fdc71ffb700 1 -- 172.21.15.98:0/1358045688 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fdc5c05c490 con 0x7fdc741021f0 2024-09-13T02:54:29.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:29 smithi142 ceph-mon[33443]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:29.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:29 smithi142 ceph-mon[33443]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:29.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.849+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdc7419bd50 con 0x7fdc741021f0 2024-09-13T02:54:29.851 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:29 smithi098 ceph-mon[27886]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:29.851 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:29 smithi098 ceph-mon[27886]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:29.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.850+0000 7fdc71ffb700 1 -- 172.21.15.98:0/1358045688 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fdc5c05c020 con 0x7fdc741021f0 2024-09-13T02:54:29.852 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:54:29.852 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:54:29.852 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:54:29.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:54:29.852 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:54:29.853 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:54:29.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.853+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdc6006e440 msgr2=0x7fdc600708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:29.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.853+0000 7fdc7a41d700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdc6006e440 0x7fdc600708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc64011490 tx=0x7fdc64009260 comp rx=0 tx=0).stop 2024-09-13T02:54:29.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.853+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 msgr2=0x7fdc74196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:29.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.853+0000 7fdc7a41d700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 0x7fdc74196020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c000c00 tx=0x7fdc5c00f690 comp rx=0 tx=0).stop 2024-09-13T02:54:29.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.853+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 shutdown_connections 2024-09-13T02:54:29.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.853+0000 7fdc7a41d700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdc6006e440 0x7fdc600708f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.853+0000 7fdc7a41d700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc741018a0 0x7fdc74195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.853+0000 7fdc7a41d700 1 --2- 172.21.15.98:0/1358045688 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc741021f0 0x7fdc74196020 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.853+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 >> 172.21.15.98:0/1358045688 conn(0x7fdc740f9f10 msgr2=0x7fdc74104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:29.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.854+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 shutdown_connections 2024-09-13T02:54:29.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.854+0000 7fdc7a41d700 1 -- 172.21.15.98:0/1358045688 wait complete. 2024-09-13T02:54:29.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.992+0000 7fbf5d033700 1 -- 172.21.15.98:0/2706251240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf580feb50 msgr2=0x7fbf58100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:29.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.992+0000 7fbf5d033700 1 --2- 172.21.15.98:0/2706251240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf580feb50 0x7fbf58100f70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009910 tx=0x7fbf48009c20 comp rx=0 tx=0).stop 2024-09-13T02:54:29.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.992+0000 7fbf5d033700 1 -- 172.21.15.98:0/2706251240 shutdown_connections 2024-09-13T02:54:29.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.992+0000 7fbf5d033700 1 --2- 172.21.15.98:0/2706251240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf581014b0 0x7fbf58103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.992+0000 7fbf5d033700 1 --2- 172.21.15.98:0/2706251240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf580feb50 0x7fbf58100f70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.992+0000 7fbf5d033700 1 -- 172.21.15.98:0/2706251240 >> 172.21.15.98:0/2706251240 conn(0x7fbf580fa780 msgr2=0x7fbf580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:29.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.992+0000 7fbf5d033700 1 -- 172.21.15.98:0/2706251240 shutdown_connections 2024-09-13T02:54:29.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.992+0000 7fbf5d033700 1 -- 172.21.15.98:0/2706251240 wait complete. 2024-09-13T02:54:29.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf5d033700 1 Processor -- start 2024-09-13T02:54:29.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf5d033700 1 -- start start 2024-09-13T02:54:29.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf5d033700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf580feb50 0x7fbf5819c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:29.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf5d033700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf581014b0 0x7fbf5819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:29.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf5d033700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5819cc10 con 0x7fbf581014b0 2024-09-13T02:54:29.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf5d033700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5819cd50 con 0x7fbf580feb50 2024-09-13T02:54:29.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf56d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf580feb50 0x7fbf5819c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:29.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf56d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf580feb50 0x7fbf5819c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.98:44884/0 (socket says 172.21.15.98:44884) 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf56d9d700 1 -- 172.21.15.98:0/1877098773 learned_addr learned my addr 172.21.15.98:0/1877098773 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.993+0000 7fbf5659c700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf581014b0 0x7fbf5819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.994+0000 7fbf56d9d700 1 -- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf581014b0 msgr2=0x7fbf5819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.994+0000 7fbf56d9d700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf581014b0 0x7fbf5819c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.994+0000 7fbf56d9d700 1 -- 172.21.15.98:0/1877098773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c009520 con 0x7fbf580feb50 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.994+0000 7fbf56d9d700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf580feb50 0x7fbf5819c0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800fa00 tx=0x7fbf4800fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.994+0000 7fbf3ffff700 1 -- 172.21.15.98:0/1877098773 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4801d070 con 0x7fbf580feb50 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.994+0000 7fbf3ffff700 1 -- 172.21.15.98:0/1877098773 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbf4800fe90 con 0x7fbf580feb50 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.994+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf480095f0 con 0x7fbf580feb50 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.994+0000 7fbf3ffff700 1 -- 172.21.15.98:0/1877098773 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf48003ea0 con 0x7fbf580feb50 2024-09-13T02:54:29.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.994+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf581a1ab0 con 0x7fbf580feb50 2024-09-13T02:54:29.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.995+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf581961c0 con 0x7fbf580feb50 2024-09-13T02:54:29.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.996+0000 7fbf3ffff700 1 -- 172.21.15.98:0/1877098773 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 32) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fbf48017790 con 0x7fbf580feb50 2024-09-13T02:54:29.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.997+0000 7fbf3ffff700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbf4006e440 0x7fbf400708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:29.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.997+0000 7fbf3ffff700 1 -- 172.21.15.98:0/1877098773 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fbf4808f680 con 0x7fbf580feb50 2024-09-13T02:54:29.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.997+0000 7fbf5659c700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbf4006e440 0x7fbf400708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:29.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:29.997+0000 7fbf5659c700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbf4006e440 0x7fbf400708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009df0 tx=0x7fbf4c009260 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:30.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.002+0000 7fbf3ffff700 1 -- 172.21.15.98:0/1877098773 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fbf4805c6b0 con 0x7fbf580feb50 2024-09-13T02:54:30.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.367+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf58061190 con 0x7fbf4006e440 2024-09-13T02:54:30.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.368+0000 7fbf3ffff700 1 -- 172.21.15.98:0/1877098773 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fbf58061190 con 0x7fbf4006e440 2024-09-13T02:54:30.370 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:54:30.370 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:54:30.370 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:54:30.370 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T02:54:30.370 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:54:30.370 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr" 2024-09-13T02:54:30.370 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:54:30.371 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T02:54:30.371 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-13T02:54:30.371 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:54:30.371 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:54:30.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.371+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbf4006e440 msgr2=0x7fbf400708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:30.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.371+0000 7fbf5d033700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbf4006e440 0x7fbf400708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009df0 tx=0x7fbf4c009260 comp rx=0 tx=0).stop 2024-09-13T02:54:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.371+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf580feb50 msgr2=0x7fbf5819c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.371+0000 7fbf5d033700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf580feb50 0x7fbf5819c0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800fa00 tx=0x7fbf4800fa30 comp rx=0 tx=0).stop 2024-09-13T02:54:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.372+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 shutdown_connections 2024-09-13T02:54:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.372+0000 7fbf5d033700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fbf4006e440 0x7fbf400708f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.372+0000 7fbf5d033700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf580feb50 0x7fbf5819c0b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.372+0000 7fbf5d033700 1 --2- 172.21.15.98:0/1877098773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf581014b0 0x7fbf5819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.372+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 >> 172.21.15.98:0/1877098773 conn(0x7fbf580fa780 msgr2=0x7fbf580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.372+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 shutdown_connections 2024-09-13T02:54:30.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:54:30.372+0000 7fbf5d033700 1 -- 172.21.15.98:0/1877098773 wait complete. 2024-09-13T02:54:30.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:30 smithi098 ceph-mon[27886]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:30.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:30 smithi098 ceph-mon[27886]: pgmap v35: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 239 op/s 2024-09-13T02:54:30.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:30 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1358045688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:31.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:30 smithi142 ceph-mon[33443]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:31.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:30 smithi142 ceph-mon[33443]: pgmap v35: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 239 op/s 2024-09-13T02:54:31.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:30 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1358045688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:31 smithi098 ceph-mon[27886]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:31 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:31 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:31 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:31 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:31.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:31 smithi098 ceph-mon[27886]: pgmap v36: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 254 op/s 2024-09-13T02:54:32.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:31 smithi142 ceph-mon[33443]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:32.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:31 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:32.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:31 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:32.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:31 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:32.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:31 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:32.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:31 smithi142 ceph-mon[33443]: pgmap v36: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 254 op/s 2024-09-13T02:54:33.109 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T02:54:33.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T02:54:33.424 DEBUG:teuthology.parallel:result is None 2024-09-13T02:54:34.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:34 smithi098 ceph-mon[27886]: pgmap v37: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 317 op/s 2024-09-13T02:54:34.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:34 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:34.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:34 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:35.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:34 smithi142 ceph-mon[33443]: pgmap v37: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 317 op/s 2024-09-13T02:54:35.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:34 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:35.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:34 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:36.933 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:36 smithi098 ceph-mon[27886]: pgmap v38: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-09-13T02:54:37.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:36 smithi142 ceph-mon[33443]: pgmap v38: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-09-13T02:54:38.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:38 smithi142 ceph-mon[33443]: pgmap v39: 65 pgs: 65 active+clean; 272 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 272 op/s 2024-09-13T02:54:38.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:38 smithi098 ceph-mon[27886]: pgmap v39: 65 pgs: 65 active+clean; 272 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 272 op/s 2024-09-13T02:54:40.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:40 smithi098 ceph-mon[27886]: pgmap v40: 65 pgs: 65 active+clean; 272 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 167 op/s 2024-09-13T02:54:41.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:40 smithi142 ceph-mon[33443]: pgmap v40: 65 pgs: 65 active+clean; 272 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 167 op/s 2024-09-13T02:54:41.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:41 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:41.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:41 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:41.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:41 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:41.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:41 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:41.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:41 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:42.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:41 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:42.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:41 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:42.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:41 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:42.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:41 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:42.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:41 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:42.027 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T02:54:42.027 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T02:54:42.319 DEBUG:teuthology.parallel:result is None 2024-09-13T02:54:42.319 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T02:54:42.350 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T02:54:42.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T02:54:42.385 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T02:54:42.385 DEBUG:teuthology.parallel:result is None 2024-09-13T02:54:42.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:42 smithi098 ceph-mon[27886]: pgmap v41: 65 pgs: 65 active+clean; 273 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 184 op/s 2024-09-13T02:54:43.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:42 smithi142 ceph-mon[33443]: pgmap v41: 65 pgs: 65 active+clean; 273 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 184 op/s 2024-09-13T02:54:44.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:44 smithi098 ceph-mon[27886]: pgmap v42: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 236 op/s 2024-09-13T02:54:45.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:44 smithi142 ceph-mon[33443]: pgmap v42: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 236 op/s 2024-09-13T02:54:46.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:46 smithi098 ceph-mon[27886]: pgmap v43: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 899 KiB/s rd, 954 KiB/s wr, 173 op/s 2024-09-13T02:54:47.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:46 smithi142 ceph-mon[33443]: pgmap v43: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 899 KiB/s rd, 954 KiB/s wr, 173 op/s 2024-09-13T02:54:48.718 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:48 smithi142 ceph-mon[33443]: pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1016 KiB/s rd, 1.0 MiB/s wr, 201 op/s 2024-09-13T02:54:48.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:48 smithi098 ceph-mon[27886]: pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1016 KiB/s rd, 1.0 MiB/s wr, 201 op/s 2024-09-13T02:54:49.345 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:49.345 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:49.345 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:49.345 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:49.345 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:49.346 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:49.346 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.346 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.346 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.346 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.346 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.346 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.346 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.346 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:49 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:49.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:49 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:50.649 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:50 smithi098 ceph-mon[27886]: pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 577 KiB/s rd, 538 KiB/s wr, 111 op/s 2024-09-13T02:54:50.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:50 smithi142 ceph-mon[33443]: pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 577 KiB/s rd, 538 KiB/s wr, 111 op/s 2024-09-13T02:54:51.666 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:51 smithi098 ceph-mon[27886]: Upgrade: Updating prometheus.smithi098 2024-09-13T02:54:51.667 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:51 smithi098 ceph-mon[27886]: Deploying daemon prometheus.smithi098 on smithi098 2024-09-13T02:54:51.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:51 smithi142 ceph-mon[33443]: Upgrade: Updating prometheus.smithi098 2024-09-13T02:54:51.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:51 smithi142 ceph-mon[33443]: Deploying daemon prometheus.smithi098 on smithi098 2024-09-13T02:54:52.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:52 smithi098 ceph-mon[27886]: pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 577 KiB/s rd, 538 KiB/s wr, 111 op/s 2024-09-13T02:54:52.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:52 smithi142 ceph-mon[33443]: pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 577 KiB/s rd, 538 KiB/s wr, 111 op/s 2024-09-13T02:54:54.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:54 smithi142 ceph-mon[33443]: pgmap v47: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 415 KiB/s rd, 430 KiB/s wr, 95 op/s 2024-09-13T02:54:54.844 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:54 smithi098 ceph-mon[27886]: pgmap v47: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 415 KiB/s rd, 430 KiB/s wr, 95 op/s 2024-09-13T02:54:56.611 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:56 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:56.611 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:56 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:56.611 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:56 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:56.611 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:56 smithi098 ceph-mon[27886]: pgmap v48: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 118 KiB/s rd, 76 KiB/s wr, 29 op/s 2024-09-13T02:54:56.611 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:56 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:56.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:56 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:56.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:56 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:54:56.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:56 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:56.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:56 smithi142 ceph-mon[33443]: pgmap v48: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 118 KiB/s rd, 76 KiB/s wr, 29 op/s 2024-09-13T02:54:56.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:56 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:58.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:58 smithi098 ceph-mon[27886]: mgrmap e33: smithi098.ukgenf(active, since 91s), standbys: smithi142.jutrvi 2024-09-13T02:54:58.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:54:58 smithi098 ceph-mon[27886]: pgmap v49: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 118 KiB/s rd, 76 KiB/s wr, 30 op/s 2024-09-13T02:54:58.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:58 smithi142 ceph-mon[33443]: mgrmap e33: smithi098.ukgenf(active, since 91s), standbys: smithi142.jutrvi 2024-09-13T02:54:58.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:54:58 smithi142 ceph-mon[33443]: pgmap v49: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 118 KiB/s rd, 76 KiB/s wr, 30 op/s 2024-09-13T02:55:00.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.497+0000 7ff978de0700 1 -- 172.21.15.98:0/239993519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974100d60 msgr2=0x7ff974103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:00.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.497+0000 7ff978de0700 1 --2- 172.21.15.98:0/239993519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974100d60 0x7ff974103140 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff964009910 tx=0x7ff964009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:00.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.497+0000 7ff978de0700 1 -- 172.21.15.98:0/239993519 shutdown_connections 2024-09-13T02:55:00.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.497+0000 7ff978de0700 1 --2- 172.21.15.98:0/239993519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff974103680 0x7ff974105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:00.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.497+0000 7ff978de0700 1 --2- 172.21.15.98:0/239993519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974100d60 0x7ff974103140 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:00.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.497+0000 7ff978de0700 1 -- 172.21.15.98:0/239993519 >> 172.21.15.98:0/239993519 conn(0x7ff9740fa780 msgr2=0x7ff9740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:00.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.497+0000 7ff978de0700 1 -- 172.21.15.98:0/239993519 shutdown_connections 2024-09-13T02:55:00.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.497+0000 7ff978de0700 1 -- 172.21.15.98:0/239993519 wait complete. 2024-09-13T02:55:00.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.497+0000 7ff978de0700 1 Processor -- start 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff978de0700 1 -- start start 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff978de0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff974100d60 0x7ff974195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff978de0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974103680 0x7ff974195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff978de0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff974196580 con 0x7ff974103680 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff978de0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9741966c0 con 0x7ff974100d60 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff971d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974103680 0x7ff974195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff971d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974103680 0x7ff974195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33794/0 (socket says 172.21.15.98:33794) 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff971d9b700 1 -- 172.21.15.98:0/3110129562 learned_addr learned my addr 172.21.15.98:0/3110129562 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff97259c700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff974100d60 0x7ff974195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff971d9b700 1 -- 172.21.15.98:0/3110129562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff974100d60 msgr2=0x7ff974195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff971d9b700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff974100d60 0x7ff974195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff971d9b700 1 -- 172.21.15.98:0/3110129562 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9640095f0 con 0x7ff974103680 2024-09-13T02:55:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff971d9b700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974103680 0x7ff974195ff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff96800c930 tx=0x7ff96800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:00.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.498+0000 7ff9637fe700 1 -- 172.21.15.98:0/3110129562 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff968007ad0 con 0x7ff974103680 2024-09-13T02:55:00.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.499+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97419b180 con 0x7ff974103680 2024-09-13T02:55:00.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.499+0000 7ff9637fe700 1 -- 172.21.15.98:0/3110129562 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff96800ce80 con 0x7ff974103680 2024-09-13T02:55:00.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.499+0000 7ff9637fe700 1 -- 172.21.15.98:0/3110129562 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff968018630 con 0x7ff974103680 2024-09-13T02:55:00.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.499+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97419b6a0 con 0x7ff974103680 2024-09-13T02:55:00.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.500+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97418fbc0 con 0x7ff974103680 2024-09-13T02:55:00.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.500+0000 7ff9637fe700 1 -- 172.21.15.98:0/3110129562 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7ff968007c30 con 0x7ff974103680 2024-09-13T02:55:00.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.500+0000 7ff9637fe700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff95c06e300 0x7ff95c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:00.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.501+0000 7ff9637fe700 1 -- 172.21.15.98:0/3110129562 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff96808dff0 con 0x7ff974103680 2024-09-13T02:55:00.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.501+0000 7ff97259c700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff95c06e300 0x7ff95c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:00.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.501+0000 7ff97259c700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff95c06e300 0x7ff95c0707b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff964006010 tx=0x7ff964005280 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.505+0000 7ff9637fe700 1 -- 172.21.15.98:0/3110129562 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff96805b240 con 0x7ff974103680 2024-09-13T02:55:00.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.785+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff974061190 con 0x7ff95c06e300 2024-09-13T02:55:00.787 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:00 smithi098 ceph-mon[27886]: pgmap v50: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:55:00.787 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:00 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:00.788 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:00 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:00.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.787+0000 7ff9637fe700 1 -- 172.21.15.98:0/3110129562 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7ff974061190 con 0x7ff95c06e300 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff95c06e300 msgr2=0x7ff95c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff95c06e300 0x7ff95c0707b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff964006010 tx=0x7ff964005280 comp rx=0 tx=0).stop 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974103680 msgr2=0x7ff974195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974103680 0x7ff974195ff0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff96800c930 tx=0x7ff96800cc40 comp rx=0 tx=0).stop 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 shutdown_connections 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff95c06e300 0x7ff95c0707b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff974100d60 0x7ff974195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 --2- 172.21.15.98:0/3110129562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff974103680 0x7ff974195ff0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 >> 172.21.15.98:0/3110129562 conn(0x7ff9740fa780 msgr2=0x7ff9740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 shutdown_connections 2024-09-13T02:55:00.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.789+0000 7ff978de0700 1 -- 172.21.15.98:0/3110129562 wait complete. 2024-09-13T02:55:00.801 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:55:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.900+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/4211733979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 msgr2=0x7f9b78100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.900+0000 7f9b7d7cf700 1 --2- 172.21.15.98:0/4211733979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 0x7f9b78100650 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009910 tx=0x7f9b68009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.900+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/4211733979 shutdown_connections 2024-09-13T02:55:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.900+0000 7f9b7d7cf700 1 --2- 172.21.15.98:0/4211733979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b78101440 0x7f9b78101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.900+0000 7f9b7d7cf700 1 --2- 172.21.15.98:0/4211733979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 0x7f9b78100650 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.900+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/4211733979 >> 172.21.15.98:0/4211733979 conn(0x7f9b780fb7f0 msgr2=0x7f9b780fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.900+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/4211733979 shutdown_connections 2024-09-13T02:55:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.900+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/4211733979 wait complete. 2024-09-13T02:55:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.901+0000 7f9b7d7cf700 1 Processor -- start 2024-09-13T02:55:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.901+0000 7f9b7d7cf700 1 -- start start 2024-09-13T02:55:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.901+0000 7f9b7d7cf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 0x7f9b78197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.901+0000 7f9b7d7cf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b78101440 0x7f9b78198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.901+0000 7f9b7d7cf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78198850 con 0x7f9b78100240 2024-09-13T02:55:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.901+0000 7f9b7d7cf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7819d260 con 0x7f9b78101440 2024-09-13T02:55:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b76ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 0x7f9b78197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b76ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 0x7f9b78197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33814/0 (socket says 172.21.15.98:33814) 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b76ffd700 1 -- 172.21.15.98:0/232983565 learned_addr learned my addr 172.21.15.98:0/232983565 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b767fc700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b78101440 0x7f9b78198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b76ffd700 1 -- 172.21.15.98:0/232983565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b78101440 msgr2=0x7f9b78198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b76ffd700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b78101440 0x7f9b78198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b76ffd700 1 -- 172.21.15.98:0/232983565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b680095f0 con 0x7f9b78100240 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b76ffd700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 0x7f9b78197cf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800bda0 tx=0x7f9b6800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b5ffff700 1 -- 172.21.15.98:0/232983565 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b6801d070 con 0x7f9b78100240 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b5ffff700 1 -- 172.21.15.98:0/232983565 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b6800f460 con 0x7f9b78100240 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7819d400 con 0x7f9b78100240 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b5ffff700 1 -- 172.21.15.98:0/232983565 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b68021620 con 0x7f9b78100240 2024-09-13T02:55:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.902+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7819d8c0 con 0x7f9b78100240 2024-09-13T02:55:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.903+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b78105520 con 0x7f9b78100240 2024-09-13T02:55:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.904+0000 7f9b5ffff700 1 -- 172.21.15.98:0/232983565 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f9b6800f5d0 con 0x7f9b78100240 2024-09-13T02:55:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.904+0000 7f9b5ffff700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9b6006e300 0x7f9b600707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.904+0000 7f9b5ffff700 1 -- 172.21.15.98:0/232983565 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9b6808f220 con 0x7f9b78100240 2024-09-13T02:55:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.905+0000 7f9b767fc700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9b6006e300 0x7f9b600707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.905+0000 7f9b767fc700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9b6006e300 0x7f9b600707b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c005950 tx=0x7f9b6c00b410 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:00.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:00.909+0000 7f9b5ffff700 1 -- 172.21.15.98:0/232983565 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f9b680589c0 con 0x7f9b78100240 2024-09-13T02:55:01.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:00 smithi142 ceph-mon[33443]: pgmap v50: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:55:01.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:00 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:01.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:00 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:01.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.137+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b78061190 con 0x7f9b6006e300 2024-09-13T02:55:01.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.138+0000 7f9b5ffff700 1 -- 172.21.15.98:0/232983565 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f9b78061190 con 0x7f9b6006e300 2024-09-13T02:55:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9b6006e300 msgr2=0x7f9b600707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9b6006e300 0x7f9b600707b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c005950 tx=0x7f9b6c00b410 comp rx=0 tx=0).stop 2024-09-13T02:55:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 msgr2=0x7f9b78197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 0x7f9b78197cf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800bda0 tx=0x7f9b6800bdd0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 shutdown_connections 2024-09-13T02:55:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f9b6006e300 0x7f9b600707b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b78100240 0x7f9b78197cf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 --2- 172.21.15.98:0/232983565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b78101440 0x7f9b78198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 >> 172.21.15.98:0/232983565 conn(0x7f9b780fb7f0 msgr2=0x7f9b78102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 shutdown_connections 2024-09-13T02:55:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.141+0000 7f9b7d7cf700 1 -- 172.21.15.98:0/232983565 wait complete. 2024-09-13T02:55:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.261+0000 7f7890b79700 1 -- 172.21.15.98:0/1226995250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fe500 msgr2=0x7f788c0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.261+0000 7f7890b79700 1 --2- 172.21.15.98:0/1226995250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fe500 0x7f788c0fe910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f787c009910 tx=0x7f787c009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.261+0000 7f7890b79700 1 -- 172.21.15.98:0/1226995250 shutdown_connections 2024-09-13T02:55:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.261+0000 7f7890b79700 1 --2- 172.21.15.98:0/1226995250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f788c0fee50 0x7f788c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.261+0000 7f7890b79700 1 --2- 172.21.15.98:0/1226995250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fe500 0x7f788c0fe910 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.261+0000 7f7890b79700 1 -- 172.21.15.98:0/1226995250 >> 172.21.15.98:0/1226995250 conn(0x7f788c0f9f10 msgr2=0x7f788c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.261+0000 7f7890b79700 1 -- 172.21.15.98:0/1226995250 shutdown_connections 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.261+0000 7f7890b79700 1 -- 172.21.15.98:0/1226995250 wait complete. 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.261+0000 7f7890b79700 1 Processor -- start 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7890b79700 1 -- start start 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7890b79700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f788c0fe500 0x7f788c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7890b79700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fee50 0x7f788c0ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7890b79700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0ffa70 con 0x7f788c0fee50 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7890b79700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0ffbb0 con 0x7f788c0fe500 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7889d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fee50 0x7f788c0ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7889d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fee50 0x7f788c0ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33834/0 (socket says 172.21.15.98:33834) 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7889d9b700 1 -- 172.21.15.98:0/3595732478 learned_addr learned my addr 172.21.15.98:0/3595732478 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f788a59c700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f788c0fe500 0x7f788c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:01.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7889d9b700 1 -- 172.21.15.98:0/3595732478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f788c0fe500 msgr2=0x7f788c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7889d9b700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f788c0fe500 0x7f788c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7889d9b700 1 -- 172.21.15.98:0/3595732478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0095f0 con 0x7f788c0fee50 2024-09-13T02:55:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7889d9b700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fee50 0x7f788c0ff530 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f788000d8d0 tx=0x7f788000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f787b7fe700 1 -- 172.21.15.98:0/3595732478 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f788000f860 con 0x7f788c0fee50 2024-09-13T02:55:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c0ffe90 con 0x7f788c0fee50 2024-09-13T02:55:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f787b7fe700 1 -- 172.21.15.98:0/3595732478 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f788000fe70 con 0x7f788c0fee50 2024-09-13T02:55:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.262+0000 7f787b7fe700 1 -- 172.21.15.98:0/3595732478 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f788000e5e0 con 0x7f788c0fee50 2024-09-13T02:55:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.263+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c19db90 con 0x7f788c0fee50 2024-09-13T02:55:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.263+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788c108d50 con 0x7f788c0fee50 2024-09-13T02:55:01.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.264+0000 7f787b7fe700 1 -- 172.21.15.98:0/3595732478 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f7880010460 con 0x7f788c0fee50 2024-09-13T02:55:01.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.264+0000 7f787b7fe700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f787406e300 0x7f78740707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:01.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.264+0000 7f787b7fe700 1 -- 172.21.15.98:0/3595732478 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f788008dc40 con 0x7f788c0fee50 2024-09-13T02:55:01.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.265+0000 7f788a59c700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f787406e300 0x7f78740707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:01.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.265+0000 7f788a59c700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f787406e300 0x7f78740707b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f787c006010 tx=0x7f787c00b540 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:01.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.269+0000 7f787b7fe700 1 -- 172.21.15.98:0/3595732478 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f788005ae90 con 0x7f788c0fee50 2024-09-13T02:55:01.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.484+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f788c105ed0 con 0x7f787406e300 2024-09-13T02:55:01.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.497+0000 7f787b7fe700 1 -- 172.21.15.98:0/3595732478 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f788c105ed0 con 0x7f787406e300 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (9m) 1s ago 10m 24.6M - 0.25.0 c8568f914cd2 babcc5d689b7 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (10m) 1s ago 10m 7940k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (9m) 30s ago 9m 7486k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (10m) 1s ago 10m 6665k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (9m) 30s ago 9m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (8m) 1s ago 10m 86.7M - 9.4.7 954c08fa6188 6b3b619a7e20 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (5m) 1s ago 5m 94.4M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (5m) 1s ago 5m 154M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (4m) 30s ago 4m 14.3M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:55:01.499 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (5m) 30s ago 5m 17.4M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (2m) 1s ago 11m 496M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (51s) 30s ago 9m 437M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (11m) 1s ago 12m 58.1M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (9m) 30s ago 9m 42.6M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (38s) 1s ago 10m 7910k - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (34s) 30s ago 9m 3670k - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (8m) 1s ago 8m 212M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (8m) 1s ago 8m 222M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (7m) 1s ago 7m 183M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (7m) 30s ago 7m 232M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (6m) 30s ago 6m 207M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (6m) 30s ago 6m 187M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:55:01.500 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (6s) 1s ago 10m 48.7M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:55:01.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f787406e300 msgr2=0x7f78740707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f787406e300 0x7f78740707b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f787c006010 tx=0x7f787c00b540 comp rx=0 tx=0).stop 2024-09-13T02:55:01.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fee50 msgr2=0x7f788c0ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fee50 0x7f788c0ff530 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f788000d8d0 tx=0x7f788000dbe0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 shutdown_connections 2024-09-13T02:55:01.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f787406e300 0x7f78740707b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f788c0fe500 0x7f788c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 --2- 172.21.15.98:0/3595732478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f788c0fee50 0x7f788c0ff530 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 >> 172.21.15.98:0/3595732478 conn(0x7f788c0f9f10 msgr2=0x7f788c1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:01.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 shutdown_connections 2024-09-13T02:55:01.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.499+0000 7f7890b79700 1 -- 172.21.15.98:0/3595732478 wait complete. 2024-09-13T02:55:01.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.603+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/1113273578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 msgr2=0x7f6c34101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.603+0000 7f6c3a5b2700 1 --2- 172.21.15.98:0/1113273578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 0x7f6c34101890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009910 tx=0x7f6c28009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:01.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.603+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/1113273578 shutdown_connections 2024-09-13T02:55:01.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.603+0000 7f6c3a5b2700 1 --2- 172.21.15.98:0/1113273578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 0x7f6c34101890 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.603+0000 7f6c3a5b2700 1 --2- 172.21.15.98:0/1113273578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c34100240 0x7f6c34100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.603+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/1113273578 >> 172.21.15.98:0/1113273578 conn(0x7f6c340fb7f0 msgr2=0x7f6c340fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:01.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.603+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/1113273578 shutdown_connections 2024-09-13T02:55:01.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.603+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/1113273578 wait complete. 2024-09-13T02:55:01.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c3a5b2700 1 Processor -- start 2024-09-13T02:55:01.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c3a5b2700 1 -- start start 2024-09-13T02:55:01.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c3a5b2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c34100240 0x7f6c34197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:01.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c3a5b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 0x7f6c34198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:01.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c3a5b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34198860 con 0x7f6c34101440 2024-09-13T02:55:01.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c3a5b2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3419d270 con 0x7f6c34100240 2024-09-13T02:55:01.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c337fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 0x7f6c34198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:01.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c337fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 0x7f6c34198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33852/0 (socket says 172.21.15.98:33852) 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c337fe700 1 -- 172.21.15.98:0/3088978426 learned_addr learned my addr 172.21.15.98:0/3088978426 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c33fff700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c34100240 0x7f6c34197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c337fe700 1 -- 172.21.15.98:0/3088978426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c34100240 msgr2=0x7f6c34197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c337fe700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c34100240 0x7f6c34197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.604+0000 7f6c337fe700 1 -- 172.21.15.98:0/3088978426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c280095f0 con 0x7f6c34101440 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.605+0000 7f6c337fe700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 0x7f6c34198240 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6c28006010 tx=0x7f6c2800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.605+0000 7f6c317fa700 1 -- 172.21.15.98:0/3088978426 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c2801d070 con 0x7f6c34101440 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.605+0000 7f6c317fa700 1 -- 172.21.15.98:0/3088978426 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6c2800f460 con 0x7f6c34101440 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.605+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3419d410 con 0x7f6c34101440 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.605+0000 7f6c317fa700 1 -- 172.21.15.98:0/3088978426 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c28021640 con 0x7f6c34101440 2024-09-13T02:55:01.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.605+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3419d8d0 con 0x7f6c34101440 2024-09-13T02:55:01.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.606+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34105520 con 0x7f6c34101440 2024-09-13T02:55:01.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.607+0000 7f6c317fa700 1 -- 172.21.15.98:0/3088978426 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f6c2800fab0 con 0x7f6c34101440 2024-09-13T02:55:01.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.607+0000 7f6c317fa700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6c1c06e300 0x7f6c1c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:01.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.607+0000 7f6c33fff700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6c1c06e300 0x7f6c1c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:01.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.607+0000 7f6c317fa700 1 -- 172.21.15.98:0/3088978426 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6c2808f2a0 con 0x7f6c34101440 2024-09-13T02:55:01.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.608+0000 7f6c33fff700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6c1c06e300 0x7f6c1c0707b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c341991e0 tx=0x7f6c2400b410 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.614+0000 7f6c317fa700 1 -- 172.21.15.98:0/3088978426 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f6c280589e0 con 0x7f6c34101440 2024-09-13T02:55:01.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.910+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6c3402cc30 con 0x7f6c34101440 2024-09-13T02:55:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.910+0000 7f6c317fa700 1 -- 172.21.15.98:0/3088978426 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f6c2805c0a0 con 0x7f6c34101440 2024-09-13T02:55:01.912 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:55:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:55:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:55:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:55:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:55:01.913 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:55:01.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6c1c06e300 msgr2=0x7f6c1c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6c1c06e300 0x7f6c1c0707b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c341991e0 tx=0x7f6c2400b410 comp rx=0 tx=0).stop 2024-09-13T02:55:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 msgr2=0x7f6c34198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 0x7f6c34198240 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6c28006010 tx=0x7f6c2800bd70 comp rx=0 tx=0).stop 2024-09-13T02:55:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 shutdown_connections 2024-09-13T02:55:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6c1c06e300 0x7f6c1c0707b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c34100240 0x7f6c34197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 --2- 172.21.15.98:0/3088978426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c34101440 0x7f6c34198240 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 >> 172.21.15.98:0/3088978426 conn(0x7f6c340fb7f0 msgr2=0x7f6c34102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 shutdown_connections 2024-09-13T02:55:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:01.914+0000 7f6c3a5b2700 1 -- 172.21.15.98:0/3088978426 wait complete. 2024-09-13T02:55:02.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.026+0000 7f8532296700 1 -- 172.21.15.98:0/2600620455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 msgr2=0x7f852c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:02.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.026+0000 7f8532296700 1 --2- 172.21.15.98:0/2600620455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 0x7f852c100650 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f851c009910 tx=0x7f851c009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:02.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.026+0000 7f8532296700 1 -- 172.21.15.98:0/2600620455 shutdown_connections 2024-09-13T02:55:02.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.026+0000 7f8532296700 1 --2- 172.21.15.98:0/2600620455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f852c101440 0x7f852c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:02.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.026+0000 7f8532296700 1 --2- 172.21.15.98:0/2600620455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 0x7f852c100650 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:02.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.026+0000 7f8532296700 1 -- 172.21.15.98:0/2600620455 >> 172.21.15.98:0/2600620455 conn(0x7f852c0fb7f0 msgr2=0x7f852c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:02.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.026+0000 7f8532296700 1 -- 172.21.15.98:0/2600620455 shutdown_connections 2024-09-13T02:55:02.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.026+0000 7f8532296700 1 -- 172.21.15.98:0/2600620455 wait complete. 2024-09-13T02:55:02.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.027+0000 7f8532296700 1 Processor -- start 2024-09-13T02:55:02.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.027+0000 7f8532296700 1 -- start start 2024-09-13T02:55:02.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.027+0000 7f8532296700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 0x7f852c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:02.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.027+0000 7f8532296700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f852c101440 0x7f852c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.027+0000 7f8532296700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c196580 con 0x7f852c100240 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.027+0000 7f8532296700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c1966c0 con 0x7f852c101440 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f852bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 0x7f852c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f852bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 0x7f852c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33866/0 (socket says 172.21.15.98:33866) 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f852bfff700 1 -- 172.21.15.98:0/3163649463 learned_addr learned my addr 172.21.15.98:0/3163649463 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f852b7fe700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f852c101440 0x7f852c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f852bfff700 1 -- 172.21.15.98:0/3163649463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f852c101440 msgr2=0x7f852c195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f852bfff700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f852c101440 0x7f852c195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f852bfff700 1 -- 172.21.15.98:0/3163649463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0095f0 con 0x7f852c100240 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f852bfff700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 0x7f852c195ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f851c00bda0 tx=0x7f851c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f85297fa700 1 -- 172.21.15.98:0/3163649463 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851c01d070 con 0x7f852c100240 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c19b120 con 0x7f852c100240 2024-09-13T02:55:02.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f85297fa700 1 -- 172.21.15.98:0/3163649463 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f851c004c50 con 0x7f852c100240 2024-09-13T02:55:02.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f85297fa700 1 -- 172.21.15.98:0/3163649463 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851c00f690 con 0x7f852c100240 2024-09-13T02:55:02.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.028+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c19b5e0 con 0x7f852c100240 2024-09-13T02:55:02.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.029+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c108d90 con 0x7f852c100240 2024-09-13T02:55:02.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.030+0000 7f85297fa700 1 -- 172.21.15.98:0/3163649463 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f851c022a20 con 0x7f852c100240 2024-09-13T02:55:02.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.030+0000 7f85297fa700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f851406e300 0x7f85140707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:02.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.031+0000 7f85297fa700 1 -- 172.21.15.98:0/3163649463 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f851c08f700 con 0x7f852c100240 2024-09-13T02:55:02.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.031+0000 7f852b7fe700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f851406e300 0x7f85140707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:02.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.031+0000 7f852b7fe700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f851406e300 0x7f85140707b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8520005ea0 tx=0x7f8520005e30 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:02.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.035+0000 7f85297fa700 1 -- 172.21.15.98:0/3163649463 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f851c05ca00 con 0x7f852c100240 2024-09-13T02:55:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:01 smithi098 ceph-mon[27886]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:01 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:01 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:01 smithi098 ceph-mon[27886]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:01 smithi098 ceph-mon[27886]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:01 smithi098 ceph-mon[27886]: pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:55:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:01 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3088978426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:01 smithi142 ceph-mon[33443]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:01 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:01 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:01 smithi142 ceph-mon[33443]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:01 smithi142 ceph-mon[33443]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:01 smithi142 ceph-mon[33443]: pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:55:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:01 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3088978426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:02.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.256+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f852c105d90 con 0x7f851406e300 2024-09-13T02:55:02.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.258+0000 7f85297fa700 1 -- 172.21.15.98:0/3163649463 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f852c105d90 con 0x7f851406e300 2024-09-13T02:55:02.259 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:55:02.259 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:55:02.260 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:55:02.260 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T02:55:02.260 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:55:02.260 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr" 2024-09-13T02:55:02.260 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:55:02.260 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T02:55:02.261 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-13T02:55:02.261 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:55:02.261 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:55:02.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f851406e300 msgr2=0x7f85140707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:02.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f851406e300 0x7f85140707b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8520005ea0 tx=0x7f8520005e30 comp rx=0 tx=0).stop 2024-09-13T02:55:02.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 msgr2=0x7f852c195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:02.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 0x7f852c195ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f851c00bda0 tx=0x7f851c00be80 comp rx=0 tx=0).stop 2024-09-13T02:55:02.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 shutdown_connections 2024-09-13T02:55:02.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f851406e300 0x7f85140707b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:02.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f852c100240 0x7f852c195ab0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:02.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 --2- 172.21.15.98:0/3163649463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f852c101440 0x7f852c195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:02.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 >> 172.21.15.98:0/3163649463 conn(0x7f852c0fb7f0 msgr2=0x7f852c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:02.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 shutdown_connections 2024-09-13T02:55:02.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:02.260+0000 7f8532296700 1 -- 172.21.15.98:0/3163649463 wait complete. 2024-09-13T02:55:03.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:03 smithi098 ceph-mon[27886]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:03.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:03 smithi142 ceph-mon[33443]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.633 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.634 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.634 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.634 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.634 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.634 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.634 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.634 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:04 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:04.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:04 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:05.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:05 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:55:05.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:05 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:55:06.452 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:06 smithi098 ceph-mon[27886]: Upgrade: Updating alertmanager.smithi098 2024-09-13T02:55:06.452 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:06 smithi098 ceph-mon[27886]: Deploying daemon alertmanager.smithi098 on smithi098 2024-09-13T02:55:06.453 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:06 smithi098 ceph-mon[27886]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T02:55:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:06 smithi142 ceph-mon[33443]: Upgrade: Updating alertmanager.smithi098 2024-09-13T02:55:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:06 smithi142 ceph-mon[33443]: Deploying daemon alertmanager.smithi098 on smithi098 2024-09-13T02:55:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:06 smithi142 ceph-mon[33443]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T02:55:08.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:08 smithi098 ceph-mon[27886]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T02:55:08.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:08 smithi142 ceph-mon[33443]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T02:55:10.859 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:10 smithi098 ceph-mon[27886]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:11.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:10 smithi142 ceph-mon[33443]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:11.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:11.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:11.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:11.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:11.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:11.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:12.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:12.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:12.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:12.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:12.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:12.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:12.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:12 smithi098 ceph-mon[27886]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:13.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:12 smithi142 ceph-mon[33443]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:14.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:14 smithi098 ceph-mon[27886]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:15.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:14 smithi142 ceph-mon[33443]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:16 smithi098 ceph-mon[27886]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:16 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:16 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:17.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:16 smithi142 ceph-mon[33443]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:16 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:16 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:17 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:17 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:17 smithi098 ceph-mon[27886]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:17 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:17 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:17 smithi142 ceph-mon[33443]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:20.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:20.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:20.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:20.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:20 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:21.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:20 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:21.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:21 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:55:22.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:21 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:55:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:22 smithi098 ceph-mon[27886]: Upgrade: Updating grafana.smithi098 2024-09-13T02:55:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:22 smithi098 ceph-mon[27886]: Deploying daemon grafana.smithi098 on smithi098 2024-09-13T02:55:22.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:22 smithi098 ceph-mon[27886]: pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:23.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:22 smithi142 ceph-mon[33443]: Upgrade: Updating grafana.smithi098 2024-09-13T02:55:23.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:22 smithi142 ceph-mon[33443]: Deploying daemon grafana.smithi098 on smithi098 2024-09-13T02:55:23.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:22 smithi142 ceph-mon[33443]: pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:24 smithi098 ceph-mon[27886]: pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:25.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:24 smithi142 ceph-mon[33443]: pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:26.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:26 smithi098 ceph-mon[27886]: pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:26.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:27.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:26 smithi142 ceph-mon[33443]: pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:27.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:28.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:28 smithi098 ceph-mon[27886]: pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:28.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:28 smithi142 ceph-mon[33443]: pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:30.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:30 smithi098 ceph-mon[27886]: pgmap v65: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:31.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:30 smithi142 ceph-mon[33443]: pgmap v65: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:32.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.398+0000 7f6b3194d700 1 -- 172.21.15.98:0/1735211333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1018a0 msgr2=0x7f6b2c101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:32.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.398+0000 7f6b3194d700 1 --2- 172.21.15.98:0/1735211333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1018a0 0x7f6b2c101cb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009910 tx=0x7f6b1c009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:32.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.398+0000 7f6b3194d700 1 -- 172.21.15.98:0/1735211333 shutdown_connections 2024-09-13T02:55:32.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.398+0000 7f6b3194d700 1 --2- 172.21.15.98:0/1735211333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b2c1021f0 0x7f6b2c0fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.398+0000 7f6b3194d700 1 --2- 172.21.15.98:0/1735211333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1018a0 0x7f6b2c101cb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.398+0000 7f6b3194d700 1 -- 172.21.15.98:0/1735211333 >> 172.21.15.98:0/1735211333 conn(0x7f6b2c0f9f10 msgr2=0x7f6b2c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.398+0000 7f6b3194d700 1 -- 172.21.15.98:0/1735211333 shutdown_connections 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.398+0000 7f6b3194d700 1 -- 172.21.15.98:0/1735211333 wait complete. 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.399+0000 7f6b3194d700 1 Processor -- start 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.399+0000 7f6b3194d700 1 -- start start 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.399+0000 7f6b3194d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b2c1018a0 0x7f6b2c195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.399+0000 7f6b3194d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1021f0 0x7f6b2c196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.399+0000 7f6b3194d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c196690 con 0x7f6b2c1021f0 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.399+0000 7f6b3194d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c1967d0 con 0x7f6b2c1018a0 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.399+0000 7f6b2a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1021f0 0x7f6b2c196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:32.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.399+0000 7f6b2a7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1021f0 0x7f6b2c196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42868/0 (socket says 172.21.15.98:42868) 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.399+0000 7f6b2a7fc700 1 -- 172.21.15.98:0/2895362035 learned_addr learned my addr 172.21.15.98:0/2895362035 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.400+0000 7f6b2a7fc700 1 -- 172.21.15.98:0/2895362035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b2c1018a0 msgr2=0x7f6b2c195b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.400+0000 7f6b2a7fc700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b2c1018a0 0x7f6b2c195b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.400+0000 7f6b2a7fc700 1 -- 172.21.15.98:0/2895362035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c0095f0 con 0x7f6b2c1021f0 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.400+0000 7f6b2a7fc700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1021f0 0x7f6b2c196070 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000e8f0 tx=0x7f6b2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.400+0000 7f6b3094b700 1 -- 172.21.15.98:0/2895362035 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b20009790 con 0x7f6b2c1021f0 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.400+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c19b280 con 0x7f6b2c1021f0 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.400+0000 7f6b3094b700 1 -- 172.21.15.98:0/2895362035 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6b20004ce0 con 0x7f6b2c1021f0 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.400+0000 7f6b3094b700 1 -- 172.21.15.98:0/2895362035 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b20005690 con 0x7f6b2c1021f0 2024-09-13T02:55:32.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.400+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2c19b7d0 con 0x7f6b2c1021f0 2024-09-13T02:55:32.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.402+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2c108d30 con 0x7f6b2c1021f0 2024-09-13T02:55:32.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.402+0000 7f6b3094b700 1 -- 172.21.15.98:0/2895362035 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f6b20004750 con 0x7f6b2c1021f0 2024-09-13T02:55:32.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.403+0000 7f6b3094b700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6b1406e300 0x7f6b140707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:32.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.403+0000 7f6b3094b700 1 -- 172.21.15.98:0/2895362035 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6b20014070 con 0x7f6b2c1021f0 2024-09-13T02:55:32.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.403+0000 7f6b2affd700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6b1406e300 0x7f6b140707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:32.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.404+0000 7f6b2affd700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6b1406e300 0x7f6b140707b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c006010 tx=0x7f6b1c009f70 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:32.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.408+0000 7f6b3094b700 1 -- 172.21.15.98:0/2895362035 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f6b2005b6f0 con 0x7f6b2c1021f0 2024-09-13T02:55:32.674 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:32 smithi098 ceph-mon[27886]: pgmap v66: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:32.674 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:32 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:32.674 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:32 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:32.674 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:32 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:32.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.718+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b2c105f90 con 0x7f6b1406e300 2024-09-13T02:55:32.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.722+0000 7f6b3094b700 1 -- 172.21.15.98:0/2895362035 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f6b2c105f90 con 0x7f6b1406e300 2024-09-13T02:55:32.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.724+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6b1406e300 msgr2=0x7f6b140707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.724+0000 7f6b3194d700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6b1406e300 0x7f6b140707b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c006010 tx=0x7f6b1c009f70 comp rx=0 tx=0).stop 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.724+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1021f0 msgr2=0x7f6b2c196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.724+0000 7f6b3194d700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1021f0 0x7f6b2c196070 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000e8f0 tx=0x7f6b2000ecb0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.725+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 shutdown_connections 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.725+0000 7f6b3194d700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6b1406e300 0x7f6b140707b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.725+0000 7f6b3194d700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b2c1018a0 0x7f6b2c195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.725+0000 7f6b3194d700 1 --2- 172.21.15.98:0/2895362035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b2c1021f0 0x7f6b2c196070 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.725+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 >> 172.21.15.98:0/2895362035 conn(0x7f6b2c0f9f10 msgr2=0x7f6b2c104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.725+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 shutdown_connections 2024-09-13T02:55:32.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.725+0000 7f6b3194d700 1 -- 172.21.15.98:0/2895362035 wait complete. 2024-09-13T02:55:32.744 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:55:32.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.851+0000 7ff568a81700 1 -- 172.21.15.98:0/3685410554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 msgr2=0x7ff5640ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.851+0000 7ff568a81700 1 --2- 172.21.15.98:0/3685410554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 0x7ff5640ffb20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff554009910 tx=0x7ff554009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.851+0000 7ff568a81700 1 -- 172.21.15.98:0/3685410554 shutdown_connections 2024-09-13T02:55:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.851+0000 7ff568a81700 1 --2- 172.21.15.98:0/3685410554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff564100060 0x7ff5641004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.851+0000 7ff568a81700 1 --2- 172.21.15.98:0/3685410554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 0x7ff5640ffb20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.851+0000 7ff568a81700 1 -- 172.21.15.98:0/3685410554 >> 172.21.15.98:0/3685410554 conn(0x7ff5640f9f10 msgr2=0x7ff5640fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.851+0000 7ff568a81700 1 -- 172.21.15.98:0/3685410554 shutdown_connections 2024-09-13T02:55:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.851+0000 7ff568a81700 1 -- 172.21.15.98:0/3685410554 wait complete. 2024-09-13T02:55:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff568a81700 1 Processor -- start 2024-09-13T02:55:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff568a81700 1 -- start start 2024-09-13T02:55:32.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff568a81700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 0x7ff564103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:32.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff568a81700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff564100060 0x7ff5641018a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:32.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff568a81700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564101de0 con 0x7ff5640ff710 2024-09-13T02:55:32.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff568a81700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564101f20 con 0x7ff564100060 2024-09-13T02:55:32.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff56259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 0x7ff564103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:32.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff56259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 0x7ff564103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42884/0 (socket says 172.21.15.98:42884) 2024-09-13T02:55:32.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff56259c700 1 -- 172.21.15.98:0/2166557684 learned_addr learned my addr 172.21.15.98:0/2166557684 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:32.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff561d9b700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff564100060 0x7ff5641018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:32.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff56259c700 1 -- 172.21.15.98:0/2166557684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff564100060 msgr2=0x7ff5641018a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:32.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff56259c700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff564100060 0x7ff5641018a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:32.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff56259c700 1 -- 172.21.15.98:0/2166557684 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5540095f0 con 0x7ff5640ff710 2024-09-13T02:55:32.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.852+0000 7ff56259c700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 0x7ff564103250 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff554006010 tx=0x7ff55400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:32.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.853+0000 7ff5537fe700 1 -- 172.21.15.98:0/2166557684 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff55401d070 con 0x7ff5640ff710 2024-09-13T02:55:32.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.853+0000 7ff5537fe700 1 -- 172.21.15.98:0/2166557684 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff55400f460 con 0x7ff5640ff710 2024-09-13T02:55:32.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.853+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5641021a0 con 0x7ff5640ff710 2024-09-13T02:55:32.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.853+0000 7ff5537fe700 1 -- 172.21.15.98:0/2166557684 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff554021640 con 0x7ff5640ff710 2024-09-13T02:55:32.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.853+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff564102690 con 0x7ff5640ff710 2024-09-13T02:55:32.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.854+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff564107c10 con 0x7ff5640ff710 2024-09-13T02:55:32.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.854+0000 7ff5537fe700 1 -- 172.21.15.98:0/2166557684 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7ff55400fab0 con 0x7ff5640ff710 2024-09-13T02:55:32.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.855+0000 7ff5537fe700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff54c06e300 0x7ff54c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:32.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.855+0000 7ff5537fe700 1 -- 172.21.15.98:0/2166557684 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff55408f180 con 0x7ff5640ff710 2024-09-13T02:55:32.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.855+0000 7ff561d9b700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff54c06e300 0x7ff54c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:32.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.855+0000 7ff561d9b700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff54c06e300 0x7ff54c0707b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff558005950 tx=0x7ff55800b410 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:32.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:32.859+0000 7ff5537fe700 1 -- 172.21.15.98:0/2166557684 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff55405c450 con 0x7ff5640ff710 2024-09-13T02:55:33.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:32 smithi142 ceph-mon[33443]: pgmap v66: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:33.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:32 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:33.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:32 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:33.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:32 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:33.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.095+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5640feab0 con 0x7ff54c06e300 2024-09-13T02:55:33.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.097+0000 7ff5537fe700 1 -- 172.21.15.98:0/2166557684 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7ff5640feab0 con 0x7ff54c06e300 2024-09-13T02:55:33.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.099+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff54c06e300 msgr2=0x7ff54c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.099+0000 7ff568a81700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff54c06e300 0x7ff54c0707b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff558005950 tx=0x7ff55800b410 comp rx=0 tx=0).stop 2024-09-13T02:55:33.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.099+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 msgr2=0x7ff564103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.099+0000 7ff568a81700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 0x7ff564103250 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff554006010 tx=0x7ff55400bd70 comp rx=0 tx=0).stop 2024-09-13T02:55:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.099+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 shutdown_connections 2024-09-13T02:55:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.099+0000 7ff568a81700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff54c06e300 0x7ff54c0707b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.099+0000 7ff568a81700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5640ff710 0x7ff564103250 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.099+0000 7ff568a81700 1 --2- 172.21.15.98:0/2166557684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff564100060 0x7ff5641018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.099+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 >> 172.21.15.98:0/2166557684 conn(0x7ff5640f9f10 msgr2=0x7ff5640fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.100+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 shutdown_connections 2024-09-13T02:55:33.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.100+0000 7ff568a81700 1 -- 172.21.15.98:0/2166557684 wait complete. 2024-09-13T02:55:33.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.235+0000 7ff702bb2700 1 -- 172.21.15.98:0/3978846775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc1003d0 msgr2=0x7ff6fc100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.235+0000 7ff702bb2700 1 --2- 172.21.15.98:0/3978846775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc1003d0 0x7ff6fc100840 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009910 tx=0x7ff6e8009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:33.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.235+0000 7ff702bb2700 1 -- 172.21.15.98:0/3978846775 shutdown_connections 2024-09-13T02:55:33.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.235+0000 7ff702bb2700 1 --2- 172.21.15.98:0/3978846775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc1003d0 0x7ff6fc100840 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.235+0000 7ff702bb2700 1 --2- 172.21.15.98:0/3978846775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc0ff130 0x7ff6fc0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.235+0000 7ff702bb2700 1 -- 172.21.15.98:0/3978846775 >> 172.21.15.98:0/3978846775 conn(0x7ff6fc0fa780 msgr2=0x7ff6fc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:33.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.235+0000 7ff702bb2700 1 -- 172.21.15.98:0/3978846775 shutdown_connections 2024-09-13T02:55:33.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.235+0000 7ff702bb2700 1 -- 172.21.15.98:0/3978846775 wait complete. 2024-09-13T02:55:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff702bb2700 1 Processor -- start 2024-09-13T02:55:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff702bb2700 1 -- start start 2024-09-13T02:55:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff702bb2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc0ff130 0x7ff6fc103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff702bb2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc1003d0 0x7ff6fc1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:33.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff702bb2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc101cf0 con 0x7ff6fc0ff130 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff702bb2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc101e30 con 0x7ff6fc1003d0 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff70094e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc0ff130 0x7ff6fc103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff70094e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc0ff130 0x7ff6fc103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42904/0 (socket says 172.21.15.98:42904) 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff70094e700 1 -- 172.21.15.98:0/116960646 learned_addr learned my addr 172.21.15.98:0/116960646 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.236+0000 7ff6fbfff700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc1003d0 0x7ff6fc1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.237+0000 7ff70094e700 1 -- 172.21.15.98:0/116960646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc1003d0 msgr2=0x7ff6fc1017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.237+0000 7ff70094e700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc1003d0 0x7ff6fc1017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.237+0000 7ff70094e700 1 -- 172.21.15.98:0/116960646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e80095f0 con 0x7ff6fc0ff130 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.237+0000 7ff70094e700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc0ff130 0x7ff6fc103160 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000e920 tx=0x7ff6f000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.237+0000 7ff6f9ffb700 1 -- 172.21.15.98:0/116960646 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f000c9d0 con 0x7ff6fc0ff130 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.237+0000 7ff6f9ffb700 1 -- 172.21.15.98:0/116960646 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff6f0010430 con 0x7ff6fc0ff130 2024-09-13T02:55:33.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.237+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc102110 con 0x7ff6fc0ff130 2024-09-13T02:55:33.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.237+0000 7ff6f9ffb700 1 -- 172.21.15.98:0/116960646 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f0018650 con 0x7ff6fc0ff130 2024-09-13T02:55:33.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.237+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc19dac0 con 0x7ff6fc0ff130 2024-09-13T02:55:33.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.239+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc107c10 con 0x7ff6fc0ff130 2024-09-13T02:55:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.239+0000 7ff6f9ffb700 1 -- 172.21.15.98:0/116960646 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7ff6f00105a0 con 0x7ff6fc0ff130 2024-09-13T02:55:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.239+0000 7ff6f9ffb700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff6ec06e300 0x7ff6ec0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.239+0000 7ff6f9ffb700 1 -- 172.21.15.98:0/116960646 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff6f0014070 con 0x7ff6fc0ff130 2024-09-13T02:55:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.239+0000 7ff6fbfff700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff6ec06e300 0x7ff6ec0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:33.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.240+0000 7ff6fbfff700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff6ec06e300 0x7ff6ec0707b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009fd0 tx=0x7ff6e8005940 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:33.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.244+0000 7ff6f9ffb700 1 -- 172.21.15.98:0/116960646 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff6f00539d0 con 0x7ff6fc0ff130 2024-09-13T02:55:33.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.470+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6fc068c50 con 0x7ff6ec06e300 2024-09-13T02:55:33.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.484+0000 7ff6f9ffb700 1 -- 172.21.15.98:0/116960646 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7ff6fc068c50 con 0x7ff6ec06e300 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (23s) 17s ago 10m 13.8M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (11m) 17s ago 11m 7956k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (10m) 62s ago 10m 7486k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (11m) 17s ago 11m 6665k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (10m) 62s ago 10m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 starting - - - - 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (5m) 17s ago 5m 94.0M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (5m) 17s ago 5m 154M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (5m) 62s ago 5m 14.3M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (5m) 62s ago 5m 17.4M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (2m) 17s ago 12m 496M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:55:33.486 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (83s) 62s ago 10m 437M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (12m) 17s ago 12m 58.4M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (10m) 62s ago 10m 42.6M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (70s) 17s ago 11m 14.7M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (66s) 62s ago 10m 3670k - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (9m) 17s ago 9m 212M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (8m) 17s ago 8m 222M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (8m) 17s ago 8m 184M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (7m) 62s ago 7m 232M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (7m) 62s ago 7m 207M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (7m) 62s ago 7m 187M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:55:33.487 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (38s) 17s ago 10m 55.6M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:55:33.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff6ec06e300 msgr2=0x7ff6ec0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff6ec06e300 0x7ff6ec0707b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009fd0 tx=0x7ff6e8005940 comp rx=0 tx=0).stop 2024-09-13T02:55:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc0ff130 msgr2=0x7ff6fc103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc0ff130 0x7ff6fc103160 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000e920 tx=0x7ff6f000ec30 comp rx=0 tx=0).stop 2024-09-13T02:55:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 shutdown_connections 2024-09-13T02:55:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff6ec06e300 0x7ff6ec0707b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6fc0ff130 0x7ff6fc103160 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 --2- 172.21.15.98:0/116960646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6fc1003d0 0x7ff6fc1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 >> 172.21.15.98:0/116960646 conn(0x7ff6fc0fa780 msgr2=0x7ff6fc068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 shutdown_connections 2024-09-13T02:55:33.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.487+0000 7ff702bb2700 1 -- 172.21.15.98:0/116960646 wait complete. 2024-09-13T02:55:33.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.594+0000 7fae331a8700 1 -- 172.21.15.98:0/3518512275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c102230 msgr2=0x7fae2c0fe360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.594+0000 7fae331a8700 1 --2- 172.21.15.98:0/3518512275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c102230 0x7fae2c0fe360 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fae18009910 tx=0x7fae18009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:33.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 -- 172.21.15.98:0/3518512275 shutdown_connections 2024-09-13T02:55:33.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 --2- 172.21.15.98:0/3518512275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c102230 0x7fae2c0fe360 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 --2- 172.21.15.98:0/3518512275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c1018e0 0x7fae2c101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 -- 172.21.15.98:0/3518512275 >> 172.21.15.98:0/3518512275 conn(0x7fae2c0f9f10 msgr2=0x7fae2c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:33.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 -- 172.21.15.98:0/3518512275 shutdown_connections 2024-09-13T02:55:33.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 -- 172.21.15.98:0/3518512275 wait complete. 2024-09-13T02:55:33.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 Processor -- start 2024-09-13T02:55:33.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 -- start start 2024-09-13T02:55:33.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c1018e0 0x7fae2c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:33.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c102230 0x7fae2c1960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:33.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c1966d0 con 0x7fae2c1018e0 2024-09-13T02:55:33.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae331a8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c196810 con 0x7fae2c102230 2024-09-13T02:55:33.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae30f44700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c1018e0 0x7fae2c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:33.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.595+0000 7fae30f44700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c1018e0 0x7fae2c195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42914/0 (socket says 172.21.15.98:42914) 2024-09-13T02:55:33.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae30f44700 1 -- 172.21.15.98:0/1379760683 learned_addr learned my addr 172.21.15.98:0/1379760683 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:33.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae2bfff700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c102230 0x7fae2c1960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:33.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae30f44700 1 -- 172.21.15.98:0/1379760683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c102230 msgr2=0x7fae2c1960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae30f44700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c102230 0x7fae2c1960b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae30f44700 1 -- 172.21.15.98:0/1379760683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180095f0 con 0x7fae2c1018e0 2024-09-13T02:55:33.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae30f44700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c1018e0 0x7fae2c195b70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fae2000b4b0 tx=0x7fae2000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:33.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae29ffb700 1 -- 172.21.15.98:0/1379760683 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae20011800 con 0x7fae2c1018e0 2024-09-13T02:55:33.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c19b2c0 con 0x7fae2c1018e0 2024-09-13T02:55:33.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae29ffb700 1 -- 172.21.15.98:0/1379760683 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fae20011e10 con 0x7fae2c1018e0 2024-09-13T02:55:33.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae29ffb700 1 -- 172.21.15.98:0/1379760683 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae2000f2e0 con 0x7fae2c1018e0 2024-09-13T02:55:33.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.596+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c19b810 con 0x7fae2c1018e0 2024-09-13T02:55:33.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.597+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c108da0 con 0x7fae2c1018e0 2024-09-13T02:55:33.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.598+0000 7fae29ffb700 1 -- 172.21.15.98:0/1379760683 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7fae20010380 con 0x7fae2c1018e0 2024-09-13T02:55:33.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.598+0000 7fae29ffb700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fae1c06e300 0x7fae1c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:33.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.598+0000 7fae29ffb700 1 -- 172.21.15.98:0/1379760683 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fae2008dca0 con 0x7fae2c1018e0 2024-09-13T02:55:33.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.598+0000 7fae2bfff700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fae1c06e300 0x7fae1c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:33.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.599+0000 7fae2bfff700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fae1c06e300 0x7fae1c0707b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae18006010 tx=0x7fae18005960 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:33.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.603+0000 7fae29ffb700 1 -- 172.21.15.98:0/1379760683 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fae20092070 con 0x7fae2c1018e0 2024-09-13T02:55:33.903 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:33 smithi098 ceph-mon[27886]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:33.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.904+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fae2c108f60 con 0x7fae2c1018e0 2024-09-13T02:55:33.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.905+0000 7fae29ffb700 1 -- 172.21.15.98:0/1379760683 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fae2005aef0 con 0x7fae2c1018e0 2024-09-13T02:55:33.906 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:55:33.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:55:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:55:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T02:55:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:55:33.908 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:55:33.908 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fae1c06e300 msgr2=0x7fae1c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fae1c06e300 0x7fae1c0707b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae18006010 tx=0x7fae18005960 comp rx=0 tx=0).stop 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c1018e0 msgr2=0x7fae2c195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c1018e0 0x7fae2c195b70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fae2000b4b0 tx=0x7fae2000b870 comp rx=0 tx=0).stop 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 shutdown_connections 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fae1c06e300 0x7fae1c0707b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae2c1018e0 0x7fae2c195b70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 --2- 172.21.15.98:0/1379760683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c102230 0x7fae2c1960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 >> 172.21.15.98:0/1379760683 conn(0x7fae2c0f9f10 msgr2=0x7fae2c1048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:33.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 shutdown_connections 2024-09-13T02:55:33.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:33.907+0000 7fae331a8700 1 -- 172.21.15.98:0/1379760683 wait complete. 2024-09-13T02:55:34.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:33 smithi142 ceph-mon[33443]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.017+0000 7f5e6168a700 1 -- 172.21.15.98:0/1220825899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 msgr2=0x7f5e5c0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.017+0000 7f5e6168a700 1 --2- 172.21.15.98:0/1220825899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 0x7f5e5c0fe910 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009910 tx=0x7f5e4c009c20 comp rx=0 tx=0).stop 2024-09-13T02:55:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.017+0000 7f5e6168a700 1 -- 172.21.15.98:0/1220825899 shutdown_connections 2024-09-13T02:55:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.017+0000 7f5e6168a700 1 --2- 172.21.15.98:0/1220825899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0fee50 0x7f5e5c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.017+0000 7f5e6168a700 1 --2- 172.21.15.98:0/1220825899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 0x7f5e5c0fe910 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.017+0000 7f5e6168a700 1 -- 172.21.15.98:0/1220825899 >> 172.21.15.98:0/1220825899 conn(0x7f5e5c0f9f10 msgr2=0x7f5e5c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.017+0000 7f5e6168a700 1 -- 172.21.15.98:0/1220825899 shutdown_connections 2024-09-13T02:55:34.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.017+0000 7f5e6168a700 1 -- 172.21.15.98:0/1220825899 wait complete. 2024-09-13T02:55:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.018+0000 7f5e6168a700 1 Processor -- start 2024-09-13T02:55:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.018+0000 7f5e6168a700 1 -- start start 2024-09-13T02:55:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.018+0000 7f5e6168a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 0x7f5e5c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.018+0000 7f5e6168a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0fee50 0x7f5e5c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.018+0000 7f5e6168a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c196630 con 0x7f5e5c0fe500 2024-09-13T02:55:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.018+0000 7f5e6168a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c196770 con 0x7f5e5c0fee50 2024-09-13T02:55:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.018+0000 7f5e5affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 0x7f5e5c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:34.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e5affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 0x7f5e5c195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42926/0 (socket says 172.21.15.98:42926) 2024-09-13T02:55:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e5affd700 1 -- 172.21.15.98:0/2671009132 learned_addr learned my addr 172.21.15.98:0/2671009132 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:55:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e5a7fc700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0fee50 0x7f5e5c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e5affd700 1 -- 172.21.15.98:0/2671009132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0fee50 msgr2=0x7f5e5c196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e5affd700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0fee50 0x7f5e5c196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e5affd700 1 -- 172.21.15.98:0/2671009132 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c0095f0 con 0x7f5e5c0fe500 2024-09-13T02:55:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e5affd700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 0x7f5e5c195ad0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00fa00 tx=0x7f5e4c00fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e43fff700 1 -- 172.21.15.98:0/2671009132 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c01d070 con 0x7f5e5c0fe500 2024-09-13T02:55:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e43fff700 1 -- 172.21.15.98:0/2671009132 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5e4c005640 con 0x7f5e5c0fe500 2024-09-13T02:55:34.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c19b1c0 con 0x7f5e5c0fe500 2024-09-13T02:55:34.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c19b6b0 con 0x7f5e5c0fe500 2024-09-13T02:55:34.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.019+0000 7f5e43fff700 1 -- 172.21.15.98:0/2671009132 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c017630 con 0x7f5e5c0fe500 2024-09-13T02:55:34.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.021+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c108d70 con 0x7f5e5c0fe500 2024-09-13T02:55:34.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.021+0000 7f5e43fff700 1 -- 172.21.15.98:0/2671009132 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f5e4c003680 con 0x7f5e5c0fe500 2024-09-13T02:55:34.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.022+0000 7f5e43fff700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5e4406e300 0x7f5e440707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:34.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.022+0000 7f5e43fff700 1 -- 172.21.15.98:0/2671009132 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5e4c08f3b0 con 0x7f5e5c0fe500 2024-09-13T02:55:34.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.022+0000 7f5e5a7fc700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5e4406e300 0x7f5e440707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:34.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.023+0000 7f5e5a7fc700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5e4406e300 0x7f5e440707b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c068200 tx=0x7f5e50009260 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:34.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.026+0000 7f5e43fff700 1 -- 172.21.15.98:0/2671009132 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5e4c05c680 con 0x7f5e5c0fe500 2024-09-13T02:55:34.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.260+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e5c105ed0 con 0x7f5e4406e300 2024-09-13T02:55:34.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.261+0000 7f5e43fff700 1 -- 172.21.15.98:0/2671009132 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f5e5c105ed0 con 0x7f5e4406e300 2024-09-13T02:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T02:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr" 2024-09-13T02:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T02:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading grafana daemons", 2024-09-13T02:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5e4406e300 msgr2=0x7f5e440707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5e4406e300 0x7f5e440707b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c068200 tx=0x7f5e50009260 comp rx=0 tx=0).stop 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 msgr2=0x7f5e5c195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 0x7f5e5c195ad0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00fa00 tx=0x7f5e4c00fa30 comp rx=0 tx=0).stop 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 shutdown_connections 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5e4406e300 0x7f5e440707b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e5c0fe500 0x7f5e5c195ad0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 --2- 172.21.15.98:0/2671009132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0fee50 0x7f5e5c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 >> 172.21.15.98:0/2671009132 conn(0x7f5e5c0f9f10 msgr2=0x7f5e5c1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:34.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 shutdown_connections 2024-09-13T02:55:34.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:55:34.264+0000 7f5e6168a700 1 -- 172.21.15.98:0/2671009132 wait complete. 2024-09-13T02:55:34.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:34 smithi098 ceph-mon[27886]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:34.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:34 smithi098 ceph-mon[27886]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:34.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:34 smithi098 ceph-mon[27886]: pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:34.971 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:34 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1379760683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:35.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:34 smithi142 ceph-mon[33443]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:35.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:34 smithi142 ceph-mon[33443]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:35.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:34 smithi142 ceph-mon[33443]: pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:35.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:34 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1379760683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:35.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:35 smithi098 ceph-mon[27886]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:36.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:35 smithi142 ceph-mon[33443]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:36 smithi098 ceph-mon[27886]: pgmap v68: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:37.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:36 smithi142 ceph-mon[33443]: pgmap v68: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:38.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:38.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:38.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:38 smithi098 ceph-mon[27886]: pgmap v69: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:38.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:38.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:39.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:39.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:39.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:38 smithi142 ceph-mon[33443]: pgmap v69: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:39.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:39.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:40.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:40 smithi098 ceph-mon[27886]: pgmap v70: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:41.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:40 smithi142 ceph-mon[33443]: pgmap v70: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:41.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:41 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:42.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:41 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:42.946 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:42 smithi098 ceph-mon[27886]: pgmap v71: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:43.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:42 smithi142 ceph-mon[33443]: pgmap v71: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: pgmap v72: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:44.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.981 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T02:55:44.982 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:44.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:44.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:44.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:44.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:44.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:44.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T02:55:44.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T02:55:44.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:44.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:44.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:44.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:44.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:44.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:44.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:44.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:44 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:45.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: pgmap v72: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:45.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:45.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:45.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:45.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:45.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T02:55:45.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:45.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:45.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:44 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:45.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:45 smithi098 ceph-mon[27886]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:55:45.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:45 smithi098 ceph-mon[27886]: Upgrade: Finalizing container_image settings 2024-09-13T02:55:45.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:45 smithi098 ceph-mon[27886]: Upgrade: Complete! 2024-09-13T02:55:46.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:45 smithi142 ceph-mon[33443]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:55:46.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:45 smithi142 ceph-mon[33443]: Upgrade: Finalizing container_image settings 2024-09-13T02:55:46.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:45 smithi142 ceph-mon[33443]: Upgrade: Complete! 2024-09-13T02:55:46.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:46 smithi098 ceph-mon[27886]: pgmap v73: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:46.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:46 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:47.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:46 smithi142 ceph-mon[33443]: pgmap v73: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:47.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:46 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:55:48.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:48 smithi098 ceph-mon[27886]: pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:48.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:48 smithi142 ceph-mon[33443]: pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:50 smithi098 ceph-mon[27886]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:51.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:50 smithi142 ceph-mon[33443]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:52.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:52 smithi098 ceph-mon[27886]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:55:53.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:52 smithi142 ceph-mon[33443]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:55:54.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:54 smithi098 ceph-mon[27886]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:55.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:54 smithi142 ceph-mon[33443]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:56.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:56 smithi098 ceph-mon[27886]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:56.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:56 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:57.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:56 smithi142 ceph-mon[33443]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:55:57.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:56 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:58.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:55:58 smithi098 ceph-mon[27886]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:55:58.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:55:58 smithi142 ceph-mon[33443]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:00.858 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:00 smithi098 ceph-mon[27886]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:01.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:00 smithi142 ceph-mon[33443]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:02.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:02 smithi098 ceph-mon[27886]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:03.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:02 smithi142 ceph-mon[33443]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:04.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.386+0000 7fc706cc3700 1 -- 172.21.15.98:0/3489806633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700074d00 msgr2=0x7fc700073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:04.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.386+0000 7fc706cc3700 1 --2- 172.21.15.98:0/3489806633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700074d00 0x7fc700073160 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009910 tx=0x7fc6f4009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:04.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.386+0000 7fc706cc3700 1 -- 172.21.15.98:0/3489806633 shutdown_connections 2024-09-13T02:56:04.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.386+0000 7fc706cc3700 1 --2- 172.21.15.98:0/3489806633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc700073730 0x7fc700073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:04.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.386+0000 7fc706cc3700 1 --2- 172.21.15.98:0/3489806633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700074d00 0x7fc700073160 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:04.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.386+0000 7fc706cc3700 1 -- 172.21.15.98:0/3489806633 >> 172.21.15.98:0/3489806633 conn(0x7fc7000fb7f0 msgr2=0x7fc7000fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:04.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.386+0000 7fc706cc3700 1 -- 172.21.15.98:0/3489806633 shutdown_connections 2024-09-13T02:56:04.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.386+0000 7fc706cc3700 1 -- 172.21.15.98:0/3489806633 wait complete. 2024-09-13T02:56:04.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc706cc3700 1 Processor -- start 2024-09-13T02:56:04.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc706cc3700 1 -- start start 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc706cc3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700073730 0x7fc700197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc706cc3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc700074d00 0x7fc700198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc706cc3700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc700198920 con 0x7fc700073730 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc706cc3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc700198a60 con 0x7fc700074d00 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc704a5f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700073730 0x7fc700197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc704a5f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700073730 0x7fc700197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37874/0 (socket says 172.21.15.98:37874) 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc704a5f700 1 -- 172.21.15.98:0/4278322685 learned_addr learned my addr 172.21.15.98:0/4278322685 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc6fffff700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc700074d00 0x7fc700198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc704a5f700 1 -- 172.21.15.98:0/4278322685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc700074d00 msgr2=0x7fc700198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc704a5f700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc700074d00 0x7fc700198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc704a5f700 1 -- 172.21.15.98:0/4278322685 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f40095f0 con 0x7fc700073730 2024-09-13T02:56:04.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.387+0000 7fc6fffff700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc700074d00 0x7fc700198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:56:04.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.388+0000 7fc704a5f700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700073730 0x7fc700197dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40092e0 tx=0x7fc6f400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:04.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.388+0000 7fc6fdffb700 1 -- 172.21.15.98:0/4278322685 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f401d070 con 0x7fc700073730 2024-09-13T02:56:04.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.388+0000 7fc6fdffb700 1 -- 172.21.15.98:0/4278322685 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6f400f460 con 0x7fc700073730 2024-09-13T02:56:04.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.388+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70019d4b0 con 0x7fc700073730 2024-09-13T02:56:04.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.388+0000 7fc6fdffb700 1 -- 172.21.15.98:0/4278322685 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f4021640 con 0x7fc700073730 2024-09-13T02:56:04.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.388+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70019d9a0 con 0x7fc700073730 2024-09-13T02:56:04.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.389+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70010aff0 con 0x7fc700073730 2024-09-13T02:56:04.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.390+0000 7fc6fdffb700 1 -- 172.21.15.98:0/4278322685 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7fc6f400fa90 con 0x7fc700073730 2024-09-13T02:56:04.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.390+0000 7fc6fdffb700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc6f006e300 0x7fc6f00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:04.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.390+0000 7fc6fdffb700 1 -- 172.21.15.98:0/4278322685 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc6f408f460 con 0x7fc700073730 2024-09-13T02:56:04.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.390+0000 7fc6fffff700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc6f006e300 0x7fc6f00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:04.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.391+0000 7fc6fffff700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc6f006e300 0x7fc6f00707b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec007900 tx=0x7fc6ec008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:04.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.395+0000 7fc6fdffb700 1 -- 172.21.15.98:0/4278322685 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fc6f405c6b0 con 0x7fc700073730 2024-09-13T02:56:04.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.616+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc70019dfe0 con 0x7fc6f006e300 2024-09-13T02:56:04.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.617+0000 7fc6fdffb700 1 -- 172.21.15.98:0/4278322685 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc70019dfe0 con 0x7fc6f006e300 2024-09-13T02:56:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc6f006e300 msgr2=0x7fc6f00707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc6f006e300 0x7fc6f00707b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec007900 tx=0x7fc6ec008040 comp rx=0 tx=0).stop 2024-09-13T02:56:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700073730 msgr2=0x7fc700197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700073730 0x7fc700197dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40092e0 tx=0x7fc6f400be20 comp rx=0 tx=0).stop 2024-09-13T02:56:04.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 shutdown_connections 2024-09-13T02:56:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fc6f006e300 0x7fc6f00707b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc700073730 0x7fc700197dc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 --2- 172.21.15.98:0/4278322685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc700074d00 0x7fc700198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 >> 172.21.15.98:0/4278322685 conn(0x7fc7000fb7f0 msgr2=0x7fc7001060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.619+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 shutdown_connections 2024-09-13T02:56:04.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:04.620+0000 7fc706cc3700 1 -- 172.21.15.98:0/4278322685 wait complete. 2024-09-13T02:56:04.944 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:04 smithi098 ceph-mon[27886]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:05.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:04 smithi142 ceph-mon[33443]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:05.216 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-13T02:56:05.459 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:05.956 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:05 smithi098 ceph-mon[27886]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:06.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:05 smithi142 ceph-mon[33443]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:06.854 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:06 smithi098 ceph-mon[27886]: pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:07.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:06 smithi142 ceph-mon[33443]: pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:07.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.114+0000 7f6a67c6d700 1 -- 172.21.15.98:0/2100785605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 msgr2=0x7f6a600ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:07.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.114+0000 7f6a67c6d700 1 --2- 172.21.15.98:0/2100785605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 0x7f6a600ff720 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009910 tx=0x7f6a54009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:07.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.114+0000 7f6a67c6d700 1 -- 172.21.15.98:0/2100785605 shutdown_connections 2024-09-13T02:56:07.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.114+0000 7f6a67c6d700 1 --2- 172.21.15.98:0/2100785605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a600ffc60 0x7f6a6010a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:07.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.114+0000 7f6a67c6d700 1 --2- 172.21.15.98:0/2100785605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 0x7f6a600ff720 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:07.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.114+0000 7f6a67c6d700 1 -- 172.21.15.98:0/2100785605 >> 172.21.15.98:0/2100785605 conn(0x7f6a600748b0 msgr2=0x7f6a60074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:07.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.114+0000 7f6a67c6d700 1 -- 172.21.15.98:0/2100785605 shutdown_connections 2024-09-13T02:56:07.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.114+0000 7f6a67c6d700 1 -- 172.21.15.98:0/2100785605 wait complete. 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.115+0000 7f6a67c6d700 1 Processor -- start 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.115+0000 7f6a67c6d700 1 -- start start 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.115+0000 7f6a67c6d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 0x7f6a60198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.115+0000 7f6a67c6d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a600ffc60 0x7f6a60198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.115+0000 7f6a67c6d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60198d20 con 0x7f6a600ff350 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.115+0000 7f6a67c6d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6019cab0 con 0x7f6a600ffc60 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.115+0000 7f6a65a09700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 0x7f6a60198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.115+0000 7f6a65a09700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 0x7f6a60198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37892/0 (socket says 172.21.15.98:37892) 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.115+0000 7f6a65a09700 1 -- 172.21.15.98:0/3044062723 learned_addr learned my addr 172.21.15.98:0/3044062723 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a65208700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a600ffc60 0x7f6a60198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a65a09700 1 -- 172.21.15.98:0/3044062723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a600ffc60 msgr2=0x7f6a60198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:07.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a65a09700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a600ffc60 0x7f6a60198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:07.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a65a09700 1 -- 172.21.15.98:0/3044062723 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a540095f0 con 0x7f6a600ff350 2024-09-13T02:56:07.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a65208700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a600ffc60 0x7f6a60198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:56:07.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a65a09700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 0x7f6a60198100 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6a540092e0 tx=0x7f6a5400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:07.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a52ffd700 1 -- 172.21.15.98:0/3044062723 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a5401d070 con 0x7f6a600ff350 2024-09-13T02:56:07.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6019cd30 con 0x7f6a600ff350 2024-09-13T02:56:07.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a52ffd700 1 -- 172.21.15.98:0/3044062723 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a5400f460 con 0x7f6a600ff350 2024-09-13T02:56:07.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a52ffd700 1 -- 172.21.15.98:0/3044062723 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a540175f0 con 0x7f6a600ff350 2024-09-13T02:56:07.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.116+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6019d220 con 0x7f6a600ff350 2024-09-13T02:56:07.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.117+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6010a230 con 0x7f6a600ff350 2024-09-13T02:56:07.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.118+0000 7f6a52ffd700 1 -- 172.21.15.98:0/3044062723 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f6a5400f5d0 con 0x7f6a600ff350 2024-09-13T02:56:07.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.118+0000 7f6a52ffd700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6a4c06e300 0x7f6a4c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:07.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.118+0000 7f6a52ffd700 1 -- 172.21.15.98:0/3044062723 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6a5408f5f0 con 0x7f6a600ff350 2024-09-13T02:56:07.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.119+0000 7f6a65208700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6a4c06e300 0x7f6a4c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:07.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.119+0000 7f6a65208700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6a4c06e300 0x7f6a4c0707b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6a60199720 tx=0x7f6a5c008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:07.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.123+0000 7f6a52ffd700 1 -- 172.21.15.98:0/3044062723 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f6a54058d10 con 0x7f6a600ff350 2024-09-13T02:56:07.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.428+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6a6004f2a0 con 0x7f6a600ff350 2024-09-13T02:56:07.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.428+0000 7f6a52ffd700 1 -- 172.21.15.98:0/3044062723 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f6a5405c3d0 con 0x7f6a600ff350 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6a4c06e300 msgr2=0x7f6a4c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6a4c06e300 0x7f6a4c0707b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6a60199720 tx=0x7f6a5c008040 comp rx=0 tx=0).stop 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 msgr2=0x7f6a60198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 0x7f6a60198100 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6a540092e0 tx=0x7f6a5400be20 comp rx=0 tx=0).stop 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 shutdown_connections 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f6a4c06e300 0x7f6a4c0707b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a600ff350 0x7f6a60198100 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 --2- 172.21.15.98:0/3044062723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a600ffc60 0x7f6a60198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 >> 172.21.15.98:0/3044062723 conn(0x7f6a600748b0 msgr2=0x7f6a60100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:07.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 shutdown_connections 2024-09-13T02:56:07.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:07.431+0000 7f6a67c6d700 1 -- 172.21.15.98:0/3044062723 wait complete. 2024-09-13T02:56:07.443 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:56:08.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-13T02:56:08.277 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:08.657 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:08 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3044062723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:08.657 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:08 smithi098 ceph-mon[27886]: pgmap v84: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:08.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:08 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3044062723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:08.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:08 smithi142 ceph-mon[33443]: pgmap v84: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:09.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.939+0000 7f4a58df8700 1 -- 172.21.15.98:0/906073398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 msgr2=0x7f4a54104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.939+0000 7f4a58df8700 1 --2- 172.21.15.98:0/906073398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 0x7f4a54104e50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c009910 tx=0x7f4a3c009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.939+0000 7f4a58df8700 1 -- 172.21.15.98:0/906073398 shutdown_connections 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.939+0000 7f4a58df8700 1 --2- 172.21.15.98:0/906073398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 0x7f4a54104e50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.939+0000 7f4a58df8700 1 --2- 172.21.15.98:0/906073398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a541004e0 0x7f4a541008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.939+0000 7f4a58df8700 1 -- 172.21.15.98:0/906073398 >> 172.21.15.98:0/906073398 conn(0x7f4a540fbda0 msgr2=0x7f4a540fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.939+0000 7f4a58df8700 1 -- 172.21.15.98:0/906073398 shutdown_connections 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.939+0000 7f4a58df8700 1 -- 172.21.15.98:0/906073398 wait complete. 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a58df8700 1 Processor -- start 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a58df8700 1 -- start start 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a58df8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a541004e0 0x7f4a54196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a58df8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 0x7f4a54196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a58df8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54196c20 con 0x7f4a54100e80 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a58df8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5419a9b0 con 0x7f4a541004e0 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a51d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 0x7f4a54196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a51d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 0x7f4a54196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37914/0 (socket says 172.21.15.98:37914) 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a51d9b700 1 -- 172.21.15.98:0/1473980319 learned_addr learned my addr 172.21.15.98:0/1473980319 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a51d9b700 1 -- 172.21.15.98:0/1473980319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a541004e0 msgr2=0x7f4a54196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a5259c700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a541004e0 0x7f4a54196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a51d9b700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a541004e0 0x7f4a54196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a51d9b700 1 -- 172.21.15.98:0/1473980319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c0095f0 con 0x7f4a54100e80 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a5259c700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a541004e0 0x7f4a54196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.940+0000 7f4a51d9b700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 0x7f4a54196540 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00bda0 tx=0x7f4a3c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.941+0000 7f4a4b7fe700 1 -- 172.21.15.98:0/1473980319 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a3c01d070 con 0x7f4a54100e80 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.941+0000 7f4a4b7fe700 1 -- 172.21.15.98:0/1473980319 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a3c004fb0 con 0x7f4a54100e80 2024-09-13T02:56:09.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.941+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5419ac30 con 0x7f4a54100e80 2024-09-13T02:56:09.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.941+0000 7f4a4b7fe700 1 -- 172.21.15.98:0/1473980319 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a3c00f480 con 0x7f4a54100e80 2024-09-13T02:56:09.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.941+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5419b120 con 0x7f4a54100e80 2024-09-13T02:56:09.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.942+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a541087a0 con 0x7f4a54100e80 2024-09-13T02:56:09.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.942+0000 7f4a4b7fe700 1 -- 172.21.15.98:0/1473980319 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f4a3c022870 con 0x7f4a54100e80 2024-09-13T02:56:09.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.943+0000 7f4a4b7fe700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4a4006e300 0x7f4a400707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.943+0000 7f4a4b7fe700 1 -- 172.21.15.98:0/1473980319 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4a3c08f600 con 0x7f4a54100e80 2024-09-13T02:56:09.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.943+0000 7f4a5259c700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4a4006e300 0x7f4a400707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.943+0000 7f4a5259c700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4a4006e300 0x7f4a400707b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a44007eb0 tx=0x7f4a440073c0 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:09.947+0000 7f4a4b7fe700 1 -- 172.21.15.98:0/1473980319 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f4a3c058f70 con 0x7f4a54100e80 2024-09-13T02:56:10.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.231+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4a5404f2a0 con 0x7f4a54100e80 2024-09-13T02:56:10.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.231+0000 7f4a4b7fe700 1 -- 172.21.15.98:0/1473980319 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f4a3c05c630 con 0x7f4a54100e80 2024-09-13T02:56:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4a4006e300 msgr2=0x7f4a400707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4a4006e300 0x7f4a400707b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a44007eb0 tx=0x7f4a440073c0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 msgr2=0x7f4a54196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 0x7f4a54196540 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00bda0 tx=0x7f4a3c00be80 comp rx=0 tx=0).stop 2024-09-13T02:56:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 shutdown_connections 2024-09-13T02:56:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4a4006e300 0x7f4a400707b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a541004e0 0x7f4a54196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 --2- 172.21.15.98:0/1473980319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a54100e80 0x7f4a54196540 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 >> 172.21.15.98:0/1473980319 conn(0x7f4a540fbda0 msgr2=0x7f4a540fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 shutdown_connections 2024-09-13T02:56:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:10.233+0000 7f4a58df8700 1 -- 172.21.15.98:0/1473980319 wait complete. 2024-09-13T02:56:10.245 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)" 2024-09-13T02:56:10.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:10 smithi098 ceph-mon[27886]: pgmap v85: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:10.953 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:10 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/1473980319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:10.975 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-13T02:56:11.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:10 smithi142 ceph-mon[33443]: pgmap v85: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:11.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:10 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/1473980319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:11.180 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:11 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:12.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:11 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.890+0000 7f504942f700 1 -- 172.21.15.98:0/3899473104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 msgr2=0x7f504410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.890+0000 7f504942f700 1 --2- 172.21.15.98:0/3899473104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 0x7f504410a6d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f502c009910 tx=0x7f502c009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.890+0000 7f504942f700 1 -- 172.21.15.98:0/3899473104 shutdown_connections 2024-09-13T02:56:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.890+0000 7f504942f700 1 --2- 172.21.15.98:0/3899473104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 0x7f504410a6d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.890+0000 7f504942f700 1 --2- 172.21.15.98:0/3899473104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440ff350 0x7f50440ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.890+0000 7f504942f700 1 -- 172.21.15.98:0/3899473104 >> 172.21.15.98:0/3899473104 conn(0x7f50440748b0 msgr2=0x7f5044074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.890+0000 7f504942f700 1 -- 172.21.15.98:0/3899473104 shutdown_connections 2024-09-13T02:56:12.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.890+0000 7f504942f700 1 -- 172.21.15.98:0/3899473104 wait complete. 2024-09-13T02:56:12.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f504942f700 1 Processor -- start 2024-09-13T02:56:12.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f504942f700 1 -- start start 2024-09-13T02:56:12.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f504942f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440ff350 0x7f5044195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:12.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f504942f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 0x7f5044196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:12.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f504942f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044196a20 con 0x7f50440ffc60 2024-09-13T02:56:12.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f504942f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504419a7b0 con 0x7f50440ff350 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f503bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 0x7f5044196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f503bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 0x7f5044196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37936/0 (socket says 172.21.15.98:37936) 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f503bfff700 1 -- 172.21.15.98:0/3923727009 learned_addr learned my addr 172.21.15.98:0/3923727009 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f5042ffd700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440ff350 0x7f5044195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f503bfff700 1 -- 172.21.15.98:0/3923727009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440ff350 msgr2=0x7f5044195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f503bfff700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440ff350 0x7f5044195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f503bfff700 1 -- 172.21.15.98:0/3923727009 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c0095f0 con 0x7f50440ffc60 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.891+0000 7f5042ffd700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440ff350 0x7f5044195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.892+0000 7f503bfff700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 0x7f5044196340 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f502c006010 tx=0x7f502c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.892+0000 7f5040ff9700 1 -- 172.21.15.98:0/3923727009 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f502c01d070 con 0x7f50440ffc60 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.892+0000 7f5040ff9700 1 -- 172.21.15.98:0/3923727009 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f502c00f460 con 0x7f50440ffc60 2024-09-13T02:56:12.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.892+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504419aa30 con 0x7f50440ffc60 2024-09-13T02:56:12.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.892+0000 7f5040ff9700 1 -- 172.21.15.98:0/3923727009 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f502c017630 con 0x7f50440ffc60 2024-09-13T02:56:12.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.892+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504419af20 con 0x7f50440ffc60 2024-09-13T02:56:12.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.893+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5044107dd0 con 0x7f50440ffc60 2024-09-13T02:56:12.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.893+0000 7f5040ff9700 1 -- 172.21.15.98:0/3923727009 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f502c00f5d0 con 0x7f50440ffc60 2024-09-13T02:56:12.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.894+0000 7f5040ff9700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f503006e300 0x7f50300707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:12.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.894+0000 7f5042ffd700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f503006e300 0x7f50300707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:12.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.894+0000 7f5040ff9700 1 -- 172.21.15.98:0/3923727009 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f502c08f4c0 con 0x7f50440ffc60 2024-09-13T02:56:12.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.894+0000 7f5042ffd700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f503006e300 0x7f50300707b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5034005950 tx=0x7f50340058e0 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:12.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:12.899+0000 7f5040ff9700 1 -- 172.21.15.98:0/3923727009 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f502c058c60 con 0x7f50440ffc60 2024-09-13T02:56:12.900 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:12 smithi098 ceph-mon[27886]: pgmap v86: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:13.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:12 smithi142 ceph-mon[33443]: pgmap v86: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.185+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f504404f2a0 con 0x7f50440ffc60 2024-09-13T02:56:13.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.186+0000 7f5040ff9700 1 -- 172.21.15.98:0/3923727009 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f502c05c320 con 0x7f50440ffc60 2024-09-13T02:56:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f503006e300 msgr2=0x7f50300707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f503006e300 0x7f50300707b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5034005950 tx=0x7f50340058e0 comp rx=0 tx=0).stop 2024-09-13T02:56:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 msgr2=0x7f5044196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 0x7f5044196340 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f502c006010 tx=0x7f502c00be20 comp rx=0 tx=0).stop 2024-09-13T02:56:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 shutdown_connections 2024-09-13T02:56:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f503006e300 0x7f50300707b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50440ff350 0x7f5044195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:13.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 --2- 172.21.15.98:0/3923727009 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50440ffc60 0x7f5044196340 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:13.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 >> 172.21.15.98:0/3923727009 conn(0x7f50440748b0 msgr2=0x7f5044104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:13.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 shutdown_connections 2024-09-13T02:56:13.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:13.188+0000 7f504942f700 1 -- 172.21.15.98:0/3923727009 wait complete. 2024-09-13T02:56:13.200 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:56:13.862 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:13 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3923727009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:13.884 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-13T02:56:14.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:13 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3923727009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:14.084 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:14.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:14 smithi098 ceph-mon[27886]: pgmap v87: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:14.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:14 smithi142 ceph-mon[33443]: pgmap v87: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:15.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.552+0000 7fdbd952e700 1 -- 172.21.15.98:0/768692232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ffb20 msgr2=0x7fdbd4104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:15.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.552+0000 7fdbd952e700 1 --2- 172.21.15.98:0/768692232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ffb20 0x7fdbd4104000 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009910 tx=0x7fdbc4009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:15.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.552+0000 7fdbd952e700 1 -- 172.21.15.98:0/768692232 shutdown_connections 2024-09-13T02:56:15.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.552+0000 7fdbd952e700 1 --2- 172.21.15.98:0/768692232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ffb20 0x7fdbd4104000 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:15.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.552+0000 7fdbd952e700 1 --2- 172.21.15.98:0/768692232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40ff210 0x7fdbd40ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:15.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.552+0000 7fdbd952e700 1 -- 172.21.15.98:0/768692232 >> 172.21.15.98:0/768692232 conn(0x7fdbd40fac80 msgr2=0x7fdbd40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:15.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.552+0000 7fdbd952e700 1 -- 172.21.15.98:0/768692232 shutdown_connections 2024-09-13T02:56:15.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.552+0000 7fdbd952e700 1 -- 172.21.15.98:0/768692232 wait complete. 2024-09-13T02:56:15.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.553+0000 7fdbd952e700 1 Processor -- start 2024-09-13T02:56:15.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.553+0000 7fdbd952e700 1 -- start start 2024-09-13T02:56:15.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.553+0000 7fdbd952e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ff210 0x7fdbd419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:15.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.553+0000 7fdbd952e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40ffb20 0x7fdbd419c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:15.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.553+0000 7fdbd952e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd419d0a0 con 0x7fdbd40ff210 2024-09-13T02:56:15.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.553+0000 7fdbd952e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd41a0e30 con 0x7fdbd40ffb20 2024-09-13T02:56:15.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ff210 0x7fdbd419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:15.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ff210 0x7fdbd419c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41134/0 (socket says 172.21.15.98:41134) 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd2ffd700 1 -- 172.21.15.98:0/108887570 learned_addr learned my addr 172.21.15.98:0/108887570 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd27fc700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40ffb20 0x7fdbd419c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd2ffd700 1 -- 172.21.15.98:0/108887570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40ffb20 msgr2=0x7fdbd419c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd2ffd700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40ffb20 0x7fdbd419c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd2ffd700 1 -- 172.21.15.98:0/108887570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc40095f0 con 0x7fdbd40ff210 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd2ffd700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ff210 0x7fdbd419c480 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800d8d0 tx=0x7fdbc800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbbbfff700 1 -- 172.21.15.98:0/108887570 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbc80098a0 con 0x7fdbd40ff210 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd41a1110 con 0x7fdbd40ff210 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbbbfff700 1 -- 172.21.15.98:0/108887570 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbc8010460 con 0x7fdbd40ff210 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbbbfff700 1 -- 172.21.15.98:0/108887570 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbc800f5f0 con 0x7fdbd40ff210 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.554+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd41a1660 con 0x7fdbd40ff210 2024-09-13T02:56:15.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.555+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd4101690 con 0x7fdbd40ff210 2024-09-13T02:56:15.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.556+0000 7fdbbbfff700 1 -- 172.21.15.98:0/108887570 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7fdbc8009a00 con 0x7fdbd40ff210 2024-09-13T02:56:15.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.556+0000 7fdbbbfff700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdbbc06e300 0x7fdbbc0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:15.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.556+0000 7fdbbbfff700 1 -- 172.21.15.98:0/108887570 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdbc808df40 con 0x7fdbd40ff210 2024-09-13T02:56:15.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.556+0000 7fdbd27fc700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdbbc06e300 0x7fdbbc0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:15.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.557+0000 7fdbd27fc700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdbbc06e300 0x7fdbbc0707b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdbd419daa0 tx=0x7fdbc401a040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:15.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.561+0000 7fdbbbfff700 1 -- 172.21.15.98:0/108887570 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fdbc80c29d0 con 0x7fdbd40ff210 2024-09-13T02:56:15.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:15.790+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbd41a1880 con 0x7fdbbc06e300 2024-09-13T02:56:16.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:16 smithi098 ceph-mon[27886]: pgmap v88: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:16 smithi142 ceph-mon[33443]: pgmap v88: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:17.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.471+0000 7fdbbbfff700 1 -- 172.21.15.98:0/108887570 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5393 (secure 0 0 0) 0x7fdbd41a1880 con 0x7fdbbc06e300 2024-09-13T02:56:17.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdbbc06e300 msgr2=0x7fdbbc0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:17.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdbbc06e300 0x7fdbbc0707b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdbd419daa0 tx=0x7fdbc401a040 comp rx=0 tx=0).stop 2024-09-13T02:56:17.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ff210 msgr2=0x7fdbd419c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ff210 0x7fdbd419c480 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800d8d0 tx=0x7fdbc800dbe0 comp rx=0 tx=0).stop 2024-09-13T02:56:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 shutdown_connections 2024-09-13T02:56:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7fdbbc06e300 0x7fdbbc0707b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbd40ff210 0x7fdbd419c480 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 --2- 172.21.15.98:0/108887570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbd40ffb20 0x7fdbd419c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 >> 172.21.15.98:0/108887570 conn(0x7fdbd40fac80 msgr2=0x7fdbd4110680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 shutdown_connections 2024-09-13T02:56:17.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:17.474+0000 7fdbd952e700 1 -- 172.21.15.98:0/108887570 wait complete. 2024-09-13T02:56:17.486 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:56:17.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:17 smithi098 ceph-mon[27886]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:18.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:17 smithi142 ceph-mon[33443]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:18.162 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch ps' 2024-09-13T02:56:18.366 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:18.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:18 smithi098 ceph-mon[27886]: pgmap v89: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:19.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:18 smithi142 ceph-mon[33443]: pgmap v89: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.032+0000 7f86779f7700 1 -- 172.21.15.98:0/269849589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101d30 msgr2=0x7f867010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.032+0000 7f86779f7700 1 --2- 172.21.15.98:0/269849589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101d30 0x7f867010a230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8660009910 tx=0x7f8660009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.032+0000 7f86779f7700 1 -- 172.21.15.98:0/269849589 shutdown_connections 2024-09-13T02:56:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.032+0000 7f86779f7700 1 --2- 172.21.15.98:0/269849589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101d30 0x7f867010a230 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.032+0000 7f86779f7700 1 --2- 172.21.15.98:0/269849589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8670101420 0x7f86701017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.032+0000 7f86779f7700 1 -- 172.21.15.98:0/269849589 >> 172.21.15.98:0/269849589 conn(0x7f86700fac80 msgr2=0x7f86700fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.032+0000 7f86779f7700 1 -- 172.21.15.98:0/269849589 shutdown_connections 2024-09-13T02:56:20.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.032+0000 7f86779f7700 1 -- 172.21.15.98:0/269849589 wait complete. 2024-09-13T02:56:20.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.033+0000 7f86779f7700 1 Processor -- start 2024-09-13T02:56:20.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.033+0000 7f86779f7700 1 -- start start 2024-09-13T02:56:20.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.033+0000 7f86779f7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101420 0x7f8670195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:20.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.033+0000 7f86779f7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8670101d30 0x7f86701963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:20.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.033+0000 7f86779f7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670196a80 con 0x7f8670101420 2024-09-13T02:56:20.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.033+0000 7f86779f7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867019a810 con 0x7f8670101d30 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.033+0000 7f8675793700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101420 0x7f8670195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.033+0000 7f8675793700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101420 0x7f8670195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41148/0 (socket says 172.21.15.98:41148) 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.033+0000 7f8675793700 1 -- 172.21.15.98:0/1755939625 learned_addr learned my addr 172.21.15.98:0/1755939625 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f8674f92700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8670101d30 0x7f86701963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f8675793700 1 -- 172.21.15.98:0/1755939625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8670101d30 msgr2=0x7f86701963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f8675793700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8670101d30 0x7f86701963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f8675793700 1 -- 172.21.15.98:0/1755939625 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600095f0 con 0x7f8670101420 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f8675793700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101420 0x7f8670195e60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f866c00c8a0 tx=0x7f866c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f86667fc700 1 -- 172.21.15.98:0/1755939625 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f866c00cea0 con 0x7f8670101420 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f86667fc700 1 -- 172.21.15.98:0/1755939625 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f866c004830 con 0x7f8670101420 2024-09-13T02:56:20.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867019aaf0 con 0x7f8670101420 2024-09-13T02:56:20.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f86667fc700 1 -- 172.21.15.98:0/1755939625 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f866c0055b0 con 0x7f8670101420 2024-09-13T02:56:20.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.034+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867019b040 con 0x7f8670101420 2024-09-13T02:56:20.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.035+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86701078a0 con 0x7f8670101420 2024-09-13T02:56:20.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.036+0000 7f86667fc700 1 -- 172.21.15.98:0/1755939625 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f866c0049a0 con 0x7f8670101420 2024-09-13T02:56:20.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.037+0000 7f86667fc700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f865c06e300 0x7f865c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:20.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.037+0000 7f86667fc700 1 -- 172.21.15.98:0/1755939625 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f866c08dd00 con 0x7f8670101420 2024-09-13T02:56:20.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.037+0000 7f8674f92700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f865c06e300 0x7f865c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:20.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.037+0000 7f8674f92700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f865c06e300 0x7f865c0707b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86600059d0 tx=0x7f866001a040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:20.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.041+0000 7f86667fc700 1 -- 172.21.15.98:0/1755939625 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f866c091030 con 0x7f8670101420 2024-09-13T02:56:20.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.262+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f867019b2c0 con 0x7f865c06e300 2024-09-13T02:56:20.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.271+0000 7f86667fc700 1 -- 172.21.15.98:0/1755939625 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f867019b2c0 con 0x7f865c06e300 2024-09-13T02:56:20.273 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:56:20.273 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (69s) 42s ago 11m 13.8M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T02:56:20.273 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (12m) 42s ago 12m 7986k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (11m) 109s ago 11m 7486k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (11m) 42s ago 11m 6665k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (11m) 109s ago 11m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (48s) 42s ago 11m 47.1M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (6m) 42s ago 6m 94.4M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (6m) 42s ago 6m 154M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (6m) 109s ago 6m 14.3M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (6m) 109s ago 6m 17.4M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (3m) 42s ago 13m 504M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (2m) 109s ago 10m 437M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (13m) 42s ago 13m 59.2M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:56:20.274 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (10m) 109s ago 10m 42.6M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:56:20.275 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (117s) 42s ago 11m 16.6M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:56:20.275 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (113s) 109s ago 10m 3670k - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:56:20.275 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (10m) 42s ago 10m 213M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:56:20.275 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (9m) 42s ago 9m 222M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:56:20.275 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (9m) 42s ago 9m 184M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:56:20.275 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (8m) 109s ago 8m 232M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:56:20.275 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (8m) 109s ago 8m 207M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:56:20.275 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (7m) 109s ago 7m 187M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:56:20.275 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (85s) 42s ago 11m 60.2M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f865c06e300 msgr2=0x7f865c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f865c06e300 0x7f865c0707b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86600059d0 tx=0x7f866001a040 comp rx=0 tx=0).stop 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101420 msgr2=0x7f8670195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101420 0x7f8670195e60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f866c00c8a0 tx=0x7f866c00cc60 comp rx=0 tx=0).stop 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 shutdown_connections 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f865c06e300 0x7f865c0707b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8670101420 0x7f8670195e60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 --2- 172.21.15.98:0/1755939625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8670101d30 0x7f86701963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 >> 172.21.15.98:0/1755939625 conn(0x7f86700fac80 msgr2=0x7f86701049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 shutdown_connections 2024-09-13T02:56:20.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:20.274+0000 7f86779f7700 1 -- 172.21.15.98:0/1755939625 wait complete. 2024-09-13T02:56:20.859 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:20 smithi098 ceph-mon[27886]: pgmap v90: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:20.882 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:56:20.883 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:56:20.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-13T02:56:21.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:20 smithi142 ceph-mon[33443]: pgmap v90: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:21.092 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:21 smithi098 ceph-mon[27886]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:22.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:21 smithi142 ceph-mon[33443]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:22.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.669+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/2196113024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab4075e80 msgr2=0x7f5ab40ff350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.669+0000 7f5ab8a3a700 1 --2- 172.21.15.98:0/2196113024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab4075e80 0x7f5ab40ff350 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009940 tx=0x7f5aa8009c50 comp rx=0 tx=0).stop 2024-09-13T02:56:22.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.669+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/2196113024 shutdown_connections 2024-09-13T02:56:22.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.669+0000 7f5ab8a3a700 1 --2- 172.21.15.98:0/2196113024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab40ff890 0x7f5ab40ffd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.669+0000 7f5ab8a3a700 1 --2- 172.21.15.98:0/2196113024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab4075e80 0x7f5ab40ff350 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.669+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/2196113024 >> 172.21.15.98:0/2196113024 conn(0x7f5ab40748b0 msgr2=0x7f5ab4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.669+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/2196113024 shutdown_connections 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.669+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/2196113024 wait complete. 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab8a3a700 1 Processor -- start 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab8a3a700 1 -- start start 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab8a3a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab4075e80 0x7f5ab4198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab8a3a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab40ff890 0x7f5ab4198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab8a3a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4198d60 con 0x7f5ab40ff890 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab8a3a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab419caf0 con 0x7f5ab4075e80 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab40ff890 0x7f5ab4198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab40ff890 0x7f5ab4198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41160/0 (socket says 172.21.15.98:41160) 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab1d9b700 1 -- 172.21.15.98:0/3312701420 learned_addr learned my addr 172.21.15.98:0/3312701420 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:22.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab259c700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab4075e80 0x7f5ab4198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab1d9b700 1 -- 172.21.15.98:0/3312701420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab4075e80 msgr2=0x7f5ab4198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab1d9b700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab4075e80 0x7f5ab4198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.670+0000 7f5ab1d9b700 1 -- 172.21.15.98:0/3312701420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa80095f0 con 0x7f5ab40ff890 2024-09-13T02:56:22.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.671+0000 7f5ab1d9b700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab40ff890 0x7f5ab4198680 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400b4b0 tx=0x7f5aa400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.671+0000 7f5aa37fe700 1 -- 172.21.15.98:0/3312701420 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa4011800 con 0x7f5ab40ff890 2024-09-13T02:56:22.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.671+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab419cdd0 con 0x7f5ab40ff890 2024-09-13T02:56:22.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.671+0000 7f5aa37fe700 1 -- 172.21.15.98:0/3312701420 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5aa4011e20 con 0x7f5ab40ff890 2024-09-13T02:56:22.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.671+0000 7f5aa37fe700 1 -- 172.21.15.98:0/3312701420 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa400f2e0 con 0x7f5ab40ff890 2024-09-13T02:56:22.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.671+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab419d320 con 0x7f5ab40ff890 2024-09-13T02:56:22.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.672+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab410a230 con 0x7f5ab40ff890 2024-09-13T02:56:22.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.672+0000 7f5aa37fe700 1 -- 172.21.15.98:0/3312701420 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f5aa4010380 con 0x7f5ab40ff890 2024-09-13T02:56:22.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.673+0000 7f5aa37fe700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5a9c06e300 0x7f5a9c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.673+0000 7f5aa37fe700 1 -- 172.21.15.98:0/3312701420 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5aa408dc20 con 0x7f5ab40ff890 2024-09-13T02:56:22.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.673+0000 7f5ab259c700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5a9c06e300 0x7f5a9c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.673+0000 7f5ab259c700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5a9c06e300 0x7f5a9c0707b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8005cd0 tx=0x7f5aa8005c20 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.678+0000 7f5aa37fe700 1 -- 172.21.15.98:0/3312701420 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5aa4057340 con 0x7f5ab40ff890 2024-09-13T02:56:22.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.879+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f5ab419d610 con 0x7f5ab40ff890 2024-09-13T02:56:22.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.884+0000 7f5aa37fe700 1 -- 172.21.15.98:0/3312701420 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v45)=0 v45) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5aa405aa00 con 0x7f5ab40ff890 2024-09-13T02:56:22.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5a9c06e300 msgr2=0x7f5a9c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5a9c06e300 0x7f5a9c0707b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8005cd0 tx=0x7f5aa8005c20 comp rx=0 tx=0).stop 2024-09-13T02:56:22.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab40ff890 msgr2=0x7f5ab4198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab40ff890 0x7f5ab4198680 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400b4b0 tx=0x7f5aa400b870 comp rx=0 tx=0).stop 2024-09-13T02:56:22.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 shutdown_connections 2024-09-13T02:56:22.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f5a9c06e300 0x7f5a9c0707b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ab4075e80 0x7f5ab4198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 --2- 172.21.15.98:0/3312701420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ab40ff890 0x7f5ab4198680 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 >> 172.21.15.98:0/3312701420 conn(0x7f5ab40748b0 msgr2=0x7f5ab40fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:22.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 shutdown_connections 2024-09-13T02:56:22.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:22.886+0000 7f5ab8a3a700 1 -- 172.21.15.98:0/3312701420 wait complete. 2024-09-13T02:56:22.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:22 smithi098 ceph-mon[27886]: pgmap v91: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:23.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:22 smithi142 ceph-mon[33443]: pgmap v91: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:23.525 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:56:23.525 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:56:23.526 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T02:56:23.727 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:24.190 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:23 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/3312701420' entity='client.admin' 2024-09-13T02:56:24.190 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:23 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:24.190 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:23 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:24.190 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:23 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:24.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:23 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:24.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:23 smithi098 ceph-mon[27886]: pgmap v92: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:23 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/3312701420' entity='client.admin' 2024-09-13T02:56:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:23 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:23 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:23 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:23 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:24.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:23 smithi142 ceph-mon[33443]: pgmap v92: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:25.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.319+0000 7f60e6981700 1 -- 172.21.15.98:0/1356538821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ffd50 msgr2=0x7f60e0103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:25.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.319+0000 7f60e6981700 1 --2- 172.21.15.98:0/1356538821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ffd50 0x7f60e0103d20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009910 tx=0x7f60d4009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:25.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.319+0000 7f60e6981700 1 -- 172.21.15.98:0/1356538821 shutdown_connections 2024-09-13T02:56:25.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.319+0000 7f60e6981700 1 --2- 172.21.15.98:0/1356538821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ffd50 0x7f60e0103d20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:25.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.319+0000 7f60e6981700 1 --2- 172.21.15.98:0/1356538821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e00ff3b0 0x7f60e00ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:25.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.319+0000 7f60e6981700 1 -- 172.21.15.98:0/1356538821 >> 172.21.15.98:0/1356538821 conn(0x7f60e00fac90 msgr2=0x7f60e00fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:25.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.319+0000 7f60e6981700 1 -- 172.21.15.98:0/1356538821 shutdown_connections 2024-09-13T02:56:25.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.319+0000 7f60e6981700 1 -- 172.21.15.98:0/1356538821 wait complete. 2024-09-13T02:56:25.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.320+0000 7f60e6981700 1 Processor -- start 2024-09-13T02:56:25.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.320+0000 7f60e6981700 1 -- start start 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.320+0000 7f60e6981700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ff3b0 0x7f60e0196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.320+0000 7f60e6981700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e00ffd50 0x7f60e0197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.320+0000 7f60e6981700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0197870 con 0x7f60e00ff3b0 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.320+0000 7f60e6981700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01979e0 con 0x7f60e00ffd50 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ff3b0 0x7f60e0196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ff3b0 0x7f60e0196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53000/0 (socket says 172.21.15.98:53000) 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dffff700 1 -- 172.21.15.98:0/1954054863 learned_addr learned my addr 172.21.15.98:0/1954054863 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60df7fe700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e00ffd50 0x7f60e0197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dffff700 1 -- 172.21.15.98:0/1954054863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e00ffd50 msgr2=0x7f60e0197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dffff700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e00ffd50 0x7f60e0197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dffff700 1 -- 172.21.15.98:0/1954054863 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40095f0 con 0x7f60e00ff3b0 2024-09-13T02:56:25.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dffff700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ff3b0 0x7f60e0196d10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f60d000d8d0 tx=0x7f60d000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dd7fa700 1 -- 172.21.15.98:0/1954054863 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d00098a0 con 0x7f60e00ff3b0 2024-09-13T02:56:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dd7fa700 1 -- 172.21.15.98:0/1954054863 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60d0010460 con 0x7f60e00ff3b0 2024-09-13T02:56:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60dd7fa700 1 -- 172.21.15.98:0/1954054863 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d000f5f0 con 0x7f60e00ff3b0 2024-09-13T02:56:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e019fd80 con 0x7f60e00ff3b0 2024-09-13T02:56:25.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.321+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e01a0240 con 0x7f60e00ff3b0 2024-09-13T02:56:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.322+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e0107720 con 0x7f60e00ff3b0 2024-09-13T02:56:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.323+0000 7f60dd7fa700 1 -- 172.21.15.98:0/1954054863 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f60d0009a00 con 0x7f60e00ff3b0 2024-09-13T02:56:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.323+0000 7f60dd7fa700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f60c806e300 0x7f60c80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.323+0000 7f60dd7fa700 1 -- 172.21.15.98:0/1954054863 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f60d008de50 con 0x7f60e00ff3b0 2024-09-13T02:56:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.323+0000 7f60df7fe700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f60c806e300 0x7f60c80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:25.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.324+0000 7f60df7fe700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f60c806e300 0x7f60c80707b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006010 tx=0x7f60d401a040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:25.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.328+0000 7f60dd7fa700 1 -- 172.21.15.98:0/1954054863 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f60d00575f0 con 0x7f60e00ff3b0 2024-09-13T02:56:25.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.523+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f60e004f2a0 con 0x7f60e00ff3b0 2024-09-13T02:56:25.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.524+0000 7f60dd7fa700 1 -- 172.21.15.98:0/1954054863 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v45)=0 v45) v1 ==== 155+0+0 (secure 0 0 0) 0x7f60d00160e0 con 0x7f60e00ff3b0 2024-09-13T02:56:25.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f60c806e300 msgr2=0x7f60c80707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:25.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f60c806e300 0x7f60c80707b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006010 tx=0x7f60d401a040 comp rx=0 tx=0).stop 2024-09-13T02:56:25.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ff3b0 msgr2=0x7f60e0196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:25.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ff3b0 0x7f60e0196d10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f60d000d8d0 tx=0x7f60d000dbe0 comp rx=0 tx=0).stop 2024-09-13T02:56:25.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 shutdown_connections 2024-09-13T02:56:25.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f60c806e300 0x7f60c80707b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:25.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60e00ff3b0 0x7f60e0196d10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:25.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 --2- 172.21.15.98:0/1954054863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e00ffd50 0x7f60e0197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:25.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 >> 172.21.15.98:0/1954054863 conn(0x7f60e00fac90 msgr2=0x7f60e00fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:25.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.526+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 shutdown_connections 2024-09-13T02:56:25.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:25.527+0000 7f60e6981700 1 -- 172.21.15.98:0/1954054863 wait complete. 2024-09-13T02:56:26.132 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T02:56:26.334 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:26.708 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:26 smithi098 ceph-mon[27886]: pgmap v93: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:26.708 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:26 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:27.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:26 smithi142 ceph-mon[33443]: pgmap v93: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:26 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:28.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.044+0000 7f758af26700 1 -- 172.21.15.98:0/2602479547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7584100e80 msgr2=0x7f7584104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:28.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.044+0000 7f758af26700 1 --2- 172.21.15.98:0/2602479547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7584100e80 0x7f7584104e50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7570009910 tx=0x7f7570009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:28.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.044+0000 7f758af26700 1 -- 172.21.15.98:0/2602479547 shutdown_connections 2024-09-13T02:56:28.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.044+0000 7f758af26700 1 --2- 172.21.15.98:0/2602479547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7584100e80 0x7f7584104e50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:28.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.044+0000 7f758af26700 1 --2- 172.21.15.98:0/2602479547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75841004e0 0x7f75841008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:28.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.044+0000 7f758af26700 1 -- 172.21.15.98:0/2602479547 >> 172.21.15.98:0/2602479547 conn(0x7f75840fbda0 msgr2=0x7f75840fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:28.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.045+0000 7f758af26700 1 -- 172.21.15.98:0/2602479547 shutdown_connections 2024-09-13T02:56:28.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.045+0000 7f758af26700 1 -- 172.21.15.98:0/2602479547 wait complete. 2024-09-13T02:56:28.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.045+0000 7f758af26700 1 Processor -- start 2024-09-13T02:56:28.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.045+0000 7f758af26700 1 -- start start 2024-09-13T02:56:28.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.045+0000 7f758af26700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:28.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.045+0000 7f758af26700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 0x7f7584073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:28.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.045+0000 7f758af26700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584073ad0 con 0x7f75841004e0 2024-09-13T02:56:28.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.045+0000 7f758af26700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584073c10 con 0x7f7584100e80 2024-09-13T02:56:28.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7588cc2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:28.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7588cc2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53022/0 (socket says 172.21.15.98:53022) 2024-09-13T02:56:28.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7588cc2700 1 -- 172.21.15.98:0/2899324455 learned_addr learned my addr 172.21.15.98:0/2899324455 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:28.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7583fff700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 0x7f7584073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:28.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7588cc2700 1 -- 172.21.15.98:0/2899324455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 msgr2=0x7f7584073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:28.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7588cc2700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 0x7f7584073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:28.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7588cc2700 1 -- 172.21.15.98:0/2899324455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700095f0 con 0x7f75841004e0 2024-09-13T02:56:28.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7588cc2700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584073050 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f757800c930 tx=0x7f757800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:28.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7581ffb700 1 -- 172.21.15.98:0/2899324455 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7578007ad0 con 0x7f75841004e0 2024-09-13T02:56:28.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7581ffb700 1 -- 172.21.15.98:0/2899324455 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7578007c30 con 0x7f75841004e0 2024-09-13T02:56:28.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75841a20e0 con 0x7f75841004e0 2024-09-13T02:56:28.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.046+0000 7f7581ffb700 1 -- 172.21.15.98:0/2899324455 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7578018610 con 0x7f75841004e0 2024-09-13T02:56:28.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.047+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75841a2440 con 0x7f75841004e0 2024-09-13T02:56:28.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.048+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7584108850 con 0x7f75841004e0 2024-09-13T02:56:28.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.048+0000 7f7581ffb700 1 -- 172.21.15.98:0/2899324455 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f757800f450 con 0x7f75841004e0 2024-09-13T02:56:28.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.048+0000 7f7581ffb700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f757406e300 0x7f75740707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:28.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.049+0000 7f7581ffb700 1 -- 172.21.15.98:0/2899324455 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f757808e270 con 0x7f75841004e0 2024-09-13T02:56:28.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.049+0000 7f7583fff700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f757406e300 0x7f75740707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:28.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.049+0000 7f7583fff700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f757406e300 0x7f75740707b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7584074840 tx=0x7f757001a040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:28.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.053+0000 7f7581ffb700 1 -- 172.21.15.98:0/2899324455 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f7578057990 con 0x7f75841004e0 2024-09-13T02:56:28.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.252+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f758404f2a0 con 0x7f75841004e0 2024-09-13T02:56:28.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.252+0000 7f7581ffb700 1 -- 172.21.15.98:0/2899324455 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v45)=0 v45) v1 ==== 163+0+0 (secure 0 0 0) 0x7f758404f2a0 con 0x7f75841004e0 2024-09-13T02:56:28.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f757406e300 msgr2=0x7f75740707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:28.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f757406e300 0x7f75740707b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7584074840 tx=0x7f757001a040 comp rx=0 tx=0).stop 2024-09-13T02:56:28.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 msgr2=0x7f7584073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:28.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584073050 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f757800c930 tx=0x7f757800ccf0 comp rx=0 tx=0).stop 2024-09-13T02:56:28.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 shutdown_connections 2024-09-13T02:56:28.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f757406e300 0x7f75740707b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:28.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584073050 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:28.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 --2- 172.21.15.98:0/2899324455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 0x7f7584073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:28.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 >> 172.21.15.98:0/2899324455 conn(0x7f75840fbda0 msgr2=0x7f75840fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:28.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 shutdown_connections 2024-09-13T02:56:28.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:28.254+0000 7f758af26700 1 -- 172.21.15.98:0/2899324455 wait complete. 2024-09-13T02:56:28.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:28 smithi098 ceph-mon[27886]: pgmap v94: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:28.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:28 smithi142 ceph-mon[33443]: pgmap v94: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:28.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T02:56:29.043 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/569140749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 msgr2=0x7f4eb40ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 --2- 172.21.15.98:0/569140749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 0x7f4eb40ff720 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009910 tx=0x7f4eb0009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/569140749 shutdown_connections 2024-09-13T02:56:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 --2- 172.21.15.98:0/569140749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4eb40ffc60 0x7f4eb410a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 --2- 172.21.15.98:0/569140749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 0x7f4eb40ff720 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:30.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/569140749 >> 172.21.15.98:0/569140749 conn(0x7f4eb40748b0 msgr2=0x7f4eb4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/569140749 shutdown_connections 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/569140749 wait complete. 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 Processor -- start 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.663+0000 7f4ebc4ac700 1 -- start start 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4ebc4ac700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 0x7f4eb4195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4ebc4ac700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4eb40ffc60 0x7f4eb4196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4ebc4ac700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4196be0 con 0x7f4eb40ff350 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4ebc4ac700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb419a970 con 0x7f4eb40ffc60 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eba248700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 0x7f4eb4195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eba248700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 0x7f4eb4195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53050/0 (socket says 172.21.15.98:53050) 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eba248700 1 -- 172.21.15.98:0/3149100760 learned_addr learned my addr 172.21.15.98:0/3149100760 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eb9a47700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4eb40ffc60 0x7f4eb4196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:30.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eba248700 1 -- 172.21.15.98:0/3149100760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4eb40ffc60 msgr2=0x7f4eb4196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eba248700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4eb40ffc60 0x7f4eb4196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eba248700 1 -- 172.21.15.98:0/3149100760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb00095f0 con 0x7f4eb40ff350 2024-09-13T02:56:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eb9a47700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4eb40ffc60 0x7f4eb4196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:56:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eba248700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 0x7f4eb4195fc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00092e0 tx=0x7f4eb000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4eab7fe700 1 -- 172.21.15.98:0/3149100760 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb001d070 con 0x7f4eb40ff350 2024-09-13T02:56:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.664+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb419abf0 con 0x7f4eb40ff350 2024-09-13T02:56:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.665+0000 7f4eab7fe700 1 -- 172.21.15.98:0/3149100760 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4eb000f460 con 0x7f4eb40ff350 2024-09-13T02:56:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.665+0000 7f4eab7fe700 1 -- 172.21.15.98:0/3149100760 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb00175f0 con 0x7f4eb40ff350 2024-09-13T02:56:30.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.665+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb419b0e0 con 0x7f4eb40ff350 2024-09-13T02:56:30.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.665+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb4107dd0 con 0x7f4eb40ff350 2024-09-13T02:56:30.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.666+0000 7f4eab7fe700 1 -- 172.21.15.98:0/3149100760 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f4eb000f5d0 con 0x7f4eb40ff350 2024-09-13T02:56:30.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.667+0000 7f4eab7fe700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4ea006e300 0x7f4ea00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:30.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.667+0000 7f4eb9a47700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4ea006e300 0x7f4ea00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:30.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.667+0000 7f4eab7fe700 1 -- 172.21.15.98:0/3149100760 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4eb008f5f0 con 0x7f4eb40ff350 2024-09-13T02:56:30.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.667+0000 7f4eb9a47700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4ea006e300 0x7f4ea00707b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4eb41975e0 tx=0x7f4ea4008040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:30.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.671+0000 7f4eab7fe700 1 -- 172.21.15.98:0/3149100760 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f4eb0058d10 con 0x7f4eb40ff350 2024-09-13T02:56:30.857 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:30 smithi098 ceph-mon[27886]: pgmap v95: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:30.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.894+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f4eb404f2a0 con 0x7f4eb40ff350 2024-09-13T02:56:30.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.894+0000 7f4eab7fe700 1 -- 172.21.15.98:0/3149100760 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v45)=0 v45) v1 ==== 135+0+0 (secure 0 0 0) 0x7f4eb005c3d0 con 0x7f4eb40ff350 2024-09-13T02:56:30.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4ea006e300 msgr2=0x7f4ea00707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:30.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4ea006e300 0x7f4ea00707b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4eb41975e0 tx=0x7f4ea4008040 comp rx=0 tx=0).stop 2024-09-13T02:56:30.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 msgr2=0x7f4eb4195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:30.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 0x7f4eb4195fc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00092e0 tx=0x7f4eb000be20 comp rx=0 tx=0).stop 2024-09-13T02:56:30.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 shutdown_connections 2024-09-13T02:56:30.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4ea006e300 0x7f4ea00707b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:30.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4eb40ff350 0x7f4eb4195fc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:30.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 --2- 172.21.15.98:0/3149100760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4eb40ffc60 0x7f4eb4196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:30.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 >> 172.21.15.98:0/3149100760 conn(0x7f4eb40748b0 msgr2=0x7f4eb4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:30.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 shutdown_connections 2024-09-13T02:56:30.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:30.897+0000 7f4ebc4ac700 1 -- 172.21.15.98:0/3149100760 wait complete. 2024-09-13T02:56:31.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:30 smithi142 ceph-mon[33443]: pgmap v95: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:31.499 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T02:56:31.701 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:32.917 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:32 smithi098 ceph-mon[27886]: pgmap v96: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:33.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:32 smithi142 ceph-mon[33443]: pgmap v96: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:33.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.160+0000 7f123cabd700 1 -- 172.21.15.98:0/2047206619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ffd60 msgr2=0x7f1238103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:33.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.160+0000 7f123cabd700 1 --2- 172.21.15.98:0/2047206619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ffd60 0x7f1238103d30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f122c009910 tx=0x7f122c009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:33.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.160+0000 7f123cabd700 1 -- 172.21.15.98:0/2047206619 shutdown_connections 2024-09-13T02:56:33.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.160+0000 7f123cabd700 1 --2- 172.21.15.98:0/2047206619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ffd60 0x7f1238103d30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:33.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.160+0000 7f123cabd700 1 --2- 172.21.15.98:0/2047206619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12380ff3c0 0x7f12380ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:33.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.160+0000 7f123cabd700 1 -- 172.21.15.98:0/2047206619 >> 172.21.15.98:0/2047206619 conn(0x7f12380fac80 msgr2=0x7f12380fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:33.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.160+0000 7f123cabd700 1 -- 172.21.15.98:0/2047206619 shutdown_connections 2024-09-13T02:56:33.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.160+0000 7f123cabd700 1 -- 172.21.15.98:0/2047206619 wait complete. 2024-09-13T02:56:33.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f123cabd700 1 Processor -- start 2024-09-13T02:56:33.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f123cabd700 1 -- start start 2024-09-13T02:56:33.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f123cabd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ff3c0 0x7f1238195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:33.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f123cabd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12380ffd60 0x7f12381963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:33.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f123cabd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1238196aa0 con 0x7f12380ff3c0 2024-09-13T02:56:33.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f123cabd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123819a830 con 0x7f12380ffd60 2024-09-13T02:56:33.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f123659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ff3c0 0x7f1238195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f123659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ff3c0 0x7f1238195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53064/0 (socket says 172.21.15.98:53064) 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f123659c700 1 -- 172.21.15.98:0/2616140927 learned_addr learned my addr 172.21.15.98:0/2616140927 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.161+0000 7f1235d9b700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12380ffd60 0x7f12381963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.162+0000 7f123659c700 1 -- 172.21.15.98:0/2616140927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12380ffd60 msgr2=0x7f12381963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.162+0000 7f123659c700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12380ffd60 0x7f12381963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.162+0000 7f123659c700 1 -- 172.21.15.98:0/2616140927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c0095f0 con 0x7f12380ff3c0 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.162+0000 7f123659c700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ff3c0 0x7f1238195e80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f122800d8d0 tx=0x7f122800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.162+0000 7f12277fe700 1 -- 172.21.15.98:0/2616140927 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12280098a0 con 0x7f12380ff3c0 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.162+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123819ab10 con 0x7f12380ff3c0 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.162+0000 7f12277fe700 1 -- 172.21.15.98:0/2616140927 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1228010460 con 0x7f12380ff3c0 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.162+0000 7f12277fe700 1 -- 172.21.15.98:0/2616140927 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f122800f5f0 con 0x7f12380ff3c0 2024-09-13T02:56:33.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.162+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123819b060 con 0x7f12380ff3c0 2024-09-13T02:56:33.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.163+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123804f2a0 con 0x7f12380ff3c0 2024-09-13T02:56:33.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.164+0000 7f12277fe700 1 -- 172.21.15.98:0/2616140927 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f1228009a00 con 0x7f12380ff3c0 2024-09-13T02:56:33.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.164+0000 7f12277fe700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f122006e300 0x7f12200707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:33.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.164+0000 7f12277fe700 1 -- 172.21.15.98:0/2616140927 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f122808df40 con 0x7f12380ff3c0 2024-09-13T02:56:33.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.164+0000 7f1235d9b700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f122006e300 0x7f12200707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:33.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.165+0000 7f1235d9b700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f122006e300 0x7f12200707b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f12381974a0 tx=0x7f122c01a040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:33.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.169+0000 7f12277fe700 1 -- 172.21.15.98:0/2616140927 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f12280c29d0 con 0x7f12380ff3c0 2024-09-13T02:56:33.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.397+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}) v1 -- 0x7f123819b390 con 0x7f122006e300 2024-09-13T02:56:33.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.403+0000 7f12277fe700 1 -- 172.21.15.98:0/2616140927 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f123819b390 con 0x7f122006e300 2024-09-13T02:56:33.404 INFO:teuthology.orchestra.run.smithi098.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f122006e300 msgr2=0x7f12200707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f122006e300 0x7f12200707b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f12381974a0 tx=0x7f122c01a040 comp rx=0 tx=0).stop 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ff3c0 msgr2=0x7f1238195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ff3c0 0x7f1238195e80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f122800d8d0 tx=0x7f122800dbe0 comp rx=0 tx=0).stop 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 shutdown_connections 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f122006e300 0x7f12200707b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12380ff3c0 0x7f1238195e80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 --2- 172.21.15.98:0/2616140927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12380ffd60 0x7f12381963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 >> 172.21.15.98:0/2616140927 conn(0x7f12380fac80 msgr2=0x7f1238068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 shutdown_connections 2024-09-13T02:56:33.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:33.405+0000 7f123cabd700 1 -- 172.21.15.98:0/2616140927 wait complete. 2024-09-13T02:56:34.200 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:56:34.201 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T02:56:34.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T02:56:34.404 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T02:56:34.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:34 smithi098 ceph-mon[27886]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:34.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:34 smithi098 ceph-mon[27886]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:56:34.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:34 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:34.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:34 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:34.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:34 smithi098 ceph-mon[27886]: pgmap v97: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:34.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:34 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:34.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:34 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:34.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:34 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:34.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:34 smithi142 ceph-mon[33443]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:34.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:34 smithi142 ceph-mon[33443]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:56:34.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:34 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:34.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:34 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:34.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:34 smithi142 ceph-mon[33443]: pgmap v97: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:34.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:34 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:34.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:34 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:34.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:34 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:35.639 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:35 smithi098 ceph-mon[27886]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:56:35.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:35 smithi142 ceph-mon[33443]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:56:36.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.556+0000 7f16cedfc700 1 -- 172.21.15.98:0/3915713679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 msgr2=0x7f16c8104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:36.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.556+0000 7f16cedfc700 1 --2- 172.21.15.98:0/3915713679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 0x7f16c8104e50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f16b800b0a0 tx=0x7f16b800b3b0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.556+0000 7f16cedfc700 1 -- 172.21.15.98:0/3915713679 shutdown_connections 2024-09-13T02:56:36.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.556+0000 7f16cedfc700 1 --2- 172.21.15.98:0/3915713679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 0x7f16c8104e50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.556+0000 7f16cedfc700 1 --2- 172.21.15.98:0/3915713679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c81004e0 0x7f16c81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.556+0000 7f16cedfc700 1 -- 172.21.15.98:0/3915713679 >> 172.21.15.98:0/3915713679 conn(0x7f16c80fbda0 msgr2=0x7f16c80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:36.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.556+0000 7f16cedfc700 1 -- 172.21.15.98:0/3915713679 shutdown_connections 2024-09-13T02:56:36.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.556+0000 7f16cedfc700 1 -- 172.21.15.98:0/3915713679 wait complete. 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16cedfc700 1 Processor -- start 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16cedfc700 1 -- start start 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16cedfc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c81004e0 0x7f16c8195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16cedfc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 0x7f16c8196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16cedfc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8196aa0 con 0x7f16c8100e80 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16cedfc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8196be0 con 0x7f16c81004e0 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16c7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 0x7f16c8196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16c7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 0x7f16c8196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52738/0 (socket says 172.21.15.98:52738) 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16c7fff700 1 -- 172.21.15.98:0/3722868602 learned_addr learned my addr 172.21.15.98:0/3722868602 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16c7fff700 1 -- 172.21.15.98:0/3722868602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c81004e0 msgr2=0x7f16c8195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:36.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16c7fff700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c81004e0 0x7f16c8195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.557+0000 7f16c7fff700 1 -- 172.21.15.98:0/3722868602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b8009d00 con 0x7f16c8100e80 2024-09-13T02:56:36.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.558+0000 7f16c7fff700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 0x7f16c8196450 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f16b8006130 tx=0x7f16b800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:36.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.558+0000 7f16c5ffb700 1 -- 172.21.15.98:0/3722868602 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16b800e040 con 0x7f16c8100e80 2024-09-13T02:56:36.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.558+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c819a9d0 con 0x7f16c8100e80 2024-09-13T02:56:36.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.558+0000 7f16c5ffb700 1 -- 172.21.15.98:0/3722868602 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16b8003de0 con 0x7f16c8100e80 2024-09-13T02:56:36.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.558+0000 7f16c5ffb700 1 -- 172.21.15.98:0/3722868602 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16b801d8e0 con 0x7f16c8100e80 2024-09-13T02:56:36.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.558+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c819aec0 con 0x7f16c8100e80 2024-09-13T02:56:36.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.559+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c8108850 con 0x7f16c8100e80 2024-09-13T02:56:36.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.559+0000 7f16c5ffb700 1 -- 172.21.15.98:0/3722868602 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f16b8004820 con 0x7f16c8100e80 2024-09-13T02:56:36.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.560+0000 7f16c5ffb700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f16b406e300 0x7f16b40707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:36.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.560+0000 7f16c5ffb700 1 -- 172.21.15.98:0/3722868602 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f16b808f9a0 con 0x7f16c8100e80 2024-09-13T02:56:36.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.560+0000 7f16ccb98700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f16b406e300 0x7f16b40707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:36.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.560+0000 7f16ccb98700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f16b406e300 0x7f16b40707b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f16c0005fd0 tx=0x7f16c0005d00 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:36.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.564+0000 7f16c5ffb700 1 -- 172.21.15.98:0/3722868602 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f16b80590c0 con 0x7f16c8100e80 2024-09-13T02:56:36.705 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:36 smithi098 ceph-mon[27886]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:36.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:36 smithi142 ceph-mon[33443]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:36.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.795+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16c8197380 con 0x7f16b406e300 2024-09-13T02:56:36.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.796+0000 7f16c5ffb700 1 -- 172.21.15.98:0/3722868602 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f16c8197380 con 0x7f16b406e300 2024-09-13T02:56:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f16b406e300 msgr2=0x7f16b40707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f16b406e300 0x7f16b40707b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f16c0005fd0 tx=0x7f16c0005d00 comp rx=0 tx=0).stop 2024-09-13T02:56:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 msgr2=0x7f16c8196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 0x7f16c8196450 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f16b8006130 tx=0x7f16b800cdd0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 shutdown_connections 2024-09-13T02:56:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f16b406e300 0x7f16b40707b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c81004e0 0x7f16c8195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 --2- 172.21.15.98:0/3722868602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16c8100e80 0x7f16c8196450 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 >> 172.21.15.98:0/3722868602 conn(0x7f16c80fbda0 msgr2=0x7f16c80fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 shutdown_connections 2024-09-13T02:56:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.799+0000 7f16cedfc700 1 -- 172.21.15.98:0/3722868602 wait complete. 2024-09-13T02:56:36.811 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:56:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.907+0000 7f4915685700 1 -- 172.21.15.98:0/1618904486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 msgr2=0x7f491010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.907+0000 7f4915685700 1 --2- 172.21.15.98:0/1618904486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 0x7f491010a6d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009910 tx=0x7f48f8009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.907+0000 7f4915685700 1 -- 172.21.15.98:0/1618904486 shutdown_connections 2024-09-13T02:56:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.907+0000 7f4915685700 1 --2- 172.21.15.98:0/1618904486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 0x7f491010a6d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.907+0000 7f4915685700 1 --2- 172.21.15.98:0/1618904486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100ff350 0x7f49100ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.907+0000 7f4915685700 1 -- 172.21.15.98:0/1618904486 >> 172.21.15.98:0/1618904486 conn(0x7f49100748b0 msgr2=0x7f4910074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.907+0000 7f4915685700 1 -- 172.21.15.98:0/1618904486 shutdown_connections 2024-09-13T02:56:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.907+0000 7f4915685700 1 -- 172.21.15.98:0/1618904486 wait complete. 2024-09-13T02:56:36.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.907+0000 7f4915685700 1 Processor -- start 2024-09-13T02:56:36.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f4915685700 1 -- start start 2024-09-13T02:56:36.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f4915685700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100ff350 0x7f4910100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:36.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f4915685700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 0x7f4910100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:36.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f4915685700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4910100fb0 con 0x7f49100ffc60 2024-09-13T02:56:36.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f4915685700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49101010f0 con 0x7f49100ff350 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f490e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 0x7f4910100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f490e7fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 0x7f4910100a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52756/0 (socket says 172.21.15.98:52756) 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f490e7fc700 1 -- 172.21.15.98:0/3034254447 learned_addr learned my addr 172.21.15.98:0/3034254447 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f490e7fc700 1 -- 172.21.15.98:0/3034254447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100ff350 msgr2=0x7f4910100530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f490effd700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100ff350 0x7f4910100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f490e7fc700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100ff350 0x7f4910100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f490e7fc700 1 -- 172.21.15.98:0/3034254447 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f80095f0 con 0x7f49100ffc60 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.908+0000 7f490e7fc700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 0x7f4910100a70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f48f8006010 tx=0x7f48f800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.909+0000 7f4907fff700 1 -- 172.21.15.98:0/3034254447 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48f801d070 con 0x7f49100ffc60 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.909+0000 7f4907fff700 1 -- 172.21.15.98:0/3034254447 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48f800f460 con 0x7f49100ffc60 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.909+0000 7f4907fff700 1 -- 172.21.15.98:0/3034254447 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48f8017630 con 0x7f49100ffc60 2024-09-13T02:56:36.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.909+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4910101370 con 0x7f49100ffc60 2024-09-13T02:56:36.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.909+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49101a23b0 con 0x7f49100ffc60 2024-09-13T02:56:36.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.910+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910107dd0 con 0x7f49100ffc60 2024-09-13T02:56:36.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.910+0000 7f4907fff700 1 -- 172.21.15.98:0/3034254447 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f48f800f5d0 con 0x7f49100ffc60 2024-09-13T02:56:36.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.911+0000 7f4907fff700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f48fc06e300 0x7f48fc0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:36.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.911+0000 7f4907fff700 1 -- 172.21.15.98:0/3034254447 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f48f808f690 con 0x7f49100ffc60 2024-09-13T02:56:36.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.911+0000 7f490effd700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f48fc06e300 0x7f48fc0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:36.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.911+0000 7f490effd700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f48fc06e300 0x7f48fc0707b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4900009550 tx=0x7f4900009040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:36.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:36.915+0000 7f4907fff700 1 -- 172.21.15.98:0/3034254447 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f48f8058d90 con 0x7f49100ffc60 2024-09-13T02:56:37.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.144+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4910061190 con 0x7f48fc06e300 2024-09-13T02:56:37.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.145+0000 7f4907fff700 1 -- 172.21.15.98:0/3034254447 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f4910061190 con 0x7f48fc06e300 2024-09-13T02:56:37.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.147+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f48fc06e300 msgr2=0x7f48fc0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.147+0000 7f4915685700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f48fc06e300 0x7f48fc0707b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4900009550 tx=0x7f4900009040 comp rx=0 tx=0).stop 2024-09-13T02:56:37.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.147+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 msgr2=0x7f4910100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.147+0000 7f4915685700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 0x7f4910100a70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f48f8006010 tx=0x7f48f800be20 comp rx=0 tx=0).stop 2024-09-13T02:56:37.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.147+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 shutdown_connections 2024-09-13T02:56:37.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.147+0000 7f4915685700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f48fc06e300 0x7f48fc0707b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.147+0000 7f4915685700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49100ff350 0x7f4910100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.147+0000 7f4915685700 1 --2- 172.21.15.98:0/3034254447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f49100ffc60 0x7f4910100a70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.147+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 >> 172.21.15.98:0/3034254447 conn(0x7f49100748b0 msgr2=0x7f4910104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:37.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.148+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 shutdown_connections 2024-09-13T02:56:37.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.148+0000 7f4915685700 1 -- 172.21.15.98:0/3034254447 wait complete. 2024-09-13T02:56:37.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.253+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2454822328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ffd60 msgr2=0x7f92e8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.253+0000 7f92ed3c4700 1 --2- 172.21.15.98:0/2454822328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ffd60 0x7f92e8103d30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009910 tx=0x7f92d8009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.253+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2454822328 shutdown_connections 2024-09-13T02:56:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.253+0000 7f92ed3c4700 1 --2- 172.21.15.98:0/2454822328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ffd60 0x7f92e8103d30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.253+0000 7f92ed3c4700 1 --2- 172.21.15.98:0/2454822328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80ff3c0 0x7f92e80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.253+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2454822328 >> 172.21.15.98:0/2454822328 conn(0x7f92e80fac80 msgr2=0x7f92e80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.253+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2454822328 shutdown_connections 2024-09-13T02:56:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.253+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2454822328 wait complete. 2024-09-13T02:56:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92ed3c4700 1 Processor -- start 2024-09-13T02:56:37.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92ed3c4700 1 -- start start 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92ed3c4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ff3c0 0x7f92e8100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92ed3c4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80ffd60 0x7f92e8101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92ed3c4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8101850 con 0x7f92e80ff3c0 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92ed3c4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8101990 con 0x7f92e80ffd60 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92e6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ff3c0 0x7f92e8100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92e6ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ff3c0 0x7f92e8100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52778/0 (socket says 172.21.15.98:52778) 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92e6ffd700 1 -- 172.21.15.98:0/2074896695 learned_addr learned my addr 172.21.15.98:0/2074896695 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.254+0000 7f92e67fc700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80ffd60 0x7f92e8101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92e6ffd700 1 -- 172.21.15.98:0/2074896695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80ffd60 msgr2=0x7f92e8101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92e6ffd700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80ffd60 0x7f92e8101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92e6ffd700 1 -- 172.21.15.98:0/2074896695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80095f0 con 0x7f92e80ff3c0 2024-09-13T02:56:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92e67fc700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80ffd60 0x7f92e8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:56:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92e6ffd700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ff3c0 0x7f92e8100dd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00d8d0 tx=0x7f92dc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92cffff700 1 -- 172.21.15.98:0/2074896695 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92dc009940 con 0x7f92e80ff3c0 2024-09-13T02:56:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e81a2120 con 0x7f92e80ff3c0 2024-09-13T02:56:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92cffff700 1 -- 172.21.15.98:0/2074896695 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92dc010460 con 0x7f92e80ff3c0 2024-09-13T02:56:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92cffff700 1 -- 172.21.15.98:0/2074896695 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92dc00f5f0 con 0x7f92e80ff3c0 2024-09-13T02:56:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.255+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e81a2530 con 0x7f92e80ff3c0 2024-09-13T02:56:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.256+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e8108740 con 0x7f92e80ff3c0 2024-09-13T02:56:37.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.256+0000 7f92cffff700 1 -- 172.21.15.98:0/2074896695 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f92dc0105d0 con 0x7f92e80ff3c0 2024-09-13T02:56:37.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.257+0000 7f92cffff700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f92d006e300 0x7f92d00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:37.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.257+0000 7f92cffff700 1 -- 172.21.15.98:0/2074896695 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f92dc08e070 con 0x7f92e80ff3c0 2024-09-13T02:56:37.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.257+0000 7f92e67fc700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f92d006e300 0x7f92d00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:37.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.257+0000 7f92e67fc700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f92d006e300 0x7f92d00707b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92e81025c0 tx=0x7f92d801a040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:37.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.261+0000 7f92cffff700 1 -- 172.21.15.98:0/2074896695 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f92dc057790 con 0x7f92e80ff3c0 2024-09-13T02:56:37.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.480+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f92e8061190 con 0x7f92d006e300 2024-09-13T02:56:37.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.489+0000 7f92cffff700 1 -- 172.21.15.98:0/2074896695 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f92e8061190 con 0x7f92d006e300 2024-09-13T02:56:37.491 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:56:37.491 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (87s) 59s ago 12m 13.8M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (12m) 59s ago 12m 7986k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (11m) 2m ago 11m 7486k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (12m) 59s ago 12m 6665k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (11m) 2m ago 11m 6669k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (65s) 59s ago 11m 47.1M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (6m) 59s ago 6m 94.4M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (6m) 59s ago 6m 154M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (6m) 2m ago 6m 14.3M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (6m) 2m ago 6m 17.4M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (3m) 59s ago 13m 504M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (2m) 2m ago 11m 437M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (13m) 59s ago 13m 59.2M 2048M 18.2.0 dc2bc1663786 19714ab6c54b 2024-09-13T02:56:37.492 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (11m) 2m ago 11m 42.6M 2048M 18.2.0 dc2bc1663786 1f9ae4541346 2024-09-13T02:56:37.493 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (2m) 59s ago 12m 16.6M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:56:37.493 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (2m) 2m ago 11m 3670k - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:56:37.493 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (10m) 59s ago 10m 213M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:56:37.493 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (9m) 59s ago 9m 222M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:56:37.493 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (9m) 59s ago 9m 184M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:56:37.493 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (9m) 2m ago 8m 232M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:56:37.493 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (8m) 2m ago 8m 207M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:56:37.493 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (8m) 2m ago 8m 187M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:56:37.493 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (102s) 59s ago 11m 60.2M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f92d006e300 msgr2=0x7f92d00707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f92d006e300 0x7f92d00707b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92e81025c0 tx=0x7f92d801a040 comp rx=0 tx=0).stop 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ff3c0 msgr2=0x7f92e8100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ff3c0 0x7f92e8100dd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00d8d0 tx=0x7f92dc00dc90 comp rx=0 tx=0).stop 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 shutdown_connections 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f92d006e300 0x7f92d00707b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92e80ff3c0 0x7f92e8100dd0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 --2- 172.21.15.98:0/2074896695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e80ffd60 0x7f92e8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 >> 172.21.15.98:0/2074896695 conn(0x7f92e80fac80 msgr2=0x7f92e8069050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 shutdown_connections 2024-09-13T02:56:37.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.492+0000 7f92ed3c4700 1 -- 172.21.15.98:0/2074896695 wait complete. 2024-09-13T02:56:37.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 -- 172.21.15.98:0/3035457811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc8100e60 msgr2=0x7f4bc8104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 --2- 172.21.15.98:0/3035457811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc8100e60 0x7f4bc8104e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009910 tx=0x7f4bb4009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:37.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 -- 172.21.15.98:0/3035457811 shutdown_connections 2024-09-13T02:56:37.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 --2- 172.21.15.98:0/3035457811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc8100e60 0x7f4bc8104e30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 --2- 172.21.15.98:0/3035457811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bc81004c0 0x7f4bc8100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 -- 172.21.15.98:0/3035457811 >> 172.21.15.98:0/3035457811 conn(0x7f4bc80fbd80 msgr2=0x7f4bc80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:37.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 -- 172.21.15.98:0/3035457811 shutdown_connections 2024-09-13T02:56:37.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 -- 172.21.15.98:0/3035457811 wait complete. 2024-09-13T02:56:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 Processor -- start 2024-09-13T02:56:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.603+0000 7f4bcedd9700 1 -- start start 2024-09-13T02:56:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bcedd9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81004c0 0x7f4bc8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bcedd9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bc8100e60 0x7f4bc8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bcedd9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc8073ad0 con 0x7f4bc81004c0 2024-09-13T02:56:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bcedd9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc8073c10 con 0x7f4bc8100e60 2024-09-13T02:56:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bccb75700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81004c0 0x7f4bc8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bccb75700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81004c0 0x7f4bc8073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52796/0 (socket says 172.21.15.98:52796) 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bccb75700 1 -- 172.21.15.98:0/4200489707 learned_addr learned my addr 172.21.15.98:0/4200489707 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bc7fff700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bc8100e60 0x7f4bc8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bccb75700 1 -- 172.21.15.98:0/4200489707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bc8100e60 msgr2=0x7f4bc8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bccb75700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bc8100e60 0x7f4bc8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bccb75700 1 -- 172.21.15.98:0/4200489707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb40095f0 con 0x7f4bc81004c0 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bccb75700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81004c0 0x7f4bc8073050 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c8a0 tx=0x7f4bbc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bc5ffb700 1 -- 172.21.15.98:0/4200489707 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bbc0078e0 con 0x7f4bc81004c0 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.604+0000 7f4bc5ffb700 1 -- 172.21.15.98:0/4200489707 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bbc00f450 con 0x7f4bc81004c0 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.605+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc81a20c0 con 0x7f4bc81004c0 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.605+0000 7f4bc5ffb700 1 -- 172.21.15.98:0/4200489707 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bbc00e5e0 con 0x7f4bc81004c0 2024-09-13T02:56:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.605+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc81a24d0 con 0x7f4bc81004c0 2024-09-13T02:56:37.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.606+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc8108830 con 0x7f4bc81004c0 2024-09-13T02:56:37.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.606+0000 7f4bc5ffb700 1 -- 172.21.15.98:0/4200489707 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f4bbc00f5c0 con 0x7f4bc81004c0 2024-09-13T02:56:37.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.607+0000 7f4bc5ffb700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4bb806e300 0x7f4bb80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:37.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.607+0000 7f4bc5ffb700 1 -- 172.21.15.98:0/4200489707 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4bbc08e120 con 0x7f4bc81004c0 2024-09-13T02:56:37.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.607+0000 7f4bc7fff700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4bb806e300 0x7f4bb80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:37.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.607+0000 7f4bc7fff700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4bb806e300 0x7f4bb80707b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8074840 tx=0x7f4bb401a040 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:37.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.612+0000 7f4bc5ffb700 1 -- 172.21.15.98:0/4200489707 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f4bbc0577a0 con 0x7f4bc81004c0 2024-09-13T02:56:37.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.907+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4bc8108210 con 0x7f4bc81004c0 2024-09-13T02:56:37.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.908+0000 7f4bc5ffb700 1 -- 172.21.15.98:0/4200489707 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f4bbc05ae60 con 0x7f4bc81004c0 2024-09-13T02:56:37.909 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:56:37.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:56:37.911 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:56:37.911 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-13T02:56:37.911 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:37.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:56:37.911 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:56:37.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4bb806e300 msgr2=0x7f4bb80707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4bb806e300 0x7f4bb80707b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8074840 tx=0x7f4bb401a040 comp rx=0 tx=0).stop 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81004c0 msgr2=0x7f4bc8073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81004c0 0x7f4bc8073050 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c8a0 tx=0x7f4bbc00cbb0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 shutdown_connections 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f4bb806e300 0x7f4bb80707b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bc81004c0 0x7f4bc8073050 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 --2- 172.21.15.98:0/4200489707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bc8100e60 0x7f4bc8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 >> 172.21.15.98:0/4200489707 conn(0x7f4bc80fbd80 msgr2=0x7f4bc80fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 shutdown_connections 2024-09-13T02:56:37.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:37.910+0000 7f4bcedd9700 1 -- 172.21.15.98:0/4200489707 wait complete. 2024-09-13T02:56:38.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.018+0000 7ff620ee5700 1 -- 172.21.15.98:0/3930323393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c104130 msgr2=0x7ff61c104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.018+0000 7ff620ee5700 1 --2- 172.21.15.98:0/3930323393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c104130 0x7ff61c104500 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009910 tx=0x7ff60c009c20 comp rx=0 tx=0).stop 2024-09-13T02:56:38.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.018+0000 7ff620ee5700 1 -- 172.21.15.98:0/3930323393 shutdown_connections 2024-09-13T02:56:38.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.018+0000 7ff620ee5700 1 --2- 172.21.15.98:0/3930323393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff61c0ffbd0 0x7ff61c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.018+0000 7ff620ee5700 1 --2- 172.21.15.98:0/3930323393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c104130 0x7ff61c104500 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.018+0000 7ff620ee5700 1 -- 172.21.15.98:0/3930323393 >> 172.21.15.98:0/3930323393 conn(0x7ff61c075130 msgr2=0x7ff61c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:38.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.018+0000 7ff620ee5700 1 -- 172.21.15.98:0/3930323393 shutdown_connections 2024-09-13T02:56:38.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.018+0000 7ff620ee5700 1 -- 172.21.15.98:0/3930323393 wait complete. 2024-09-13T02:56:38.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.019+0000 7ff620ee5700 1 Processor -- start 2024-09-13T02:56:38.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.019+0000 7ff620ee5700 1 -- start start 2024-09-13T02:56:38.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.019+0000 7ff620ee5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c0ffbd0 0x7ff61c196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:38.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff620ee5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff61c104130 0x7ff61c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff620ee5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c197810 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff620ee5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c197950 con 0x7ff61c104130 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff61a59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c0ffbd0 0x7ff61c196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff61a59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c0ffbd0 0x7ff61c196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52814/0 (socket says 172.21.15.98:52814) 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff61a59c700 1 -- 172.21.15.98:0/878758796 learned_addr learned my addr 172.21.15.98:0/878758796 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff619d9b700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff61c104130 0x7ff61c1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff61a59c700 1 -- 172.21.15.98:0/878758796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff61c104130 msgr2=0x7ff61c1971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff61a59c700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff61c104130 0x7ff61c1971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff61a59c700 1 -- 172.21.15.98:0/878758796 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0095f0 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff61a59c700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c0ffbd0 0x7ff61c196cb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff60c000c00 tx=0x7ff60c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff60b7fe700 1 -- 172.21.15.98:0/878758796 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff60c01d070 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff60b7fe700 1 -- 172.21.15.98:0/878758796 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff60c00f460 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c19fd20 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.020+0000 7ff60b7fe700 1 -- 172.21.15.98:0/878758796 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff60c005e20 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.021+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c1a0130 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.022+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c1076a0 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.022+0000 7ff60b7fe700 1 -- 172.21.15.98:0/878758796 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7ff60c00f5d0 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.023+0000 7ff60b7fe700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff60406e300 0x7ff6040707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:38.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.023+0000 7ff60b7fe700 1 -- 172.21.15.98:0/878758796 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff60c08f450 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.023+0000 7ff619d9b700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff60406e300 0x7ff6040707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:38.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.023+0000 7ff619d9b700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff60406e300 0x7ff6040707b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff610005950 tx=0x7ff6100058e0 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:38.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.028+0000 7ff60b7fe700 1 -- 172.21.15.98:0/878758796 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff60c058cb0 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.276+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff61c04f2a0 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.277+0000 7ff60b7fe700 1 -- 172.21.15.98:0/878758796 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1850 (secure 0 0 0) 0x7ff60c05c370 con 0x7ff61c0ffbd0 2024-09-13T02:56:38.278 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T02:56:38.279 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T02:56:38.280 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:38.281 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:38.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff60406e300 msgr2=0x7ff6040707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff60406e300 0x7ff6040707b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff610005950 tx=0x7ff6100058e0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c0ffbd0 msgr2=0x7ff61c196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c0ffbd0 0x7ff61c196cb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff60c000c00 tx=0x7ff60c00be20 comp rx=0 tx=0).stop 2024-09-13T02:56:38.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 shutdown_connections 2024-09-13T02:56:38.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7ff60406e300 0x7ff6040707b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff61c0ffbd0 0x7ff61c196cb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 --2- 172.21.15.98:0/878758796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff61c104130 0x7ff61c1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 >> 172.21.15.98:0/878758796 conn(0x7ff61c075130 msgr2=0x7ff61c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:38.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.280+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 shutdown_connections 2024-09-13T02:56:38.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.281+0000 7ff620ee5700 1 -- 172.21.15.98:0/878758796 wait complete. 2024-09-13T02:56:38.283 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:56:38.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.389+0000 7f0576bf0700 1 -- 172.21.15.98:0/2996988340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 msgr2=0x7f0570104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.389+0000 7f0576bf0700 1 --2- 172.21.15.98:0/2996988340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 0x7f0570104500 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f056800b0a0 tx=0x7f056800b3b0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.389+0000 7f0576bf0700 1 -- 172.21.15.98:0/2996988340 shutdown_connections 2024-09-13T02:56:38.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.389+0000 7f0576bf0700 1 --2- 172.21.15.98:0/2996988340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05700ffbd0 0x7f0570100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.389+0000 7f0576bf0700 1 --2- 172.21.15.98:0/2996988340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 0x7f0570104500 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.389+0000 7f0576bf0700 1 -- 172.21.15.98:0/2996988340 >> 172.21.15.98:0/2996988340 conn(0x7f0570075130 msgr2=0x7f0570075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.389+0000 7f0576bf0700 1 -- 172.21.15.98:0/2996988340 shutdown_connections 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.389+0000 7f0576bf0700 1 -- 172.21.15.98:0/2996988340 wait complete. 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f0576bf0700 1 Processor -- start 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f0576bf0700 1 -- start start 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f0576bf0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05700ffbd0 0x7f05701981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f0576bf0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 0x7f0570198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f0576bf0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570198df0 con 0x7f0570104130 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f0576bf0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057019cb80 con 0x7f05700ffbd0 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f056ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 0x7f0570198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f056ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 0x7f0570198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52838/0 (socket says 172.21.15.98:52838) 2024-09-13T02:56:38.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f056ffff700 1 -- 172.21.15.98:0/1560846642 learned_addr learned my addr 172.21.15.98:0/1560846642 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f057498c700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05700ffbd0 0x7f05701981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f056ffff700 1 -- 172.21.15.98:0/1560846642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05700ffbd0 msgr2=0x7f05701981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f056ffff700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05700ffbd0 0x7f05701981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f056ffff700 1 -- 172.21.15.98:0/1560846642 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009d00 con 0x7f0570104130 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f057498c700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05700ffbd0 0x7f05701981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.390+0000 7f056ffff700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 0x7f0570198710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f056000b4b0 tx=0x7f056000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.391+0000 7f056dffb700 1 -- 172.21.15.98:0/1560846642 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0560011800 con 0x7f0570104130 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.391+0000 7f056dffb700 1 -- 172.21.15.98:0/1560846642 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0560011e20 con 0x7f0570104130 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.391+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057019ce60 con 0x7f0570104130 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.391+0000 7f056dffb700 1 -- 172.21.15.98:0/1560846642 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056000f2e0 con 0x7f0570104130 2024-09-13T02:56:38.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.391+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057019d3b0 con 0x7f0570104130 2024-09-13T02:56:38.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.392+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057004f2a0 con 0x7f0570104130 2024-09-13T02:56:38.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.392+0000 7f056dffb700 1 -- 172.21.15.98:0/1560846642 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f0560010380 con 0x7f0570104130 2024-09-13T02:56:38.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.393+0000 7f056dffb700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f055c06e300 0x7f055c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:38.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.393+0000 7f056dffb700 1 -- 172.21.15.98:0/1560846642 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f056008db70 con 0x7f0570104130 2024-09-13T02:56:38.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.393+0000 7f057498c700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f055c06e300 0x7f055c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:38.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.393+0000 7f057498c700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f055c06e300 0x7f055c0707b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f05680062a0 tx=0x7f0568006210 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:38.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.398+0000 7f056dffb700 1 -- 172.21.15.98:0/1560846642 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f05600573c0 con 0x7f0570104130 2024-09-13T02:56:38.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.619+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 --> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f057019d6f0 con 0x7f055c06e300 2024-09-13T02:56:38.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:38.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:38.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:38.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: Upgrade: Target is version 19.1.1-322-g7741f7f9 (squid) 2024-09-13T02:56:38.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d'] 2024-09-13T02:56:38.621 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:38.622 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:38.622 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: Upgrade: Setting container_image for all mgr 2024-09-13T02:56:38.622 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:38.622 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:56:38.622 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:38.622 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:38.622 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/4200489707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:38.622 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:38 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/878758796' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.620+0000 7f056dffb700 1 -- 172.21.15.98:0/1560846642 <== mgr.14644 v2:172.21.15.98:6800/2032110974 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f057019d6f0 con 0x7f055c06e300 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr" 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "2/23 daemons upgraded", 2024-09-13T02:56:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T02:56:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:56:38.624 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:56:38.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f055c06e300 msgr2=0x7f055c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f055c06e300 0x7f055c0707b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f05680062a0 tx=0x7f0568006210 comp rx=0 tx=0).stop 2024-09-13T02:56:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 msgr2=0x7f0570198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 0x7f0570198710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f056000b4b0 tx=0x7f056000b870 comp rx=0 tx=0).stop 2024-09-13T02:56:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 shutdown_connections 2024-09-13T02:56:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f055c06e300 0x7f055c0707b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05700ffbd0 0x7f05701981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 --2- 172.21.15.98:0/1560846642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0570104130 0x7f0570198710 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 >> 172.21.15.98:0/1560846642 conn(0x7f0570075130 msgr2=0x7f0570068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 shutdown_connections 2024-09-13T02:56:38.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.622+0000 7f0576bf0700 1 -- 172.21.15.98:0/1560846642 wait complete. 2024-09-13T02:56:38.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.730+0000 7f75f784a700 1 -- 172.21.15.98:0/823734569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100460 msgr2=0x7f75f0100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.730+0000 7f75f784a700 1 --2- 172.21.15.98:0/823734569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100460 0x7f75f0100830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009940 tx=0x7f75ec009c50 comp rx=0 tx=0).stop 2024-09-13T02:56:38.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.730+0000 7f75f784a700 1 -- 172.21.15.98:0/823734569 shutdown_connections 2024-09-13T02:56:38.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.730+0000 7f75f784a700 1 --2- 172.21.15.98:0/823734569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f0100d70 0x7f75f01094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.730+0000 7f75f784a700 1 --2- 172.21.15.98:0/823734569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100460 0x7f75f0100830 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.730+0000 7f75f784a700 1 -- 172.21.15.98:0/823734569 >> 172.21.15.98:0/823734569 conn(0x7f75f00748b0 msgr2=0x7f75f0074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:38.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.730+0000 7f75f784a700 1 -- 172.21.15.98:0/823734569 shutdown_connections 2024-09-13T02:56:38.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.730+0000 7f75f784a700 1 -- 172.21.15.98:0/823734569 wait complete. 2024-09-13T02:56:38.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.731+0000 7f75f784a700 1 Processor -- start 2024-09-13T02:56:38.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.731+0000 7f75f784a700 1 -- start start 2024-09-13T02:56:38.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.731+0000 7f75f784a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f0100460 0x7f75f0194f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:38.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.731+0000 7f75f784a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100d70 0x7f75f0195440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:38.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.731+0000 7f75f784a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0195b20 con 0x7f75f0100d70 2024-09-13T02:56:38.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.731+0000 7f75f784a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f01998b0 con 0x7f75f0100460 2024-09-13T02:56:38.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.731+0000 7f75f4de5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100d70 0x7f75f0195440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:38.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.731+0000 7f75f4de5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100d70 0x7f75f0195440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52854/0 (socket says 172.21.15.98:52854) 2024-09-13T02:56:38.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.731+0000 7f75f4de5700 1 -- 172.21.15.98:0/4034692059 learned_addr learned my addr 172.21.15.98:0/4034692059 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:56:38.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75f55e6700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f0100460 0x7f75f0194f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:38.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75f4de5700 1 -- 172.21.15.98:0/4034692059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f0100460 msgr2=0x7f75f0194f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:38.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75f4de5700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f0100460 0x7f75f0194f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:38.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75f4de5700 1 -- 172.21.15.98:0/4034692059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec0095f0 con 0x7f75f0100d70 2024-09-13T02:56:38.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75f4de5700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100d70 0x7f75f0195440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75e000b4b0 tx=0x7f75e000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:38.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75e67fc700 1 -- 172.21.15.98:0/4034692059 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e0011800 con 0x7f75f0100d70 2024-09-13T02:56:38.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f0199b90 con 0x7f75f0100d70 2024-09-13T02:56:38.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75e67fc700 1 -- 172.21.15.98:0/4034692059 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75e0011e20 con 0x7f75f0100d70 2024-09-13T02:56:38.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75e67fc700 1 -- 172.21.15.98:0/4034692059 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75e000f2e0 con 0x7f75f0100d70 2024-09-13T02:56:38.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.732+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f019a0e0 con 0x7f75f0100d70 2024-09-13T02:56:38.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.733+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f0106bd0 con 0x7f75f0100d70 2024-09-13T02:56:38.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.734+0000 7f75e67fc700 1 -- 172.21.15.98:0/4034692059 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 33) v1 ==== 92404+0+0 (secure 0 0 0) 0x7f75e000f510 con 0x7f75f0100d70 2024-09-13T02:56:38.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.734+0000 7f75e67fc700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f75dc06e300 0x7f75dc0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:38.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.734+0000 7f75e67fc700 1 -- 172.21.15.98:0/4034692059 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f75e008db60 con 0x7f75f0100d70 2024-09-13T02:56:38.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.734+0000 7f75f55e6700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f75dc06e300 0x7f75dc0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:38.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.735+0000 7f75f55e6700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f75dc06e300 0x7f75dc0707b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75ec006010 tx=0x7f75ec00b970 comp rx=0 tx=0).ready entity=mgr.14644 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:38.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:38.739+0000 7f75e67fc700 1 -- 172.21.15.98:0/4034692059 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f75e0057280 con 0x7f75f0100d70 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: Upgrade: Target is version 19.1.1-322-g7741f7f9 (squid) 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d'] 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: Upgrade: Setting container_image for all mgr 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:38.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:56:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/4200489707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:38.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:38 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/878758796' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:39.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.039+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f75f0196290 con 0x7f75f0100d70 2024-09-13T02:56:39.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.039+0000 7f75e67fc700 1 -- 172.21.15.98:0/4034692059 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f75e005a940 con 0x7f75f0100d70 2024-09-13T02:56:39.041 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T02:56:39.041 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:56:39.041 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:56:39.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f75dc06e300 msgr2=0x7f75dc0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:39.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f75dc06e300 0x7f75dc0707b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75ec006010 tx=0x7f75ec00b970 comp rx=0 tx=0).stop 2024-09-13T02:56:39.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100d70 msgr2=0x7f75f0195440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:39.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100d70 0x7f75f0195440 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75e000b4b0 tx=0x7f75e000b7c0 comp rx=0 tx=0).stop 2024-09-13T02:56:39.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 shutdown_connections 2024-09-13T02:56:39.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:6800/2032110974,v1:172.21.15.98:6801/2032110974] conn(0x7f75dc06e300 0x7f75dc0707b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:39.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75f0100460 0x7f75f0194f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:39.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 --2- 172.21.15.98:0/4034692059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75f0100d70 0x7f75f0195440 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:39.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 >> 172.21.15.98:0/4034692059 conn(0x7f75f00748b0 msgr2=0x7f75f0103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:39.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 shutdown_connections 2024-09-13T02:56:39.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:56:39.041+0000 7f75f784a700 1 -- 172.21.15.98:0/4034692059 wait complete. 2024-09-13T02:56:39.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:39 smithi142 ceph-mon[33443]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:39.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:39 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:39.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:39 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:56:39.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:39 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:56:39.712 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:39 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:39.712 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:39 smithi142 ceph-mon[33443]: from='client.? 172.21.15.98:0/4034692059' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:39.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:39 smithi098 ceph-mon[27886]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:39.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:39 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:39.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:39 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:56:39.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:39 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:56:39.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:39 smithi098 ceph-mon[27886]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:39.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:39 smithi098 ceph-mon[27886]: from='client.? 172.21.15.98:0/4034692059' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:40.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:40 smithi098 ceph-mon[27886]: Upgrade: Updating mon.smithi098 2024-09-13T02:56:40.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:40 smithi098 ceph-mon[27886]: Deploying daemon mon.smithi098 on smithi098 2024-09-13T02:56:40.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:40 smithi098 ceph-mon[27886]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:40.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:40 smithi098 systemd[1]: Stopping Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:56:40.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:40 smithi142 ceph-mon[33443]: Upgrade: Updating mon.smithi098 2024-09-13T02:56:40.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:40 smithi142 ceph-mon[33443]: Deploying daemon mon.smithi098 on smithi098 2024-09-13T02:56:40.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:40 smithi142 ceph-mon[33443]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:56:40.914 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:40 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[27882]: 2024-09-13T02:56:40.646+0000 7f5c51c23700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi098 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:56:41.155 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:40 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[27882]: 2024-09-13T02:56:40.646+0000 7f5c51c23700 -1 mon.smithi098@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T02:56:41.190 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:40 smithi098 podman[87154]: 2024-09-13 02:56:40.912978283 +0000 UTC m=+0.365722433 container died 19714ab6c54b070612134b22b1702980c84286be172daf17b42cc7f0d02ac390 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T02:56:41.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:41 smithi098 podman[87154]: 2024-09-13 02:56:41.279912634 +0000 UTC m=+0.732656778 container cleanup 19714ab6c54b070612134b22b1702980c84286be172daf17b42cc7f0d02ac390 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, RELEASE=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True) 2024-09-13T02:56:41.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:41 smithi098 bash[87154]: ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098 2024-09-13T02:56:41.932 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:41 smithi098 podman[87176]: 2024-09-13 02:56:41.556803168 +0000 UTC m=+0.646926657 container remove 19714ab6c54b070612134b22b1702980c84286be172daf17b42cc7f0d02ac390 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=HEAD, ceph=True, io.buildah.version=1.29.1, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212) 2024-09-13T02:56:41.932 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:41 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098.service: Deactivated successfully. 2024-09-13T02:56:41.932 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:41 smithi098 systemd[1]: Stopped Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:56:41.932 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:41 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098.service: Consumed 13.841s CPU time. 2024-09-13T02:56:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:41 smithi098 systemd[1]: Starting Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:56:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 podman[87306]: 2024-09-13 02:56:42.043151402 +0000 UTC m=+0.015825268 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:56:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 podman[87306]: 2024-09-13 02:56:42.1415795 +0000 UTC m=+0.114253406 container create b700160bc33dc36f1dcae45f1e068d246e66d4ab04601528a6d5238ce5118c14 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, RELEASE=squid-7741f7f, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T02:56:42.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 podman[87306]: 2024-09-13 02:56:42.369506439 +0000 UTC m=+0.342180292 container init b700160bc33dc36f1dcae45f1e068d246e66d4ab04601528a6d5238ce5118c14 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T02:56:42.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 podman[87306]: 2024-09-13 02:56:42.372752889 +0000 UTC m=+0.345426743 container start b700160bc33dc36f1dcae45f1e068d246e66d4ab04601528a6d5238ce5118c14 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T02:56:42.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T02:56:42.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable), process ceph-mon, pid 2 2024-09-13T02:56:42.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: pidfile_write: ignore empty --pid-file 2024-09-13T02:56:42.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: load: jerasure load: lrc 2024-09-13T02:56:42.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: RocksDB version: 7.9.2 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Git sha 0 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Compile date 2024-09-12 19:43:04 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: DB SUMMARY 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: DB Session ID: ZI41XJ5RSWYRA8QDE4PQ 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: CURRENT file: CURRENT 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1509 Bytes 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi098/store.db dir, Total Num: 1, files: 000032.sst 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi098/store.db: 000030.log size: 3369214 ; 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.error_if_exists: 0 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.create_if_missing: 0 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.paranoid_checks: 1 2024-09-13T02:56:42.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T02:56:42.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T02:56:42.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T02:56:42.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.env: 0x55dbf8e5f940 2024-09-13T02:56:42.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T02:56:42.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.info_log: 0x55dbfa7e98c0 2024-09-13T02:56:42.736 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T02:56:42.737 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.statistics: (nil) 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.use_fsync: 0 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_log_file_size: 0 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.allow_fallocate: 1 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.use_direct_reads: 0 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T02:56:42.738 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.db_log_dir: 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.wal_dir: 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.write_buffer_manager: 0x55dbfa7f8dc0 2024-09-13T02:56:42.739 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.unordered_write: 0 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T02:56:42.740 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.row_cache: None 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.wal_filter: None 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.two_write_queues: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.wal_compression: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.atomic_flush: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.log_readahead_size: 0 2024-09-13T02:56:42.741 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_background_jobs: 2 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_background_compactions: -1 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_subcompactions: 1 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T02:56:42.742 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_open_files: -1 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T02:56:42.743 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_background_flushes: -1 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Compression algorithms supported: 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: kZSTD supported: 0 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: kXpressCompression supported: 0 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: kBZip2Compression supported: 0 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: kLZ4Compression supported: 1 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: kZlibCompression supported: 1 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: kSnappyCompression supported: 1 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T02:56:42.744 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000015 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.merge_operator: 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_filter: None 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dbfa7e9520) 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: cache_index_and_filter_blocks: 1 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T02:56:42.745 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: pin_top_level_index_and_filter: 1 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: index_type: 0 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: data_block_index_type: 0 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: index_shortening: 1 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: checksum: 4 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: no_block_cache: 0 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache: 0x55dbfa7dd1f0 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache_name: BinnedLRUCache 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache_options: 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: capacity : 536870912 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: num_shard_bits : 4 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: strict_capacity_limit : 0 2024-09-13T02:56:42.746 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: high_pri_pool_ratio: 0.000 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_cache_compressed: (nil) 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: persistent_cache: (nil) 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_size: 4096 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_size_deviation: 10 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_restart_interval: 16 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: index_block_restart_interval: 1 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: metadata_block_size: 4096 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: partition_filters: 0 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: use_delta_encoding: 1 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: filter_policy: bloomfilter 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: whole_key_filtering: 1 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: verify_compression: 0 2024-09-13T02:56:42.747 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: read_amp_bytes_per_bit: 0 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: format_version: 5 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: enable_index_compression: 1 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: block_align: 0 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: max_auto_readahead_size: 262144 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: prepopulate_block_cache: 0 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: initial_auto_readahead_size: 8192 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression: NoCompression 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T02:56:42.748 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.num_levels: 7 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:56:42.749 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T02:56:42.750 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T02:56:42.751 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T02:56:42.752 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.inplace_update_support: 0 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.bloom_locality: 0 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.max_successive_merges: 0 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T02:56:42.753 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T02:56:42.754 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T02:56:42.754 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T02:56:42.754 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.ttl: 2592000 2024-09-13T02:56:42.754 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T02:56:42.754 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T02:56:42.754 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T02:56:42.754 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.enable_blob_files: false 2024-09-13T02:56:42.754 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.min_blob_size: 0 2024-09-13T02:56:42.754 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi098/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12112, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca04e896-ed11-4a52-9723-2d559823971e 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196202399120, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-13T02:56:42.755 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196202409332, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2938644, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12113, "largest_seqno": 15032, "table_properties": {"data_size": 2927501, "index_size": 6768, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3333, "raw_key_size": 28977, "raw_average_key_size": 21, "raw_value_size": 2901913, "raw_average_value_size": 2201, "num_data_blocks": 308, "num_entries": 1318, "num_filter_entries": 1318, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726196202, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ca04e896-ed11-4a52-9723-2d559823971e", "db_session_id": "ZI41XJ5RSWYRA8QDE4PQ", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196202409471, "job": 1, "event": "recovery_finished"} 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi098/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dbfa80ae00 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: DB pointer 0x55dbfa906000 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** DB Stats ** 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:56:42.756 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: L0 1/0 2.80 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 607.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: L6 1/0 6.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Sum 2/0 8.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 607.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-13T02:56:42.757 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 607.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 607.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:56:42.758 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Cumulative compaction: 0.00 GB write, 168.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Interval compaction: 0.00 GB write, 168.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Block cache BinnedLRUCache@0x55dbfa7dd1f0#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: starting mon.smithi098 rank 0 at public addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] at bind addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi098 fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: mon.smithi098@-1(???) e2 preinit fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: mon.smithi098@-1(???).mds e14 new map 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: mon.smithi098@-1(???).mds e14 print_map 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: e14 2024-09-13T02:56:42.759 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: legacy client fscid: 1 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Filesystem 'cephfs' (1) 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: fs_name cephfs 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: epoch 14 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: tableserver 0 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: root 0 2024-09-13T02:56:42.760 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: session_timeout 60 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: session_autoclose 300 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: max_file_size 1099511627776 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: max_xattr_size 65536 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: required_client_features {} 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: last_failure 0 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: last_failure_osd_epoch 0 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: max_mds 1 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: in 0 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: up {0=14454} 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: failed 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: damaged 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: stopped 2024-09-13T02:56:42.761 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: data_pools [3] 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: metadata_pool 2 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: inline_data enabled 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: balancer 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: bal_rank_mask -1 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: standby_count_wanted 1 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: qdb_cluster leader: 0 members: 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: [mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: [mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Standby daemons: 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: 2024-09-13T02:56:42.762 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: [mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:42.763 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: [mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:42.763 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: mon.smithi098@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T02:56:42.763 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: mon.smithi098@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:56:42.763 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: mon.smithi098@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:56:42.763 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: mon.smithi098@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:56:42.763 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 ceph-mon[87325]: mon.smithi098@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-13T02:56:42.763 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 bash[87306]: b700160bc33dc36f1dcae45f1e068d246e66d4ab04601528a6d5238ce5118c14 2024-09-13T02:56:42.763 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:42 smithi098 systemd[1]: Started Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:56:44.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:56:44.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:56:44.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:44.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:44.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: mon.smithi098 calling monitor election 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: mon.smithi098 is new leader, mons smithi098,smithi142 in quorum (ranks 0,1) 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: monmap epoch 2 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: last_changed 2024-09-13T02:45:33.382234+0000 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: created 2024-09-13T02:42:50.485860+0000 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: min_mon_release 18 (reef) 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: election_strategy: 1 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.smithi142 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T02:56:44.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: mgrmap e33: smithi098.ukgenf(active, since 3m), standbys: smithi142.jutrvi 2024-09-13T02:56:44.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T02:56:44.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:56:44.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:56:44.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: from='mgr.14644 ' entity='' 2024-09-13T02:56:44.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:43 smithi142 ceph-mon[33443]: mgrmap e34: smithi098.ukgenf(active, since 3m), standbys: smithi142.jutrvi 2024-09-13T02:56:44.204 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: from='mgr.14644 172.21.15.98:0/3398368864' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: mon.smithi098 calling monitor election 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: mon.smithi098 is new leader, mons smithi098,smithi142 in quorum (ranks 0,1) 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: monmap epoch 2 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: last_changed 2024-09-13T02:45:33.382234+0000 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: created 2024-09-13T02:42:50.485860+0000 2024-09-13T02:56:44.205 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: min_mon_release 18 (reef) 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: election_strategy: 1 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.smithi142 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: mgrmap e33: smithi098.ukgenf(active, since 3m), standbys: smithi142.jutrvi 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: from='mgr.14644 ' entity='' 2024-09-13T02:56:44.206 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:43 smithi098 ceph-mon[87325]: mgrmap e34: smithi098.ukgenf(active, since 3m), standbys: smithi142.jutrvi 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: Active manager daemon smithi098.ukgenf restarted 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: Activating manager daemon smithi098.ukgenf 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: mgrmap e35: smithi098.ukgenf(active, starting, since 0.00539495s), standbys: smithi142.jutrvi 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:56:48.957 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi142.jutrvi", "id": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: Manager daemon smithi098.ukgenf is now available 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: Standby manager daemon smithi142.jutrvi restarted 2024-09-13T02:56:48.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:56:48.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/1734201503' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:56:48.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/1734201503' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:56:48.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/1734201503' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:56:48.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.? 172.21.15.142:0/1734201503' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:56:48.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:48 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: Active manager daemon smithi098.ukgenf restarted 2024-09-13T02:56:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: Activating manager daemon smithi098.ukgenf 2024-09-13T02:56:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T02:56:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: mgrmap e35: smithi098.ukgenf(active, starting, since 0.00539495s), standbys: smithi142.jutrvi 2024-09-13T02:56:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:56:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi098.ukgenf", "id": "smithi098.ukgenf"}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr metadata", "who": "smithi142.jutrvi", "id": "smithi142.jutrvi"}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:56:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: Manager daemon smithi098.ukgenf is now available 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: Standby manager daemon smithi142.jutrvi restarted 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: Standby manager daemon smithi142.jutrvi started 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.? 172.21.15.142:0/1734201503' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/crt"}]: dispatch 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.? 172.21.15.142:0/1734201503' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.? 172.21.15.142:0/1734201503' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.jutrvi/key"}]: dispatch 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.? 172.21.15.142:0/1734201503' entity='mgr.smithi142.jutrvi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:56:48.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:56:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/trash_purge_schedule"}]: dispatch 2024-09-13T02:56:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:49 smithi098 ceph-mon[87325]: mgrmap e36: smithi098.ukgenf(active, since 1.01053s), standbys: smithi142.jutrvi 2024-09-13T02:56:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:49 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:49 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:56:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:49 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi098.ukgenf/trash_purge_schedule"}]: dispatch 2024-09-13T02:56:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:49 smithi142 ceph-mon[33443]: mgrmap e36: smithi098.ukgenf(active, since 1.01053s), standbys: smithi142.jutrvi 2024-09-13T02:56:50.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:50 smithi098 ceph-mon[87325]: [13/Sep/2024:02:56:49] ENGINE Bus STARTING 2024-09-13T02:56:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:50 smithi098 ceph-mon[87325]: [13/Sep/2024:02:56:49] ENGINE Serving on https://172.21.15.98:7150 2024-09-13T02:56:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:50 smithi098 ceph-mon[87325]: [13/Sep/2024:02:56:49] ENGINE Error in HTTPServer.serve 2024-09-13T02:56:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: Traceback (most recent call last): 2024-09-13T02:56:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:56:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:56:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:56:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._run(expiration_interval) 2024-09-13T02:56:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:56:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: s = self.context.wrap_socket( 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: return self.sslsocket_class._create( 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self.do_handshake() 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: self._sslobj.do_handshake() 2024-09-13T02:56:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:56:51.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:50 smithi142 ceph-mon[33443]: [13/Sep/2024:02:56:49] ENGINE Bus STARTING 2024-09-13T02:56:51.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:50 smithi142 ceph-mon[33443]: [13/Sep/2024:02:56:49] ENGINE Serving on https://172.21.15.98:7150 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:50 smithi142 ceph-mon[33443]: [13/Sep/2024:02:56:49] ENGINE Error in HTTPServer.serve 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Traceback (most recent call last): 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self._run(expiration_interval) 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: s = self.context.wrap_socket( 2024-09-13T02:56:51.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:56:51.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: return self.sslsocket_class._create( 2024-09-13T02:56:51.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:56:51.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self.do_handshake() 2024-09-13T02:56:51.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:56:51.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: self._sslobj.do_handshake() 2024-09-13T02:56:51.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:56:52.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:51 smithi142 ceph-mon[33443]: [13/Sep/2024:02:56:49] ENGINE Serving on http://172.21.15.98:8765 2024-09-13T02:56:52.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:51 smithi142 ceph-mon[33443]: [13/Sep/2024:02:56:49] ENGINE Bus STARTED 2024-09-13T02:56:52.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:51 smithi142 ceph-mon[33443]: pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:52.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:51 smithi142 ceph-mon[33443]: mgrmap e37: smithi098.ukgenf(active, since 2s), standbys: smithi142.jutrvi 2024-09-13T02:56:52.061 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:51 smithi098 ceph-mon[87325]: [13/Sep/2024:02:56:49] ENGINE Serving on http://172.21.15.98:8765 2024-09-13T02:56:52.061 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:51 smithi098 ceph-mon[87325]: [13/Sep/2024:02:56:49] ENGINE Bus STARTED 2024-09-13T02:56:52.061 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:51 smithi098 ceph-mon[87325]: pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:52.062 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:51 smithi098 ceph-mon[87325]: mgrmap e37: smithi098.ukgenf(active, since 2s), standbys: smithi142.jutrvi 2024-09-13T02:56:53.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:53.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:53.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:53.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:53.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:52 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:53.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:52 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:53.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:52 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:53.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:52 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:54.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:53 smithi098 ceph-mon[87325]: pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:53 smithi098 ceph-mon[87325]: mgrmap e38: smithi098.ukgenf(active, since 4s), standbys: smithi142.jutrvi 2024-09-13T02:56:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:53 smithi142 ceph-mon[33443]: pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:53 smithi142 ceph-mon[33443]: mgrmap e38: smithi098.ukgenf(active, since 4s), standbys: smithi142.jutrvi 2024-09-13T02:56:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:53 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:53 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:55.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:55.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:55.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:55 smithi098 ceph-mon[87325]: pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:55.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:55 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:55.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:55 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:55.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:55 smithi142 ceph-mon[33443]: pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:57 smithi098 ceph-mon[87325]: pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-13T02:56:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:57 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:57 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:57 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:57.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:57 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:58.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:57 smithi142 ceph-mon[33443]: pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-13T02:56:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:57 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:57 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:57 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:57 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:59.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: Detected new or changed devices on smithi098 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:59.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:58 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:56:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: Detected new or changed devices on smithi098 2024-09-13T02:56:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-13T02:56:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-13T02:56:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:56:59.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:59.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:59.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:56:59.897 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:59 smithi142 ceph-mon[33443]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:59.897 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:59 smithi142 ceph-mon[33443]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:59.897 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:59 smithi142 ceph-mon[33443]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:59.897 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:59 smithi142 ceph-mon[33443]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:59.897 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:56:59 smithi142 ceph-mon[33443]: pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T02:57:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:59 smithi098 ceph-mon[87325]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:57:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:59 smithi098 ceph-mon[87325]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:57:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:59 smithi098 ceph-mon[87325]: Updating smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:57:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:59 smithi098 ceph-mon[87325]: Updating smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:57:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:56:59 smithi098 ceph-mon[87325]: pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T02:57:01.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:00 smithi098 ceph-mon[87325]: Upgrade: Updating mon.smithi142 2024-09-13T02:57:01.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:00 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:01.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:00 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:57:01.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:00 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:57:01.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:00 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:01.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:00 smithi098 ceph-mon[87325]: Deploying daemon mon.smithi142 on smithi142 2024-09-13T02:57:01.163 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:00 smithi098 ceph-mon[87325]: pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T02:57:01.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:00 smithi142 ceph-mon[33443]: Upgrade: Updating mon.smithi142 2024-09-13T02:57:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:00 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:00 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:57:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:00 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:57:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:00 smithi142 ceph-mon[33443]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:00 smithi142 ceph-mon[33443]: Deploying daemon mon.smithi142 on smithi142 2024-09-13T02:57:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:00 smithi142 ceph-mon[33443]: pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T02:57:01.939 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:01 smithi142 systemd[1]: Stopping Ceph mon.smithi142 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:57:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:01 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142[33416]: 2024-09-13T02:57:01.936+0000 7f096dd41700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi142 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:57:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:01 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142[33416]: 2024-09-13T02:57:01.936+0000 7f096dd41700 -1 mon.smithi142@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T02:57:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:02 smithi142 podman[65285]: 2024-09-13 02:57:02.059507612 +0000 UTC m=+0.232592851 container died 1f9ae4541346ebf71cdbd7ccec5e5778bcc6cad2f685b021ff7dd1c38b61b31a (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T02:57:02.722 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:02 smithi142 podman[65285]: 2024-09-13 02:57:02.419990566 +0000 UTC m=+0.593075760 container cleanup 1f9ae4541346ebf71cdbd7ccec5e5778bcc6cad2f685b021ff7dd1c38b61b31a (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.build-date=20231212) 2024-09-13T02:57:02.722 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:02 smithi142 bash[65285]: ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142 2024-09-13T02:57:03.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:02 smithi142 podman[65297]: 2024-09-13 02:57:02.721364104 +0000 UTC m=+0.653458506 container remove 1f9ae4541346ebf71cdbd7ccec5e5778bcc6cad2f685b021ff7dd1c38b61b31a (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20231212, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T02:57:03.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:02 smithi142 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi142.service: Deactivated successfully. 2024-09-13T02:57:03.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:02 smithi142 systemd[1]: Stopped Ceph mon.smithi142 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:57:03.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:02 smithi142 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi142.service: Consumed 7.565s CPU time. 2024-09-13T02:57:03.349 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 systemd[1]: Starting Ceph mon.smithi142 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:57:03.349 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 podman[65427]: 2024-09-13 02:57:03.198698412 +0000 UTC m=+0.015728106 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:57:03.349 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 podman[65427]: 2024-09-13 02:57:03.348226451 +0000 UTC m=+0.165256142 container create dc3771253accc01dfa26dd040edef328863345cb3cbe8898fe9156d809f458da (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-13T02:57:03.601 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 podman[65427]: 2024-09-13 02:57:03.575349265 +0000 UTC m=+0.392378956 container init dc3771253accc01dfa26dd040edef328863345cb3cbe8898fe9156d809f458da (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T02:57:03.601 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 podman[65427]: 2024-09-13 02:57:03.578740478 +0000 UTC m=+0.395770181 container start dc3771253accc01dfa26dd040edef328863345cb3cbe8898fe9156d809f458da (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-7741f7f) 2024-09-13T02:57:04.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T02:57:04.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable), process ceph-mon, pid 2 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: pidfile_write: ignore empty --pid-file 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: load: jerasure load: lrc 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: RocksDB version: 7.9.2 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Git sha 0 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Compile date 2024-09-12 19:43:04 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: DB SUMMARY 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: DB Session ID: 2ZM9ZS29EUBOMKHRU7MH 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: CURRENT file: CURRENT 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1403 Bytes 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi142/store.db dir, Total Num: 1, files: 000027.sst 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi142/store.db: 000025.log size: 7684609 ; 2024-09-13T02:57:04.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.error_if_exists: 0 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.create_if_missing: 0 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.paranoid_checks: 1 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.env: 0x5644aa792940 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.info_log: 0x5644ab27b8c0 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.statistics: (nil) 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.use_fsync: 0 2024-09-13T02:57:04.004 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_log_file_size: 0 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.allow_fallocate: 1 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.use_direct_reads: 0 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.db_log_dir: 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.wal_dir: 2024-09-13T02:57:04.005 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.write_buffer_manager: 0x5644ab28adc0 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T02:57:04.006 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.unordered_write: 0 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.row_cache: None 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.wal_filter: None 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.two_write_queues: 0 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T02:57:04.007 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.wal_compression: 0 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.atomic_flush: 0 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.log_readahead_size: 0 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T02:57:04.008 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T02:57:04.009 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_background_jobs: 2 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_background_compactions: -1 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_subcompactions: 1 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_open_files: -1 2024-09-13T02:57:04.010 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_background_flushes: -1 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Compression algorithms supported: 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: kZSTD supported: 0 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: kXpressCompression supported: 0 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: kBZip2Compression supported: 0 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: kLZ4Compression supported: 1 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: kZlibCompression supported: 1 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T02:57:04.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: kSnappyCompression supported: 1 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi142/store.db/MANIFEST-000010 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.merge_operator: 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_filter: None 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5644ab27b520) 2024-09-13T02:57:04.012 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: cache_index_and_filter_blocks: 1 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: pin_top_level_index_and_filter: 1 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_type: 0 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_block_index_type: 0 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_shortening: 1 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: checksum: 4 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: no_block_cache: 0 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache: 0x5644ab26f1f0 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_name: BinnedLRUCache 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_options: 2024-09-13T02:57:04.013 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: capacity : 536870912 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: num_shard_bits : 4 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: strict_capacity_limit : 0 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: high_pri_pool_ratio: 0.000 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_compressed: (nil) 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: persistent_cache: (nil) 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_size: 4096 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_size_deviation: 10 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_restart_interval: 16 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_block_restart_interval: 1 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: metadata_block_size: 4096 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: partition_filters: 0 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: use_delta_encoding: 1 2024-09-13T02:57:04.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: filter_policy: bloomfilter 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: whole_key_filtering: 1 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: verify_compression: 0 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: read_amp_bytes_per_bit: 0 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: format_version: 5 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: enable_index_compression: 1 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_align: 0 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_auto_readahead_size: 262144 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: prepopulate_block_cache: 0 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: initial_auto_readahead_size: 8192 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression: NoCompression 2024-09-13T02:57:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.num_levels: 7 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T02:57:04.016 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T02:57:04.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T02:57:04.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T02:57:04.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.inplace_update_support: 0 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T02:57:04.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T02:57:04.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.bloom_locality: 0 2024-09-13T02:57:04.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.max_successive_merges: 0 2024-09-13T02:57:04.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T02:57:04.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T02:57:04.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T02:57:04.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T02:57:04.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.ttl: 2592000 2024-09-13T02:57:04.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T02:57:04.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T02:57:04.022 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T02:57:04.022 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.enable_blob_files: false 2024-09-13T02:57:04.022 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.min_blob_size: 0 2024-09-13T02:57:04.022 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T02:57:04.022 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi142/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12186, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c20e10b3-24b0-4314-8d9a-652993864a3b 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196223605949, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-13T02:57:04.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196223623494, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4581957, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12191, "largest_seqno": 15884, "table_properties": {"data_size": 4568922, "index_size": 8148, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3845, "raw_key_size": 33781, "raw_average_key_size": 22, "raw_value_size": 4539097, "raw_average_value_size": 2984, "num_data_blocks": 369, "num_entries": 1521, "num_filter_entries": 1521, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726196223, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c20e10b3-24b0-4314-8d9a-652993864a3b", "db_session_id": "2ZM9ZS29EUBOMKHRU7MH", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196223623647, "job": 1, "event": "recovery_finished"} 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi142/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5644ab29ce00 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: DB pointer 0x5644ab398000 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** DB Stats ** 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T02:57:04.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** Compaction Stats [default] ** 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: L0 1/0 4.37 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 657.8 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: L6 1/0 6.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Sum 2/0 10.40 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 657.8 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 657.8 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-09-13T02:57:04.025 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** Compaction Stats [default] ** 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 657.8 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative compaction: 0.00 GB write, 214.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval compaction: 0.00 GB write, 214.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:57:04.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Block cache BinnedLRUCache@0x5644ab26f1f0#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: starting mon.smithi142 rank 1 at public addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] at bind addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi142 fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: mon.smithi142@-1(???) e2 preinit fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: mon.smithi142@-1(???).mds e14 new map 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: mon.smithi142@-1(???).mds e14 print_map 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: e14 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:57:04.027 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: legacy client fscid: 1 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Filesystem 'cephfs' (1) 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: fs_name cephfs 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: epoch 14 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: tableserver 0 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: root 0 2024-09-13T02:57:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: session_timeout 60 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: session_autoclose 300 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_file_size 1099511627776 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_xattr_size 65536 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: required_client_features {} 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: last_failure 0 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: last_failure_osd_epoch 0 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_mds 1 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: in 0 2024-09-13T02:57:04.030 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: up {0=14454} 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: failed 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: damaged 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: stopped 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_pools [3] 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: metadata_pool 2 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: inline_data enabled 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: balancer 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: bal_rank_mask -1 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: standby_count_wanted 1 2024-09-13T02:57:04.031 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: qdb_cluster leader: 0 members: 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Standby daemons: 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: mon.smithi142@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: mon.smithi142@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:57:04.032 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: mon.smithi142@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:57:04.033 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: mon.smithi142@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:57:04.033 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 ceph-mon[65447]: mon.smithi142@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-13T02:57:04.033 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 bash[65427]: dc3771253accc01dfa26dd040edef328863345cb3cbe8898fe9156d809f458da 2024-09-13T02:57:04.033 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:03 smithi142 systemd[1]: Started Ceph mon.smithi142 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:57:05.478 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: mon.smithi098 calling monitor election 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: mon.smithi142 calling monitor election 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: mon.smithi098 is new leader, mons smithi098,smithi142 in quorum (ranks 0,1) 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: monmap epoch 3 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: last_changed 2024-09-13T02:57:04.148403+0000 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: created 2024-09-13T02:42:50.485860+0000 2024-09-13T02:57:05.479 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: min_mon_release 19 (squid) 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: election_strategy: 1 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.smithi142 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: mgrmap e38: smithi098.ukgenf(active, since 15s), standbys: smithi142.jutrvi 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:57:05.480 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:05.481 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:05.481 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:05 smithi142 ceph-mon[65447]: pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-13T02:57:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:57:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: mon.smithi098 calling monitor election 2024-09-13T02:57:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: mon.smithi142 calling monitor election 2024-09-13T02:57:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: mon.smithi098 is new leader, mons smithi098,smithi142 in quorum (ranks 0,1) 2024-09-13T02:57:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi098"}]: dispatch 2024-09-13T02:57:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: monmap epoch 3 2024-09-13T02:57:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: fsid d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T02:57:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: last_changed 2024-09-13T02:57:04.148403+0000 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: created 2024-09-13T02:42:50.485860+0000 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: min_mon_release 19 (squid) 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: election_strategy: 1 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.smithi098 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.smithi142 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: mgrmap e38: smithi098.ukgenf(active, since 15s), standbys: smithi142.jutrvi 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:05.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-09-13T02:57:05.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:05.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:05.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:05 smithi098 ceph-mon[87325]: pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-13T02:57:08.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:07 smithi142 ceph-mon[65447]: pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T02:57:08.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:07 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:08.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:07 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:08.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:07 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:08.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:07 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:07 smithi098 ceph-mon[87325]: pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T02:57:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:07 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:07 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:07 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:07 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.160+0000 7f7588fa6700 1 -- 172.21.15.98:0/2236247349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7584100e80 msgr2=0x7f7584104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.160+0000 7f7588fa6700 1 --2- 172.21.15.98:0/2236247349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7584100e80 0x7f7584104e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f756c009910 tx=0x7f756c009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.160+0000 7f7588fa6700 1 -- 172.21.15.98:0/2236247349 shutdown_connections 2024-09-13T02:57:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.160+0000 7f7588fa6700 1 --2- 172.21.15.98:0/2236247349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7584100e80 0x7f7584104e50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.160+0000 7f7588fa6700 1 --2- 172.21.15.98:0/2236247349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75841004e0 0x7f75841008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.160+0000 7f7588fa6700 1 -- 172.21.15.98:0/2236247349 >> 172.21.15.98:0/2236247349 conn(0x7f75840fbda0 msgr2=0x7f75840fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.160+0000 7f7588fa6700 1 -- 172.21.15.98:0/2236247349 shutdown_connections 2024-09-13T02:57:09.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.160+0000 7f7588fa6700 1 -- 172.21.15.98:0/2236247349 wait complete. 2024-09-13T02:57:09.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f7588fa6700 1 Processor -- start 2024-09-13T02:57:09.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f7588fa6700 1 -- start start 2024-09-13T02:57:09.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f7588fa6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:09.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f7588fa6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 0x7f7584196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:09.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f7588fa6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584196b30 con 0x7f75841004e0 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f7588fa6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758419a8c0 con 0x7f7584100e80 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f758259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f758259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33554/0 (socket says 172.21.15.98:33554) 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f758259c700 1 -- 172.21.15.98:0/295758473 learned_addr learned my addr 172.21.15.98:0/295758473 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.161+0000 7f7581d9b700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 0x7f7584196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.162+0000 7f758259c700 1 -- 172.21.15.98:0/295758473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 msgr2=0x7f7584196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.162+0000 7f758259c700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 0x7f7584196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.162+0000 7f758259c700 1 -- 172.21.15.98:0/295758473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c0095f0 con 0x7f75841004e0 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.162+0000 7f758259c700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584195f10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75740060b0 tx=0x7f757400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.162+0000 7f757b7fe700 1 -- 172.21.15.98:0/295758473 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757400dda0 con 0x7f75841004e0 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.162+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758419aba0 con 0x7f75841004e0 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.162+0000 7f757b7fe700 1 -- 172.21.15.98:0/295758473 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f757400f040 con 0x7f75841004e0 2024-09-13T02:57:09.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.162+0000 7f757b7fe700 1 -- 172.21.15.98:0/295758473 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75740146f0 con 0x7f75841004e0 2024-09-13T02:57:09.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.162+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758419b0c0 con 0x7f75841004e0 2024-09-13T02:57:09.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.163+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7584108850 con 0x7f75841004e0 2024-09-13T02:57:09.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.164+0000 7f757b7fe700 1 -- 172.21.15.98:0/295758473 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f7574015400 con 0x7f75841004e0 2024-09-13T02:57:09.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.164+0000 7f757b7fe700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f757006e7b0 0x7f7570070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:09.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.165+0000 7f7581d9b700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f757006e7b0 0x7f7570070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:09.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.165+0000 7f757b7fe700 1 -- 172.21.15.98:0/295758473 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f757408e1a0 con 0x7f75841004e0 2024-09-13T02:57:09.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.165+0000 7f7581d9b700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f757006e7b0 0x7f7570070c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f756c006010 tx=0x7f756c01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:09.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.169+0000 7f757b7fe700 1 -- 172.21.15.98:0/295758473 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f75740572d0 con 0x7f75841004e0 2024-09-13T02:57:09.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.395+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f758419b340 con 0x7f757006e7b0 2024-09-13T02:57:09.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.396+0000 7f757b7fe700 1 -- 172.21.15.98:0/295758473 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f758419b340 con 0x7f757006e7b0 2024-09-13T02:57:09.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.398+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f757006e7b0 msgr2=0x7f7570070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.398+0000 7f7588fa6700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f757006e7b0 0x7f7570070c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f756c006010 tx=0x7f756c01a040 comp rx=0 tx=0).stop 2024-09-13T02:57:09.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.398+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 msgr2=0x7f7584195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.398+0000 7f7588fa6700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584195f10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75740060b0 tx=0x7f757400d3b0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.399+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 shutdown_connections 2024-09-13T02:57:09.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.399+0000 7f7588fa6700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f757006e7b0 0x7f7570070c60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.399+0000 7f7588fa6700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75841004e0 0x7f7584195f10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.399+0000 7f7588fa6700 1 --2- 172.21.15.98:0/295758473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7584100e80 0x7f7584196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.399+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 >> 172.21.15.98:0/295758473 conn(0x7f75840fbda0 msgr2=0x7f75840fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:09.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.399+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 shutdown_connections 2024-09-13T02:57:09.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.399+0000 7f7588fa6700 1 -- 172.21.15.98:0/295758473 wait complete. 2024-09-13T02:57:09.411 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:57:09.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.504+0000 7fe005a0b700 1 -- 172.21.15.98:0/3262018257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 msgr2=0x7fe000103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.504+0000 7fe005a0b700 1 --2- 172.21.15.98:0/3262018257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 0x7fe000103c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009910 tx=0x7fdff0009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:09.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.504+0000 7fe005a0b700 1 -- 172.21.15.98:0/3262018257 shutdown_connections 2024-09-13T02:57:09.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.504+0000 7fe005a0b700 1 --2- 172.21.15.98:0/3262018257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0000ff350 0x7fe0000ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.504+0000 7fe005a0b700 1 --2- 172.21.15.98:0/3262018257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 0x7fe000103c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.504+0000 7fe005a0b700 1 -- 172.21.15.98:0/3262018257 >> 172.21.15.98:0/3262018257 conn(0x7fe0000748b0 msgr2=0x7fe000074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:09.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.504+0000 7fe005a0b700 1 -- 172.21.15.98:0/3262018257 shutdown_connections 2024-09-13T02:57:09.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.504+0000 7fe005a0b700 1 -- 172.21.15.98:0/3262018257 wait complete. 2024-09-13T02:57:09.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fe005a0b700 1 Processor -- start 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fe005a0b700 1 -- start start 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fe005a0b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0000ff350 0x7fe0001999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fe005a0b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 0x7fe000199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fe005a0b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00019a5b0 con 0x7fe0001038b0 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fe005a0b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000193a60 con 0x7fe0000ff350 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fdff7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 0x7fe000199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fdff7fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 0x7fe000199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33570/0 (socket says 172.21.15.98:33570) 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fdff7fff700 1 -- 172.21.15.98:0/3956259860 learned_addr learned my addr 172.21.15.98:0/3956259860 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fdffeffd700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0000ff350 0x7fe0001999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fdff7fff700 1 -- 172.21.15.98:0/3956259860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0000ff350 msgr2=0x7fe0001999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fdff7fff700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0000ff350 0x7fe0001999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.505+0000 7fdff7fff700 1 -- 172.21.15.98:0/3956259860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00095f0 con 0x7fe0001038b0 2024-09-13T02:57:09.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.506+0000 7fdff7fff700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 0x7fe000199f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800ed50 tx=0x7fdfe800a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:09.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.506+0000 7fe004a09700 1 -- 172.21.15.98:0/3956259860 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe80165c0 con 0x7fe0001038b0 2024-09-13T02:57:09.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.506+0000 7fe004a09700 1 -- 172.21.15.98:0/3956259860 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfe8016be0 con 0x7fe0001038b0 2024-09-13T02:57:09.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.506+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000193d40 con 0x7fe0001038b0 2024-09-13T02:57:09.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.506+0000 7fe004a09700 1 -- 172.21.15.98:0/3956259860 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfe800bcf0 con 0x7fe0001038b0 2024-09-13T02:57:09.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.506+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe000194290 con 0x7fe0001038b0 2024-09-13T02:57:09.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.507+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000106e20 con 0x7fe0001038b0 2024-09-13T02:57:09.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.507+0000 7fe004a09700 1 -- 172.21.15.98:0/3956259860 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fdfe8016720 con 0x7fe0001038b0 2024-09-13T02:57:09.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.508+0000 7fe004a09700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdfec06e7b0 0x7fdfec070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:09.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.508+0000 7fdffeffd700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdfec06e7b0 0x7fdfec070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:09.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.508+0000 7fe004a09700 1 -- 172.21.15.98:0/3956259860 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fdfe808f820 con 0x7fe0001038b0 2024-09-13T02:57:09.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.508+0000 7fdffeffd700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdfec06e7b0 0x7fdfec070c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdff0006010 tx=0x7fdff001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:09.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.512+0000 7fe004a09700 1 -- 172.21.15.98:0/3956259860 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdfe805c500 con 0x7fe0001038b0 2024-09-13T02:57:09.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.736+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe000194560 con 0x7fdfec06e7b0 2024-09-13T02:57:09.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.738+0000 7fe004a09700 1 -- 172.21.15.98:0/3956259860 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fe000194560 con 0x7fdfec06e7b0 2024-09-13T02:57:09.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdfec06e7b0 msgr2=0x7fdfec070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdfec06e7b0 0x7fdfec070c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdff0006010 tx=0x7fdff001a040 comp rx=0 tx=0).stop 2024-09-13T02:57:09.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 msgr2=0x7fe000199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 0x7fe000199f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800ed50 tx=0x7fdfe800a630 comp rx=0 tx=0).stop 2024-09-13T02:57:09.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 shutdown_connections 2024-09-13T02:57:09.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdfec06e7b0 0x7fdfec070c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0000ff350 0x7fe0001999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 --2- 172.21.15.98:0/3956259860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0001038b0 0x7fe000199f20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 >> 172.21.15.98:0/3956259860 conn(0x7fe0000748b0 msgr2=0x7fe0000fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:09.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 shutdown_connections 2024-09-13T02:57:09.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.740+0000 7fe005a0b700 1 -- 172.21.15.98:0/3956259860 wait complete. 2024-09-13T02:57:09.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.845+0000 7f15bf72d700 1 -- 172.21.15.98:0/3253031929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ff350 msgr2=0x7f15b80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.845+0000 7f15bf72d700 1 --2- 172.21.15.98:0/3253031929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ff350 0x7f15b80ff720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009910 tx=0x7f15b4009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:09.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.845+0000 7f15bf72d700 1 -- 172.21.15.98:0/3253031929 shutdown_connections 2024-09-13T02:57:09.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.845+0000 7f15bf72d700 1 --2- 172.21.15.98:0/3253031929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b80ffc60 0x7f15b810a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.845+0000 7f15bf72d700 1 --2- 172.21.15.98:0/3253031929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ff350 0x7f15b80ff720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.845+0000 7f15bf72d700 1 -- 172.21.15.98:0/3253031929 >> 172.21.15.98:0/3253031929 conn(0x7f15b80748b0 msgr2=0x7f15b8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:09.848 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:09 smithi098 ceph-mon[87325]: pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:09.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.846+0000 7f15bf72d700 1 -- 172.21.15.98:0/3253031929 shutdown_connections 2024-09-13T02:57:09.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.846+0000 7f15bf72d700 1 -- 172.21.15.98:0/3253031929 wait complete. 2024-09-13T02:57:09.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.846+0000 7f15bf72d700 1 Processor -- start 2024-09-13T02:57:09.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.846+0000 7f15bf72d700 1 -- start start 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bf72d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b80ff350 0x7f15b8195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bf72d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ffc60 0x7f15b81963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bf72d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8196ac0 con 0x7f15b80ffc60 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bf72d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b819a850 con 0x7f15b80ff350 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bccc8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ffc60 0x7f15b81963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bd4c9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b80ff350 0x7f15b8195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bccc8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ffc60 0x7f15b81963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33588/0 (socket says 172.21.15.98:33588) 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bccc8700 1 -- 172.21.15.98:0/3341397561 learned_addr learned my addr 172.21.15.98:0/3341397561 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bccc8700 1 -- 172.21.15.98:0/3341397561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b80ff350 msgr2=0x7f15b8195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bccc8700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b80ff350 0x7f15b8195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bccc8700 1 -- 172.21.15.98:0/3341397561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40095f0 con 0x7f15b80ffc60 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bccc8700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ffc60 0x7f15b81963e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15a800d8d0 tx=0x7f15a800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:09.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15ae7fc700 1 -- 172.21.15.98:0/3341397561 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a80098a0 con 0x7f15b80ffc60 2024-09-13T02:57:09.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b819ab30 con 0x7f15b80ffc60 2024-09-13T02:57:09.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15ae7fc700 1 -- 172.21.15.98:0/3341397561 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15a8010460 con 0x7f15b80ffc60 2024-09-13T02:57:09.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15ae7fc700 1 -- 172.21.15.98:0/3341397561 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15a800f5f0 con 0x7f15b80ffc60 2024-09-13T02:57:09.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.847+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b819b080 con 0x7f15b80ffc60 2024-09-13T02:57:09.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.849+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b8107dd0 con 0x7f15b80ffc60 2024-09-13T02:57:09.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.849+0000 7f15ae7fc700 1 -- 172.21.15.98:0/3341397561 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f15a8009a00 con 0x7f15b80ffc60 2024-09-13T02:57:09.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.849+0000 7f15ae7fc700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f15a406e7c0 0x7f15a4070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:09.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.850+0000 7f15ae7fc700 1 -- 172.21.15.98:0/3341397561 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f15a808e6b0 con 0x7f15b80ffc60 2024-09-13T02:57:09.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.850+0000 7f15bd4c9700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f15a406e7c0 0x7f15a4070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:09.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.850+0000 7f15bd4c9700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f15a406e7c0 0x7f15a4070c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15b4006010 tx=0x7f15b401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:09.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:09.854+0000 7f15ae7fc700 1 -- 172.21.15.98:0/3341397561 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f15a8057730 con 0x7f15b80ffc60 2024-09-13T02:57:09.926 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:09 smithi142 ceph-mon[65447]: pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:10.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.062+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f15b819b310 con 0x7f15a406e7c0 2024-09-13T02:57:10.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.071+0000 7f15ae7fc700 1 -- 172.21.15.98:0/3341397561 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f15b819b310 con 0x7f15a406e7c0 2024-09-13T02:57:10.073 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:57:10.073 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (119s) 16s ago 12m 21.5M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T02:57:10.073 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (12m) 16s ago 12m 8082k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:57:10.073 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (11m) 3s ago 11m 7696k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (12m) 16s ago 12m 6665k - 18.2.0 dc2bc1663786 9c8003bbeed3 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (11m) 3s ago 11m 6673k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (98s) 16s ago 12m 73.7M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (7m) 16s ago 7m 94.3M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (7m) 16s ago 7m 153M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (7m) 3s ago 7m 15.5M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (7m) 3s ago 7m 18.9M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (4m) 16s ago 13m 473M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (2m) 3s ago 11m 438M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (28s) 16s ago 14m 29.1M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (6s) 3s ago 11m 25.3M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (2m) 16s ago 12m 16.8M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:57:10.074 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (2m) 3s ago 11m 15.1M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:57:10.075 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (10m) 16s ago 10m 213M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:57:10.075 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (10m) 16s ago 10m 222M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:57:10.075 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (9m) 16s ago 9m 186M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:57:10.075 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (9m) 3s ago 9m 239M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:57:10.075 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (9m) 3s ago 9m 213M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:57:10.075 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (8m) 3s ago 8m 196M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:57:10.075 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (2m) 16s ago 12m 76.1M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:57:10.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.073+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f15a406e7c0 msgr2=0x7f15a4070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.073+0000 7f15bf72d700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f15a406e7c0 0x7f15a4070c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f15b4006010 tx=0x7f15b401a040 comp rx=0 tx=0).stop 2024-09-13T02:57:10.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.073+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ffc60 msgr2=0x7f15b81963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.073+0000 7f15bf72d700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ffc60 0x7f15b81963e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15a800d8d0 tx=0x7f15a800dbe0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.073+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 shutdown_connections 2024-09-13T02:57:10.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.073+0000 7f15bf72d700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f15a406e7c0 0x7f15a4070c70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.073+0000 7f15bf72d700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b80ff350 0x7f15b8195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.073+0000 7f15bf72d700 1 --2- 172.21.15.98:0/3341397561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15b80ffc60 0x7f15b81963e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.073+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 >> 172.21.15.98:0/3341397561 conn(0x7f15b80748b0 msgr2=0x7f15b8104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:10.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.074+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 shutdown_connections 2024-09-13T02:57:10.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.074+0000 7f15bf72d700 1 -- 172.21.15.98:0/3341397561 wait complete. 2024-09-13T02:57:10.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.177+0000 7f7b1b28c700 1 -- 172.21.15.98:0/260212442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 msgr2=0x7f7b140ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.177+0000 7f7b1b28c700 1 --2- 172.21.15.98:0/260212442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 0x7f7b140ff790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00b0a0 tx=0x7f7b0c00b3b0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.177+0000 7f7b1b28c700 1 -- 172.21.15.98:0/260212442 shutdown_connections 2024-09-13T02:57:10.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.177+0000 7f7b1b28c700 1 --2- 172.21.15.98:0/260212442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b140ffd60 0x7f7b14103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.177+0000 7f7b1b28c700 1 --2- 172.21.15.98:0/260212442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 0x7f7b140ff790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.177+0000 7f7b1b28c700 1 -- 172.21.15.98:0/260212442 >> 172.21.15.98:0/260212442 conn(0x7f7b140fac60 msgr2=0x7f7b140fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:10.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.177+0000 7f7b1b28c700 1 -- 172.21.15.98:0/260212442 shutdown_connections 2024-09-13T02:57:10.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.177+0000 7f7b1b28c700 1 -- 172.21.15.98:0/260212442 wait complete. 2024-09-13T02:57:10.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b1b28c700 1 Processor -- start 2024-09-13T02:57:10.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b1b28c700 1 -- start start 2024-09-13T02:57:10.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b1b28c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 0x7f7b14196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:10.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b1b28c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b140ffd60 0x7f7b141972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:10.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b1b28c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b14197990 con 0x7f7b140ff3c0 2024-09-13T02:57:10.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b1b28c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b14197ad0 con 0x7f7b140ffd60 2024-09-13T02:57:10.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b19028700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 0x7f7b14196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b19028700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 0x7f7b14196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33614/0 (socket says 172.21.15.98:33614) 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b19028700 1 -- 172.21.15.98:0/3313426536 learned_addr learned my addr 172.21.15.98:0/3313426536 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b18827700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b140ffd60 0x7f7b141972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b19028700 1 -- 172.21.15.98:0/3313426536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b140ffd60 msgr2=0x7f7b141972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.178+0000 7f7b19028700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b140ffd60 0x7f7b141972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.179+0000 7f7b19028700 1 -- 172.21.15.98:0/3313426536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c009d00 con 0x7f7b140ff3c0 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.179+0000 7f7b19028700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 0x7f7b14196d70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00b070 tx=0x7f7b0c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.179+0000 7f7b127fc700 1 -- 172.21.15.98:0/3313426536 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b0c00e040 con 0x7f7b140ff3c0 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.179+0000 7f7b127fc700 1 -- 172.21.15.98:0/3313426536 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b0c003c10 con 0x7f7b140ff3c0 2024-09-13T02:57:10.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.179+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1419fde0 con 0x7f7b140ff3c0 2024-09-13T02:57:10.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.179+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b141a0250 con 0x7f7b140ff3c0 2024-09-13T02:57:10.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.179+0000 7f7b127fc700 1 -- 172.21.15.98:0/3313426536 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b0c01d740 con 0x7f7b140ff3c0 2024-09-13T02:57:10.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.180+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b141076d0 con 0x7f7b140ff3c0 2024-09-13T02:57:10.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.181+0000 7f7b127fc700 1 -- 172.21.15.98:0/3313426536 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f7b0c004040 con 0x7f7b140ff3c0 2024-09-13T02:57:10.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.181+0000 7f7b127fc700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7afc06e7b0 0x7f7afc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:10.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.182+0000 7f7b18827700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7afc06e7b0 0x7f7afc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:10.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.182+0000 7f7b127fc700 1 -- 172.21.15.98:0/3313426536 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f7b0c0905e0 con 0x7f7b140ff3c0 2024-09-13T02:57:10.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.182+0000 7f7b18827700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7afc06e7b0 0x7f7afc070c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7b14069eb0 tx=0x7f7b0800b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:10.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.185+0000 7f7b127fc700 1 -- 172.21.15.98:0/3313426536 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7b0c0596c0 con 0x7f7b140ff3c0 2024-09-13T02:57:10.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.475+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7b14069500 con 0x7f7b140ff3c0 2024-09-13T02:57:10.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.475+0000 7f7b127fc700 1 -- 172.21.15.98:0/3313426536 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7f7b0c05cd80 con 0x7f7b140ff3c0 2024-09-13T02:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-13T02:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T02:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:57:10.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7afc06e7b0 msgr2=0x7f7afc070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7afc06e7b0 0x7f7afc070c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7b14069eb0 tx=0x7f7b0800b410 comp rx=0 tx=0).stop 2024-09-13T02:57:10.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 msgr2=0x7f7b14196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 0x7f7b14196d70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00b070 tx=0x7f7b0c00cd20 comp rx=0 tx=0).stop 2024-09-13T02:57:10.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 shutdown_connections 2024-09-13T02:57:10.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7afc06e7b0 0x7f7afc070c60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b140ff3c0 0x7f7b14196d70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 --2- 172.21.15.98:0/3313426536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b140ffd60 0x7f7b141972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 >> 172.21.15.98:0/3313426536 conn(0x7f7b140fac60 msgr2=0x7f7b140fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:10.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 shutdown_connections 2024-09-13T02:57:10.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.478+0000 7f7b1b28c700 1 -- 172.21.15.98:0/3313426536 wait complete. 2024-09-13T02:57:10.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.582+0000 7f364c12b700 1 -- 172.21.15.98:0/2045092918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3644104130 msgr2=0x7f3644104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.582+0000 7f364c12b700 1 --2- 172.21.15.98:0/2045092918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3644104130 0x7f3644104500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f364000b0a0 tx=0x7f364000b3b0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.582+0000 7f364c12b700 1 -- 172.21.15.98:0/2045092918 shutdown_connections 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.582+0000 7f364c12b700 1 --2- 172.21.15.98:0/2045092918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36440ffbd0 0x7f3644100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.582+0000 7f364c12b700 1 --2- 172.21.15.98:0/2045092918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3644104130 0x7f3644104500 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.582+0000 7f364c12b700 1 -- 172.21.15.98:0/2045092918 >> 172.21.15.98:0/2045092918 conn(0x7f3644075130 msgr2=0x7f3644075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.582+0000 7f364c12b700 1 -- 172.21.15.98:0/2045092918 shutdown_connections 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.582+0000 7f364c12b700 1 -- 172.21.15.98:0/2045092918 wait complete. 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f364c12b700 1 Processor -- start 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f364c12b700 1 -- start start 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f364c12b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36440ffbd0 0x7f3644198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f364c12b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3644104130 0x7f3644198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:10.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f364c12b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644198c60 con 0x7f36440ffbd0 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f364c12b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364419c9f0 con 0x7f3644104130 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f3649ec7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36440ffbd0 0x7f3644198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f3649ec7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36440ffbd0 0x7f3644198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33640/0 (socket says 172.21.15.98:33640) 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f3649ec7700 1 -- 172.21.15.98:0/2912383641 learned_addr learned my addr 172.21.15.98:0/2912383641 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f36496c6700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3644104130 0x7f3644198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f3649ec7700 1 -- 172.21.15.98:0/2912383641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3644104130 msgr2=0x7f3644198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.583+0000 7f3649ec7700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3644104130 0x7f3644198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.584+0000 7f3649ec7700 1 -- 172.21.15.98:0/2912383641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009d00 con 0x7f36440ffbd0 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.584+0000 7f36496c6700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3644104130 0x7f3644198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.584+0000 7f3649ec7700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36440ffbd0 0x7f3644198040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3640000f80 tx=0x7f364000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.584+0000 7f363affd700 1 -- 172.21.15.98:0/2912383641 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f364000e040 con 0x7f36440ffbd0 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.584+0000 7f363affd700 1 -- 172.21.15.98:0/2912383641 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3640003de0 con 0x7f36440ffbd0 2024-09-13T02:57:10.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.584+0000 7f363affd700 1 -- 172.21.15.98:0/2912383641 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f364001d790 con 0x7f36440ffbd0 2024-09-13T02:57:10.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.584+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364419cc70 con 0x7f36440ffbd0 2024-09-13T02:57:10.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.584+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364419d160 con 0x7f36440ffbd0 2024-09-13T02:57:10.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.585+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364404f2a0 con 0x7f36440ffbd0 2024-09-13T02:57:10.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.585+0000 7f363affd700 1 -- 172.21.15.98:0/2912383641 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3640004040 con 0x7f36440ffbd0 2024-09-13T02:57:10.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.586+0000 7f363affd700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f363006e7c0 0x7f3630070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:10.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.586+0000 7f363affd700 1 -- 172.21.15.98:0/2912383641 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f3640090020 con 0x7f36440ffbd0 2024-09-13T02:57:10.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.586+0000 7f36496c6700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f363006e7c0 0x7f3630070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:10.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.586+0000 7f36496c6700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f363006e7c0 0x7f3630070c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3634005950 tx=0x7f36340058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:10.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.590+0000 7f363affd700 1 -- 172.21.15.98:0/2912383641 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f36400590a0 con 0x7f36440ffbd0 2024-09-13T02:57:10.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:10 smithi098 ceph-mon[87325]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:10 smithi098 ceph-mon[87325]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:10 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3313426536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:10 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:10 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:10 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:10 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:10 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:10.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.851+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f364419d440 con 0x7f36440ffbd0 2024-09-13T02:57:10.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.851+0000 7f363affd700 1 -- 172.21.15.98:0/2912383641 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1941 (secure 0 0 0) 0x7f364005c760 con 0x7f36440ffbd0 2024-09-13T02:57:10.853 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T02:57:10.853 INFO:teuthology.orchestra.run.smithi098.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:57:10.853 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:57:10.853 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:10.853 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T02:57:10.854 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T02:57:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:10.856 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:10.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f363006e7c0 msgr2=0x7f3630070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f363006e7c0 0x7f3630070c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3634005950 tx=0x7f36340058e0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36440ffbd0 msgr2=0x7f3644198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36440ffbd0 0x7f3644198040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3640000f80 tx=0x7f364000cdd0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 shutdown_connections 2024-09-13T02:57:10.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f363006e7c0 0x7f3630070c70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36440ffbd0 0x7f3644198040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 --2- 172.21.15.98:0/2912383641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3644104130 0x7f3644198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 >> 172.21.15.98:0/2912383641 conn(0x7f3644075130 msgr2=0x7f3644068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:10.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 shutdown_connections 2024-09-13T02:57:10.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.854+0000 7f364c12b700 1 -- 172.21.15.98:0/2912383641 wait complete. 2024-09-13T02:57:10.858 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:57:10.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.967+0000 7fbcd47ec700 1 -- 172.21.15.98:0/2804483071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc0ffd60 msgr2=0x7fbccc103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.967+0000 7fbcd47ec700 1 --2- 172.21.15.98:0/2804483071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc0ffd60 0x7fbccc103d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009910 tx=0x7fbcbc009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:10.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.968+0000 7fbcd47ec700 1 -- 172.21.15.98:0/2804483071 shutdown_connections 2024-09-13T02:57:10.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.968+0000 7fbcd47ec700 1 --2- 172.21.15.98:0/2804483071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc0ffd60 0x7fbccc103d30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.968+0000 7fbcd47ec700 1 --2- 172.21.15.98:0/2804483071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbccc0ff3c0 0x7fbccc0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.968+0000 7fbcd47ec700 1 -- 172.21.15.98:0/2804483071 >> 172.21.15.98:0/2804483071 conn(0x7fbccc0fac80 msgr2=0x7fbccc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:10.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.968+0000 7fbcd47ec700 1 -- 172.21.15.98:0/2804483071 shutdown_connections 2024-09-13T02:57:10.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.968+0000 7fbcd47ec700 1 -- 172.21.15.98:0/2804483071 wait complete. 2024-09-13T02:57:10.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd47ec700 1 Processor -- start 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd47ec700 1 -- start start 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd47ec700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbccc0ff3c0 0x7fbccc196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd47ec700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc197410 0x7fbccc197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd47ec700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc19ffd0 con 0x7fbccc197410 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd47ec700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc1a0110 con 0x7fbccc0ff3c0 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd1d87700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc197410 0x7fbccc197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd1d87700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc197410 0x7fbccc197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33654/0 (socket says 172.21.15.98:33654) 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd1d87700 1 -- 172.21.15.98:0/1879041190 learned_addr learned my addr 172.21.15.98:0/1879041190 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd2588700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbccc0ff3c0 0x7fbccc196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd1d87700 1 -- 172.21.15.98:0/1879041190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbccc0ff3c0 msgr2=0x7fbccc196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:10.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd1d87700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbccc0ff3c0 0x7fbccc196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:10.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd1d87700 1 -- 172.21.15.98:0/1879041190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0095f0 con 0x7fbccc197410 2024-09-13T02:57:10.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.969+0000 7fbcd1d87700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc197410 0x7fbccc197880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009fd0 tx=0x7fbcbc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:10.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.970+0000 7fbcc37fe700 1 -- 172.21.15.98:0/1879041190 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc01d070 con 0x7fbccc197410 2024-09-13T02:57:10.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.970+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc1a02b0 con 0x7fbccc197410 2024-09-13T02:57:10.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.970+0000 7fbcc37fe700 1 -- 172.21.15.98:0/1879041190 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbcbc00b610 con 0x7fbccc197410 2024-09-13T02:57:10.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.970+0000 7fbcc37fe700 1 -- 172.21.15.98:0/1879041190 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc003e20 con 0x7fbccc197410 2024-09-13T02:57:10.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.970+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc1a0800 con 0x7fbccc197410 2024-09-13T02:57:10.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.971+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc107730 con 0x7fbccc197410 2024-09-13T02:57:10.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.971+0000 7fbcc37fe700 1 -- 172.21.15.98:0/1879041190 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fbcbc017400 con 0x7fbccc197410 2024-09-13T02:57:10.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.972+0000 7fbcc37fe700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbcb806e7c0 0x7fbcb8070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:10.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.972+0000 7fbcc37fe700 1 -- 172.21.15.98:0/1879041190 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fbcbc08fbc0 con 0x7fbccc197410 2024-09-13T02:57:10.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.972+0000 7fbcd2588700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbcb806e7c0 0x7fbcb8070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:10.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.972+0000 7fbcd2588700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbcb806e7c0 0x7fbcb8070c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009c60 tx=0x7fbcc8009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:10.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:10.976+0000 7fbcc37fe700 1 -- 172.21.15.98:0/1879041190 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbcbc059ba0 con 0x7fbccc197410 2024-09-13T02:57:11.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:10 smithi142 ceph-mon[65447]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:11.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:10 smithi142 ceph-mon[65447]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:11.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:10 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3313426536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:11.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:10 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:11.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:10 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:11.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:10 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:11.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:10 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:11.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:10 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:11.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.207+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbccc0694e0 con 0x7fbcb806e7c0 2024-09-13T02:57:11.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.209+0000 7fbcc37fe700 1 -- 172.21.15.98:0/1879041190 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fbccc0694e0 con 0x7fbcb806e7c0 2024-09-13T02:57:11.210 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "4/23 daemons upgraded", 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:57:11.211 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:57:11.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbcb806e7c0 msgr2=0x7fbcb8070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:11.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbcb806e7c0 0x7fbcb8070c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009c60 tx=0x7fbcc8009260 comp rx=0 tx=0).stop 2024-09-13T02:57:11.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc197410 msgr2=0x7fbccc197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:11.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc197410 0x7fbccc197880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009fd0 tx=0x7fbcbc00f690 comp rx=0 tx=0).stop 2024-09-13T02:57:11.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 shutdown_connections 2024-09-13T02:57:11.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbcb806e7c0 0x7fbcb8070c70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:11.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbccc0ff3c0 0x7fbccc196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:11.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 --2- 172.21.15.98:0/1879041190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbccc197410 0x7fbccc197880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:11.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 >> 172.21.15.98:0/1879041190 conn(0x7fbccc0fac80 msgr2=0x7fbccc0fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:11.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.212+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 shutdown_connections 2024-09-13T02:57:11.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.213+0000 7fbcd47ec700 1 -- 172.21.15.98:0/1879041190 wait complete. 2024-09-13T02:57:11.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.327+0000 7f9653543700 1 -- 172.21.15.98:0/2648035216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 msgr2=0x7f964c104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:11.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.327+0000 7f9653543700 1 --2- 172.21.15.98:0/2648035216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 0x7f964c104eb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f963c009910 tx=0x7f963c009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:11.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.327+0000 7f9653543700 1 -- 172.21.15.98:0/2648035216 shutdown_connections 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.327+0000 7f9653543700 1 --2- 172.21.15.98:0/2648035216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 0x7f964c104eb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.327+0000 7f9653543700 1 --2- 172.21.15.98:0/2648035216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0687a0 0x7f964c068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.327+0000 7f9653543700 1 -- 172.21.15.98:0/2648035216 >> 172.21.15.98:0/2648035216 conn(0x7f964c075130 msgr2=0x7f964c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9653543700 1 -- 172.21.15.98:0/2648035216 shutdown_connections 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9653543700 1 -- 172.21.15.98:0/2648035216 wait complete. 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9653543700 1 Processor -- start 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9653543700 1 -- start start 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9653543700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0687a0 0x7f964c195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9653543700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 0x7f964c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:11.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9653543700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c196a80 con 0x7f964c069140 2024-09-13T02:57:11.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9653543700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c19a810 con 0x7f964c0687a0 2024-09-13T02:57:11.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9650ade700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 0x7f964c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:11.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.328+0000 7f9650ade700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 0x7f964c1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33668/0 (socket says 172.21.15.98:33668) 2024-09-13T02:57:11.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.329+0000 7f9650ade700 1 -- 172.21.15.98:0/2701139001 learned_addr learned my addr 172.21.15.98:0/2701139001 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:11.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.329+0000 7f96512df700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0687a0 0x7f964c195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:11.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.329+0000 7f9650ade700 1 -- 172.21.15.98:0/2701139001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0687a0 msgr2=0x7f964c195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:11.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.329+0000 7f9650ade700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0687a0 0x7f964c195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:11.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.329+0000 7f9650ade700 1 -- 172.21.15.98:0/2701139001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c0095f0 con 0x7f964c069140 2024-09-13T02:57:11.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.329+0000 7f9650ade700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 0x7f964c1963a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f963c0059d0 tx=0x7f963c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:11.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.329+0000 7f96427fc700 1 -- 172.21.15.98:0/2701139001 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f963c01d070 con 0x7f964c069140 2024-09-13T02:57:11.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.330+0000 7f96427fc700 1 -- 172.21.15.98:0/2701139001 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f963c00b610 con 0x7f964c069140 2024-09-13T02:57:11.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.330+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c19aa90 con 0x7f964c069140 2024-09-13T02:57:11.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.330+0000 7f96427fc700 1 -- 172.21.15.98:0/2701139001 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f963c022470 con 0x7f964c069140 2024-09-13T02:57:11.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.330+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c19af80 con 0x7f964c069140 2024-09-13T02:57:11.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.331+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964c108750 con 0x7f964c069140 2024-09-13T02:57:11.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.331+0000 7f96427fc700 1 -- 172.21.15.98:0/2701139001 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f963c0225d0 con 0x7f964c069140 2024-09-13T02:57:11.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.332+0000 7f96427fc700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f963806e7c0 0x7f9638070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:11.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.332+0000 7f96427fc700 1 -- 172.21.15.98:0/2701139001 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f963c08fc70 con 0x7f964c069140 2024-09-13T02:57:11.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.332+0000 7f96512df700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f963806e7c0 0x7f9638070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:11.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.333+0000 7f96512df700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f963806e7c0 0x7f9638070c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9648009c60 tx=0x7f9648009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:11.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.336+0000 7f96427fc700 1 -- 172.21.15.98:0/2701139001 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f963c096080 con 0x7f964c069140 2024-09-13T02:57:11.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.625+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f964c02cc30 con 0x7f964c069140 2024-09-13T02:57:11.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.625+0000 7f96427fc700 1 -- 172.21.15.98:0/2701139001 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f963c059c80 con 0x7f964c069140 2024-09-13T02:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:57:11.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.627+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f963806e7c0 msgr2=0x7f9638070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:11.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.627+0000 7f9653543700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f963806e7c0 0x7f9638070c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9648009c60 tx=0x7f9648009260 comp rx=0 tx=0).stop 2024-09-13T02:57:11.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.627+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 msgr2=0x7f964c1963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:11.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.627+0000 7f9653543700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 0x7f964c1963a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f963c0059d0 tx=0x7f963c00f690 comp rx=0 tx=0).stop 2024-09-13T02:57:11.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.627+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 shutdown_connections 2024-09-13T02:57:11.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.627+0000 7f9653543700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f963806e7c0 0x7f9638070c70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:11.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.628+0000 7f9653543700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f964c0687a0 0x7f964c195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:11.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.628+0000 7f9653543700 1 --2- 172.21.15.98:0/2701139001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f964c069140 0x7f964c1963a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:11.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.628+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 >> 172.21.15.98:0/2701139001 conn(0x7f964c075130 msgr2=0x7f964c104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:11.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.628+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 shutdown_connections 2024-09-13T02:57:11.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:11.628+0000 7f9653543700 1 -- 172.21.15.98:0/2701139001 wait complete. 2024-09-13T02:57:11.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:12.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: Detected new or changed devices on smithi142 2024-09-13T02:57:12.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:12.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: Reconfiguring mon.smithi098 (monmap changed)... 2024-09-13T02:57:12.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:57:12.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:57:12.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:12.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: Reconfiguring daemon mon.smithi098 on smithi098 2024-09-13T02:57:12.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2912383641' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:12.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:11 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2701139001' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: Detected new or changed devices on smithi142 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: Reconfiguring mon.smithi098 (monmap changed)... 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: Reconfiguring daemon mon.smithi098 on smithi098 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2912383641' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:12.067 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:11 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2701139001' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:12.727 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:12 smithi098 ceph-mon[87325]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:12.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:12 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:12.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:12 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:12.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:12 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.ukgenf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:57:12.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:12 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:57:12.728 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:12 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:13.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:12 smithi142 ceph-mon[65447]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:13.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:12 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:13.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:12 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:13.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:12 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi098.ukgenf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:57:13.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:12 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:57:13.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:12 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:13.940 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: Reconfiguring mgr.smithi098.ukgenf (monmap changed)... 2024-09-13T02:57:13.940 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: Reconfiguring daemon mgr.smithi098.ukgenf on smithi098 2024-09-13T02:57:13.940 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:13.940 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:13.940 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:13.940 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:57:13.941 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:57:13.941 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T02:57:13.941 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi098"}]: dispatch 2024-09-13T02:57:13.941 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: Reconfiguring mgr.smithi098.ukgenf (monmap changed)... 2024-09-13T02:57:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: Reconfiguring daemon mgr.smithi098.ukgenf on smithi098 2024-09-13T02:57:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:57:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:57:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T02:57:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi098"}]: dispatch 2024-09-13T02:57:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:14.903 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:14 smithi142 ceph-mon[65447]: Reconfiguring ceph-exporter.smithi098 (monmap changed)... 2024-09-13T02:57:14.903 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:14 smithi142 ceph-mon[65447]: Unable to update caps for client.ceph-exporter.smithi098 2024-09-13T02:57:14.903 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:14 smithi142 ceph-mon[65447]: Reconfiguring daemon ceph-exporter.smithi098 on smithi098 2024-09-13T02:57:14.906 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:14 smithi098 ceph-mon[87325]: Reconfiguring ceph-exporter.smithi098 (monmap changed)... 2024-09-13T02:57:14.906 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:14 smithi098 ceph-mon[87325]: Unable to update caps for client.ceph-exporter.smithi098 2024-09-13T02:57:14.906 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:14 smithi098 ceph-mon[87325]: Reconfiguring daemon ceph-exporter.smithi098 on smithi098 2024-09-13T02:57:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:15 smithi098 ceph-mon[87325]: pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:15 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:15 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:15 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:15 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:16.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:15 smithi142 ceph-mon[65447]: pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:16.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:15 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:16.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:15 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:16.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:15 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:16.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:15 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:16.910 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:16 smithi098 ceph-mon[87325]: Reconfiguring crash.smithi098 (monmap changed)... 2024-09-13T02:57:16.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:16 smithi098 ceph-mon[87325]: Reconfiguring daemon crash.smithi098 on smithi098 2024-09-13T02:57:16.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:16 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:16.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:16 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:16.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:16 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:57:16.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:16 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:16 smithi142 ceph-mon[65447]: Reconfiguring crash.smithi098 (monmap changed)... 2024-09-13T02:57:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:16 smithi142 ceph-mon[65447]: Reconfiguring daemon crash.smithi098 on smithi098 2024-09-13T02:57:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:16 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:16 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:16 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:57:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:16 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:17.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:17 smithi098 ceph-mon[87325]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T02:57:17.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:17 smithi098 ceph-mon[87325]: Reconfiguring daemon osd.0 on smithi098 2024-09-13T02:57:17.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:17 smithi098 ceph-mon[87325]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:18.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:17 smithi142 ceph-mon[65447]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T02:57:18.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:17 smithi142 ceph-mon[65447]: Reconfiguring daemon osd.0 on smithi098 2024-09-13T02:57:18.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:17 smithi142 ceph-mon[65447]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:19.072 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:19.073 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:19.073 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:18 smithi098 ceph-mon[87325]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T02:57:19.073 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:57:19.073 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:19.073 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:18 smithi098 ceph-mon[87325]: Reconfiguring daemon osd.1 on smithi098 2024-09-13T02:57:19.073 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:18 smithi142 ceph-mon[65447]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T02:57:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:57:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:18 smithi142 ceph-mon[65447]: Reconfiguring daemon osd.1 on smithi098 2024-09-13T02:57:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:19 smithi098 ceph-mon[87325]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:57:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:19 smithi142 ceph-mon[65447]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:57:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:21.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:20 smithi098 ceph-mon[87325]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T02:57:21.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:20 smithi098 ceph-mon[87325]: Reconfiguring daemon osd.2 on smithi098 2024-09-13T02:57:21.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:20 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:21.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:20 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:21.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:20 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.nwzstq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:21.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:20 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:20 smithi142 ceph-mon[65447]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T02:57:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:20 smithi142 ceph-mon[65447]: Reconfiguring daemon osd.2 on smithi098 2024-09-13T02:57:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:20 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:20 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:20 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.nwzstq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:20 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:22.006 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:21 smithi098 ceph-mon[87325]: Reconfiguring mds.cephfs.smithi098.nwzstq (monmap changed)... 2024-09-13T02:57:22.006 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:21 smithi098 ceph-mon[87325]: Reconfiguring daemon mds.cephfs.smithi098.nwzstq on smithi098 2024-09-13T02:57:22.006 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:21 smithi098 ceph-mon[87325]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:21 smithi142 ceph-mon[65447]: Reconfiguring mds.cephfs.smithi098.nwzstq (monmap changed)... 2024-09-13T02:57:22.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:21 smithi142 ceph-mon[65447]: Reconfiguring daemon mds.cephfs.smithi098.nwzstq on smithi098 2024-09-13T02:57:22.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:21 smithi142 ceph-mon[65447]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:23 smithi098 ceph-mon[87325]: Reconfiguring mds.cephfs.smithi098.dioppa (monmap changed)... 2024-09-13T02:57:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.dioppa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:23 smithi098 ceph-mon[87325]: Reconfiguring daemon mds.cephfs.smithi098.dioppa on smithi098 2024-09-13T02:57:23.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:23 smithi098 ceph-mon[87325]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:23.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:23.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:23.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:23 smithi142 ceph-mon[65447]: Reconfiguring mds.cephfs.smithi098.dioppa (monmap changed)... 2024-09-13T02:57:23.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.dioppa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:23.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:23.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:23 smithi142 ceph-mon[65447]: Reconfiguring daemon mds.cephfs.smithi098.dioppa on smithi098 2024-09-13T02:57:23.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:23 smithi142 ceph-mon[65447]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:24.982 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:24.982 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:24.983 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-09-13T02:57:24.983 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:57:24.983 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:57:24.983 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T02:57:24.983 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: Unable to update caps for client.ceph-exporter.smithi142 2024-09-13T02:57:24.983 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi142"}]: dispatch 2024-09-13T02:57:24.983 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:24.983 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:24 smithi142 ceph-mon[65447]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: Unable to update caps for client.ceph-exporter.smithi142 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi142"}]: dispatch 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:24.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:24 smithi098 ceph-mon[87325]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-09-13T02:57:25.829 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:25 smithi142 ceph-mon[65447]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:25.829 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:25 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:25.829 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:25 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:25.829 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:25 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:25.829 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:25 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:25 smithi098 ceph-mon[87325]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:25 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:25 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:25 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:25 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:26 smithi142 ceph-mon[65447]: Reconfiguring crash.smithi142 (monmap changed)... 2024-09-13T02:57:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:26 smithi142 ceph-mon[65447]: Reconfiguring daemon crash.smithi142 on smithi142 2024-09-13T02:57:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:26 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:26 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:26 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:57:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:26 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:57:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:26 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:27.247 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:26 smithi098 ceph-mon[87325]: Reconfiguring crash.smithi142 (monmap changed)... 2024-09-13T02:57:27.247 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:26 smithi098 ceph-mon[87325]: Reconfiguring daemon crash.smithi142 on smithi142 2024-09-13T02:57:27.247 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:26 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:27.247 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:26 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:27.247 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:26 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.jutrvi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:57:27.248 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:26 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:57:27.248 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:26 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:28.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:27 smithi142 ceph-mon[65447]: Reconfiguring mgr.smithi142.jutrvi (monmap changed)... 2024-09-13T02:57:28.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:27 smithi142 ceph-mon[65447]: Reconfiguring daemon mgr.smithi142.jutrvi on smithi142 2024-09-13T02:57:28.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:27 smithi142 ceph-mon[65447]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:27 smithi098 ceph-mon[87325]: Reconfiguring mgr.smithi142.jutrvi (monmap changed)... 2024-09-13T02:57:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:27 smithi098 ceph-mon[87325]: Reconfiguring daemon mgr.smithi142.jutrvi on smithi142 2024-09-13T02:57:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:27 smithi098 ceph-mon[87325]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:29.162 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:29.162 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:29.162 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:28 smithi142 ceph-mon[65447]: Reconfiguring mon.smithi142 (monmap changed)... 2024-09-13T02:57:29.162 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:57:29.162 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:57:29.163 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:29.163 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:28 smithi142 ceph-mon[65447]: Reconfiguring daemon mon.smithi142 on smithi142 2024-09-13T02:57:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:28 smithi098 ceph-mon[87325]: Reconfiguring mon.smithi142 (monmap changed)... 2024-09-13T02:57:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:57:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:57:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:28 smithi098 ceph-mon[87325]: Reconfiguring daemon mon.smithi142 on smithi142 2024-09-13T02:57:30.155 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:29 smithi142 ceph-mon[65447]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:30.155 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:30.156 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:30.156 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:57:30.156 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:29 smithi098 ceph-mon[87325]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:57:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:31.117 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:30 smithi142 ceph-mon[65447]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T02:57:31.117 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:30 smithi142 ceph-mon[65447]: Reconfiguring daemon osd.3 on smithi142 2024-09-13T02:57:31.117 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:30 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:31.118 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:30 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:31.118 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:30 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:57:31.118 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:30 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:30 smithi098 ceph-mon[87325]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T02:57:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:30 smithi098 ceph-mon[87325]: Reconfiguring daemon osd.3 on smithi142 2024-09-13T02:57:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:30 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:30 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:30 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:57:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:30 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:31 smithi098 ceph-mon[87325]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T02:57:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:31 smithi098 ceph-mon[87325]: Reconfiguring daemon osd.4 on smithi142 2024-09-13T02:57:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:31 smithi098 ceph-mon[87325]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:31 smithi142 ceph-mon[65447]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T02:57:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:31 smithi142 ceph-mon[65447]: Reconfiguring daemon osd.4 on smithi142 2024-09-13T02:57:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:31 smithi142 ceph-mon[65447]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:33.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:32 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:33.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:32 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:33.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:32 smithi098 ceph-mon[87325]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T02:57:33.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:32 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:57:33.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:32 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:33.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:32 smithi098 ceph-mon[87325]: Reconfiguring daemon osd.5 on smithi142 2024-09-13T02:57:33.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:32 smithi098 ceph-mon[87325]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:33.235 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:32 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:33.235 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:32 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:33.235 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:32 smithi142 ceph-mon[65447]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T02:57:33.235 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:32 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:57:33.236 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:32 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:33.236 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:32 smithi142 ceph-mon[65447]: Reconfiguring daemon osd.5 on smithi142 2024-09-13T02:57:33.236 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:32 smithi142 ceph-mon[65447]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:34.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:34 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:34.634 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:34 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:34.634 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:34 smithi142 ceph-mon[65447]: Reconfiguring mds.cephfs.smithi142.wxfmvt (monmap changed)... 2024-09-13T02:57:34.634 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:34 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.wxfmvt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:34.634 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:34 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:34.634 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:34 smithi142 ceph-mon[65447]: Reconfiguring daemon mds.cephfs.smithi142.wxfmvt on smithi142 2024-09-13T02:57:34.634 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:34 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:34.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:34 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:34.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:34 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:34.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:34 smithi098 ceph-mon[87325]: Reconfiguring mds.cephfs.smithi142.wxfmvt (monmap changed)... 2024-09-13T02:57:34.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:34 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.wxfmvt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:34.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:34 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:34.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:34 smithi098 ceph-mon[87325]: Reconfiguring daemon mds.cephfs.smithi142.wxfmvt on smithi142 2024-09-13T02:57:34.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:34 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:35 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:35 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:35 smithi098 ceph-mon[87325]: Reconfiguring mds.cephfs.smithi142.hplrrs (monmap changed)... 2024-09-13T02:57:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:35 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.hplrrs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:35 smithi098 ceph-mon[87325]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:35 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:35.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:35 smithi098 ceph-mon[87325]: Reconfiguring daemon mds.cephfs.smithi142.hplrrs on smithi142 2024-09-13T02:57:36.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:35 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:36.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:35 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:36.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:35 smithi142 ceph-mon[65447]: Reconfiguring mds.cephfs.smithi142.hplrrs (monmap changed)... 2024-09-13T02:57:36.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:35 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.hplrrs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:36.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:35 smithi142 ceph-mon[65447]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:36.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:35 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:36.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:35 smithi142 ceph-mon[65447]: Reconfiguring daemon mds.cephfs.smithi142.hplrrs on smithi142 2024-09-13T02:57:37.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:37.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:37.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:37.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:37.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:37.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all mon 2024-09-13T02:57:37.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:37.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]: dispatch 2024-09-13T02:57:37.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]': finished 2024-09-13T02:57:37.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]: dispatch 2024-09-13T02:57:37.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]': finished 2024-09-13T02:57:37.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:37 smithi098 ceph-mon[87325]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:37.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all mon 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]: dispatch 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi098"}]': finished 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]: dispatch 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]': finished 2024-09-13T02:57:37.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:37 smithi142 ceph-mon[65447]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:38 smithi098 ceph-mon[87325]: Upgrade: Updating crash.smithi098 (1/2) 2024-09-13T02:57:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:38 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:38 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:38.831 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:38 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:38.832 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:38 smithi098 ceph-mon[87325]: Deploying daemon crash.smithi098 on smithi098 2024-09-13T02:57:39.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:38 smithi142 ceph-mon[65447]: Upgrade: Updating crash.smithi098 (1/2) 2024-09-13T02:57:39.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:38 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:39.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:38 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi098", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:39.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:38 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:39.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:38 smithi142 ceph-mon[65447]: Deploying daemon crash.smithi098 on smithi098 2024-09-13T02:57:39.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:39 smithi098 ceph-mon[87325]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T02:57:40.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:39 smithi142 ceph-mon[65447]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T02:57:41.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.738+0000 7f172e77c700 1 -- 172.21.15.98:0/2204580426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17280ffbd0 msgr2=0x7f1728100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:41.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.738+0000 7f172e77c700 1 --2- 172.21.15.98:0/2204580426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17280ffbd0 0x7f1728100040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1710009910 tx=0x7f1710009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.738+0000 7f172e77c700 1 -- 172.21.15.98:0/2204580426 shutdown_connections 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.738+0000 7f172e77c700 1 --2- 172.21.15.98:0/2204580426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17280ffbd0 0x7f1728100040 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.738+0000 7f172e77c700 1 --2- 172.21.15.98:0/2204580426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1728104130 0x7f1728104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.738+0000 7f172e77c700 1 -- 172.21.15.98:0/2204580426 >> 172.21.15.98:0/2204580426 conn(0x7f1728075130 msgr2=0x7f1728075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.738+0000 7f172e77c700 1 -- 172.21.15.98:0/2204580426 shutdown_connections 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.738+0000 7f172e77c700 1 -- 172.21.15.98:0/2204580426 wait complete. 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.739+0000 7f172e77c700 1 Processor -- start 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.739+0000 7f172e77c700 1 -- start start 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.739+0000 7f172e77c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17280ffbd0 0x7f1728100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.739+0000 7f172e77c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1728104130 0x7f1728101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:41.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.739+0000 7f172e77c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17281018b0 con 0x7f1728104130 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.739+0000 7f172e77c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17281019f0 con 0x7f17280ffbd0 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17277fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1728104130 0x7f1728101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17277fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1728104130 0x7f1728101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40350/0 (socket says 172.21.15.98:40350) 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17277fe700 1 -- 172.21.15.98:0/1773343982 learned_addr learned my addr 172.21.15.98:0/1773343982 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f1727fff700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17280ffbd0 0x7f1728100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17277fe700 1 -- 172.21.15.98:0/1773343982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17280ffbd0 msgr2=0x7f1728100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17277fe700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17280ffbd0 0x7f1728100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17277fe700 1 -- 172.21.15.98:0/1773343982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17100095f0 con 0x7f1728104130 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17277fe700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1728104130 0x7f1728101370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f171000bd70 tx=0x7f171000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17257fa700 1 -- 172.21.15.98:0/1773343982 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f171001d070 con 0x7f1728104130 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1728101c70 con 0x7f1728104130 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17257fa700 1 -- 172.21.15.98:0/1773343982 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1710005dc0 con 0x7f1728104130 2024-09-13T02:57:41.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f17257fa700 1 -- 172.21.15.98:0/1773343982 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1710017400 con 0x7f1728104130 2024-09-13T02:57:41.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.740+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17281a2320 con 0x7f1728104130 2024-09-13T02:57:41.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.741+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17281086a0 con 0x7f1728104130 2024-09-13T02:57:41.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.742+0000 7f17257fa700 1 -- 172.21.15.98:0/1773343982 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f17100175c0 con 0x7f1728104130 2024-09-13T02:57:41.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.742+0000 7f17257fa700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f171406e7c0 0x7f1714070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:41.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.743+0000 7f1727fff700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f171406e7c0 0x7f1714070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:41.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.743+0000 7f17257fa700 1 -- 172.21.15.98:0/1773343982 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f171008fcc0 con 0x7f1728104130 2024-09-13T02:57:41.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.743+0000 7f1727fff700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f171406e7c0 0x7f1714070c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1718005950 tx=0x7f171800b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:41.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.747+0000 7f17257fa700 1 -- 172.21.15.98:0/1773343982 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1710058e70 con 0x7f1728104130 2024-09-13T02:57:41.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.966+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1728061190 con 0x7f171406e7c0 2024-09-13T02:57:41.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:41 smithi098 ceph-mon[87325]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:41.968 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:41 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:41.969 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:41 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:41.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.968+0000 7f17257fa700 1 -- 172.21.15.98:0/1773343982 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f1728061190 con 0x7f171406e7c0 2024-09-13T02:57:41.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f171406e7c0 msgr2=0x7f1714070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:41.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f171406e7c0 0x7f1714070c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1718005950 tx=0x7f171800b410 comp rx=0 tx=0).stop 2024-09-13T02:57:41.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1728104130 msgr2=0x7f1728101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:41.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1728104130 0x7f1728101370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f171000bd70 tx=0x7f171000bda0 comp rx=0 tx=0).stop 2024-09-13T02:57:41.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 shutdown_connections 2024-09-13T02:57:41.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f171406e7c0 0x7f1714070c70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:41.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17280ffbd0 0x7f1728100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:41.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 --2- 172.21.15.98:0/1773343982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1728104130 0x7f1728101370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:41.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 >> 172.21.15.98:0/1773343982 conn(0x7f1728075130 msgr2=0x7f17280fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:41.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 shutdown_connections 2024-09-13T02:57:41.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:41.970+0000 7f172e77c700 1 -- 172.21.15.98:0/1773343982 wait complete. 2024-09-13T02:57:41.982 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:57:41.982 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:41 smithi142 ceph-mon[65447]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:41.982 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:41 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:41.982 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:41 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.076+0000 7fb15f992700 1 -- 172.21.15.98:0/4192799866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101d30 msgr2=0x7fb15810a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.076+0000 7fb15f992700 1 --2- 172.21.15.98:0/4192799866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101d30 0x7fb15810a230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb148009910 tx=0x7fb148009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.076+0000 7fb15f992700 1 -- 172.21.15.98:0/4192799866 shutdown_connections 2024-09-13T02:57:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.076+0000 7fb15f992700 1 --2- 172.21.15.98:0/4192799866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101d30 0x7fb15810a230 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.076+0000 7fb15f992700 1 --2- 172.21.15.98:0/4192799866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb158101420 0x7fb1581017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.076+0000 7fb15f992700 1 -- 172.21.15.98:0/4192799866 >> 172.21.15.98:0/4192799866 conn(0x7fb1580fac80 msgr2=0x7fb1580fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.076+0000 7fb15f992700 1 -- 172.21.15.98:0/4192799866 shutdown_connections 2024-09-13T02:57:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.076+0000 7fb15f992700 1 -- 172.21.15.98:0/4192799866 wait complete. 2024-09-13T02:57:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.076+0000 7fb15f992700 1 Processor -- start 2024-09-13T02:57:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15f992700 1 -- start start 2024-09-13T02:57:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15f992700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101420 0x7fb158195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15f992700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb158101d30 0x7fb1581963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15f992700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb158196a80 con 0x7fb158101420 2024-09-13T02:57:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15f992700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15819a810 con 0x7fb158101d30 2024-09-13T02:57:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15d72e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101420 0x7fb158195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15d72e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101420 0x7fb158195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40364/0 (socket says 172.21.15.98:40364) 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15d72e700 1 -- 172.21.15.98:0/2918397832 learned_addr learned my addr 172.21.15.98:0/2918397832 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15d72e700 1 -- 172.21.15.98:0/2918397832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb158101d30 msgr2=0x7fb1581963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15d72e700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb158101d30 0x7fb1581963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15d72e700 1 -- 172.21.15.98:0/2918397832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1480095f0 con 0x7fb158101420 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15d72e700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101420 0x7fb158195e60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb15400d8d0 tx=0x7fb15400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb14e7fc700 1 -- 172.21.15.98:0/2918397832 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb154009940 con 0x7fb158101420 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15819aaf0 con 0x7fb158101420 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb14e7fc700 1 -- 172.21.15.98:0/2918397832 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb154010460 con 0x7fb158101420 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.077+0000 7fb14e7fc700 1 -- 172.21.15.98:0/2918397832 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb15400f5f0 con 0x7fb158101420 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.078+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15819b040 con 0x7fb158101420 2024-09-13T02:57:42.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.078+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1581078a0 con 0x7fb158101420 2024-09-13T02:57:42.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.079+0000 7fb14e7fc700 1 -- 172.21.15.98:0/2918397832 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fb1540105d0 con 0x7fb158101420 2024-09-13T02:57:42.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.080+0000 7fb14e7fc700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb14406e7b0 0x7fb144070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:42.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.080+0000 7fb14e7fc700 1 -- 172.21.15.98:0/2918397832 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb15408e800 con 0x7fb158101420 2024-09-13T02:57:42.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.080+0000 7fb15cf2d700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb14406e7b0 0x7fb144070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:42.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.080+0000 7fb15cf2d700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb14406e7b0 0x7fb144070c60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb148006010 tx=0x7fb14800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:42.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.084+0000 7fb14e7fc700 1 -- 172.21.15.98:0/2918397832 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb154057880 con 0x7fb158101420 2024-09-13T02:57:42.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.324+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb15819b2d0 con 0x7fb14406e7b0 2024-09-13T02:57:42.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.325+0000 7fb14e7fc700 1 -- 172.21.15.98:0/2918397832 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fb15819b2d0 con 0x7fb14406e7b0 2024-09-13T02:57:42.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb14406e7b0 msgr2=0x7fb144070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb14406e7b0 0x7fb144070c60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb148006010 tx=0x7fb14800b540 comp rx=0 tx=0).stop 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101420 msgr2=0x7fb158195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101420 0x7fb158195e60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb15400d8d0 tx=0x7fb15400dc90 comp rx=0 tx=0).stop 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 shutdown_connections 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb14406e7b0 0x7fb144070c60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb158101420 0x7fb158195e60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 --2- 172.21.15.98:0/2918397832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb158101d30 0x7fb1581963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 >> 172.21.15.98:0/2918397832 conn(0x7fb1580fac80 msgr2=0x7fb1581049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 shutdown_connections 2024-09-13T02:57:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.328+0000 7fb15f992700 1 -- 172.21.15.98:0/2918397832 wait complete. 2024-09-13T02:57:42.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.437+0000 7fa31da4a700 1 -- 172.21.15.98:0/2993081476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ff3c0 msgr2=0x7fa3180ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.437+0000 7fa31da4a700 1 --2- 172.21.15.98:0/2993081476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ff3c0 0x7fa3180ff790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa308009910 tx=0x7fa308009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:42.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.437+0000 7fa31da4a700 1 -- 172.21.15.98:0/2993081476 shutdown_connections 2024-09-13T02:57:42.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.437+0000 7fa31da4a700 1 --2- 172.21.15.98:0/2993081476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3180ffd60 0x7fa318103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.437+0000 7fa31da4a700 1 --2- 172.21.15.98:0/2993081476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ff3c0 0x7fa3180ff790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.437+0000 7fa31da4a700 1 -- 172.21.15.98:0/2993081476 >> 172.21.15.98:0/2993081476 conn(0x7fa3180fac80 msgr2=0x7fa3180fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:42.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.437+0000 7fa31da4a700 1 -- 172.21.15.98:0/2993081476 shutdown_connections 2024-09-13T02:57:42.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.437+0000 7fa31da4a700 1 -- 172.21.15.98:0/2993081476 wait complete. 2024-09-13T02:57:42.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.438+0000 7fa31da4a700 1 Processor -- start 2024-09-13T02:57:42.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.438+0000 7fa31da4a700 1 -- start start 2024-09-13T02:57:42.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.438+0000 7fa31da4a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3180ff3c0 0x7fa318195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:42.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.438+0000 7fa31da4a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ffd60 0x7fa318196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.438+0000 7fa31da4a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa318196ae0 con 0x7fa3180ffd60 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.438+0000 7fa31da4a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31819a870 con 0x7fa3180ff3c0 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa3167fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ffd60 0x7fa318196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa3167fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ffd60 0x7fa318196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40388/0 (socket says 172.21.15.98:40388) 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa3167fc700 1 -- 172.21.15.98:0/1063720983 learned_addr learned my addr 172.21.15.98:0/1063720983 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa316ffd700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3180ff3c0 0x7fa318195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa3167fc700 1 -- 172.21.15.98:0/1063720983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3180ff3c0 msgr2=0x7fa318195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa3167fc700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3180ff3c0 0x7fa318195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa3167fc700 1 -- 172.21.15.98:0/1063720983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080095f0 con 0x7fa3180ffd60 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa316ffd700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3180ff3c0 0x7fa318195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:57:42.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa3167fc700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ffd60 0x7fa318196400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00e970 tx=0x7fa30c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:42.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa31ca48700 1 -- 172.21.15.98:0/1063720983 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30c00c9d0 con 0x7fa3180ffd60 2024-09-13T02:57:42.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa31ca48700 1 -- 172.21.15.98:0/1063720983 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa30c004830 con 0x7fa3180ffd60 2024-09-13T02:57:42.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31819ab50 con 0x7fa3180ffd60 2024-09-13T02:57:42.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa31ca48700 1 -- 172.21.15.98:0/1063720983 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30c005660 con 0x7fa3180ffd60 2024-09-13T02:57:42.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.439+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31819b0a0 con 0x7fa3180ffd60 2024-09-13T02:57:42.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.440+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31804f2a0 con 0x7fa3180ffd60 2024-09-13T02:57:42.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.441+0000 7fa31ca48700 1 -- 172.21.15.98:0/1063720983 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa30c00cb30 con 0x7fa3180ffd60 2024-09-13T02:57:42.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.441+0000 7fa31ca48700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa30006e7c0 0x7fa300070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:42.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.442+0000 7fa31ca48700 1 -- 172.21.15.98:0/1063720983 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa30c014070 con 0x7fa3180ffd60 2024-09-13T02:57:42.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.442+0000 7fa316ffd700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa30006e7c0 0x7fa300070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:42.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.442+0000 7fa316ffd700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa30006e7c0 0x7fa300070c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa30800b760 tx=0x7fa308005940 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:42.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.449+0000 7fa31ca48700 1 -- 172.21.15.98:0/1063720983 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa30c057b60 con 0x7fa3180ffd60 2024-09-13T02:57:42.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.670+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa31819b410 con 0x7fa30006e7c0 2024-09-13T02:57:42.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.680+0000 7fa31ca48700 1 -- 172.21.15.98:0/1063720983 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa31819b410 con 0x7fa30006e7c0 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (2m) 48s ago 13m 21.5M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (13m) 48s ago 13m 8082k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (12m) 35s ago 12m 7696k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 starting - - - - 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (12m) 35s ago 12m 6673k - 18.2.0 dc2bc1663786 a0064646988e 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (2m) 48s ago 12m 73.7M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (7m) 48s ago 7m 94.3M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (7m) 48s ago 7m 153M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (7m) 35s ago 7m 15.5M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:57:42.682 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (7m) 35s ago 7m 18.9M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (4m) 48s ago 14m 473M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (3m) 35s ago 12m 438M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (60s) 48s ago 14m 29.1M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (39s) 35s ago 12m 25.3M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (3m) 48s ago 13m 16.8M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (3m) 35s ago 12m 15.1M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (11m) 48s ago 11m 213M 1216M 18.2.0 dc2bc1663786 1ba4012419d8 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (10m) 48s ago 10m 222M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (10m) 48s ago 10m 186M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (10m) 35s ago 10m 239M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (9m) 35s ago 9m 213M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (9m) 35s ago 9m 196M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:57:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (2m) 48s ago 12m 76.1M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:57:42.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.682+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa30006e7c0 msgr2=0x7fa300070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.682+0000 7fa31da4a700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa30006e7c0 0x7fa300070c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa30800b760 tx=0x7fa308005940 comp rx=0 tx=0).stop 2024-09-13T02:57:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.682+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ffd60 msgr2=0x7fa318196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.682+0000 7fa31da4a700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ffd60 0x7fa318196400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00e970 tx=0x7fa30c00ec80 comp rx=0 tx=0).stop 2024-09-13T02:57:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.682+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 shutdown_connections 2024-09-13T02:57:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.682+0000 7fa31da4a700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa30006e7c0 0x7fa300070c70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.682+0000 7fa31da4a700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3180ff3c0 0x7fa318195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.682+0000 7fa31da4a700 1 --2- 172.21.15.98:0/1063720983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3180ffd60 0x7fa318196400 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.682+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 >> 172.21.15.98:0/1063720983 conn(0x7fa3180fac80 msgr2=0x7fa318068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.683+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 shutdown_connections 2024-09-13T02:57:42.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.683+0000 7fa31da4a700 1 -- 172.21.15.98:0/1063720983 wait complete. 2024-09-13T02:57:42.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.794+0000 7f70c5fca700 1 -- 172.21.15.98:0/1880401278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 msgr2=0x7f70c0100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.794+0000 7f70c5fca700 1 --2- 172.21.15.98:0/1880401278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 0x7f70c0100830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009910 tx=0x7f70b0009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:42.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.794+0000 7f70c5fca700 1 -- 172.21.15.98:0/1880401278 shutdown_connections 2024-09-13T02:57:42.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.794+0000 7f70c5fca700 1 --2- 172.21.15.98:0/1880401278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c0100d70 0x7f70c01094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.794+0000 7f70c5fca700 1 --2- 172.21.15.98:0/1880401278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 0x7f70c0100830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.794+0000 7f70c5fca700 1 -- 172.21.15.98:0/1880401278 >> 172.21.15.98:0/1880401278 conn(0x7f70c00748b0 msgr2=0x7f70c0074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:42.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.794+0000 7f70c5fca700 1 -- 172.21.15.98:0/1880401278 shutdown_connections 2024-09-13T02:57:42.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.795+0000 7f70c5fca700 1 -- 172.21.15.98:0/1880401278 wait complete. 2024-09-13T02:57:42.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.795+0000 7f70c5fca700 1 Processor -- start 2024-09-13T02:57:42.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70c5fca700 1 -- start start 2024-09-13T02:57:42.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70c5fca700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 0x7f70c0196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:42.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70c5fca700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c0100d70 0x7f70c01972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:42.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70c5fca700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c01978d0 con 0x7f70c0100460 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70c5fca700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c0197a10 con 0x7f70c0100d70 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70bf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 0x7f70c0196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70bf7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 0x7f70c0196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40402/0 (socket says 172.21.15.98:40402) 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70bf7fe700 1 -- 172.21.15.98:0/4167552228 learned_addr learned my addr 172.21.15.98:0/4167552228 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70beffd700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c0100d70 0x7f70c01972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70bf7fe700 1 -- 172.21.15.98:0/4167552228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c0100d70 msgr2=0x7f70c01972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70bf7fe700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c0100d70 0x7f70c01972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.796+0000 7f70bf7fe700 1 -- 172.21.15.98:0/4167552228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00095f0 con 0x7f70c0100460 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.797+0000 7f70bf7fe700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 0x7f70c0196d70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f70b0000c00 tx=0x7f70b000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.797+0000 7f70bcff9700 1 -- 172.21.15.98:0/4167552228 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b0003a60 con 0x7f70c0100460 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.797+0000 7f70bcff9700 1 -- 172.21.15.98:0/4167552228 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70b0003bc0 con 0x7f70c0100460 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.797+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c0194b60 con 0x7f70c0100460 2024-09-13T02:57:42.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.797+0000 7f70bcff9700 1 -- 172.21.15.98:0/4167552228 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b001d680 con 0x7f70c0100460 2024-09-13T02:57:42.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.797+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c0195050 con 0x7f70c0100460 2024-09-13T02:57:42.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.798+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c0197bd0 con 0x7f70c0100460 2024-09-13T02:57:42.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.799+0000 7f70bcff9700 1 -- 172.21.15.98:0/4167552228 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f70b000f9b0 con 0x7f70c0100460 2024-09-13T02:57:42.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.799+0000 7f70bcff9700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f70a806e7c0 0x7f70a8070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:42.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.799+0000 7f70bcff9700 1 -- 172.21.15.98:0/4167552228 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f70b00940c0 con 0x7f70c0100460 2024-09-13T02:57:42.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.799+0000 7f70beffd700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f70a806e7c0 0x7f70a8070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:42.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.800+0000 7f70beffd700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f70a806e7c0 0x7f70a8070c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f70b4005950 tx=0x7f70b40058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:42.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:42.804+0000 7f70bcff9700 1 -- 172.21.15.98:0/4167552228 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f70b005d1c0 con 0x7f70c0100460 2024-09-13T02:57:43.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.098+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f70c0106bd0 con 0x7f70c0100460 2024-09-13T02:57:43.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.099+0000 7f70bcff9700 1 -- 172.21.15.98:0/4167552228 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7f70b0003d30 con 0x7f70c0100460 2024-09-13T02:57:43.100 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:57:43.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:57:43.102 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:57:43.102 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-13T02:57:43.102 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T02:57:43.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:57:43.102 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:57:43.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f70a806e7c0 msgr2=0x7f70a8070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f70a806e7c0 0x7f70a8070c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f70b4005950 tx=0x7f70b40058e0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 msgr2=0x7f70c0196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 0x7f70c0196d70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f70b0000c00 tx=0x7f70b000be20 comp rx=0 tx=0).stop 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 shutdown_connections 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f70a806e7c0 0x7f70a8070c70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70c0100460 0x7f70c0196d70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 --2- 172.21.15.98:0/4167552228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70c0100d70 0x7f70c01972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 >> 172.21.15.98:0/4167552228 conn(0x7f70c00748b0 msgr2=0x7f70c0103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 shutdown_connections 2024-09-13T02:57:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.101+0000 7f70c5fca700 1 -- 172.21.15.98:0/4167552228 wait complete. 2024-09-13T02:57:43.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.208+0000 7fa0d251f700 1 -- 172.21.15.98:0/690854833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc1004c0 msgr2=0x7fa0cc100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.208+0000 7fa0d251f700 1 --2- 172.21.15.98:0/690854833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc1004c0 0x7fa0cc100890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009910 tx=0x7fa0bc009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:43.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.208+0000 7fa0d251f700 1 -- 172.21.15.98:0/690854833 shutdown_connections 2024-09-13T02:57:43.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.208+0000 7fa0d251f700 1 --2- 172.21.15.98:0/690854833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0cc100e60 0x7fa0cc104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.208+0000 7fa0d251f700 1 --2- 172.21.15.98:0/690854833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc1004c0 0x7fa0cc100890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.208+0000 7fa0d251f700 1 -- 172.21.15.98:0/690854833 >> 172.21.15.98:0/690854833 conn(0x7fa0cc0fbd80 msgr2=0x7fa0cc0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:43.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.208+0000 7fa0d251f700 1 -- 172.21.15.98:0/690854833 shutdown_connections 2024-09-13T02:57:43.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.208+0000 7fa0d251f700 1 -- 172.21.15.98:0/690854833 wait complete. 2024-09-13T02:57:43.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.209+0000 7fa0d251f700 1 Processor -- start 2024-09-13T02:57:43.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.209+0000 7fa0d251f700 1 -- start start 2024-09-13T02:57:43.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.209+0000 7fa0d251f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0cc1004c0 0x7fa0cc195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.209+0000 7fa0d251f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc100e60 0x7fa0cc196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.209+0000 7fa0d251f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc196ac0 con 0x7fa0cc100e60 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.209+0000 7fa0d251f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc196c00 con 0x7fa0cc1004c0 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0cb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc100e60 0x7fa0cc196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0cb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc100e60 0x7fa0cc196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40412/0 (socket says 172.21.15.98:40412) 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0cb7fe700 1 -- 172.21.15.98:0/4130374598 learned_addr learned my addr 172.21.15.98:0/4130374598 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0cbfff700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0cc1004c0 0x7fa0cc195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0cb7fe700 1 -- 172.21.15.98:0/4130374598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0cc1004c0 msgr2=0x7fa0cc195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0cb7fe700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0cc1004c0 0x7fa0cc195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0cb7fe700 1 -- 172.21.15.98:0/4130374598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0095f0 con 0x7fa0cc100e60 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0cb7fe700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc100e60 0x7fa0cc196470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000c960 tx=0x7fa0c000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0c97fa700 1 -- 172.21.15.98:0/4130374598 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c0007a70 con 0x7fa0cc100e60 2024-09-13T02:57:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0c97fa700 1 -- 172.21.15.98:0/4130374598 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0c0007bd0 con 0x7fa0cc100e60 2024-09-13T02:57:43.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc19aa50 con 0x7fa0cc100e60 2024-09-13T02:57:43.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0c97fa700 1 -- 172.21.15.98:0/4130374598 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c00186c0 con 0x7fa0cc100e60 2024-09-13T02:57:43.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.210+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc19afa0 con 0x7fa0cc100e60 2024-09-13T02:57:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.211+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc1087d0 con 0x7fa0cc100e60 2024-09-13T02:57:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.212+0000 7fa0c97fa700 1 -- 172.21.15.98:0/4130374598 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa0c0018820 con 0x7fa0cc100e60 2024-09-13T02:57:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.212+0000 7fa0c97fa700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa0b406e7b0 0x7fa0b4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.212+0000 7fa0c97fa700 1 -- 172.21.15.98:0/4130374598 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa0c008e7c0 con 0x7fa0cc100e60 2024-09-13T02:57:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.212+0000 7fa0cbfff700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa0b406e7b0 0x7fa0b4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.213+0000 7fa0cbfff700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa0b406e7b0 0x7fa0b4070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc006010 tx=0x7fa0bc01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:43.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.217+0000 7fa0c97fa700 1 -- 172.21.15.98:0/4130374598 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa0c005b460 con 0x7fa0cc100e60 2024-09-13T02:57:43.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.468+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa0cc1081b0 con 0x7fa0cc100e60 2024-09-13T02:57:43.470 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:43.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: Upgrade: Updating crash.smithi142 (2/2) 2024-09-13T02:57:43.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:43.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:43.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:43.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: Deploying daemon crash.smithi142 on smithi142 2024-09-13T02:57:43.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:43.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:43.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T02:57:43.471 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:43 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/4167552228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:43.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.469+0000 7fa0c97fa700 1 -- 172.21.15.98:0/4130374598 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1941 (secure 0 0 0) 0x7fa0c005aff0 con 0x7fa0cc100e60 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T02:57:43.472 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T02:57:43.473 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:43.474 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:43.475 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:57:43.475 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:57:43.475 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T02:57:43.475 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:57:43.475 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:43.475 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:43.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa0b406e7b0 msgr2=0x7fa0b4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa0b406e7b0 0x7fa0b4070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc006010 tx=0x7fa0bc01a040 comp rx=0 tx=0).stop 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc100e60 msgr2=0x7fa0cc196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc100e60 0x7fa0cc196470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000c960 tx=0x7fa0c000cd20 comp rx=0 tx=0).stop 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 shutdown_connections 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa0b406e7b0 0x7fa0b4070c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0cc1004c0 0x7fa0cc195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 --2- 172.21.15.98:0/4130374598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0cc100e60 0x7fa0cc196470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 >> 172.21.15.98:0/4130374598 conn(0x7fa0cc0fbd80 msgr2=0x7fa0cc0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 shutdown_connections 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.472+0000 7fa0d251f700 1 -- 172.21.15.98:0/4130374598 wait complete. 2024-09-13T02:57:43.476 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:57:43.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.583+0000 7f569c79c700 1 -- 172.21.15.98:0/1118281685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ff350 msgr2=0x7f56940ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.583+0000 7f569c79c700 1 --2- 172.21.15.98:0/1118281685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ff350 0x7f56940ff720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f568400b0a0 tx=0x7f568400b3b0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.583+0000 7f569c79c700 1 -- 172.21.15.98:0/1118281685 shutdown_connections 2024-09-13T02:57:43.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.583+0000 7f569c79c700 1 --2- 172.21.15.98:0/1118281685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56940ffc60 0x7f569410a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.583+0000 7f569c79c700 1 --2- 172.21.15.98:0/1118281685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ff350 0x7f56940ff720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.583+0000 7f569c79c700 1 -- 172.21.15.98:0/1118281685 >> 172.21.15.98:0/1118281685 conn(0x7f56940748b0 msgr2=0x7f5694074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:43.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.583+0000 7f569c79c700 1 -- 172.21.15.98:0/1118281685 shutdown_connections 2024-09-13T02:57:43.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.583+0000 7f569c79c700 1 -- 172.21.15.98:0/1118281685 wait complete. 2024-09-13T02:57:43.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f569c79c700 1 Processor -- start 2024-09-13T02:57:43.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f569c79c700 1 -- start start 2024-09-13T02:57:43.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f569c79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56940ff350 0x7f5694195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f569c79c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ffc60 0x7f56941964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f569c79c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5694196b80 con 0x7f56940ffc60 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f569c79c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569419a910 con 0x7f56940ff350 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f5699d37700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ffc60 0x7f56941964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f5699d37700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ffc60 0x7f56941964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40428/0 (socket says 172.21.15.98:40428) 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f569a538700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56940ff350 0x7f5694195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.584+0000 7f5699d37700 1 -- 172.21.15.98:0/260281558 learned_addr learned my addr 172.21.15.98:0/260281558 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.585+0000 7f5699d37700 1 -- 172.21.15.98:0/260281558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56940ff350 msgr2=0x7f5694195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.585+0000 7f5699d37700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56940ff350 0x7f5694195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.585+0000 7f5699d37700 1 -- 172.21.15.98:0/260281558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5684009d00 con 0x7f56940ffc60 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.585+0000 7f5699d37700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ffc60 0x7f56941964a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f568800d8d0 tx=0x7f568800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:43.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.585+0000 7f56937fe700 1 -- 172.21.15.98:0/260281558 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56880098a0 con 0x7f56940ffc60 2024-09-13T02:57:43.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.585+0000 7f56937fe700 1 -- 172.21.15.98:0/260281558 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5688010460 con 0x7f56940ffc60 2024-09-13T02:57:43.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.585+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569419abf0 con 0x7f56940ffc60 2024-09-13T02:57:43.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.585+0000 7f56937fe700 1 -- 172.21.15.98:0/260281558 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f568800f5f0 con 0x7f56940ffc60 2024-09-13T02:57:43.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.585+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569419b140 con 0x7f56940ffc60 2024-09-13T02:57:43.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.586+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5694107dd0 con 0x7f56940ffc60 2024-09-13T02:57:43.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.586+0000 7f56937fe700 1 -- 172.21.15.98:0/260281558 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f5688009a00 con 0x7f56940ffc60 2024-09-13T02:57:43.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.587+0000 7f56937fe700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f567c06e7b0 0x7f567c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:43.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.587+0000 7f56937fe700 1 -- 172.21.15.98:0/260281558 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f568808e6d0 con 0x7f56940ffc60 2024-09-13T02:57:43.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.587+0000 7f569a538700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f567c06e7b0 0x7f567c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:43.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.587+0000 7f569a538700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f567c06e7b0 0x7f567c070c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f568400b830 tx=0x7f5684000f40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:43.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.591+0000 7f56937fe700 1 -- 172.21.15.98:0/260281558 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5688057750 con 0x7f56940ffc60 2024-09-13T02:57:43.605 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:43.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: Upgrade: Updating crash.smithi142 (2/2) 2024-09-13T02:57:43.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:43.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:43.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:43.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: Deploying daemon crash.smithi142 on smithi142 2024-09-13T02:57:43.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:43.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:43.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T02:57:43.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:43 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/4167552228' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:43.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.815+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f569419b420 con 0x7f567c06e7b0 2024-09-13T02:57:43.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.816+0000 7f56937fe700 1 -- 172.21.15.98:0/260281558 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f569419b420 con 0x7f567c06e7b0 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "4/23 daemons upgraded", 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading crash daemons", 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:57:43.818 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:57:43.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.818+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f567c06e7b0 msgr2=0x7f567c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.818+0000 7f569c79c700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f567c06e7b0 0x7f567c070c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f568400b830 tx=0x7f5684000f40 comp rx=0 tx=0).stop 2024-09-13T02:57:43.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.818+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ffc60 msgr2=0x7f56941964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.818+0000 7f569c79c700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ffc60 0x7f56941964a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f568800d8d0 tx=0x7f568800dbe0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.818+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 shutdown_connections 2024-09-13T02:57:43.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.818+0000 7f569c79c700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f567c06e7b0 0x7f567c070c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.818+0000 7f569c79c700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56940ff350 0x7f5694195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.818+0000 7f569c79c700 1 --2- 172.21.15.98:0/260281558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56940ffc60 0x7f56941964a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.818+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 >> 172.21.15.98:0/260281558 conn(0x7f56940748b0 msgr2=0x7f5694104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:43.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.819+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 shutdown_connections 2024-09-13T02:57:43.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.819+0000 7f569c79c700 1 -- 172.21.15.98:0/260281558 wait complete. 2024-09-13T02:57:43.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.922+0000 7f911a838700 1 -- 172.21.15.98:0/2188205999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 msgr2=0x7f91141007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.922+0000 7f911a838700 1 --2- 172.21.15.98:0/2188205999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 0x7f91141007a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009910 tx=0x7f90fc009c20 comp rx=0 tx=0).stop 2024-09-13T02:57:43.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.922+0000 7f911a838700 1 -- 172.21.15.98:0/2188205999 shutdown_connections 2024-09-13T02:57:43.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.922+0000 7f911a838700 1 --2- 172.21.15.98:0/2188205999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9114100d70 0x7f9114104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.922+0000 7f911a838700 1 --2- 172.21.15.98:0/2188205999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 0x7f91141007a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.922+0000 7f911a838700 1 -- 172.21.15.98:0/2188205999 >> 172.21.15.98:0/2188205999 conn(0x7f91140fbcb0 msgr2=0x7f91140fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:43.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.922+0000 7f911a838700 1 -- 172.21.15.98:0/2188205999 shutdown_connections 2024-09-13T02:57:43.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.922+0000 7f911a838700 1 -- 172.21.15.98:0/2188205999 wait complete. 2024-09-13T02:57:43.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f911a838700 1 Processor -- start 2024-09-13T02:57:43.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f911a838700 1 -- start start 2024-09-13T02:57:43.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f911a838700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 0x7f9114195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:43.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f911a838700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9114100d70 0x7f9114196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:43.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f911a838700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9114196a50 con 0x7f91141003d0 2024-09-13T02:57:43.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f911a838700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911419a7e0 con 0x7f9114100d70 2024-09-13T02:57:43.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f9113fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 0x7f9114195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f9113fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 0x7f9114195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40448/0 (socket says 172.21.15.98:40448) 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f9113fff700 1 -- 172.21.15.98:0/3466601907 learned_addr learned my addr 172.21.15.98:0/3466601907 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f91137fe700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9114100d70 0x7f9114196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f9113fff700 1 -- 172.21.15.98:0/3466601907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9114100d70 msgr2=0x7f9114196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f9113fff700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9114100d70 0x7f9114196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.923+0000 7f9113fff700 1 -- 172.21.15.98:0/3466601907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc0095f0 con 0x7f91141003d0 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.924+0000 7f9113fff700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 0x7f9114195e30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90fc006010 tx=0x7f90fc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.924+0000 7f91117fa700 1 -- 172.21.15.98:0/3466601907 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90fc01d070 con 0x7f91141003d0 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.924+0000 7f91117fa700 1 -- 172.21.15.98:0/3466601907 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90fc005dc0 con 0x7f91141003d0 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.924+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911419aa60 con 0x7f91141003d0 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.924+0000 7f91117fa700 1 -- 172.21.15.98:0/3466601907 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90fc017400 con 0x7f91141003d0 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.924+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911419af50 con 0x7f91141003d0 2024-09-13T02:57:43.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.925+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91141087f0 con 0x7f91141003d0 2024-09-13T02:57:43.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.925+0000 7f91117fa700 1 -- 172.21.15.98:0/3466601907 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f90fc003a60 con 0x7f91141003d0 2024-09-13T02:57:43.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.926+0000 7f91117fa700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f910006e7c0 0x7f9100070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:43.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.926+0000 7f91117fa700 1 -- 172.21.15.98:0/3466601907 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f90fc08fc60 con 0x7f91141003d0 2024-09-13T02:57:43.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.926+0000 7f91137fe700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f910006e7c0 0x7f9100070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:43.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.926+0000 7f91137fe700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f910006e7c0 0x7f9100070c70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9114197450 tx=0x7f910400b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:43.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:43.930+0000 7f91117fa700 1 -- 172.21.15.98:0/3466601907 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f90fc058ce0 con 0x7f91141003d0 2024-09-13T02:57:44.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.213+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f911404f2a0 con 0x7f91141003d0 2024-09-13T02:57:44.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.213+0000 7f91117fa700 1 -- 172.21.15.98:0/3466601907 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f90fc05c3a0 con 0x7f91141003d0 2024-09-13T02:57:44.215 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:44.216 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:57:44.216 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:57:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f910006e7c0 msgr2=0x7f9100070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f910006e7c0 0x7f9100070c70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9114197450 tx=0x7f910400b410 comp rx=0 tx=0).stop 2024-09-13T02:57:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 msgr2=0x7f9114195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 0x7f9114195e30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90fc006010 tx=0x7f90fc00bd70 comp rx=0 tx=0).stop 2024-09-13T02:57:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 shutdown_connections 2024-09-13T02:57:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f910006e7c0 0x7f9100070c70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141003d0 0x7f9114195e30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 --2- 172.21.15.98:0/3466601907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9114100d70 0x7f9114196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 >> 172.21.15.98:0/3466601907 conn(0x7f91140fbcb0 msgr2=0x7f91140fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 shutdown_connections 2024-09-13T02:57:44.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:57:44.215+0000 7f911a838700 1 -- 172.21.15.98:0/3466601907 wait complete. 2024-09-13T02:57:44.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:44 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/4130374598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:44.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:44 smithi098 ceph-mon[87325]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:44.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:44 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3466601907' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:44.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:44 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/4130374598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:44.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:44 smithi142 ceph-mon[65447]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:44.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:44 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3466601907' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:45.541 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:45 smithi142 ceph-mon[65447]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:45.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:45 smithi098 ceph-mon[87325]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:46.832 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:46 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:46.833 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:46 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:46.833 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:46 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:46.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:46 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:46.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:46 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:46.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:46 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:47.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:47 smithi098 ceph-mon[87325]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:48.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:47 smithi142 ceph-mon[65447]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:49.630 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:49.630 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:49.630 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:49 smithi142 ceph-mon[65447]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:49.630 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:49.630 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:49.630 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:49.673 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:49.673 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:49.673 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:49 smithi098 ceph-mon[87325]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:49.673 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:49.673 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:49.673 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:51.629 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:51 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:51.629 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:51 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:51.629 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:51 smithi098 ceph-mon[87325]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:51.629 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:51 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:51.629 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:51 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:51.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:51 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:51.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:51 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:51.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:51 smithi142 ceph-mon[65447]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:51.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:51 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:51.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:51 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:53.444 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:53.445 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:53.445 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:53 smithi098 ceph-mon[87325]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:53.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:53.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:53.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:53 smithi142 ceph-mon[65447]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all crash 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]: dispatch 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]': finished 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]: dispatch 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]': finished 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: Upgrade: osd.0 is safe to restart 2024-09-13T02:57:55.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:55 smithi098 ceph-mon[87325]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:55.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:55.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:55.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:55.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:55.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:55.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:55.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:55.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:55.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all crash 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]: dispatch 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi098"}]': finished 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]: dispatch 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]': finished 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: Upgrade: osd.0 is safe to restart 2024-09-13T02:57:55.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:55 smithi142 ceph-mon[65447]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:56.905 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:56 smithi142 ceph-mon[65447]: Upgrade: Updating osd.0 2024-09-13T02:57:56.905 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:56 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:56.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:56 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:57:56.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:56 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:56.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:56 smithi142 ceph-mon[65447]: Deploying daemon osd.0 on smithi098 2024-09-13T02:57:56.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:56 smithi098 ceph-mon[87325]: Upgrade: Updating osd.0 2024-09-13T02:57:56.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:56 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:57:56.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:56 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:57:56.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:56 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:56.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:56 smithi098 ceph-mon[87325]: Deploying daemon osd.0 on smithi098 2024-09-13T02:57:57.925 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:57 smithi098 ceph-mon[87325]: pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:57 smithi142 ceph-mon[65447]: pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:57:58.855 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:57:58 smithi098 systemd[1]: Stopping Ceph osd.0 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:57:59.233 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:57:58 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[42809]: 2024-09-13T02:57:58.853+0000 7f55968e0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:57:59.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:57:58 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[42809]: 2024-09-13T02:57:58.853+0000 7f55968e0700 -1 osd.0 49 *** Got signal Terminated *** 2024-09-13T02:57:59.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:57:58 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[42809]: 2024-09-13T02:57:58.853+0000 7f55968e0700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:58:00.113 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:59 smithi098 ceph-mon[87325]: pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:58:00.114 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:57:59 smithi098 ceph-mon[87325]: osd.0 marked itself down and dead 2024-09-13T02:58:00.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:59 smithi142 ceph-mon[65447]: pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:58:00.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:57:59 smithi142 ceph-mon[65447]: osd.0 marked itself down and dead 2024-09-13T02:58:00.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:00 smithi098 podman[98015]: 2024-09-13 02:58:00.112906451 +0000 UTC m=+1.366101999 container died 1ba4012419d8a60605426bb1acbdc20853014da96c2b16d4cec8e1956d5fa2bf (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, ceph=True) 2024-09-13T02:58:00.848 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:00 smithi098 ceph-mon[87325]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:58:00.849 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:00 smithi098 ceph-mon[87325]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T02:58:00.849 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:00 smithi098 podman[98015]: 2024-09-13 02:58:00.595763939 +0000 UTC m=+1.848959485 container cleanup 1ba4012419d8a60605426bb1acbdc20853014da96c2b16d4cec8e1956d5fa2bf (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-13T02:58:00.849 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:00 smithi098 bash[98015]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0 2024-09-13T02:58:01.184 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:00 smithi098 podman[98030]: 2024-09-13 02:58:00.847822074 +0000 UTC m=+0.737403566 container remove 1ba4012419d8a60605426bb1acbdc20853014da96c2b16d4cec8e1956d5fa2bf (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T02:58:01.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:00 smithi142 ceph-mon[65447]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:58:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:00 smithi142 ceph-mon[65447]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T02:58:01.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:01 smithi098 podman[98119]: 2024-09-13 02:58:01.086545502 +0000 UTC m=+0.016185389 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:01.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:01 smithi098 podman[98119]: 2024-09-13 02:58:01.190731376 +0000 UTC m=+0.120371310 container create 9901951e796303741406977c9737852534317fe9c261665bb55c2f844aa2cfba (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T02:58:01.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:01 smithi098 podman[98119]: 2024-09-13 02:58:01.426541176 +0000 UTC m=+0.356181057 container init 9901951e796303741406977c9737852534317fe9c261665bb55c2f844aa2cfba (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T02:58:01.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:01 smithi098 podman[98119]: 2024-09-13 02:58:01.42995743 +0000 UTC m=+0.359597323 container start 9901951e796303741406977c9737852534317fe9c261665bb55c2f844aa2cfba (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-7741f7f) 2024-09-13T02:58:01.783 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:01 smithi098 ceph-mon[87325]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T02:58:01.783 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:01 smithi098 ceph-mon[87325]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T02:58:01.783 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:01 smithi098 podman[98119]: 2024-09-13 02:58:01.526650855 +0000 UTC m=+0.456290752 container attach 9901951e796303741406977c9737852534317fe9c261665bb55c2f844aa2cfba (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T02:58:01.784 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:01 smithi098 podman[98119]: 2024-09-13 02:58:01.62442431 +0000 UTC m=+0.554064191 container died 9901951e796303741406977c9737852534317fe9c261665bb55c2f844aa2cfba (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T02:58:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:01 smithi142 ceph-mon[65447]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T02:58:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:01 smithi142 ceph-mon[65447]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T02:58:02.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 podman[98141]: 2024-09-13 02:58:02.147135009 +0000 UTC m=+0.516396385 container remove 9901951e796303741406977c9737852534317fe9c261665bb55c2f844aa2cfba (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:58:02.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T02:58:02.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 systemd[1]: Stopped Ceph osd.0 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:58:02.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.0.service: Consumed 52.713s CPU time. 2024-09-13T02:58:02.485 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 systemd[1]: Starting Ceph osd.0 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:58:02.902 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 podman[98239]: 2024-09-13 02:58:02.483754885 +0000 UTC m=+0.016487430 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:02.902 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 podman[98239]: 2024-09-13 02:58:02.590385046 +0000 UTC m=+0.123117623 container create a0e0b6355e470075878f6561051e23dd3d17e3b321839f28694cab7cbc2bbd20 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:58:02.902 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 podman[98239]: 2024-09-13 02:58:02.827559729 +0000 UTC m=+0.360292271 container init a0e0b6355e470075878f6561051e23dd3d17e3b321839f28694cab7cbc2bbd20 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T02:58:02.902 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 podman[98239]: 2024-09-13 02:58:02.830861607 +0000 UTC m=+0.363594141 container start a0e0b6355e470075878f6561051e23dd3d17e3b321839f28694cab7cbc2bbd20 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T02:58:02.903 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 podman[98239]: 2024-09-13 02:58:02.901485486 +0000 UTC m=+0.434218024 container attach a0e0b6355e470075878f6561051e23dd3d17e3b321839f28694cab7cbc2bbd20 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T02:58:03.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate[98255]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:03.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 bash[98239]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:03.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate[98255]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:03.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:02 smithi098 bash[98239]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:03.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-mon[87325]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-13T02:58:03.977 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:03.978 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:03.978 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate[98255]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:58:03.978 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 bash[98239]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:58:03.978 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate[98255]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:58:03.978 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 bash[98239]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:58:04.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate[98255]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:58:04.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 bash[98239]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:58:04.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate[98255]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:58:04.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 bash[98239]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:58:04.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate[98255]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T02:58:04.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 bash[98239]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T02:58:04.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate[98255]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:58:04.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 bash[98239]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:58:04.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate[98255]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T02:58:04.235 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:03 smithi098 bash[98239]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T02:58:04.235 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:04 smithi098 podman[98239]: 2024-09-13 02:58:04.004245063 +0000 UTC m=+1.536977601 container died a0e0b6355e470075878f6561051e23dd3d17e3b321839f28694cab7cbc2bbd20 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T02:58:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:03 smithi142 ceph-mon[65447]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-13T02:58:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:04.714 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:04 smithi098 podman[98405]: 2024-09-13 02:58:04.505585085 +0000 UTC m=+0.494755666 container remove a0e0b6355e470075878f6561051e23dd3d17e3b321839f28694cab7cbc2bbd20 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T02:58:04.976 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:04 smithi098 ceph-mon[87325]: Health check failed: Degraded data redundancy: 51/267 objects degraded (19.101%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:04.977 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:04 smithi098 podman[98463]: 2024-09-13 02:58:04.615966919 +0000 UTC m=+0.015788315 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:04.977 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:04 smithi098 podman[98463]: 2024-09-13 02:58:04.72888921 +0000 UTC m=+0.128710599 container create 1252221d152e5d1a9a8be511d3ec49e8631dab02711fc0c828b95093789d68c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:58:04.977 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:04 smithi098 podman[98463]: 2024-09-13 02:58:04.951359861 +0000 UTC m=+0.351181249 container init 1252221d152e5d1a9a8be511d3ec49e8631dab02711fc0c828b95093789d68c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T02:58:04.977 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:04 smithi098 podman[98463]: 2024-09-13 02:58:04.954461332 +0000 UTC m=+0.354282732 container start 1252221d152e5d1a9a8be511d3ec49e8631dab02711fc0c828b95093789d68c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T02:58:04.977 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:04 smithi098 ceph-osd[98483]: -- 172.21.15.98:0/110902808 <== mon.0 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571339981e0 con 0x557133996000 2024-09-13T02:58:05.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:05 smithi098 bash[98463]: 1252221d152e5d1a9a8be511d3ec49e8631dab02711fc0c828b95093789d68c1 2024-09-13T02:58:05.234 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:05 smithi098 systemd[1]: Started Ceph osd.0 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:58:05.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:04 smithi142 ceph-mon[65447]: Health check failed: Degraded data redundancy: 51/267 objects degraded (19.101%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:05.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:05 smithi098 ceph-mon[87325]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:05.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:05.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:05.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:05 smithi142 ceph-mon[65447]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:07.138 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:06 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[98479]: 2024-09-13T02:58:06.827+0000 7f8098118640 -1 Falling back to public interface 2024-09-13T02:58:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:07 smithi098 ceph-mon[87325]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:07 smithi142 ceph-mon[65447]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:09 smithi098 ceph-mon[87325]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:09 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:09 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:09 smithi142 ceph-mon[65447]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:09 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:09 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:11.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:11 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:11.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:11 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:11.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:11 smithi098 ceph-mon[87325]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:11 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:11 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:11 smithi142 ceph-mon[65447]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:12.644 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:12 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[98479]: 2024-09-13T02:58:12.346+0000 7f8098118640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-13T02:58:12.645 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:12 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[98479]: 2024-09-13T02:58:12.643+0000 7f8098118640 -1 osd.0 49 log_to_monitors true 2024-09-13T02:58:12.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:12 smithi098 ceph-mon[87325]: from='osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:58:13.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:12 smithi142 ceph-mon[65447]: from='osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:58:13.822 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[98479]: 2024-09-13T02:58:13.523+0000 7f808beaa640 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:58:13.823 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:58:13.823 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:13.823 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T02:58:13.823 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:58:13.823 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541]' entity='osd.0' 2024-09-13T02:58:13.823 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:13.823 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:13.823 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:13.823 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:13.824 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:13.824 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:13.824 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:13.824 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:13.824 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:13.824 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/267 objects degraded (19.101%) 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541]' entity='osd.0' 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:14.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:14.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:14.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.326+0000 7feadd5aa700 1 -- 172.21.15.98:0/2306254053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 msgr2=0x7fead8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:14.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.326+0000 7feadd5aa700 1 --2- 172.21.15.98:0/2306254053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 0x7fead8103d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feac8009910 tx=0x7feac8009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:14.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.326+0000 7feadd5aa700 1 -- 172.21.15.98:0/2306254053 shutdown_connections 2024-09-13T02:58:14.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.326+0000 7feadd5aa700 1 --2- 172.21.15.98:0/2306254053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 0x7fead8103d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.326+0000 7feadd5aa700 1 --2- 172.21.15.98:0/2306254053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead80ff3c0 0x7fead80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.326+0000 7feadd5aa700 1 -- 172.21.15.98:0/2306254053 >> 172.21.15.98:0/2306254053 conn(0x7fead80fac80 msgr2=0x7fead80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:14.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.326+0000 7feadd5aa700 1 -- 172.21.15.98:0/2306254053 shutdown_connections 2024-09-13T02:58:14.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.326+0000 7feadd5aa700 1 -- 172.21.15.98:0/2306254053 wait complete. 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.327+0000 7feadd5aa700 1 Processor -- start 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.327+0000 7feadd5aa700 1 -- start start 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.327+0000 7feadd5aa700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead80ff3c0 0x7fead8100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.327+0000 7feadd5aa700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 0x7fead8101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.327+0000 7feadd5aa700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8101850 con 0x7fead80ffd60 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.327+0000 7feadd5aa700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8101990 con 0x7fead80ff3c0 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.327+0000 7fead67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 0x7fead8101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.327+0000 7fead67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 0x7fead8101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44100/0 (socket says 172.21.15.98:44100) 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.327+0000 7fead67fc700 1 -- 172.21.15.98:0/1007186360 learned_addr learned my addr 172.21.15.98:0/1007186360 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7fead6ffd700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead80ff3c0 0x7fead8100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7fead67fc700 1 -- 172.21.15.98:0/1007186360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead80ff3c0 msgr2=0x7fead8100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:14.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7fead67fc700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead80ff3c0 0x7fead8100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7fead67fc700 1 -- 172.21.15.98:0/1007186360 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac80095f0 con 0x7fead80ffd60 2024-09-13T02:58:14.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7fead67fc700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 0x7fead8101310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feac800bda0 tx=0x7feac800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:14.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7feabffff700 1 -- 172.21.15.98:0/1007186360 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac801d070 con 0x7fead80ffd60 2024-09-13T02:58:14.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7feabffff700 1 -- 172.21.15.98:0/1007186360 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feac8004fb0 con 0x7fead80ffd60 2024-09-13T02:58:14.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead8101c10 con 0x7fead80ffd60 2024-09-13T02:58:14.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead81a2370 con 0x7fead80ffd60 2024-09-13T02:58:14.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.328+0000 7feabffff700 1 -- 172.21.15.98:0/1007186360 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac800f630 con 0x7fead80ffd60 2024-09-13T02:58:14.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.329+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead804f2a0 con 0x7fead80ffd60 2024-09-13T02:58:14.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.330+0000 7feabffff700 1 -- 172.21.15.98:0/1007186360 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7feac8022870 con 0x7fead80ffd60 2024-09-13T02:58:14.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.330+0000 7feabffff700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7feac006e7c0 0x7feac0070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:14.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.330+0000 7feabffff700 1 -- 172.21.15.98:0/1007186360 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6070+0+0 (secure 0 0 0) 0x7feac808fd20 con 0x7fead80ffd60 2024-09-13T02:58:14.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.330+0000 7fead6ffd700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7feac006e7c0 0x7feac0070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:14.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.331+0000 7fead6ffd700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7feac006e7c0 0x7feac0070c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feacc005ea0 tx=0x7feacc005e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:14.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.335+0000 7feabffff700 1 -- 172.21.15.98:0/1007186360 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feac8058f70 con 0x7fead80ffd60 2024-09-13T02:58:14.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.599+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fead8102eb0 con 0x7feac006e7c0 2024-09-13T02:58:14.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.601+0000 7feabffff700 1 -- 172.21.15.98:0/1007186360 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fead8102eb0 con 0x7feac006e7c0 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7feac006e7c0 msgr2=0x7feac0070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7feac006e7c0 0x7feac0070c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feacc005ea0 tx=0x7feacc005e30 comp rx=0 tx=0).stop 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 msgr2=0x7fead8101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 0x7fead8101310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feac800bda0 tx=0x7feac800be80 comp rx=0 tx=0).stop 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 shutdown_connections 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7feac006e7c0 0x7feac0070c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead80ff3c0 0x7fead8100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 --2- 172.21.15.98:0/1007186360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fead80ffd60 0x7fead8101310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 >> 172.21.15.98:0/1007186360 conn(0x7fead80fac80 msgr2=0x7fead80fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:14.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 shutdown_connections 2024-09-13T02:58:14.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.603+0000 7feadd5aa700 1 -- 172.21.15.98:0/1007186360 wait complete. 2024-09-13T02:58:14.615 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:58:14.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.712+0000 7f2f6066e700 1 -- 172.21.15.98:0/3542515209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101420 msgr2=0x7f2f581017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:14.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.712+0000 7f2f6066e700 1 --2- 172.21.15.98:0/3542515209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101420 0x7f2f581017f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009910 tx=0x7f2f54009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:14.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.712+0000 7f2f6066e700 1 -- 172.21.15.98:0/3542515209 shutdown_connections 2024-09-13T02:58:14.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.712+0000 7f2f6066e700 1 --2- 172.21.15.98:0/3542515209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f58101d30 0x7f2f5810a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.712+0000 7f2f6066e700 1 --2- 172.21.15.98:0/3542515209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101420 0x7f2f581017f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.712+0000 7f2f6066e700 1 -- 172.21.15.98:0/3542515209 >> 172.21.15.98:0/3542515209 conn(0x7f2f580fac60 msgr2=0x7f2f580fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:14.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.712+0000 7f2f6066e700 1 -- 172.21.15.98:0/3542515209 shutdown_connections 2024-09-13T02:58:14.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.712+0000 7f2f6066e700 1 -- 172.21.15.98:0/3542515209 wait complete. 2024-09-13T02:58:14.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.713+0000 7f2f6066e700 1 Processor -- start 2024-09-13T02:58:14.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.713+0000 7f2f6066e700 1 -- start start 2024-09-13T02:58:14.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.713+0000 7f2f6066e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f58101420 0x7f2f580ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:14.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.713+0000 7f2f6066e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101d30 0x7f2f580ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.713+0000 7f2f6066e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580ffb00 con 0x7f2f58101d30 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.713+0000 7f2f6066e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580ffc40 con 0x7f2f58101420 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.713+0000 7f2f5dc09700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101d30 0x7f2f580ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.713+0000 7f2f5dc09700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101d30 0x7f2f580ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37726/0 (socket says 172.21.15.98:37726) 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.713+0000 7f2f5dc09700 1 -- 172.21.15.98:0/2561775854 learned_addr learned my addr 172.21.15.98:0/2561775854 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f5e40a700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f58101420 0x7f2f580ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f5dc09700 1 -- 172.21.15.98:0/2561775854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f58101420 msgr2=0x7f2f580ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f5dc09700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f58101420 0x7f2f580ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f5dc09700 1 -- 172.21.15.98:0/2561775854 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f540095f0 con 0x7f2f58101d30 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f5dc09700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101d30 0x7f2f580ff5c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800d900 tx=0x7f2f4800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:14.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f4f7fe700 1 -- 172.21.15.98:0/2561775854 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f480041f0 con 0x7f2f58101d30 2024-09-13T02:58:14.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f4f7fe700 1 -- 172.21.15.98:0/2561775854 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f48004cf0 con 0x7f2f58101d30 2024-09-13T02:58:14.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f4f7fe700 1 -- 172.21.15.98:0/2561775854 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f4800b750 con 0x7f2f58101d30 2024-09-13T02:58:14.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f581a2070 con 0x7f2f58101d30 2024-09-13T02:58:14.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.714+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f581a2480 con 0x7f2f58101d30 2024-09-13T02:58:14.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.715+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f58107900 con 0x7f2f58101d30 2024-09-13T02:58:14.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.716+0000 7f2f4f7fe700 1 -- 172.21.15.98:0/2561775854 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f2f48004750 con 0x7f2f58101d30 2024-09-13T02:58:14.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.716+0000 7f2f4f7fe700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f4406e7c0 0x7f2f44070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:14.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.716+0000 7f2f4f7fe700 1 -- 172.21.15.98:0/2561775854 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2f4808e610 con 0x7f2f58101d30 2024-09-13T02:58:14.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.716+0000 7f2f5e40a700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f4406e7c0 0x7f2f44070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:14.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.717+0000 7f2f5e40a700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f4406e7c0 0x7f2f44070c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2f54006010 tx=0x7f2f5401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:14.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.721+0000 7f2f4f7fe700 1 -- 172.21.15.98:0/2561775854 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f48057710 con 0x7f2f58101d30 2024-09-13T02:58:14.859 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:14 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:14.860 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:14 smithi098 ceph-mon[87325]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T02:58:14.860 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:14 smithi098 ceph-mon[87325]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:58:14.860 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:14 smithi098 ceph-mon[87325]: osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541] boot 2024-09-13T02:58:14.860 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:14 smithi098 ceph-mon[87325]: osdmap e53: 6 total, 6 up, 6 in 2024-09-13T02:58:14.860 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:14 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:58:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.964+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f58061190 con 0x7f2f4406e7c0 2024-09-13T02:58:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.965+0000 7f2f4f7fe700 1 -- 172.21.15.98:0/2561775854 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2f58061190 con 0x7f2f4406e7c0 2024-09-13T02:58:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f4406e7c0 msgr2=0x7f2f44070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f4406e7c0 0x7f2f44070c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2f54006010 tx=0x7f2f5401a040 comp rx=0 tx=0).stop 2024-09-13T02:58:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101d30 msgr2=0x7f2f580ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101d30 0x7f2f580ff5c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800d900 tx=0x7f2f4800dc10 comp rx=0 tx=0).stop 2024-09-13T02:58:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 shutdown_connections 2024-09-13T02:58:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f4406e7c0 0x7f2f44070c70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f58101420 0x7f2f580ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 --2- 172.21.15.98:0/2561775854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f58101d30 0x7f2f580ff5c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 >> 172.21.15.98:0/2561775854 conn(0x7f2f580fac60 msgr2=0x7f2f58104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 shutdown_connections 2024-09-13T02:58:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:14.967+0000 7f2f6066e700 1 -- 172.21.15.98:0/2561775854 wait complete. 2024-09-13T02:58:15.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:14 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:15.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:14 smithi142 ceph-mon[65447]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T02:58:15.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:14 smithi142 ceph-mon[65447]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:58:15.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:14 smithi142 ceph-mon[65447]: osd.0 [v2:172.21.15.98:6802/843315541,v1:172.21.15.98:6803/843315541] boot 2024-09-13T02:58:15.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:14 smithi142 ceph-mon[65447]: osdmap e53: 6 total, 6 up, 6 in 2024-09-13T02:58:15.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:14 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:58:15.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.071+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/3360398481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 msgr2=0x7fa49c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.071+0000 7fa4a2bcc700 1 --2- 172.21.15.98:0/3360398481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 0x7fa49c1008b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa490009910 tx=0x7fa490009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:15.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.071+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/3360398481 shutdown_connections 2024-09-13T02:58:15.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.071+0000 7fa4a2bcc700 1 --2- 172.21.15.98:0/3360398481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa49c100e80 0x7fa49c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.071+0000 7fa4a2bcc700 1 --2- 172.21.15.98:0/3360398481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 0x7fa49c1008b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.071+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/3360398481 >> 172.21.15.98:0/3360398481 conn(0x7fa49c0fbda0 msgr2=0x7fa49c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:15.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.072+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/3360398481 shutdown_connections 2024-09-13T02:58:15.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.072+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/3360398481 wait complete. 2024-09-13T02:58:15.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.072+0000 7fa4a2bcc700 1 Processor -- start 2024-09-13T02:58:15.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.072+0000 7fa4a2bcc700 1 -- start start 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.072+0000 7fa4a2bcc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 0x7fa49c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.072+0000 7fa4a2bcc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa49c100e80 0x7fa49c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.072+0000 7fa4a2bcc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c196b10 con 0x7fa49c1004e0 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.072+0000 7fa4a2bcc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c19a8a0 con 0x7fa49c100e80 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.072+0000 7fa4a0968700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 0x7fa49c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa4a0968700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 0x7fa49c195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37730/0 (socket says 172.21.15.98:37730) 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa4a0968700 1 -- 172.21.15.98:0/872035797 learned_addr learned my addr 172.21.15.98:0/872035797 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa49bfff700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa49c100e80 0x7fa49c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa4a0968700 1 -- 172.21.15.98:0/872035797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa49c100e80 msgr2=0x7fa49c196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa4a0968700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa49c100e80 0x7fa49c196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa4a0968700 1 -- 172.21.15.98:0/872035797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900095f0 con 0x7fa49c1004e0 2024-09-13T02:58:15.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa4a0968700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 0x7fa49c195ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa4900092e0 tx=0x7fa49000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:15.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa499ffb700 1 -- 172.21.15.98:0/872035797 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49001d070 con 0x7fa49c1004e0 2024-09-13T02:58:15.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa499ffb700 1 -- 172.21.15.98:0/872035797 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa490005e00 con 0x7fa49c1004e0 2024-09-13T02:58:15.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c19ab20 con 0x7fa49c1004e0 2024-09-13T02:58:15.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa499ffb700 1 -- 172.21.15.98:0/872035797 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa490017400 con 0x7fa49c1004e0 2024-09-13T02:58:15.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.073+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c19b010 con 0x7fa49c1004e0 2024-09-13T02:58:15.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.074+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c1087f0 con 0x7fa49c1004e0 2024-09-13T02:58:15.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.075+0000 7fa499ffb700 1 -- 172.21.15.98:0/872035797 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa49000f6f0 con 0x7fa49c1004e0 2024-09-13T02:58:15.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.075+0000 7fa499ffb700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa48c06e7b0 0x7fa48c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:15.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.075+0000 7fa499ffb700 1 -- 172.21.15.98:0/872035797 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa49008fcb0 con 0x7fa49c1004e0 2024-09-13T02:58:15.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.076+0000 7fa49bfff700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa48c06e7b0 0x7fa48c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:15.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.076+0000 7fa49bfff700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa48c06e7b0 0x7fa48c070c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa49c197510 tx=0x7fa48800b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:15.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.080+0000 7fa499ffb700 1 -- 172.21.15.98:0/872035797 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa490058d30 con 0x7fa49c1004e0 2024-09-13T02:58:15.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.297+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa49c19b2f0 con 0x7fa48c06e7b0 2024-09-13T02:58:15.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.306+0000 7fa499ffb700 1 -- 172.21.15.98:0/872035797 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa49c19b2f0 con 0x7fa48c06e7b0 2024-09-13T02:58:15.308 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:58:15.308 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (3m) 5s ago 13m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T02:58:15.308 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (13m) 5s ago 13m 8182k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:58:15.308 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (13m) 26s ago 13m 7755k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:58:15.308 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (34s) 5s ago 13m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T02:58:15.308 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (30s) 26s ago 12m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T02:58:15.308 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (2m) 5s ago 13m 78.9M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (8m) 5s ago 8m 94.2M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (8m) 5s ago 8m 152M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (8m) 26s ago 8m 15.8M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (8m) 26s ago 8m 19.2M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (5m) 5s ago 15m 497M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (4m) 26s ago 12m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (93s) 5s ago 15m 44.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (72s) 26s ago 12m 35.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (3m) 5s ago 13m 16.5M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (3m) 26s ago 12m 15.0M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (10s) 5s ago 11m 14.2M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (11m) 5s ago 11m 222M 1216M 18.2.0 dc2bc1663786 e9eee821d539 2024-09-13T02:58:15.309 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (11m) 5s ago 11m 184M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:58:15.310 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (10m) 26s ago 10m 240M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:58:15.310 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (10m) 26s ago 10m 214M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:58:15.310 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (9m) 26s ago 9m 197M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:58:15.310 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (3m) 5s ago 13m 78.3M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:58:15.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa48c06e7b0 msgr2=0x7fa48c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa48c06e7b0 0x7fa48c070c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa49c197510 tx=0x7fa48800b410 comp rx=0 tx=0).stop 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 msgr2=0x7fa49c195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 0x7fa49c195ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa4900092e0 tx=0x7fa49000bd70 comp rx=0 tx=0).stop 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 shutdown_connections 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa48c06e7b0 0x7fa48c070c60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa49c1004e0 0x7fa49c195ef0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 --2- 172.21.15.98:0/872035797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa49c100e80 0x7fa49c196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 >> 172.21.15.98:0/872035797 conn(0x7fa49c0fbda0 msgr2=0x7fa49c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.308+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 shutdown_connections 2024-09-13T02:58:15.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.309+0000 7fa4a2bcc700 1 -- 172.21.15.98:0/872035797 wait complete. 2024-09-13T02:58:15.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 -- 172.21.15.98:0/3913391212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 msgr2=0x7fdd38104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 --2- 172.21.15.98:0/3913391212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 0x7fdd38104e50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009910 tx=0x7fdd2c009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:15.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 -- 172.21.15.98:0/3913391212 shutdown_connections 2024-09-13T02:58:15.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 --2- 172.21.15.98:0/3913391212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 0x7fdd38104e50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 --2- 172.21.15.98:0/3913391212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381004e0 0x7fdd381008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 -- 172.21.15.98:0/3913391212 >> 172.21.15.98:0/3913391212 conn(0x7fdd380fbda0 msgr2=0x7fdd380fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:15.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 -- 172.21.15.98:0/3913391212 shutdown_connections 2024-09-13T02:58:15.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 -- 172.21.15.98:0/3913391212 wait complete. 2024-09-13T02:58:15.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 Processor -- start 2024-09-13T02:58:15.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.412+0000 7fdd3e487700 1 -- start start 2024-09-13T02:58:15.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd3e487700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381004e0 0x7fdd38196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:15.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd3e487700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 0x7fdd38196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:15.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd3e487700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38196c20 con 0x7fdd38100e80 2024-09-13T02:58:15.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd3e487700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3819a9b0 con 0x7fdd381004e0 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd377fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 0x7fdd38196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd377fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 0x7fdd38196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37758/0 (socket says 172.21.15.98:37758) 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd377fe700 1 -- 172.21.15.98:0/230341117 learned_addr learned my addr 172.21.15.98:0/230341117 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd37fff700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381004e0 0x7fdd38196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd377fe700 1 -- 172.21.15.98:0/230341117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381004e0 msgr2=0x7fdd38196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd377fe700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381004e0 0x7fdd38196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.413+0000 7fdd377fe700 1 -- 172.21.15.98:0/230341117 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0095f0 con 0x7fdd38100e80 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.414+0000 7fdd377fe700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 0x7fdd38196540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00bda0 tx=0x7fdd2c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.414+0000 7fdd357fa700 1 -- 172.21.15.98:0/230341117 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd2c01d070 con 0x7fdd38100e80 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.414+0000 7fdd357fa700 1 -- 172.21.15.98:0/230341117 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd2c00f460 con 0x7fdd38100e80 2024-09-13T02:58:15.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.414+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3819ac30 con 0x7fdd38100e80 2024-09-13T02:58:15.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.414+0000 7fdd357fa700 1 -- 172.21.15.98:0/230341117 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd2c017630 con 0x7fdd38100e80 2024-09-13T02:58:15.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.414+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3819b120 con 0x7fdd38100e80 2024-09-13T02:58:15.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.415+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd381087a0 con 0x7fdd38100e80 2024-09-13T02:58:15.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.415+0000 7fdd357fa700 1 -- 172.21.15.98:0/230341117 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fdd2c00fab0 con 0x7fdd38100e80 2024-09-13T02:58:15.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.416+0000 7fdd357fa700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdd2006e7c0 0x7fdd20070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:15.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.416+0000 7fdd357fa700 1 -- 172.21.15.98:0/230341117 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fdd2c08fc00 con 0x7fdd38100e80 2024-09-13T02:58:15.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.416+0000 7fdd37fff700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdd2006e7c0 0x7fdd20070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:15.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.416+0000 7fdd37fff700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdd2006e7c0 0x7fdd20070c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009a10 tx=0x7fdd28009190 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:15.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.420+0000 7fdd357fa700 1 -- 172.21.15.98:0/230341117 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdd2c095020 con 0x7fdd38100e80 2024-09-13T02:58:15.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.724+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdd3802cc30 con 0x7fdd38100e80 2024-09-13T02:58:15.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.724+0000 7fdd357fa700 1 -- 172.21.15.98:0/230341117 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fdd2c058d00 con 0x7fdd38100e80 2024-09-13T02:58:15.726 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:58:15.726 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:58:15.727 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:15.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:58:15.727 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:58:15.727 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:15.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:58:15.727 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:58:15.727 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-09-13T02:58:15.727 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:58:15.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:58:15.728 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:58:15.728 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:58:15.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:58:15.728 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:58:15.728 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-09-13T02:58:15.728 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 5 2024-09-13T02:58:15.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:58:15.728 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:58:15.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdd2006e7c0 msgr2=0x7fdd20070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdd2006e7c0 0x7fdd20070c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009a10 tx=0x7fdd28009190 comp rx=0 tx=0).stop 2024-09-13T02:58:15.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 msgr2=0x7fdd38196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 0x7fdd38196540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00bda0 tx=0x7fdd2c00bdd0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 shutdown_connections 2024-09-13T02:58:15.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdd2006e7c0 0x7fdd20070c70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381004e0 0x7fdd38196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 --2- 172.21.15.98:0/230341117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd38100e80 0x7fdd38196540 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 >> 172.21.15.98:0/230341117 conn(0x7fdd380fbda0 msgr2=0x7fdd380fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:15.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 shutdown_connections 2024-09-13T02:58:15.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.727+0000 7fdd3e487700 1 -- 172.21.15.98:0/230341117 wait complete. 2024-09-13T02:58:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.831+0000 7fa4d06c9700 1 -- 172.21.15.98:0/542777417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 msgr2=0x7fa4c8104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.831+0000 7fa4d06c9700 1 --2- 172.21.15.98:0/542777417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 0x7fa4c8104e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009910 tx=0x7fa4b8009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 -- 172.21.15.98:0/542777417 shutdown_connections 2024-09-13T02:58:15.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 --2- 172.21.15.98:0/542777417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 0x7fa4c8104e30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 --2- 172.21.15.98:0/542777417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c81004c0 0x7fa4c8100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 -- 172.21.15.98:0/542777417 >> 172.21.15.98:0/542777417 conn(0x7fa4c80fbd80 msgr2=0x7fa4c80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 -- 172.21.15.98:0/542777417 shutdown_connections 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 -- 172.21.15.98:0/542777417 wait complete. 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 Processor -- start 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 -- start start 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c81004c0 0x7fa4c8195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 0x7fa4c8196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c8196b70 con 0x7fa4c8100e60 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.832+0000 7fa4d06c9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c819a900 con 0x7fa4c81004c0 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4cdc64700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 0x7fa4c8196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4cdc64700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 0x7fa4c8196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37776/0 (socket says 172.21.15.98:37776) 2024-09-13T02:58:15.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4ce465700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c81004c0 0x7fa4c8195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:15.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4cdc64700 1 -- 172.21.15.98:0/1066053157 learned_addr learned my addr 172.21.15.98:0/1066053157 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:15.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4cdc64700 1 -- 172.21.15.98:0/1066053157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c81004c0 msgr2=0x7fa4c8195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:15.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4cdc64700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c81004c0 0x7fa4c8195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:15.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4cdc64700 1 -- 172.21.15.98:0/1066053157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80095f0 con 0x7fa4c8100e60 2024-09-13T02:58:15.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4ce465700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c81004c0 0x7fa4c8195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:58:15.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4cdc64700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 0x7fa4c8196490 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009fd0 tx=0x7fa4b800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:15.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4bf7fe700 1 -- 172.21.15.98:0/1066053157 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4b801d070 con 0x7fa4c8100e60 2024-09-13T02:58:15.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4bf7fe700 1 -- 172.21.15.98:0/1066053157 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4b8022470 con 0x7fa4c8100e60 2024-09-13T02:58:15.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c819ab80 con 0x7fa4c8100e60 2024-09-13T02:58:15.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4bf7fe700 1 -- 172.21.15.98:0/1066053157 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4b8017650 con 0x7fa4c8100e60 2024-09-13T02:58:15.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.833+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c819b010 con 0x7fa4c8100e60 2024-09-13T02:58:15.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.834+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c8108830 con 0x7fa4c8100e60 2024-09-13T02:58:15.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.835+0000 7fa4bf7fe700 1 -- 172.21.15.98:0/1066053157 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa4b80225e0 con 0x7fa4c8100e60 2024-09-13T02:58:15.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.835+0000 7fa4bf7fe700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b406e7b0 0x7fa4b4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:15.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.835+0000 7fa4bf7fe700 1 -- 172.21.15.98:0/1066053157 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa4b808fd40 con 0x7fa4c8100e60 2024-09-13T02:58:15.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.835+0000 7fa4ce465700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b406e7b0 0x7fa4b4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:15.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.836+0000 7fa4ce465700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b406e7b0 0x7fa4b4070c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4011490 tx=0x7fa4c4009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:15.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:15.840+0000 7fa4bf7fe700 1 -- 172.21.15.98:0/1066053157 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4b8058dc0 con 0x7fa4c8100e60 2024-09-13T02:58:15.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:15 smithi098 ceph-mon[87325]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:15 smithi098 ceph-mon[87325]: pgmap v50: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 7/267 objects degraded (2.622%) 2024-09-13T02:58:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:15 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:15 smithi098 ceph-mon[87325]: osdmap e54: 6 total, 6 up, 6 in 2024-09-13T02:58:16.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:15 smithi142 ceph-mon[65447]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:16.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:15 smithi142 ceph-mon[65447]: pgmap v50: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 7/267 objects degraded (2.622%) 2024-09-13T02:58:16.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:15 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:16.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:15 smithi142 ceph-mon[65447]: osdmap e54: 6 total, 6 up, 6 in 2024-09-13T02:58:16.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.085+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4c8197350 con 0x7fa4c8100e60 2024-09-13T02:58:16.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.085+0000 7fa4bf7fe700 1 -- 172.21.15.98:0/1066053157 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1941 (secure 0 0 0) 0x7fa4b805c480 con 0x7fa4c8100e60 2024-09-13T02:58:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T02:58:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:58:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:58:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:58:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T02:58:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:58:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T02:58:16.088 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T02:58:16.089 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:16.090 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b406e7b0 msgr2=0x7fa4b4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b406e7b0 0x7fa4b4070c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4011490 tx=0x7fa4c4009260 comp rx=0 tx=0).stop 2024-09-13T02:58:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 msgr2=0x7fa4c8196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 0x7fa4c8196490 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009fd0 tx=0x7fa4b800f690 comp rx=0 tx=0).stop 2024-09-13T02:58:16.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 shutdown_connections 2024-09-13T02:58:16.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b406e7b0 0x7fa4b4070c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4c81004c0 0x7fa4c8195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 --2- 172.21.15.98:0/1066053157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4c8100e60 0x7fa4c8196490 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 >> 172.21.15.98:0/1066053157 conn(0x7fa4c80fbd80 msgr2=0x7fa4c80fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:16.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 shutdown_connections 2024-09-13T02:58:16.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.087+0000 7fa4d06c9700 1 -- 172.21.15.98:0/1066053157 wait complete. 2024-09-13T02:58:16.092 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:58:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.193+0000 7f7429d80700 1 -- 172.21.15.98:0/4139401061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7424100e80 msgr2=0x7f7424104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.193+0000 7f7429d80700 1 --2- 172.21.15.98:0/4139401061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7424100e80 0x7f7424104e50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7418009910 tx=0x7f7418009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.193+0000 7f7429d80700 1 -- 172.21.15.98:0/4139401061 shutdown_connections 2024-09-13T02:58:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.193+0000 7f7429d80700 1 --2- 172.21.15.98:0/4139401061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7424100e80 0x7f7424104e50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.193+0000 7f7429d80700 1 --2- 172.21.15.98:0/4139401061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74241004e0 0x7f74241008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.193+0000 7f7429d80700 1 -- 172.21.15.98:0/4139401061 >> 172.21.15.98:0/4139401061 conn(0x7f74240fbda0 msgr2=0x7f74240fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.193+0000 7f7429d80700 1 -- 172.21.15.98:0/4139401061 shutdown_connections 2024-09-13T02:58:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.193+0000 7f7429d80700 1 -- 172.21.15.98:0/4139401061 wait complete. 2024-09-13T02:58:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.193+0000 7f7429d80700 1 Processor -- start 2024-09-13T02:58:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f7429d80700 1 -- start start 2024-09-13T02:58:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f7429d80700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74241004e0 0x7f7424195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f7429d80700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424100e80 0x7f7424196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f7429d80700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7424196b30 con 0x7f74241004e0 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f7429d80700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742419a8c0 con 0x7f7424100e80 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f74237fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74241004e0 0x7f7424195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f74237fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74241004e0 0x7f7424195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37786/0 (socket says 172.21.15.98:37786) 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f74237fe700 1 -- 172.21.15.98:0/2270507740 learned_addr learned my addr 172.21.15.98:0/2270507740 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f7422ffd700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424100e80 0x7f7424196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f74237fe700 1 -- 172.21.15.98:0/2270507740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424100e80 msgr2=0x7f7424196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f74237fe700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424100e80 0x7f7424196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f74237fe700 1 -- 172.21.15.98:0/2270507740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180095f0 con 0x7f74241004e0 2024-09-13T02:58:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f7422ffd700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424100e80 0x7f7424196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:58:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.194+0000 7f74237fe700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74241004e0 0x7f7424195f10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74140060b0 tx=0x7f741400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.195+0000 7f7420ff9700 1 -- 172.21.15.98:0/2270507740 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741400dda0 con 0x7f74241004e0 2024-09-13T02:58:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.195+0000 7f7420ff9700 1 -- 172.21.15.98:0/2270507740 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f741400f040 con 0x7f74241004e0 2024-09-13T02:58:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.195+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742419aba0 con 0x7f74241004e0 2024-09-13T02:58:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.195+0000 7f7420ff9700 1 -- 172.21.15.98:0/2270507740 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7414014790 con 0x7f74241004e0 2024-09-13T02:58:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.195+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742419b0f0 con 0x7f74241004e0 2024-09-13T02:58:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.196+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7424108850 con 0x7f74241004e0 2024-09-13T02:58:16.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.196+0000 7f7420ff9700 1 -- 172.21.15.98:0/2270507740 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f7414014980 con 0x7f74241004e0 2024-09-13T02:58:16.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.197+0000 7f7420ff9700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f740c06e7b0 0x7f740c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:16.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.197+0000 7f7420ff9700 1 -- 172.21.15.98:0/2270507740 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f741408e290 con 0x7f74241004e0 2024-09-13T02:58:16.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.197+0000 7f7422ffd700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f740c06e7b0 0x7f740c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:16.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.197+0000 7f7422ffd700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f740c06e7b0 0x7f740c070c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7424197530 tx=0x7f741801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:16.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.201+0000 7f7420ff9700 1 -- 172.21.15.98:0/2270507740 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f74140573c0 con 0x7f74241004e0 2024-09-13T02:58:16.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.421+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f742419b370 con 0x7f740c06e7b0 2024-09-13T02:58:16.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.422+0000 7f7420ff9700 1 -- 172.21.15.98:0/2270507740 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f742419b370 con 0x7f740c06e7b0 2024-09-13T02:58:16.424 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:58:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:58:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:58:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:58:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:58:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T02:58:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-13T02:58:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T02:58:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:58:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "7/23 daemons upgraded", 2024-09-13T02:58:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:58:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:58:16.425 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f740c06e7b0 msgr2=0x7f740c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f740c06e7b0 0x7f740c070c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7424197530 tx=0x7f741801a040 comp rx=0 tx=0).stop 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74241004e0 msgr2=0x7f7424195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74241004e0 0x7f7424195f10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74140060b0 tx=0x7f741400d3b0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 shutdown_connections 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f740c06e7b0 0x7f740c070c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74241004e0 0x7f7424195f10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 --2- 172.21.15.98:0/2270507740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424100e80 0x7f7424196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 >> 172.21.15.98:0/2270507740 conn(0x7f74240fbda0 msgr2=0x7f74240fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 shutdown_connections 2024-09-13T02:58:16.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.425+0000 7f7429d80700 1 -- 172.21.15.98:0/2270507740 wait complete. 2024-09-13T02:58:16.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.529+0000 7fa4e313f700 1 -- 172.21.15.98:0/3745513358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 msgr2=0x7fa4dc10c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.529+0000 7fa4e313f700 1 --2- 172.21.15.98:0/3745513358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 0x7fa4dc10c700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009910 tx=0x7fa4c8009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:16.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.529+0000 7fa4e313f700 1 -- 172.21.15.98:0/3745513358 shutdown_connections 2024-09-13T02:58:16.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.529+0000 7fa4e313f700 1 --2- 172.21.15.98:0/3745513358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 0x7fa4dc10c700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.529+0000 7fa4e313f700 1 --2- 172.21.15.98:0/3745513358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4dc0ff090 0x7fa4dc0ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.529+0000 7fa4e313f700 1 -- 172.21.15.98:0/3745513358 >> 172.21.15.98:0/3745513358 conn(0x7fa4dc0face0 msgr2=0x7fa4dc0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:16.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.530+0000 7fa4e313f700 1 -- 172.21.15.98:0/3745513358 shutdown_connections 2024-09-13T02:58:16.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.530+0000 7fa4e313f700 1 -- 172.21.15.98:0/3745513358 wait complete. 2024-09-13T02:58:16.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.530+0000 7fa4e313f700 1 Processor -- start 2024-09-13T02:58:16.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.530+0000 7fa4e313f700 1 -- start start 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4e313f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4dc0ff090 0x7fa4dc198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4e313f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 0x7fa4dc1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4e313f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc198c90 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4e313f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc19ca20 con 0x7fa4dc0ff090 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4dbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 0x7fa4dc1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4dbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 0x7fa4dc1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37800/0 (socket says 172.21.15.98:37800) 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4dbfff700 1 -- 172.21.15.98:0/646324332 learned_addr learned my addr 172.21.15.98:0/646324332 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4e0edb700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4dc0ff090 0x7fa4dc198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4dbfff700 1 -- 172.21.15.98:0/646324332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4dc0ff090 msgr2=0x7fa4dc198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4dbfff700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4dc0ff090 0x7fa4dc198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4dbfff700 1 -- 172.21.15.98:0/646324332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c80095f0 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4dbfff700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 0x7fa4dc1985b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80092e0 tx=0x7fa4c800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:16.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4d9ffb700 1 -- 172.21.15.98:0/646324332 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c801d070 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4d9ffb700 1 -- 172.21.15.98:0/646324332 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4c8005e00 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc19cca0 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.531+0000 7fa4d9ffb700 1 -- 172.21.15.98:0/646324332 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c8017400 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.532+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc19d190 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.532+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc109e70 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.533+0000 7fa4d9ffb700 1 -- 172.21.15.98:0/646324332 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 38) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa4c800f6f0 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.533+0000 7fa4d9ffb700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4cc06e7b0 0x7fa4cc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:16.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.534+0000 7fa4d9ffb700 1 -- 172.21.15.98:0/646324332 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa4c808fc00 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.534+0000 7fa4e0edb700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4cc06e7b0 0x7fa4cc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:16.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.534+0000 7fa4e0edb700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4cc06e7b0 0x7fa4cc070c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0005950 tx=0x7fa4d000b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:16.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.538+0000 7fa4d9ffb700 1 -- 172.21.15.98:0/646324332 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4c8095020 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.826+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa4dc04f2a0 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.826+0000 7fa4d9ffb700 1 -- 172.21.15.98:0/646324332 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+537 (secure 0 0 0) 0x7fa4c8058d00 con 0x7fa4dc0ff9a0 2024-09-13T02:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded 2024-09-13T02:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded 2024-09-13T02:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-13T02:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-13T02:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-13T02:58:16.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4cc06e7b0 msgr2=0x7fa4cc070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4cc06e7b0 0x7fa4cc070c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0005950 tx=0x7fa4d000b410 comp rx=0 tx=0).stop 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 msgr2=0x7fa4dc1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 0x7fa4dc1985b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80092e0 tx=0x7fa4c800bd70 comp rx=0 tx=0).stop 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 shutdown_connections 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4cc06e7b0 0x7fa4cc070c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4dc0ff090 0x7fa4dc198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 --2- 172.21.15.98:0/646324332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4dc0ff9a0 0x7fa4dc1985b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 >> 172.21.15.98:0/646324332 conn(0x7fa4dc0face0 msgr2=0x7fa4dc0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 shutdown_connections 2024-09-13T02:58:16.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:16.829+0000 7fa4e313f700 1 -- 172.21.15.98:0/646324332 wait complete. 2024-09-13T02:58:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:16 smithi098 ceph-mon[87325]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:16 smithi098 ceph-mon[87325]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:16 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/230341117' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:16 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1066053157' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:16 smithi142 ceph-mon[65447]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:16 smithi142 ceph-mon[65447]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:16 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/230341117' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:16 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1066053157' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:17.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:17 smithi098 ceph-mon[87325]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:17.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:17 smithi098 ceph-mon[87325]: pgmap v52: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s; 7/267 objects degraded (2.622%) 2024-09-13T02:58:17.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:17 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/646324332' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:18.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:17 smithi142 ceph-mon[65447]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:18.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:17 smithi142 ceph-mon[65447]: pgmap v52: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 0 op/s; 7/267 objects degraded (2.622%) 2024-09-13T02:58:18.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:17 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/646324332' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:18 smithi098 ceph-mon[87325]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded) 2024-09-13T02:58:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:18 smithi142 ceph-mon[65447]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/267 objects degraded (2.622%), 3 pgs degraded) 2024-09-13T02:58:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:20.135 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:19 smithi098 ceph-mon[87325]: pgmap v53: 65 pgs: 25 peering, 40 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:58:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:19 smithi142 ceph-mon[65447]: pgmap v53: 65 pgs: 25 peering, 40 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:58:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:21 smithi098 ceph-mon[87325]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 0 op/s 2024-09-13T02:58:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:21 smithi098 ceph-mon[87325]: mgrmap e39: smithi098.ukgenf(active, since 92s), standbys: smithi142.jutrvi 2024-09-13T02:58:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:21 smithi142 ceph-mon[65447]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 0 op/s 2024-09-13T02:58:22.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:21 smithi142 ceph-mon[65447]: mgrmap e39: smithi098.ukgenf(active, since 92s), standbys: smithi142.jutrvi 2024-09-13T02:58:24.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:23 smithi098 ceph-mon[87325]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 125 B/s wr, 0 op/s 2024-09-13T02:58:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:23 smithi142 ceph-mon[65447]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 125 B/s wr, 0 op/s 2024-09-13T02:58:26.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:25 smithi142 ceph-mon[65447]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 1 op/s 2024-09-13T02:58:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:25 smithi098 ceph-mon[87325]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 1 op/s 2024-09-13T02:58:28.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:27 smithi098 ceph-mon[87325]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1007 B/s rd, 274 B/s wr, 1 op/s 2024-09-13T02:58:28.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:27 smithi142 ceph-mon[65447]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1007 B/s rd, 274 B/s wr, 1 op/s 2024-09-13T02:58:29.109 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:29.109 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:29.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:29 smithi098 ceph-mon[87325]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T02:58:29.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:29 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:29.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:29 smithi098 ceph-mon[87325]: Upgrade: osd.1 is safe to restart 2024-09-13T02:58:30.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:29 smithi142 ceph-mon[65447]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-13T02:58:30.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:29 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:30.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:29 smithi142 ceph-mon[65447]: Upgrade: osd.1 is safe to restart 2024-09-13T02:58:31.417 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:31 smithi098 ceph-mon[87325]: Upgrade: Updating osd.1 2024-09-13T02:58:31.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:31 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:31.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:31 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:58:31.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:31 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:31.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:31 smithi098 ceph-mon[87325]: Deploying daemon osd.1 on smithi098 2024-09-13T02:58:31.418 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:31 smithi098 ceph-mon[87325]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:58:31.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:31 smithi142 ceph-mon[65447]: Upgrade: Updating osd.1 2024-09-13T02:58:31.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:31 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:31.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:31 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:58:31.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:31 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:31.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:31 smithi142 ceph-mon[65447]: Deploying daemon osd.1 on smithi098 2024-09-13T02:58:31.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:31 smithi142 ceph-mon[65447]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T02:58:33.423 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:33 smithi098 systemd[1]: Stopping Ceph osd.1 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:58:33.733 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:33 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[48296]: 2024-09-13T02:58:33.420+0000 7f059e5d0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:58:33.734 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:33 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[48296]: 2024-09-13T02:58:33.420+0000 7f059e5d0700 -1 osd.1 54 *** Got signal Terminated *** 2024-09-13T02:58:33.734 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:33 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[48296]: 2024-09-13T02:58:33.420+0000 7f059e5d0700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:58:34.136 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:33 smithi098 ceph-mon[87325]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T02:58:34.136 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:33 smithi098 ceph-mon[87325]: osd.1 marked itself down and dead 2024-09-13T02:58:34.136 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:33 smithi142 ceph-mon[65447]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T02:58:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:33 smithi142 ceph-mon[65447]: osd.1 marked itself down and dead 2024-09-13T02:58:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:34.423 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:34 smithi098 podman[103427]: 2024-09-13 02:58:34.13498145 +0000 UTC m=+0.868575806 container died e9eee821d53937dabd0fe91a2170a19110074f7f68387d770e3847254c996836 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212) 2024-09-13T02:58:34.734 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:34 smithi098 podman[103427]: 2024-09-13 02:58:34.604864423 +0000 UTC m=+1.338458767 container cleanup e9eee821d53937dabd0fe91a2170a19110074f7f68387d770e3847254c996836 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD) 2024-09-13T02:58:34.734 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:34 smithi098 bash[103427]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1 2024-09-13T02:58:35.197 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:34 smithi098 ceph-mon[87325]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:58:35.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:34 smithi098 ceph-mon[87325]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T02:58:35.198 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:34 smithi098 ceph-mon[87325]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T02:58:35.198 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:34 smithi098 podman[103443]: 2024-09-13 02:58:34.881775277 +0000 UTC m=+0.740749931 container remove e9eee821d53937dabd0fe91a2170a19110074f7f68387d770e3847254c996836 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS) 2024-09-13T02:58:35.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:34 smithi142 ceph-mon[65447]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:58:35.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:34 smithi142 ceph-mon[65447]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T02:58:35.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:34 smithi142 ceph-mon[65447]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T02:58:35.478 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:35 smithi098 podman[103528]: 2024-09-13 02:58:35.099834456 +0000 UTC m=+0.016250962 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:35.478 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:35 smithi098 podman[103528]: 2024-09-13 02:58:35.199376489 +0000 UTC m=+0.115792995 container create bd0a4214063d3d5c63cbdba89a3173abc566af7833e9c9f06ecac99e630cd8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:58:35.478 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:35 smithi098 podman[103528]: 2024-09-13 02:58:35.402369113 +0000 UTC m=+0.318785631 container init bd0a4214063d3d5c63cbdba89a3173abc566af7833e9c9f06ecac99e630cd8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T02:58:35.478 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:35 smithi098 podman[103528]: 2024-09-13 02:58:35.405792771 +0000 UTC m=+0.322209283 container start bd0a4214063d3d5c63cbdba89a3173abc566af7833e9c9f06ecac99e630cd8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:58:35.478 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:35 smithi098 podman[103528]: 2024-09-13 02:58:35.477195801 +0000 UTC m=+0.393612317 container attach bd0a4214063d3d5c63cbdba89a3173abc566af7833e9c9f06ecac99e630cd8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:58:35.734 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:35 smithi098 podman[103528]: 2024-09-13 02:58:35.600275219 +0000 UTC m=+0.516691732 container died bd0a4214063d3d5c63cbdba89a3173abc566af7833e9c9f06ecac99e630cd8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f) 2024-09-13T02:58:36.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:35 smithi142 ceph-mon[65447]: pgmap v62: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-13T02:58:36.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:35 smithi142 ceph-mon[65447]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-13T02:58:36.132 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:35 smithi098 ceph-mon[87325]: pgmap v62: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-13T02:58:36.132 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:35 smithi098 ceph-mon[87325]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-13T02:58:36.484 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 podman[103552]: 2024-09-13 02:58:36.1313366 +0000 UTC m=+0.521051196 container remove bd0a4214063d3d5c63cbdba89a3173abc566af7833e9c9f06ecac99e630cd8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-13T02:58:36.484 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T02:58:36.484 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 systemd[1]: Stopped Ceph osd.1 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:58:36.484 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.1.service: Consumed 57.228s CPU time. 2024-09-13T02:58:36.484 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 systemd[1]: Starting Ceph osd.1 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:58:36.886 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 podman[103653]: 2024-09-13 02:58:36.486940425 +0000 UTC m=+0.016219833 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:36.886 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 podman[103653]: 2024-09-13 02:58:36.599402205 +0000 UTC m=+0.128681651 container create 8417f96aa59847cee79b4cc5cc7d2ff79117ba2c534e0ac6e0d42646966881ac (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-13T02:58:36.886 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 podman[103653]: 2024-09-13 02:58:36.810375034 +0000 UTC m=+0.339654450 container init 8417f96aa59847cee79b4cc5cc7d2ff79117ba2c534e0ac6e0d42646966881ac (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T02:58:36.886 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 podman[103653]: 2024-09-13 02:58:36.813793804 +0000 UTC m=+0.343073217 container start 8417f96aa59847cee79b4cc5cc7d2ff79117ba2c534e0ac6e0d42646966881ac (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-13T02:58:36.886 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 podman[103653]: 2024-09-13 02:58:36.885164609 +0000 UTC m=+0.414444019 container attach 8417f96aa59847cee79b4cc5cc7d2ff79117ba2c534e0ac6e0d42646966881ac (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:58:37.141 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate[103667]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:37.141 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 bash[103653]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:37.141 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate[103667]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:37.141 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:36 smithi098 bash[103653]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:37.965 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:37 smithi098 ceph-mon[87325]: pgmap v64: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-13T02:58:37.966 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate[103667]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:58:37.966 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 bash[103653]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:58:37.966 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate[103667]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T02:58:37.966 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 bash[103653]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate[103667]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 bash[103653]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate[103667]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 bash[103653]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate[103667]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 bash[103653]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate[103667]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 bash[103653]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate[103667]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T02:58:38.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:37 smithi098 bash[103653]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T02:58:38.235 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:38 smithi098 podman[103809]: 2024-09-13 02:58:38.020542716 +0000 UTC m=+0.016310781 container died 8417f96aa59847cee79b4cc5cc7d2ff79117ba2c534e0ac6e0d42646966881ac (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T02:58:38.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:37 smithi142 ceph-mon[65447]: pgmap v64: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-13T02:58:39.093 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:38 smithi098 ceph-mon[87325]: Health check failed: Degraded data redundancy: 2/267 objects degraded (0.749%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:39.093 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:38 smithi098 podman[103809]: 2024-09-13 02:58:38.882158159 +0000 UTC m=+0.877926320 container remove 8417f96aa59847cee79b4cc5cc7d2ff79117ba2c534e0ac6e0d42646966881ac (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T02:58:39.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:38 smithi142 ceph-mon[65447]: Health check failed: Degraded data redundancy: 2/267 objects degraded (0.749%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:39.386 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:39 smithi098 podman[103865]: 2024-09-13 02:58:39.091322875 +0000 UTC m=+0.112969352 container create 0f8e265c15791d27eb14e37206cfba52f7e6331fbeb040bcd2090e5e7c85fedc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-13T02:58:39.386 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:39 smithi098 podman[103865]: 2024-09-13 02:58:38.994337217 +0000 UTC m=+0.015983695 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:39.386 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:39 smithi098 podman[103865]: 2024-09-13 02:58:39.293671142 +0000 UTC m=+0.315317620 container init 0f8e265c15791d27eb14e37206cfba52f7e6331fbeb040bcd2090e5e7c85fedc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:58:39.386 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:39 smithi098 podman[103865]: 2024-09-13 02:58:39.29688643 +0000 UTC m=+0.318532909 container start 0f8e265c15791d27eb14e37206cfba52f7e6331fbeb040bcd2090e5e7c85fedc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-7741f7f) 2024-09-13T02:58:39.386 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:39 smithi098 ceph-osd[103885]: -- 172.21.15.98:0/224787738 <== mon.0 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557512ac81e0 con 0x557512a5e000 2024-09-13T02:58:39.387 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:39 smithi098 bash[103865]: 0f8e265c15791d27eb14e37206cfba52f7e6331fbeb040bcd2090e5e7c85fedc 2024-09-13T02:58:39.734 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:39 smithi098 systemd[1]: Started Ceph osd.1 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:58:40.154 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:39 smithi098 ceph-mon[87325]: pgmap v65: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 2/267 objects degraded (0.749%) 2024-09-13T02:58:40.154 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:39 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:40.154 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:39 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:40.154 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:39 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:40.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:39 smithi142 ceph-mon[65447]: pgmap v65: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 2/267 objects degraded (0.749%) 2024-09-13T02:58:40.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:39 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:40.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:39 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:40.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:39 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:41.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:40 smithi098 ceph-mon[87325]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-13T02:58:41.234 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:40 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[103881]: 2024-09-13T02:58:40.937+0000 7fb086fd8640 -1 Falling back to public interface 2024-09-13T02:58:41.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:40 smithi142 ceph-mon[65447]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-13T02:58:41.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:41 smithi098 ceph-mon[87325]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:41 smithi142 ceph-mon[65447]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:44.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:43 smithi098 ceph-mon[87325]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:43 smithi142 ceph-mon[65447]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:45.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:45 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:45.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:45 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:45.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:45 smithi098 ceph-mon[87325]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:45.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:45 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:45.589 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:45 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:45.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:45 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:45.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:45 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:45.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:45 smithi142 ceph-mon[65447]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:45.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:45 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:45.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:45 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:46.711 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:46 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[103881]: 2024-09-13T02:58:46.471+0000 7fb086fd8640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-13T02:58:46.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.940+0000 7f995dd5a700 1 -- 172.21.15.98:0/3244535332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 msgr2=0x7f9958103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:46.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.940+0000 7f995dd5a700 1 --2- 172.21.15.98:0/3244535332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 0x7f9958103d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f994c009910 tx=0x7f994c009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:46.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.940+0000 7f995dd5a700 1 -- 172.21.15.98:0/3244535332 shutdown_connections 2024-09-13T02:58:46.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.940+0000 7f995dd5a700 1 --2- 172.21.15.98:0/3244535332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 0x7f9958103d30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:46.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.940+0000 7f995dd5a700 1 --2- 172.21.15.98:0/3244535332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99580ff3c0 0x7f99580ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:46.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.940+0000 7f995dd5a700 1 -- 172.21.15.98:0/3244535332 >> 172.21.15.98:0/3244535332 conn(0x7f99580fac60 msgr2=0x7f99580fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:46.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.940+0000 7f995dd5a700 1 -- 172.21.15.98:0/3244535332 shutdown_connections 2024-09-13T02:58:46.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.940+0000 7f995dd5a700 1 -- 172.21.15.98:0/3244535332 wait complete. 2024-09-13T02:58:46.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.941+0000 7f995dd5a700 1 Processor -- start 2024-09-13T02:58:46.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.941+0000 7f995dd5a700 1 -- start start 2024-09-13T02:58:46.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.941+0000 7f995dd5a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99580ff3c0 0x7f9958196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:46.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.941+0000 7f995dd5a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 0x7f9958197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:46.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.941+0000 7f995dd5a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9958197970 con 0x7f99580ffd60 2024-09-13T02:58:46.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.941+0000 7f995dd5a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9958197ae0 con 0x7f99580ff3c0 2024-09-13T02:58:46.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.941+0000 7f9956ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 0x7f9958197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:46.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f9956ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 0x7f9958197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35008/0 (socket says 172.21.15.98:35008) 2024-09-13T02:58:46.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f9956ffd700 1 -- 172.21.15.98:0/3382177812 learned_addr learned my addr 172.21.15.98:0/3382177812 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:46.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f99577fe700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99580ff3c0 0x7f9958196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:46.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f9956ffd700 1 -- 172.21.15.98:0/3382177812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99580ff3c0 msgr2=0x7f9958196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:46.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f9956ffd700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99580ff3c0 0x7f9958196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:46.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f9956ffd700 1 -- 172.21.15.98:0/3382177812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0095f0 con 0x7f99580ffd60 2024-09-13T02:58:46.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f9956ffd700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 0x7f9958197350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f994c005f50 tx=0x7f994c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:46.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f9954ff9700 1 -- 172.21.15.98:0/3382177812 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f994c01d070 con 0x7f99580ffd60 2024-09-13T02:58:46.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f9954ff9700 1 -- 172.21.15.98:0/3382177812 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f994c00f460 con 0x7f99580ffd60 2024-09-13T02:58:46.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995819fe80 con 0x7f99580ffd60 2024-09-13T02:58:46.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f9954ff9700 1 -- 172.21.15.98:0/3382177812 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f994c017630 con 0x7f99580ffd60 2024-09-13T02:58:46.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.942+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99581a02f0 con 0x7f99580ffd60 2024-09-13T02:58:46.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.943+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9958107680 con 0x7f99580ffd60 2024-09-13T02:58:46.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.944+0000 7f9954ff9700 1 -- 172.21.15.98:0/3382177812 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f994c00f5d0 con 0x7f99580ffd60 2024-09-13T02:58:46.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.945+0000 7f9954ff9700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f994006e680 0x7f9940070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:46.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.945+0000 7f9954ff9700 1 -- 172.21.15.98:0/3382177812 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f994c08fa10 con 0x7f99580ffd60 2024-09-13T02:58:46.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.945+0000 7f99577fe700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f994006e680 0x7f9940070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:46.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.945+0000 7f99577fe700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f994006e680 0x7f9940070b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9948009a10 tx=0x7f9948009190 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:46.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:46.950+0000 7f9954ff9700 1 -- 172.21.15.98:0/3382177812 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f994c058d30 con 0x7f99580ffd60 2024-09-13T02:58:46.983 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:46 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[103881]: 2024-09-13T02:58:46.809+0000 7fb086fd8640 -1 osd.1 54 log_to_monitors true 2024-09-13T02:58:47.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.181+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9958061190 con 0x7f994006e680 2024-09-13T02:58:47.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.183+0000 7f9954ff9700 1 -- 172.21.15.98:0/3382177812 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9958061190 con 0x7f994006e680 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f994006e680 msgr2=0x7f9940070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f994006e680 0x7f9940070b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9948009a10 tx=0x7f9948009190 comp rx=0 tx=0).stop 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 msgr2=0x7f9958197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 0x7f9958197350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f994c005f50 tx=0x7f994c00bd70 comp rx=0 tx=0).stop 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 shutdown_connections 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f994006e680 0x7f9940070b30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99580ff3c0 0x7f9958196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 --2- 172.21.15.98:0/3382177812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99580ffd60 0x7f9958197350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 >> 172.21.15.98:0/3382177812 conn(0x7f99580fac60 msgr2=0x7f99580fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:47.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 shutdown_connections 2024-09-13T02:58:47.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.185+0000 7f995dd5a700 1 -- 172.21.15.98:0/3382177812 wait complete. 2024-09-13T02:58:47.197 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:58:47.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.296+0000 7f024df1a700 1 -- 172.21.15.98:0/1941781851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ff3c0 msgr2=0x7f02480ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.296+0000 7f024df1a700 1 --2- 172.21.15.98:0/1941781851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ff3c0 0x7f02480ff790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0238009910 tx=0x7f0238009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:47.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.296+0000 7f024df1a700 1 -- 172.21.15.98:0/1941781851 shutdown_connections 2024-09-13T02:58:47.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.296+0000 7f024df1a700 1 --2- 172.21.15.98:0/1941781851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02480ffd60 0x7f0248103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.296+0000 7f024df1a700 1 --2- 172.21.15.98:0/1941781851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ff3c0 0x7f02480ff790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.296+0000 7f024df1a700 1 -- 172.21.15.98:0/1941781851 >> 172.21.15.98:0/1941781851 conn(0x7f02480fac60 msgr2=0x7f02480fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:47.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.296+0000 7f024df1a700 1 -- 172.21.15.98:0/1941781851 shutdown_connections 2024-09-13T02:58:47.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.296+0000 7f024df1a700 1 -- 172.21.15.98:0/1941781851 wait complete. 2024-09-13T02:58:47.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.297+0000 7f024df1a700 1 Processor -- start 2024-09-13T02:58:47.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.297+0000 7f024df1a700 1 -- start start 2024-09-13T02:58:47.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.297+0000 7f024df1a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02480ff3c0 0x7f0248195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:47.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.297+0000 7f024df1a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ffd60 0x7f02481963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:47.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.297+0000 7f024df1a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0248196a80 con 0x7f02480ffd60 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.297+0000 7f024df1a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024819a810 con 0x7f02480ff3c0 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.298+0000 7f0246ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ffd60 0x7f02481963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.298+0000 7f0246ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ffd60 0x7f02481963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35028/0 (socket says 172.21.15.98:35028) 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.298+0000 7f0246ffd700 1 -- 172.21.15.98:0/3390551325 learned_addr learned my addr 172.21.15.98:0/3390551325 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.298+0000 7f02477fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02480ff3c0 0x7f0248195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.298+0000 7f02477fe700 1 -- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ffd60 msgr2=0x7f02481963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.298+0000 7f02477fe700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ffd60 0x7f02481963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.298+0000 7f02477fe700 1 -- 172.21.15.98:0/3390551325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02380095f0 con 0x7f02480ff3c0 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.298+0000 7f0246ffd700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ffd60 0x7f02481963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.298+0000 7f02477fe700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02480ff3c0 0x7f0248195e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0238000c00 tx=0x7f023800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.299+0000 7f0244ff9700 1 -- 172.21.15.98:0/3390551325 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f023801d070 con 0x7f02480ff3c0 2024-09-13T02:58:47.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.299+0000 7f0244ff9700 1 -- 172.21.15.98:0/3390551325 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0238005dc0 con 0x7f02480ff3c0 2024-09-13T02:58:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.299+0000 7f0244ff9700 1 -- 172.21.15.98:0/3390551325 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f023800fe60 con 0x7f02480ff3c0 2024-09-13T02:58:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.299+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024819aa90 con 0x7f02480ff3c0 2024-09-13T02:58:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.299+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024819af30 con 0x7f02480ff3c0 2024-09-13T02:58:47.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.301+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02481086e0 con 0x7f02480ff3c0 2024-09-13T02:58:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.301+0000 7f0244ff9700 1 -- 172.21.15.98:0/3390551325 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f023800f660 con 0x7f02480ff3c0 2024-09-13T02:58:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.301+0000 7f0244ff9700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f023006e680 0x7f0230070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.301+0000 7f0244ff9700 1 -- 172.21.15.98:0/3390551325 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f023808f900 con 0x7f02480ff3c0 2024-09-13T02:58:47.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.302+0000 7f0246ffd700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f023006e680 0x7f0230070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:47.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.302+0000 7f0246ffd700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f023006e680 0x7f0230070b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0248197480 tx=0x7f023c00b480 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:47.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.307+0000 7f0244ff9700 1 -- 172.21.15.98:0/3390551325 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0238058ba0 con 0x7f02480ff3c0 2024-09-13T02:58:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.552+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f024819b1a0 con 0x7f023006e680 2024-09-13T02:58:47.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.553+0000 7f0244ff9700 1 -- 172.21.15.98:0/3390551325 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f024819b1a0 con 0x7f023006e680 2024-09-13T02:58:47.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f023006e680 msgr2=0x7f0230070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f023006e680 0x7f0230070b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0248197480 tx=0x7f023c00b480 comp rx=0 tx=0).stop 2024-09-13T02:58:47.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02480ff3c0 msgr2=0x7f0248195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02480ff3c0 0x7f0248195e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0238000c00 tx=0x7f023800bd70 comp rx=0 tx=0).stop 2024-09-13T02:58:47.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 shutdown_connections 2024-09-13T02:58:47.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f023006e680 0x7f0230070b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02480ff3c0 0x7f0248195e60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 --2- 172.21.15.98:0/3390551325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02480ffd60 0x7f02481963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 >> 172.21.15.98:0/3390551325 conn(0x7f02480fac60 msgr2=0x7f0248069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:47.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 shutdown_connections 2024-09-13T02:58:47.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.555+0000 7f024df1a700 1 -- 172.21.15.98:0/3390551325 wait complete. 2024-09-13T02:58:47.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.671+0000 7fd9664d2700 1 -- 172.21.15.98:0/4000974484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9600687a0 msgr2=0x7fd960068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.671+0000 7fd9664d2700 1 --2- 172.21.15.98:0/4000974484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9600687a0 0x7fd960068b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd954009910 tx=0x7fd954009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:47.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.671+0000 7fd9664d2700 1 -- 172.21.15.98:0/4000974484 shutdown_connections 2024-09-13T02:58:47.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.671+0000 7fd9664d2700 1 --2- 172.21.15.98:0/4000974484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd960069140 0x7fd960104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.671+0000 7fd9664d2700 1 --2- 172.21.15.98:0/4000974484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9600687a0 0x7fd960068b70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.671+0000 7fd9664d2700 1 -- 172.21.15.98:0/4000974484 >> 172.21.15.98:0/4000974484 conn(0x7fd960075130 msgr2=0x7fd960075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:47.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.671+0000 7fd9664d2700 1 -- 172.21.15.98:0/4000974484 shutdown_connections 2024-09-13T02:58:47.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.671+0000 7fd9664d2700 1 -- 172.21.15.98:0/4000974484 wait complete. 2024-09-13T02:58:47.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.671+0000 7fd9664d2700 1 Processor -- start 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd9664d2700 1 -- start start 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd9664d2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9600687a0 0x7fd960195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd9664d2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd960069140 0x7fd960196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd9664d2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960196b00 con 0x7fd960069140 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd9664d2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96019a890 con 0x7fd9600687a0 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd95f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd960069140 0x7fd960196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd95f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd960069140 0x7fd960196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35052/0 (socket says 172.21.15.98:35052) 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd95f7fe700 1 -- 172.21.15.98:0/2168234683 learned_addr learned my addr 172.21.15.98:0/2168234683 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd95ffff700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9600687a0 0x7fd960195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd95f7fe700 1 -- 172.21.15.98:0/2168234683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9600687a0 msgr2=0x7fd960195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd95f7fe700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9600687a0 0x7fd960195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.672+0000 7fd95f7fe700 1 -- 172.21.15.98:0/2168234683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540095f0 con 0x7fd960069140 2024-09-13T02:58:47.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.673+0000 7fd95f7fe700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd960069140 0x7fd960196420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd95000c8f0 tx=0x7fd95000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:47.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.673+0000 7fd95d7fa700 1 -- 172.21.15.98:0/2168234683 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd950007a50 con 0x7fd960069140 2024-09-13T02:58:47.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.673+0000 7fd95d7fa700 1 -- 172.21.15.98:0/2168234683 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd950007bb0 con 0x7fd960069140 2024-09-13T02:58:47.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.673+0000 7fd95d7fa700 1 -- 172.21.15.98:0/2168234683 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd950018630 con 0x7fd960069140 2024-09-13T02:58:47.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.673+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96019ab70 con 0x7fd960069140 2024-09-13T02:58:47.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.673+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96019b0c0 con 0x7fd960069140 2024-09-13T02:58:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.674+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd960108770 con 0x7fd960069140 2024-09-13T02:58:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.675+0000 7fd95d7fa700 1 -- 172.21.15.98:0/2168234683 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd950007d20 con 0x7fd960069140 2024-09-13T02:58:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.675+0000 7fd95d7fa700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd94806e680 0x7fd948070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.675+0000 7fd95d7fa700 1 -- 172.21.15.98:0/2168234683 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd95008e540 con 0x7fd960069140 2024-09-13T02:58:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.675+0000 7fd95ffff700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd94806e680 0x7fd948070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.676+0000 7fd95ffff700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd94806e680 0x7fd948070b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd95400b5c0 tx=0x7fd95401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.680+0000 7fd95d7fa700 1 -- 172.21.15.98:0/2168234683 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd9500577e0 con 0x7fd960069140 2024-09-13T02:58:47.814 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:47 smithi098 ceph-mon[87325]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:47.814 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:47 smithi098 ceph-mon[87325]: from='osd.1 [v2:172.21.15.98:6810/2689543754,v1:172.21.15.98:6811/2689543754]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:58:47.814 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:47 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:47.814 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 02:58:47 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[103881]: 2024-09-13T02:58:47.785+0000 7fb07ed72640 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:58:47.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.910+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd96019b340 con 0x7fd94806e680 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.919+0000 7fd95d7fa700 1 -- 172.21.15.98:0/2168234683 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd96019b340 con 0x7fd94806e680 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (3m) 3s ago 14m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (14m) 3s ago 14m 8372k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (13m) 59s ago 13m 7755k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (67s) 3s ago 14m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (62s) 59s ago 13m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (3m) 3s ago 14m 77.6M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (8m) 3s ago 8m 93.9M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:58:47.921 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (8m) 3s ago 8m 152M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (8m) 59s ago 8m 15.8M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (8m) 59s ago 8m 19.2M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (5m) 3s ago 15m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (4m) 59s ago 13m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (2m) 3s ago 15m 47.3M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (104s) 59s ago 13m 35.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (4m) 3s ago 14m 16.4M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (4m) 59s ago 13m 15.0M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (43s) 3s ago 12m 91.4M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (8s) 3s ago 12m 11.6M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (11m) 3s ago 11m 185M 1216M 18.2.0 dc2bc1663786 855dbca56916 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (11m) 59s ago 11m 240M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:58:47.922 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (10m) 59s ago 10m 214M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:58:47.923 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (10m) 59s ago 10m 197M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:58:47.923 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (3m) 3s ago 13m 78.7M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:58:47.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd94806e680 msgr2=0x7fd948070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd94806e680 0x7fd948070b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd95400b5c0 tx=0x7fd95401a040 comp rx=0 tx=0).stop 2024-09-13T02:58:47.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd960069140 msgr2=0x7fd960196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:47.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd960069140 0x7fd960196420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd95000c8f0 tx=0x7fd95000ccb0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 shutdown_connections 2024-09-13T02:58:47.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd94806e680 0x7fd948070b30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9600687a0 0x7fd960195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 --2- 172.21.15.98:0/2168234683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd960069140 0x7fd960196420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:47.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 >> 172.21.15.98:0/2168234683 conn(0x7fd960075130 msgr2=0x7fd9600fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:47.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 shutdown_connections 2024-09-13T02:58:47.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:47.921+0000 7fd9664d2700 1 -- 172.21.15.98:0/2168234683 wait complete. 2024-09-13T02:58:48.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.030+0000 7fe114f0e700 1 -- 172.21.15.98:0/3581102114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ff350 msgr2=0x7fe1100ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.030+0000 7fe114f0e700 1 --2- 172.21.15.98:0/3581102114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ff350 0x7fe1100ff720 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe104009910 tx=0x7fe104009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:48.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.030+0000 7fe114f0e700 1 -- 172.21.15.98:0/3581102114 shutdown_connections 2024-09-13T02:58:48.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.030+0000 7fe114f0e700 1 --2- 172.21.15.98:0/3581102114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1100ffc60 0x7fe11010a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.030+0000 7fe114f0e700 1 --2- 172.21.15.98:0/3581102114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ff350 0x7fe1100ff720 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.030+0000 7fe114f0e700 1 -- 172.21.15.98:0/3581102114 >> 172.21.15.98:0/3581102114 conn(0x7fe1100748b0 msgr2=0x7fe110074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:48.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.030+0000 7fe114f0e700 1 -- 172.21.15.98:0/3581102114 shutdown_connections 2024-09-13T02:58:48.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.030+0000 7fe114f0e700 1 -- 172.21.15.98:0/3581102114 wait complete. 2024-09-13T02:58:48.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe114f0e700 1 Processor -- start 2024-09-13T02:58:48.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe114f0e700 1 -- start start 2024-09-13T02:58:48.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe114f0e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1100ff350 0x7fe110195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe114f0e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ffc60 0x7fe110196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe114f0e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe110196a50 con 0x7fe1100ffc60 2024-09-13T02:58:48.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe114f0e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11019a7e0 con 0x7fe1100ff350 2024-09-13T02:58:48.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe10dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ffc60 0x7fe110196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe10e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1100ff350 0x7fe110195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe10dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ffc60 0x7fe110196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35058/0 (socket says 172.21.15.98:35058) 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.031+0000 7fe10dd9b700 1 -- 172.21.15.98:0/179980819 learned_addr learned my addr 172.21.15.98:0/179980819 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.032+0000 7fe10dd9b700 1 -- 172.21.15.98:0/179980819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1100ff350 msgr2=0x7fe110195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.032+0000 7fe10dd9b700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1100ff350 0x7fe110195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.032+0000 7fe10dd9b700 1 -- 172.21.15.98:0/179980819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1040095f0 con 0x7fe1100ffc60 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.032+0000 7fe10e59c700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1100ff350 0x7fe110195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.032+0000 7fe10dd9b700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ffc60 0x7fe110196370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe10000d8d0 tx=0x7fe10000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.032+0000 7fe0ff7fe700 1 -- 172.21.15.98:0/179980819 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1000098a0 con 0x7fe1100ffc60 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.032+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11019aac0 con 0x7fe1100ffc60 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.032+0000 7fe0ff7fe700 1 -- 172.21.15.98:0/179980819 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe100010460 con 0x7fe1100ffc60 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.032+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11019af50 con 0x7fe1100ffc60 2024-09-13T02:58:48.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.033+0000 7fe0ff7fe700 1 -- 172.21.15.98:0/179980819 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe10000f5f0 con 0x7fe1100ffc60 2024-09-13T02:58:48.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.033+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f0005320 con 0x7fe1100ffc60 2024-09-13T02:58:48.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.034+0000 7fe0ff7fe700 1 -- 172.21.15.98:0/179980819 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe100009a00 con 0x7fe1100ffc60 2024-09-13T02:58:48.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.034+0000 7fe0ff7fe700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe0f806e680 0x7fe0f8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.035+0000 7fe0ff7fe700 1 -- 172.21.15.98:0/179980819 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe10008e2a0 con 0x7fe1100ffc60 2024-09-13T02:58:48.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.035+0000 7fe10e59c700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe0f806e680 0x7fe0f8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.035+0000 7fe10e59c700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe0f806e680 0x7fe0f8070b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe104006010 tx=0x7fe10401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:48.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.039+0000 7fe0ff7fe700 1 -- 172.21.15.98:0/179980819 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe1000575c0 con 0x7fe1100ffc60 2024-09-13T02:58:48.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:47 smithi142 ceph-mon[65447]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:48.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:47 smithi142 ceph-mon[65447]: from='osd.1 [v2:172.21.15.98:6810/2689543754,v1:172.21.15.98:6811/2689543754]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:58:48.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:47 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:48.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.348+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0f0006200 con 0x7fe1100ffc60 2024-09-13T02:58:48.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.348+0000 7fe0ff7fe700 1 -- 172.21.15.98:0/179980819 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fe10005ac80 con 0x7fe1100ffc60 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-13T02:58:48.351 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:58:48.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:58:48.352 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:58:48.352 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:58:48.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:58:48.352 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:58:48.352 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-09-13T02:58:48.352 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 5 2024-09-13T02:58:48.352 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:58:48.352 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:58:48.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.350+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe0f806e680 msgr2=0x7fe0f8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.350+0000 7fe114f0e700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe0f806e680 0x7fe0f8070b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe104006010 tx=0x7fe10401a040 comp rx=0 tx=0).stop 2024-09-13T02:58:48.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.350+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ffc60 msgr2=0x7fe110196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.350+0000 7fe114f0e700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ffc60 0x7fe110196370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe10000d8d0 tx=0x7fe10000dbe0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.350+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 shutdown_connections 2024-09-13T02:58:48.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.350+0000 7fe114f0e700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe0f806e680 0x7fe0f8070b30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.350+0000 7fe114f0e700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1100ff350 0x7fe110195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.350+0000 7fe114f0e700 1 --2- 172.21.15.98:0/179980819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1100ffc60 0x7fe110196370 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.350+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 >> 172.21.15.98:0/179980819 conn(0x7fe1100748b0 msgr2=0x7fe110104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:48.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.351+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 shutdown_connections 2024-09-13T02:58:48.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.351+0000 7fe114f0e700 1 -- 172.21.15.98:0/179980819 wait complete. 2024-09-13T02:58:48.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.456+0000 7fce3a608700 1 -- 172.21.15.98:0/906629565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ffc60 msgr2=0x7fce3410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.456+0000 7fce3a608700 1 --2- 172.21.15.98:0/906629565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ffc60 0x7fce3410a6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fce28009910 tx=0x7fce28009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:48.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.456+0000 7fce3a608700 1 -- 172.21.15.98:0/906629565 shutdown_connections 2024-09-13T02:58:48.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.456+0000 7fce3a608700 1 --2- 172.21.15.98:0/906629565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ffc60 0x7fce3410a6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.456+0000 7fce3a608700 1 --2- 172.21.15.98:0/906629565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce340ff350 0x7fce340ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.456+0000 7fce3a608700 1 -- 172.21.15.98:0/906629565 >> 172.21.15.98:0/906629565 conn(0x7fce340748b0 msgr2=0x7fce34074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:48.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.456+0000 7fce3a608700 1 -- 172.21.15.98:0/906629565 shutdown_connections 2024-09-13T02:58:48.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.456+0000 7fce3a608700 1 -- 172.21.15.98:0/906629565 wait complete. 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.457+0000 7fce3a608700 1 Processor -- start 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.457+0000 7fce3a608700 1 -- start start 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce3a608700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ff350 0x7fce34195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce3a608700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce340ffc60 0x7fce34196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce3a608700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34196b50 con 0x7fce340ff350 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce3a608700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3419a870 con 0x7fce340ffc60 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce33fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ff350 0x7fce34195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce33fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ff350 0x7fce34195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35070/0 (socket says 172.21.15.98:35070) 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce33fff700 1 -- 172.21.15.98:0/2949728423 learned_addr learned my addr 172.21.15.98:0/2949728423 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce337fe700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce340ffc60 0x7fce34196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce33fff700 1 -- 172.21.15.98:0/2949728423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce340ffc60 msgr2=0x7fce34196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce33fff700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce340ffc60 0x7fce34196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.458+0000 7fce33fff700 1 -- 172.21.15.98:0/2949728423 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280095f0 con 0x7fce340ff350 2024-09-13T02:58:48.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.459+0000 7fce33fff700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ff350 0x7fce34195f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce2400b480 tx=0x7fce2400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:48.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.459+0000 7fce317fa700 1 -- 172.21.15.98:0/2949728423 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce240118c0 con 0x7fce340ff350 2024-09-13T02:58:48.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.459+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3419ab50 con 0x7fce340ff350 2024-09-13T02:58:48.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.459+0000 7fce317fa700 1 -- 172.21.15.98:0/2949728423 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce24010380 con 0x7fce340ff350 2024-09-13T02:58:48.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.459+0000 7fce317fa700 1 -- 172.21.15.98:0/2949728423 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce2400f4f0 con 0x7fce340ff350 2024-09-13T02:58:48.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.459+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3419b0a0 con 0x7fce340ff350 2024-09-13T02:58:48.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.460+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce20005320 con 0x7fce340ff350 2024-09-13T02:58:48.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.461+0000 7fce317fa700 1 -- 172.21.15.98:0/2949728423 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fce240104f0 con 0x7fce340ff350 2024-09-13T02:58:48.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.461+0000 7fce317fa700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fce1c06e680 0x7fce1c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.461+0000 7fce317fa700 1 -- 172.21.15.98:0/2949728423 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fce2408e030 con 0x7fce340ff350 2024-09-13T02:58:48.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.461+0000 7fce337fe700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fce1c06e680 0x7fce1c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.462+0000 7fce337fe700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fce1c06e680 0x7fce1c070b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce280059d0 tx=0x7fce2801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:48.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.465+0000 7fce317fa700 1 -- 172.21.15.98:0/2949728423 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce24057350 con 0x7fce340ff350 2024-09-13T02:58:48.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.722+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fce20006200 con 0x7fce340ff350 2024-09-13T02:58:48.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.723+0000 7fce317fa700 1 -- 172.21.15.98:0/2949728423 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1941 (secure 0 0 0) 0x7fce2405aa10 con 0x7fce340ff350 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:58:48.725 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:58:48.726 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:48.727 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:58:48.728 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:58:48.728 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T02:58:48.728 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:58:48.728 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:48.728 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:48.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fce1c06e680 msgr2=0x7fce1c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fce1c06e680 0x7fce1c070b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce280059d0 tx=0x7fce2801a040 comp rx=0 tx=0).stop 2024-09-13T02:58:48.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ff350 msgr2=0x7fce34195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ff350 0x7fce34195f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce2400b480 tx=0x7fce2400b840 comp rx=0 tx=0).stop 2024-09-13T02:58:48.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 shutdown_connections 2024-09-13T02:58:48.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fce1c06e680 0x7fce1c070b30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce340ff350 0x7fce34195f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 --2- 172.21.15.98:0/2949728423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce340ffc60 0x7fce34196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 >> 172.21.15.98:0/2949728423 conn(0x7fce340748b0 msgr2=0x7fce34104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:48.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 shutdown_connections 2024-09-13T02:58:48.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.725+0000 7fce3a608700 1 -- 172.21.15.98:0/2949728423 wait complete. 2024-09-13T02:58:48.730 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:58:48.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.849+0000 7f1c9ea47700 1 -- 172.21.15.98:0/3831363228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101420 msgr2=0x7f1c981017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.849+0000 7f1c9ea47700 1 --2- 172.21.15.98:0/3831363228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101420 0x7f1c981017f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009910 tx=0x7f1c80009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:48.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.849+0000 7f1c9ea47700 1 -- 172.21.15.98:0/3831363228 shutdown_connections 2024-09-13T02:58:48.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.849+0000 7f1c9ea47700 1 --2- 172.21.15.98:0/3831363228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c98101d30 0x7f1c9810a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.849+0000 7f1c9ea47700 1 --2- 172.21.15.98:0/3831363228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101420 0x7f1c981017f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.849+0000 7f1c9ea47700 1 -- 172.21.15.98:0/3831363228 >> 172.21.15.98:0/3831363228 conn(0x7f1c980fac60 msgr2=0x7f1c980fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:48.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.850+0000 7f1c9ea47700 1 -- 172.21.15.98:0/3831363228 shutdown_connections 2024-09-13T02:58:48.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.850+0000 7f1c9ea47700 1 -- 172.21.15.98:0/3831363228 wait complete. 2024-09-13T02:58:48.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.850+0000 7f1c9ea47700 1 Processor -- start 2024-09-13T02:58:48.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.850+0000 7f1c9ea47700 1 -- start start 2024-09-13T02:58:48.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.850+0000 7f1c9ea47700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c98101420 0x7f1c980ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.850+0000 7f1c9ea47700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101d30 0x7f1c980ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.850+0000 7f1c9ea47700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980ffb00 con 0x7f1c98101d30 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.850+0000 7f1c9ea47700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980ffc40 con 0x7f1c98101420 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c977fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101d30 0x7f1c980ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c977fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101d30 0x7f1c980ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35102/0 (socket says 172.21.15.98:35102) 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c977fe700 1 -- 172.21.15.98:0/2779488033 learned_addr learned my addr 172.21.15.98:0/2779488033 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c97fff700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c98101420 0x7f1c980ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c977fe700 1 -- 172.21.15.98:0/2779488033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c98101420 msgr2=0x7f1c980ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c977fe700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c98101420 0x7f1c980ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c977fe700 1 -- 172.21.15.98:0/2779488033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800095f0 con 0x7f1c98101d30 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c97fff700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c98101420 0x7f1c980ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c977fe700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101d30 0x7f1c980ff5c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800c930 tx=0x7f1c8800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c957fa700 1 -- 172.21.15.98:0/2779488033 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c88007ad0 con 0x7f1c98101d30 2024-09-13T02:58:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c957fa700 1 -- 172.21.15.98:0/2779488033 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c8800ce80 con 0x7f1c98101d30 2024-09-13T02:58:48.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c957fa700 1 -- 172.21.15.98:0/2779488033 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c88018630 con 0x7f1c98101d30 2024-09-13T02:58:48.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.851+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c981a2070 con 0x7f1c98101d30 2024-09-13T02:58:48.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.852+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c981a23d0 con 0x7f1c98101d30 2024-09-13T02:58:48.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.852+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c98107900 con 0x7f1c98101d30 2024-09-13T02:58:48.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.853+0000 7f1c957fa700 1 -- 172.21.15.98:0/2779488033 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1c88007c30 con 0x7f1c98101d30 2024-09-13T02:58:48.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.854+0000 7f1c957fa700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f1c8406e680 0x7f1c84070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.854+0000 7f1c957fa700 1 -- 172.21.15.98:0/2779488033 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1c8808e490 con 0x7f1c98101d30 2024-09-13T02:58:48.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.854+0000 7f1c97fff700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f1c8406e680 0x7f1c84070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.854+0000 7f1c97fff700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f1c8406e680 0x7f1c84070b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c80006010 tx=0x7f1c8001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:48.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:48.862+0000 7f1c957fa700 1 -- 172.21.15.98:0/2779488033 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1c880577b0 con 0x7f1c98101d30 2024-09-13T02:58:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='client.44185 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='osd.1 [v2:172.21.15.98:6810/2689543754,v1:172.21.15.98:6811/2689543754]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:58:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T02:58:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='osd.1 [v2:172.21.15.98:6810/2689543754,v1:172.21.15.98:6811/2689543754]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:58:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/179980819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2949728423' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:49.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.084+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c98061190 con 0x7f1c8406e680 2024-09-13T02:58:49.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.086+0000 7f1c957fa700 1 -- 172.21.15.98:0/2779488033 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1c98061190 con 0x7f1c8406e680 2024-09-13T02:58:49.087 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:58:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "8/23 daemons upgraded", 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:58:49.088 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:58:49.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f1c8406e680 msgr2=0x7f1c84070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f1c8406e680 0x7f1c84070b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c80006010 tx=0x7f1c8001a040 comp rx=0 tx=0).stop 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101d30 msgr2=0x7f1c980ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101d30 0x7f1c980ff5c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800c930 tx=0x7f1c8800cc40 comp rx=0 tx=0).stop 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 shutdown_connections 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f1c8406e680 0x7f1c84070b30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c98101420 0x7f1c980ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 --2- 172.21.15.98:0/2779488033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c98101d30 0x7f1c980ff5c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 >> 172.21.15.98:0/2779488033 conn(0x7f1c980fac60 msgr2=0x7f1c98104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 shutdown_connections 2024-09-13T02:58:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.088+0000 7f1c9ea47700 1 -- 172.21.15.98:0/2779488033 wait complete. 2024-09-13T02:58:49.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.192+0000 7f474b983700 1 -- 172.21.15.98:0/2930265902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4744100e80 msgr2=0x7f4744104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.192+0000 7f474b983700 1 --2- 172.21.15.98:0/2930265902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4744100e80 0x7f4744104e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4738009910 tx=0x7f4738009c20 comp rx=0 tx=0).stop 2024-09-13T02:58:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.192+0000 7f474b983700 1 -- 172.21.15.98:0/2930265902 shutdown_connections 2024-09-13T02:58:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.192+0000 7f474b983700 1 --2- 172.21.15.98:0/2930265902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4744100e80 0x7f4744104e50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.192+0000 7f474b983700 1 --2- 172.21.15.98:0/2930265902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47441004e0 0x7f47441008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.192+0000 7f474b983700 1 -- 172.21.15.98:0/2930265902 >> 172.21.15.98:0/2930265902 conn(0x7f47440fbda0 msgr2=0x7f47440fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.192+0000 7f474b983700 1 -- 172.21.15.98:0/2930265902 shutdown_connections 2024-09-13T02:58:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.192+0000 7f474b983700 1 -- 172.21.15.98:0/2930265902 wait complete. 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474b983700 1 Processor -- start 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474b983700 1 -- start start 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474b983700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47441004e0 0x7f4744195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474b983700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4744100e80 0x7f4744196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474b983700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4744196b30 con 0x7f47441004e0 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474b983700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474419a8c0 con 0x7f4744100e80 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474971f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47441004e0 0x7f4744195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474971f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47441004e0 0x7f4744195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35108/0 (socket says 172.21.15.98:35108) 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474971f700 1 -- 172.21.15.98:0/900558334 learned_addr learned my addr 172.21.15.98:0/900558334 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f4748f1e700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4744100e80 0x7f4744196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474971f700 1 -- 172.21.15.98:0/900558334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4744100e80 msgr2=0x7f4744196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474971f700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4744100e80 0x7f4744196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474971f700 1 -- 172.21.15.98:0/900558334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380095f0 con 0x7f47441004e0 2024-09-13T02:58:49.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.193+0000 7f474971f700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47441004e0 0x7f4744195f10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f473c0060b0 tx=0x7f473c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:49.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.194+0000 7f47427fc700 1 -- 172.21.15.98:0/900558334 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f473c00dda0 con 0x7f47441004e0 2024-09-13T02:58:49.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.194+0000 7f47427fc700 1 -- 172.21.15.98:0/900558334 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f473c00f040 con 0x7f47441004e0 2024-09-13T02:58:49.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.194+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474419aba0 con 0x7f47441004e0 2024-09-13T02:58:49.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.194+0000 7f47427fc700 1 -- 172.21.15.98:0/900558334 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f473c014790 con 0x7f47441004e0 2024-09-13T02:58:49.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.194+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474419b0f0 con 0x7f47441004e0 2024-09-13T02:58:49.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.195+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4744108850 con 0x7f47441004e0 2024-09-13T02:58:49.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.195+0000 7f47427fc700 1 -- 172.21.15.98:0/900558334 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f473c014980 con 0x7f47441004e0 2024-09-13T02:58:49.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.196+0000 7f47427fc700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f472c06e680 0x7f472c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.196+0000 7f47427fc700 1 -- 172.21.15.98:0/900558334 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f473c08e010 con 0x7f47441004e0 2024-09-13T02:58:49.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.196+0000 7f4748f1e700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f472c06e680 0x7f472c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.196+0000 7f4748f1e700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f472c06e680 0x7f472c070b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4744197530 tx=0x7f473801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.202+0000 7f47427fc700 1 -- 172.21.15.98:0/900558334 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f473c057360 con 0x7f47441004e0 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='client.44185 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='osd.1 [v2:172.21.15.98:6810/2689543754,v1:172.21.15.98:6811/2689543754]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='osd.1 [v2:172.21.15.98:6810/2689543754,v1:172.21.15.98:6811/2689543754]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/179980819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2949728423' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:58:49.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:49.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.486+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f474404f2a0 con 0x7f47441004e0 2024-09-13T02:58:49.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.487+0000 7f47427fc700 1 -- 172.21.15.98:0/900558334 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1093 (secure 0 0 0) 0x7f473c05aa20 con 0x7f47441004e0 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 35/267 objects degraded (13.109%), 13 pgs degraded 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 35/267 objects degraded (13.109%), 13 pgs degraded 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-13T02:58:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-13T02:58:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-13T02:58:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-13T02:58:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-13T02:58:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-13T02:58:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-13T02:58:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-13T02:58:49.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f472c06e680 msgr2=0x7f472c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f472c06e680 0x7f472c070b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4744197530 tx=0x7f473801a040 comp rx=0 tx=0).stop 2024-09-13T02:58:49.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47441004e0 msgr2=0x7f4744195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47441004e0 0x7f4744195f10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f473c0060b0 tx=0x7f473c00d3b0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 shutdown_connections 2024-09-13T02:58:49.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f472c06e680 0x7f472c070b30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47441004e0 0x7f4744195f10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 --2- 172.21.15.98:0/900558334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4744100e80 0x7f4744196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 >> 172.21.15.98:0/900558334 conn(0x7f47440fbda0 msgr2=0x7f47440fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.489+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 shutdown_connections 2024-09-13T02:58:49.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:58:49.490+0000 7f474b983700 1 -- 172.21.15.98:0/900558334 wait complete. 2024-09-13T02:58:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:49 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:49 smithi098 ceph-mon[87325]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T02:58:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:49 smithi098 ceph-mon[87325]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:49 smithi098 ceph-mon[87325]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:58:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:49 smithi098 ceph-mon[87325]: osd.1 [v2:172.21.15.98:6810/2689543754,v1:172.21.15.98:6811/2689543754] boot 2024-09-13T02:58:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:49 smithi098 ceph-mon[87325]: osdmap e58: 6 total, 6 up, 6 in 2024-09-13T02:58:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:58:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:49 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/900558334' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:50.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:49 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:49 smithi142 ceph-mon[65447]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T02:58:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:49 smithi142 ceph-mon[65447]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:58:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:49 smithi142 ceph-mon[65447]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:58:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:49 smithi142 ceph-mon[65447]: osd.1 [v2:172.21.15.98:6810/2689543754,v1:172.21.15.98:6811/2689543754] boot 2024-09-13T02:58:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:49 smithi142 ceph-mon[65447]: osdmap e58: 6 total, 6 up, 6 in 2024-09-13T02:58:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:58:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:49 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/900558334' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:51.135 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:50 smithi098 ceph-mon[87325]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:51.135 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:50 smithi098 ceph-mon[87325]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T02:58:51.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:50 smithi142 ceph-mon[65447]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:50 smithi142 ceph-mon[65447]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T02:58:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:51 smithi098 ceph-mon[87325]: pgmap v74: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/267 objects degraded (6.742%) 2024-09-13T02:58:52.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:51 smithi142 ceph-mon[65447]: pgmap v74: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/267 objects degraded (6.742%) 2024-09-13T02:58:53.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:52 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 18/267 objects degraded (6.742%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:53.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:52 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 18/267 objects degraded (6.742%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:53 smithi098 ceph-mon[87325]: pgmap v75: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/267 objects degraded (6.742%) 2024-09-13T02:58:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:53 smithi142 ceph-mon[65447]: pgmap v75: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 18/267 objects degraded (6.742%) 2024-09-13T02:58:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:54 smithi098 ceph-mon[87325]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 7 pgs degraded) 2024-09-13T02:58:55.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:54 smithi142 ceph-mon[65447]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 7 pgs degraded) 2024-09-13T02:58:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:55 smithi098 ceph-mon[87325]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T02:58:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:55 smithi142 ceph-mon[65447]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T02:58:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:57 smithi098 ceph-mon[87325]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T02:58:58.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:57 smithi142 ceph-mon[65447]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T02:59:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:58:59 smithi098 ceph-mon[87325]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-13T02:59:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:58:59 smithi142 ceph-mon[65447]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-13T02:59:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:01 smithi098 ceph-mon[87325]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 936 B/s rd, 1 op/s 2024-09-13T02:59:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:01 smithi142 ceph-mon[65447]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 936 B/s rd, 1 op/s 2024-09-13T02:59:03.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:03 smithi098 ceph-mon[87325]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:59:03.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:59:03.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:03.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:03.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:03 smithi142 ceph-mon[65447]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:59:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:59:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:04.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:04 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:59:04.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:04 smithi098 ceph-mon[87325]: Upgrade: osd.2 is safe to restart 2024-09-13T02:59:04.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:04 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:04.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:04 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:59:04.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:04 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:05.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:04 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:59:05.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:04 smithi142 ceph-mon[65447]: Upgrade: osd.2 is safe to restart 2024-09-13T02:59:05.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:04 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:05.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:04 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:59:05.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:04 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:06.053 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:05 smithi098 ceph-mon[87325]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:59:06.053 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:05 smithi098 ceph-mon[87325]: Upgrade: Updating osd.2 2024-09-13T02:59:06.053 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:05 smithi098 ceph-mon[87325]: Deploying daemon osd.2 on smithi098 2024-09-13T02:59:06.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:05 smithi142 ceph-mon[65447]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:59:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:05 smithi142 ceph-mon[65447]: Upgrade: Updating osd.2 2024-09-13T02:59:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:05 smithi142 ceph-mon[65447]: Deploying daemon osd.2 on smithi098 2024-09-13T02:59:07.874 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:07 smithi098 systemd[1]: Stopping Ceph osd.2 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:59:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:07 smithi098 ceph-mon[87325]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:59:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:07 smithi098 ceph-mon[87325]: osd.2 marked itself down and dead 2024-09-13T02:59:08.234 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:07 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[53712]: 2024-09-13T02:59:07.872+0000 7f3b3d2b5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:59:08.234 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:07 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[53712]: 2024-09-13T02:59:07.872+0000 7f3b3d2b5700 -1 osd.2 59 *** Got signal Terminated *** 2024-09-13T02:59:08.234 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:07 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[53712]: 2024-09-13T02:59:07.872+0000 7f3b3d2b5700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:59:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:07 smithi142 ceph-mon[65447]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:59:08.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:07 smithi142 ceph-mon[65447]: osd.2 marked itself down and dead 2024-09-13T02:59:08.617 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:08 smithi098 podman[109097]: 2024-09-13 02:59:08.343097914 +0000 UTC m=+0.578128911 container died 855dbca569160b0b9321af3a14ce27ceed569b8b7b381cc7a32d90756677c905 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0) 2024-09-13T02:59:08.878 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:08 smithi098 podman[109097]: 2024-09-13 02:59:08.706437783 +0000 UTC m=+0.941468780 container cleanup 855dbca569160b0b9321af3a14ce27ceed569b8b7b381cc7a32d90756677c905 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD) 2024-09-13T02:59:08.878 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:08 smithi098 bash[109097]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2 2024-09-13T02:59:09.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:08 smithi098 ceph-mon[87325]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:59:09.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:08 smithi098 ceph-mon[87325]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T02:59:09.234 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:08 smithi098 podman[109115]: 2024-09-13 02:59:08.983139131 +0000 UTC m=+0.630899393 container remove 855dbca569160b0b9321af3a14ce27ceed569b8b7b381cc7a32d90756677c905 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2, RELEASE=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T02:59:09.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:08 smithi142 ceph-mon[65447]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:59:09.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:08 smithi142 ceph-mon[65447]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T02:59:09.554 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:09 smithi098 podman[109203]: 2024-09-13 02:59:09.284027043 +0000 UTC m=+0.103249627 container create 59854779e9172289d01550fb7f68fc7ff41ad54bfc411997a51981ba3d9e7dc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T02:59:09.554 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:09 smithi098 podman[109203]: 2024-09-13 02:59:09.196706183 +0000 UTC m=+0.015928777 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:59:09.554 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:09 smithi098 podman[109203]: 2024-09-13 02:59:09.494980032 +0000 UTC m=+0.314202625 container init 59854779e9172289d01550fb7f68fc7ff41ad54bfc411997a51981ba3d9e7dc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T02:59:09.554 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:09 smithi098 podman[109203]: 2024-09-13 02:59:09.498886329 +0000 UTC m=+0.318108924 container start 59854779e9172289d01550fb7f68fc7ff41ad54bfc411997a51981ba3d9e7dc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f) 2024-09-13T02:59:09.554 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:09 smithi098 podman[109203]: 2024-09-13 02:59:09.553323445 +0000 UTC m=+0.372546033 container attach 59854779e9172289d01550fb7f68fc7ff41ad54bfc411997a51981ba3d9e7dc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-13T02:59:09.887 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:09 smithi098 podman[109203]: 2024-09-13 02:59:09.693396167 +0000 UTC m=+0.512618752 container died 59854779e9172289d01550fb7f68fc7ff41ad54bfc411997a51981ba3d9e7dc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:59:10.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:09 smithi098 ceph-mon[87325]: pgmap v84: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T02:59:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:09 smithi098 ceph-mon[87325]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T02:59:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:09 smithi142 ceph-mon[65447]: pgmap v84: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T02:59:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:09 smithi142 ceph-mon[65447]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T02:59:10.545 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:10 smithi098 podman[109226]: 2024-09-13 02:59:10.290839809 +0000 UTC m=+0.591722463 container remove 59854779e9172289d01550fb7f68fc7ff41ad54bfc411997a51981ba3d9e7dc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:59:10.545 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:10 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T02:59:10.545 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:10 smithi098 systemd[1]: Stopped Ceph osd.2 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:59:10.545 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:10 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.2.service: Consumed 48.264s CPU time. 2024-09-13T02:59:10.859 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:10 smithi098 systemd[1]: Starting Ceph osd.2 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:59:10.859 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:10 smithi098 podman[109324]: 2024-09-13 02:59:10.656943985 +0000 UTC m=+0.016341745 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:59:10.859 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:10 smithi098 podman[109324]: 2024-09-13 02:59:10.775550833 +0000 UTC m=+0.134948596 container create 85bd7eb8240e661733778508b0217e5ef9ff704905be887826d38550406f0876 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:59:11.129 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:10 smithi098 ceph-mon[87325]: pgmap v86: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 10/267 objects degraded (3.745%) 2024-09-13T02:59:11.129 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:10 smithi098 ceph-mon[87325]: Health check failed: Degraded data redundancy: 10/267 objects degraded (3.745%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:11.129 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 podman[109324]: 2024-09-13 02:59:11.054129432 +0000 UTC m=+0.413527202 container init 85bd7eb8240e661733778508b0217e5ef9ff704905be887826d38550406f0876 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T02:59:11.130 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 podman[109324]: 2024-09-13 02:59:11.058003773 +0000 UTC m=+0.417401540 container start 85bd7eb8240e661733778508b0217e5ef9ff704905be887826d38550406f0876 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, io.buildah.version=1.37.2) 2024-09-13T02:59:11.130 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 podman[109324]: 2024-09-13 02:59:11.128554064 +0000 UTC m=+0.487951835 container attach 85bd7eb8240e661733778508b0217e5ef9ff704905be887826d38550406f0876 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:59:11.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:10 smithi142 ceph-mon[65447]: pgmap v86: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 10/267 objects degraded (3.745%) 2024-09-13T02:59:11.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:10 smithi142 ceph-mon[65447]: Health check failed: Degraded data redundancy: 10/267 objects degraded (3.745%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:11.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate[109339]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:11.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 bash[109324]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:11.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate[109339]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:11.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 bash[109324]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:12.206 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate[109339]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:59:12.206 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 bash[109324]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:59:12.206 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate[109339]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T02:59:12.206 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:11 smithi098 bash[109324]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T02:59:12.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate[109339]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T02:59:12.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 bash[109324]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T02:59:12.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate[109339]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T02:59:12.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 bash[109324]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T02:59:12.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate[109339]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T02:59:12.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 bash[109324]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T02:59:12.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate[109339]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:59:12.485 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 bash[109324]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:59:12.485 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate[109339]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T02:59:12.485 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 bash[109324]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T02:59:12.485 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 podman[109324]: 2024-09-13 02:59:12.234444605 +0000 UTC m=+1.593842374 container died 85bd7eb8240e661733778508b0217e5ef9ff704905be887826d38550406f0876 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:59:13.111 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:12 smithi098 podman[109474]: 2024-09-13 02:59:12.807825841 +0000 UTC m=+0.565732401 container remove 85bd7eb8240e661733778508b0217e5ef9ff704905be887826d38550406f0876 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T02:59:13.112 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:13 smithi098 podman[109533]: 2024-09-13 02:59:13.000514361 +0000 UTC m=+0.100498378 container create 04c10c8159baa6668838e951c7b597d5f5ad582f0b1db07f5d7a5a33fc98bf45 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T02:59:13.112 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:13 smithi098 podman[109533]: 2024-09-13 02:59:12.915700718 +0000 UTC m=+0.015684745 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:59:13.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:13 smithi098 podman[109533]: 2024-09-13 02:59:13.203422928 +0000 UTC m=+0.303406953 container init 04c10c8159baa6668838e951c7b597d5f5ad582f0b1db07f5d7a5a33fc98bf45 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T02:59:13.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:13 smithi098 podman[109533]: 2024-09-13 02:59:13.206669232 +0000 UTC m=+0.306653250 container start 04c10c8159baa6668838e951c7b597d5f5ad582f0b1db07f5d7a5a33fc98bf45 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T02:59:13.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:13 smithi098 ceph-osd[109552]: -- 172.21.15.98:0/1164611130 <== mon.0 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55951efdc1e0 con 0x55951e1dbc00 2024-09-13T02:59:13.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:13 smithi098 bash[109533]: 04c10c8159baa6668838e951c7b597d5f5ad582f0b1db07f5d7a5a33fc98bf45 2024-09-13T02:59:13.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:13 smithi098 systemd[1]: Started Ceph osd.2 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:59:14.029 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:13 smithi098 ceph-mon[87325]: pgmap v87: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 10/267 objects degraded (3.745%) 2024-09-13T02:59:14.029 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:14.029 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:14.029 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:14.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:13 smithi142 ceph-mon[65447]: pgmap v87: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 10/267 objects degraded (3.745%) 2024-09-13T02:59:14.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:14.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:14.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:14.929 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:14 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[109548]: 2024-09-13T02:59:14.841+0000 7f54c70dd640 -1 Falling back to public interface 2024-09-13T02:59:15.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:15 smithi098 ceph-mon[87325]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:59:16.054 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:15 smithi142 ceph-mon[65447]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:59:17.869 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:17 smithi098 ceph-mon[87325]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:59:17.869 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:17 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:17 smithi142 ceph-mon[65447]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:59:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:17 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:19.599 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.599 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.599 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:19 smithi098 ceph-mon[87325]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:59:19.599 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.600 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:19.600 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.600 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.598+0000 7fc798a36700 1 -- 172.21.15.98:0/2036760936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 msgr2=0x7fc7941008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.598+0000 7fc798a36700 1 --2- 172.21.15.98:0/2036760936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 0x7fc7941008b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc784009910 tx=0x7fc784009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.598+0000 7fc798a36700 1 -- 172.21.15.98:0/2036760936 shutdown_connections 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.598+0000 7fc798a36700 1 --2- 172.21.15.98:0/2036760936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc794100e80 0x7fc794104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.598+0000 7fc798a36700 1 --2- 172.21.15.98:0/2036760936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 0x7fc7941008b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.598+0000 7fc798a36700 1 -- 172.21.15.98:0/2036760936 >> 172.21.15.98:0/2036760936 conn(0x7fc7940fbda0 msgr2=0x7fc7940fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.598+0000 7fc798a36700 1 -- 172.21.15.98:0/2036760936 shutdown_connections 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.598+0000 7fc798a36700 1 -- 172.21.15.98:0/2036760936 wait complete. 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.599+0000 7fc798a36700 1 Processor -- start 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.599+0000 7fc798a36700 1 -- start start 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.599+0000 7fc798a36700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 0x7fc794073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.599+0000 7fc798a36700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc794100e80 0x7fc794073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:19.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.599+0000 7fc798a36700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc794073ad0 con 0x7fc7941004e0 2024-09-13T02:59:19.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.599+0000 7fc798a36700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc794073c10 con 0x7fc794100e80 2024-09-13T02:59:19.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.599+0000 7fc79259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 0x7fc794073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:19.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.599+0000 7fc79259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 0x7fc794073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59180/0 (socket says 172.21.15.98:59180) 2024-09-13T02:59:19.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.599+0000 7fc79259c700 1 -- 172.21.15.98:0/163658709 learned_addr learned my addr 172.21.15.98:0/163658709 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:19.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc791d9b700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc794100e80 0x7fc794073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:19.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc79259c700 1 -- 172.21.15.98:0/163658709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc794100e80 msgr2=0x7fc794073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:19.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc79259c700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc794100e80 0x7fc794073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:19.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc79259c700 1 -- 172.21.15.98:0/163658709 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840095f0 con 0x7fc7941004e0 2024-09-13T02:59:19.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc791d9b700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc794100e80 0x7fc794073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:59:19.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc79259c700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 0x7fc794073050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc784005b40 tx=0x7fc78400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:19.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc7837fe700 1 -- 172.21.15.98:0/163658709 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78401d070 con 0x7fc7941004e0 2024-09-13T02:59:19.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc794073e90 con 0x7fc7941004e0 2024-09-13T02:59:19.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc794195ff0 con 0x7fc7941004e0 2024-09-13T02:59:19.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc7837fe700 1 -- 172.21.15.98:0/163658709 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7840048e0 con 0x7fc7941004e0 2024-09-13T02:59:19.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.600+0000 7fc7837fe700 1 -- 172.21.15.98:0/163658709 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc784003bc0 con 0x7fc7941004e0 2024-09-13T02:59:19.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.602+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc774005320 con 0x7fc7941004e0 2024-09-13T02:59:19.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.602+0000 7fc7837fe700 1 -- 172.21.15.98:0/163658709 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc7840041f0 con 0x7fc7941004e0 2024-09-13T02:59:19.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.603+0000 7fc7837fe700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc77c06e680 0x7fc77c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:19.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.603+0000 7fc7837fe700 1 -- 172.21.15.98:0/163658709 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc78408fa50 con 0x7fc7941004e0 2024-09-13T02:59:19.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.603+0000 7fc791d9b700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc77c06e680 0x7fc77c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:19.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.604+0000 7fc791d9b700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc77c06e680 0x7fc77c070b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc788006fd0 tx=0x7fc788008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:19.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.608+0000 7fc7837fe700 1 -- 172.21.15.98:0/163658709 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc784058d70 con 0x7fc7941004e0 2024-09-13T02:59:19.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:19 smithi142 ceph-mon[65447]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:59:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:19.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.844+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc774000bf0 con 0x7fc77c06e680 2024-09-13T02:59:19.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.846+0000 7fc7837fe700 1 -- 172.21.15.98:0/163658709 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc774000bf0 con 0x7fc77c06e680 2024-09-13T02:59:19.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc77c06e680 msgr2=0x7fc77c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc77c06e680 0x7fc77c070b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc788006fd0 tx=0x7fc788008040 comp rx=0 tx=0).stop 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 msgr2=0x7fc794073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 0x7fc794073050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc784005b40 tx=0x7fc78400be20 comp rx=0 tx=0).stop 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 shutdown_connections 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc77c06e680 0x7fc77c070b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941004e0 0x7fc794073050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 --2- 172.21.15.98:0/163658709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc794100e80 0x7fc794073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 >> 172.21.15.98:0/163658709 conn(0x7fc7940fbda0 msgr2=0x7fc7940fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 shutdown_connections 2024-09-13T02:59:19.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.848+0000 7fc798a36700 1 -- 172.21.15.98:0/163658709 wait complete. 2024-09-13T02:59:19.860 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:59:19.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.958+0000 7f84a869e700 1 -- 172.21.15.98:0/1631841662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 msgr2=0x7f84a010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:19.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.958+0000 7f84a869e700 1 --2- 172.21.15.98:0/1631841662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 0x7f84a010a230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8490009910 tx=0x7f8490009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:19.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.958+0000 7f84a869e700 1 -- 172.21.15.98:0/1631841662 shutdown_connections 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.958+0000 7f84a869e700 1 --2- 172.21.15.98:0/1631841662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 0x7f84a010a230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.958+0000 7f84a869e700 1 --2- 172.21.15.98:0/1631841662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84a0101420 0x7f84a01017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.958+0000 7f84a869e700 1 -- 172.21.15.98:0/1631841662 >> 172.21.15.98:0/1631841662 conn(0x7f84a00fac60 msgr2=0x7f84a00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.958+0000 7f84a869e700 1 -- 172.21.15.98:0/1631841662 shutdown_connections 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.958+0000 7f84a869e700 1 -- 172.21.15.98:0/1631841662 wait complete. 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.959+0000 7f84a869e700 1 Processor -- start 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.959+0000 7f84a869e700 1 -- start start 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.959+0000 7f84a869e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84a0101420 0x7f84a0195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.959+0000 7f84a869e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 0x7f84a01963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.959+0000 7f84a869e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a0196a90 con 0x7f84a0101d30 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.959+0000 7f84a869e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a019a610 con 0x7f84a0101420 2024-09-13T02:59:19.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84a5c39700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 0x7f84a01963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:19.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84a5c39700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 0x7f84a01963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59206/0 (socket says 172.21.15.98:59206) 2024-09-13T02:59:19.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84a5c39700 1 -- 172.21.15.98:0/2504640766 learned_addr learned my addr 172.21.15.98:0/2504640766 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:19.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84a643a700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84a0101420 0x7f84a0195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:19.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84a5c39700 1 -- 172.21.15.98:0/2504640766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84a0101420 msgr2=0x7f84a0195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:19.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84a5c39700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84a0101420 0x7f84a0195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:19.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84a5c39700 1 -- 172.21.15.98:0/2504640766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900095f0 con 0x7f84a0101d30 2024-09-13T02:59:19.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84a5c39700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 0x7f84a01963b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84900048f0 tx=0x7f8490004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:19.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84977fe700 1 -- 172.21.15.98:0/2504640766 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f849001d070 con 0x7f84a0101d30 2024-09-13T02:59:19.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a019a890 con 0x7f84a0101d30 2024-09-13T02:59:19.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84977fe700 1 -- 172.21.15.98:0/2504640766 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f849000beb0 con 0x7f84a0101d30 2024-09-13T02:59:19.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.960+0000 7f84977fe700 1 -- 172.21.15.98:0/2504640766 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f849000f690 con 0x7f84a0101d30 2024-09-13T02:59:19.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.961+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a019ad80 con 0x7f84a0101d30 2024-09-13T02:59:19.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.962+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a01078c0 con 0x7f84a0101d30 2024-09-13T02:59:19.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.963+0000 7f84977fe700 1 -- 172.21.15.98:0/2504640766 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8490004e00 con 0x7f84a0101d30 2024-09-13T02:59:19.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.964+0000 7f84977fe700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f848c06e680 0x7f848c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:19.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.964+0000 7f84977fe700 1 -- 172.21.15.98:0/2504640766 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f8490090570 con 0x7f84a0101d30 2024-09-13T02:59:19.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.964+0000 7f84a643a700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f848c06e680 0x7f848c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:19.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.965+0000 7f84a643a700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f848c06e680 0x7f848c070b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f849c005950 tx=0x7f849c00b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:19.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:19.968+0000 7f84977fe700 1 -- 172.21.15.98:0/2504640766 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8490059890 con 0x7f84a0101d30 2024-09-13T02:59:20.233 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:20 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[109548]: 2024-09-13T02:59:20.087+0000 7f54c70dd640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-13T02:59:20.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.252+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84a019b060 con 0x7f848c06e680 2024-09-13T02:59:20.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.254+0000 7f84977fe700 1 -- 172.21.15.98:0/2504640766 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f84a019b060 con 0x7f848c06e680 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f848c06e680 msgr2=0x7f848c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f848c06e680 0x7f848c070b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f849c005950 tx=0x7f849c00b410 comp rx=0 tx=0).stop 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 msgr2=0x7f84a01963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 0x7f84a01963b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84900048f0 tx=0x7f8490004920 comp rx=0 tx=0).stop 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 shutdown_connections 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f848c06e680 0x7f848c070b30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84a0101420 0x7f84a0195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 --2- 172.21.15.98:0/2504640766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84a0101d30 0x7f84a01963b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 >> 172.21.15.98:0/2504640766 conn(0x7f84a00fac60 msgr2=0x7f84a0104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:20.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 shutdown_connections 2024-09-13T02:59:20.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.257+0000 7f84a869e700 1 -- 172.21.15.98:0/2504640766 wait complete. 2024-09-13T02:59:20.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.367+0000 7fc6f7428700 1 -- 172.21.15.98:0/3521656811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ff3c0 msgr2=0x7fc6f00ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:20.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.367+0000 7fc6f7428700 1 --2- 172.21.15.98:0/3521656811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ff3c0 0x7fc6f00ff790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009910 tx=0x7fc6ec009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:20.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.367+0000 7fc6f7428700 1 -- 172.21.15.98:0/3521656811 shutdown_connections 2024-09-13T02:59:20.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.367+0000 7fc6f7428700 1 --2- 172.21.15.98:0/3521656811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6f00ffd60 0x7fc6f0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.367+0000 7fc6f7428700 1 --2- 172.21.15.98:0/3521656811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ff3c0 0x7fc6f00ff790 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.367+0000 7fc6f7428700 1 -- 172.21.15.98:0/3521656811 >> 172.21.15.98:0/3521656811 conn(0x7fc6f00fac60 msgr2=0x7fc6f00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:20.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.367+0000 7fc6f7428700 1 -- 172.21.15.98:0/3521656811 shutdown_connections 2024-09-13T02:59:20.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.367+0000 7fc6f7428700 1 -- 172.21.15.98:0/3521656811 wait complete. 2024-09-13T02:59:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f7428700 1 Processor -- start 2024-09-13T02:59:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f7428700 1 -- start start 2024-09-13T02:59:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f7428700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6f00ff3c0 0x7fc6f0195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f7428700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ffd60 0x7fc6f01963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f7428700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0196a80 con 0x7fc6f00ffd60 2024-09-13T02:59:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f7428700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f019a810 con 0x7fc6f00ff3c0 2024-09-13T02:59:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f49c3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ffd60 0x7fc6f01963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f49c3700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ffd60 0x7fc6f01963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59234/0 (socket says 172.21.15.98:59234) 2024-09-13T02:59:20.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f49c3700 1 -- 172.21.15.98:0/3829637210 learned_addr learned my addr 172.21.15.98:0/3829637210 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f51c4700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6f00ff3c0 0x7fc6f0195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f49c3700 1 -- 172.21.15.98:0/3829637210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6f00ff3c0 msgr2=0x7fc6f0195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f49c3700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6f00ff3c0 0x7fc6f0195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f49c3700 1 -- 172.21.15.98:0/3829637210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec0095f0 con 0x7fc6f00ffd60 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.368+0000 7fc6f51c4700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6f00ff3c0 0x7fc6f0195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.369+0000 7fc6f49c3700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ffd60 0x7fc6f01963a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d900 tx=0x7fc6e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.369+0000 7fc6e67fc700 1 -- 172.21.15.98:0/3829637210 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e0009900 con 0x7fc6f00ffd60 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.369+0000 7fc6e67fc700 1 -- 172.21.15.98:0/3829637210 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6e0010460 con 0x7fc6f00ffd60 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.369+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f019aaf0 con 0x7fc6f00ffd60 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.369+0000 7fc6e67fc700 1 -- 172.21.15.98:0/3829637210 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e000f5f0 con 0x7fc6f00ffd60 2024-09-13T02:59:20.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.369+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f019b040 con 0x7fc6f00ffd60 2024-09-13T02:59:20.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.370+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f01086e0 con 0x7fc6f00ffd60 2024-09-13T02:59:20.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.371+0000 7fc6e67fc700 1 -- 172.21.15.98:0/3829637210 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc6e00105d0 con 0x7fc6f00ffd60 2024-09-13T02:59:20.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.371+0000 7fc6e67fc700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc6dc06e680 0x7fc6dc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:20.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.371+0000 7fc6e67fc700 1 -- 172.21.15.98:0/3829637210 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc6e008e400 con 0x7fc6f00ffd60 2024-09-13T02:59:20.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.371+0000 7fc6f51c4700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc6dc06e680 0x7fc6dc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:20.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.372+0000 7fc6f51c4700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc6dc06e680 0x7fc6dc070b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00b5c0 tx=0x7fc6ec0053a0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:20.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.376+0000 7fc6e67fc700 1 -- 172.21.15.98:0/3829637210 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc6e00576a0 con 0x7fc6f00ffd60 2024-09-13T02:59:20.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.593+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6f019b260 con 0x7fc6dc06e680 2024-09-13T02:59:20.595 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:20 smithi098 ceph-mon[87325]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:20.595 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:20 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[109548]: 2024-09-13T02:59:20.341+0000 7f54c70dd640 -1 osd.2 59 log_to_monitors true 2024-09-13T02:59:20.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.602+0000 7fc6e67fc700 1 -- 172.21.15.98:0/3829637210 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc6f019b260 con 0x7fc6dc06e680 2024-09-13T02:59:20.604 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:59:20.604 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (4m) 2s ago 14m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (15m) 2s ago 15m 8694k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (14m) 92s ago 14m 7755k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (100s) 2s ago 14m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (95s) 92s ago 14m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (3m) 2s ago 14m 80.3M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (9m) 2s ago 9m 93.9M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (9m) 2s ago 9m 152M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (9m) 92s ago 9m 15.8M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (9m) 92s ago 9m 19.2M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (6m) 2s ago 16m 500M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (5m) 92s ago 13m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (2m) 2s ago 16m 49.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T02:59:20.605 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (2m) 92s ago 13m 35.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T02:59:20.606 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (4m) 2s ago 14m 16.2M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:59:20.606 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (4m) 92s ago 13m 15.0M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:59:20.606 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (75s) 2s ago 13m 92.8M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T02:59:20.606 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (41s) 2s ago 12m 85.1M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T02:59:20.606 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (7s) 2s ago 12m 14.4M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 04c10c8159ba 2024-09-13T02:59:20.606 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (11m) 92s ago 11m 240M 2240M 18.2.0 dc2bc1663786 4c69bc135394 2024-09-13T02:59:20.606 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (11m) 92s ago 11m 214M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:59:20.606 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (10m) 92s ago 10m 197M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:59:20.606 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (4m) 2s ago 14m 78.7M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:59:20.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.604+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc6dc06e680 msgr2=0x7fc6dc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:20.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.604+0000 7fc6f7428700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc6dc06e680 0x7fc6dc070b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00b5c0 tx=0x7fc6ec0053a0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.604+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ffd60 msgr2=0x7fc6f01963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:20.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.604+0000 7fc6f7428700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ffd60 0x7fc6f01963a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d900 tx=0x7fc6e000dcc0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.605+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 shutdown_connections 2024-09-13T02:59:20.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.605+0000 7fc6f7428700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc6dc06e680 0x7fc6dc070b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.605+0000 7fc6f7428700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6f00ff3c0 0x7fc6f0195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.605+0000 7fc6f7428700 1 --2- 172.21.15.98:0/3829637210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6f00ffd60 0x7fc6f01963a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.605+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 >> 172.21.15.98:0/3829637210 conn(0x7fc6f00fac60 msgr2=0x7fc6f0069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:20.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.605+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 shutdown_connections 2024-09-13T02:59:20.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.605+0000 7fc6f7428700 1 -- 172.21.15.98:0/3829637210 wait complete. 2024-09-13T02:59:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 -- 172.21.15.98:0/3398578390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 msgr2=0x7f5f60103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 --2- 172.21.15.98:0/3398578390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 0x7f5f60103d30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009910 tx=0x7f5f54009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 -- 172.21.15.98:0/3398578390 shutdown_connections 2024-09-13T02:59:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 --2- 172.21.15.98:0/3398578390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 0x7f5f60103d30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 --2- 172.21.15.98:0/3398578390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f600ff3c0 0x7f5f600ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 -- 172.21.15.98:0/3398578390 >> 172.21.15.98:0/3398578390 conn(0x7f5f600fac80 msgr2=0x7f5f600fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 -- 172.21.15.98:0/3398578390 shutdown_connections 2024-09-13T02:59:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 -- 172.21.15.98:0/3398578390 wait complete. 2024-09-13T02:59:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 Processor -- start 2024-09-13T02:59:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.711+0000 7f5f64f5e700 1 -- start start 2024-09-13T02:59:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f64f5e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f600ff3c0 0x7f5f60194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f64f5e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 0x7f5f60195410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f64f5e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60195af0 con 0x7f5f600ffd60 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f64f5e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60199880 con 0x7f5f600ff3c0 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f5dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 0x7f5f60195410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f5dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 0x7f5f60195410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59264/0 (socket says 172.21.15.98:59264) 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f5dd9b700 1 -- 172.21.15.98:0/100818913 learned_addr learned my addr 172.21.15.98:0/100818913 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f5e59c700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f600ff3c0 0x7f5f60194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f5dd9b700 1 -- 172.21.15.98:0/100818913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f600ff3c0 msgr2=0x7f5f60194ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f5dd9b700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f600ff3c0 0x7f5f60194ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f5dd9b700 1 -- 172.21.15.98:0/100818913 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540095f0 con 0x7f5f600ffd60 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f5dd9b700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 0x7f5f60195410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400bda0 tx=0x7f5f5400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f4f7fe700 1 -- 172.21.15.98:0/100818913 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f5401d070 con 0x7f5f600ffd60 2024-09-13T02:59:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f4f7fe700 1 -- 172.21.15.98:0/100818913 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f54004fb0 con 0x7f5f600ffd60 2024-09-13T02:59:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f60199b00 con 0x7f5f600ffd60 2024-09-13T02:59:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f4f7fe700 1 -- 172.21.15.98:0/100818913 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f5400f460 con 0x7f5f600ffd60 2024-09-13T02:59:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.712+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f60199ff0 con 0x7f5f600ffd60 2024-09-13T02:59:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.713+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f60107680 con 0x7f5f600ffd60 2024-09-13T02:59:20.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.714+0000 7f5f4f7fe700 1 -- 172.21.15.98:0/100818913 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5f54022800 con 0x7f5f600ffd60 2024-09-13T02:59:20.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.714+0000 7f5f4f7fe700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5f4806e680 0x7f5f48070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:20.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.715+0000 7f5f5e59c700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5f4806e680 0x7f5f48070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:20.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.715+0000 7f5f4f7fe700 1 -- 172.21.15.98:0/100818913 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5f5408fb10 con 0x7f5f600ffd60 2024-09-13T02:59:20.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.715+0000 7f5f5e59c700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5f4806e680 0x7f5f48070b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f50006fd0 tx=0x7f5f50008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:20.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:20.719+0000 7f5f4f7fe700 1 -- 172.21.15.98:0/100818913 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5f54058e60 con 0x7f5f600ffd60 2024-09-13T02:59:20.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:20 smithi142 ceph-mon[65447]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:21.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.017+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5f6004f2a0 con 0x7f5f600ffd60 2024-09-13T02:59:21.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.018+0000 7f5f4f7fe700 1 -- 172.21.15.98:0/100818913 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f5f54027330 con 0x7f5f600ffd60 2024-09-13T02:59:21.020 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:59:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:59:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:59:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T02:59:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:59:21.022 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:59:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.020+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5f4806e680 msgr2=0x7f5f48070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.020+0000 7f5f64f5e700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5f4806e680 0x7f5f48070b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f50006fd0 tx=0x7f5f50008040 comp rx=0 tx=0).stop 2024-09-13T02:59:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.020+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 msgr2=0x7f5f60195410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.020+0000 7f5f64f5e700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 0x7f5f60195410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400bda0 tx=0x7f5f5400be80 comp rx=0 tx=0).stop 2024-09-13T02:59:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.020+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 shutdown_connections 2024-09-13T02:59:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.020+0000 7f5f64f5e700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5f4806e680 0x7f5f48070b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.020+0000 7f5f64f5e700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f600ff3c0 0x7f5f60194ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.020+0000 7f5f64f5e700 1 --2- 172.21.15.98:0/100818913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f600ffd60 0x7f5f60195410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.021+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 >> 172.21.15.98:0/100818913 conn(0x7f5f600fac80 msgr2=0x7f5f600fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.021+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 shutdown_connections 2024-09-13T02:59:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.021+0000 7f5f64f5e700 1 -- 172.21.15.98:0/100818913 wait complete. 2024-09-13T02:59:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.129+0000 7f618451e700 1 -- 172.21.15.98:0/1421050141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ff3c0 msgr2=0x7f617c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.129+0000 7f618451e700 1 --2- 172.21.15.98:0/1421050141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ff3c0 0x7f617c0ff790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6170009910 tx=0x7f6170009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.129+0000 7f618451e700 1 -- 172.21.15.98:0/1421050141 shutdown_connections 2024-09-13T02:59:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.129+0000 7f618451e700 1 --2- 172.21.15.98:0/1421050141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617c0ffd60 0x7f617c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.129+0000 7f618451e700 1 --2- 172.21.15.98:0/1421050141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ff3c0 0x7f617c0ff790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.129+0000 7f618451e700 1 -- 172.21.15.98:0/1421050141 >> 172.21.15.98:0/1421050141 conn(0x7f617c0fac60 msgr2=0x7f617c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.129+0000 7f618451e700 1 -- 172.21.15.98:0/1421050141 shutdown_connections 2024-09-13T02:59:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.129+0000 7f618451e700 1 -- 172.21.15.98:0/1421050141 wait complete. 2024-09-13T02:59:21.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f618451e700 1 Processor -- start 2024-09-13T02:59:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f618451e700 1 -- start start 2024-09-13T02:59:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f618451e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617c0ff3c0 0x7f617c195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f618451e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ffd60 0x7f617c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f618451e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c196a80 con 0x7f617c0ffd60 2024-09-13T02:59:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f618451e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c19a810 con 0x7f617c0ff3c0 2024-09-13T02:59:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f6181ab9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ffd60 0x7f617c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f6181ab9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ffd60 0x7f617c1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59290/0 (socket says 172.21.15.98:59290) 2024-09-13T02:59:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f6181ab9700 1 -- 172.21.15.98:0/1673338741 learned_addr learned my addr 172.21.15.98:0/1673338741 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:21.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f61822ba700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617c0ff3c0 0x7f617c195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f6181ab9700 1 -- 172.21.15.98:0/1673338741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617c0ff3c0 msgr2=0x7f617c195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f6181ab9700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617c0ff3c0 0x7f617c195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.130+0000 7f6181ab9700 1 -- 172.21.15.98:0/1673338741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700095f0 con 0x7f617c0ffd60 2024-09-13T02:59:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.131+0000 7f6181ab9700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ffd60 0x7f617c1963a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f617800d900 tx=0x7f617800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.131+0000 7f616f7fe700 1 -- 172.21.15.98:0/1673338741 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6178009900 con 0x7f617c0ffd60 2024-09-13T02:59:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.131+0000 7f616f7fe700 1 -- 172.21.15.98:0/1673338741 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6178010460 con 0x7f617c0ffd60 2024-09-13T02:59:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.131+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c19aaf0 con 0x7f617c0ffd60 2024-09-13T02:59:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.131+0000 7f616f7fe700 1 -- 172.21.15.98:0/1673338741 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f617800f5f0 con 0x7f617c0ffd60 2024-09-13T02:59:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.131+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c19b040 con 0x7f617c0ffd60 2024-09-13T02:59:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.132+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c1086e0 con 0x7f617c0ffd60 2024-09-13T02:59:21.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.133+0000 7f616f7fe700 1 -- 172.21.15.98:0/1673338741 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f61780105d0 con 0x7f617c0ffd60 2024-09-13T02:59:21.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.133+0000 7f616f7fe700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f616806e680 0x7f6168070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.133+0000 7f616f7fe700 1 -- 172.21.15.98:0/1673338741 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f617808e400 con 0x7f617c0ffd60 2024-09-13T02:59:21.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.133+0000 7f61822ba700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f616806e680 0x7f6168070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.134+0000 7f61822ba700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f616806e680 0x7f6168070b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f617000b5c0 tx=0x7f617001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:21.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.138+0000 7f616f7fe700 1 -- 172.21.15.98:0/1673338741 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f61780576a0 con 0x7f617c0ffd60 2024-09-13T02:59:21.406 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 02:59:21 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[109548]: 2024-09-13T02:59:21.330+0000 7f54bee77640 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:59:21.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:21 smithi098 ceph-mon[87325]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:21.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:21 smithi098 ceph-mon[87325]: from='osd.2 [v2:172.21.15.98:6818/3300891147,v1:172.21.15.98:6819/3300891147]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:59:21.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:21 smithi098 ceph-mon[87325]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:21.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:21 smithi098 ceph-mon[87325]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 346 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:59:21.406 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:21 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/100818913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:21.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.404+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f617c04f2a0 con 0x7f617c0ffd60 2024-09-13T02:59:21.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.404+0000 7f616f7fe700 1 -- 172.21.15.98:0/1673338741 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1941 (secure 0 0 0) 0x7f617805ad60 con 0x7f617c0ffd60 2024-09-13T02:59:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T02:59:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:59:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:59:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:59:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T02:59:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:59:21.407 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T02:59:21.408 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T02:59:21.409 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:21.410 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:21.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f616806e680 msgr2=0x7f6168070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f616806e680 0x7f6168070b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f617000b5c0 tx=0x7f617001a040 comp rx=0 tx=0).stop 2024-09-13T02:59:21.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ffd60 msgr2=0x7f617c1963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ffd60 0x7f617c1963a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f617800d900 tx=0x7f617800dcc0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 shutdown_connections 2024-09-13T02:59:21.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f616806e680 0x7f6168070b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617c0ff3c0 0x7f617c195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 --2- 172.21.15.98:0/1673338741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f617c0ffd60 0x7f617c1963a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 >> 172.21.15.98:0/1673338741 conn(0x7f617c0fac60 msgr2=0x7f617c069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:21.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 shutdown_connections 2024-09-13T02:59:21.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.408+0000 7f618451e700 1 -- 172.21.15.98:0/1673338741 wait complete. 2024-09-13T02:59:21.412 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:59:21.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:21 smithi142 ceph-mon[65447]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:21.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:21 smithi142 ceph-mon[65447]: from='osd.2 [v2:172.21.15.98:6818/3300891147,v1:172.21.15.98:6819/3300891147]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:59:21.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:21 smithi142 ceph-mon[65447]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:21.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:21 smithi142 ceph-mon[65447]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 346 B/s rd, 1 op/s; 35/267 objects degraded (13.109%) 2024-09-13T02:59:21.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:21 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/100818913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:21.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.533+0000 7f932e19e700 1 -- 172.21.15.98:0/541792087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 msgr2=0x7f9328104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.533+0000 7f932e19e700 1 --2- 172.21.15.98:0/541792087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 0x7f9328104500 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9318009910 tx=0x7f9318009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:21.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.533+0000 7f932e19e700 1 -- 172.21.15.98:0/541792087 shutdown_connections 2024-09-13T02:59:21.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.533+0000 7f932e19e700 1 --2- 172.21.15.98:0/541792087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93280ffbd0 0x7f9328100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.533+0000 7f932e19e700 1 --2- 172.21.15.98:0/541792087 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 0x7f9328104500 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.533+0000 7f932e19e700 1 -- 172.21.15.98:0/541792087 >> 172.21.15.98:0/541792087 conn(0x7f9328075130 msgr2=0x7f9328075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:21.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.533+0000 7f932e19e700 1 -- 172.21.15.98:0/541792087 shutdown_connections 2024-09-13T02:59:21.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.533+0000 7f932e19e700 1 -- 172.21.15.98:0/541792087 wait complete. 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.534+0000 7f932e19e700 1 Processor -- start 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.534+0000 7f932e19e700 1 -- start start 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.534+0000 7f932e19e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93280ffbd0 0x7f9328195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f932e19e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 0x7f9328196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f932e19e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9328196a70 con 0x7f9328104130 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f932e19e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932819a800 con 0x7f93280ffbd0 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9326ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 0x7f9328196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9326ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 0x7f9328196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59300/0 (socket says 172.21.15.98:59300) 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9326ffd700 1 -- 172.21.15.98:0/2957577123 learned_addr learned my addr 172.21.15.98:0/2957577123 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f93277fe700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93280ffbd0 0x7f9328195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9326ffd700 1 -- 172.21.15.98:0/2957577123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93280ffbd0 msgr2=0x7f9328195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9326ffd700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93280ffbd0 0x7f9328195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9326ffd700 1 -- 172.21.15.98:0/2957577123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93180095f0 con 0x7f9328104130 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9326ffd700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 0x7f9328196390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c8a0 tx=0x7f931c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9324ff9700 1 -- 172.21.15.98:0/2957577123 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f931c0078e0 con 0x7f9328104130 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932819aae0 con 0x7f9328104130 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9324ff9700 1 -- 172.21.15.98:0/2957577123 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f931c00f450 con 0x7f9328104130 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.535+0000 7f9324ff9700 1 -- 172.21.15.98:0/2957577123 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f931c00e5e0 con 0x7f9328104130 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.536+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932819b030 con 0x7f9328104130 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.537+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93281086a0 con 0x7f9328104130 2024-09-13T02:59:21.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.537+0000 7f9324ff9700 1 -- 172.21.15.98:0/2957577123 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f931c00f5c0 con 0x7f9328104130 2024-09-13T02:59:21.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.538+0000 7f9324ff9700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f931006e680 0x7f9310070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.538+0000 7f9324ff9700 1 -- 172.21.15.98:0/2957577123 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f931c08e3f0 con 0x7f9328104130 2024-09-13T02:59:21.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.538+0000 7f93277fe700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f931006e680 0x7f9310070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.538+0000 7f93277fe700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f931006e680 0x7f9310070b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9318006010 tx=0x7f931801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:21.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.542+0000 7f9324ff9700 1 -- 172.21.15.98:0/2957577123 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f931c057710 con 0x7f9328104130 2024-09-13T02:59:21.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.777+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f932819b370 con 0x7f931006e680 2024-09-13T02:59:21.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.779+0000 7f9324ff9700 1 -- 172.21.15.98:0/2957577123 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f932819b370 con 0x7f931006e680 2024-09-13T02:59:21.780 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "9/23 daemons upgraded", 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:59:21.781 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:59:21.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f931006e680 msgr2=0x7f9310070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f931006e680 0x7f9310070b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9318006010 tx=0x7f931801a040 comp rx=0 tx=0).stop 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 msgr2=0x7f9328196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 0x7f9328196390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c8a0 tx=0x7f931c00cbb0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 shutdown_connections 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f931006e680 0x7f9310070b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93280ffbd0 0x7f9328195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 --2- 172.21.15.98:0/2957577123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328104130 0x7f9328196390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 >> 172.21.15.98:0/2957577123 conn(0x7f9328075130 msgr2=0x7f93280fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 shutdown_connections 2024-09-13T02:59:21.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.781+0000 7f932e19e700 1 -- 172.21.15.98:0/2957577123 wait complete. 2024-09-13T02:59:21.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.891+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1611114788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 msgr2=0x7fcf14103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.891+0000 7fcf1c46d700 1 --2- 172.21.15.98:0/1611114788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 0x7fcf14103d30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009910 tx=0x7fcf04009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:21.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.891+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1611114788 shutdown_connections 2024-09-13T02:59:21.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.891+0000 7fcf1c46d700 1 --2- 172.21.15.98:0/1611114788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 0x7fcf14103d30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.891+0000 7fcf1c46d700 1 --2- 172.21.15.98:0/1611114788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf140ff3c0 0x7fcf140ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.891+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1611114788 >> 172.21.15.98:0/1611114788 conn(0x7fcf140fac60 msgr2=0x7fcf140fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:21.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.891+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1611114788 shutdown_connections 2024-09-13T02:59:21.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.891+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1611114788 wait complete. 2024-09-13T02:59:21.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf1c46d700 1 Processor -- start 2024-09-13T02:59:21.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf1c46d700 1 -- start start 2024-09-13T02:59:21.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf1c46d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf140ff3c0 0x7fcf14194db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf1c46d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 0x7fcf141952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf1c46d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf141959d0 con 0x7fcf140ffd60 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf1c46d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf14199760 con 0x7fcf140ff3c0 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf19a08700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 0x7fcf141952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf19a08700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 0x7fcf141952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59310/0 (socket says 172.21.15.98:59310) 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf19a08700 1 -- 172.21.15.98:0/1935845149 learned_addr learned my addr 172.21.15.98:0/1935845149 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf1a209700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf140ff3c0 0x7fcf14194db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf19a08700 1 -- 172.21.15.98:0/1935845149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf140ff3c0 msgr2=0x7fcf14194db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf19a08700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf140ff3c0 0x7fcf14194db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.892+0000 7fcf19a08700 1 -- 172.21.15.98:0/1935845149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040095f0 con 0x7fcf140ffd60 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.893+0000 7fcf19a08700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 0x7fcf141952f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf040092e0 tx=0x7fcf0400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.893+0000 7fcf0b7fe700 1 -- 172.21.15.98:0/1935845149 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf0401d070 con 0x7fcf140ffd60 2024-09-13T02:59:21.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.893+0000 7fcf0b7fe700 1 -- 172.21.15.98:0/1935845149 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf04005dc0 con 0x7fcf140ffd60 2024-09-13T02:59:21.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.893+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf141999e0 con 0x7fcf140ffd60 2024-09-13T02:59:21.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.893+0000 7fcf0b7fe700 1 -- 172.21.15.98:0/1935845149 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf04017400 con 0x7fcf140ffd60 2024-09-13T02:59:21.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.893+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf14199ed0 con 0x7fcf140ffd60 2024-09-13T02:59:21.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.894+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf14107730 con 0x7fcf140ffd60 2024-09-13T02:59:21.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.895+0000 7fcf0b7fe700 1 -- 172.21.15.98:0/1935845149 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcf0400f6f0 con 0x7fcf140ffd60 2024-09-13T02:59:21.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.895+0000 7fcf0b7fe700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcf0006e680 0x7fcf00070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.896+0000 7fcf0b7fe700 1 -- 172.21.15.98:0/1935845149 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fcf0408f950 con 0x7fcf140ffd60 2024-09-13T02:59:21.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.896+0000 7fcf1a209700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcf0006e680 0x7fcf00070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.896+0000 7fcf1a209700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcf0006e680 0x7fcf00070b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf10005950 tx=0x7fcf1000b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:21.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:21.900+0000 7fcf0b7fe700 1 -- 172.21.15.98:0/1935845149 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcf04058bf0 con 0x7fcf140ffd60 2024-09-13T02:59:22.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.197+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcf1404f2a0 con 0x7fcf140ffd60 2024-09-13T02:59:22.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.198+0000 7fcf0b7fe700 1 -- 172.21.15.98:0/1935845149 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1130 (secure 0 0 0) 0x7fcf0405c2b0 con 0x7fcf140ffd60 2024-09-13T02:59:22.200 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: osd.2 (root=default,host=smithi098) is down 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 35/267 objects degraded (13.109%), 12 pgs degraded 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-13T02:59:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-13T02:59:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-13T02:59:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-13T02:59:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-13T02:59:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-13T02:59:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.200+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcf0006e680 msgr2=0x7fcf00070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.200+0000 7fcf1c46d700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcf0006e680 0x7fcf00070b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf10005950 tx=0x7fcf1000b410 comp rx=0 tx=0).stop 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.200+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 msgr2=0x7fcf141952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.200+0000 7fcf1c46d700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 0x7fcf141952f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf040092e0 tx=0x7fcf0400bd70 comp rx=0 tx=0).stop 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.201+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 shutdown_connections 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.201+0000 7fcf1c46d700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcf0006e680 0x7fcf00070b30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.201+0000 7fcf1c46d700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf140ff3c0 0x7fcf14194db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.201+0000 7fcf1c46d700 1 --2- 172.21.15.98:0/1935845149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf140ffd60 0x7fcf141952f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.201+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 >> 172.21.15.98:0/1935845149 conn(0x7fcf140fac60 msgr2=0x7fcf140fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.201+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 shutdown_connections 2024-09-13T02:59:22.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:22.201+0000 7fcf1c46d700 1 -- 172.21.15.98:0/1935845149 wait complete. 2024-09-13T02:59:22.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:22 smithi098 ceph-mon[87325]: from='osd.2 [v2:172.21.15.98:6818/3300891147,v1:172.21.15.98:6819/3300891147]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:59:22.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:22 smithi098 ceph-mon[87325]: osdmap e62: 6 total, 5 up, 6 in 2024-09-13T02:59:22.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:22 smithi098 ceph-mon[87325]: from='osd.2 [v2:172.21.15.98:6818/3300891147,v1:172.21.15.98:6819/3300891147]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:59:22.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:22 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1673338741' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:59:22.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:22 smithi098 ceph-mon[87325]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:22.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:22 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1935845149' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:22.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:22 smithi142 ceph-mon[65447]: from='osd.2 [v2:172.21.15.98:6818/3300891147,v1:172.21.15.98:6819/3300891147]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:59:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:22 smithi142 ceph-mon[65447]: osdmap e62: 6 total, 5 up, 6 in 2024-09-13T02:59:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:22 smithi142 ceph-mon[65447]: from='osd.2 [v2:172.21.15.98:6818/3300891147,v1:172.21.15.98:6819/3300891147]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-13T02:59:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:22 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1673338741' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:59:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:22 smithi142 ceph-mon[65447]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:22.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:22 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1935845149' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:23.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:23.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:59:23.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: osd.2 [v2:172.21.15.98:6818/3300891147,v1:172.21.15.98:6819/3300891147] boot 2024-09-13T02:59:23.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T02:59:23.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:59:23.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:23.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: pgmap v94: 65 pgs: 5 peering, 12 active+undersized, 10 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 31/267 objects degraded (11.610%) 2024-09-13T02:59:23.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:23 smithi098 ceph-mon[87325]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: osd.2 [v2:172.21.15.98:6818/3300891147,v1:172.21.15.98:6819/3300891147] boot 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:23.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:23.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:23.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:23.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:23.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T02:59:23.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: pgmap v94: 65 pgs: 5 peering, 12 active+undersized, 10 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 31/267 objects degraded (11.610%) 2024-09-13T02:59:23.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:23 smithi142 ceph-mon[65447]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T02:59:24.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:24 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 31/267 objects degraded (11.610%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:24.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:24 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 31/267 objects degraded (11.610%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:25.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:25 smithi098 ceph-mon[87325]: pgmap v96: 65 pgs: 8 peering, 4 active+undersized, 5 active+undersized+degraded, 48 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 18/267 objects degraded (6.742%) 2024-09-13T02:59:25.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:25 smithi142 ceph-mon[65447]: pgmap v96: 65 pgs: 8 peering, 4 active+undersized, 5 active+undersized+degraded, 48 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 18/267 objects degraded (6.742%) 2024-09-13T02:59:27.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:26 smithi098 ceph-mon[87325]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 5 pgs degraded) 2024-09-13T02:59:27.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:26 smithi142 ceph-mon[65447]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 5 pgs degraded) 2024-09-13T02:59:27.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:27 smithi098 ceph-mon[87325]: pgmap v97: 65 pgs: 8 peering, 57 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:59:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:27 smithi142 ceph-mon[65447]: pgmap v97: 65 pgs: 8 peering, 57 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:59:30.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:29 smithi098 ceph-mon[87325]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 691 B/s rd, 1 op/s 2024-09-13T02:59:30.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:29 smithi142 ceph-mon[65447]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 691 B/s rd, 1 op/s 2024-09-13T02:59:32.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:31 smithi098 ceph-mon[87325]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:59:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:31 smithi142 ceph-mon[65447]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:59:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:33 smithi098 ceph-mon[87325]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T02:59:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:33 smithi142 ceph-mon[65447]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T02:59:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:36.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:35 smithi098 ceph-mon[87325]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T02:59:36.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:35 smithi142 ceph-mon[65447]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T02:59:38.123 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:37 smithi142 ceph-mon[65447]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:59:38.123 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:37 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:37 smithi098 ceph-mon[87325]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T02:59:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:37 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:38 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:38 smithi098 ceph-mon[87325]: Upgrade: osd.3 is safe to restart 2024-09-13T02:59:39.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:38 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:39.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:38 smithi142 ceph-mon[65447]: Upgrade: osd.3 is safe to restart 2024-09-13T02:59:40.175 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:39 smithi142 ceph-mon[65447]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:59:40.176 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:39 smithi142 ceph-mon[65447]: Upgrade: Updating osd.3 2024-09-13T02:59:40.176 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:39 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:40.176 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:39 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:59:40.176 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:39 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:40.176 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:39 smithi142 ceph-mon[65447]: Deploying daemon osd.3 on smithi142 2024-09-13T02:59:40.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:39 smithi098 ceph-mon[87325]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:59:40.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:39 smithi098 ceph-mon[87325]: Upgrade: Updating osd.3 2024-09-13T02:59:40.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:39 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:40.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:39 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:59:40.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:39 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:40.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:39 smithi098 ceph-mon[87325]: Deploying daemon osd.3 on smithi142 2024-09-13T02:59:41.890 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:41 smithi142 systemd[1]: Stopping Ceph osd.3 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:59:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:41 smithi098 ceph-mon[87325]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:59:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:41 smithi142 ceph-mon[65447]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:59:42.252 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:42 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[39284]: 2024-09-13T02:59:42.002+0000 7f853c7ff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:59:42.252 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:42 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[39284]: 2024-09-13T02:59:42.002+0000 7f853c7ff700 -1 osd.3 64 *** Got signal Terminated *** 2024-09-13T02:59:42.252 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:42 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[39284]: 2024-09-13T02:59:42.002+0000 7f853c7ff700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:59:43.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:42 smithi098 ceph-mon[87325]: osd.3 marked itself down and dead 2024-09-13T02:59:43.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:42 smithi142 ceph-mon[65447]: osd.3 marked itself down and dead 2024-09-13T02:59:43.730 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:43 smithi142 podman[74906]: 2024-09-13 02:59:43.446613382 +0000 UTC m=+1.577595684 container died 4c69bc135394672a82b3cbc9edd983f69742d2410908b8c7f35f9fecaeb52942 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0) 2024-09-13T02:59:44.001 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:43 smithi142 podman[74906]: 2024-09-13 02:59:43.828081015 +0000 UTC m=+1.959063309 container cleanup 4c69bc135394672a82b3cbc9edd983f69742d2410908b8c7f35f9fecaeb52942 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, RELEASE=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T02:59:44.002 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:43 smithi142 bash[74906]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3 2024-09-13T02:59:44.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:43 smithi142 ceph-mon[65447]: pgmap v105: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:59:44.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:43 smithi142 ceph-mon[65447]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:59:44.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:43 smithi142 ceph-mon[65447]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T02:59:44.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:43 smithi098 ceph-mon[87325]: pgmap v105: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T02:59:44.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:43 smithi098 ceph-mon[87325]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:59:44.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:43 smithi098 ceph-mon[87325]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T02:59:44.497 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:44 smithi142 podman[74922]: 2024-09-13 02:59:44.149212777 +0000 UTC m=+0.695824932 container remove 4c69bc135394672a82b3cbc9edd983f69742d2410908b8c7f35f9fecaeb52942 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T02:59:44.751 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:44 smithi142 podman[75010]: 2024-09-13 02:59:44.496990636 +0000 UTC m=+0.104722204 container create d2606ea5cfc19e95981f2997ffd4f9f2281e3aaf354848549139264c5c767a63 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:59:44.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:44 smithi142 podman[75010]: 2024-09-13 02:59:44.408330725 +0000 UTC m=+0.016062297 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:59:44.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:44 smithi142 podman[75010]: 2024-09-13 02:59:44.708052244 +0000 UTC m=+0.315783821 container init d2606ea5cfc19e95981f2997ffd4f9f2281e3aaf354848549139264c5c767a63 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T02:59:44.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:44 smithi142 podman[75010]: 2024-09-13 02:59:44.7117944 +0000 UTC m=+0.319525977 container start d2606ea5cfc19e95981f2997ffd4f9f2281e3aaf354848549139264c5c767a63 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T02:59:45.188 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:44 smithi142 ceph-mon[65447]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T02:59:45.188 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:44 smithi142 podman[75010]: 2024-09-13 02:59:44.783234078 +0000 UTC m=+0.390965662 container attach d2606ea5cfc19e95981f2997ffd4f9f2281e3aaf354848549139264c5c767a63 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T02:59:45.188 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:44 smithi142 podman[75010]: 2024-09-13 02:59:44.902020785 +0000 UTC m=+0.509752353 container died d2606ea5cfc19e95981f2997ffd4f9f2281e3aaf354848549139264c5c767a63 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T02:59:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:44 smithi098 ceph-mon[87325]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T02:59:45.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:45 smithi142 podman[75033]: 2024-09-13 02:59:45.461506343 +0000 UTC m=+0.553081594 container remove d2606ea5cfc19e95981f2997ffd4f9f2281e3aaf354848549139264c5c767a63 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T02:59:45.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:45 smithi142 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T02:59:45.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:45 smithi142 systemd[1]: Stopped Ceph osd.3 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:59:45.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:45 smithi142 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 3.129s CPU time. 2024-09-13T02:59:45.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:45 smithi142 systemd[1]: Starting Ceph osd.3 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T02:59:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:45 smithi098 ceph-mon[87325]: pgmap v108: 65 pgs: 10 active+undersized, 6 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/267 objects degraded (11.610%) 2024-09-13T02:59:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:45 smithi098 ceph-mon[87325]: Health check failed: Degraded data redundancy: 31/267 objects degraded (11.610%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:46.249 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:45 smithi142 ceph-mon[65447]: pgmap v108: 65 pgs: 10 active+undersized, 6 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/267 objects degraded (11.610%) 2024-09-13T02:59:46.249 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:45 smithi142 ceph-mon[65447]: Health check failed: Degraded data redundancy: 31/267 objects degraded (11.610%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:46.249 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:45 smithi142 podman[75131]: 2024-09-13 02:59:45.80613518 +0000 UTC m=+0.016264763 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:59:46.249 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:45 smithi142 podman[75131]: 2024-09-13 02:59:45.904018182 +0000 UTC m=+0.114147756 container create 666f51672e141150f9cf6ec7ff2d1b9a5ca79b7ea06d565135aa16b61871947c (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-7741f7f) 2024-09-13T02:59:46.249 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:46 smithi142 podman[75131]: 2024-09-13 02:59:46.140440695 +0000 UTC m=+0.350570265 container init 666f51672e141150f9cf6ec7ff2d1b9a5ca79b7ea06d565135aa16b61871947c (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T02:59:46.249 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:46 smithi142 podman[75131]: 2024-09-13 02:59:46.144688763 +0000 UTC m=+0.354818329 container start 666f51672e141150f9cf6ec7ff2d1b9a5ca79b7ea06d565135aa16b61871947c (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:59:46.250 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:46 smithi142 podman[75131]: 2024-09-13 02:59:46.248528523 +0000 UTC m=+0.458658089 container attach 666f51672e141150f9cf6ec7ff2d1b9a5ca79b7ea06d565135aa16b61871947c (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:59:46.501 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:46 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate[75145]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:46.502 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:46 smithi142 bash[75131]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:46.502 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:46 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate[75145]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:46.502 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:46 smithi142 bash[75131]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:47.309 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate[75145]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:59:47.309 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 bash[75131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:59:47.309 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate[75145]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:59:47.309 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 bash[75131]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate[75145]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 bash[75131]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate[75145]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 bash[75131]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate[75145]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 bash[75131]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate[75145]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 bash[75131]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate[75145]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T02:59:47.611 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 bash[75131]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T02:59:47.612 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 podman[75283]: 2024-09-13 02:59:47.367297236 +0000 UTC m=+0.017167433 container died 666f51672e141150f9cf6ec7ff2d1b9a5ca79b7ea06d565135aa16b61871947c (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T02:59:48.207 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:47 smithi142 ceph-mon[65447]: pgmap v109: 65 pgs: 12 active+undersized, 5 stale+active+clean, 10 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-09-13T02:59:48.208 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:47 smithi142 podman[75283]: 2024-09-13 02:59:47.893677404 +0000 UTC m=+0.543547594 container remove 666f51672e141150f9cf6ec7ff2d1b9a5ca79b7ea06d565135aa16b61871947c (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T02:59:48.208 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:48 smithi142 podman[75352]: 2024-09-13 02:59:48.007611453 +0000 UTC m=+0.017692491 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:59:48.208 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:48 smithi142 podman[75352]: 2024-09-13 02:59:48.11115217 +0000 UTC m=+0.121233187 container create 322e0a9d6b20d46cdb971df9ea6a11c39ccf53f8cbfd6f518d30bb54676f16d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T02:59:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:47 smithi098 ceph-mon[87325]: pgmap v109: 65 pgs: 12 active+undersized, 5 stale+active+clean, 10 active+undersized+degraded, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 35/267 objects degraded (13.109%) 2024-09-13T02:59:48.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:48 smithi142 podman[75352]: 2024-09-13 02:59:48.330432118 +0000 UTC m=+0.340513135 container init 322e0a9d6b20d46cdb971df9ea6a11c39ccf53f8cbfd6f518d30bb54676f16d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:59:48.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:48 smithi142 podman[75352]: 2024-09-13 02:59:48.333842838 +0000 UTC m=+0.343923855 container start 322e0a9d6b20d46cdb971df9ea6a11c39ccf53f8cbfd6f518d30bb54676f16d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T02:59:48.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:48 smithi142 ceph-osd[75372]: -- 172.21.15.142:0/2259499380 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7b281e1e0 con 0x55a7b27b4000 2024-09-13T02:59:48.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:48 smithi142 bash[75352]: 322e0a9d6b20d46cdb971df9ea6a11c39ccf53f8cbfd6f518d30bb54676f16d0 2024-09-13T02:59:48.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:48 smithi142 systemd[1]: Started Ceph osd.3 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T02:59:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:49 smithi142 ceph-mon[65447]: pgmap v110: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-09-13T02:59:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:49.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:49 smithi098 ceph-mon[87325]: pgmap v110: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-09-13T02:59:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:49.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:50.481 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:50 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[75368]: 2024-09-13T02:59:50.224+0000 7faa2a8de640 -1 Falling back to public interface 2024-09-13T02:59:52.135 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:51 smithi098 ceph-mon[87325]: pgmap v111: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-09-13T02:59:52.135 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:51 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:52.135 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:51 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:51 smithi142 ceph-mon[65447]: pgmap v111: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-09-13T02:59:52.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:51 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:52.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:51 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.315+0000 7f48f0bae700 1 -- 172.21.15.98:0/2898110686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100460 msgr2=0x7f48ec100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.315+0000 7f48f0bae700 1 --2- 172.21.15.98:0/2898110686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100460 0x7f48ec100830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009910 tx=0x7f48dc009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.315+0000 7f48f0bae700 1 -- 172.21.15.98:0/2898110686 shutdown_connections 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.315+0000 7f48f0bae700 1 --2- 172.21.15.98:0/2898110686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48ec100d70 0x7f48ec1094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.315+0000 7f48f0bae700 1 --2- 172.21.15.98:0/2898110686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100460 0x7f48ec100830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.315+0000 7f48f0bae700 1 -- 172.21.15.98:0/2898110686 >> 172.21.15.98:0/2898110686 conn(0x7f48ec0748b0 msgr2=0x7f48ec074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.315+0000 7f48f0bae700 1 -- 172.21.15.98:0/2898110686 shutdown_connections 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.315+0000 7f48f0bae700 1 -- 172.21.15.98:0/2898110686 wait complete. 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.315+0000 7f48f0bae700 1 Processor -- start 2024-09-13T02:59:52.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48f0bae700 1 -- start start 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48f0bae700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48ec100460 0x7f48ec196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48f0bae700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100d70 0x7f48ec1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48f0bae700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec1978d0 con 0x7f48ec100d70 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48f0bae700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec197a10 con 0x7f48ec100460 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48e9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100d70 0x7f48ec1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48e9d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100d70 0x7f48ec1972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58632/0 (socket says 172.21.15.98:58632) 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48e9d9b700 1 -- 172.21.15.98:0/826959033 learned_addr learned my addr 172.21.15.98:0/826959033 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48ea59c700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48ec100460 0x7f48ec196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48e9d9b700 1 -- 172.21.15.98:0/826959033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48ec100460 msgr2=0x7f48ec196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48e9d9b700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48ec100460 0x7f48ec196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.316+0000 7f48e9d9b700 1 -- 172.21.15.98:0/826959033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0095f0 con 0x7f48ec100d70 2024-09-13T02:59:52.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.317+0000 7f48e9d9b700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100d70 0x7f48ec1972b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f48e000d8d0 tx=0x7f48e000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:52.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.317+0000 7f48db7fe700 1 -- 172.21.15.98:0/826959033 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e00098a0 con 0x7f48ec100d70 2024-09-13T02:59:52.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.317+0000 7f48db7fe700 1 -- 172.21.15.98:0/826959033 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48e0010460 con 0x7f48ec100d70 2024-09-13T02:59:52.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.317+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec19fde0 con 0x7f48ec100d70 2024-09-13T02:59:52.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.317+0000 7f48db7fe700 1 -- 172.21.15.98:0/826959033 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e000f5f0 con 0x7f48ec100d70 2024-09-13T02:59:52.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.317+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec1a02a0 con 0x7f48ec100d70 2024-09-13T02:59:52.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.318+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ec106bd0 con 0x7f48ec100d70 2024-09-13T02:59:52.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.319+0000 7f48db7fe700 1 -- 172.21.15.98:0/826959033 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f48e0009a00 con 0x7f48ec100d70 2024-09-13T02:59:52.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.319+0000 7f48db7fe700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f48d406e680 0x7f48d4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:52.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.319+0000 7f48db7fe700 1 -- 172.21.15.98:0/826959033 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f48e008e410 con 0x7f48ec100d70 2024-09-13T02:59:52.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.319+0000 7f48ea59c700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f48d406e680 0x7f48d4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:52.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.320+0000 7f48ea59c700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f48d406e680 0x7f48d4070b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f48dc006010 tx=0x7f48dc01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:52.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.324+0000 7f48db7fe700 1 -- 172.21.15.98:0/826959033 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f48e00576b0 con 0x7f48ec100d70 2024-09-13T02:59:52.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.556+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48ec061190 con 0x7f48d406e680 2024-09-13T02:59:52.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.558+0000 7f48db7fe700 1 -- 172.21.15.98:0/826959033 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f48ec061190 con 0x7f48d406e680 2024-09-13T02:59:52.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.560+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f48d406e680 msgr2=0x7f48d4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:52.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.560+0000 7f48f0bae700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f48d406e680 0x7f48d4070b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f48dc006010 tx=0x7f48dc01a040 comp rx=0 tx=0).stop 2024-09-13T02:59:52.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.560+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100d70 msgr2=0x7f48ec1972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:52.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.560+0000 7f48f0bae700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100d70 0x7f48ec1972b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f48e000d8d0 tx=0x7f48e000dbe0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.560+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 shutdown_connections 2024-09-13T02:59:52.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.560+0000 7f48f0bae700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f48d406e680 0x7f48d4070b30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.560+0000 7f48f0bae700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48ec100460 0x7f48ec196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.560+0000 7f48f0bae700 1 --2- 172.21.15.98:0/826959033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48ec100d70 0x7f48ec1972b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.560+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 >> 172.21.15.98:0/826959033 conn(0x7f48ec0748b0 msgr2=0x7f48ec103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:52.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.561+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 shutdown_connections 2024-09-13T02:59:52.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.561+0000 7f48f0bae700 1 -- 172.21.15.98:0/826959033 wait complete. 2024-09-13T02:59:52.574 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T02:59:52.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.681+0000 7fd37a2f2700 1 -- 172.21.15.98:0/2480623525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3740ffbd0 msgr2=0x7fd374100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:52.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.681+0000 7fd37a2f2700 1 --2- 172.21.15.98:0/2480623525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3740ffbd0 0x7fd374100040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd368009910 tx=0x7fd368009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:52.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.681+0000 7fd37a2f2700 1 -- 172.21.15.98:0/2480623525 shutdown_connections 2024-09-13T02:59:52.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.681+0000 7fd37a2f2700 1 --2- 172.21.15.98:0/2480623525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3740ffbd0 0x7fd374100040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.681+0000 7fd37a2f2700 1 --2- 172.21.15.98:0/2480623525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd374104130 0x7fd374104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.681+0000 7fd37a2f2700 1 -- 172.21.15.98:0/2480623525 >> 172.21.15.98:0/2480623525 conn(0x7fd374075130 msgr2=0x7fd374075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:52.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.681+0000 7fd37a2f2700 1 -- 172.21.15.98:0/2480623525 shutdown_connections 2024-09-13T02:59:52.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.681+0000 7fd37a2f2700 1 -- 172.21.15.98:0/2480623525 wait complete. 2024-09-13T02:59:52.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.682+0000 7fd37a2f2700 1 Processor -- start 2024-09-13T02:59:52.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.682+0000 7fd37a2f2700 1 -- start start 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.682+0000 7fd37a2f2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740ffbd0 0x7fd374100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd37a2f2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd374104130 0x7fd374101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd37a2f2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3741018b0 con 0x7fd374104130 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd37a2f2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3741019f0 con 0x7fd3740ffbd0 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd3737fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd374104130 0x7fd374101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd3737fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd374104130 0x7fd374101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58646/0 (socket says 172.21.15.98:58646) 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd3737fe700 1 -- 172.21.15.98:0/1112663318 learned_addr learned my addr 172.21.15.98:0/1112663318 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd373fff700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740ffbd0 0x7fd374100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd3737fe700 1 -- 172.21.15.98:0/1112663318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740ffbd0 msgr2=0x7fd374100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd3737fe700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740ffbd0 0x7fd374100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd3737fe700 1 -- 172.21.15.98:0/1112663318 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680095f0 con 0x7fd374104130 2024-09-13T02:59:52.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd373fff700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740ffbd0 0x7fd374100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:59:52.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.683+0000 7fd3737fe700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd374104130 0x7fd374101370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd368006010 tx=0x7fd36800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:52.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.684+0000 7fd3717fa700 1 -- 172.21.15.98:0/1112663318 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36801d070 con 0x7fd374104130 2024-09-13T02:59:52.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.684+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd374101c70 con 0x7fd374104130 2024-09-13T02:59:52.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.684+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3741a2370 con 0x7fd374104130 2024-09-13T02:59:52.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.684+0000 7fd3717fa700 1 -- 172.21.15.98:0/1112663318 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd36800f460 con 0x7fd374104130 2024-09-13T02:59:52.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.684+0000 7fd3717fa700 1 -- 172.21.15.98:0/1112663318 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd368017630 con 0x7fd374104130 2024-09-13T02:59:52.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.685+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3741086a0 con 0x7fd374104130 2024-09-13T02:59:52.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.685+0000 7fd3717fa700 1 -- 172.21.15.98:0/1112663318 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd368003a60 con 0x7fd374104130 2024-09-13T02:59:52.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.686+0000 7fd3717fa700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd35c06e680 0x7fd35c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:52.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.686+0000 7fd3717fa700 1 -- 172.21.15.98:0/1112663318 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd36808f9c0 con 0x7fd374104130 2024-09-13T02:59:52.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.686+0000 7fd373fff700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd35c06e680 0x7fd35c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:52.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.686+0000 7fd373fff700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd35c06e680 0x7fd35c070b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd364005950 tx=0x7fd36400a300 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:52.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.690+0000 7fd3717fa700 1 -- 172.21.15.98:0/1112663318 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd368058da0 con 0x7fd374104130 2024-09-13T02:59:52.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.928+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd374102470 con 0x7fd35c06e680 2024-09-13T02:59:52.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.930+0000 7fd3717fa700 1 -- 172.21.15.98:0/1112663318 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd374102470 con 0x7fd35c06e680 2024-09-13T02:59:52.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd35c06e680 msgr2=0x7fd35c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:52.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd35c06e680 0x7fd35c070b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd364005950 tx=0x7fd36400a300 comp rx=0 tx=0).stop 2024-09-13T02:59:52.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd374104130 msgr2=0x7fd374101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:52.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd374104130 0x7fd374101370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd368006010 tx=0x7fd36800bd70 comp rx=0 tx=0).stop 2024-09-13T02:59:52.935 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:52.935 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:52.935 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:52 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:52.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 shutdown_connections 2024-09-13T02:59:52.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd35c06e680 0x7fd35c070b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740ffbd0 0x7fd374100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 --2- 172.21.15.98:0/1112663318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd374104130 0x7fd374101370 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:52.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 >> 172.21.15.98:0/1112663318 conn(0x7fd374075130 msgr2=0x7fd3740fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:52.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 shutdown_connections 2024-09-13T02:59:52.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:52.933+0000 7fd37a2f2700 1 -- 172.21.15.98:0/1112663318 wait complete. 2024-09-13T02:59:53.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.047+0000 7f686e732700 1 -- 172.21.15.98:0/4045840304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68681004e0 msgr2=0x7f68681008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.047+0000 7f686e732700 1 --2- 172.21.15.98:0/4045840304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68681004e0 0x7f68681008b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6858009910 tx=0x7f6858009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:53.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.047+0000 7f686e732700 1 -- 172.21.15.98:0/4045840304 shutdown_connections 2024-09-13T02:59:53.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.047+0000 7f686e732700 1 --2- 172.21.15.98:0/4045840304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6868100e80 0x7f6868104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.047+0000 7f686e732700 1 --2- 172.21.15.98:0/4045840304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68681004e0 0x7f68681008b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.047+0000 7f686e732700 1 -- 172.21.15.98:0/4045840304 >> 172.21.15.98:0/4045840304 conn(0x7f68680fbda0 msgr2=0x7f68680fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:53.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.047+0000 7f686e732700 1 -- 172.21.15.98:0/4045840304 shutdown_connections 2024-09-13T02:59:53.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.047+0000 7f686e732700 1 -- 172.21.15.98:0/4045840304 wait complete. 2024-09-13T02:59:53.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.048+0000 7f686e732700 1 Processor -- start 2024-09-13T02:59:53.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.048+0000 7f686e732700 1 -- start start 2024-09-13T02:59:53.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f686e732700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68681004e0 0x7f6868195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:53.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f686e732700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6868100e80 0x7f68681964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:53.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f686e732700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868196bb0 con 0x7f6868100e80 2024-09-13T02:59:53.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f686e732700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686819a940 con 0x7f68681004e0 2024-09-13T02:59:53.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68677fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6868100e80 0x7f68681964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:53.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68677fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6868100e80 0x7f68681964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58664/0 (socket says 172.21.15.98:58664) 2024-09-13T02:59:53.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68677fe700 1 -- 172.21.15.98:0/815365288 learned_addr learned my addr 172.21.15.98:0/815365288 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:53.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f6867fff700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68681004e0 0x7f6868195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:53.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68677fe700 1 -- 172.21.15.98:0/815365288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68681004e0 msgr2=0x7f6868195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68677fe700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68681004e0 0x7f6868195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68677fe700 1 -- 172.21.15.98:0/815365288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580095f0 con 0x7f6868100e80 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f6867fff700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68681004e0 0x7f6868195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68677fe700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6868100e80 0x7f68681964d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f685c00b480 tx=0x7f685c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68657fa700 1 -- 172.21.15.98:0/815365288 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685c011800 con 0x7f6868100e80 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686819ac20 con 0x7f6868100e80 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68657fa700 1 -- 172.21.15.98:0/815365288 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f685c011e20 con 0x7f6868100e80 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.049+0000 7f68657fa700 1 -- 172.21.15.98:0/815365288 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685c010ea0 con 0x7f6868100e80 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.050+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686819b170 con 0x7f6868100e80 2024-09-13T02:59:53.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.050+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68681087f0 con 0x7f6868100e80 2024-09-13T02:59:53.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.051+0000 7f68657fa700 1 -- 172.21.15.98:0/815365288 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f685c010380 con 0x7f6868100e80 2024-09-13T02:59:53.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.051+0000 7f68657fa700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f685006e680 0x7f6850070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:53.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.052+0000 7f68657fa700 1 -- 172.21.15.98:0/815365288 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f685c08e070 con 0x7f6868100e80 2024-09-13T02:59:53.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.052+0000 7f6867fff700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f685006e680 0x7f6850070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:53.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.052+0000 7f6867fff700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f685006e680 0x7f6850070b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6858006010 tx=0x7f685801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:53.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.056+0000 7f68657fa700 1 -- 172.21.15.98:0/815365288 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f685c057310 con 0x7f6868100e80 2024-09-13T02:59:53.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:52 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:53.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:52 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:53.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:52 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:53.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.274+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f686819b3f0 con 0x7f685006e680 2024-09-13T02:59:53.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.291+0000 7f68657fa700 1 -- 172.21.15.98:0/815365288 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f686819b3f0 con 0x7f685006e680 2024-09-13T02:59:53.293 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:59:53.293 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (4m) 34s ago 15m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (15m) 34s ago 15m 8694k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (14m) 2s ago 14m 7922k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (2m) 34s ago 15m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (2m) 2s ago 14m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (4m) 34s ago 15m 80.3M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (9m) 34s ago 9m 93.9M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (9m) 34s ago 9m 152M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (9m) 2s ago 9m 16.7M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (9m) 2s ago 9m 20.1M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (6m) 34s ago 16m 500M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T02:59:53.294 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (5m) 2s ago 14m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (3m) 34s ago 16m 49.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (2m) 2s ago 14m 41.2M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (5m) 34s ago 15m 16.2M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (5m) 2s ago 14m 15.0M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (108s) 34s ago 13m 92.8M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (74s) 34s ago 13m 85.1M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (40s) 34s ago 12m 14.4M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 04c10c8159ba 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (5s) 2s ago 12m 14.3M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 322e0a9d6b20 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (11m) 2s ago 11m 215M 2240M 18.2.0 dc2bc1663786 a7209462d325 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (11m) 2s ago 11m 196M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T02:59:53.295 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (4m) 34s ago 14m 78.7M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T02:59:53.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f685006e680 msgr2=0x7f6850070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f685006e680 0x7f6850070b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6858006010 tx=0x7f685801a040 comp rx=0 tx=0).stop 2024-09-13T02:59:53.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6868100e80 msgr2=0x7f68681964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6868100e80 0x7f68681964d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f685c00b480 tx=0x7f685c00b790 comp rx=0 tx=0).stop 2024-09-13T02:59:53.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 shutdown_connections 2024-09-13T02:59:53.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f685006e680 0x7f6850070b30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68681004e0 0x7f6868195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 --2- 172.21.15.98:0/815365288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6868100e80 0x7f68681964d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 >> 172.21.15.98:0/815365288 conn(0x7f68680fbda0 msgr2=0x7f68680fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:53.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 shutdown_connections 2024-09-13T02:59:53.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.294+0000 7f686e732700 1 -- 172.21.15.98:0/815365288 wait complete. 2024-09-13T02:59:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.400+0000 7f61ac77e700 1 -- 172.21.15.98:0/3870560706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 msgr2=0x7f61a410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.400+0000 7f61ac77e700 1 --2- 172.21.15.98:0/3870560706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 0x7f61a410a6d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6194009910 tx=0x7f6194009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.400+0000 7f61ac77e700 1 -- 172.21.15.98:0/3870560706 shutdown_connections 2024-09-13T02:59:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.400+0000 7f61ac77e700 1 --2- 172.21.15.98:0/3870560706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 0x7f61a410a6d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.400+0000 7f61ac77e700 1 --2- 172.21.15.98:0/3870560706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a40ff350 0x7f61a40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.400+0000 7f61ac77e700 1 -- 172.21.15.98:0/3870560706 >> 172.21.15.98:0/3870560706 conn(0x7f61a40748b0 msgr2=0x7f61a4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.400+0000 7f61ac77e700 1 -- 172.21.15.98:0/3870560706 shutdown_connections 2024-09-13T02:59:53.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.400+0000 7f61ac77e700 1 -- 172.21.15.98:0/3870560706 wait complete. 2024-09-13T02:59:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61ac77e700 1 Processor -- start 2024-09-13T02:59:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61ac77e700 1 -- start start 2024-09-13T02:59:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61ac77e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a40ff350 0x7f61a4195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61ac77e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 0x7f61a41963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61ac77e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41969f0 con 0x7f61a40ffc60 2024-09-13T02:59:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61ac77e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4196b30 con 0x7f61a40ff350 2024-09-13T02:59:53.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61a9d19700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 0x7f61a41963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61a9d19700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 0x7f61a41963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58672/0 (socket says 172.21.15.98:58672) 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61a9d19700 1 -- 172.21.15.98:0/44896878 learned_addr learned my addr 172.21.15.98:0/44896878 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.401+0000 7f61aa51a700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a40ff350 0x7f61a4195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.402+0000 7f61a9d19700 1 -- 172.21.15.98:0/44896878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a40ff350 msgr2=0x7f61a4195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.402+0000 7f61a9d19700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a40ff350 0x7f61a4195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.402+0000 7f61a9d19700 1 -- 172.21.15.98:0/44896878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61940095f0 con 0x7f61a40ffc60 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.402+0000 7f61a9d19700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 0x7f61a41963a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6194006010 tx=0x7f619400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.402+0000 7f619b7fe700 1 -- 172.21.15.98:0/44896878 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f619401d070 con 0x7f61a40ffc60 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.402+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a419a920 con 0x7f61a40ffc60 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.402+0000 7f619b7fe700 1 -- 172.21.15.98:0/44896878 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6194004fb0 con 0x7f61a40ffc60 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.402+0000 7f619b7fe700 1 -- 172.21.15.98:0/44896878 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6194022ea0 con 0x7f61a40ffc60 2024-09-13T02:59:53.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.402+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a419ae10 con 0x7f61a40ffc60 2024-09-13T02:59:53.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.403+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a4107dd0 con 0x7f61a40ffc60 2024-09-13T02:59:53.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.404+0000 7f619b7fe700 1 -- 172.21.15.98:0/44896878 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6194022470 con 0x7f61a40ffc60 2024-09-13T02:59:53.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.404+0000 7f619b7fe700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f619006e680 0x7f6190070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:53.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.404+0000 7f619b7fe700 1 -- 172.21.15.98:0/44896878 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f619408faf0 con 0x7f61a40ffc60 2024-09-13T02:59:53.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.404+0000 7f61aa51a700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f619006e680 0x7f6190070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:53.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.405+0000 7f61aa51a700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f619006e680 0x7f6190070b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005ea0 tx=0x7f61a0005e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:53.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.408+0000 7f619b7fe700 1 -- 172.21.15.98:0/44896878 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6194058e40 con 0x7f61a40ffc60 2024-09-13T02:59:53.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.701+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f61a404f2a0 con 0x7f61a40ffc60 2024-09-13T02:59:53.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.701+0000 7f619b7fe700 1 -- 172.21.15.98:0/44896878 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f6194027330 con 0x7f61a40ffc60 2024-09-13T02:59:53.703 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:59:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T02:59:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:59:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T02:59:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:59:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T02:59:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-13T02:59:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 3 2024-09-13T02:59:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:59:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T02:59:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T02:59:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T02:59:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T02:59:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-09-13T02:59:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 7 2024-09-13T02:59:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T02:59:53.705 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:59:53.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f619006e680 msgr2=0x7f6190070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f619006e680 0x7f6190070b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005ea0 tx=0x7f61a0005e30 comp rx=0 tx=0).stop 2024-09-13T02:59:53.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 msgr2=0x7f61a41963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 0x7f61a41963a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6194006010 tx=0x7f619400be20 comp rx=0 tx=0).stop 2024-09-13T02:59:53.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 shutdown_connections 2024-09-13T02:59:53.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f619006e680 0x7f6190070b30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a40ff350 0x7f61a4195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 --2- 172.21.15.98:0/44896878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61a40ffc60 0x7f61a41963a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 >> 172.21.15.98:0/44896878 conn(0x7f61a40748b0 msgr2=0x7f61a4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:53.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 shutdown_connections 2024-09-13T02:59:53.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.704+0000 7f61ac77e700 1 -- 172.21.15.98:0/44896878 wait complete. 2024-09-13T02:59:53.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.810+0000 7f0948388700 1 -- 172.21.15.98:0/3551599090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 msgr2=0x7f0940103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.810+0000 7f0948388700 1 --2- 172.21.15.98:0/3551599090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 0x7f0940103d30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0934009910 tx=0x7f0934009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:53.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.810+0000 7f0948388700 1 -- 172.21.15.98:0/3551599090 shutdown_connections 2024-09-13T02:59:53.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.810+0000 7f0948388700 1 --2- 172.21.15.98:0/3551599090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 0x7f0940103d30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.810+0000 7f0948388700 1 --2- 172.21.15.98:0/3551599090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09400ff3c0 0x7f09400ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.810+0000 7f0948388700 1 -- 172.21.15.98:0/3551599090 >> 172.21.15.98:0/3551599090 conn(0x7f09400fac80 msgr2=0x7f09400fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:53.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.810+0000 7f0948388700 1 -- 172.21.15.98:0/3551599090 shutdown_connections 2024-09-13T02:59:53.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.810+0000 7f0948388700 1 -- 172.21.15.98:0/3551599090 wait complete. 2024-09-13T02:59:53.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.810+0000 7f0948388700 1 Processor -- start 2024-09-13T02:59:53.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0948388700 1 -- start start 2024-09-13T02:59:53.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0948388700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09400ff3c0 0x7f0940100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:53.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0948388700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 0x7f0940101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:53.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0948388700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940101850 con 0x7f09400ffd60 2024-09-13T02:59:53.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0948388700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940101990 con 0x7f09400ff3c0 2024-09-13T02:59:53.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0945923700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 0x7f0940101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:53.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0945923700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 0x7f0940101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58696/0 (socket says 172.21.15.98:58696) 2024-09-13T02:59:53.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0945923700 1 -- 172.21.15.98:0/3473236242 learned_addr learned my addr 172.21.15.98:0/3473236242 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:53.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0946124700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09400ff3c0 0x7f0940100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:53.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0945923700 1 -- 172.21.15.98:0/3473236242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09400ff3c0 msgr2=0x7f0940100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:53.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0945923700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09400ff3c0 0x7f0940100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:53.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0945923700 1 -- 172.21.15.98:0/3473236242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09340095f0 con 0x7f09400ffd60 2024-09-13T02:59:53.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0945923700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 0x7f0940101310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f093400b5d0 tx=0x7f093400b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:53.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f093f7fe700 1 -- 172.21.15.98:0/3473236242 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093401d070 con 0x7f09400ffd60 2024-09-13T02:59:53.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f093f7fe700 1 -- 172.21.15.98:0/3473236242 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09340052a0 con 0x7f09400ffd60 2024-09-13T02:59:53.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f093f7fe700 1 -- 172.21.15.98:0/3473236242 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0934022470 con 0x7f09400ffd60 2024-09-13T02:59:53.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.811+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0940101c10 con 0x7f09400ffd60 2024-09-13T02:59:53.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.812+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09401a2370 con 0x7f09400ffd60 2024-09-13T02:59:53.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.812+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094004f2a0 con 0x7f09400ffd60 2024-09-13T02:59:53.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.813+0000 7f093f7fe700 1 -- 172.21.15.98:0/3473236242 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0934003710 con 0x7f09400ffd60 2024-09-13T02:59:53.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.813+0000 7f093f7fe700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f092806e680 0x7f0928070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:53.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.813+0000 7f093f7fe700 1 -- 172.21.15.98:0/3473236242 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f093408f860 con 0x7f09400ffd60 2024-09-13T02:59:53.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.813+0000 7f0946124700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f092806e680 0x7f0928070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:53.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.814+0000 7f0946124700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f092806e680 0x7f0928070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f093000f540 tx=0x7f093000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:53.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:53.818+0000 7f093f7fe700 1 -- 172.21.15.98:0/3473236242 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0934058b80 con 0x7f09400ffd60 2024-09-13T02:59:53.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:53 smithi098 ceph-mon[87325]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:53 smithi098 ceph-mon[87325]: pgmap v112: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-09-13T02:59:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:53 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/44896878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:54.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.067+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f09401a26e0 con 0x7f09400ffd60 2024-09-13T02:59:54.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.068+0000 7f093f7fe700 1 -- 172.21.15.98:0/3473236242 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1941 (secure 0 0 0) 0x7f093405c240 con 0x7f09400ffd60 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:59:54.070 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T02:59:54.071 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:54.072 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:59:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:59:54.073 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T02:59:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T02:59:54.073 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:54.073 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:54.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f092806e680 msgr2=0x7f0928070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f092806e680 0x7f0928070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f093000f540 tx=0x7f093000b040 comp rx=0 tx=0).stop 2024-09-13T02:59:54.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 msgr2=0x7f0940101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 0x7f0940101310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f093400b5d0 tx=0x7f093400b600 comp rx=0 tx=0).stop 2024-09-13T02:59:54.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 shutdown_connections 2024-09-13T02:59:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f092806e680 0x7f0928070b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09400ff3c0 0x7f0940100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 --2- 172.21.15.98:0/3473236242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09400ffd60 0x7f0940101310 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 >> 172.21.15.98:0/3473236242 conn(0x7f09400fac80 msgr2=0x7f09400fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 shutdown_connections 2024-09-13T02:59:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.070+0000 7f0948388700 1 -- 172.21.15.98:0/3473236242 wait complete. 2024-09-13T02:59:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T02:59:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.175+0000 7f922d752700 1 -- 172.21.15.98:0/1660584598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9228069140 msgr2=0x7f9228104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.175+0000 7f922d752700 1 --2- 172.21.15.98:0/1660584598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9228069140 0x7f9228104eb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9210009910 tx=0x7f9210009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.175+0000 7f922d752700 1 -- 172.21.15.98:0/1660584598 shutdown_connections 2024-09-13T02:59:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.175+0000 7f922d752700 1 --2- 172.21.15.98:0/1660584598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9228069140 0x7f9228104eb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.175+0000 7f922d752700 1 --2- 172.21.15.98:0/1660584598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92280687a0 0x7f9228068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.175+0000 7f922d752700 1 -- 172.21.15.98:0/1660584598 >> 172.21.15.98:0/1660584598 conn(0x7f9228075130 msgr2=0x7f9228075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.175+0000 7f922d752700 1 -- 172.21.15.98:0/1660584598 shutdown_connections 2024-09-13T02:59:54.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.175+0000 7f922d752700 1 -- 172.21.15.98:0/1660584598 wait complete. 2024-09-13T02:59:54.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f922d752700 1 Processor -- start 2024-09-13T02:59:54.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f922d752700 1 -- start start 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f922d752700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92280687a0 0x7f9228195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f922d752700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228069140 0x7f92281963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f922d752700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9228196a80 con 0x7f92280687a0 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f922d752700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922819a810 con 0x7f9228069140 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f9226ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92280687a0 0x7f9228195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f9226ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92280687a0 0x7f9228195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58708/0 (socket says 172.21.15.98:58708) 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f9226ffd700 1 -- 172.21.15.98:0/1343090436 learned_addr learned my addr 172.21.15.98:0/1343090436 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f92267fc700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228069140 0x7f92281963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f9226ffd700 1 -- 172.21.15.98:0/1343090436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228069140 msgr2=0x7f92281963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f9226ffd700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228069140 0x7f92281963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.176+0000 7f9226ffd700 1 -- 172.21.15.98:0/1343090436 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100095f0 con 0x7f92280687a0 2024-09-13T02:59:54.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.177+0000 7f9226ffd700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92280687a0 0x7f9228195e60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f922000ef10 tx=0x7f922000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:54.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.177+0000 7f921ffff700 1 -- 172.21.15.98:0/1343090436 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f922000c9f0 con 0x7f92280687a0 2024-09-13T02:59:54.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.177+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922819aa90 con 0x7f92280687a0 2024-09-13T02:59:54.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.177+0000 7f921ffff700 1 -- 172.21.15.98:0/1343090436 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f922000f040 con 0x7f92280687a0 2024-09-13T02:59:54.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.177+0000 7f921ffff700 1 -- 172.21.15.98:0/1343090436 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92200146b0 con 0x7f92280687a0 2024-09-13T02:59:54.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.177+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922819afb0 con 0x7f92280687a0 2024-09-13T02:59:54.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.178+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9228108750 con 0x7f92280687a0 2024-09-13T02:59:54.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.178+0000 7f921ffff700 1 -- 172.21.15.98:0/1343090436 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9220007500 con 0x7f92280687a0 2024-09-13T02:59:54.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.179+0000 7f921ffff700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f921406e680 0x7f9214070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:54.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.179+0000 7f921ffff700 1 -- 172.21.15.98:0/1343090436 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f922008e8f0 con 0x7f92280687a0 2024-09-13T02:59:54.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.179+0000 7f92267fc700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f921406e680 0x7f9214070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:54.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.179+0000 7f92267fc700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f921406e680 0x7f9214070b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92100059d0 tx=0x7f9210005940 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:54.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.183+0000 7f921ffff700 1 -- 172.21.15.98:0/1343090436 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9220057b90 con 0x7f92280687a0 2024-09-13T02:59:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:53 smithi142 ceph-mon[65447]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:53 smithi142 ceph-mon[65447]: pgmap v112: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-09-13T02:59:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:53 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/44896878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:54.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.404+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f922819b1d0 con 0x7f921406e680 2024-09-13T02:59:54.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.405+0000 7f921ffff700 1 -- 172.21.15.98:0/1343090436 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f922819b1d0 con 0x7f921406e680 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T02:59:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "10/23 daemons upgraded", 2024-09-13T02:59:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:59:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T02:59:54.408 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T02:59:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f921406e680 msgr2=0x7f9214070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f921406e680 0x7f9214070b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92100059d0 tx=0x7f9210005940 comp rx=0 tx=0).stop 2024-09-13T02:59:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92280687a0 msgr2=0x7f9228195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92280687a0 0x7f9228195e60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f922000ef10 tx=0x7f922000c3a0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 shutdown_connections 2024-09-13T02:59:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f921406e680 0x7f9214070b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92280687a0 0x7f9228195e60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 --2- 172.21.15.98:0/1343090436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228069140 0x7f92281963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 >> 172.21.15.98:0/1343090436 conn(0x7f9228075130 msgr2=0x7f9228104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:54.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 shutdown_connections 2024-09-13T02:59:54.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.408+0000 7f922d752700 1 -- 172.21.15.98:0/1343090436 wait complete. 2024-09-13T02:59:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.512+0000 7fb472472700 1 -- 172.21.15.98:0/972366500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ffd60 msgr2=0x7fb46c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.512+0000 7fb472472700 1 --2- 172.21.15.98:0/972366500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ffd60 0x7fb46c103d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb454009910 tx=0x7fb454009c20 comp rx=0 tx=0).stop 2024-09-13T02:59:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.512+0000 7fb472472700 1 -- 172.21.15.98:0/972366500 shutdown_connections 2024-09-13T02:59:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.512+0000 7fb472472700 1 --2- 172.21.15.98:0/972366500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ffd60 0x7fb46c103d30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.512+0000 7fb472472700 1 --2- 172.21.15.98:0/972366500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ff3c0 0x7fb46c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.512+0000 7fb472472700 1 -- 172.21.15.98:0/972366500 >> 172.21.15.98:0/972366500 conn(0x7fb46c0fac80 msgr2=0x7fb46c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.512+0000 7fb472472700 1 -- 172.21.15.98:0/972366500 shutdown_connections 2024-09-13T02:59:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.512+0000 7fb472472700 1 -- 172.21.15.98:0/972366500 wait complete. 2024-09-13T02:59:54.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb472472700 1 Processor -- start 2024-09-13T02:59:54.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb472472700 1 -- start start 2024-09-13T02:59:54.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb472472700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ff3c0 0x7fb46c195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:54.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb472472700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ffd60 0x7fb46c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:54.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb472472700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c196ac0 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb472472700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c19a850 con 0x7fb46c0ffd60 2024-09-13T02:59:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb46bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ff3c0 0x7fb46c195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb46bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ff3c0 0x7fb46c195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45960/0 (socket says 172.21.15.98:45960) 2024-09-13T02:59:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb46bfff700 1 -- 172.21.15.98:0/4178320851 learned_addr learned my addr 172.21.15.98:0/4178320851 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T02:59:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.513+0000 7fb46b7fe700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ffd60 0x7fb46c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.514+0000 7fb46bfff700 1 -- 172.21.15.98:0/4178320851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ffd60 msgr2=0x7fb46c1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.514+0000 7fb46bfff700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ffd60 0x7fb46c1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.514+0000 7fb46bfff700 1 -- 172.21.15.98:0/4178320851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540095f0 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.514+0000 7fb46bfff700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ff3c0 0x7fb46c195ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00d8d0 tx=0x7fb45c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:54.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.514+0000 7fb4697fa700 1 -- 172.21.15.98:0/4178320851 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45c009940 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.514+0000 7fb4697fa700 1 -- 172.21.15.98:0/4178320851 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb45c010460 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.514+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c19ab30 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.514+0000 7fb4697fa700 1 -- 172.21.15.98:0/4178320851 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45c00f5f0 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.514+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c19b080 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.515+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c04f2a0 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.515+0000 7fb4697fa700 1 -- 172.21.15.98:0/4178320851 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb45c0105d0 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.516+0000 7fb4697fa700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb45806e680 0x7fb458070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:54.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.516+0000 7fb46b7fe700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb45806e680 0x7fb458070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:54.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.516+0000 7fb4697fa700 1 -- 172.21.15.98:0/4178320851 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb45c08e470 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.516+0000 7fb46b7fe700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb45806e680 0x7fb458070b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb46c1974c0 tx=0x7fb45401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:54.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.520+0000 7fb4697fa700 1 -- 172.21.15.98:0/4178320851 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb45c057790 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.807+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb46c197200 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.807+0000 7fb4697fa700 1 -- 172.21.15.98:0/4178320851 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1461 (secure 0 0 0) 0x7fb45c0165d0 con 0x7fb46c0ff3c0 2024-09-13T02:59:54.809 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded 2024-09-13T02:59:54.809 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: osd.3 (root=default,host=smithi142) is down 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-13T02:59:54.810 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-13T02:59:54.811 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-13T02:59:54.811 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-13T02:59:54.811 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-13T02:59:54.811 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-13T02:59:54.811 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-13T02:59:54.811 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-13T02:59:54.811 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-13T02:59:54.811 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-13T02:59:54.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb45806e680 msgr2=0x7fb458070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb45806e680 0x7fb458070b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb46c1974c0 tx=0x7fb45401a040 comp rx=0 tx=0).stop 2024-09-13T02:59:54.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ff3c0 msgr2=0x7fb46c195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:54.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ff3c0 0x7fb46c195ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00d8d0 tx=0x7fb45c00dc90 comp rx=0 tx=0).stop 2024-09-13T02:59:54.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 shutdown_connections 2024-09-13T02:59:54.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb45806e680 0x7fb458070b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb46c0ff3c0 0x7fb46c195ea0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 --2- 172.21.15.98:0/4178320851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ffd60 0x7fb46c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:54.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 >> 172.21.15.98:0/4178320851 conn(0x7fb46c0fac80 msgr2=0x7fb46c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:54.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 shutdown_connections 2024-09-13T02:59:54.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T02:59:54.810+0000 7fb472472700 1 -- 172.21.15.98:0/4178320851 wait complete. 2024-09-13T02:59:55.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:54 smithi098 ceph-mon[87325]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:55.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:54 smithi098 ceph-mon[87325]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:55.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:54 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3473236242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:59:55.118 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:54 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/4178320851' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:55.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:54 smithi142 ceph-mon[65447]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:55.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:54 smithi142 ceph-mon[65447]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:55.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:54 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3473236242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:59:55.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:54 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/4178320851' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:56.152 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[75368]: 2024-09-13T02:59:55.824+0000 7faa2a8de640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-13T02:59:56.152 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:56.152 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: pgmap v113: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-09-13T02:59:56.152 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:56.152 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:56.152 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:56.152 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:59:56.153 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:56.153 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:56.153 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:56.153 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:56.153 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:56.153 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: pgmap v113: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/267 objects degraded (22.097%) 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:56.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:56.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:56.752 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:56 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[75368]: 2024-09-13T02:59:56.150+0000 7faa2a8de640 -1 osd.3 64 log_to_monitors true 2024-09-13T02:59:57.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:56 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:57.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:56 smithi098 ceph-mon[87325]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T02:59:57.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:56 smithi098 ceph-mon[87325]: from='osd.3 [v2:172.21.15.142:6800/1053868764,v1:172.21.15.142:6801/1053868764]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:59:57.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:56 smithi098 ceph-mon[87325]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:59:57.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:56 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:57.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:56 smithi142 ceph-mon[65447]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T02:59:57.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:56 smithi142 ceph-mon[65447]: from='osd.3 [v2:172.21.15.142:6800/1053868764,v1:172.21.15.142:6801/1053868764]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:59:57.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:56 smithi142 ceph-mon[65447]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:59:57.985 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 02:59:57 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[75368]: 2024-09-13T02:59:57.668+0000 7faa1e670640 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:59:57.986 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:57 smithi142 ceph-mon[65447]: pgmap v114: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 59/267 objects degraded (22.097%) 2024-09-13T02:59:57.986 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:57 smithi142 ceph-mon[65447]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:59:57.986 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:57 smithi142 ceph-mon[65447]: from='osd.3 [v2:172.21.15.142:6800/1053868764,v1:172.21.15.142:6801/1053868764]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:59:57.986 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:57 smithi142 ceph-mon[65447]: osdmap e67: 6 total, 5 up, 6 in 2024-09-13T02:59:57.986 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:57 smithi142 ceph-mon[65447]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:59:57.986 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:57 smithi142 ceph-mon[65447]: from='osd.3 ' entity='osd.3' 2024-09-13T02:59:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:57 smithi098 ceph-mon[87325]: pgmap v114: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 59/267 objects degraded (22.097%) 2024-09-13T02:59:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:57 smithi098 ceph-mon[87325]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:59:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:57 smithi098 ceph-mon[87325]: from='osd.3 [v2:172.21.15.142:6800/1053868764,v1:172.21.15.142:6801/1053868764]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:59:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:57 smithi098 ceph-mon[87325]: osdmap e67: 6 total, 5 up, 6 in 2024-09-13T02:59:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:57 smithi098 ceph-mon[87325]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T02:59:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:57 smithi098 ceph-mon[87325]: from='osd.3 ' entity='osd.3' 2024-09-13T02:59:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:58 smithi098 ceph-mon[87325]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:59:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:58 smithi098 ceph-mon[87325]: osd.3 [v2:172.21.15.142:6800/1053868764,v1:172.21.15.142:6801/1053868764] boot 2024-09-13T02:59:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:58 smithi098 ceph-mon[87325]: osdmap e68: 6 total, 6 up, 6 in 2024-09-13T02:59:59.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:59:59.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:58 smithi142 ceph-mon[65447]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:59:59.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:58 smithi142 ceph-mon[65447]: osd.3 [v2:172.21.15.142:6800/1053868764,v1:172.21.15.142:6801/1053868764] boot 2024-09-13T02:59:59.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:58 smithi142 ceph-mon[65447]: osdmap e68: 6 total, 6 up, 6 in 2024-09-13T02:59:59.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:58 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T03:00:00.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:59 smithi098 ceph-mon[87325]: pgmap v117: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 59/267 objects degraded (22.097%) 2024-09-13T03:00:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 02:59:59 smithi098 ceph-mon[87325]: osdmap e69: 6 total, 6 up, 6 in 2024-09-13T03:00:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:59 smithi142 ceph-mon[65447]: pgmap v117: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 59/267 objects degraded (22.097%) 2024-09-13T03:00:00.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 02:59:59 smithi142 ceph-mon[65447]: osdmap e69: 6 total, 6 up, 6 in 2024-09-13T03:00:01.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded 2024-09-13T03:00:01.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:00:01.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:00:01.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: [WRN] PG_DEGRADED: Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:01.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-13T03:00:01.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-13T03:00:01.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-13T03:00:01.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-13T03:00:01.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:00 smithi098 ceph-mon[87325]: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: [WRN] PG_DEGRADED: Degraded data redundancy: 59/267 objects degraded (22.097%), 18 pgs degraded 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-13T03:00:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-13T03:00:01.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:00 smithi142 ceph-mon[65447]: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-13T03:00:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:01 smithi098 ceph-mon[87325]: pgmap v119: 65 pgs: 14 active+undersized, 16 active+undersized+degraded, 35 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/267 objects degraded (18.727%) 2024-09-13T03:00:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:01 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 50/267 objects degraded (18.727%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:01 smithi142 ceph-mon[65447]: pgmap v119: 65 pgs: 14 active+undersized, 16 active+undersized+degraded, 35 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 50/267 objects degraded (18.727%) 2024-09-13T03:00:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:01 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 50/267 objects degraded (18.727%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:03 smithi098 ceph-mon[87325]: pgmap v120: 65 pgs: 3 active+undersized, 4 active+undersized+degraded, 58 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 14/267 objects degraded (5.243%) 2024-09-13T03:00:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:03 smithi142 ceph-mon[65447]: pgmap v120: 65 pgs: 3 active+undersized, 4 active+undersized+degraded, 58 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 14/267 objects degraded (5.243%) 2024-09-13T03:00:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:04 smithi098 ceph-mon[87325]: pgmap v121: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 652 B/s rd, 1 op/s 2024-09-13T03:00:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:04 smithi098 ceph-mon[87325]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/267 objects degraded (5.243%), 4 pgs degraded) 2024-09-13T03:00:05.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:04 smithi142 ceph-mon[65447]: pgmap v121: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 652 B/s rd, 1 op/s 2024-09-13T03:00:05.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:04 smithi142 ceph-mon[65447]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/267 objects degraded (5.243%), 4 pgs degraded) 2024-09-13T03:00:08.167 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:07 smithi098 ceph-mon[87325]: pgmap v122: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 635 B/s rd, 1 op/s 2024-09-13T03:00:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:07 smithi142 ceph-mon[65447]: pgmap v122: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 635 B/s rd, 1 op/s 2024-09-13T03:00:10.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:09 smithi098 ceph-mon[87325]: pgmap v123: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T03:00:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:09 smithi142 ceph-mon[65447]: pgmap v123: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T03:00:11.155 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:10 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T03:00:11.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:10 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T03:00:12.058 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:11 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T03:00:12.058 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:11 smithi142 ceph-mon[65447]: Upgrade: osd.4 is safe to restart 2024-09-13T03:00:12.058 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:11 smithi142 ceph-mon[65447]: pgmap v124: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 926 B/s rd, 1 op/s 2024-09-13T03:00:12.059 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:11 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:12.059 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:11 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T03:00:12.059 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:11 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:12.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:11 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T03:00:12.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:11 smithi098 ceph-mon[87325]: Upgrade: osd.4 is safe to restart 2024-09-13T03:00:12.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:11 smithi098 ceph-mon[87325]: pgmap v124: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 926 B/s rd, 1 op/s 2024-09-13T03:00:12.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:11 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:12.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:11 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T03:00:12.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:11 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:13.092 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:12 smithi142 ceph-mon[65447]: Upgrade: Updating osd.4 2024-09-13T03:00:13.093 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:12 smithi142 ceph-mon[65447]: Deploying daemon osd.4 on smithi142 2024-09-13T03:00:13.225 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:12 smithi098 ceph-mon[87325]: Upgrade: Updating osd.4 2024-09-13T03:00:13.226 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:12 smithi098 ceph-mon[87325]: Deploying daemon osd.4 on smithi142 2024-09-13T03:00:14.124 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:13 smithi142 ceph-mon[65447]: pgmap v125: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:00:14.125 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:13 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:14.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:13 smithi098 ceph-mon[87325]: pgmap v125: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:00:14.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:13 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:14.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:14 smithi142 systemd[1]: Stopping Ceph osd.4 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:00:15.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:14 smithi142 ceph-mon[65447]: osd.4 marked itself down and dead 2024-09-13T03:00:15.002 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:14 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[43929]: 2024-09-13T03:00:14.612+0000 7fb089ac0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:00:15.002 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:14 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[43929]: 2024-09-13T03:00:14.612+0000 7fb089ac0700 -1 osd.4 69 *** Got signal Terminated *** 2024-09-13T03:00:15.002 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:14 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[43929]: 2024-09-13T03:00:14.612+0000 7fb089ac0700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:00:15.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:14 smithi098 ceph-mon[87325]: osd.4 marked itself down and dead 2024-09-13T03:00:15.640 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:15 smithi142 podman[79939]: 2024-09-13 03:00:15.386098482 +0000 UTC m=+0.902325647 container died a7209462d32513110762e002c1526989ac03511c591761652ac9ead1391fc0bc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212) 2024-09-13T03:00:16.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:15 smithi142 ceph-mon[65447]: pgmap v126: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:00:16.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:15 smithi142 ceph-mon[65447]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T03:00:16.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:15 smithi142 ceph-mon[65447]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T03:00:16.002 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:15 smithi142 podman[79939]: 2024-09-13 03:00:15.746148001 +0000 UTC m=+1.262375169 container cleanup a7209462d32513110762e002c1526989ac03511c591761652ac9ead1391fc0bc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, ceph=True) 2024-09-13T03:00:16.002 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:15 smithi142 bash[79939]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4 2024-09-13T03:00:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:15 smithi098 ceph-mon[87325]: pgmap v126: 65 pgs: 65 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:00:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:15 smithi098 ceph-mon[87325]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T03:00:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:15 smithi098 ceph-mon[87325]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T03:00:16.359 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:16 smithi142 podman[79964]: 2024-09-13 03:00:16.031005962 +0000 UTC m=+0.641810855 container remove a7209462d32513110762e002c1526989ac03511c591761652ac9ead1391fc0bc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=HEAD, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0) 2024-09-13T03:00:16.646 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:16 smithi142 podman[80055]: 2024-09-13 03:00:16.358568136 +0000 UTC m=+0.111579812 container create 6a73a42d5dae1eb123f9db9986ca851e6845918b60c537bc6126cd5e3deb26eb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T03:00:16.646 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:16 smithi142 podman[80055]: 2024-09-13 03:00:16.262812031 +0000 UTC m=+0.015823708 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:16.646 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:16 smithi142 podman[80055]: 2024-09-13 03:00:16.592848338 +0000 UTC m=+0.345860028 container init 6a73a42d5dae1eb123f9db9986ca851e6845918b60c537bc6126cd5e3deb26eb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-7741f7f) 2024-09-13T03:00:16.647 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:16 smithi142 podman[80055]: 2024-09-13 03:00:16.596659859 +0000 UTC m=+0.349671549 container start 6a73a42d5dae1eb123f9db9986ca851e6845918b60c537bc6126cd5e3deb26eb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T03:00:17.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:16 smithi142 ceph-mon[65447]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T03:00:17.002 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:16 smithi142 podman[80055]: 2024-09-13 03:00:16.68408562 +0000 UTC m=+0.437097311 container attach 6a73a42d5dae1eb123f9db9986ca851e6845918b60c537bc6126cd5e3deb26eb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True) 2024-09-13T03:00:17.002 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:16 smithi142 podman[80055]: 2024-09-13 03:00:16.799322282 +0000 UTC m=+0.552333958 container died 6a73a42d5dae1eb123f9db9986ca851e6845918b60c537bc6126cd5e3deb26eb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T03:00:17.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:16 smithi098 ceph-mon[87325]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T03:00:17.752 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:17 smithi142 podman[80079]: 2024-09-13 03:00:17.395648613 +0000 UTC m=+0.586792807 container remove 6a73a42d5dae1eb123f9db9986ca851e6845918b60c537bc6126cd5e3deb26eb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS) 2024-09-13T03:00:17.752 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:17 smithi142 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T03:00:17.752 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:17 smithi142 systemd[1]: Stopped Ceph osd.4 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T03:00:17.752 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:17 smithi142 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.4.service: Consumed 52.292s CPU time. 2024-09-13T03:00:17.752 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:17 smithi142 systemd[1]: Starting Ceph osd.4 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:00:18.100 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:17 smithi142 ceph-mon[65447]: pgmap v129: 65 pgs: 2 active+undersized, 5 stale+active+clean, 58 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-13T03:00:18.100 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:17 smithi142 podman[80180]: 2024-09-13 03:00:17.729513961 +0000 UTC m=+0.015425976 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:18.100 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:17 smithi142 podman[80180]: 2024-09-13 03:00:17.872001036 +0000 UTC m=+0.157913038 container create 9e135c549e0ca5c18ef11bd79b2def8f2e9d51d2e419d891edf199fe33c3d8b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:00:18.100 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 podman[80180]: 2024-09-13 03:00:18.099560583 +0000 UTC m=+0.385472585 container init 9e135c549e0ca5c18ef11bd79b2def8f2e9d51d2e419d891edf199fe33c3d8b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T03:00:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:17 smithi098 ceph-mon[87325]: pgmap v129: 65 pgs: 2 active+undersized, 5 stale+active+clean, 58 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-13T03:00:18.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 podman[80180]: 2024-09-13 03:00:18.102916715 +0000 UTC m=+0.388828718 container start 9e135c549e0ca5c18ef11bd79b2def8f2e9d51d2e419d891edf199fe33c3d8b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T03:00:18.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 podman[80180]: 2024-09-13 03:00:18.191041099 +0000 UTC m=+0.476953106 container attach 9e135c549e0ca5c18ef11bd79b2def8f2e9d51d2e419d891edf199fe33c3d8b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:00:18.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate[80195]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:18.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 bash[80180]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:18.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate[80195]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:18.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 bash[80180]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:19.251 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate[80195]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T03:00:19.252 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 bash[80180]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T03:00:19.252 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate[80195]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T03:00:19.252 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:18 smithi142 bash[80180]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T03:00:19.589 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate[80195]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T03:00:19.589 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 bash[80180]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T03:00:19.589 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate[80195]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T03:00:19.589 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 bash[80180]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T03:00:19.589 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate[80195]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T03:00:19.589 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 bash[80180]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T03:00:19.589 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate[80195]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T03:00:19.589 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 bash[80180]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T03:00:19.590 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate[80195]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T03:00:19.590 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 bash[80180]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T03:00:19.590 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 podman[80180]: 2024-09-13 03:00:19.287855296 +0000 UTC m=+1.573767309 container died 9e135c549e0ca5c18ef11bd79b2def8f2e9d51d2e419d891edf199fe33c3d8b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f) 2024-09-13T03:00:19.862 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:19 smithi142 ceph-mon[65447]: pgmap v130: 65 pgs: 16 active+undersized, 1 stale+active+clean, 13 active+undersized+degraded, 35 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 39/267 objects degraded (14.607%) 2024-09-13T03:00:19.862 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:19.862 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:19.862 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:19 smithi142 ceph-mon[65447]: Health check failed: Degraded data redundancy: 39/267 objects degraded (14.607%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:20.180 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:19 smithi142 podman[80340]: 2024-09-13 03:00:19.861110477 +0000 UTC m=+0.562223243 container remove 9e135c549e0ca5c18ef11bd79b2def8f2e9d51d2e419d891edf199fe33c3d8b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T03:00:20.180 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:20 smithi142 podman[80399]: 2024-09-13 03:00:19.973432536 +0000 UTC m=+0.016067020 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:20.180 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:20 smithi142 podman[80399]: 2024-09-13 03:00:20.078529623 +0000 UTC m=+0.121164107 container create 087c65ddb960db597c489550967b795e8ca2143de1dfe80e2a2e6d131b8f8493 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-13T03:00:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:19 smithi098 ceph-mon[87325]: pgmap v130: 65 pgs: 16 active+undersized, 1 stale+active+clean, 13 active+undersized+degraded, 35 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 39/267 objects degraded (14.607%) 2024-09-13T03:00:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:19 smithi098 ceph-mon[87325]: Health check failed: Degraded data redundancy: 39/267 objects degraded (14.607%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:20.751 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:20 smithi142 podman[80399]: 2024-09-13 03:00:20.281052141 +0000 UTC m=+0.323686638 container init 087c65ddb960db597c489550967b795e8ca2143de1dfe80e2a2e6d131b8f8493 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:00:20.752 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:20 smithi142 podman[80399]: 2024-09-13 03:00:20.284139106 +0000 UTC m=+0.326773594 container start 087c65ddb960db597c489550967b795e8ca2143de1dfe80e2a2e6d131b8f8493 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4, ceph=True, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:00:20.752 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:20 smithi142 ceph-osd[80418]: -- 172.21.15.142:0/1341132019 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef81e561e0 con 0x55ef81dec000 2024-09-13T03:00:20.752 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:20 smithi142 bash[80399]: 087c65ddb960db597c489550967b795e8ca2143de1dfe80e2a2e6d131b8f8493 2024-09-13T03:00:20.752 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:20 smithi142 systemd[1]: Started Ceph osd.4 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T03:00:21.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:21 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:21.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:21 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:21.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:21 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:21.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:21 smithi142 ceph-mon[65447]: pgmap v131: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/267 objects degraded (17.228%) 2024-09-13T03:00:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:21 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:21 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:21 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:21.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:21 smithi098 ceph-mon[87325]: pgmap v131: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/267 objects degraded (17.228%) 2024-09-13T03:00:22.254 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:22 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:00:22.181+0000 7fa460a62640 -1 Falling back to public interface 2024-09-13T03:00:24.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:23 smithi098 ceph-mon[87325]: pgmap v132: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:24.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:24.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:24.238 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:23 smithi142 ceph-mon[65447]: pgmap v132: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:24.238 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:24.238 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 -- 172.21.15.98:0/931174577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 msgr2=0x7f66f4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 --2- 172.21.15.98:0/931174577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 0x7f66f4103d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009910 tx=0x7f66dc009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 -- 172.21.15.98:0/931174577 shutdown_connections 2024-09-13T03:00:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 --2- 172.21.15.98:0/931174577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 0x7f66f4103d30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 --2- 172.21.15.98:0/931174577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66f40ff3c0 0x7f66f40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 -- 172.21.15.98:0/931174577 >> 172.21.15.98:0/931174577 conn(0x7f66f40fac80 msgr2=0x7f66f40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:24.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 -- 172.21.15.98:0/931174577 shutdown_connections 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 -- 172.21.15.98:0/931174577 wait complete. 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 Processor -- start 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.922+0000 7f66f8bf6700 1 -- start start 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f8bf6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66f40ff3c0 0x7f66f4196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f8bf6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 0x7f66f41972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f8bf6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41978e0 con 0x7f66f40ffd60 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f8bf6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f4197a20 con 0x7f66f40ff3c0 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 0x7f66f41972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 0x7f66f41972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37798/0 (socket says 172.21.15.98:37798) 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f1d9b700 1 -- 172.21.15.98:0/4165750939 learned_addr learned my addr 172.21.15.98:0/4165750939 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f259c700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66f40ff3c0 0x7f66f4196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f1d9b700 1 -- 172.21.15.98:0/4165750939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66f40ff3c0 msgr2=0x7f66f4196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:24.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f1d9b700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66f40ff3c0 0x7f66f4196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:24.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f1d9b700 1 -- 172.21.15.98:0/4165750939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0095f0 con 0x7f66f40ffd60 2024-09-13T03:00:24.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f259c700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66f40ff3c0 0x7f66f4196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:00:24.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f1d9b700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 0x7f66f41972c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00bda0 tx=0x7f66dc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:24.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66eb7fe700 1 -- 172.21.15.98:0/4165750939 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66dc01d070 con 0x7f66f40ffd60 2024-09-13T03:00:24.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66eb7fe700 1 -- 172.21.15.98:0/4165750939 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66dc00f460 con 0x7f66f40ffd60 2024-09-13T03:00:24.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66eb7fe700 1 -- 172.21.15.98:0/4165750939 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66dc017630 con 0x7f66f40ffd60 2024-09-13T03:00:24.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.923+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f419fdf0 con 0x7f66f40ffd60 2024-09-13T03:00:24.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.924+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41a0200 con 0x7f66f40ffd60 2024-09-13T03:00:24.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.924+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f4107730 con 0x7f66f40ffd60 2024-09-13T03:00:24.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.925+0000 7f66eb7fe700 1 -- 172.21.15.98:0/4165750939 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f66dc00fa40 con 0x7f66f40ffd60 2024-09-13T03:00:24.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.925+0000 7f66eb7fe700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f66e006e680 0x7f66e0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:24.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.926+0000 7f66eb7fe700 1 -- 172.21.15.98:0/4165750939 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f66dc08fa00 con 0x7f66f40ffd60 2024-09-13T03:00:24.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.926+0000 7f66f259c700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f66e006e680 0x7f66e0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:24.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.926+0000 7f66f259c700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f66e006e680 0x7f66e0070b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f66ec005fd0 tx=0x7f66ec005ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:24.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:24.930+0000 7f66eb7fe700 1 -- 172.21.15.98:0/4165750939 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f66dc058ca0 con 0x7f66f40ffd60 2024-09-13T03:00:25.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:24 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:25.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:24 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:25.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.151+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66f4061190 con 0x7f66e006e680 2024-09-13T03:00:25.152 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:24 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:25.153 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:24 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:25.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.152+0000 7f66eb7fe700 1 -- 172.21.15.98:0/4165750939 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f66f4061190 con 0x7f66e006e680 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f66e006e680 msgr2=0x7f66e0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f66e006e680 0x7f66e0070b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f66ec005fd0 tx=0x7f66ec005ee0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 msgr2=0x7f66f41972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 0x7f66f41972c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00bda0 tx=0x7f66dc00be80 comp rx=0 tx=0).stop 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 shutdown_connections 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f66e006e680 0x7f66e0070b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66f40ff3c0 0x7f66f4196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 --2- 172.21.15.98:0/4165750939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66f40ffd60 0x7f66f41972c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 >> 172.21.15.98:0/4165750939 conn(0x7f66f40fac80 msgr2=0x7f66f40fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:25.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 shutdown_connections 2024-09-13T03:00:25.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.154+0000 7f66f8bf6700 1 -- 172.21.15.98:0/4165750939 wait complete. 2024-09-13T03:00:25.166 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T03:00:25.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.260+0000 7fd2db705700 1 -- 172.21.15.98:0/3655340616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d4069140 msgr2=0x7fd2d4104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.260+0000 7fd2db705700 1 --2- 172.21.15.98:0/3655340616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d4069140 0x7fd2d4104eb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4009910 tx=0x7fd2c4009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:25.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.260+0000 7fd2db705700 1 -- 172.21.15.98:0/3655340616 shutdown_connections 2024-09-13T03:00:25.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.260+0000 7fd2db705700 1 --2- 172.21.15.98:0/3655340616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d4069140 0x7fd2d4104eb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.260+0000 7fd2db705700 1 --2- 172.21.15.98:0/3655340616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2d40687a0 0x7fd2d4068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.260+0000 7fd2db705700 1 -- 172.21.15.98:0/3655340616 >> 172.21.15.98:0/3655340616 conn(0x7fd2d4075130 msgr2=0x7fd2d4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:25.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.260+0000 7fd2db705700 1 -- 172.21.15.98:0/3655340616 shutdown_connections 2024-09-13T03:00:25.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.260+0000 7fd2db705700 1 -- 172.21.15.98:0/3655340616 wait complete. 2024-09-13T03:00:25.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2db705700 1 Processor -- start 2024-09-13T03:00:25.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2db705700 1 -- start start 2024-09-13T03:00:25.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2db705700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d40687a0 0x7fd2d4195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:25.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2db705700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2d4069140 0x7fd2d41963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:25.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2db705700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4196a80 con 0x7fd2d40687a0 2024-09-13T03:00:25.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2db705700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d419a810 con 0x7fd2d4069140 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2d94a1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d40687a0 0x7fd2d4195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2d94a1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d40687a0 0x7fd2d4195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37810/0 (socket says 172.21.15.98:37810) 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2d94a1700 1 -- 172.21.15.98:0/3475606220 learned_addr learned my addr 172.21.15.98:0/3475606220 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2d8ca0700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2d4069140 0x7fd2d41963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2d94a1700 1 -- 172.21.15.98:0/3475606220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2d4069140 msgr2=0x7fd2d41963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2d94a1700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2d4069140 0x7fd2d41963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2d94a1700 1 -- 172.21.15.98:0/3475606220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40095f0 con 0x7fd2d40687a0 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.261+0000 7fd2d94a1700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d40687a0 0x7fd2d4195e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000ada0 tx=0x7fd2d000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.262+0000 7fd2ca7fc700 1 -- 172.21.15.98:0/3475606220 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2d000f070 con 0x7fd2d40687a0 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.262+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d419aaf0 con 0x7fd2d40687a0 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.262+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d419b010 con 0x7fd2d40687a0 2024-09-13T03:00:25.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.262+0000 7fd2ca7fc700 1 -- 172.21.15.98:0/3475606220 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2d000ae90 con 0x7fd2d40687a0 2024-09-13T03:00:25.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.262+0000 7fd2ca7fc700 1 -- 172.21.15.98:0/3475606220 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2d0005690 con 0x7fd2d40687a0 2024-09-13T03:00:25.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.262+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b8005320 con 0x7fd2d40687a0 2024-09-13T03:00:25.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.263+0000 7fd2ca7fc700 1 -- 172.21.15.98:0/3475606220 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd2d0004e80 con 0x7fd2d40687a0 2024-09-13T03:00:25.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.263+0000 7fd2ca7fc700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd2c006e680 0x7fd2c0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:25.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.264+0000 7fd2ca7fc700 1 -- 172.21.15.98:0/3475606220 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd2d008dd90 con 0x7fd2d40687a0 2024-09-13T03:00:25.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.264+0000 7fd2d8ca0700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd2c006e680 0x7fd2c0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:25.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.264+0000 7fd2d8ca0700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd2c006e680 0x7fd2c0070b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4006010 tx=0x7fd2c401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:25.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.268+0000 7fd2ca7fc700 1 -- 172.21.15.98:0/3475606220 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd2d00570b0 con 0x7fd2d40687a0 2024-09-13T03:00:25.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.490+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2b8000bf0 con 0x7fd2c006e680 2024-09-13T03:00:25.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.491+0000 7fd2ca7fc700 1 -- 172.21.15.98:0/3475606220 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd2b8000bf0 con 0x7fd2c006e680 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd2c006e680 msgr2=0x7fd2c0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd2c006e680 0x7fd2c0070b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4006010 tx=0x7fd2c401a040 comp rx=0 tx=0).stop 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d40687a0 msgr2=0x7fd2d4195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d40687a0 0x7fd2d4195e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000ada0 tx=0x7fd2d000c330 comp rx=0 tx=0).stop 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 shutdown_connections 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd2c006e680 0x7fd2c0070b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2d40687a0 0x7fd2d4195e60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 --2- 172.21.15.98:0/3475606220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2d4069140 0x7fd2d41963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 >> 172.21.15.98:0/3475606220 conn(0x7fd2d4075130 msgr2=0x7fd2d4104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:25.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 shutdown_connections 2024-09-13T03:00:25.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.493+0000 7fd2db705700 1 -- 172.21.15.98:0/3475606220 wait complete. 2024-09-13T03:00:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.598+0000 7fa8de253700 1 -- 172.21.15.98:0/3210967263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100d70 msgr2=0x7fa8d81094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.598+0000 7fa8de253700 1 --2- 172.21.15.98:0/3210967263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100d70 0x7fa8d81094d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009910 tx=0x7fa8cc009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.598+0000 7fa8de253700 1 -- 172.21.15.98:0/3210967263 shutdown_connections 2024-09-13T03:00:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.598+0000 7fa8de253700 1 --2- 172.21.15.98:0/3210967263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100d70 0x7fa8d81094d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.598+0000 7fa8de253700 1 --2- 172.21.15.98:0/3210967263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8100460 0x7fa8d8100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.598+0000 7fa8de253700 1 -- 172.21.15.98:0/3210967263 >> 172.21.15.98:0/3210967263 conn(0x7fa8d80748b0 msgr2=0x7fa8d8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.598+0000 7fa8de253700 1 -- 172.21.15.98:0/3210967263 shutdown_connections 2024-09-13T03:00:25.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.598+0000 7fa8de253700 1 -- 172.21.15.98:0/3210967263 wait complete. 2024-09-13T03:00:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8de253700 1 Processor -- start 2024-09-13T03:00:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8de253700 1 -- start start 2024-09-13T03:00:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8de253700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100460 0x7fa8d8195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8de253700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8100d70 0x7fa8d8196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8de253700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8196b60 con 0x7fa8d8100460 2024-09-13T03:00:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8de253700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d819a8f0 con 0x7fa8d8100d70 2024-09-13T03:00:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8d77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100460 0x7fa8d8195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8d77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100460 0x7fa8d8195f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37826/0 (socket says 172.21.15.98:37826) 2024-09-13T03:00:25.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8d77fe700 1 -- 172.21.15.98:0/2110416280 learned_addr learned my addr 172.21.15.98:0/2110416280 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8d6ffd700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8100d70 0x7fa8d8196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8d77fe700 1 -- 172.21.15.98:0/2110416280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8100d70 msgr2=0x7fa8d8196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8d77fe700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8100d70 0x7fa8d8196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.599+0000 7fa8d77fe700 1 -- 172.21.15.98:0/2110416280 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0095f0 con 0x7fa8d8100460 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.600+0000 7fa8d77fe700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100460 0x7fa8d8195f40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800d8d0 tx=0x7fa8c800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.600+0000 7fa8d4ff9700 1 -- 172.21.15.98:0/2110416280 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8c80098a0 con 0x7fa8d8100460 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.600+0000 7fa8d4ff9700 1 -- 172.21.15.98:0/2110416280 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8c8010460 con 0x7fa8d8100460 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.600+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d819abd0 con 0x7fa8d8100460 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.600+0000 7fa8d4ff9700 1 -- 172.21.15.98:0/2110416280 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8c800f5f0 con 0x7fa8d8100460 2024-09-13T03:00:25.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.600+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d819b120 con 0x7fa8d8100460 2024-09-13T03:00:25.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.601+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d8107e40 con 0x7fa8d8100460 2024-09-13T03:00:25.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.601+0000 7fa8d4ff9700 1 -- 172.21.15.98:0/2110416280 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa8c8009a00 con 0x7fa8d8100460 2024-09-13T03:00:25.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.602+0000 7fa8d4ff9700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa8c006e680 0x7fa8c0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:25.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.602+0000 7fa8d6ffd700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa8c006e680 0x7fa8c0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:25.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.602+0000 7fa8d4ff9700 1 -- 172.21.15.98:0/2110416280 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa8c808e330 con 0x7fa8d8100460 2024-09-13T03:00:25.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.602+0000 7fa8d6ffd700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa8c006e680 0x7fa8c0070b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8197560 tx=0x7fa8cc01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:25.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.606+0000 7fa8d4ff9700 1 -- 172.21.15.98:0/2110416280 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa8c8057650 con 0x7fa8d8100460 2024-09-13T03:00:25.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.819+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8d81973b0 con 0x7fa8c006e680 2024-09-13T03:00:25.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.828+0000 7fa8d4ff9700 1 -- 172.21.15.98:0/2110416280 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa8d81973b0 con 0x7fa8c006e680 2024-09-13T03:00:25.830 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:00:25.830 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (5m) 67s ago 15m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T03:00:25.830 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (16m) 67s ago 16m 8694k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T03:00:25.830 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (15m) 2s ago 15m 8178k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T03:00:25.830 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (2m) 67s ago 16m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T03:00:25.830 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (2m) 2s ago 15m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T03:00:25.830 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (4m) 67s ago 15m 80.3M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (10m) 67s ago 10m 93.9M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (10m) 67s ago 10m 152M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (10m) 2s ago 10m 16.9M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (10m) 2s ago 10m 20.3M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (7m) 67s ago 17m 500M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (6m) 2s ago 14m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (3m) 67s ago 17m 49.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (3m) 2s ago 14m 40.2M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (6m) 67s ago 16m 16.2M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (5m) 2s ago 15m 14.9M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (2m) 67s ago 14m 92.8M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T03:00:25.831 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (106s) 67s ago 13m 85.1M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T03:00:25.832 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (72s) 67s ago 13m 14.4M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 04c10c8159ba 2024-09-13T03:00:25.832 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (37s) 2s ago 12m 98.3M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 322e0a9d6b20 2024-09-13T03:00:25.832 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (5s) 2s ago 12m 14.5M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 087c65ddb960 2024-09-13T03:00:25.832 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (11m) 2s ago 11m 197M 2240M 18.2.0 dc2bc1663786 5c985f043acb 2024-09-13T03:00:25.832 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (5m) 67s ago 15m 78.7M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa8c006e680 msgr2=0x7fa8c0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa8c006e680 0x7fa8c0070b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8197560 tx=0x7fa8cc01a040 comp rx=0 tx=0).stop 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100460 msgr2=0x7fa8d8195f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100460 0x7fa8d8195f40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800d8d0 tx=0x7fa8c800dbe0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 shutdown_connections 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa8c006e680 0x7fa8c0070b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8d8100460 0x7fa8d8195f40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 --2- 172.21.15.98:0/2110416280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8d8100d70 0x7fa8d8196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 >> 172.21.15.98:0/2110416280 conn(0x7fa8d80748b0 msgr2=0x7fa8d80fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 shutdown_connections 2024-09-13T03:00:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.831+0000 7fa8de253700 1 -- 172.21.15.98:0/2110416280 wait complete. 2024-09-13T03:00:25.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.935+0000 7f4b585e4700 1 -- 172.21.15.98:0/1483881114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 msgr2=0x7f4b5010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.935+0000 7f4b585e4700 1 --2- 172.21.15.98:0/1483881114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 0x7f4b5010a6d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009910 tx=0x7f4b40009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:25.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.935+0000 7f4b585e4700 1 -- 172.21.15.98:0/1483881114 shutdown_connections 2024-09-13T03:00:25.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.935+0000 7f4b585e4700 1 --2- 172.21.15.98:0/1483881114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 0x7f4b5010a6d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.935+0000 7f4b585e4700 1 --2- 172.21.15.98:0/1483881114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b500ff350 0x7f4b500ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.935+0000 7f4b585e4700 1 -- 172.21.15.98:0/1483881114 >> 172.21.15.98:0/1483881114 conn(0x7f4b500748b0 msgr2=0x7f4b50074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:25.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.936+0000 7f4b585e4700 1 -- 172.21.15.98:0/1483881114 shutdown_connections 2024-09-13T03:00:25.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.936+0000 7f4b585e4700 1 -- 172.21.15.98:0/1483881114 wait complete. 2024-09-13T03:00:25.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.936+0000 7f4b585e4700 1 Processor -- start 2024-09-13T03:00:25.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.936+0000 7f4b585e4700 1 -- start start 2024-09-13T03:00:25.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.936+0000 7f4b585e4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b500ff350 0x7f4b50195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:25.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.936+0000 7f4b585e4700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 0x7f4b501963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:25.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.936+0000 7f4b585e4700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b50196a30 con 0x7f4b500ffc60 2024-09-13T03:00:25.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.936+0000 7f4b585e4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b50196b70 con 0x7f4b500ff350 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b55b7f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 0x7f4b501963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b56380700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b500ff350 0x7f4b50195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b55b7f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 0x7f4b501963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37838/0 (socket says 172.21.15.98:37838) 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b55b7f700 1 -- 172.21.15.98:0/1571709324 learned_addr learned my addr 172.21.15.98:0/1571709324 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b55b7f700 1 -- 172.21.15.98:0/1571709324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b500ff350 msgr2=0x7f4b50195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b55b7f700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b500ff350 0x7f4b50195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b55b7f700 1 -- 172.21.15.98:0/1571709324 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b400095f0 con 0x7f4b500ffc60 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b55b7f700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 0x7f4b501963e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b40006010 tx=0x7f4b400055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b477fe700 1 -- 172.21.15.98:0/1571709324 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b4001d070 con 0x7f4b500ffc60 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b477fe700 1 -- 172.21.15.98:0/1571709324 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b40005dc0 con 0x7f4b500ffc60 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5019a950 con 0x7f4b500ffc60 2024-09-13T03:00:25.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b477fe700 1 -- 172.21.15.98:0/1571709324 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b40021410 con 0x7f4b500ffc60 2024-09-13T03:00:25.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.937+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5019aea0 con 0x7f4b500ffc60 2024-09-13T03:00:25.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.938+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b50107dd0 con 0x7f4b500ffc60 2024-09-13T03:00:25.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.939+0000 7f4b477fe700 1 -- 172.21.15.98:0/1571709324 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4b4000f460 con 0x7f4b500ffc60 2024-09-13T03:00:25.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.939+0000 7f4b477fe700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4b3c06e680 0x7f4b3c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:25.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.939+0000 7f4b477fe700 1 -- 172.21.15.98:0/1571709324 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f4b4008f7f0 con 0x7f4b500ffc60 2024-09-13T03:00:25.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.939+0000 7f4b56380700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4b3c06e680 0x7f4b3c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:25.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.940+0000 7f4b56380700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4b3c06e680 0x7f4b3c070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00ac50 tx=0x7f4b4c00a380 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:25.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:25.944+0000 7f4b477fe700 1 -- 172.21.15.98:0/1571709324 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b40058a90 con 0x7f4b500ffc60 2024-09-13T03:00:26.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:25 smithi142 ceph-mon[65447]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 206 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:26.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.230+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b50197200 con 0x7f4b500ffc60 2024-09-13T03:00:26.232 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:25 smithi098 ceph-mon[87325]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 206 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:26.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.231+0000 7f4b477fe700 1 -- 172.21.15.98:0/1571709324 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f4b4005c150 con 0x7f4b500ffc60 2024-09-13T03:00:26.233 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:00:26.233 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T03:00:26.233 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:26.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:00:26.233 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T03:00:26.233 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:26.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:00:26.233 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 8 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T03:00:26.234 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:00:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4b3c06e680 msgr2=0x7f4b3c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4b3c06e680 0x7f4b3c070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00ac50 tx=0x7f4b4c00a380 comp rx=0 tx=0).stop 2024-09-13T03:00:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 msgr2=0x7f4b501963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 0x7f4b501963e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b40006010 tx=0x7f4b400055f0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 shutdown_connections 2024-09-13T03:00:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4b3c06e680 0x7f4b3c070b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b500ff350 0x7f4b50195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 --2- 172.21.15.98:0/1571709324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b500ffc60 0x7f4b501963e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 >> 172.21.15.98:0/1571709324 conn(0x7f4b500748b0 msgr2=0x7f4b50104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:26.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 shutdown_connections 2024-09-13T03:00:26.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.233+0000 7f4b585e4700 1 -- 172.21.15.98:0/1571709324 wait complete. 2024-09-13T03:00:26.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.337+0000 7fdbf45dd700 1 -- 172.21.15.98:0/4182979913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101410 msgr2=0x7fdbec1017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.337+0000 7fdbf45dd700 1 --2- 172.21.15.98:0/4182979913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101410 0x7fdbec1017e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400b0a0 tx=0x7fdbe400b3b0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.337+0000 7fdbf45dd700 1 -- 172.21.15.98:0/4182979913 shutdown_connections 2024-09-13T03:00:26.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.337+0000 7fdbf45dd700 1 --2- 172.21.15.98:0/4182979913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbec101d20 0x7fdbec10a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.337+0000 7fdbf45dd700 1 --2- 172.21.15.98:0/4182979913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101410 0x7fdbec1017e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.337+0000 7fdbf45dd700 1 -- 172.21.15.98:0/4182979913 >> 172.21.15.98:0/4182979913 conn(0x7fdbec0fac90 msgr2=0x7fdbec0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:26.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.337+0000 7fdbf45dd700 1 -- 172.21.15.98:0/4182979913 shutdown_connections 2024-09-13T03:00:26.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.337+0000 7fdbf45dd700 1 -- 172.21.15.98:0/4182979913 wait complete. 2024-09-13T03:00:26.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf45dd700 1 Processor -- start 2024-09-13T03:00:26.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf45dd700 1 -- start start 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf45dd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbec101410 0x7fdbec0ff070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf45dd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101d20 0x7fdbec0ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf45dd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0ffaf0 con 0x7fdbec101d20 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf45dd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0ffc30 con 0x7fdbec101410 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf1b78700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101d20 0x7fdbec0ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf1b78700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101d20 0x7fdbec0ff5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37854/0 (socket says 172.21.15.98:37854) 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf1b78700 1 -- 172.21.15.98:0/3502333433 learned_addr learned my addr 172.21.15.98:0/3502333433 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf2379700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbec101410 0x7fdbec0ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf1b78700 1 -- 172.21.15.98:0/3502333433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbec101410 msgr2=0x7fdbec0ff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf1b78700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbec101410 0x7fdbec0ff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf1b78700 1 -- 172.21.15.98:0/3502333433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4009d00 con 0x7fdbec101d20 2024-09-13T03:00:26.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.338+0000 7fdbf1b78700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101d20 0x7fdbec0ff5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000e920 tx=0x7fdbe000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:26.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.339+0000 7fdbeb7fe700 1 -- 172.21.15.98:0/3502333433 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe000c9d0 con 0x7fdbec101d20 2024-09-13T03:00:26.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.339+0000 7fdbeb7fe700 1 -- 172.21.15.98:0/3502333433 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbe0010430 con 0x7fdbec101d20 2024-09-13T03:00:26.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.339+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec1a2090 con 0x7fdbec101d20 2024-09-13T03:00:26.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.339+0000 7fdbeb7fe700 1 -- 172.21.15.98:0/3502333433 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe0018630 con 0x7fdbec101d20 2024-09-13T03:00:26.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.339+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec1a24a0 con 0x7fdbec101d20 2024-09-13T03:00:26.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.339+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec1078f0 con 0x7fdbec101d20 2024-09-13T03:00:26.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.340+0000 7fdbeb7fe700 1 -- 172.21.15.98:0/3502333433 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdbe00105a0 con 0x7fdbec101d20 2024-09-13T03:00:26.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.340+0000 7fdbeb7fe700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdbd406e680 0x7fdbd4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:26.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.341+0000 7fdbf2379700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdbd406e680 0x7fdbd4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:26.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.341+0000 7fdbeb7fe700 1 -- 172.21.15.98:0/3502333433 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fdbe0014070 con 0x7fdbec101d20 2024-09-13T03:00:26.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.341+0000 7fdbf2379700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdbd406e680 0x7fdbd4070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4000f80 tx=0x7fdbe40061f0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:26.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.345+0000 7fdbeb7fe700 1 -- 172.21.15.98:0/3502333433 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdbe00541b0 con 0x7fdbec101d20 2024-09-13T03:00:26.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.591+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdbec100640 con 0x7fdbec101d20 2024-09-13T03:00:26.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.592+0000 7fdbeb7fe700 1 -- 172.21.15.98:0/3502333433 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1941 (secure 0 0 0) 0x7fdbe0057a80 con 0x7fdbec101d20 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T03:00:26.594 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:00:26.595 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T03:00:26.596 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 0 members: 2024-09-13T03:00:26.597 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:26.597 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:00:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:00:26.597 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T03:00:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:00:26.597 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:26.597 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:26.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdbd406e680 msgr2=0x7fdbd4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdbd406e680 0x7fdbd4070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4000f80 tx=0x7fdbe40061f0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101d20 msgr2=0x7fdbec0ff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101d20 0x7fdbec0ff5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000e920 tx=0x7fdbe000ec30 comp rx=0 tx=0).stop 2024-09-13T03:00:26.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 shutdown_connections 2024-09-13T03:00:26.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdbd406e680 0x7fdbd4070b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbec101410 0x7fdbec0ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 --2- 172.21.15.98:0/3502333433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbec101d20 0x7fdbec0ff5b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 >> 172.21.15.98:0/3502333433 conn(0x7fdbec0fac90 msgr2=0x7fdbec104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:26.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 shutdown_connections 2024-09-13T03:00:26.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.594+0000 7fdbf45dd700 1 -- 172.21.15.98:0/3502333433 wait complete. 2024-09-13T03:00:26.599 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T03:00:26.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.700+0000 7f2c7b95b700 1 -- 172.21.15.98:0/648460031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101d30 msgr2=0x7f2c7410a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.700+0000 7f2c7b95b700 1 --2- 172.21.15.98:0/648460031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101d30 0x7f2c7410a230 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009910 tx=0x7f2c60009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:26.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.700+0000 7f2c7b95b700 1 -- 172.21.15.98:0/648460031 shutdown_connections 2024-09-13T03:00:26.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.700+0000 7f2c7b95b700 1 --2- 172.21.15.98:0/648460031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101d30 0x7f2c7410a230 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.700+0000 7f2c7b95b700 1 --2- 172.21.15.98:0/648460031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c74101420 0x7f2c741017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.700+0000 7f2c7b95b700 1 -- 172.21.15.98:0/648460031 >> 172.21.15.98:0/648460031 conn(0x7f2c740fac60 msgr2=0x7f2c740fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:26.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.700+0000 7f2c7b95b700 1 -- 172.21.15.98:0/648460031 shutdown_connections 2024-09-13T03:00:26.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.700+0000 7f2c7b95b700 1 -- 172.21.15.98:0/648460031 wait complete. 2024-09-13T03:00:26.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c7b95b700 1 Processor -- start 2024-09-13T03:00:26.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c7b95b700 1 -- start start 2024-09-13T03:00:26.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c7b95b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101420 0x7f2c740ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:26.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c7b95b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c74101d30 0x7f2c740ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:26.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c7b95b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740ffb00 con 0x7f2c74101420 2024-09-13T03:00:26.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c7b95b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740ffc40 con 0x7f2c74101d30 2024-09-13T03:00:26.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c796f7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101420 0x7f2c740ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:26.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c796f7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101420 0x7f2c740ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37866/0 (socket says 172.21.15.98:37866) 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c796f7700 1 -- 172.21.15.98:0/1833754199 learned_addr learned my addr 172.21.15.98:0/1833754199 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c796f7700 1 -- 172.21.15.98:0/1833754199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c74101d30 msgr2=0x7f2c740ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c796f7700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c74101d30 0x7f2c740ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.701+0000 7f2c796f7700 1 -- 172.21.15.98:0/1833754199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c600095f0 con 0x7f2c74101420 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.702+0000 7f2c796f7700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101420 0x7f2c740ff080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800ba50 tx=0x7f2c6800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.702+0000 7f2c727fc700 1 -- 172.21.15.98:0/1833754199 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c6800ca00 con 0x7f2c74101420 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.702+0000 7f2c727fc700 1 -- 172.21.15.98:0/1833754199 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c6800cb60 con 0x7f2c74101420 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.702+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c741a21d0 con 0x7f2c74101420 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.702+0000 7f2c727fc700 1 -- 172.21.15.98:0/1833754199 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c680075a0 con 0x7f2c74101420 2024-09-13T03:00:26.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.702+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c741a25e0 con 0x7f2c74101420 2024-09-13T03:00:26.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.703+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c741078a0 con 0x7f2c74101420 2024-09-13T03:00:26.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.703+0000 7f2c727fc700 1 -- 172.21.15.98:0/1833754199 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2c6800ccd0 con 0x7f2c74101420 2024-09-13T03:00:26.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.704+0000 7f2c727fc700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2c6406e680 0x7f2c64070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:26.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.704+0000 7f2c727fc700 1 -- 172.21.15.98:0/1833754199 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2c68006e40 con 0x7f2c74101420 2024-09-13T03:00:26.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.704+0000 7f2c78ef6700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2c6406e680 0x7f2c64070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:26.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.704+0000 7f2c78ef6700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2c6406e680 0x7f2c64070b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2c60006010 tx=0x7f2c6000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:26.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.708+0000 7f2c727fc700 1 -- 172.21.15.98:0/1833754199 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2c68057050 con 0x7f2c74101420 2024-09-13T03:00:26.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.932+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c74061190 con 0x7f2c6406e680 2024-09-13T03:00:26.934 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:26 smithi098 ceph-mon[87325]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:26.934 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:26 smithi098 ceph-mon[87325]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:26.934 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:26 smithi098 ceph-mon[87325]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:26.934 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:26 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1571709324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:26.934 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:26 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3502333433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:26.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.933+0000 7f2c727fc700 1 -- 172.21.15.98:0/1833754199 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2c74061190 con 0x7f2c6406e680 2024-09-13T03:00:26.935 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:00:26.935 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:00:26.935 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T03:00:26.935 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:00:26.935 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T03:00:26.935 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T03:00:26.935 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-13T03:00:26.935 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T03:00:26.936 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T03:00:26.936 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "11/23 daemons upgraded", 2024-09-13T03:00:26.936 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T03:00:26.936 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T03:00:26.936 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:00:26.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.935+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2c6406e680 msgr2=0x7f2c64070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.935+0000 7f2c7b95b700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2c6406e680 0x7f2c64070b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2c60006010 tx=0x7f2c6000b540 comp rx=0 tx=0).stop 2024-09-13T03:00:26.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.935+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101420 msgr2=0x7f2c740ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:26.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.935+0000 7f2c7b95b700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101420 0x7f2c740ff080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800ba50 tx=0x7f2c6800be10 comp rx=0 tx=0).stop 2024-09-13T03:00:26.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.935+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 shutdown_connections 2024-09-13T03:00:26.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.935+0000 7f2c7b95b700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2c6406e680 0x7f2c64070b30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.935+0000 7f2c7b95b700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c74101420 0x7f2c740ff080 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.935+0000 7f2c7b95b700 1 --2- 172.21.15.98:0/1833754199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c74101d30 0x7f2c740ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:26.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.935+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 >> 172.21.15.98:0/1833754199 conn(0x7f2c740fac60 msgr2=0x7f2c741049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:26.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.936+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 shutdown_connections 2024-09-13T03:00:26.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:26.936+0000 7f2c7b95b700 1 -- 172.21.15.98:0/1833754199 wait complete. 2024-09-13T03:00:27.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:26 smithi142 ceph-mon[65447]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:27.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:26 smithi142 ceph-mon[65447]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:26 smithi142 ceph-mon[65447]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:26 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1571709324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:27.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:26 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3502333433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:27.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.040+0000 7efeb1e8f700 1 -- 172.21.15.98:0/3683837048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac1004e0 msgr2=0x7efeac1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:27.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.040+0000 7efeb1e8f700 1 --2- 172.21.15.98:0/3683837048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac1004e0 0x7efeac1008b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b0a0 tx=0x7efe9c00b3b0 comp rx=0 tx=0).stop 2024-09-13T03:00:27.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.041+0000 7efeb1e8f700 1 -- 172.21.15.98:0/3683837048 shutdown_connections 2024-09-13T03:00:27.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.041+0000 7efeb1e8f700 1 --2- 172.21.15.98:0/3683837048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeac100e80 0x7efeac104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:27.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.041+0000 7efeb1e8f700 1 --2- 172.21.15.98:0/3683837048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac1004e0 0x7efeac1008b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:27.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.041+0000 7efeb1e8f700 1 -- 172.21.15.98:0/3683837048 >> 172.21.15.98:0/3683837048 conn(0x7efeac0fbda0 msgr2=0x7efeac0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:27.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.041+0000 7efeb1e8f700 1 -- 172.21.15.98:0/3683837048 shutdown_connections 2024-09-13T03:00:27.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.041+0000 7efeb1e8f700 1 -- 172.21.15.98:0/3683837048 wait complete. 2024-09-13T03:00:27.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.041+0000 7efeb1e8f700 1 Processor -- start 2024-09-13T03:00:27.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.041+0000 7efeb1e8f700 1 -- start start 2024-09-13T03:00:27.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeb1e8f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeac1004e0 0x7efeac073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeb1e8f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac100e80 0x7efeac073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeb1e8f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac073ad0 con 0x7efeac100e80 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeb1e8f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac073c10 con 0x7efeac1004e0 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeaaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac100e80 0x7efeac073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeab7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeac1004e0 0x7efeac073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeaaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac100e80 0x7efeac073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37876/0 (socket says 172.21.15.98:37876) 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeaaffd700 1 -- 172.21.15.98:0/2698058822 learned_addr learned my addr 172.21.15.98:0/2698058822 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeaaffd700 1 -- 172.21.15.98:0/2698058822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeac1004e0 msgr2=0x7efeac073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeaaffd700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeac1004e0 0x7efeac073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeaaffd700 1 -- 172.21.15.98:0/2698058822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c009d00 con 0x7efeac100e80 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeaaffd700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac100e80 0x7efeac073590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe9400d8d0 tx=0x7efe9400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efea8ff9700 1 -- 172.21.15.98:0/2698058822 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe940041f0 con 0x7efeac100e80 2024-09-13T03:00:27.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efea8ff9700 1 -- 172.21.15.98:0/2698058822 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe94007620 con 0x7efeac100e80 2024-09-13T03:00:27.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac1a20c0 con 0x7efeac100e80 2024-09-13T03:00:27.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efea8ff9700 1 -- 172.21.15.98:0/2698058822 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe940056b0 con 0x7efeac100e80 2024-09-13T03:00:27.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.042+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac1a24d0 con 0x7efeac100e80 2024-09-13T03:00:27.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.043+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac1087f0 con 0x7efeac100e80 2024-09-13T03:00:27.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.044+0000 7efea8ff9700 1 -- 172.21.15.98:0/2698058822 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efe94004830 con 0x7efeac100e80 2024-09-13T03:00:27.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.044+0000 7efea8ff9700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efe9806e680 0x7efe98070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:27.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.044+0000 7efea8ff9700 1 -- 172.21.15.98:0/2698058822 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6070+0+0 (secure 0 0 0) 0x7efe9408e3a0 con 0x7efeac100e80 2024-09-13T03:00:27.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.044+0000 7efeab7fe700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efe9806e680 0x7efe98070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:27.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.045+0000 7efeab7fe700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efe9806e680 0x7efe98070b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe9c000f80 tx=0x7efe9c0060c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:27.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.049+0000 7efea8ff9700 1 -- 172.21.15.98:0/2698058822 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efe94057640 con 0x7efeac100e80 2024-09-13T03:00:27.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.358+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efeac1081d0 con 0x7efeac100e80 2024-09-13T03:00:27.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.359+0000 7efea8ff9700 1 -- 172.21.15.98:0/2698058822 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1296 (secure 0 0 0) 0x7efe9405ad00 con 0x7efeac100e80 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 46/267 objects degraded (17.228%), 15 pgs degraded 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout: osd.4 (root=default,host=smithi142) is down 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/267 objects degraded (17.228%), 15 pgs degraded 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-13T03:00:27.361 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-13T03:00:27.362 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-13T03:00:27.362 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-13T03:00:27.362 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-13T03:00:27.362 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-13T03:00:27.362 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-13T03:00:27.362 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-13T03:00:27.362 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-13T03:00:27.362 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-13T03:00:27.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.361+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efe9806e680 msgr2=0x7efe98070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:27.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.361+0000 7efeb1e8f700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efe9806e680 0x7efe98070b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe9c000f80 tx=0x7efe9c0060c0 comp rx=0 tx=0).stop 2024-09-13T03:00:27.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.361+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac100e80 msgr2=0x7efeac073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:27.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.362+0000 7efeb1e8f700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac100e80 0x7efeac073590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe9400d8d0 tx=0x7efe9400dbe0 comp rx=0 tx=0).stop 2024-09-13T03:00:27.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.362+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 shutdown_connections 2024-09-13T03:00:27.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.362+0000 7efeb1e8f700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efe9806e680 0x7efe98070b30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:27.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.362+0000 7efeb1e8f700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeac1004e0 0x7efeac073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:27.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.362+0000 7efeb1e8f700 1 --2- 172.21.15.98:0/2698058822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeac100e80 0x7efeac073590 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:27.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.362+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 >> 172.21.15.98:0/2698058822 conn(0x7efeac0fbda0 msgr2=0x7efeac0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:27.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.362+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 shutdown_connections 2024-09-13T03:00:27.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:27.362+0000 7efeb1e8f700 1 -- 172.21.15.98:0/2698058822 wait complete. 2024-09-13T03:00:28.118 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:00:27.795+0000 7fa460a62640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-13T03:00:28.118 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: pgmap v134: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 187 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:28.118 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2698058822' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:00:28.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:27 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 46/267 objects degraded (17.228%), 15 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: pgmap v134: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 187 B/s rd, 0 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2698058822' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:00:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:27 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 46/267 objects degraded (17.228%), 15 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:28 smithi098 ceph-mon[87325]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:28 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:28 smithi098 ceph-mon[87325]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T03:00:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:28 smithi098 ceph-mon[87325]: from='osd.4 [v2:172.21.15.142:6808/1073100241,v1:172.21.15.142:6809/1073100241]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T03:00:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:28 smithi098 ceph-mon[87325]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T03:00:29.251 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:28 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:00:28.116+0000 7fa460a62640 -1 osd.4 69 log_to_monitors true 2024-09-13T03:00:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:28 smithi142 ceph-mon[65447]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:28 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:28 smithi142 ceph-mon[65447]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T03:00:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:28 smithi142 ceph-mon[65447]: from='osd.4 [v2:172.21.15.142:6808/1073100241,v1:172.21.15.142:6809/1073100241]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T03:00:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:28 smithi142 ceph-mon[65447]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T03:00:30.001 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:00:29 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:00:29.645+0000 7fa4547f4640 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T03:00:30.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:29 smithi142 ceph-mon[65447]: pgmap v135: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 597 B/s rd, 1 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:30.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:29 smithi142 ceph-mon[65447]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T03:00:30.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:29 smithi142 ceph-mon[65447]: osdmap e72: 6 total, 5 up, 6 in 2024-09-13T03:00:30.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:29 smithi142 ceph-mon[65447]: from='osd.4 [v2:172.21.15.142:6808/1073100241,v1:172.21.15.142:6809/1073100241]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T03:00:30.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:29 smithi142 ceph-mon[65447]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T03:00:30.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:29 smithi142 ceph-mon[65447]: from='osd.4 ' entity='osd.4' 2024-09-13T03:00:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:29 smithi098 ceph-mon[87325]: pgmap v135: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 597 B/s rd, 1 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:29 smithi098 ceph-mon[87325]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T03:00:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:29 smithi098 ceph-mon[87325]: osdmap e72: 6 total, 5 up, 6 in 2024-09-13T03:00:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:29 smithi098 ceph-mon[87325]: from='osd.4 [v2:172.21.15.142:6808/1073100241,v1:172.21.15.142:6809/1073100241]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T03:00:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:29 smithi098 ceph-mon[87325]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T03:00:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:29 smithi098 ceph-mon[87325]: from='osd.4 ' entity='osd.4' 2024-09-13T03:00:31.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:30 smithi098 ceph-mon[87325]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T03:00:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:30 smithi098 ceph-mon[87325]: osd.4 [v2:172.21.15.142:6808/1073100241,v1:172.21.15.142:6809/1073100241] boot 2024-09-13T03:00:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:30 smithi098 ceph-mon[87325]: osdmap e73: 6 total, 6 up, 6 in 2024-09-13T03:00:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:30 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T03:00:31.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:30 smithi142 ceph-mon[65447]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T03:00:31.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:30 smithi142 ceph-mon[65447]: osd.4 [v2:172.21.15.142:6808/1073100241,v1:172.21.15.142:6809/1073100241] boot 2024-09-13T03:00:31.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:30 smithi142 ceph-mon[65447]: osdmap e73: 6 total, 6 up, 6 in 2024-09-13T03:00:31.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:30 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T03:00:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:31 smithi098 ceph-mon[87325]: pgmap v138: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:31 smithi098 ceph-mon[87325]: osdmap e74: 6 total, 6 up, 6 in 2024-09-13T03:00:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:31 smithi142 ceph-mon[65447]: pgmap v138: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 46/267 objects degraded (17.228%) 2024-09-13T03:00:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:31 smithi142 ceph-mon[65447]: osdmap e74: 6 total, 6 up, 6 in 2024-09-13T03:00:33.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:32 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 17/267 objects degraded (6.367%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:33.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:32 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 17/267 objects degraded (6.367%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:33 smithi098 ceph-mon[87325]: pgmap v140: 65 pgs: 1 peering, 10 active+undersized, 7 active+undersized+degraded, 47 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 17/267 objects degraded (6.367%) 2024-09-13T03:00:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:33 smithi142 ceph-mon[65447]: pgmap v140: 65 pgs: 1 peering, 10 active+undersized, 7 active+undersized+degraded, 47 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 17/267 objects degraded (6.367%) 2024-09-13T03:00:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:35.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:34 smithi098 ceph-mon[87325]: pgmap v141: 65 pgs: 1 peering, 64 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 0 op/s 2024-09-13T03:00:35.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:34 smithi098 ceph-mon[87325]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/267 objects degraded (6.367%), 7 pgs degraded) 2024-09-13T03:00:35.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:34 smithi142 ceph-mon[65447]: pgmap v141: 65 pgs: 1 peering, 64 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 0 op/s 2024-09-13T03:00:35.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:34 smithi142 ceph-mon[65447]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/267 objects degraded (6.367%), 7 pgs degraded) 2024-09-13T03:00:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:37 smithi098 ceph-mon[87325]: pgmap v142: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 259 B/s rd, 0 op/s 2024-09-13T03:00:38.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:37 smithi142 ceph-mon[65447]: pgmap v142: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 259 B/s rd, 0 op/s 2024-09-13T03:00:40.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:39 smithi098 ceph-mon[87325]: pgmap v143: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 885 B/s rd, 1 op/s 2024-09-13T03:00:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:39 smithi142 ceph-mon[65447]: pgmap v143: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 885 B/s rd, 1 op/s 2024-09-13T03:00:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:41 smithi098 ceph-mon[87325]: pgmap v144: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s 2024-09-13T03:00:42.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:41 smithi142 ceph-mon[65447]: pgmap v144: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s 2024-09-13T03:00:42.961 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:42 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:43.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:42 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:43 smithi098 ceph-mon[87325]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:43 smithi098 ceph-mon[87325]: Upgrade: osd.5 is safe to restart 2024-09-13T03:00:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:43 smithi098 ceph-mon[87325]: pgmap v145: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-13T03:00:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T03:00:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:43.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:44.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:43 smithi142 ceph-mon[65447]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:44.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:43 smithi142 ceph-mon[65447]: Upgrade: osd.5 is safe to restart 2024-09-13T03:00:44.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:43 smithi142 ceph-mon[65447]: pgmap v145: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-13T03:00:44.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:44.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T03:00:44.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:44.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:44.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:44 smithi142 ceph-mon[65447]: Upgrade: Updating osd.5 2024-09-13T03:00:44.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:44 smithi142 ceph-mon[65447]: Deploying daemon osd.5 on smithi142 2024-09-13T03:00:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:44 smithi098 ceph-mon[87325]: Upgrade: Updating osd.5 2024-09-13T03:00:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:44 smithi098 ceph-mon[87325]: Deploying daemon osd.5 on smithi142 2024-09-13T03:00:46.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:45 smithi142 ceph-mon[65447]: pgmap v146: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:00:46.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:45 smithi098 ceph-mon[87325]: pgmap v146: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:00:46.826 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:46 smithi142 systemd[1]: Stopping Ceph osd.5 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:00:47.251 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:46 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[48554]: 2024-09-13T03:00:46.835+0000 7f10cafbc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:00:47.252 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:46 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[48554]: 2024-09-13T03:00:46.835+0000 7f10cafbc700 -1 osd.5 74 *** Got signal Terminated *** 2024-09-13T03:00:47.252 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:46 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[48554]: 2024-09-13T03:00:46.835+0000 7f10cafbc700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:00:48.237 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:47 smithi098 ceph-mon[87325]: pgmap v147: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:00:48.237 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:47 smithi098 ceph-mon[87325]: osd.5 marked itself down and dead 2024-09-13T03:00:48.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:47 smithi142 ceph-mon[65447]: pgmap v147: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:00:48.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:47 smithi142 ceph-mon[65447]: osd.5 marked itself down and dead 2024-09-13T03:00:48.637 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:48 smithi142 podman[84977]: 2024-09-13 03:00:48.323450021 +0000 UTC m=+1.594508798 container died 5c985f043acb1de5b737814806ce60c718611ccdf48248ca1aa1e996178a7c8d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T03:00:48.971 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:48 smithi142 podman[84977]: 2024-09-13 03:00:48.743844377 +0000 UTC m=+2.014903159 container cleanup 5c985f043acb1de5b737814806ce60c718611ccdf48248ca1aa1e996178a7c8d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-13T03:00:48.971 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:48 smithi142 bash[84977]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 5]}]: dispatch 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [3, 5]}]: dispatch 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 5]}]: dispatch 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [0, 1]}]: dispatch 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 5]}]: dispatch 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 5]}]: dispatch 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 5]}]: dispatch 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]: dispatch 2024-09-13T03:00:48.972 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 5]}]: dispatch 2024-09-13T03:00:48.973 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 2]}]: dispatch 2024-09-13T03:00:48.973 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:48.973 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 5]}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [3, 5]}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 5]}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [0, 1]}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 5]}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 5]}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 5]}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 5]}]: dispatch 2024-09-13T03:00:48.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 2]}]: dispatch 2024-09-13T03:00:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:48.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:49.251 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:48 smithi142 podman[85003]: 2024-09-13 03:00:48.970282056 +0000 UTC m=+0.640813525 container remove 5c985f043acb1de5b737814806ce60c718611ccdf48248ca1aa1e996178a7c8d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T03:00:49.657 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:49 smithi142 podman[85091]: 2024-09-13 03:00:49.272624844 +0000 UTC m=+0.016427182 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:49.657 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:49 smithi142 podman[85091]: 2024-09-13 03:00:49.370974349 +0000 UTC m=+0.114776676 container create 6535477a44f677d819d97b7dbc20e6bd06c9704de1dbd291739e3dc4ca62e753 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T03:00:49.657 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:49 smithi142 podman[85091]: 2024-09-13 03:00:49.573435401 +0000 UTC m=+0.317237727 container init 6535477a44f677d819d97b7dbc20e6bd06c9704de1dbd291739e3dc4ca62e753 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:00:49.657 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:49 smithi142 podman[85091]: 2024-09-13 03:00:49.576678855 +0000 UTC m=+0.320481194 container start 6535477a44f677d819d97b7dbc20e6bd06c9704de1dbd291739e3dc4ca62e753 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f) 2024-09-13T03:00:49.657 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:49 smithi142 podman[85091]: 2024-09-13 03:00:49.656546295 +0000 UTC m=+0.400348623 container attach 6535477a44f677d819d97b7dbc20e6bd06c9704de1dbd291739e3dc4ca62e753 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:00:50.001 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:49 smithi142 podman[85091]: 2024-09-13 03:00:49.764284593 +0000 UTC m=+0.508086922 container died 6535477a44f677d819d97b7dbc20e6bd06c9704de1dbd291739e3dc4ca62e753 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: pgmap v149: 65 pgs: 13 stale+active+clean, 52 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 5]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [3, 5]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 5]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [0, 1]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 5]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 5]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 5]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 5]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 2]}]': finished 2024-09-13T03:00:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:49 smithi142 ceph-mon[65447]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: pgmap v149: 65 pgs: 13 stale+active+clean, 52 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [3, 5]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.11", "id": [3, 5]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 5]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [0, 1]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.d", "id": [3, 5]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 5]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 5]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 5]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 2]}]': finished 2024-09-13T03:00:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:49 smithi098 ceph-mon[87325]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T03:00:50.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:50 smithi142 podman[85115]: 2024-09-13 03:00:50.368756591 +0000 UTC m=+0.595966240 container remove 6535477a44f677d819d97b7dbc20e6bd06c9704de1dbd291739e3dc4ca62e753 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:00:50.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:50 smithi142 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T03:00:50.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:50 smithi142 systemd[1]: Stopped Ceph osd.5 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T03:00:50.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:50 smithi142 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.5.service: Consumed 52.037s CPU time. 2024-09-13T03:00:50.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:50 smithi142 systemd[1]: Starting Ceph osd.5 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:00:51.106 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:50 smithi142 ceph-mon[65447]: osdmap e77: 6 total, 5 up, 6 in 2024-09-13T03:00:51.106 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:50 smithi142 ceph-mon[65447]: osdmap e78: 6 total, 5 up, 6 in 2024-09-13T03:00:51.106 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:50 smithi142 podman[85213]: 2024-09-13 03:00:50.794677039 +0000 UTC m=+0.111872880 container create 20170137faecd9fb9b99e2827ec4f991e0cbbbb22b817ded4c4f75fd3ed82aeb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:00:51.107 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:50 smithi142 podman[85213]: 2024-09-13 03:00:50.698557164 +0000 UTC m=+0.015753004 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:51.107 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 podman[85213]: 2024-09-13 03:00:51.013667302 +0000 UTC m=+0.330863153 container init 20170137faecd9fb9b99e2827ec4f991e0cbbbb22b817ded4c4f75fd3ed82aeb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T03:00:51.107 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 podman[85213]: 2024-09-13 03:00:51.017292469 +0000 UTC m=+0.334488310 container start 20170137faecd9fb9b99e2827ec4f991e0cbbbb22b817ded4c4f75fd3ed82aeb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:00:51.107 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 podman[85213]: 2024-09-13 03:00:51.105294766 +0000 UTC m=+0.422490619 container attach 20170137faecd9fb9b99e2827ec4f991e0cbbbb22b817ded4c4f75fd3ed82aeb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-13T03:00:51.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:50 smithi098 ceph-mon[87325]: osdmap e77: 6 total, 5 up, 6 in 2024-09-13T03:00:51.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:50 smithi098 ceph-mon[87325]: osdmap e78: 6 total, 5 up, 6 in 2024-09-13T03:00:51.501 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate[85228]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:51.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 bash[85213]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:51.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate[85228]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:51.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 bash[85213]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:52.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:51 smithi142 ceph-mon[65447]: pgmap v152: 65 pgs: 3 active+undersized, 3 unknown, 1 peering, 9 stale+active+clean, 3 active+undersized+degraded, 46 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 10/267 objects degraded (3.745%) 2024-09-13T03:00:52.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:51 smithi142 ceph-mon[65447]: Health check failed: Degraded data redundancy: 10/267 objects degraded (3.745%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:52.203 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate[85228]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T03:00:52.203 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 bash[85213]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T03:00:52.203 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate[85228]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T03:00:52.203 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:51 smithi142 bash[85213]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T03:00:52.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:51 smithi098 ceph-mon[87325]: pgmap v152: 65 pgs: 3 active+undersized, 3 unknown, 1 peering, 9 stale+active+clean, 3 active+undersized+degraded, 46 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 10/267 objects degraded (3.745%) 2024-09-13T03:00:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:51 smithi098 ceph-mon[87325]: Health check failed: Degraded data redundancy: 10/267 objects degraded (3.745%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate[85228]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 bash[85213]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate[85228]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 bash[85213]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate[85228]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 bash[85213]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate[85228]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 bash[85213]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate[85228]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 bash[85213]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T03:00:52.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 podman[85376]: 2024-09-13 03:00:52.254134611 +0000 UTC m=+0.016326115 container died 20170137faecd9fb9b99e2827ec4f991e0cbbbb22b817ded4c4f75fd3ed82aeb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T03:00:52.917 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:52 smithi142 ceph-mon[65447]: osdmap e79: 6 total, 5 up, 6 in 2024-09-13T03:00:53.135 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:52 smithi098 ceph-mon[87325]: osdmap e79: 6 total, 5 up, 6 in 2024-09-13T03:00:53.229 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:52 smithi142 podman[85376]: 2024-09-13 03:00:52.917101581 +0000 UTC m=+0.679293086 container remove 20170137faecd9fb9b99e2827ec4f991e0cbbbb22b817ded4c4f75fd3ed82aeb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-13T03:00:53.229 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:53 smithi142 podman[85434]: 2024-09-13 03:00:53.126575228 +0000 UTC m=+0.111887782 container create 31b09c7c1472c2edfe2cbae6e1469ababb79d83a23e7cfdd830671c0b2b65fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T03:00:53.229 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:53 smithi142 podman[85434]: 2024-09-13 03:00:53.030559486 +0000 UTC m=+0.015872003 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:53.751 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:53 smithi142 podman[85434]: 2024-09-13 03:00:53.362409094 +0000 UTC m=+0.347721603 container init 31b09c7c1472c2edfe2cbae6e1469ababb79d83a23e7cfdd830671c0b2b65fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T03:00:53.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:53 smithi142 podman[85434]: 2024-09-13 03:00:53.365580345 +0000 UTC m=+0.350892854 container start 31b09c7c1472c2edfe2cbae6e1469ababb79d83a23e7cfdd830671c0b2b65fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f) 2024-09-13T03:00:53.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:53 smithi142 ceph-osd[85453]: -- 172.21.15.142:0/4006210627 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55744319a1e0 con 0x557442347c00 2024-09-13T03:00:53.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:53 smithi142 bash[85434]: 31b09c7c1472c2edfe2cbae6e1469ababb79d83a23e7cfdd830671c0b2b65fbb 2024-09-13T03:00:53.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:53 smithi142 systemd[1]: Started Ceph osd.5 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T03:00:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:53 smithi098 ceph-mon[87325]: pgmap v155: 65 pgs: 3 active+clean+remapped, 13 active+undersized, 1 remapped+peering, 3 unknown, 1 peering, 1 stale+active+clean, 10 active+undersized+degraded, 33 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/267 objects degraded (13.109%); 2.0 MiB/s, 2 objects/s recovering 2024-09-13T03:00:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:53 smithi098 ceph-mon[87325]: osdmap e80: 6 total, 5 up, 6 in 2024-09-13T03:00:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:53.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:54.110 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:53 smithi142 ceph-mon[65447]: pgmap v155: 65 pgs: 3 active+clean+remapped, 13 active+undersized, 1 remapped+peering, 3 unknown, 1 peering, 1 stale+active+clean, 10 active+undersized+degraded, 33 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/267 objects degraded (13.109%); 2.0 MiB/s, 2 objects/s recovering 2024-09-13T03:00:54.110 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:53 smithi142 ceph-mon[65447]: osdmap e80: 6 total, 5 up, 6 in 2024-09-13T03:00:54.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:54.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:54.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:55.538 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:00:55 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:00:55.264+0000 7fa2b05d5640 -1 Falling back to public interface 2024-09-13T03:00:56.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:55 smithi098 ceph-mon[87325]: pgmap v157: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 1 remapped+peering, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 833 B/s rd, 1 op/s; 38/267 objects degraded (14.232%); 2/267 objects misplaced (0.749%); 1.6 MiB/s, 51 objects/s recovering 2024-09-13T03:00:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:55 smithi142 ceph-mon[65447]: pgmap v157: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 1 remapped+peering, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 833 B/s rd, 1 op/s; 38/267 objects degraded (14.232%); 2/267 objects misplaced (0.749%); 1.6 MiB/s, 51 objects/s recovering 2024-09-13T03:00:57.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:57 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:57.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:57 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:57.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:57 smithi142 ceph-mon[65447]: pgmap v158: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 1 remapped+peering, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 38/267 objects degraded (14.232%); 2/267 objects misplaced (0.749%); 1.3 MiB/s, 42 objects/s recovering 2024-09-13T03:00:57.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:57 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:57.294 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:57 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:57.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:57 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:57.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:57 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:57.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:57 smithi098 ceph-mon[87325]: pgmap v158: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 1 remapped+peering, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 38/267 objects degraded (14.232%); 2/267 objects misplaced (0.749%); 1.3 MiB/s, 42 objects/s recovering 2024-09-13T03:00:57.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:57 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:57.481 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:57 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:00:57.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.479+0000 7fbff62cd700 1 -- 172.21.15.98:0/1948633499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff0104130 msgr2=0x7fbff0104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:57.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.479+0000 7fbff62cd700 1 --2- 172.21.15.98:0/1948633499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff0104130 0x7fbff0104500 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009910 tx=0x7fbfe0009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:57.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.479+0000 7fbff62cd700 1 -- 172.21.15.98:0/1948633499 shutdown_connections 2024-09-13T03:00:57.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.479+0000 7fbff62cd700 1 --2- 172.21.15.98:0/1948633499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff00ffbd0 0x7fbff0100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.479+0000 7fbff62cd700 1 --2- 172.21.15.98:0/1948633499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff0104130 0x7fbff0104500 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.479+0000 7fbff62cd700 1 -- 172.21.15.98:0/1948633499 >> 172.21.15.98:0/1948633499 conn(0x7fbff0075130 msgr2=0x7fbff0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.479+0000 7fbff62cd700 1 -- 172.21.15.98:0/1948633499 shutdown_connections 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.479+0000 7fbff62cd700 1 -- 172.21.15.98:0/1948633499 wait complete. 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.480+0000 7fbff62cd700 1 Processor -- start 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.480+0000 7fbff62cd700 1 -- start start 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.480+0000 7fbff62cd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff00ffbd0 0x7fbff0100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.480+0000 7fbff62cd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0104130 0x7fbff0101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.480+0000 7fbff62cd700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0101940 con 0x7fbff00ffbd0 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.480+0000 7fbff62cd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0101ab0 con 0x7fbff0104130 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.480+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff00ffbd0 0x7fbff0100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:57.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.480+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff00ffbd0 0x7fbff0100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57128/0 (socket says 172.21.15.98:57128) 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbfeffff700 1 -- 172.21.15.98:0/3355857027 learned_addr learned my addr 172.21.15.98:0/3355857027 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbfef7fe700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0104130 0x7fbff0101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbfeffff700 1 -- 172.21.15.98:0/3355857027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0104130 msgr2=0x7fbff0101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbfeffff700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0104130 0x7fbff0101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbfeffff700 1 -- 172.21.15.98:0/3355857027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00095f0 con 0x7fbff00ffbd0 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbfeffff700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff00ffbd0 0x7fbff0100e30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000bd70 tx=0x7fbfe000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbfed7fa700 1 -- 172.21.15.98:0/3355857027 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe001d070 con 0x7fbff00ffbd0 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff01a21a0 con 0x7fbff00ffbd0 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbfed7fa700 1 -- 172.21.15.98:0/3355857027 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbfe000f460 con 0x7fbff00ffbd0 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbfed7fa700 1 -- 172.21.15.98:0/3355857027 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe0017630 con 0x7fbff00ffbd0 2024-09-13T03:00:57.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.481+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff01a2550 con 0x7fbff00ffbd0 2024-09-13T03:00:57.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.482+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff004f2a0 con 0x7fbff00ffbd0 2024-09-13T03:00:57.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.483+0000 7fbfed7fa700 1 -- 172.21.15.98:0/3355857027 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fbfe000f5d0 con 0x7fbff00ffbd0 2024-09-13T03:00:57.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.483+0000 7fbfed7fa700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbfdc06e680 0x7fbfdc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:57.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.483+0000 7fbfed7fa700 1 -- 172.21.15.98:0/3355857027 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6690+0+0 (secure 0 0 0) 0x7fbfe008fd20 con 0x7fbff00ffbd0 2024-09-13T03:00:57.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.483+0000 7fbfef7fe700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbfdc06e680 0x7fbfdc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:57.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.484+0000 7fbfef7fe700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbfdc06e680 0x7fbfdc070b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbff0102620 tx=0x7fbfd8009190 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:57.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.488+0000 7fbfed7fa700 1 -- 172.21.15.98:0/3355857027 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbfe0058d50 con 0x7fbff00ffbd0 2024-09-13T03:00:57.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.708+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbff0068540 con 0x7fbfdc06e680 2024-09-13T03:00:57.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.709+0000 7fbfed7fa700 1 -- 172.21.15.98:0/3355857027 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbff0068540 con 0x7fbfdc06e680 2024-09-13T03:00:57.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.711+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbfdc06e680 msgr2=0x7fbfdc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:57.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.711+0000 7fbff62cd700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbfdc06e680 0x7fbfdc070b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbff0102620 tx=0x7fbfd8009190 comp rx=0 tx=0).stop 2024-09-13T03:00:57.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.711+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff00ffbd0 msgr2=0x7fbff0100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:57.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.711+0000 7fbff62cd700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff00ffbd0 0x7fbff0100e30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000bd70 tx=0x7fbfe000bda0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.711+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 shutdown_connections 2024-09-13T03:00:57.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.711+0000 7fbff62cd700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fbfdc06e680 0x7fbfdc070b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.711+0000 7fbff62cd700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbff00ffbd0 0x7fbff0100e30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.711+0000 7fbff62cd700 1 --2- 172.21.15.98:0/3355857027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0104130 0x7fbff0101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.711+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 >> 172.21.15.98:0/3355857027 conn(0x7fbff0075130 msgr2=0x7fbff0109220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:57.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.712+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 shutdown_connections 2024-09-13T03:00:57.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.712+0000 7fbff62cd700 1 -- 172.21.15.98:0/3355857027 wait complete. 2024-09-13T03:00:57.723 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T03:00:57.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.818+0000 7fa4d5b41700 1 -- 172.21.15.98:0/512567877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 msgr2=0x7fa4d0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:57.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.818+0000 7fa4d5b41700 1 --2- 172.21.15.98:0/512567877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 0x7fa4d0103d30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009910 tx=0x7fa4c4009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:57.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.818+0000 7fa4d5b41700 1 -- 172.21.15.98:0/512567877 shutdown_connections 2024-09-13T03:00:57.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.818+0000 7fa4d5b41700 1 --2- 172.21.15.98:0/512567877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 0x7fa4d0103d30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.819+0000 7fa4d5b41700 1 --2- 172.21.15.98:0/512567877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d00ff3c0 0x7fa4d00ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.819+0000 7fa4d5b41700 1 -- 172.21.15.98:0/512567877 >> 172.21.15.98:0/512567877 conn(0x7fa4d00fac80 msgr2=0x7fa4d00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:57.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.819+0000 7fa4d5b41700 1 -- 172.21.15.98:0/512567877 shutdown_connections 2024-09-13T03:00:57.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.819+0000 7fa4d5b41700 1 -- 172.21.15.98:0/512567877 wait complete. 2024-09-13T03:00:57.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.819+0000 7fa4d5b41700 1 Processor -- start 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.819+0000 7fa4d5b41700 1 -- start start 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4d5b41700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d00ff3c0 0x7fa4d0100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4d5b41700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 0x7fa4d0101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4d5b41700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0101850 con 0x7fa4d00ffd60 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4d5b41700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0101990 con 0x7fa4d00ff3c0 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ceffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 0x7fa4d0101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ceffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 0x7fa4d0101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57146/0 (socket says 172.21.15.98:57146) 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ceffd700 1 -- 172.21.15.98:0/2821315120 learned_addr learned my addr 172.21.15.98:0/2821315120 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4cf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d00ff3c0 0x7fa4d0100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ceffd700 1 -- 172.21.15.98:0/2821315120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d00ff3c0 msgr2=0x7fa4d0100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ceffd700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d00ff3c0 0x7fa4d0100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:57.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ceffd700 1 -- 172.21.15.98:0/2821315120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40095f0 con 0x7fa4d00ffd60 2024-09-13T03:00:57.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ceffd700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 0x7fa4d0101310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40092e0 tx=0x7fa4c400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:57.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ccff9700 1 -- 172.21.15.98:0/2821315120 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c401d070 con 0x7fa4d00ffd60 2024-09-13T03:00:57.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ccff9700 1 -- 172.21.15.98:0/2821315120 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4c400f460 con 0x7fa4d00ffd60 2024-09-13T03:00:57.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4ccff9700 1 -- 172.21.15.98:0/2821315120 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c40175d0 con 0x7fa4d00ffd60 2024-09-13T03:00:57.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.820+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d0101c10 con 0x7fa4d00ffd60 2024-09-13T03:00:57.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.821+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d01a2390 con 0x7fa4d00ffd60 2024-09-13T03:00:57.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.821+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d0108740 con 0x7fa4d00ffd60 2024-09-13T03:00:57.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.822+0000 7fa4ccff9700 1 -- 172.21.15.98:0/2821315120 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa4c400f5d0 con 0x7fa4d00ffd60 2024-09-13T03:00:57.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.822+0000 7fa4ccff9700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b806e680 0x7fa4b8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:57.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.822+0000 7fa4ccff9700 1 -- 172.21.15.98:0/2821315120 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6690+0+0 (secure 0 0 0) 0x7fa4c408fcf0 con 0x7fa4d00ffd60 2024-09-13T03:00:57.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.822+0000 7fa4cf7fe700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b806e680 0x7fa4b8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:57.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.823+0000 7fa4cf7fe700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b806e680 0x7fa4b8070b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0005950 tx=0x7fa4c000a300 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:57.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:57.827+0000 7fa4ccff9700 1 -- 172.21.15.98:0/2821315120 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4c4058cc0 con 0x7fa4d00ffd60 2024-09-13T03:00:58.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.048+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4d0061190 con 0x7fa4b806e680 2024-09-13T03:00:58.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.049+0000 7fa4ccff9700 1 -- 172.21.15.98:0/2821315120 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa4d0061190 con 0x7fa4b806e680 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b806e680 msgr2=0x7fa4b8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b806e680 0x7fa4b8070b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0005950 tx=0x7fa4c000a300 comp rx=0 tx=0).stop 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 msgr2=0x7fa4d0101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 0x7fa4d0101310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40092e0 tx=0x7fa4c400bd70 comp rx=0 tx=0).stop 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 shutdown_connections 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa4b806e680 0x7fa4b8070b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4d00ff3c0 0x7fa4d0100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 --2- 172.21.15.98:0/2821315120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa4d00ffd60 0x7fa4d0101310 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 >> 172.21.15.98:0/2821315120 conn(0x7fa4d00fac80 msgr2=0x7fa4d00690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 shutdown_connections 2024-09-13T03:00:58.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.051+0000 7fa4d5b41700 1 -- 172.21.15.98:0/2821315120 wait complete. 2024-09-13T03:00:58.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.155+0000 7fad21de1700 1 -- 172.21.15.98:0/3233306696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 msgr2=0x7fad1c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.155+0000 7fad21de1700 1 --2- 172.21.15.98:0/3233306696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 0x7fad1c0ff720 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009910 tx=0x7fad0c009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.155+0000 7fad21de1700 1 -- 172.21.15.98:0/3233306696 shutdown_connections 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.155+0000 7fad21de1700 1 --2- 172.21.15.98:0/3233306696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c0ffc60 0x7fad1c10a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.155+0000 7fad21de1700 1 --2- 172.21.15.98:0/3233306696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 0x7fad1c0ff720 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.155+0000 7fad21de1700 1 -- 172.21.15.98:0/3233306696 >> 172.21.15.98:0/3233306696 conn(0x7fad1c0748b0 msgr2=0x7fad1c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.156+0000 7fad21de1700 1 -- 172.21.15.98:0/3233306696 shutdown_connections 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.156+0000 7fad21de1700 1 -- 172.21.15.98:0/3233306696 wait complete. 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.156+0000 7fad21de1700 1 Processor -- start 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.156+0000 7fad21de1700 1 -- start start 2024-09-13T03:00:58.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad21de1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 0x7fad1c195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:58.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad21de1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c0ffc60 0x7fad1c1964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:58.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad21de1700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c196b80 con 0x7fad1c0ff350 2024-09-13T03:00:58.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad21de1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c19a910 con 0x7fad1c0ffc60 2024-09-13T03:00:58.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad1b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 0x7fad1c195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:58.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad1b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 0x7fad1c195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57158/0 (socket says 172.21.15.98:57158) 2024-09-13T03:00:58.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad1b7fe700 1 -- 172.21.15.98:0/4160932175 learned_addr learned my addr 172.21.15.98:0/4160932175 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:58.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad1affd700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c0ffc60 0x7fad1c1964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:58.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad1b7fe700 1 -- 172.21.15.98:0/4160932175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c0ffc60 msgr2=0x7fad1c1964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad1b7fe700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c0ffc60 0x7fad1c1964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad1b7fe700 1 -- 172.21.15.98:0/4160932175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c0095f0 con 0x7fad1c0ff350 2024-09-13T03:00:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad1affd700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c0ffc60 0x7fad1c1964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:00:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad1b7fe700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 0x7fad1c195f60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0092e0 tx=0x7fad0c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad18ff9700 1 -- 172.21.15.98:0/4160932175 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0c01d070 con 0x7fad1c0ff350 2024-09-13T03:00:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad18ff9700 1 -- 172.21.15.98:0/4160932175 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad0c00f460 con 0x7fad1c0ff350 2024-09-13T03:00:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.157+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c19ab90 con 0x7fad1c0ff350 2024-09-13T03:00:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.158+0000 7fad18ff9700 1 -- 172.21.15.98:0/4160932175 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0c0175f0 con 0x7fad1c0ff350 2024-09-13T03:00:58.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.158+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c19b080 con 0x7fad1c0ff350 2024-09-13T03:00:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.159+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c107dd0 con 0x7fad1c0ff350 2024-09-13T03:00:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.159+0000 7fad18ff9700 1 -- 172.21.15.98:0/4160932175 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fad0c00f5d0 con 0x7fad1c0ff350 2024-09-13T03:00:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.160+0000 7fad18ff9700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fad0406e680 0x7fad04070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.160+0000 7fad18ff9700 1 -- 172.21.15.98:0/4160932175 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6690+0+0 (secure 0 0 0) 0x7fad0c08fc80 con 0x7fad1c0ff350 2024-09-13T03:00:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.160+0000 7fad1affd700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fad0406e680 0x7fad04070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:58.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.160+0000 7fad1affd700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fad0406e680 0x7fad04070b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad1c197580 tx=0x7fad10005f50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:58.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.164+0000 7fad18ff9700 1 -- 172.21.15.98:0/4160932175 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fad0c058d30 con 0x7fad1c0ff350 2024-09-13T03:00:58.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.373+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad1c197360 con 0x7fad0406e680 2024-09-13T03:00:58.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.382+0000 7fad18ff9700 1 -- 172.21.15.98:0/4160932175 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fad1c197360 con 0x7fad0406e680 2024-09-13T03:00:58.384 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:00:58.384 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (5m) 100s ago 16m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T03:00:58.384 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (16m) 100s ago 16m 8694k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T03:00:58.384 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (15m) 2s ago 15m 8464k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T03:00:58.384 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (3m) 100s ago 16m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T03:00:58.384 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (3m) 2s ago 15m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T03:00:58.384 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (5m) 100s ago 16m 80.3M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (10m) 100s ago 10m 93.9M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (11m) 100s ago 11m 152M - 18.2.0 dc2bc1663786 f38c219aaa93 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (10m) 2s ago 10m 17.1M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (11m) 2s ago 11m 20.5M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (7m) 100s ago 17m 500M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (6m) 2s ago 15m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (4m) 100s ago 18m 49.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (3m) 2s ago 15m 41.9M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (6m) 100s ago 16m 16.2M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (6m) 2s ago 15m 15.0M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (2m) 100s ago 14m 92.8M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (2m) 100s ago 14m 85.1M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T03:00:58.385 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (105s) 100s ago 13m 14.4M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 04c10c8159ba 2024-09-13T03:00:58.386 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (70s) 2s ago 13m 103M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 322e0a9d6b20 2024-09-13T03:00:58.386 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (38s) 2s ago 12m 98.3M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 087c65ddb960 2024-09-13T03:00:58.386 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (5s) 2s ago 12m 12.1M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 31b09c7c1472 2024-09-13T03:00:58.386 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (6m) 100s ago 16m 78.7M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T03:00:58.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.384+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fad0406e680 msgr2=0x7fad04070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.384+0000 7fad21de1700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fad0406e680 0x7fad04070b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad1c197580 tx=0x7fad10005f50 comp rx=0 tx=0).stop 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.384+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 msgr2=0x7fad1c195f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.385+0000 7fad21de1700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 0x7fad1c195f60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0092e0 tx=0x7fad0c00be20 comp rx=0 tx=0).stop 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.385+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 shutdown_connections 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.385+0000 7fad21de1700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fad0406e680 0x7fad04070b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.385+0000 7fad21de1700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad1c0ff350 0x7fad1c195f60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.385+0000 7fad21de1700 1 --2- 172.21.15.98:0/4160932175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad1c0ffc60 0x7fad1c1964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.385+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 >> 172.21.15.98:0/4160932175 conn(0x7fad1c0748b0 msgr2=0x7fad1c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.385+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 shutdown_connections 2024-09-13T03:00:58.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.385+0000 7fad21de1700 1 -- 172.21.15.98:0/4160932175 wait complete. 2024-09-13T03:00:58.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:58 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 38/267 objects degraded (14.232%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:58.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:58 smithi098 ceph-mon[87325]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:58.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.488+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/621137536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4068540 msgr2=0x7fd6b40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.488+0000 7fd6b8b7b700 1 --2- 172.21.15.98:0/621137536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4068540 0x7fd6b40689b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009910 tx=0x7fd6a8009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:58.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.488+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/621137536 shutdown_connections 2024-09-13T03:00:58.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.488+0000 7fd6b8b7b700 1 --2- 172.21.15.98:0/621137536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4068540 0x7fd6b40689b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.488+0000 7fd6b8b7b700 1 --2- 172.21.15.98:0/621137536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6b4106320 0x7fd6b41066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.488+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/621137536 >> 172.21.15.98:0/621137536 conn(0x7fd6b4075130 msgr2=0x7fd6b4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:58.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.488+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/621137536 shutdown_connections 2024-09-13T03:00:58.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.488+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/621137536 wait complete. 2024-09-13T03:00:58.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b8b7b700 1 Processor -- start 2024-09-13T03:00:58.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b8b7b700 1 -- start start 2024-09-13T03:00:58.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b8b7b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6b4068540 0x7fd6b4195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:58.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b8b7b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4106320 0x7fd6b41963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:58.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b8b7b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4196a80 con 0x7fd6b4106320 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b8b7b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b419a810 con 0x7fd6b4068540 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4106320 0x7fd6b41963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b1d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4106320 0x7fd6b41963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57178/0 (socket says 172.21.15.98:57178) 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b1d9b700 1 -- 172.21.15.98:0/989250867 learned_addr learned my addr 172.21.15.98:0/989250867 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b259c700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6b4068540 0x7fd6b4195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b1d9b700 1 -- 172.21.15.98:0/989250867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6b4068540 msgr2=0x7fd6b4195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b1d9b700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6b4068540 0x7fd6b4195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b1d9b700 1 -- 172.21.15.98:0/989250867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a80095f0 con 0x7fd6b4106320 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b259c700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6b4068540 0x7fd6b4195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.489+0000 7fd6b1d9b700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4106320 0x7fd6b41963a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8006010 tx=0x7fd6a800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:58.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.490+0000 7fd6a37fe700 1 -- 172.21.15.98:0/989250867 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6a801d070 con 0x7fd6b4106320 2024-09-13T03:00:58.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.490+0000 7fd6a37fe700 1 -- 172.21.15.98:0/989250867 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6a800f460 con 0x7fd6b4106320 2024-09-13T03:00:58.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.490+0000 7fd6a37fe700 1 -- 172.21.15.98:0/989250867 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6a8017630 con 0x7fd6b4106320 2024-09-13T03:00:58.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.490+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b419aa90 con 0x7fd6b4106320 2024-09-13T03:00:58.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.490+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b419af80 con 0x7fd6b4106320 2024-09-13T03:00:58.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.490+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b4108770 con 0x7fd6b4106320 2024-09-13T03:00:58.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.491+0000 7fd6a37fe700 1 -- 172.21.15.98:0/989250867 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd6a800f5d0 con 0x7fd6b4106320 2024-09-13T03:00:58.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.492+0000 7fd6a37fe700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd69c06e680 0x7fd69c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:58.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.492+0000 7fd6a37fe700 1 -- 172.21.15.98:0/989250867 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6690+0+0 (secure 0 0 0) 0x7fd6a808fca0 con 0x7fd6b4106320 2024-09-13T03:00:58.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.492+0000 7fd6b259c700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd69c06e680 0x7fd69c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:58.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.492+0000 7fd6b259c700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd69c06e680 0x7fd69c070b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4005950 tx=0x7fd6a40058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:58.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.496+0000 7fd6a37fe700 1 -- 172.21.15.98:0/989250867 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd6a8094070 con 0x7fd6b4106320 2024-09-13T03:00:58.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:58 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 38/267 objects degraded (14.232%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:58.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:58 smithi142 ceph-mon[65447]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:58.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.787+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd6b404f2a0 con 0x7fd6b4106320 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.788+0000 7fd6a37fe700 1 -- 172.21.15.98:0/989250867 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+708 (secure 0 0 0) 0x7fd6a8058cd0 con 0x7fd6b4106320 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 5 2024-09-13T03:00:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:00:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T03:00:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-13T03:00:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:00:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T03:00:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-13T03:00:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 9 2024-09-13T03:00:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T03:00:58.791 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:00:58.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd69c06e680 msgr2=0x7fd69c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd69c06e680 0x7fd69c070b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4005950 tx=0x7fd6a40058e0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4106320 msgr2=0x7fd6b41963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4106320 0x7fd6b41963a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8006010 tx=0x7fd6a800be20 comp rx=0 tx=0).stop 2024-09-13T03:00:58.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 shutdown_connections 2024-09-13T03:00:58.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd69c06e680 0x7fd69c070b30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6b4068540 0x7fd6b4195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 --2- 172.21.15.98:0/989250867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6b4106320 0x7fd6b41963a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 >> 172.21.15.98:0/989250867 conn(0x7fd6b4075130 msgr2=0x7fd6b40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:58.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 shutdown_connections 2024-09-13T03:00:58.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.791+0000 7fd6b8b7b700 1 -- 172.21.15.98:0/989250867 wait complete. 2024-09-13T03:00:58.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.900+0000 7fca0f8ed700 1 -- 172.21.15.98:0/2595738206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080fefb0 msgr2=0x7fca080ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.900+0000 7fca0f8ed700 1 --2- 172.21.15.98:0/2595738206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080fefb0 0x7fca080ff380 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fca04009910 tx=0x7fca04009c20 comp rx=0 tx=0).stop 2024-09-13T03:00:58.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.901+0000 7fca0f8ed700 1 -- 172.21.15.98:0/2595738206 shutdown_connections 2024-09-13T03:00:58.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.901+0000 7fca0f8ed700 1 --2- 172.21.15.98:0/2595738206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca080ff8c0 0x7fca0810c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.901+0000 7fca0f8ed700 1 --2- 172.21.15.98:0/2595738206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080fefb0 0x7fca080ff380 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.901+0000 7fca0f8ed700 1 -- 172.21.15.98:0/2595738206 >> 172.21.15.98:0/2595738206 conn(0x7fca080fac80 msgr2=0x7fca080fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.901+0000 7fca0f8ed700 1 -- 172.21.15.98:0/2595738206 shutdown_connections 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.901+0000 7fca0f8ed700 1 -- 172.21.15.98:0/2595738206 wait complete. 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.901+0000 7fca0f8ed700 1 Processor -- start 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.901+0000 7fca0f8ed700 1 -- start start 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0f8ed700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca080fefb0 0x7fca08198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0f8ed700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080ff8c0 0x7fca08198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0f8ed700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08198c30 con 0x7fca080ff8c0 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0f8ed700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0819c9c0 con 0x7fca080fefb0 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0ce88700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080ff8c0 0x7fca08198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0ce88700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080ff8c0 0x7fca08198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57190/0 (socket says 172.21.15.98:57190) 2024-09-13T03:00:58.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0ce88700 1 -- 172.21.15.98:0/835161499 learned_addr learned my addr 172.21.15.98:0/835161499 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:58.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0d689700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca080fefb0 0x7fca08198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0ce88700 1 -- 172.21.15.98:0/835161499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca080fefb0 msgr2=0x7fca08198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0ce88700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca080fefb0 0x7fca08198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0ce88700 1 -- 172.21.15.98:0/835161499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca040095f0 con 0x7fca080ff8c0 2024-09-13T03:00:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0ce88700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080ff8c0 0x7fca08198550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800d8d0 tx=0x7fc9f800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fc9fe7fc700 1 -- 172.21.15.98:0/835161499 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f80098a0 con 0x7fca080ff8c0 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fc9fe7fc700 1 -- 172.21.15.98:0/835161499 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9f8010460 con 0x7fca080ff8c0 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0819cca0 con 0x7fca080ff8c0 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fc9fe7fc700 1 -- 172.21.15.98:0/835161499 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f800f5f0 con 0x7fca080ff8c0 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.902+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0819d1f0 con 0x7fca080ff8c0 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.903+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca08109d90 con 0x7fca080ff8c0 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.904+0000 7fc9fe7fc700 1 -- 172.21.15.98:0/835161499 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc9f8009a00 con 0x7fca080ff8c0 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.904+0000 7fc9fe7fc700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc9f406e680 0x7fc9f4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.905+0000 7fc9fe7fc700 1 -- 172.21.15.98:0/835161499 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6690+0+0 (secure 0 0 0) 0x7fc9f808e6c0 con 0x7fca080ff8c0 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.905+0000 7fca0d689700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc9f406e680 0x7fc9f4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.905+0000 7fca0d689700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc9f406e680 0x7fc9f4070b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca04006010 tx=0x7fca0401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:58.910+0000 7fc9fe7fc700 1 -- 172.21.15.98:0/835161499 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc9f80576f0 con 0x7fca080ff8c0 2024-09-13T03:00:59.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.152+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fca0804f2a0 con 0x7fca080ff8c0 2024-09-13T03:00:59.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.153+0000 7fc9fe7fc700 1 -- 172.21.15.98:0/835161499 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1941 (secure 0 0 0) 0x7fc9f80167b0 con 0x7fca080ff8c0 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:e14 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 14 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T03:00:59.155 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T02:50:06.420732+0000 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T03:00:59.156 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=14454} 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 0 members: 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:14454} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.98:6826/831008890,v1:172.21.15.98:6827/831008890] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:14470} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.98:6828/3075365470,v1:172.21.15.98:6829/3075365470] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:59.157 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:00:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:00:59.158 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T03:00:59.158 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:00:59.158 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:24269} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:59.158 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc9f406e680 msgr2=0x7fc9f4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc9f406e680 0x7fc9f4070b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca04006010 tx=0x7fca0401a040 comp rx=0 tx=0).stop 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080ff8c0 msgr2=0x7fca08198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080ff8c0 0x7fca08198550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800d8d0 tx=0x7fc9f800dbe0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 shutdown_connections 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fc9f406e680 0x7fc9f4070b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca080fefb0 0x7fca08198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 --2- 172.21.15.98:0/835161499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca080ff8c0 0x7fca08198550 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 >> 172.21.15.98:0/835161499 conn(0x7fca080fac80 msgr2=0x7fca080fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 shutdown_connections 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.155+0000 7fca0f8ed700 1 -- 172.21.15.98:0/835161499 wait complete. 2024-09-13T03:00:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 14 2024-09-13T03:00:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.262+0000 7f480fc4a700 1 -- 172.21.15.98:0/1754208847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 msgr2=0x7f48080ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.262+0000 7f480fc4a700 1 --2- 172.21.15.98:0/1754208847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 0x7f48080ff790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f480000b0a0 tx=0x7f480000b3b0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.262+0000 7f480fc4a700 1 -- 172.21.15.98:0/1754208847 shutdown_connections 2024-09-13T03:00:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.262+0000 7f480fc4a700 1 --2- 172.21.15.98:0/1754208847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48080ffd60 0x7f4808103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.262+0000 7f480fc4a700 1 --2- 172.21.15.98:0/1754208847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 0x7f48080ff790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.262+0000 7f480fc4a700 1 -- 172.21.15.98:0/1754208847 >> 172.21.15.98:0/1754208847 conn(0x7f48080fac60 msgr2=0x7f48080fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:59.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.262+0000 7f480fc4a700 1 -- 172.21.15.98:0/1754208847 shutdown_connections 2024-09-13T03:00:59.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.262+0000 7f480fc4a700 1 -- 172.21.15.98:0/1754208847 wait complete. 2024-09-13T03:00:59.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480fc4a700 1 Processor -- start 2024-09-13T03:00:59.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480fc4a700 1 -- start start 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480fc4a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 0x7f4808198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480fc4a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48080ffd60 0x7f48081986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480fc4a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4808198d80 con 0x7f48080ff3c0 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480fc4a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480819cb10 con 0x7f48080ffd60 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480d9e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 0x7f4808198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480d9e6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 0x7f4808198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57206/0 (socket says 172.21.15.98:57206) 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480d9e6700 1 -- 172.21.15.98:0/1649260533 learned_addr learned my addr 172.21.15.98:0/1649260533 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480d1e5700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48080ffd60 0x7f48081986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480d9e6700 1 -- 172.21.15.98:0/1649260533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48080ffd60 msgr2=0x7f48081986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480d9e6700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48080ffd60 0x7f48081986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.263+0000 7f480d9e6700 1 -- 172.21.15.98:0/1649260533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800009d00 con 0x7f48080ff3c0 2024-09-13T03:00:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.264+0000 7f480d9e6700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 0x7f4808198160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4800009bb0 tx=0x7f480000bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.264+0000 7f4806ffd700 1 -- 172.21.15.98:0/1649260533 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4800003a00 con 0x7f48080ff3c0 2024-09-13T03:00:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.264+0000 7f4806ffd700 1 -- 172.21.15.98:0/1649260533 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f480001d070 con 0x7f48080ff3c0 2024-09-13T03:00:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.264+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480819cd90 con 0x7f48080ff3c0 2024-09-13T03:00:59.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.264+0000 7f4806ffd700 1 -- 172.21.15.98:0/1649260533 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4800011460 con 0x7f48080ff3c0 2024-09-13T03:00:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.264+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480819d2e0 con 0x7f48080ff3c0 2024-09-13T03:00:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.265+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48081076d0 con 0x7f48080ff3c0 2024-09-13T03:00:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.265+0000 7f4806ffd700 1 -- 172.21.15.98:0/1649260533 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f480001f030 con 0x7f48080ff3c0 2024-09-13T03:00:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.266+0000 7f4806ffd700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f47f006e680 0x7f47f0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.266+0000 7f4806ffd700 1 -- 172.21.15.98:0/1649260533 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6690+0+0 (secure 0 0 0) 0x7f480008f770 con 0x7f48080ff3c0 2024-09-13T03:00:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.266+0000 7f480d1e5700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f47f006e680 0x7f47f0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:59.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.266+0000 7f480d1e5700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f47f006e680 0x7f47f0070b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4808199780 tx=0x7f47fc009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:59.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.270+0000 7f4806ffd700 1 -- 172.21.15.98:0/1649260533 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4800058820 con 0x7f48080ff3c0 2024-09-13T03:00:59.458 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:59 smithi142 ceph-mon[65447]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:59.459 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:59 smithi142 ceph-mon[65447]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:59.459 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:59 smithi142 ceph-mon[65447]: pgmap v159: 65 pgs: 10 active+clean+remapped, 14 active+undersized, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 38/267 objects degraded (14.232%); 5/267 objects misplaced (1.873%); 1.0 MiB/s, 32 objects/s recovering 2024-09-13T03:00:59.459 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:59 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/989250867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:59.459 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:00:59 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/835161499' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:59.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:59 smithi098 ceph-mon[87325]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:59.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:59 smithi098 ceph-mon[87325]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:59.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:59 smithi098 ceph-mon[87325]: pgmap v159: 65 pgs: 10 active+clean+remapped, 14 active+undersized, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 38/267 objects degraded (14.232%); 5/267 objects misplaced (1.873%); 1.0 MiB/s, 32 objects/s recovering 2024-09-13T03:00:59.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:59 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/989250867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:59.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:00:59 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/835161499' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:59.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.492+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48081995b0 con 0x7f47f006e680 2024-09-13T03:00:59.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.493+0000 7f4806ffd700 1 -- 172.21.15.98:0/1649260533 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f48081995b0 con 0x7f47f006e680 2024-09-13T03:00:59.495 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:00:59.495 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:00:59.495 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T03:00:59.495 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:00:59.495 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T03:00:59.496 INFO:teuthology.orchestra.run.smithi098.stdout: "osd", 2024-09-13T03:00:59.496 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T03:00:59.496 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-13T03:00:59.496 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T03:00:59.496 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T03:00:59.496 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "12/23 daemons upgraded", 2024-09-13T03:00:59.496 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T03:00:59.496 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T03:00:59.497 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:00:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f47f006e680 msgr2=0x7f47f0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f47f006e680 0x7f47f0070b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4808199780 tx=0x7f47fc009260 comp rx=0 tx=0).stop 2024-09-13T03:00:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 msgr2=0x7f4808198160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 0x7f4808198160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4800009bb0 tx=0x7f480000bc60 comp rx=0 tx=0).stop 2024-09-13T03:00:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 shutdown_connections 2024-09-13T03:00:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f47f006e680 0x7f47f0070b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48080ff3c0 0x7f4808198160 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 --2- 172.21.15.98:0/1649260533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48080ffd60 0x7f48081986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 >> 172.21.15.98:0/1649260533 conn(0x7f48080fac60 msgr2=0x7f48080fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 shutdown_connections 2024-09-13T03:00:59.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.495+0000 7f480fc4a700 1 -- 172.21.15.98:0/1649260533 wait complete. 2024-09-13T03:00:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.600+0000 7f5d4e747700 1 -- 172.21.15.98:0/4197264503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 msgr2=0x7f5d48103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.600+0000 7f5d4e747700 1 --2- 172.21.15.98:0/4197264503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 0x7f5d48103c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800aa20 tx=0x7f5d3800ad30 comp rx=0 tx=0).stop 2024-09-13T03:00:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.600+0000 7f5d4e747700 1 -- 172.21.15.98:0/4197264503 shutdown_connections 2024-09-13T03:00:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.600+0000 7f5d4e747700 1 --2- 172.21.15.98:0/4197264503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d480ff350 0x7f5d480ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.600+0000 7f5d4e747700 1 --2- 172.21.15.98:0/4197264503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 0x7f5d48103c80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.600+0000 7f5d4e747700 1 -- 172.21.15.98:0/4197264503 >> 172.21.15.98:0/4197264503 conn(0x7f5d480748b0 msgr2=0x7f5d48074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.600+0000 7f5d4e747700 1 -- 172.21.15.98:0/4197264503 shutdown_connections 2024-09-13T03:00:59.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.600+0000 7f5d4e747700 1 -- 172.21.15.98:0/4197264503 wait complete. 2024-09-13T03:00:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d4e747700 1 Processor -- start 2024-09-13T03:00:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d4e747700 1 -- start start 2024-09-13T03:00:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d4e747700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d480ff350 0x7f5d481999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d4e747700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 0x7f5d48199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d4e747700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4819a5b0 con 0x7f5d481038b0 2024-09-13T03:00:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d4e747700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d48193a60 con 0x7f5d480ff350 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 0x7f5d48199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d477fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 0x7f5d48199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57220/0 (socket says 172.21.15.98:57220) 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d477fe700 1 -- 172.21.15.98:0/2227812106 learned_addr learned my addr 172.21.15.98:0/2227812106 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.601+0000 7f5d47fff700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d480ff350 0x7f5d481999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.602+0000 7f5d477fe700 1 -- 172.21.15.98:0/2227812106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d480ff350 msgr2=0x7f5d481999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.602+0000 7f5d477fe700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d480ff350 0x7f5d481999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.602+0000 7f5d477fe700 1 -- 172.21.15.98:0/2227812106 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3800a700 con 0x7f5d481038b0 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.602+0000 7f5d477fe700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 0x7f5d48199f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d30007b50 tx=0x7f5d30007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.602+0000 7f5d457fa700 1 -- 172.21.15.98:0/2227812106 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d30011070 con 0x7f5d481038b0 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.602+0000 7f5d457fa700 1 -- 172.21.15.98:0/2227812106 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d3000c2e0 con 0x7f5d481038b0 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.602+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d48193d40 con 0x7f5d481038b0 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.602+0000 7f5d457fa700 1 -- 172.21.15.98:0/2227812106 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d3000e740 con 0x7f5d481038b0 2024-09-13T03:00:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.602+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d48194290 con 0x7f5d481038b0 2024-09-13T03:00:59.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.603+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d48106e20 con 0x7f5d481038b0 2024-09-13T03:00:59.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.603+0000 7f5d457fa700 1 -- 172.21.15.98:0/2227812106 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5d30004a00 con 0x7f5d481038b0 2024-09-13T03:00:59.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.604+0000 7f5d457fa700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5d3406e680 0x7f5d34070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:59.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.604+0000 7f5d47fff700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5d3406e680 0x7f5d34070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:59.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.604+0000 7f5d457fa700 1 -- 172.21.15.98:0/2227812106 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6690+0+0 (secure 0 0 0) 0x7f5d3008fd50 con 0x7f5d481038b0 2024-09-13T03:00:59.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.605+0000 7f5d47fff700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5d3406e680 0x7f5d34070b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800afd0 tx=0x7f5d38005dc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:59.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.608+0000 7f5d457fa700 1 -- 172.21.15.98:0/2227812106 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5d3005c930 con 0x7f5d481038b0 2024-09-13T03:00:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.892+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5d48194500 con 0x7f5d481038b0 2024-09-13T03:00:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.893+0000 7f5d457fa700 1 -- 172.21.15.98:0/2227812106 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1368 (secure 0 0 0) 0x7f5d30004cb0 con 0x7f5d481038b0 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 38/267 objects degraded (14.232%), 12 pgs degraded 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout: osd.5 (root=default,host=smithi142) is down 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 38/267 objects degraded (14.232%), 12 pgs degraded 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-13T03:00:59.895 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-13T03:00:59.896 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-13T03:00:59.896 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-13T03:00:59.896 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-13T03:00:59.896 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-13T03:00:59.896 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:59.896 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-13T03:00:59.896 INFO:teuthology.orchestra.run.smithi098.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5d3406e680 msgr2=0x7f5d34070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5d3406e680 0x7f5d34070b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800afd0 tx=0x7f5d38005dc0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 msgr2=0x7f5d48199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 0x7f5d48199f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d30007b50 tx=0x7f5d30007e60 comp rx=0 tx=0).stop 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 shutdown_connections 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f5d3406e680 0x7f5d34070b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d480ff350 0x7f5d481999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 --2- 172.21.15.98:0/2227812106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d481038b0 0x7f5d48199f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 >> 172.21.15.98:0/2227812106 conn(0x7f5d480748b0 msgr2=0x7f5d480fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 shutdown_connections 2024-09-13T03:00:59.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:00:59.895+0000 7f5d4e747700 1 -- 172.21.15.98:0/2227812106 wait complete. 2024-09-13T03:01:00.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:00 smithi098 ceph-mon[87325]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:00.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:00 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2227812106' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:01:00.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:00 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:00.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:00 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:00.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:00 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:00.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:00 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:00.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:00 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:00.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:00 smithi142 ceph-mon[65447]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:00.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:00 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2227812106' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:01:00.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:00 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:00.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:00 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:00.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:00 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:00.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:00 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:00.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:00 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:01.001 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:01:00 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:01:00.746+0000 7fa2b05d5640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-13T03:01:01.001 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:01:00 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:01:00.996+0000 7fa2b05d5640 -1 osd.5 74 log_to_monitors true 2024-09-13T03:01:01.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:01.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:01.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all osd 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T03:01:01.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: pgmap v160: 65 pgs: 10 active+clean+remapped, 14 active+undersized, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 38/267 objects degraded (14.232%); 5/267 objects misplaced (1.873%); 920 KiB/s, 28 objects/s recovering 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='osd.5 [v2:172.21.15.142:6816/89036588,v1:172.21.15.142:6817/89036588]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T03:01:01.486 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:01 smithi098 ceph-mon[87325]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T03:01:01.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:01.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:01.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:01.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:01.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:01.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all osd 2024-09-13T03:01:01.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T03:01:01.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T03:01:01.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T03:01:01.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T03:01:01.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T03:01:01.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: pgmap v160: 65 pgs: 10 active+clean+remapped, 14 active+undersized, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s; 38/267 objects degraded (14.232%); 5/267 objects misplaced (1.873%); 920 KiB/s, 28 objects/s recovering 2024-09-13T03:01:01.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='osd.5 [v2:172.21.15.142:6816/89036588,v1:172.21.15.142:6817/89036588]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T03:01:01.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:01 smithi142 ceph-mon[65447]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T03:01:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T03:01:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T03:01:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T03:01:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: from='osd.5 [v2:172.21.15.142:6816/89036588,v1:172.21.15.142:6817/89036588]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T03:01:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: osdmap e81: 6 total, 5 up, 6 in 2024-09-13T03:01:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T03:01:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T03:01:02.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:02.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T03:01:02.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: from='osd.5 ' entity='osd.5' 2024-09-13T03:01:02.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:02 smithi098 ceph-mon[87325]: osdmap e82: 6 total, 5 up, 6 in 2024-09-13T03:01:02.501 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:01:02.079+0000 7fa2a4367640 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: from='osd.5 [v2:172.21.15.142:6816/89036588,v1:172.21.15.142:6817/89036588]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: osdmap e81: 6 total, 5 up, 6 in 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: from='osd.5 ' entity='osd.5' 2024-09-13T03:01:02.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:02 smithi142 ceph-mon[65447]: osdmap e82: 6 total, 5 up, 6 in 2024-09-13T03:01:03.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T03:01:03.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 2 up:standby 2024-09-13T03:01:03.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:03.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:03.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:03.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: pgmap v163: 65 pgs: 10 active+clean+remapped, 14 active+undersized, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/267 objects degraded (14.232%); 5/267 objects misplaced (1.873%) 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: osd.5 [v2:172.21.15.142:6816/89036588,v1:172.21.15.142:6817/89036588] boot 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: osdmap e83: 6 total, 6 up, 6 in 2024-09-13T03:01:03.735 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T03:01:03.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 2 up:standby 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: pgmap v163: 65 pgs: 10 active+clean+remapped, 14 active+undersized, 12 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/267 objects degraded (14.232%); 5/267 objects misplaced (1.873%) 2024-09-13T03:01:03.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T03:01:03.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: osd.5 [v2:172.21.15.142:6816/89036588,v1:172.21.15.142:6817/89036588] boot 2024-09-13T03:01:03.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: osdmap e83: 6 total, 6 up, 6 in 2024-09-13T03:01:03.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T03:01:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.98:6828/2438634369,v1:172.21.15.98:6829/2438634369] up:boot 2024-09-13T03:01:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 3 up:standby 2024-09-13T03:01:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T03:01:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: Upgrade: Updating mds.cephfs.smithi098.nwzstq 2024-09-13T03:01:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:04.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.nwzstq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:04.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:04.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: Deploying daemon mds.cephfs.smithi098.nwzstq on smithi098 2024-09-13T03:01:04.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:04 smithi098 ceph-mon[87325]: osdmap e84: 6 total, 6 up, 6 in 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.98:6828/2438634369,v1:172.21.15.98:6829/2438634369] up:boot 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 3 up:standby 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: Upgrade: Updating mds.cephfs.smithi098.nwzstq 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.nwzstq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:04.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: Deploying daemon mds.cephfs.smithi098.nwzstq on smithi098 2024-09-13T03:01:04.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:04 smithi142 ceph-mon[65447]: osdmap e84: 6 total, 6 up, 6 in 2024-09-13T03:01:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:05 smithi098 ceph-mon[87325]: pgmap v166: 65 pgs: 4 remapped+peering, 3 peering, 6 active+clean+remapped, 13 active+undersized, 10 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 33/267 objects degraded (12.360%); 4/267 objects misplaced (1.498%) 2024-09-13T03:01:05.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:05 smithi098 ceph-mon[87325]: osdmap e85: 6 total, 6 up, 6 in 2024-09-13T03:01:05.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:05 smithi142 ceph-mon[65447]: pgmap v166: 65 pgs: 4 remapped+peering, 3 peering, 6 active+clean+remapped, 13 active+undersized, 10 active+undersized+degraded, 29 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 33/267 objects degraded (12.360%); 4/267 objects misplaced (1.498%) 2024-09-13T03:01:05.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:05 smithi142 ceph-mon[65447]: osdmap e85: 6 total, 6 up, 6 in 2024-09-13T03:01:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:05 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[87321]: 2024-09-13T03:01:05.786+0000 7f6bf01fb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:01:06.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:06 smithi098 ceph-mon[87325]: Health check update: Degraded data redundancy: 33/267 objects degraded (12.360%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T03:01:06.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:06 smithi098 ceph-mon[87325]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T03:01:06.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:06 smithi098 ceph-mon[87325]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:01:06.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:06 smithi098 ceph-mon[87325]: osdmap e86: 6 total, 6 up, 6 in 2024-09-13T03:01:06.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:06 smithi098 ceph-mon[87325]: Standby daemon mds.cephfs.smithi142.wxfmvt assigned to filesystem cephfs as rank 0 2024-09-13T03:01:06.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:06 smithi098 ceph-mon[87325]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T03:01:06.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:06 smithi098 ceph-mon[87325]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T03:01:06.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:06 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi142.wxfmvt=up:replay} 2 up:standby 2024-09-13T03:01:06.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:06 smithi142 ceph-mon[65447]: Health check update: Degraded data redundancy: 33/267 objects degraded (12.360%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T03:01:06.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:06 smithi142 ceph-mon[65447]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T03:01:06.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:06 smithi142 ceph-mon[65447]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:01:06.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:06 smithi142 ceph-mon[65447]: osdmap e86: 6 total, 6 up, 6 in 2024-09-13T03:01:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:06 smithi142 ceph-mon[65447]: Standby daemon mds.cephfs.smithi142.wxfmvt assigned to filesystem cephfs as rank 0 2024-09-13T03:01:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:06 smithi142 ceph-mon[65447]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T03:01:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:06 smithi142 ceph-mon[65447]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T03:01:06.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:06 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi142.wxfmvt=up:replay} 2 up:standby 2024-09-13T03:01:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:07 smithi098 ceph-mon[87325]: pgmap v169: 65 pgs: 1 active+undersized+remapped, 2 remapped+peering, 6 peering, 3 active+clean+remapped, 4 active+undersized, 5 active+undersized+degraded, 44 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s; 18/267 objects degraded (6.742%); 3/267 objects misplaced (1.124%); 0 B/s, 63 objects/s recovering 2024-09-13T03:01:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:07 smithi098 ceph-mon[87325]: osdmap e87: 6 total, 6 up, 6 in 2024-09-13T03:01:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:07 smithi098 ceph-mon[87325]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T03:01:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:07 smithi098 ceph-mon[87325]: osdmap e88: 6 total, 6 up, 6 in 2024-09-13T03:01:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:07 smithi142 ceph-mon[65447]: pgmap v169: 65 pgs: 1 active+undersized+remapped, 2 remapped+peering, 6 peering, 3 active+clean+remapped, 4 active+undersized, 5 active+undersized+degraded, 44 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s; 18/267 objects degraded (6.742%); 3/267 objects misplaced (1.124%); 0 B/s, 63 objects/s recovering 2024-09-13T03:01:08.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:07 smithi142 ceph-mon[65447]: osdmap e87: 6 total, 6 up, 6 in 2024-09-13T03:01:08.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:07 smithi142 ceph-mon[65447]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T03:01:08.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:07 smithi142 ceph-mon[65447]: osdmap e88: 6 total, 6 up, 6 in 2024-09-13T03:01:09.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:09 smithi098 ceph-mon[87325]: osdmap e89: 6 total, 6 up, 6 in 2024-09-13T03:01:09.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:09 smithi098 ceph-mon[87325]: pgmap v173: 65 pgs: 1 active+undersized+remapped, 2 remapped+peering, 6 peering, 1 active+clean+remapped, 55 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 7 op/s; 0 B/s, 146 objects/s recovering 2024-09-13T03:01:09.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:09 smithi142 ceph-mon[65447]: osdmap e89: 6 total, 6 up, 6 in 2024-09-13T03:01:09.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:09 smithi142 ceph-mon[65447]: pgmap v173: 65 pgs: 1 active+undersized+remapped, 2 remapped+peering, 6 peering, 1 active+clean+remapped, 55 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 7 op/s; 0 B/s, 146 objects/s recovering 2024-09-13T03:01:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:10 smithi098 ceph-mon[87325]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 5 pgs degraded) 2024-09-13T03:01:10.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:10 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T03:01:10.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:10 smithi142 ceph-mon[65447]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/267 objects degraded (6.742%), 5 pgs degraded) 2024-09-13T03:01:10.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:10 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T03:01:11.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:11 smithi098 ceph-mon[87325]: pgmap v174: 65 pgs: 1 active+undersized+remapped, 1 remapped+peering, 3 peering, 1 active+clean+remapped, 59 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 6 op/s; 0 B/s, 109 objects/s recovering 2024-09-13T03:01:11.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:11 smithi142 ceph-mon[65447]: pgmap v174: 65 pgs: 1 active+undersized+remapped, 1 remapped+peering, 3 peering, 1 active+clean+remapped, 59 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 6 op/s; 0 B/s, 109 objects/s recovering 2024-09-13T03:01:13.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:12 smithi098 ceph-mon[87325]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T03:01:13.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:12 smithi142 ceph-mon[65447]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T03:01:14.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:13 smithi098 ceph-mon[87325]: pgmap v175: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 8 op/s; 0 B/s, 87 objects/s recovering 2024-09-13T03:01:14.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:13 smithi142 ceph-mon[65447]: pgmap v175: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 8 op/s; 0 B/s, 87 objects/s recovering 2024-09-13T03:01:15.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:15 smithi098 ceph-mon[87325]: pgmap v176: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s; 0 B/s, 65 objects/s recovering 2024-09-13T03:01:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:15 smithi142 ceph-mon[65447]: pgmap v176: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s; 0 B/s, 65 objects/s recovering 2024-09-13T03:01:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:16 smithi098 ceph-mon[87325]: reconnect by client.24313 192.168.0.1:0/3572139203 after 0.00099998 2024-09-13T03:01:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:16 smithi098 ceph-mon[87325]: reconnect by client.14508 192.168.0.1:0/3551376023 after 0.00099998 2024-09-13T03:01:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:16 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:reconnect 2024-09-13T03:01:16.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:16 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi142.wxfmvt=up:reconnect} 2 up:standby 2024-09-13T03:01:17.232 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:16 smithi142 ceph-mon[65447]: reconnect by client.24313 192.168.0.1:0/3572139203 after 0.00099998 2024-09-13T03:01:17.232 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:16 smithi142 ceph-mon[65447]: reconnect by client.14508 192.168.0.1:0/3551376023 after 0.00099998 2024-09-13T03:01:17.232 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:16 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:reconnect 2024-09-13T03:01:17.232 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:16 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi142.wxfmvt=up:reconnect} 2 up:standby 2024-09-13T03:01:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:17 smithi098 ceph-mon[87325]: pgmap v177: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s; 0 B/s, 56 objects/s recovering 2024-09-13T03:01:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:17 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:rejoin 2024-09-13T03:01:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:17 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi142.wxfmvt=up:rejoin} 2 up:standby 2024-09-13T03:01:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:17 smithi098 ceph-mon[87325]: daemon mds.cephfs.smithi142.wxfmvt is now active in filesystem cephfs as rank 0 2024-09-13T03:01:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:17 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:17 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:17 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:17 smithi142 ceph-mon[65447]: pgmap v177: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s; 0 B/s, 56 objects/s recovering 2024-09-13T03:01:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:17 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:rejoin 2024-09-13T03:01:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:17 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi142.wxfmvt=up:rejoin} 2 up:standby 2024-09-13T03:01:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:17 smithi142 ceph-mon[65447]: daemon mds.cephfs.smithi142.wxfmvt is now active in filesystem cephfs as rank 0 2024-09-13T03:01:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:17 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:17 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:18.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:17 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:18 smithi098 ceph-mon[87325]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T03:01:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:18 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:active 2024-09-13T03:01:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:18 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] up:boot 2024-09-13T03:01:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:18 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi142.wxfmvt=up:active} 3 up:standby 2024-09-13T03:01:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T03:01:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:18 smithi142 ceph-mon[65447]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T03:01:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:18 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] up:active 2024-09-13T03:01:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:18 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] up:boot 2024-09-13T03:01:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:18 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi142.wxfmvt=up:active} 3 up:standby 2024-09-13T03:01:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T03:01:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:20.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:19 smithi142 ceph-mon[65447]: pgmap v178: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 199 B/s wr, 4 op/s; 0 B/s, 23 objects/s recovering 2024-09-13T03:01:20.130 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:19 smithi098 ceph-mon[87325]: pgmap v178: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 199 B/s wr, 4 op/s; 0 B/s, 23 objects/s recovering 2024-09-13T03:01:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:21 smithi098 ceph-mon[87325]: pgmap v179: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 4 op/s; 0 B/s, 19 objects/s recovering 2024-09-13T03:01:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:21 smithi142 ceph-mon[65447]: pgmap v179: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 4 op/s; 0 B/s, 19 objects/s recovering 2024-09-13T03:01:23.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:23.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:23.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:23 smithi098 ceph-mon[87325]: pgmap v180: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 8 op/s; 0 B/s, 19 objects/s recovering 2024-09-13T03:01:23.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:23.569 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:23 smithi142 ceph-mon[65447]: pgmap v180: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 8 op/s; 0 B/s, 19 objects/s recovering 2024-09-13T03:01:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:23.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:26.140 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:25 smithi098 ceph-mon[87325]: pgmap v181: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-13T03:01:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:25 smithi142 ceph-mon[65447]: pgmap v181: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-13T03:01:27.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:27.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:27.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:27.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:27.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:27.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:27.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:27.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:27.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:27.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:27.485 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:27 smithi098 ceph-mon[87325]: pgmap v182: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-13T03:01:27.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:27.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:27 smithi142 ceph-mon[65447]: pgmap v182: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-13T03:01:29.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:28 smithi098 ceph-mon[87325]: Upgrade: Updating mds.cephfs.smithi098.dioppa 2024-09-13T03:01:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.dioppa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:28 smithi098 ceph-mon[87325]: Deploying daemon mds.cephfs.smithi098.dioppa on smithi098 2024-09-13T03:01:29.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:28 smithi142 ceph-mon[65447]: Upgrade: Updating mds.cephfs.smithi098.dioppa 2024-09-13T03:01:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi098.dioppa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:28 smithi142 ceph-mon[65447]: Deploying daemon mds.cephfs.smithi098.dioppa on smithi098 2024-09-13T03:01:30.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.006+0000 7f3314d4e700 1 -- 172.21.15.98:0/2492517788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33101004e0 msgr2=0x7f33101008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.006+0000 7f3314d4e700 1 --2- 172.21.15.98:0/2492517788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33101004e0 0x7f33101008b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3300009910 tx=0x7f3300009c20 comp rx=0 tx=0).stop 2024-09-13T03:01:30.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.006+0000 7f3314d4e700 1 -- 172.21.15.98:0/2492517788 shutdown_connections 2024-09-13T03:01:30.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.006+0000 7f3314d4e700 1 --2- 172.21.15.98:0/2492517788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3310100e80 0x7f3310104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.006+0000 7f3314d4e700 1 --2- 172.21.15.98:0/2492517788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33101004e0 0x7f33101008b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.006+0000 7f3314d4e700 1 -- 172.21.15.98:0/2492517788 >> 172.21.15.98:0/2492517788 conn(0x7f33100fbda0 msgr2=0x7f33100fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:30.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.006+0000 7f3314d4e700 1 -- 172.21.15.98:0/2492517788 shutdown_connections 2024-09-13T03:01:30.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.006+0000 7f3314d4e700 1 -- 172.21.15.98:0/2492517788 wait complete. 2024-09-13T03:01:30.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3314d4e700 1 Processor -- start 2024-09-13T03:01:30.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3314d4e700 1 -- start start 2024-09-13T03:01:30.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3314d4e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33101004e0 0x7f3310073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:30.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3314d4e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3310100e80 0x7f3310073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:30.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3314d4e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3310073ad0 con 0x7f3310100e80 2024-09-13T03:01:30.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3314d4e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3310073c10 con 0x7f33101004e0 2024-09-13T03:01:30.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3307fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3310100e80 0x7f3310073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:30.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3307fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3310100e80 0x7f3310073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33964/0 (socket says 172.21.15.98:33964) 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3307fff700 1 -- 172.21.15.98:0/3038533844 learned_addr learned my addr 172.21.15.98:0/3038533844 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f330e59c700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33101004e0 0x7f3310073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3307fff700 1 -- 172.21.15.98:0/3038533844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33101004e0 msgr2=0x7f3310073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3307fff700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33101004e0 0x7f3310073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.007+0000 7f3307fff700 1 -- 172.21.15.98:0/3038533844 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000095f0 con 0x7f3310100e80 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.008+0000 7f3307fff700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3310100e80 0x7f3310073590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32f800b480 tx=0x7f32f800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.008+0000 7f33077fe700 1 -- 172.21.15.98:0/3038533844 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f80118c0 con 0x7f3310100e80 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.008+0000 7f33077fe700 1 -- 172.21.15.98:0/3038533844 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32f8010380 con 0x7f3310100e80 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.008+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33101a2160 con 0x7f3310100e80 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.008+0000 7f33077fe700 1 -- 172.21.15.98:0/3038533844 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f800f4f0 con 0x7f3310100e80 2024-09-13T03:01:30.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.008+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33101a2570 con 0x7f3310100e80 2024-09-13T03:01:30.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.009+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33101087f0 con 0x7f3310100e80 2024-09-13T03:01:30.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.009+0000 7f33077fe700 1 -- 172.21.15.98:0/3038533844 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f32f80104f0 con 0x7f3310100e80 2024-09-13T03:01:30.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.010+0000 7f33077fe700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f32fc06e680 0x7f32fc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:30.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.010+0000 7f33077fe700 1 -- 172.21.15.98:0/3038533844 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6446+0+0 (secure 0 0 0) 0x7f32f808e270 con 0x7f3310100e80 2024-09-13T03:01:30.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.010+0000 7f330e59c700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f32fc06e680 0x7f32fc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:30.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.010+0000 7f330e59c700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f32fc06e680 0x7f32fc070b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f330000b5c0 tx=0x7f330001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:30.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.015+0000 7f33077fe700 1 -- 172.21.15.98:0/3038533844 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f32f8057420 con 0x7f3310100e80 2024-09-13T03:01:30.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:29 smithi098 ceph-mon[87325]: pgmap v183: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-13T03:01:30.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.237+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3310061190 con 0x7f32fc06e680 2024-09-13T03:01:30.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.238+0000 7f33077fe700 1 -- 172.21.15.98:0/3038533844 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3310061190 con 0x7f32fc06e680 2024-09-13T03:01:30.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f32fc06e680 msgr2=0x7f32fc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f32fc06e680 0x7f32fc070b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f330000b5c0 tx=0x7f330001a040 comp rx=0 tx=0).stop 2024-09-13T03:01:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3310100e80 msgr2=0x7f3310073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3310100e80 0x7f3310073590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32f800b480 tx=0x7f32f800b840 comp rx=0 tx=0).stop 2024-09-13T03:01:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 shutdown_connections 2024-09-13T03:01:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f32fc06e680 0x7f32fc070b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33101004e0 0x7f3310073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 --2- 172.21.15.98:0/3038533844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3310100e80 0x7f3310073590 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 >> 172.21.15.98:0/3038533844 conn(0x7f33100fbda0 msgr2=0x7f33100fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 shutdown_connections 2024-09-13T03:01:30.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.241+0000 7f3314d4e700 1 -- 172.21.15.98:0/3038533844 wait complete. 2024-09-13T03:01:30.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:29 smithi142 ceph-mon[65447]: pgmap v183: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-13T03:01:30.253 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T03:01:30.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.348+0000 7f81b6486700 1 -- 172.21.15.98:0/321413447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ffd60 msgr2=0x7f81b0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.348+0000 7f81b6486700 1 --2- 172.21.15.98:0/321413447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ffd60 0x7f81b0103d30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009910 tx=0x7f81a4009c20 comp rx=0 tx=0).stop 2024-09-13T03:01:30.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.348+0000 7f81b6486700 1 -- 172.21.15.98:0/321413447 shutdown_connections 2024-09-13T03:01:30.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.348+0000 7f81b6486700 1 --2- 172.21.15.98:0/321413447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ffd60 0x7f81b0103d30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.348+0000 7f81b6486700 1 --2- 172.21.15.98:0/321413447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b00ff3c0 0x7f81b00ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.348+0000 7f81b6486700 1 -- 172.21.15.98:0/321413447 >> 172.21.15.98:0/321413447 conn(0x7f81b00fac80 msgr2=0x7f81b00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:30.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.348+0000 7f81b6486700 1 -- 172.21.15.98:0/321413447 shutdown_connections 2024-09-13T03:01:30.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.348+0000 7f81b6486700 1 -- 172.21.15.98:0/321413447 wait complete. 2024-09-13T03:01:30.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.349+0000 7f81b6486700 1 Processor -- start 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.349+0000 7f81b6486700 1 -- start start 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.349+0000 7f81b6486700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ff3c0 0x7f81b0195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.349+0000 7f81b6486700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b00ffd60 0x7f81b01963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.349+0000 7f81b6486700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b0196a20 con 0x7f81b00ff3c0 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.349+0000 7f81b6486700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b0196b60 con 0x7f81b00ffd60 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81affff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ff3c0 0x7f81b0195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81affff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ff3c0 0x7f81b0195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33988/0 (socket says 172.21.15.98:33988) 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81affff700 1 -- 172.21.15.98:0/1288010716 learned_addr learned my addr 172.21.15.98:0/1288010716 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81af7fe700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b00ffd60 0x7f81b01963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:30.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81affff700 1 -- 172.21.15.98:0/1288010716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b00ffd60 msgr2=0x7f81b01963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81affff700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b00ffd60 0x7f81b01963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81affff700 1 -- 172.21.15.98:0/1288010716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a40095f0 con 0x7f81b00ff3c0 2024-09-13T03:01:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81affff700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ff3c0 0x7f81b0195e90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c930 tx=0x7f81a000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81ad7fa700 1 -- 172.21.15.98:0/1288010716 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a0007ad0 con 0x7f81b00ff3c0 2024-09-13T03:01:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81ad7fa700 1 -- 172.21.15.98:0/1288010716 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81a0007c30 con 0x7f81b00ff3c0 2024-09-13T03:01:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b019a9b0 con 0x7f81b00ff3c0 2024-09-13T03:01:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81ad7fa700 1 -- 172.21.15.98:0/1288010716 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a0018610 con 0x7f81b00ff3c0 2024-09-13T03:01:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.350+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b019af00 con 0x7f81b00ff3c0 2024-09-13T03:01:30.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.351+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b0108740 con 0x7f81b00ff3c0 2024-09-13T03:01:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.352+0000 7f81ad7fa700 1 -- 172.21.15.98:0/1288010716 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f81a000f450 con 0x7f81b00ff3c0 2024-09-13T03:01:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.352+0000 7f81ad7fa700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f819806e680 0x7f8198070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.352+0000 7f81ad7fa700 1 -- 172.21.15.98:0/1288010716 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6446+0+0 (secure 0 0 0) 0x7f81a008e8f0 con 0x7f81b00ff3c0 2024-09-13T03:01:30.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.352+0000 7f81af7fe700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f819806e680 0x7f8198070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:30.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.353+0000 7f81af7fe700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f819806e680 0x7f8198070b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81b01974b0 tx=0x7f81a401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:30.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.357+0000 7f81ad7fa700 1 -- 172.21.15.98:0/1288010716 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f81a0057a20 con 0x7f81b00ff3c0 2024-09-13T03:01:30.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.582+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81b019b180 con 0x7f819806e680 2024-09-13T03:01:30.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.583+0000 7f81ad7fa700 1 -- 172.21.15.98:0/1288010716 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f81b019b180 con 0x7f819806e680 2024-09-13T03:01:30.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f819806e680 msgr2=0x7f8198070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f819806e680 0x7f8198070b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81b01974b0 tx=0x7f81a401a040 comp rx=0 tx=0).stop 2024-09-13T03:01:30.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ff3c0 msgr2=0x7f81b0195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ff3c0 0x7f81b0195e90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c930 tx=0x7f81a000ccf0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 shutdown_connections 2024-09-13T03:01:30.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f819806e680 0x7f8198070b30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81b00ff3c0 0x7f81b0195e90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 --2- 172.21.15.98:0/1288010716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b00ffd60 0x7f81b01963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 >> 172.21.15.98:0/1288010716 conn(0x7f81b00fac80 msgr2=0x7f81b00690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:30.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 shutdown_connections 2024-09-13T03:01:30.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.586+0000 7f81b6486700 1 -- 172.21.15.98:0/1288010716 wait complete. 2024-09-13T03:01:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.691+0000 7f96df0b5700 1 -- 172.21.15.98:0/1879173479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ffd60 msgr2=0x7f96d8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.691+0000 7f96df0b5700 1 --2- 172.21.15.98:0/1879173479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ffd60 0x7f96d8103d30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009910 tx=0x7f96c4009c20 comp rx=0 tx=0).stop 2024-09-13T03:01:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 -- 172.21.15.98:0/1879173479 shutdown_connections 2024-09-13T03:01:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 --2- 172.21.15.98:0/1879173479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ffd60 0x7f96d8103d30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 --2- 172.21.15.98:0/1879173479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96d80ff3c0 0x7f96d80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 -- 172.21.15.98:0/1879173479 >> 172.21.15.98:0/1879173479 conn(0x7f96d80fac80 msgr2=0x7f96d80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 -- 172.21.15.98:0/1879173479 shutdown_connections 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 -- 172.21.15.98:0/1879173479 wait complete. 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 Processor -- start 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 -- start start 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ff3c0 0x7f96d8195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96d80ffd60 0x7f96d81963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d8196aa0 con 0x7f96d80ff3c0 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96df0b5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d819a830 con 0x7f96d80ffd60 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.692+0000 7f96dce51700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ff3c0 0x7f96d8195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96dce51700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ff3c0 0x7f96d8195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34006/0 (socket says 172.21.15.98:34006) 2024-09-13T03:01:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96dce51700 1 -- 172.21.15.98:0/1178852267 learned_addr learned my addr 172.21.15.98:0/1178852267 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96d7fff700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96d80ffd60 0x7f96d81963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96dce51700 1 -- 172.21.15.98:0/1178852267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96d80ffd60 msgr2=0x7f96d81963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96dce51700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96d80ffd60 0x7f96d81963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96dce51700 1 -- 172.21.15.98:0/1178852267 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40095f0 con 0x7f96d80ff3c0 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96d7fff700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96d80ffd60 0x7f96d81963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96dce51700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ff3c0 0x7f96d8195e80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00d8d0 tx=0x7f96cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96d5ffb700 1 -- 172.21.15.98:0/1178852267 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96cc009940 con 0x7f96d80ff3c0 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96d5ffb700 1 -- 172.21.15.98:0/1178852267 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96cc010460 con 0x7f96d80ff3c0 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d819ab10 con 0x7f96d80ff3c0 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96d5ffb700 1 -- 172.21.15.98:0/1178852267 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96cc00f5f0 con 0x7f96d80ff3c0 2024-09-13T03:01:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.693+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d819b060 con 0x7f96d80ff3c0 2024-09-13T03:01:30.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.694+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d804f2a0 con 0x7f96d80ff3c0 2024-09-13T03:01:30.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.695+0000 7f96d5ffb700 1 -- 172.21.15.98:0/1178852267 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f96cc0105d0 con 0x7f96d80ff3c0 2024-09-13T03:01:30.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.695+0000 7f96d5ffb700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f96c806e680 0x7f96c8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:30.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.695+0000 7f96d5ffb700 1 -- 172.21.15.98:0/1178852267 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6446+0+0 (secure 0 0 0) 0x7f96cc08e6f0 con 0x7f96d80ff3c0 2024-09-13T03:01:30.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.695+0000 7f96d7fff700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f96c806e680 0x7f96c8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:30.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.696+0000 7f96d7fff700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f96c806e680 0x7f96c8070b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96d81974a0 tx=0x7f96c401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:30.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.700+0000 7f96d5ffb700 1 -- 172.21.15.98:0/1178852267 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f96cc057820 con 0x7f96d80ff3c0 2024-09-13T03:01:30.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.914+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f96d819b390 con 0x7f96c806e680 2024-09-13T03:01:31.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.923+0000 7f96d5ffb700 1 -- 172.21.15.98:0/1178852267 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f96d819b390 con 0x7f96c806e680 2024-09-13T03:01:31.008 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (6m) 8s ago 16m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (17m) 8s ago 17m 9177k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (16m) 34s ago 16m 8464k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (3m) 8s ago 17m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (3m) 34s ago 16m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (5m) 8s ago 16m 80.3M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (11m) 8s ago 11m 11.6M - 18.2.0 dc2bc1663786 2e922b9685e6 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (14s) 8s ago 11m 13.3M - 19.1.1-322-g7741f7f9 19dc8d659727 8daec38027b8 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (11m) 34s ago 11m 17.1M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (11m) 34s ago 11m 20.5M - 18.2.0 dc2bc1663786 c63878f1490b 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (8m) 8s ago 18m 505M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T03:01:31.009 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (7m) 34s ago 16m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (4m) 8s ago 18m 55.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (4m) 34s ago 15m 41.9M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 8s ago 17m 16.2M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (7m) 34s ago 16m 15.0M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (3m) 8s ago 15m 109M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (2m) 8s ago 14m 110M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (2m) 8s ago 14m 101M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 04c10c8159ba 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (102s) 34s ago 13m 103M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 322e0a9d6b20 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (70s) 34s ago 13m 98.3M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 087c65ddb960 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (37s) 34s ago 13m 12.1M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 31b09c7c1472 2024-09-13T03:01:31.010 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (6m) 8s ago 16m 75.3M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T03:01:31.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f96c806e680 msgr2=0x7f96c8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f96c806e680 0x7f96c8070b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96d81974a0 tx=0x7f96c401a040 comp rx=0 tx=0).stop 2024-09-13T03:01:31.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ff3c0 msgr2=0x7f96d8195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ff3c0 0x7f96d8195e80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00d8d0 tx=0x7f96cc00dc90 comp rx=0 tx=0).stop 2024-09-13T03:01:31.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 shutdown_connections 2024-09-13T03:01:31.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f96c806e680 0x7f96c8070b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96d80ff3c0 0x7f96d8195e80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 --2- 172.21.15.98:0/1178852267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96d80ffd60 0x7f96d81963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 >> 172.21.15.98:0/1178852267 conn(0x7f96d80fac80 msgr2=0x7f96d8068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:31.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 shutdown_connections 2024-09-13T03:01:31.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:30.926+0000 7f96df0b5700 1 -- 172.21.15.98:0/1178852267 wait complete. 2024-09-13T03:01:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.030+0000 7f59ba668700 1 -- 172.21.15.98:0/3890059316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ffd60 msgr2=0x7f59b4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.030+0000 7f59ba668700 1 --2- 172.21.15.98:0/3890059316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ffd60 0x7f59b4103d30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009910 tx=0x7f59a8009c20 comp rx=0 tx=0).stop 2024-09-13T03:01:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.030+0000 7f59ba668700 1 -- 172.21.15.98:0/3890059316 shutdown_connections 2024-09-13T03:01:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.030+0000 7f59ba668700 1 --2- 172.21.15.98:0/3890059316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ffd60 0x7f59b4103d30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.030+0000 7f59ba668700 1 --2- 172.21.15.98:0/3890059316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59b40ff3c0 0x7f59b40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.030+0000 7f59ba668700 1 -- 172.21.15.98:0/3890059316 >> 172.21.15.98:0/3890059316 conn(0x7f59b40fac80 msgr2=0x7f59b40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.030+0000 7f59ba668700 1 -- 172.21.15.98:0/3890059316 shutdown_connections 2024-09-13T03:01:31.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.030+0000 7f59ba668700 1 -- 172.21.15.98:0/3890059316 wait complete. 2024-09-13T03:01:31.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.030+0000 7f59ba668700 1 Processor -- start 2024-09-13T03:01:31.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59ba668700 1 -- start start 2024-09-13T03:01:31.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59ba668700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ff3c0 0x7f59b4194e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:31.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59ba668700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59b40ffd60 0x7f59b4195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:31.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59ba668700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b41959a0 con 0x7f59b40ff3c0 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59ba668700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b4195ae0 con 0x7f59b40ffd60 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ff3c0 0x7f59b4194e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ff3c0 0x7f59b4194e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34022/0 (socket says 172.21.15.98:34022) 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59b3fff700 1 -- 172.21.15.98:0/1100181710 learned_addr learned my addr 172.21.15.98:0/1100181710 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59b37fe700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59b40ffd60 0x7f59b4195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59b3fff700 1 -- 172.21.15.98:0/1100181710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59b40ffd60 msgr2=0x7f59b4195350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59b3fff700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59b40ffd60 0x7f59b4195350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59b3fff700 1 -- 172.21.15.98:0/1100181710 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80095f0 con 0x7f59b40ff3c0 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59b37fe700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59b40ffd60 0x7f59b4195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.031+0000 7f59b3fff700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ff3c0 0x7f59b4194e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59a400c930 tx=0x7f59a400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:31.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.032+0000 7f59b17fa700 1 -- 172.21.15.98:0/1100181710 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59a4007ad0 con 0x7f59b40ff3c0 2024-09-13T03:01:31.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.032+0000 7f59b17fa700 1 -- 172.21.15.98:0/1100181710 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59a4007c30 con 0x7f59b40ff3c0 2024-09-13T03:01:31.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.032+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b4199930 con 0x7f59b40ff3c0 2024-09-13T03:01:31.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.032+0000 7f59b17fa700 1 -- 172.21.15.98:0/1100181710 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59a4018610 con 0x7f59b40ff3c0 2024-09-13T03:01:31.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.032+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b4199e80 con 0x7f59b40ff3c0 2024-09-13T03:01:31.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.033+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b4107730 con 0x7f59b40ff3c0 2024-09-13T03:01:31.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.033+0000 7f59b17fa700 1 -- 172.21.15.98:0/1100181710 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f59a400f450 con 0x7f59b40ff3c0 2024-09-13T03:01:31.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.034+0000 7f59b17fa700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f599c06e680 0x7f599c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:31.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.034+0000 7f59b17fa700 1 -- 172.21.15.98:0/1100181710 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6446+0+0 (secure 0 0 0) 0x7f59a408e8f0 con 0x7f59b40ff3c0 2024-09-13T03:01:31.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.034+0000 7f59b37fe700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f599c06e680 0x7f599c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:31.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.034+0000 7f59b37fe700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f599c06e680 0x7f599c070b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f59a8006010 tx=0x7f59a800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:31.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.038+0000 7f59b17fa700 1 -- 172.21.15.98:0/1100181710 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f59a4057a20 con 0x7f59b40ff3c0 2024-09-13T03:01:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:30 smithi098 ceph-mon[87325]: osdmap e90: 6 total, 6 up, 6 in 2024-09-13T03:01:31.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:30 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi142.wxfmvt=up:active} 2 up:standby 2024-09-13T03:01:31.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:30 smithi142 ceph-mon[65447]: osdmap e90: 6 total, 6 up, 6 in 2024-09-13T03:01:31.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:30 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi142.wxfmvt=up:active} 2 up:standby 2024-09-13T03:01:31.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.321+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f59b4107110 con 0x7f59b40ff3c0 2024-09-13T03:01:31.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.322+0000 7f59b17fa700 1 -- 172.21.15.98:0/1100181710 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f59a405b0e0 con 0x7f59b40ff3c0 2024-09-13T03:01:31.324 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:01:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T03:01:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:01:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:01:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T03:01:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:01:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:01:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T03:01:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:01:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:01:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T03:01:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-13T03:01:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T03:01:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:01:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T03:01:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-13T03:01:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 11 2024-09-13T03:01:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T03:01:31.327 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:01:31.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.324+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f599c06e680 msgr2=0x7f599c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.324+0000 7f59ba668700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f599c06e680 0x7f599c070b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f59a8006010 tx=0x7f59a800b540 comp rx=0 tx=0).stop 2024-09-13T03:01:31.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.324+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ff3c0 msgr2=0x7f59b4194e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.324+0000 7f59ba668700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ff3c0 0x7f59b4194e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59a400c930 tx=0x7f59a400ccf0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.325+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 shutdown_connections 2024-09-13T03:01:31.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.325+0000 7f59ba668700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f599c06e680 0x7f599c070b30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.325+0000 7f59ba668700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59b40ff3c0 0x7f59b4194e10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.325+0000 7f59ba668700 1 --2- 172.21.15.98:0/1100181710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59b40ffd60 0x7f59b4195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.325+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 >> 172.21.15.98:0/1100181710 conn(0x7f59b40fac80 msgr2=0x7f59b40fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:31.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.325+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 shutdown_connections 2024-09-13T03:01:31.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.325+0000 7f59ba668700 1 -- 172.21.15.98:0/1100181710 wait complete. 2024-09-13T03:01:31.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.430+0000 7f98d935c700 1 -- 172.21.15.98:0/3715377861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 msgr2=0x7f98d40ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.430+0000 7f98d935c700 1 --2- 172.21.15.98:0/3715377861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 0x7f98d40ff790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009910 tx=0x7f98c8009c20 comp rx=0 tx=0).stop 2024-09-13T03:01:31.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.430+0000 7f98d935c700 1 -- 172.21.15.98:0/3715377861 shutdown_connections 2024-09-13T03:01:31.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.430+0000 7f98d935c700 1 --2- 172.21.15.98:0/3715377861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98d40ffd60 0x7f98d4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.430+0000 7f98d935c700 1 --2- 172.21.15.98:0/3715377861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 0x7f98d40ff790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.430+0000 7f98d935c700 1 -- 172.21.15.98:0/3715377861 >> 172.21.15.98:0/3715377861 conn(0x7f98d40fac80 msgr2=0x7f98d40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:31.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.430+0000 7f98d935c700 1 -- 172.21.15.98:0/3715377861 shutdown_connections 2024-09-13T03:01:31.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.430+0000 7f98d935c700 1 -- 172.21.15.98:0/3715377861 wait complete. 2024-09-13T03:01:31.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d935c700 1 Processor -- start 2024-09-13T03:01:31.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d935c700 1 -- start start 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d935c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 0x7f98d4196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d935c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98d40ffd60 0x7f98d4197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d935c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d41977a0 con 0x7f98d40ff3c0 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d935c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4197910 con 0x7f98d40ffd60 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 0x7f98d4196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 0x7f98d4196cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34048/0 (socket says 172.21.15.98:34048) 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d2ffd700 1 -- 172.21.15.98:0/3013174142 learned_addr learned my addr 172.21.15.98:0/3013174142 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.431+0000 7f98d27fc700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98d40ffd60 0x7f98d4197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.432+0000 7f98d2ffd700 1 -- 172.21.15.98:0/3013174142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98d40ffd60 msgr2=0x7f98d4197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.432+0000 7f98d2ffd700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98d40ffd60 0x7f98d4197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.432+0000 7f98d2ffd700 1 -- 172.21.15.98:0/3013174142 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c80095f0 con 0x7f98d40ff3c0 2024-09-13T03:01:31.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.432+0000 7f98d2ffd700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 0x7f98d4196cd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98c8006010 tx=0x7f98c800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:31.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.432+0000 7f98bbfff700 1 -- 172.21.15.98:0/3013174142 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98c801d070 con 0x7f98d40ff3c0 2024-09-13T03:01:31.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.432+0000 7f98bbfff700 1 -- 172.21.15.98:0/3013174142 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98c800f460 con 0x7f98d40ff3c0 2024-09-13T03:01:31.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.432+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d419fd40 con 0x7f98d40ff3c0 2024-09-13T03:01:31.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.432+0000 7f98bbfff700 1 -- 172.21.15.98:0/3013174142 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98c8017630 con 0x7f98d40ff3c0 2024-09-13T03:01:31.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.432+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d41a00f0 con 0x7f98d40ff3c0 2024-09-13T03:01:31.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.433+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d41076d0 con 0x7f98d40ff3c0 2024-09-13T03:01:31.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.433+0000 7f98bbfff700 1 -- 172.21.15.98:0/3013174142 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f98c800f5d0 con 0x7f98d40ff3c0 2024-09-13T03:01:31.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.434+0000 7f98bbfff700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f98bc06e680 0x7f98bc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:31.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.434+0000 7f98bbfff700 1 -- 172.21.15.98:0/3013174142 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6446+0+0 (secure 0 0 0) 0x7f98c808fb40 con 0x7f98d40ff3c0 2024-09-13T03:01:31.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.434+0000 7f98d27fc700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f98bc06e680 0x7f98bc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:31.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.434+0000 7f98d27fc700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f98bc06e680 0x7f98bc070b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98d40696a0 tx=0x7f98c400a380 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:31.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.438+0000 7f98bbfff700 1 -- 172.21.15.98:0/3013174142 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f98c8058cf0 con 0x7f98d40ff3c0 2024-09-13T03:01:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.683+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f98d41070b0 con 0x7f98d40ff3c0 2024-09-13T03:01:31.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.683+0000 7f98bbfff700 1 -- 172.21.15.98:0/3013174142 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1751 (secure 0 0 0) 0x7f98c805c3b0 con 0x7f98d40ff3c0 2024-09-13T03:01:31.685 INFO:teuthology.orchestra.run.smithi098.stdout:e22 2024-09-13T03:01:31.685 INFO:teuthology.orchestra.run.smithi098.stdout:btime 2024-09-13T03:01:29:932248+0000 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 21 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T03:01:31.686 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T03:01:17.863320+0000 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 86 2024-09-13T03:01:31.687 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=24269} 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T03:01:31.688 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T03:01:31.689 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T03:01:31.689 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 24269 members: 24269 2024-09-13T03:01:31.689 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{0:24269} state up:active seq 173 join_fscid=1 addr [v2:172.21.15.142:6824/2448398872,v1:172.21.15.142:6825/2448398872] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:01:31.689 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:01:31.689 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:01:31.689 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T03:01:31.689 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:01:31.689 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:24285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:01:31.689 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:01:31.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.686+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f98bc06e680 msgr2=0x7f98bc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.686+0000 7f98d935c700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f98bc06e680 0x7f98bc070b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98d40696a0 tx=0x7f98c400a380 comp rx=0 tx=0).stop 2024-09-13T03:01:31.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.687+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 msgr2=0x7f98d4196cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.687+0000 7f98d935c700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 0x7f98d4196cd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98c8006010 tx=0x7f98c800bd70 comp rx=0 tx=0).stop 2024-09-13T03:01:31.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.687+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 shutdown_connections 2024-09-13T03:01:31.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.687+0000 7f98d935c700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f98bc06e680 0x7f98bc070b30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.687+0000 7f98d935c700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d40ff3c0 0x7f98d4196cd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.687+0000 7f98d935c700 1 --2- 172.21.15.98:0/3013174142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98d40ffd60 0x7f98d4197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.687+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 >> 172.21.15.98:0/3013174142 conn(0x7f98d40fac80 msgr2=0x7f98d40fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:31.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.687+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 shutdown_connections 2024-09-13T03:01:31.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.687+0000 7f98d935c700 1 -- 172.21.15.98:0/3013174142 wait complete. 2024-09-13T03:01:31.691 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 22 2024-09-13T03:01:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.792+0000 7f0c6ce47700 1 -- 172.21.15.98:0/3897180301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 msgr2=0x7f0c68103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.792+0000 7f0c6ce47700 1 --2- 172.21.15.98:0/3897180301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 0x7f0c68103d20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009910 tx=0x7f0c58009c20 comp rx=0 tx=0).stop 2024-09-13T03:01:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.792+0000 7f0c6ce47700 1 -- 172.21.15.98:0/3897180301 shutdown_connections 2024-09-13T03:01:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.792+0000 7f0c6ce47700 1 --2- 172.21.15.98:0/3897180301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 0x7f0c68103d20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.792+0000 7f0c6ce47700 1 --2- 172.21.15.98:0/3897180301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c680ff3b0 0x7f0c680ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.792+0000 7f0c6ce47700 1 -- 172.21.15.98:0/3897180301 >> 172.21.15.98:0/3897180301 conn(0x7f0c680fac90 msgr2=0x7f0c680fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.792+0000 7f0c6ce47700 1 -- 172.21.15.98:0/3897180301 shutdown_connections 2024-09-13T03:01:31.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.792+0000 7f0c6ce47700 1 -- 172.21.15.98:0/3897180301 wait complete. 2024-09-13T03:01:31.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.793+0000 7f0c6ce47700 1 Processor -- start 2024-09-13T03:01:31.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.793+0000 7f0c6ce47700 1 -- start start 2024-09-13T03:01:31.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.793+0000 7f0c6ce47700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c680ff3b0 0x7f0c68194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:31.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.793+0000 7f0c6ce47700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 0x7f0c68195410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:31.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.793+0000 7f0c6ce47700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68195af0 con 0x7f0c680ffd50 2024-09-13T03:01:31.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.793+0000 7f0c6ce47700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68199880 con 0x7f0c680ff3b0 2024-09-13T03:01:31.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.793+0000 7f0c65d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 0x7f0c68195410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:31.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.793+0000 7f0c65d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 0x7f0c68195410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34074/0 (socket says 172.21.15.98:34074) 2024-09-13T03:01:31.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.793+0000 7f0c65d9b700 1 -- 172.21.15.98:0/1455098488 learned_addr learned my addr 172.21.15.98:0/1455098488 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:01:31.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c6659c700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c680ff3b0 0x7f0c68194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:31.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c65d9b700 1 -- 172.21.15.98:0/1455098488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c680ff3b0 msgr2=0x7f0c68194ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c65d9b700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c680ff3b0 0x7f0c68194ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c65d9b700 1 -- 172.21.15.98:0/1455098488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580095f0 con 0x7f0c680ffd50 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c65d9b700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 0x7f0c68195410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800bda0 tx=0x7f0c5800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c577fe700 1 -- 172.21.15.98:0/1455098488 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5801f070 con 0x7f0c680ffd50 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c68199b00 con 0x7f0c680ffd50 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c577fe700 1 -- 172.21.15.98:0/1455098488 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c58003680 con 0x7f0c680ffd50 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c577fe700 1 -- 172.21.15.98:0/1455098488 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5800f690 con 0x7f0c680ffd50 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.794+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c68199ff0 con 0x7f0c680ffd50 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.795+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6804f2a0 con 0x7f0c680ffd50 2024-09-13T03:01:31.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.796+0000 7f0c577fe700 1 -- 172.21.15.98:0/1455098488 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0c58003c60 con 0x7f0c680ffd50 2024-09-13T03:01:31.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.796+0000 7f0c577fe700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0c5006e680 0x7f0c50070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:31.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.796+0000 7f0c577fe700 1 -- 172.21.15.98:0/1455098488 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6446+0+0 (secure 0 0 0) 0x7f0c58091c50 con 0x7f0c680ffd50 2024-09-13T03:01:31.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.796+0000 7f0c6659c700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0c5006e680 0x7f0c50070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:31.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.796+0000 7f0c6659c700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0c5006e680 0x7f0c50070b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006fd0 tx=0x7f0c5c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:31.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:31.800+0000 7f0c577fe700 1 -- 172.21.15.98:0/1455098488 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0c5805ace0 con 0x7f0c680ffd50 2024-09-13T03:01:32.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.023+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c6819a2f0 con 0x7f0c5006e680 2024-09-13T03:01:32.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.025+0000 7f0c577fe700 1 -- 172.21.15.98:0/1455098488 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0c6819a2f0 con 0x7f0c5006e680 2024-09-13T03:01:32.026 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:01:32.026 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "osd", 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "13/23 daemons upgraded", 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T03:01:32.027 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T03:01:32.028 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:01:32.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0c5006e680 msgr2=0x7f0c50070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0c5006e680 0x7f0c50070b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006fd0 tx=0x7f0c5c008040 comp rx=0 tx=0).stop 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 msgr2=0x7f0c68195410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 0x7f0c68195410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800bda0 tx=0x7f0c5800be80 comp rx=0 tx=0).stop 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 shutdown_connections 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0c5006e680 0x7f0c50070b30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c680ff3b0 0x7f0c68194ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 --2- 172.21.15.98:0/1455098488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c680ffd50 0x7f0c68195410 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 >> 172.21.15.98:0/1455098488 conn(0x7f0c680fac90 msgr2=0x7f0c680fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 shutdown_connections 2024-09-13T03:01:32.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.027+0000 7f0c6ce47700 1 -- 172.21.15.98:0/1455098488 wait complete. 2024-09-13T03:01:32.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.131+0000 7f7df6478700 1 -- 172.21.15.98:0/2069775166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 msgr2=0x7f7df0100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.131+0000 7f7df6478700 1 --2- 172.21.15.98:0/2069775166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 0x7f7df0100830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009940 tx=0x7f7de0009c50 comp rx=0 tx=0).stop 2024-09-13T03:01:32.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.131+0000 7f7df6478700 1 -- 172.21.15.98:0/2069775166 shutdown_connections 2024-09-13T03:01:32.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.131+0000 7f7df6478700 1 --2- 172.21.15.98:0/2069775166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7df0100d70 0x7f7df01094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.131+0000 7f7df6478700 1 --2- 172.21.15.98:0/2069775166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 0x7f7df0100830 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.131+0000 7f7df6478700 1 -- 172.21.15.98:0/2069775166 >> 172.21.15.98:0/2069775166 conn(0x7f7df00748b0 msgr2=0x7f7df0074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:32.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.131+0000 7f7df6478700 1 -- 172.21.15.98:0/2069775166 shutdown_connections 2024-09-13T03:01:32.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.131+0000 7f7df6478700 1 -- 172.21.15.98:0/2069775166 wait complete. 2024-09-13T03:01:32.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.132+0000 7f7df6478700 1 Processor -- start 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.132+0000 7f7df6478700 1 -- start start 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.132+0000 7f7df6478700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 0x7f7df0196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.132+0000 7f7df6478700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7df0100d70 0x7f7df01970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.132+0000 7f7df6478700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0197710 con 0x7f7df0100460 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.132+0000 7f7df6478700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0197880 con 0x7f7df0100d70 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7deffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 0x7f7df0196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7deffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 0x7f7df0196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34086/0 (socket says 172.21.15.98:34086) 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7deffff700 1 -- 172.21.15.98:0/1332846813 learned_addr learned my addr 172.21.15.98:0/1332846813 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7def7fe700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7df0100d70 0x7f7df01970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:32.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7deffff700 1 -- 172.21.15.98:0/1332846813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7df0100d70 msgr2=0x7f7df01970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7deffff700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7df0100d70 0x7f7df01970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7deffff700 1 -- 172.21.15.98:0/1332846813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00095f0 con 0x7f7df0100460 2024-09-13T03:01:32.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7deffff700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 0x7f7df0196bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7de00055f0 tx=0x7f7de0005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:32.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7ded7fa700 1 -- 172.21.15.98:0/1332846813 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7de001d070 con 0x7f7df0100460 2024-09-13T03:01:32.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7ded7fa700 1 -- 172.21.15.98:0/1332846813 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7de0005dc0 con 0x7f7df0100460 2024-09-13T03:01:32.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df019fc20 con 0x7f7df0100460 2024-09-13T03:01:32.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7ded7fa700 1 -- 172.21.15.98:0/1332846813 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7de000fe40 con 0x7f7df0100460 2024-09-13T03:01:32.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.133+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df01a0110 con 0x7f7df0100460 2024-09-13T03:01:32.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.134+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df0106bd0 con 0x7f7df0100460 2024-09-13T03:01:32.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.135+0000 7f7ded7fa700 1 -- 172.21.15.98:0/1332846813 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7de000f680 con 0x7f7df0100460 2024-09-13T03:01:32.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.135+0000 7f7ded7fa700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7dd806e680 0x7f7dd8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:32.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.135+0000 7f7def7fe700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7dd806e680 0x7f7dd8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:32.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.135+0000 7f7ded7fa700 1 -- 172.21.15.98:0/1332846813 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6446+0+0 (secure 0 0 0) 0x7f7de008f900 con 0x7f7df0100460 2024-09-13T03:01:32.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.136+0000 7f7def7fe700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7dd806e680 0x7f7dd8070b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7df00ffc20 tx=0x7f7de40073d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:32.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.140+0000 7f7ded7fa700 1 -- 172.21.15.98:0/1332846813 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7de0058a30 con 0x7f7df0100460 2024-09-13T03:01:32.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:31 smithi098 ceph-mon[87325]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:31 smithi098 ceph-mon[87325]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:31 smithi098 ceph-mon[87325]: pgmap v185: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-13T03:01:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:31 smithi098 ceph-mon[87325]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:31 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1100181710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:31 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3013174142' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:01:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:31 smithi142 ceph-mon[65447]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:31 smithi142 ceph-mon[65447]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:31 smithi142 ceph-mon[65447]: pgmap v185: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-13T03:01:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:31 smithi142 ceph-mon[65447]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:31 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1100181710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:31 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3013174142' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:01:32.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.423+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7df01065b0 con 0x7f7df0100460 2024-09-13T03:01:32.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.423+0000 7f7ded7fa700 1 -- 172.21.15.98:0/1332846813 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7de005c0f0 con 0x7f7df0100460 2024-09-13T03:01:32.425 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T03:01:32.425 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:01:32.425 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:01:32.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.425+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7dd806e680 msgr2=0x7f7dd8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.425+0000 7f7df6478700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7dd806e680 0x7f7dd8070b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7df00ffc20 tx=0x7f7de40073d0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.425+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 msgr2=0x7f7df0196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.425+0000 7f7df6478700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 0x7f7df0196bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7de00055f0 tx=0x7f7de0005620 comp rx=0 tx=0).stop 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.426+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 shutdown_connections 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.426+0000 7f7df6478700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f7dd806e680 0x7f7dd8070b30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.426+0000 7f7df6478700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7df0100460 0x7f7df0196bb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.426+0000 7f7df6478700 1 --2- 172.21.15.98:0/1332846813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7df0100d70 0x7f7df01970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.426+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 >> 172.21.15.98:0/1332846813 conn(0x7f7df00748b0 msgr2=0x7f7df0103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.426+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 shutdown_connections 2024-09-13T03:01:32.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:01:32.426+0000 7f7df6478700 1 -- 172.21.15.98:0/1332846813 wait complete. 2024-09-13T03:01:33.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:32 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1332846813' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:01:33.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:32 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1332846813' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:01:34.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:33 smithi098 ceph-mon[87325]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:34.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:33 smithi098 ceph-mon[87325]: pgmap v186: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 307 B/s rd, 204 B/s wr, 0 op/s 2024-09-13T03:01:34.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T03:01:34.162 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:33 smithi142 ceph-mon[65447]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:33 smithi142 ceph-mon[65447]: pgmap v186: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 307 B/s rd, 204 B/s wr, 0 op/s 2024-09-13T03:01:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T03:01:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:35.222 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:34 smithi098 ceph-mon[87325]: pgmap v187: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:35.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:34 smithi142 ceph-mon[65447]: pgmap v187: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:36 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:36 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:36 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:36 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.98:6828/3981027621,v1:172.21.15.98:6829/3981027621] up:boot 2024-09-13T03:01:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:36 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi142.wxfmvt=up:active} 3 up:standby 2024-09-13T03:01:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:36 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T03:01:37.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:36 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:37.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:36 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:37.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:36 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:37.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:36 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.98:6828/3981027621,v1:172.21.15.98:6829/3981027621] up:boot 2024-09-13T03:01:37.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:36 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi142.wxfmvt=up:active} 3 up:standby 2024-09-13T03:01:37.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:36 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T03:01:37.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:37 smithi098 ceph-mon[87325]: pgmap v188: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:37.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:37 smithi142 ceph-mon[65447]: pgmap v188: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:40.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:39 smithi098 ceph-mon[87325]: pgmap v189: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:39 smithi142 ceph-mon[65447]: pgmap v189: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:41.160 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:41 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:41.160 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:41 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:41.160 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:41 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:41.160 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:41 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:41.160 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:41 smithi098 ceph-mon[87325]: pgmap v190: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:41.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:41 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:41.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:41 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:41.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:41 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:41.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:41 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:41.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:41 smithi142 ceph-mon[65447]: pgmap v190: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:44.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:43 smithi098 ceph-mon[87325]: pgmap v191: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:44.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:44.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:44.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:44.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:43 smithi142 ceph-mon[65447]: pgmap v191: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:44.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:44.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:44.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:44.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:44.913 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:44 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:44.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:44 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:44.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:44 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:44.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:44 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:44.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:44 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:44.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:44 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:44 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:44 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:44 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:44 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:44 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:45.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:44 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:45.921 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:45 smithi142 ceph-mon[65447]: pgmap v192: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:45.921 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:45 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:45.921 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:45 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.wxfmvt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:45.921 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:45 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:46.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:45 smithi098 ceph-mon[87325]: pgmap v192: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:45 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:45 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.wxfmvt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:45 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:47.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:46 smithi142 ceph-mon[65447]: Upgrade: Updating mds.cephfs.smithi142.wxfmvt 2024-09-13T03:01:47.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:46 smithi142 ceph-mon[65447]: Deploying daemon mds.cephfs.smithi142.wxfmvt on smithi142 2024-09-13T03:01:47.105 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:46 smithi098 ceph-mon[87325]: Upgrade: Updating mds.cephfs.smithi142.wxfmvt 2024-09-13T03:01:47.105 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:46 smithi098 ceph-mon[87325]: Deploying daemon mds.cephfs.smithi142.wxfmvt on smithi142 2024-09-13T03:01:47.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:47 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[87321]: 2024-09-13T03:01:47.103+0000 7f6bf01fb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:01:48.090 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:47 smithi142 ceph-mon[65447]: pgmap v193: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:48.090 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:47 smithi142 ceph-mon[65447]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T03:01:48.090 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:47 smithi142 ceph-mon[65447]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:01:48.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:47 smithi142 ceph-mon[65447]: osdmap e91: 6 total, 6 up, 6 in 2024-09-13T03:01:48.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:47 smithi142 ceph-mon[65447]: Standby daemon mds.cephfs.smithi142.hplrrs assigned to filesystem cephfs as rank 0 2024-09-13T03:01:48.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:47 smithi142 ceph-mon[65447]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T03:01:48.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:47 smithi142 ceph-mon[65447]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T03:01:48.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:47 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi142.hplrrs=up:replay} 2 up:standby 2024-09-13T03:01:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:47 smithi098 ceph-mon[87325]: pgmap v193: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-13T03:01:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:47 smithi098 ceph-mon[87325]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T03:01:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:47 smithi098 ceph-mon[87325]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:01:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:47 smithi098 ceph-mon[87325]: osdmap e91: 6 total, 6 up, 6 in 2024-09-13T03:01:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:47 smithi098 ceph-mon[87325]: Standby daemon mds.cephfs.smithi142.hplrrs assigned to filesystem cephfs as rank 0 2024-09-13T03:01:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:47 smithi098 ceph-mon[87325]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T03:01:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:47 smithi098 ceph-mon[87325]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T03:01:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:47 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi142.hplrrs=up:replay} 2 up:standby 2024-09-13T03:01:50.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:50.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:49 smithi142 ceph-mon[65447]: pgmap v195: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 820 KiB/s rd, 0 op/s 2024-09-13T03:01:50.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:49 smithi098 ceph-mon[87325]: pgmap v195: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 820 KiB/s rd, 0 op/s 2024-09-13T03:01:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:51 smithi098 ceph-mon[87325]: pgmap v196: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1 op/s 2024-09-13T03:01:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:51 smithi142 ceph-mon[65447]: pgmap v196: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1 op/s 2024-09-13T03:01:54.214 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:53 smithi142 ceph-mon[65447]: pgmap v197: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-13T03:01:54.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:53 smithi098 ceph-mon[87325]: pgmap v197: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-13T03:01:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:55 smithi098 ceph-mon[87325]: pgmap v198: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-13T03:01:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:55 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.142:6824/2834620980,v1:172.21.15.142:6825/2834620980] up:boot 2024-09-13T03:01:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:55 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi142.hplrrs=up:replay} 3 up:standby 2024-09-13T03:01:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T03:01:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:55 smithi142 ceph-mon[65447]: pgmap v198: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-13T03:01:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:55 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.142:6824/2834620980,v1:172.21.15.142:6825/2834620980] up:boot 2024-09-13T03:01:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:55 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi142.hplrrs=up:replay} 3 up:standby 2024-09-13T03:01:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T03:01:56.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:56.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:56.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:57 smithi142 ceph-mon[65447]: pgmap v199: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-13T03:01:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:57 smithi142 ceph-mon[65447]: reconnect by client.24313 192.168.0.1:0/3572139203 after 0.000999981 2024-09-13T03:01:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:57 smithi142 ceph-mon[65447]: reconnect by client.14508 192.168.0.1:0/3551376023 after 0.000999981 2024-09-13T03:01:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:57 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] up:reconnect 2024-09-13T03:01:58.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:57 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi142.hplrrs=up:reconnect} 3 up:standby 2024-09-13T03:01:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:57 smithi098 ceph-mon[87325]: pgmap v199: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-13T03:01:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:57 smithi098 ceph-mon[87325]: reconnect by client.24313 192.168.0.1:0/3572139203 after 0.000999981 2024-09-13T03:01:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:57 smithi098 ceph-mon[87325]: reconnect by client.14508 192.168.0.1:0/3551376023 after 0.000999981 2024-09-13T03:01:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:57 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] up:reconnect 2024-09-13T03:01:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:57 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi142.hplrrs=up:reconnect} 3 up:standby 2024-09-13T03:01:59.096 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:58 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] up:rejoin 2024-09-13T03:01:59.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:58 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi142.hplrrs=up:rejoin} 3 up:standby 2024-09-13T03:01:59.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:58 smithi142 ceph-mon[65447]: daemon mds.cephfs.smithi142.hplrrs is now active in filesystem cephfs as rank 0 2024-09-13T03:01:59.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:58 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:59.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:58 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:59.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:58 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:59.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:58 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:59.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:58 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] up:rejoin 2024-09-13T03:01:59.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:58 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi142.hplrrs=up:rejoin} 3 up:standby 2024-09-13T03:01:59.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:58 smithi098 ceph-mon[87325]: daemon mds.cephfs.smithi142.hplrrs is now active in filesystem cephfs as rank 0 2024-09-13T03:01:59.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:59.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:59.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:01:59.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:58 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:00.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:59 smithi142 ceph-mon[65447]: pgmap v200: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-13T03:02:00.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:59 smithi142 ceph-mon[65447]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T03:02:00.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:59 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] up:active 2024-09-13T03:02:00.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:01:59 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi142.hplrrs=up:active} 3 up:standby 2024-09-13T03:02:00.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:59 smithi098 ceph-mon[87325]: pgmap v200: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-13T03:02:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:59 smithi098 ceph-mon[87325]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T03:02:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:59 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] up:active 2024-09-13T03:02:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:01:59 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi142.hplrrs=up:active} 3 up:standby 2024-09-13T03:02:02.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:01 smithi098 ceph-mon[87325]: pgmap v201: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2024-09-13T03:02:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:01 smithi142 ceph-mon[65447]: pgmap v201: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2024-09-13T03:02:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 -- 172.21.15.98:0/1534250658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 msgr2=0x7fe22c10a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 --2- 172.21.15.98:0/1534250658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 0x7fe22c10a6e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe214009910 tx=0x7fe214009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 -- 172.21.15.98:0/1534250658 shutdown_connections 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 --2- 172.21.15.98:0/1534250658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 0x7fe22c10a6e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 --2- 172.21.15.98:0/1534250658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0ff360 0x7fe22c0ff730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 -- 172.21.15.98:0/1534250658 >> 172.21.15.98:0/1534250658 conn(0x7fe22c0748c0 msgr2=0x7fe22c074cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 -- 172.21.15.98:0/1534250658 shutdown_connections 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 -- 172.21.15.98:0/1534250658 wait complete. 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 Processor -- start 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.545+0000 7fe23208d700 1 -- start start 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe23208d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0ff360 0x7fe22c195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe23208d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 0x7fe22c196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe23208d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c196b20 con 0x7fe22c0ffc70 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe23208d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c19a860 con 0x7fe22c0ff360 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe223fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 0x7fe22c196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe223fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 0x7fe22c196440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35824/0 (socket says 172.21.15.98:35824) 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe223fff700 1 -- 172.21.15.98:0/3075093299 learned_addr learned my addr 172.21.15.98:0/3075093299 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe22b7fe700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0ff360 0x7fe22c195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe223fff700 1 -- 172.21.15.98:0/3075093299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0ff360 msgr2=0x7fe22c195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe223fff700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0ff360 0x7fe22c195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe223fff700 1 -- 172.21.15.98:0/3075093299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2140095f0 con 0x7fe22c0ffc70 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe22b7fe700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0ff360 0x7fe22c195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:02:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe223fff700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 0x7fe22c196440 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe214006010 tx=0x7fe21400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe2297fa700 1 -- 172.21.15.98:0/3075093299 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21401d070 con 0x7fe22c0ffc70 2024-09-13T03:02:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe2297fa700 1 -- 172.21.15.98:0/3075093299 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe214004fb0 con 0x7fe22c0ffc70 2024-09-13T03:02:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c19ab40 con 0x7fe22c0ffc70 2024-09-13T03:02:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.546+0000 7fe2297fa700 1 -- 172.21.15.98:0/3075093299 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe214022ea0 con 0x7fe22c0ffc70 2024-09-13T03:02:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.547+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c19b090 con 0x7fe22c0ffc70 2024-09-13T03:02:02.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.547+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c107de0 con 0x7fe22c0ffc70 2024-09-13T03:02:02.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.548+0000 7fe2297fa700 1 -- 172.21.15.98:0/3075093299 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe214022470 con 0x7fe22c0ffc70 2024-09-13T03:02:02.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.548+0000 7fe2297fa700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe21806e680 0x7fe218070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:02.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.549+0000 7fe2297fa700 1 -- 172.21.15.98:0/3075093299 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe21408fc20 con 0x7fe22c0ffc70 2024-09-13T03:02:02.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.549+0000 7fe22b7fe700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe21806e680 0x7fe218070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:02.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.549+0000 7fe22b7fe700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe21806e680 0x7fe218070b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0099d0 tx=0x7fe21c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:02.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.553+0000 7fe2297fa700 1 -- 172.21.15.98:0/3075093299 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe214058d80 con 0x7fe22c0ffc70 2024-09-13T03:02:02.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.772+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe22c19b3c0 con 0x7fe21806e680 2024-09-13T03:02:02.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.773+0000 7fe2297fa700 1 -- 172.21.15.98:0/3075093299 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe22c19b3c0 con 0x7fe21806e680 2024-09-13T03:02:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.775+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe21806e680 msgr2=0x7fe218070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.775+0000 7fe23208d700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe21806e680 0x7fe218070b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0099d0 tx=0x7fe21c008040 comp rx=0 tx=0).stop 2024-09-13T03:02:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.775+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 msgr2=0x7fe22c196440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.775+0000 7fe23208d700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 0x7fe22c196440 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe214006010 tx=0x7fe21400be20 comp rx=0 tx=0).stop 2024-09-13T03:02:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.776+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 shutdown_connections 2024-09-13T03:02:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.776+0000 7fe23208d700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe21806e680 0x7fe218070b30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.776+0000 7fe23208d700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c0ff360 0x7fe22c195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.776+0000 7fe23208d700 1 --2- 172.21.15.98:0/3075093299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe22c0ffc70 0x7fe22c196440 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.776+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 >> 172.21.15.98:0/3075093299 conn(0x7fe22c0748c0 msgr2=0x7fe22c104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.776+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 shutdown_connections 2024-09-13T03:02:02.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.776+0000 7fe23208d700 1 -- 172.21.15.98:0/3075093299 wait complete. 2024-09-13T03:02:02.787 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T03:02:02.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.883+0000 7f5095d7a700 1 -- 172.21.15.98:0/56516008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ffd60 msgr2=0x7f5090103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.883+0000 7f5095d7a700 1 --2- 172.21.15.98:0/56516008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ffd60 0x7f5090103d30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5084009910 tx=0x7f5084009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:02.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.883+0000 7f5095d7a700 1 -- 172.21.15.98:0/56516008 shutdown_connections 2024-09-13T03:02:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.883+0000 7f5095d7a700 1 --2- 172.21.15.98:0/56516008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ffd60 0x7f5090103d30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.883+0000 7f5095d7a700 1 --2- 172.21.15.98:0/56516008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50900ff3c0 0x7f50900ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.883+0000 7f5095d7a700 1 -- 172.21.15.98:0/56516008 >> 172.21.15.98:0/56516008 conn(0x7f50900fac80 msgr2=0x7f50900fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.883+0000 7f5095d7a700 1 -- 172.21.15.98:0/56516008 shutdown_connections 2024-09-13T03:02:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.884+0000 7f5095d7a700 1 -- 172.21.15.98:0/56516008 wait complete. 2024-09-13T03:02:02.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.884+0000 7f5095d7a700 1 Processor -- start 2024-09-13T03:02:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.884+0000 7f5095d7a700 1 -- start start 2024-09-13T03:02:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.884+0000 7f5095d7a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ff3c0 0x7f5090196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.884+0000 7f5095d7a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50900ffd60 0x7f5090196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f5095d7a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5090196c20 con 0x7f50900ff3c0 2024-09-13T03:02:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f5095d7a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509019a9b0 con 0x7f50900ffd60 2024-09-13T03:02:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ff3c0 0x7f5090196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508f7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ff3c0 0x7f5090196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35844/0 (socket says 172.21.15.98:35844) 2024-09-13T03:02:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508f7fe700 1 -- 172.21.15.98:0/3556212452 learned_addr learned my addr 172.21.15.98:0/3556212452 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:02.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508effd700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50900ffd60 0x7f5090196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508f7fe700 1 -- 172.21.15.98:0/3556212452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50900ffd60 msgr2=0x7f5090196540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508f7fe700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50900ffd60 0x7f5090196540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508f7fe700 1 -- 172.21.15.98:0/3556212452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840095f0 con 0x7f50900ff3c0 2024-09-13T03:02:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508effd700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50900ffd60 0x7f5090196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:02:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508f7fe700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ff3c0 0x7f5090196000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f508000b4b0 tx=0x7f508000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508cff9700 1 -- 172.21.15.98:0/3556212452 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5080011800 con 0x7f50900ff3c0 2024-09-13T03:02:02.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508cff9700 1 -- 172.21.15.98:0/3556212452 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5080011e20 con 0x7f50900ff3c0 2024-09-13T03:02:02.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509019ac90 con 0x7f50900ff3c0 2024-09-13T03:02:02.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f508cff9700 1 -- 172.21.15.98:0/3556212452 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f508000f2e0 con 0x7f50900ff3c0 2024-09-13T03:02:02.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.885+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509019b1e0 con 0x7f50900ff3c0 2024-09-13T03:02:02.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.886+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509004f2a0 con 0x7f50900ff3c0 2024-09-13T03:02:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.887+0000 7f508cff9700 1 -- 172.21.15.98:0/3556212452 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5080010380 con 0x7f50900ff3c0 2024-09-13T03:02:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.887+0000 7f508cff9700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f507806e680 0x7f5078070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.888+0000 7f508cff9700 1 -- 172.21.15.98:0/3556212452 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f508008e250 con 0x7f50900ff3c0 2024-09-13T03:02:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.888+0000 7f508effd700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f507806e680 0x7f5078070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:02.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.888+0000 7f508effd700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f507806e680 0x7f5078070b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5090197620 tx=0x7f508401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:02.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:02.892+0000 7f508cff9700 1 -- 172.21.15.98:0/3556212452 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5080057450 con 0x7f50900ff3c0 2024-09-13T03:02:03.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.113+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f509019b520 con 0x7f507806e680 2024-09-13T03:02:03.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.114+0000 7f508cff9700 1 -- 172.21.15.98:0/3556212452 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f509019b520 con 0x7f507806e680 2024-09-13T03:02:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.116+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f507806e680 msgr2=0x7f5078070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.116+0000 7f5095d7a700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f507806e680 0x7f5078070b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5090197620 tx=0x7f508401a040 comp rx=0 tx=0).stop 2024-09-13T03:02:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.116+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ff3c0 msgr2=0x7f5090196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.116+0000 7f5095d7a700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ff3c0 0x7f5090196000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f508000b4b0 tx=0x7f508000b870 comp rx=0 tx=0).stop 2024-09-13T03:02:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.116+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 shutdown_connections 2024-09-13T03:02:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.116+0000 7f5095d7a700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f507806e680 0x7f5078070b30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.116+0000 7f5095d7a700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50900ff3c0 0x7f5090196000 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.116+0000 7f5095d7a700 1 --2- 172.21.15.98:0/3556212452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50900ffd60 0x7f5090196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.116+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 >> 172.21.15.98:0/3556212452 conn(0x7f50900fac80 msgr2=0x7f50901034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.117+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 shutdown_connections 2024-09-13T03:02:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.117+0000 7f5095d7a700 1 -- 172.21.15.98:0/3556212452 wait complete. 2024-09-13T03:02:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.221+0000 7f20d7dca700 1 -- 172.21.15.98:0/1120521725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ff3c0 msgr2=0x7f20d00ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.221+0000 7f20d7dca700 1 --2- 172.21.15.98:0/1120521725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ff3c0 0x7f20d00ff790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009910 tx=0x7f20cc009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.221+0000 7f20d7dca700 1 -- 172.21.15.98:0/1120521725 shutdown_connections 2024-09-13T03:02:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.221+0000 7f20d7dca700 1 --2- 172.21.15.98:0/1120521725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20d00ffd60 0x7f20d0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.221+0000 7f20d7dca700 1 --2- 172.21.15.98:0/1120521725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ff3c0 0x7f20d00ff790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.221+0000 7f20d7dca700 1 -- 172.21.15.98:0/1120521725 >> 172.21.15.98:0/1120521725 conn(0x7f20d00fac80 msgr2=0x7f20d00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:03.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.222+0000 7f20d7dca700 1 -- 172.21.15.98:0/1120521725 shutdown_connections 2024-09-13T03:02:03.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.222+0000 7f20d7dca700 1 -- 172.21.15.98:0/1120521725 wait complete. 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.222+0000 7f20d7dca700 1 Processor -- start 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.222+0000 7f20d7dca700 1 -- start start 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d7dca700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20d00ff3c0 0x7f20d0194e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d7dca700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ffd60 0x7f20d01953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d7dca700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d0195ab0 con 0x7f20d00ffd60 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d7dca700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d0199840 con 0x7f20d00ff3c0 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d5365700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ffd60 0x7f20d01953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d5365700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ffd60 0x7f20d01953d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35864/0 (socket says 172.21.15.98:35864) 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d5365700 1 -- 172.21.15.98:0/3147296952 learned_addr learned my addr 172.21.15.98:0/3147296952 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:03.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d5b66700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20d00ff3c0 0x7f20d0194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d5365700 1 -- 172.21.15.98:0/3147296952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20d00ff3c0 msgr2=0x7f20d0194e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d5365700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20d00ff3c0 0x7f20d0194e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d5365700 1 -- 172.21.15.98:0/3147296952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0095f0 con 0x7f20d00ffd60 2024-09-13T03:02:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20d5365700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ffd60 0x7f20d01953d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20c400b480 tx=0x7f20c400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.223+0000 7f20c2ffd700 1 -- 172.21.15.98:0/3147296952 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20c4011800 con 0x7f20d00ffd60 2024-09-13T03:02:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.224+0000 7f20c2ffd700 1 -- 172.21.15.98:0/3147296952 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20c4011e20 con 0x7f20d00ffd60 2024-09-13T03:02:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.224+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d0199b20 con 0x7f20d00ffd60 2024-09-13T03:02:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.224+0000 7f20c2ffd700 1 -- 172.21.15.98:0/3147296952 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20c4010ea0 con 0x7f20d00ffd60 2024-09-13T03:02:03.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.224+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d019a070 con 0x7f20d00ffd60 2024-09-13T03:02:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.225+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d004f2a0 con 0x7f20d00ffd60 2024-09-13T03:02:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.225+0000 7f20c2ffd700 1 -- 172.21.15.98:0/3147296952 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f20c4010380 con 0x7f20d00ffd60 2024-09-13T03:02:03.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.226+0000 7f20c2ffd700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f20bc06e680 0x7f20bc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:03.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.226+0000 7f20c2ffd700 1 -- 172.21.15.98:0/3147296952 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f20c408e240 con 0x7f20d00ffd60 2024-09-13T03:02:03.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.226+0000 7f20d5b66700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f20bc06e680 0x7f20bc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:03.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.226+0000 7f20d5b66700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f20bc06e680 0x7f20bc070b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20cc005f50 tx=0x7f20cc01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:03.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.230+0000 7f20c2ffd700 1 -- 172.21.15.98:0/3147296952 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f20c4057310 con 0x7f20d00ffd60 2024-09-13T03:02:03.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.441+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f20d019a370 con 0x7f20bc06e680 2024-09-13T03:02:03.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.451+0000 7f20c2ffd700 1 -- 172.21.15.98:0/3147296952 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f20d019a370 con 0x7f20bc06e680 2024-09-13T03:02:03.453 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:02:03.453 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (6m) 23s ago 17m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T03:02:03.453 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (17m) 23s ago 17m 9202k - 18.2.0 dc2bc1663786 0cc9a722ff8e 2024-09-13T03:02:03.453 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (16m) 5s ago 16m 9164k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T03:02:03.453 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (4m) 23s ago 17m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T03:02:03.453 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (4m) 5s ago 16m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T03:02:03.453 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (6m) 23s ago 17m 80.4M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T03:02:03.453 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (28s) 23s ago 12m 13.2M - 19.1.1-322-g7741f7f9 19dc8d659727 e3d60a038b35 2024-09-13T03:02:03.453 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (46s) 23s ago 12m 15.4M - 19.1.1-322-g7741f7f9 19dc8d659727 8daec38027b8 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (12m) 5s ago 12m 243M - 18.2.0 dc2bc1663786 48909d18e24e 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (9s) 5s ago 12m 12.9M - 19.1.1-322-g7741f7f9 19dc8d659727 46f9730b3ab7 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (9m) 23s ago 18m 505M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (7m) 5s ago 16m 442M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (5m) 23s ago 19m 54.9M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (5m) 5s ago 16m 43.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (7m) 23s ago 17m 16.7M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (7m) 5s ago 16m 14.8M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (3m) 23s ago 15m 110M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (3m) 23s ago 15m 108M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T03:02:03.454 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (2m) 23s ago 14m 101M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 04c10c8159ba 2024-09-13T03:02:03.455 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (2m) 5s ago 14m 111M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 322e0a9d6b20 2024-09-13T03:02:03.455 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (103s) 5s ago 13m 109M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 087c65ddb960 2024-09-13T03:02:03.455 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (70s) 5s ago 13m 117M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 31b09c7c1472 2024-09-13T03:02:03.455 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (7m) 23s ago 17m 78.1M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T03:02:03.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f20bc06e680 msgr2=0x7f20bc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f20bc06e680 0x7f20bc070b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20cc005f50 tx=0x7f20cc01a040 comp rx=0 tx=0).stop 2024-09-13T03:02:03.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ffd60 msgr2=0x7f20d01953d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ffd60 0x7f20d01953d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20c400b480 tx=0x7f20c400b790 comp rx=0 tx=0).stop 2024-09-13T03:02:03.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 shutdown_connections 2024-09-13T03:02:03.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f20bc06e680 0x7f20bc070b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20d00ff3c0 0x7f20d0194e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 --2- 172.21.15.98:0/3147296952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d00ffd60 0x7f20d01953d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 >> 172.21.15.98:0/3147296952 conn(0x7f20d00fac80 msgr2=0x7f20d00fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:03.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 shutdown_connections 2024-09-13T03:02:03.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.453+0000 7f20d7dca700 1 -- 172.21.15.98:0/3147296952 wait complete. 2024-09-13T03:02:03.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.560+0000 7fcd55d6f700 1 -- 172.21.15.98:0/4200379255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 msgr2=0x7fcd50103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.560+0000 7fcd55d6f700 1 --2- 172.21.15.98:0/4200379255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 0x7fcd50103d20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009910 tx=0x7fcd44009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:03.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.560+0000 7fcd55d6f700 1 -- 172.21.15.98:0/4200379255 shutdown_connections 2024-09-13T03:02:03.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.560+0000 7fcd55d6f700 1 --2- 172.21.15.98:0/4200379255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 0x7fcd50103d20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.560+0000 7fcd55d6f700 1 --2- 172.21.15.98:0/4200379255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd500ff3b0 0x7fcd500ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.560+0000 7fcd55d6f700 1 -- 172.21.15.98:0/4200379255 >> 172.21.15.98:0/4200379255 conn(0x7fcd500fac90 msgr2=0x7fcd500fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:03.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.560+0000 7fcd55d6f700 1 -- 172.21.15.98:0/4200379255 shutdown_connections 2024-09-13T03:02:03.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.560+0000 7fcd55d6f700 1 -- 172.21.15.98:0/4200379255 wait complete. 2024-09-13T03:02:03.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.560+0000 7fcd55d6f700 1 Processor -- start 2024-09-13T03:02:03.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd55d6f700 1 -- start start 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd55d6f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd500ff3b0 0x7fcd50196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd55d6f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 0x7fcd501972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd55d6f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd501978d0 con 0x7fcd500ffd50 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd55d6f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50197a10 con 0x7fcd500ff3b0 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd4effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 0x7fcd501972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd4effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 0x7fcd501972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35884/0 (socket says 172.21.15.98:35884) 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd4effd700 1 -- 172.21.15.98:0/533316328 learned_addr learned my addr 172.21.15.98:0/533316328 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd4f7fe700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd500ff3b0 0x7fcd50196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd4effd700 1 -- 172.21.15.98:0/533316328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd500ff3b0 msgr2=0x7fcd50196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd4effd700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd500ff3b0 0x7fcd50196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.561+0000 7fcd4effd700 1 -- 172.21.15.98:0/533316328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440095f0 con 0x7fcd500ffd50 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.562+0000 7fcd4effd700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 0x7fcd501972b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd440092e0 tx=0x7fcd4400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:03.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.562+0000 7fcd4cff9700 1 -- 172.21.15.98:0/533316328 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4401d070 con 0x7fcd500ffd50 2024-09-13T03:02:03.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.562+0000 7fcd4cff9700 1 -- 172.21.15.98:0/533316328 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd44005dc0 con 0x7fcd500ffd50 2024-09-13T03:02:03.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.562+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5019fde0 con 0x7fcd500ffd50 2024-09-13T03:02:03.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.562+0000 7fcd4cff9700 1 -- 172.21.15.98:0/533316328 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd44017400 con 0x7fcd500ffd50 2024-09-13T03:02:03.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.562+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd501a01f0 con 0x7fcd500ffd50 2024-09-13T03:02:03.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.563+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd50107720 con 0x7fcd500ffd50 2024-09-13T03:02:03.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.563+0000 7fcd4cff9700 1 -- 172.21.15.98:0/533316328 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcd44003a60 con 0x7fcd500ffd50 2024-09-13T03:02:03.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.564+0000 7fcd4cff9700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd3806e680 0x7fcd38070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:03.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.564+0000 7fcd4cff9700 1 -- 172.21.15.98:0/533316328 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcd4408fad0 con 0x7fcd500ffd50 2024-09-13T03:02:03.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.564+0000 7fcd4f7fe700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd3806e680 0x7fcd38070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:03.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.564+0000 7fcd4f7fe700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd3806e680 0x7fcd38070b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009550 tx=0x7fcd400091b0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:03.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.568+0000 7fcd4cff9700 1 -- 172.21.15.98:0/533316328 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcd44058ba0 con 0x7fcd500ffd50 2024-09-13T03:02:03.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.864+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcd5004f2a0 con 0x7fcd500ffd50 2024-09-13T03:02:03.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.864+0000 7fcd4cff9700 1 -- 172.21.15.98:0/533316328 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7fcd4405c260 con 0x7fcd500ffd50 2024-09-13T03:02:03.866 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:02:03.866 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T03:02:03.866 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:02:03.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:02:03.866 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T03:02:03.866 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:02:03.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 3 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 13 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T03:02:03.867 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:02:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.866+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd3806e680 msgr2=0x7fcd38070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.866+0000 7fcd55d6f700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd3806e680 0x7fcd38070b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009550 tx=0x7fcd400091b0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.866+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 msgr2=0x7fcd501972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.866+0000 7fcd55d6f700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 0x7fcd501972b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd440092e0 tx=0x7fcd4400bd70 comp rx=0 tx=0).stop 2024-09-13T03:02:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.866+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 shutdown_connections 2024-09-13T03:02:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.866+0000 7fcd55d6f700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd3806e680 0x7fcd38070b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.867+0000 7fcd55d6f700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd500ff3b0 0x7fcd50196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.867+0000 7fcd55d6f700 1 --2- 172.21.15.98:0/533316328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd500ffd50 0x7fcd501972b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.867+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 >> 172.21.15.98:0/533316328 conn(0x7fcd500fac90 msgr2=0x7fcd500fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:03.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.867+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 shutdown_connections 2024-09-13T03:02:03.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.867+0000 7fcd55d6f700 1 -- 172.21.15.98:0/533316328 wait complete. 2024-09-13T03:02:03.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.971+0000 7f6c8cb36700 1 -- 172.21.15.98:0/4260646438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100460 msgr2=0x7f6c88100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.971+0000 7f6c8cb36700 1 --2- 172.21.15.98:0/4260646438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100460 0x7f6c88100830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009910 tx=0x7f6c78009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.971+0000 7f6c8cb36700 1 -- 172.21.15.98:0/4260646438 shutdown_connections 2024-09-13T03:02:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.971+0000 7f6c8cb36700 1 --2- 172.21.15.98:0/4260646438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c88100d70 0x7f6c881094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.971+0000 7f6c8cb36700 1 --2- 172.21.15.98:0/4260646438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100460 0x7f6c88100830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.971+0000 7f6c8cb36700 1 -- 172.21.15.98:0/4260646438 >> 172.21.15.98:0/4260646438 conn(0x7f6c880748b0 msgr2=0x7f6c88074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.971+0000 7f6c8cb36700 1 -- 172.21.15.98:0/4260646438 shutdown_connections 2024-09-13T03:02:03.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.971+0000 7f6c8cb36700 1 -- 172.21.15.98:0/4260646438 wait complete. 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.971+0000 7f6c8cb36700 1 Processor -- start 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c8cb36700 1 -- start start 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c8cb36700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c88100460 0x7f6c88101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c8cb36700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100d70 0x7f6c88101a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c8cb36700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88101fc0 con 0x7f6c88100d70 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c8cb36700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88102100 con 0x7f6c88100460 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c85d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100d70 0x7f6c88101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c85d9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100d70 0x7f6c88101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35902/0 (socket says 172.21.15.98:35902) 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c85d9b700 1 -- 172.21.15.98:0/2083171408 learned_addr learned my addr 172.21.15.98:0/2083171408 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:03.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c8659c700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c88100460 0x7f6c88101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c85d9b700 1 -- 172.21.15.98:0/2083171408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c88100460 msgr2=0x7f6c88101540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c85d9b700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c88100460 0x7f6c88101540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c85d9b700 1 -- 172.21.15.98:0/2083171408 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c780095f0 con 0x7f6c88100d70 2024-09-13T03:02:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c85d9b700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100d70 0x7f6c88101a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00d8d0 tx=0x7f6c7c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.972+0000 7f6c777fe700 1 -- 172.21.15.98:0/2083171408 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c7c0098a0 con 0x7f6c88100d70 2024-09-13T03:02:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.973+0000 7f6c777fe700 1 -- 172.21.15.98:0/2083171408 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c7c010460 con 0x7f6c88100d70 2024-09-13T03:02:03.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.973+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c881a1fd0 con 0x7f6c88100d70 2024-09-13T03:02:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.973+0000 7f6c777fe700 1 -- 172.21.15.98:0/2083171408 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c7c00f5f0 con 0x7f6c88100d70 2024-09-13T03:02:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.973+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c881a23e0 con 0x7f6c88100d70 2024-09-13T03:02:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.974+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88107e40 con 0x7f6c88100d70 2024-09-13T03:02:03.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.974+0000 7f6c777fe700 1 -- 172.21.15.98:0/2083171408 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6c7c009a00 con 0x7f6c88100d70 2024-09-13T03:02:03.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.975+0000 7f6c777fe700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6c7006e680 0x7f6c70070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:03.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.975+0000 7f6c8659c700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6c7006e680 0x7f6c70070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:03.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.975+0000 7f6c777fe700 1 -- 172.21.15.98:0/2083171408 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6c7c08e550 con 0x7f6c88100d70 2024-09-13T03:02:03.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.975+0000 7f6c8659c700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6c7006e680 0x7f6c70070b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6c78006010 tx=0x7f6c7801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:03.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:03.979+0000 7f6c777fe700 1 -- 172.21.15.98:0/2083171408 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6c7c0576a0 con 0x7f6c88100d70 2024-09-13T03:02:04.109 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:03 smithi142 ceph-mon[65447]: pgmap v202: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-13T03:02:04.110 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:03 smithi142 ceph-mon[65447]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:04.110 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:04.110 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:04.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.221+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c8804f2a0 con 0x7f6c88100d70 2024-09-13T03:02:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:03 smithi098 ceph-mon[87325]: pgmap v202: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-13T03:02:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:03 smithi098 ceph-mon[87325]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:04.223 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:04.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.221+0000 7f6c777fe700 1 -- 172.21.15.98:0/2083171408 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1929 (secure 0 0 0) 0x7f6c7c05ad60 con 0x7f6c88100d70 2024-09-13T03:02:04.224 INFO:teuthology.orchestra.run.smithi098.stdout:e29 2024-09-13T03:02:04.224 INFO:teuthology.orchestra.run.smithi098.stdout:btime 2024-09-13T03:01:58:827614+0000 2024-09-13T03:02:04.224 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:02:04.224 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:02:04.224 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T03:02:04.224 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:02:04.224 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 29 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T03:01:58.827612+0000 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T03:02:04.225 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 91 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=24285} 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T03:02:04.226 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 24285 members: 24285 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{0:24285} state up:active seq 182 join_fscid=1 addr [v2:172.21.15.142:6826/837388084,v1:172.21.15.142:6827/837388084] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.98:6828/3981027621,v1:172.21.15.98:6829/3981027621] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:44315} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6824/2834620980,v1:172.21.15.142:6825/2834620980] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.224+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6c7006e680 msgr2=0x7f6c70070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.224+0000 7f6c8cb36700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6c7006e680 0x7f6c70070b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6c78006010 tx=0x7f6c7801a040 comp rx=0 tx=0).stop 2024-09-13T03:02:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.224+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100d70 msgr2=0x7f6c88101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.224+0000 7f6c8cb36700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100d70 0x7f6c88101a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00d8d0 tx=0x7f6c7c00dbe0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.224+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 shutdown_connections 2024-09-13T03:02:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.224+0000 7f6c8cb36700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6c7006e680 0x7f6c70070b30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.224+0000 7f6c8cb36700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c88100460 0x7f6c88101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.224+0000 7f6c8cb36700 1 --2- 172.21.15.98:0/2083171408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c88100d70 0x7f6c88101a80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.224+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 >> 172.21.15.98:0/2083171408 conn(0x7f6c880748b0 msgr2=0x7f6c880ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.225+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 shutdown_connections 2024-09-13T03:02:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.225+0000 7f6c8cb36700 1 -- 172.21.15.98:0/2083171408 wait complete. 2024-09-13T03:02:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 29 2024-09-13T03:02:04.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.329+0000 7fa1ec3df700 1 -- 172.21.15.98:0/763421541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 msgr2=0x7fa1e40ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:04.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.329+0000 7fa1ec3df700 1 --2- 172.21.15.98:0/763421541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 0x7fa1e40ff720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009910 tx=0x7fa1e0009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:04.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.329+0000 7fa1ec3df700 1 -- 172.21.15.98:0/763421541 shutdown_connections 2024-09-13T03:02:04.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 --2- 172.21.15.98:0/763421541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e40ffc60 0x7fa1e410a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 --2- 172.21.15.98:0/763421541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 0x7fa1e40ff720 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 -- 172.21.15.98:0/763421541 >> 172.21.15.98:0/763421541 conn(0x7fa1e40748b0 msgr2=0x7fa1e4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:04.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 -- 172.21.15.98:0/763421541 shutdown_connections 2024-09-13T03:02:04.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 -- 172.21.15.98:0/763421541 wait complete. 2024-09-13T03:02:04.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 Processor -- start 2024-09-13T03:02:04.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 -- start start 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 0x7fa1e4195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e40ffc60 0x7fa1e41963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4196ac0 con 0x7fa1e40ff350 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ec3df700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e419a850 con 0x7fa1e40ffc60 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.330+0000 7fa1ea17b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 0x7fa1e4195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1ea17b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 0x7fa1e4195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35916/0 (socket says 172.21.15.98:35916) 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1ea17b700 1 -- 172.21.15.98:0/1888624390 learned_addr learned my addr 172.21.15.98:0/1888624390 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1e997a700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e40ffc60 0x7fa1e41963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1ea17b700 1 -- 172.21.15.98:0/1888624390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e40ffc60 msgr2=0x7fa1e41963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1ea17b700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e40ffc60 0x7fa1e41963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1ea17b700 1 -- 172.21.15.98:0/1888624390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e00095f0 con 0x7fa1e40ff350 2024-09-13T03:02:04.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1ea17b700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 0x7fa1e4195ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00092e0 tx=0x7fa1e000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:04.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1db7fe700 1 -- 172.21.15.98:0/1888624390 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e001d070 con 0x7fa1e40ff350 2024-09-13T03:02:04.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1db7fe700 1 -- 172.21.15.98:0/1888624390 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1e0005dc0 con 0x7fa1e40ff350 2024-09-13T03:02:04.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e419aad0 con 0x7fa1e40ff350 2024-09-13T03:02:04.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1db7fe700 1 -- 172.21.15.98:0/1888624390 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e0017400 con 0x7fa1e40ff350 2024-09-13T03:02:04.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.331+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e419afc0 con 0x7fa1e40ff350 2024-09-13T03:02:04.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.332+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e4107dd0 con 0x7fa1e40ff350 2024-09-13T03:02:04.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.333+0000 7fa1db7fe700 1 -- 172.21.15.98:0/1888624390 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa1e000f460 con 0x7fa1e40ff350 2024-09-13T03:02:04.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.333+0000 7fa1db7fe700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa1d006e680 0x7fa1d0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:04.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.333+0000 7fa1db7fe700 1 -- 172.21.15.98:0/1888624390 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa1e008fae0 con 0x7fa1e40ff350 2024-09-13T03:02:04.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.333+0000 7fa1e997a700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa1d006e680 0x7fa1d0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:04.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.334+0000 7fa1e997a700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa1d006e680 0x7fa1d0070b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa1e41974c0 tx=0x7fa1d400a300 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:04.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.337+0000 7fa1db7fe700 1 -- 172.21.15.98:0/1888624390 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa1e0058c30 con 0x7fa1e40ff350 2024-09-13T03:02:04.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.583+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1e402cca0 con 0x7fa1d006e680 2024-09-13T03:02:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.585+0000 7fa1db7fe700 1 -- 172.21.15.98:0/1888624390 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa1e402cca0 con 0x7fa1d006e680 2024-09-13T03:02:04.586 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:02:04.586 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:02:04.586 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T03:02:04.586 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout: "osd", 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout: "mon" 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "15/23 daemons upgraded", 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T03:02:04.587 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:02:04.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa1d006e680 msgr2=0x7fa1d0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:04.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa1d006e680 0x7fa1d0070b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa1e41974c0 tx=0x7fa1d400a300 comp rx=0 tx=0).stop 2024-09-13T03:02:04.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 msgr2=0x7fa1e4195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:04.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 0x7fa1e4195ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00092e0 tx=0x7fa1e000bd70 comp rx=0 tx=0).stop 2024-09-13T03:02:04.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 shutdown_connections 2024-09-13T03:02:04.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa1d006e680 0x7fa1d0070b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1e40ff350 0x7fa1e4195ea0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 --2- 172.21.15.98:0/1888624390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e40ffc60 0x7fa1e41963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 >> 172.21.15.98:0/1888624390 conn(0x7fa1e40748b0 msgr2=0x7fa1e4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 shutdown_connections 2024-09-13T03:02:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.587+0000 7fa1ec3df700 1 -- 172.21.15.98:0/1888624390 wait complete. 2024-09-13T03:02:04.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.691+0000 7f4e7b689700 1 -- 172.21.15.98:0/756240602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100460 msgr2=0x7f4e74100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:04.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.691+0000 7f4e7b689700 1 --2- 172.21.15.98:0/756240602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100460 0x7f4e74100830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009910 tx=0x7f4e64009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:04.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.691+0000 7f4e7b689700 1 -- 172.21.15.98:0/756240602 shutdown_connections 2024-09-13T03:02:04.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.691+0000 7f4e7b689700 1 --2- 172.21.15.98:0/756240602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e74100d70 0x7f4e741094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.691+0000 7f4e7b689700 1 --2- 172.21.15.98:0/756240602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100460 0x7f4e74100830 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.691+0000 7f4e7b689700 1 -- 172.21.15.98:0/756240602 >> 172.21.15.98:0/756240602 conn(0x7f4e740748b0 msgr2=0x7f4e74074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:04.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.691+0000 7f4e7b689700 1 -- 172.21.15.98:0/756240602 shutdown_connections 2024-09-13T03:02:04.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.691+0000 7f4e7b689700 1 -- 172.21.15.98:0/756240602 wait complete. 2024-09-13T03:02:04.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e7b689700 1 Processor -- start 2024-09-13T03:02:04.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e7b689700 1 -- start start 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e7b689700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e74100460 0x7f4e74196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e7b689700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100d70 0x7f4e74197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e7b689700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e741978b0 con 0x7f4e74100d70 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e7b689700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74197a20 con 0x7f4e74100460 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e78c24700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100d70 0x7f4e74197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e78c24700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100d70 0x7f4e74197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47444/0 (socket says 172.21.15.98:47444) 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e78c24700 1 -- 172.21.15.98:0/2523556722 learned_addr learned my addr 172.21.15.98:0/2523556722 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.692+0000 7f4e79425700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e74100460 0x7f4e74196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.693+0000 7f4e78c24700 1 -- 172.21.15.98:0/2523556722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e74100460 msgr2=0x7f4e74196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.693+0000 7f4e78c24700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e74100460 0x7f4e74196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:04.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.693+0000 7f4e78c24700 1 -- 172.21.15.98:0/2523556722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640095f0 con 0x7f4e74100d70 2024-09-13T03:02:04.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.693+0000 7f4e78c24700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100d70 0x7f4e74197290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000d900 tx=0x7f4e7000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:04.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.693+0000 7f4e6a7fc700 1 -- 172.21.15.98:0/2523556722 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e700041f0 con 0x7f4e74100d70 2024-09-13T03:02:04.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.693+0000 7f4e6a7fc700 1 -- 172.21.15.98:0/2523556722 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e70004cf0 con 0x7f4e74100d70 2024-09-13T03:02:04.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.693+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7419fdc0 con 0x7f4e74100d70 2024-09-13T03:02:04.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.693+0000 7f4e6a7fc700 1 -- 172.21.15.98:0/2523556722 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e7000b750 con 0x7f4e74100d70 2024-09-13T03:02:04.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.693+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e741a02b0 con 0x7f4e74100d70 2024-09-13T03:02:04.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.694+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e74106bd0 con 0x7f4e74100d70 2024-09-13T03:02:04.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.694+0000 7f4e6a7fc700 1 -- 172.21.15.98:0/2523556722 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4e70004750 con 0x7f4e74100d70 2024-09-13T03:02:04.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.695+0000 7f4e6a7fc700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4e6006e680 0x7f4e60070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:04.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.695+0000 7f4e6a7fc700 1 -- 172.21.15.98:0/2523556722 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4e7008e530 con 0x7f4e74100d70 2024-09-13T03:02:04.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.695+0000 7f4e79425700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4e6006e680 0x7f4e60070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:04.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.696+0000 7f4e79425700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4e6006e680 0x7f4e60070b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e64006010 tx=0x7f4e6401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:04.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.699+0000 7f4e6a7fc700 1 -- 172.21.15.98:0/2523556722 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4e70057680 con 0x7f4e74100d70 2024-09-13T03:02:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.997+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4e741065b0 con 0x7f4e74100d70 2024-09-13T03:02:04.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.997+0000 7f4e6a7fc700 1 -- 172.21.15.98:0/2523556722 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4e7005ad40 con 0x7f4e74100d70 2024-09-13T03:02:04.999 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T03:02:04.999 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:02:04.999 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:02:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.999+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4e6006e680 msgr2=0x7f4e60070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.999+0000 7f4e7b689700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4e6006e680 0x7f4e60070b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e64006010 tx=0x7f4e6401a040 comp rx=0 tx=0).stop 2024-09-13T03:02:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.999+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100d70 msgr2=0x7f4e74197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.999+0000 7f4e7b689700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100d70 0x7f4e74197290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000d900 tx=0x7f4e7000dc10 comp rx=0 tx=0).stop 2024-09-13T03:02:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.999+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 shutdown_connections 2024-09-13T03:02:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.999+0000 7f4e7b689700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4e6006e680 0x7f4e60070b30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.999+0000 7f4e7b689700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e74100460 0x7f4e74196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.999+0000 7f4e7b689700 1 --2- 172.21.15.98:0/2523556722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e74100d70 0x7f4e74197290 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:04.999+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 >> 172.21.15.98:0/2523556722 conn(0x7f4e740748b0 msgr2=0x7f4e74103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:05.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:05.000+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 shutdown_connections 2024-09-13T03:02:05.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:05.000+0000 7f4e7b689700 1 -- 172.21.15.98:0/2523556722 wait complete. 2024-09-13T03:02:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:04 smithi098 ceph-mon[87325]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:04 smithi098 ceph-mon[87325]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:04 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/533316328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:05.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:04 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2083171408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:02:05.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:04 smithi142 ceph-mon[65447]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:05.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:04 smithi142 ceph-mon[65447]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:05.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:04 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/533316328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:05.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:04 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2083171408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: pgmap v203: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2523556722' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:06.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:06.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:06.003 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:05 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: pgmap v203: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2523556722' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:06.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:06.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:06.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:05 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:07.943 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:07 smithi142 ceph-mon[65447]: pgmap v204: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.1 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T03:02:07.944 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:07 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:07.944 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:07 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.hplrrs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:02:07.944 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:07 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:07 smithi098 ceph-mon[87325]: pgmap v204: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.1 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T03:02:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:07 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:07 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.hplrrs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:02:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:07 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:09.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:08 smithi142 ceph-mon[65447]: Upgrade: Updating mds.cephfs.smithi142.hplrrs 2024-09-13T03:02:09.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:08 smithi142 ceph-mon[65447]: Deploying daemon mds.cephfs.smithi142.hplrrs on smithi142 2024-09-13T03:02:09.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:08 smithi098 ceph-mon[87325]: Upgrade: Updating mds.cephfs.smithi142.hplrrs 2024-09-13T03:02:09.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:08 smithi098 ceph-mon[87325]: Deploying daemon mds.cephfs.smithi142.hplrrs on smithi142 2024-09-13T03:02:09.733 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[87321]: 2024-09-13T03:02:09.301+0000 7f6bf01fb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:02:10.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-mon[87325]: pgmap v205: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T03:02:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-mon[87325]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T03:02:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-mon[87325]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:02:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-mon[87325]: osdmap e92: 6 total, 6 up, 6 in 2024-09-13T03:02:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-mon[87325]: Standby daemon mds.cephfs.smithi098.nwzstq assigned to filesystem cephfs as rank 0 2024-09-13T03:02:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-mon[87325]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T03:02:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-mon[87325]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T03:02:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi098.nwzstq=up:replay} 2 up:standby 2024-09-13T03:02:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:09 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T03:02:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:09 smithi142 ceph-mon[65447]: pgmap v205: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T03:02:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:09 smithi142 ceph-mon[65447]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T03:02:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:09 smithi142 ceph-mon[65447]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:02:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:09 smithi142 ceph-mon[65447]: osdmap e92: 6 total, 6 up, 6 in 2024-09-13T03:02:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:09 smithi142 ceph-mon[65447]: Standby daemon mds.cephfs.smithi098.nwzstq assigned to filesystem cephfs as rank 0 2024-09-13T03:02:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:09 smithi142 ceph-mon[65447]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T03:02:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:09 smithi142 ceph-mon[65447]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T03:02:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:09 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi098.nwzstq=up:replay} 2 up:standby 2024-09-13T03:02:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:09 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T03:02:12.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:11 smithi098 ceph-mon[87325]: pgmap v207: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-13T03:02:12.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:11 smithi142 ceph-mon[65447]: pgmap v207: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-13T03:02:14.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:13 smithi098 ceph-mon[87325]: pgmap v208: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T03:02:14.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:13 smithi142 ceph-mon[65447]: pgmap v208: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T03:02:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:15 smithi098 ceph-mon[87325]: pgmap v209: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-13T03:02:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:15 smithi142 ceph-mon[65447]: pgmap v209: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-13T03:02:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:17 smithi098 ceph-mon[87325]: pgmap v210: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-13T03:02:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:17 smithi142 ceph-mon[65447]: pgmap v210: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-13T03:02:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:18 smithi098 ceph-mon[87325]: reconnect by client.14508 192.168.0.1:0/3551376023 after 0.000999987 2024-09-13T03:02:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:18 smithi098 ceph-mon[87325]: reconnect by client.24313 192.168.0.1:0/3572139203 after 0.000999987 2024-09-13T03:02:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:18 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] up:reconnect 2024-09-13T03:02:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:18 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi098.nwzstq=up:reconnect} 2 up:standby 2024-09-13T03:02:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:19.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:18 smithi142 ceph-mon[65447]: reconnect by client.14508 192.168.0.1:0/3551376023 after 0.000999987 2024-09-13T03:02:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:18 smithi142 ceph-mon[65447]: reconnect by client.24313 192.168.0.1:0/3572139203 after 0.000999987 2024-09-13T03:02:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:18 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] up:reconnect 2024-09-13T03:02:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:18 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi098.nwzstq=up:reconnect} 2 up:standby 2024-09-13T03:02:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:19.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:19.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:19 smithi098 ceph-mon[87325]: pgmap v211: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-13T03:02:19.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:19 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] up:rejoin 2024-09-13T03:02:19.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:19 smithi098 ceph-mon[87325]: fsmap cephfs:1/1 {0=cephfs.smithi098.nwzstq=up:rejoin} 2 up:standby 2024-09-13T03:02:19.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:19 smithi098 ceph-mon[87325]: daemon mds.cephfs.smithi098.nwzstq is now active in filesystem cephfs as rank 0 2024-09-13T03:02:20.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:19 smithi142 ceph-mon[65447]: pgmap v211: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-13T03:02:20.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:19 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] up:rejoin 2024-09-13T03:02:20.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:19 smithi142 ceph-mon[65447]: fsmap cephfs:1/1 {0=cephfs.smithi098.nwzstq=up:rejoin} 2 up:standby 2024-09-13T03:02:20.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:19 smithi142 ceph-mon[65447]: daemon mds.cephfs.smithi098.nwzstq is now active in filesystem cephfs as rank 0 2024-09-13T03:02:21.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:20 smithi098 ceph-mon[87325]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T03:02:21.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:20 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] up:active 2024-09-13T03:02:21.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:20 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 2 up:standby 2024-09-13T03:02:21.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:20 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:21.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:20 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:21.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:20 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:21.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:20 smithi142 ceph-mon[65447]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T03:02:21.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:20 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] up:active 2024-09-13T03:02:21.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:20 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 2 up:standby 2024-09-13T03:02:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:20 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:20 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:21.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:20 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:22.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:21 smithi142 ceph-mon[65447]: pgmap v212: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-13T03:02:22.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:21 smithi142 ceph-mon[65447]: mds.? [v2:172.21.15.142:6826/3076033085,v1:172.21.15.142:6827/3076033085] up:boot 2024-09-13T03:02:22.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:21 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 3 up:standby 2024-09-13T03:02:22.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:21 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T03:02:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:21 smithi098 ceph-mon[87325]: pgmap v212: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-13T03:02:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:21 smithi098 ceph-mon[87325]: mds.? [v2:172.21.15.142:6826/3076033085,v1:172.21.15.142:6827/3076033085] up:boot 2024-09-13T03:02:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:21 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 3 up:standby 2024-09-13T03:02:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:21 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T03:02:24.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:23 smithi098 ceph-mon[87325]: pgmap v213: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-13T03:02:24.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:24.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:23 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:23 smithi142 ceph-mon[65447]: pgmap v213: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-13T03:02:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:23 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:25.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:25 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:25.402 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:25 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:25.403 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:25 smithi098 ceph-mon[87325]: pgmap v214: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T03:02:25.470 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:25 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:25.470 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:25 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:25.470 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:25 smithi142 ceph-mon[65447]: pgmap v214: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T03:02:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: pgmap v215: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.4 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-13T03:02:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.dioppa"}]': finished 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.nwzstq"}]': finished 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.hplrrs"}]': finished 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.wxfmvt"}]': finished 2024-09-13T03:02:28.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:27 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: pgmap v215: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.4 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.dioppa"}]: dispatch 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.dioppa"}]': finished 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.nwzstq"}]: dispatch 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi098.nwzstq"}]': finished 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.hplrrs"}]: dispatch 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.hplrrs"}]': finished 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.wxfmvt"}]: dispatch 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.wxfmvt"}]': finished 2024-09-13T03:02:28.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:27 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T03:02:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:28 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all mds 2024-09-13T03:02:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:28 smithi098 ceph-mon[87325]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T03:02:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T03:02:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:28 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 3 up:standby 2024-09-13T03:02:29.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:28 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T03:02:29.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:28 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all mds 2024-09-13T03:02:29.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:28 smithi142 ceph-mon[65447]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T03:02:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T03:02:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:28 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 3 up:standby 2024-09-13T03:02:29.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:28 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T03:02:30.008 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T03:02:30.008 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: pgmap v216: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.1 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T03:02:30.008 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T03:02:30.008 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 3 up:standby 2024-09-13T03:02:30.008 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T03:02:30.008 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:30.008 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.008 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:30.009 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.009 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:30.009 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:29 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T03:02:30.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: pgmap v216: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.1 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-13T03:02:30.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T03:02:30.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 3 up:standby 2024-09-13T03:02:30.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T03:02:30.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:30.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:30.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:30.293 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:29 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:31.088 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:30 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all rgw 2024-09-13T03:02:31.088 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:30 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T03:02:31.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:30 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all rgw 2024-09-13T03:02:31.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:30 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T03:02:32.150 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:31 smithi098 ceph-mon[87325]: pgmap v217: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T03:02:32.150 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:31 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:32.151 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:31 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T03:02:32.151 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:31 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:31 smithi142 ceph-mon[65447]: pgmap v217: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T03:02:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:31 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:31 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi098", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T03:02:32.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:31 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:32.905 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:32 smithi098 ceph-mon[87325]: Upgrade: Updating ceph-exporter.smithi098 (1/2) 2024-09-13T03:02:32.905 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:32 smithi098 ceph-mon[87325]: Deploying daemon ceph-exporter.smithi098 on smithi098 2024-09-13T03:02:33.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:32 smithi142 ceph-mon[65447]: Upgrade: Updating ceph-exporter.smithi098 (1/2) 2024-09-13T03:02:33.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:32 smithi142 ceph-mon[65447]: Deploying daemon ceph-exporter.smithi098 on smithi098 2024-09-13T03:02:34.187 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:33 smithi098 ceph-mon[87325]: pgmap v218: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-13T03:02:34.187 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:34.187 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:33 smithi142 ceph-mon[65447]: pgmap v218: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-13T03:02:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:35.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.110+0000 7f324c765700 1 -- 172.21.15.98:0/1882325886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3244100e80 msgr2=0x7f3244104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.110+0000 7f324c765700 1 --2- 172.21.15.98:0/1882325886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3244100e80 0x7f3244104e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3234009910 tx=0x7f3234009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:35.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.110+0000 7f324c765700 1 -- 172.21.15.98:0/1882325886 shutdown_connections 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.110+0000 7f324c765700 1 --2- 172.21.15.98:0/1882325886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3244100e80 0x7f3244104e50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.110+0000 7f324c765700 1 --2- 172.21.15.98:0/1882325886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32441004e0 0x7f32441008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.110+0000 7f324c765700 1 -- 172.21.15.98:0/1882325886 >> 172.21.15.98:0/1882325886 conn(0x7f32440fbda0 msgr2=0x7f32440fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.110+0000 7f324c765700 1 -- 172.21.15.98:0/1882325886 shutdown_connections 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.110+0000 7f324c765700 1 -- 172.21.15.98:0/1882325886 wait complete. 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.111+0000 7f324c765700 1 Processor -- start 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.111+0000 7f324c765700 1 -- start start 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.111+0000 7f324c765700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32441004e0 0x7f3244073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.111+0000 7f324c765700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3244100e80 0x7f32440735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f324c765700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3244074e20 con 0x7f32441004e0 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f324c765700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3244074f90 con 0x7f3244100e80 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f324a501700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32441004e0 0x7f3244073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f3249d00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3244100e80 0x7f32440735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f324a501700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32441004e0 0x7f3244073070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45658/0 (socket says 172.21.15.98:45658) 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f324a501700 1 -- 172.21.15.98:0/2647850672 learned_addr learned my addr 172.21.15.98:0/2647850672 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f3249d00700 1 -- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32441004e0 msgr2=0x7f3244073070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f3249d00700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32441004e0 0x7f3244073070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f3249d00700 1 -- 172.21.15.98:0/2647850672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340095f0 con 0x7f3244100e80 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f324a501700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32441004e0 0x7f3244073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.112+0000 7f3249d00700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3244100e80 0x7f32440735b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f324406a0b0 tx=0x7f323400bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.113+0000 7f323b7fe700 1 -- 172.21.15.98:0/2647850672 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f323401d070 con 0x7f3244100e80 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.113+0000 7f323b7fe700 1 -- 172.21.15.98:0/2647850672 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3234005dc0 con 0x7f3244100e80 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.113+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3244073bb0 con 0x7f3244100e80 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.113+0000 7f323b7fe700 1 -- 172.21.15.98:0/2647850672 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f323400fe80 con 0x7f3244100e80 2024-09-13T03:02:35.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.113+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324419a250 con 0x7f3244100e80 2024-09-13T03:02:35.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.114+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3244073ed0 con 0x7f3244100e80 2024-09-13T03:02:35.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.115+0000 7f323b7fe700 1 -- 172.21.15.98:0/2647850672 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3234003a60 con 0x7f3244100e80 2024-09-13T03:02:35.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.115+0000 7f323b7fe700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f323006e680 0x7f3230070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.115+0000 7f323b7fe700 1 -- 172.21.15.98:0/2647850672 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f323408fb30 con 0x7f3244100e80 2024-09-13T03:02:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.115+0000 7f324a501700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f323006e680 0x7f3230070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.116+0000 7f324a501700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f323006e680 0x7f3230070b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3240005950 tx=0x7f324000b500 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:35.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.120+0000 7f323b7fe700 1 -- 172.21.15.98:0/2647850672 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3234058b10 con 0x7f3244100e80 2024-09-13T03:02:35.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.377+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f324404f340 con 0x7f323006e680 2024-09-13T03:02:35.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.379+0000 7f323b7fe700 1 -- 172.21.15.98:0/2647850672 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f324404f340 con 0x7f323006e680 2024-09-13T03:02:35.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.382+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f323006e680 msgr2=0x7f3230070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.382+0000 7f324c765700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f323006e680 0x7f3230070b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3240005950 tx=0x7f324000b500 comp rx=0 tx=0).stop 2024-09-13T03:02:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.382+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3244100e80 msgr2=0x7f32440735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.382+0000 7f324c765700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3244100e80 0x7f32440735b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f324406a0b0 tx=0x7f323400bd70 comp rx=0 tx=0).stop 2024-09-13T03:02:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.382+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 shutdown_connections 2024-09-13T03:02:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.382+0000 7f324c765700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f323006e680 0x7f3230070b30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.382+0000 7f324c765700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32441004e0 0x7f3244073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.382+0000 7f324c765700 1 --2- 172.21.15.98:0/2647850672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3244100e80 0x7f32440735b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.382+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 >> 172.21.15.98:0/2647850672 conn(0x7f32440fbda0 msgr2=0x7f32440fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.383+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 shutdown_connections 2024-09-13T03:02:35.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.383+0000 7f324c765700 1 -- 172.21.15.98:0/2647850672 wait complete. 2024-09-13T03:02:35.398 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T03:02:35.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.506+0000 7fdb02932700 1 -- 172.21.15.98:0/3252790965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdafc075e60 msgr2=0x7fdafc0ff350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.506+0000 7fdb02932700 1 --2- 172.21.15.98:0/3252790965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdafc075e60 0x7fdafc0ff350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009940 tx=0x7fdaec009c50 comp rx=0 tx=0).stop 2024-09-13T03:02:35.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.506+0000 7fdb02932700 1 -- 172.21.15.98:0/3252790965 shutdown_connections 2024-09-13T03:02:35.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.506+0000 7fdb02932700 1 --2- 172.21.15.98:0/3252790965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdafc0ff890 0x7fdafc0ffd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.506+0000 7fdb02932700 1 --2- 172.21.15.98:0/3252790965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdafc075e60 0x7fdafc0ff350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.506+0000 7fdb02932700 1 -- 172.21.15.98:0/3252790965 >> 172.21.15.98:0/3252790965 conn(0x7fdafc0748b0 msgr2=0x7fdafc074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:35.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.506+0000 7fdb02932700 1 -- 172.21.15.98:0/3252790965 shutdown_connections 2024-09-13T03:02:35.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.507+0000 7fdb02932700 1 -- 172.21.15.98:0/3252790965 wait complete. 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.507+0000 7fdb02932700 1 Processor -- start 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.507+0000 7fdb02932700 1 -- start start 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.508+0000 7fdb02932700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdafc075e60 0x7fdafc198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.508+0000 7fdb02932700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdafc0ff890 0x7fdafc1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.508+0000 7fdb02932700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc198cb0 con 0x7fdafc075e60 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.508+0000 7fdb02932700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc19ca40 con 0x7fdafc0ff890 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.508+0000 7fdafbfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdafc075e60 0x7fdafc198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.508+0000 7fdafb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdafc0ff890 0x7fdafc1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.508+0000 7fdafb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdafc0ff890 0x7fdafc1985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.98:50936/0 (socket says 172.21.15.98:50936) 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.508+0000 7fdafb7fe700 1 -- 172.21.15.98:0/3659338581 learned_addr learned my addr 172.21.15.98:0/3659338581 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:35.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdafbfff700 1 -- 172.21.15.98:0/3659338581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdafc0ff890 msgr2=0x7fdafc1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdafbfff700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdafc0ff890 0x7fdafc1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdafbfff700 1 -- 172.21.15.98:0/3659338581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec0095f0 con 0x7fdafc075e60 2024-09-13T03:02:35.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdafb7fe700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdafc0ff890 0x7fdafc1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T03:02:35.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdafbfff700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdafc075e60 0x7fdafc198090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009910 tx=0x7fdaec0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:35.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdaf97fa700 1 -- 172.21.15.98:0/3659338581 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaec01d070 con 0x7fdafc075e60 2024-09-13T03:02:35.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc19ccc0 con 0x7fdafc075e60 2024-09-13T03:02:35.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc19d1b0 con 0x7fdafc075e60 2024-09-13T03:02:35.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdaf97fa700 1 -- 172.21.15.98:0/3659338581 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdaec005dc0 con 0x7fdafc075e60 2024-09-13T03:02:35.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.509+0000 7fdaf97fa700 1 -- 172.21.15.98:0/3659338581 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaec00fe80 con 0x7fdafc075e60 2024-09-13T03:02:35.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.511+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae8005320 con 0x7fdafc075e60 2024-09-13T03:02:35.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.512+0000 7fdaf97fa700 1 -- 172.21.15.98:0/3659338581 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdaec00f460 con 0x7fdafc075e60 2024-09-13T03:02:35.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.512+0000 7fdaf97fa700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdae406e680 0x7fdae4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:35.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.513+0000 7fdaf97fa700 1 -- 172.21.15.98:0/3659338581 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fdaec08f840 con 0x7fdafc075e60 2024-09-13T03:02:35.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.513+0000 7fdafb7fe700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdae406e680 0x7fdae4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:35.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.513+0000 7fdafb7fe700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdae406e680 0x7fdae4070b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdafc1996b0 tx=0x7fdaf0007480 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:35.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.521+0000 7fdaf97fa700 1 -- 172.21.15.98:0/3659338581 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdaec0588c0 con 0x7fdafc075e60 2024-09-13T03:02:35.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.759+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdae8000bf0 con 0x7fdae406e680 2024-09-13T03:02:35.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.761+0000 7fdaf97fa700 1 -- 172.21.15.98:0/3659338581 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fdae8000bf0 con 0x7fdae406e680 2024-09-13T03:02:35.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.763+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdae406e680 msgr2=0x7fdae4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.763+0000 7fdb02932700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdae406e680 0x7fdae4070b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdafc1996b0 tx=0x7fdaf0007480 comp rx=0 tx=0).stop 2024-09-13T03:02:35.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.763+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdafc075e60 msgr2=0x7fdafc198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.763+0000 7fdb02932700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdafc075e60 0x7fdafc198090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009910 tx=0x7fdaec0055f0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.763+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 shutdown_connections 2024-09-13T03:02:35.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.763+0000 7fdb02932700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fdae406e680 0x7fdae4070b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.763+0000 7fdb02932700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdafc075e60 0x7fdafc198090 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.763+0000 7fdb02932700 1 --2- 172.21.15.98:0/3659338581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdafc0ff890 0x7fdafc1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.763+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 >> 172.21.15.98:0/3659338581 conn(0x7fdafc0748b0 msgr2=0x7fdafc0fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:35.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.764+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 shutdown_connections 2024-09-13T03:02:35.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.764+0000 7fdb02932700 1 -- 172.21.15.98:0/3659338581 wait complete. 2024-09-13T03:02:35.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.877+0000 7fed22133700 1 -- 172.21.15.98:0/1445437076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c068540 msgr2=0x7fed1c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.877+0000 7fed22133700 1 --2- 172.21.15.98:0/1445437076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c068540 0x7fed1c0689b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed10009910 tx=0x7fed10009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:35.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.877+0000 7fed22133700 1 -- 172.21.15.98:0/1445437076 shutdown_connections 2024-09-13T03:02:35.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.877+0000 7fed22133700 1 --2- 172.21.15.98:0/1445437076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c068540 0x7fed1c0689b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.877+0000 7fed22133700 1 --2- 172.21.15.98:0/1445437076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1c106320 0x7fed1c1066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.877+0000 7fed22133700 1 -- 172.21.15.98:0/1445437076 >> 172.21.15.98:0/1445437076 conn(0x7fed1c075130 msgr2=0x7fed1c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:35.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.877+0000 7fed22133700 1 -- 172.21.15.98:0/1445437076 shutdown_connections 2024-09-13T03:02:35.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.877+0000 7fed22133700 1 -- 172.21.15.98:0/1445437076 wait complete. 2024-09-13T03:02:35.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed22133700 1 Processor -- start 2024-09-13T03:02:35.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed22133700 1 -- start start 2024-09-13T03:02:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed22133700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1c068540 0x7fed1c0ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed22133700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c106320 0x7fed1c1001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed22133700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c1007b0 con 0x7fed1c106320 2024-09-13T03:02:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed22133700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c100920 con 0x7fed1c068540 2024-09-13T03:02:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed1affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c106320 0x7fed1c1001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:35.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed1affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c106320 0x7fed1c1001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45716/0 (socket says 172.21.15.98:45716) 2024-09-13T03:02:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed1affd700 1 -- 172.21.15.98:0/1808471421 learned_addr learned my addr 172.21.15.98:0/1808471421 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.878+0000 7fed1b7fe700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1c068540 0x7fed1c0ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.879+0000 7fed1affd700 1 -- 172.21.15.98:0/1808471421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1c068540 msgr2=0x7fed1c0ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.879+0000 7fed1affd700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1c068540 0x7fed1c0ffca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:35.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.879+0000 7fed1affd700 1 -- 172.21.15.98:0/1808471421 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100095f0 con 0x7fed1c106320 2024-09-13T03:02:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.879+0000 7fed1affd700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c106320 0x7fed1c1001e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fed10006010 tx=0x7fed1000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.879+0000 7fed18ff9700 1 -- 172.21.15.98:0/1808471421 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1001d070 con 0x7fed1c106320 2024-09-13T03:02:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.879+0000 7fed18ff9700 1 -- 172.21.15.98:0/1808471421 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed10005dc0 con 0x7fed1c106320 2024-09-13T03:02:35.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.879+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c1a2030 con 0x7fed1c106320 2024-09-13T03:02:35.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.879+0000 7fed18ff9700 1 -- 172.21.15.98:0/1808471421 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed10017400 con 0x7fed1c106320 2024-09-13T03:02:35.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.879+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c1a23e0 con 0x7fed1c106320 2024-09-13T03:02:35.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.880+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c108770 con 0x7fed1c106320 2024-09-13T03:02:35.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.881+0000 7fed18ff9700 1 -- 172.21.15.98:0/1808471421 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fed10003a60 con 0x7fed1c106320 2024-09-13T03:02:35.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.881+0000 7fed18ff9700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fed0406e680 0x7fed04070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:35.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.882+0000 7fed18ff9700 1 -- 172.21.15.98:0/1808471421 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fed1008fd30 con 0x7fed1c106320 2024-09-13T03:02:35.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.882+0000 7fed1b7fe700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fed0406e680 0x7fed04070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:35.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.882+0000 7fed1b7fe700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fed0406e680 0x7fed04070b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fed0c005950 tx=0x7fed0c00b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:35.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:35.885+0000 7fed18ff9700 1 -- 172.21.15.98:0/1808471421 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed10058ed0 con 0x7fed1c106320 2024-09-13T03:02:36.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:35 smithi142 ceph-mon[65447]: pgmap v219: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.7 MiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T03:02:36.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:35 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:36.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:35 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:36.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.111+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fed1c061190 con 0x7fed0406e680 2024-09-13T03:02:36.113 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:35 smithi098 ceph-mon[87325]: pgmap v219: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.7 MiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T03:02:36.113 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:35 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:36.113 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:35 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:36.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.121+0000 7fed18ff9700 1 -- 172.21.15.98:0/1808471421 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fed1c061190 con 0x7fed0406e680 2024-09-13T03:02:36.122 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (7m) 56s ago 18m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 starting - - - - 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (17m) 12s ago 17m 9198k - 18.2.0 dc2bc1663786 bfc27901174d 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (4m) 56s ago 18m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (4m) 12s ago 17m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (7m) 56s ago 17m 80.4M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (60s) 56s ago 12m 13.2M - 19.1.1-322-g7741f7f9 19dc8d659727 e3d60a038b35 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (79s) 56s ago 12m 15.4M - 19.1.1-322-g7741f7f9 19dc8d659727 8daec38027b8 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (15s) 12s ago 12m 12.7M - 19.1.1-322-g7741f7f9 19dc8d659727 1a7b03062ec8 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (41s) 12s ago 12m 13.8M - 19.1.1-322-g7741f7f9 19dc8d659727 46f9730b3ab7 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (9m) 56s ago 19m 505M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T03:02:36.123 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (8m) 12s ago 17m 442M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (5m) 56s ago 19m 54.9M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (5m) 12s ago 17m 46.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (8m) 56s ago 18m 16.7M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (8m) 12s ago 17m 15.4M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (4m) 56s ago 16m 110M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (3m) 56s ago 15m 108M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (3m) 56s ago 15m 101M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 04c10c8159ba 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (2m) 12s ago 14m 112M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 322e0a9d6b20 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (2m) 12s ago 14m 111M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 087c65ddb960 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (103s) 12s ago 14m 118M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 31b09c7c1472 2024-09-13T03:02:36.124 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (7m) 56s ago 17m 78.1M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T03:02:36.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fed0406e680 msgr2=0x7fed04070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fed0406e680 0x7fed04070b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fed0c005950 tx=0x7fed0c00b410 comp rx=0 tx=0).stop 2024-09-13T03:02:36.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c106320 msgr2=0x7fed1c1001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c106320 0x7fed1c1001e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fed10006010 tx=0x7fed1000bd70 comp rx=0 tx=0).stop 2024-09-13T03:02:36.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 shutdown_connections 2024-09-13T03:02:36.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fed0406e680 0x7fed04070b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1c068540 0x7fed1c0ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 --2- 172.21.15.98:0/1808471421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed1c106320 0x7fed1c1001e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 >> 172.21.15.98:0/1808471421 conn(0x7fed1c075130 msgr2=0x7fed1c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:36.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 shutdown_connections 2024-09-13T03:02:36.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.123+0000 7fed22133700 1 -- 172.21.15.98:0/1808471421 wait complete. 2024-09-13T03:02:36.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.229+0000 7f8f93460700 1 -- 172.21.15.98:0/1229464917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 msgr2=0x7f8f8c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.229+0000 7f8f93460700 1 --2- 172.21.15.98:0/1229464917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 0x7f8f8c104e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009910 tx=0x7f8f7c009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:36.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.230+0000 7f8f93460700 1 -- 172.21.15.98:0/1229464917 shutdown_connections 2024-09-13T03:02:36.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.230+0000 7f8f93460700 1 --2- 172.21.15.98:0/1229464917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 0x7f8f8c104e50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.230+0000 7f8f93460700 1 --2- 172.21.15.98:0/1229464917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f8c1004e0 0x7f8f8c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.230+0000 7f8f93460700 1 -- 172.21.15.98:0/1229464917 >> 172.21.15.98:0/1229464917 conn(0x7f8f8c0fbda0 msgr2=0x7f8f8c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:36.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.230+0000 7f8f93460700 1 -- 172.21.15.98:0/1229464917 shutdown_connections 2024-09-13T03:02:36.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.230+0000 7f8f93460700 1 -- 172.21.15.98:0/1229464917 wait complete. 2024-09-13T03:02:36.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.230+0000 7f8f93460700 1 Processor -- start 2024-09-13T03:02:36.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.230+0000 7f8f93460700 1 -- start start 2024-09-13T03:02:36.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f93460700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f8c1004e0 0x7f8f8c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:36.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f93460700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 0x7f8f8c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:36.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f93460700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c196b50 con 0x7f8f8c100e80 2024-09-13T03:02:36.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f93460700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c19a8e0 con 0x7f8f8c1004e0 2024-09-13T03:02:36.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f909fb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 0x7f8f8c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:36.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f909fb700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 0x7f8f8c196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45732/0 (socket says 172.21.15.98:45732) 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f909fb700 1 -- 172.21.15.98:0/865854578 learned_addr learned my addr 172.21.15.98:0/865854578 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f911fc700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f8c1004e0 0x7f8f8c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f909fb700 1 -- 172.21.15.98:0/865854578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f8c1004e0 msgr2=0x7f8f8c195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f909fb700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f8c1004e0 0x7f8f8c195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f909fb700 1 -- 172.21.15.98:0/865854578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0095f0 con 0x7f8f8c100e80 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f909fb700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 0x7f8f8c196470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0059d0 tx=0x7f8f7c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.231+0000 7f8f827fc700 1 -- 172.21.15.98:0/865854578 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f7c01d070 con 0x7f8f8c100e80 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.232+0000 7f8f827fc700 1 -- 172.21.15.98:0/865854578 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f7c00b610 con 0x7f8f8c100e80 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.232+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c19ab60 con 0x7f8f8c100e80 2024-09-13T03:02:36.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.232+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c19b050 con 0x7f8f8c100e80 2024-09-13T03:02:36.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.232+0000 7f8f827fc700 1 -- 172.21.15.98:0/865854578 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f7c022470 con 0x7f8f8c100e80 2024-09-13T03:02:36.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.233+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c108850 con 0x7f8f8c100e80 2024-09-13T03:02:36.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.233+0000 7f8f827fc700 1 -- 172.21.15.98:0/865854578 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8f7c00fc70 con 0x7f8f8c100e80 2024-09-13T03:02:36.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.234+0000 7f8f827fc700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8f7806e680 0x7f8f78070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:36.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.234+0000 7f8f827fc700 1 -- 172.21.15.98:0/865854578 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f8f7c08fc10 con 0x7f8f8c100e80 2024-09-13T03:02:36.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.234+0000 7f8f911fc700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8f7806e680 0x7f8f78070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:36.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.234+0000 7f8f911fc700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8f7806e680 0x7f8f78070b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009bf0 tx=0x7f8f88009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:36.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.238+0000 7f8f827fc700 1 -- 172.21.15.98:0/865854578 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8f7c058c90 con 0x7f8f8c100e80 2024-09-13T03:02:36.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.543+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8f8c197290 con 0x7f8f8c100e80 2024-09-13T03:02:36.545 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:02:36.546 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T03:02:36.547 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 14 2024-09-13T03:02:36.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T03:02:36.547 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:02:36.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.543+0000 7f8f827fc700 1 -- 172.21.15.98:0/865854578 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f8f7c05c350 con 0x7f8f8c100e80 2024-09-13T03:02:36.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8f7806e680 msgr2=0x7f8f78070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8f7806e680 0x7f8f78070b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009bf0 tx=0x7f8f88009260 comp rx=0 tx=0).stop 2024-09-13T03:02:36.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 msgr2=0x7f8f8c196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 0x7f8f8c196470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0059d0 tx=0x7f8f7c00f740 comp rx=0 tx=0).stop 2024-09-13T03:02:36.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 shutdown_connections 2024-09-13T03:02:36.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8f7806e680 0x7f8f78070b30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f8c1004e0 0x7f8f8c195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 --2- 172.21.15.98:0/865854578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f8c100e80 0x7f8f8c196470 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 >> 172.21.15.98:0/865854578 conn(0x7f8f8c0fbda0 msgr2=0x7f8f8c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:36.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.547+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 shutdown_connections 2024-09-13T03:02:36.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.548+0000 7f8f93460700 1 -- 172.21.15.98:0/865854578 wait complete. 2024-09-13T03:02:36.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.659+0000 7f080db45700 1 -- 172.21.15.98:0/1928841327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 msgr2=0x7f0808105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.659+0000 7f080db45700 1 --2- 172.21.15.98:0/1928841327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 0x7f0808105600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009910 tx=0x7f07f8009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:36.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.659+0000 7f080db45700 1 -- 172.21.15.98:0/1928841327 shutdown_connections 2024-09-13T03:02:36.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.659+0000 7f080db45700 1 --2- 172.21.15.98:0/1928841327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0808068540 0x7f08080689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.659+0000 7f080db45700 1 --2- 172.21.15.98:0/1928841327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 0x7f0808105600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.659+0000 7f080db45700 1 -- 172.21.15.98:0/1928841327 >> 172.21.15.98:0/1928841327 conn(0x7f0808075130 msgr2=0x7f0808075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:36.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.660+0000 7f080db45700 1 -- 172.21.15.98:0/1928841327 shutdown_connections 2024-09-13T03:02:36.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.660+0000 7f080db45700 1 -- 172.21.15.98:0/1928841327 wait complete. 2024-09-13T03:02:36.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.660+0000 7f080db45700 1 Processor -- start 2024-09-13T03:02:36.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.661+0000 7f080db45700 1 -- start start 2024-09-13T03:02:36.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.661+0000 7f080db45700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0808068540 0x7f08080ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:36.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.661+0000 7f080db45700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 0x7f08081001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:36.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.661+0000 7f080db45700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0808100720 con 0x7f0808105230 2024-09-13T03:02:36.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.661+0000 7f080db45700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0808100860 con 0x7f0808068540 2024-09-13T03:02:36.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.661+0000 7f0806ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 0x7f08081001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:36.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.661+0000 7f0806ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 0x7f08081001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45752/0 (socket says 172.21.15.98:45752) 2024-09-13T03:02:36.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.661+0000 7f0806ffd700 1 -- 172.21.15.98:0/3854469496 learned_addr learned my addr 172.21.15.98:0/3854469496 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:36.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.661+0000 7f08077fe700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0808068540 0x7f08080ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:36.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.662+0000 7f0806ffd700 1 -- 172.21.15.98:0/3854469496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0808068540 msgr2=0x7f08080ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.662+0000 7f0806ffd700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0808068540 0x7f08080ffca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.662+0000 7f0806ffd700 1 -- 172.21.15.98:0/3854469496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80095f0 con 0x7f0808105230 2024-09-13T03:02:36.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.662+0000 7f0806ffd700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 0x7f08081001e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00e920 tx=0x7f07fc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:36.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.662+0000 7f0804ff9700 1 -- 172.21.15.98:0/3854469496 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07fc00c9d0 con 0x7f0808105230 2024-09-13T03:02:36.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.662+0000 7f0804ff9700 1 -- 172.21.15.98:0/3854469496 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07fc010430 con 0x7f0808105230 2024-09-13T03:02:36.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.662+0000 7f080db45700 1 -- 172.21.15.98:0/3854469496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08081a1fb0 con 0x7f0808105230 2024-09-13T03:02:36.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.662+0000 7f0804ff9700 1 -- 172.21.15.98:0/3854469496 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07fc018630 con 0x7f0808105230 2024-09-13T03:02:36.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.663+0000 7f080db45700 1 -- 172.21.15.98:0/3854469496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08081a2370 con 0x7f0808105230 2024-09-13T03:02:36.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.664+0000 7f0804ff9700 1 -- 172.21.15.98:0/3854469496 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f07fc0105a0 con 0x7f0808105230 2024-09-13T03:02:36.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.664+0000 7f07ee7fc700 1 -- 172.21.15.98:0/3854469496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080804f2a0 con 0x7f0808105230 2024-09-13T03:02:36.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.665+0000 7f0804ff9700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f07f006e680 0x7f07f0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:36.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.665+0000 7f0804ff9700 1 -- 172.21.15.98:0/3854469496 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f07fc014070 con 0x7f0808105230 2024-09-13T03:02:36.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.665+0000 7f08077fe700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f07f006e680 0x7f07f0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:36.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.666+0000 7f08077fe700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f07f006e680 0x7f07f0070b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f07f80059d0 tx=0x7f07f8005940 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:36.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.673+0000 7f0804ff9700 1 -- 172.21.15.98:0/3854469496 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f07fc0579f0 con 0x7f0808105230 2024-09-13T03:02:36.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.957+0000 7f07ee7fc700 1 -- 172.21.15.98:0/3854469496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f08081011d0 con 0x7f0808105230 2024-09-13T03:02:36.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.958+0000 7f0804ff9700 1 -- 172.21.15.98:0/3854469496 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+2002 (secure 0 0 0) 0x7f07fc05b0b0 con 0x7f0808105230 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:e38 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:btime 2024-09-13T03:02:29:582796+0000 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 38 2024-09-13T03:02:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T03:02:29.582783+0000 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 92 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T03:02:36.961 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=34378} 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 34378 members: 34378 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:34378} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:36.962 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:34410} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.98:6828/3981027621,v1:172.21.15.98:6829/3981027621] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:36.963 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:02:36.963 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:02:36.963 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T03:02:36.963 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:02:36.963 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:44315} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6824/2834620980,v1:172.21.15.142:6825/2834620980] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:36.963 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/3076033085,v1:172.21.15.142:6827/3076033085] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 -- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f07f006e680 msgr2=0x7f07f0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f07f006e680 0x7f07f0070b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f07f80059d0 tx=0x7f07f8005940 comp rx=0 tx=0).stop 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 -- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 msgr2=0x7f08081001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 0x7f08081001e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00e920 tx=0x7f07fc00ec30 comp rx=0 tx=0).stop 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 -- 172.21.15.98:0/3854469496 shutdown_connections 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f07f006e680 0x7f07f0070b30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0808068540 0x7f08080ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 --2- 172.21.15.98:0/3854469496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0808105230 0x7f08081001e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 -- 172.21.15.98:0/3854469496 >> 172.21.15.98:0/3854469496 conn(0x7f0808075130 msgr2=0x7f08080fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:36.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.961+0000 7f07ee7fc700 1 -- 172.21.15.98:0/3854469496 shutdown_connections 2024-09-13T03:02:36.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:36.962+0000 7f07ee7fc700 1 -- 172.21.15.98:0/3854469496 wait complete. 2024-09-13T03:02:36.965 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 38 2024-09-13T03:02:36.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:36 smithi098 ceph-mon[87325]: from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:36 smithi098 ceph-mon[87325]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:36 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/865854578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:36 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:36 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T03:02:36.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:36 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:37.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.071+0000 7f575b955700 1 -- 172.21.15.98:0/3887226365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 msgr2=0x7f57541017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:37.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.071+0000 7f575b955700 1 --2- 172.21.15.98:0/3887226365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 0x7f57541017f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5750009910 tx=0x7f5750009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.071+0000 7f575b955700 1 -- 172.21.15.98:0/3887226365 shutdown_connections 2024-09-13T03:02:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.071+0000 7f575b955700 1 --2- 172.21.15.98:0/3887226365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5754101d30 0x7f575410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.071+0000 7f575b955700 1 --2- 172.21.15.98:0/3887226365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 0x7f57541017f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.071+0000 7f575b955700 1 -- 172.21.15.98:0/3887226365 >> 172.21.15.98:0/3887226365 conn(0x7f57540fac60 msgr2=0x7f57540fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.071+0000 7f575b955700 1 -- 172.21.15.98:0/3887226365 shutdown_connections 2024-09-13T03:02:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.071+0000 7f575b955700 1 -- 172.21.15.98:0/3887226365 wait complete. 2024-09-13T03:02:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.072+0000 7f575b955700 1 Processor -- start 2024-09-13T03:02:37.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.072+0000 7f575b955700 1 -- start start 2024-09-13T03:02:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.072+0000 7f575b955700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 0x7f5754195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.072+0000 7f575b955700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5754101d30 0x7f57541963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.072+0000 7f575b955700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5754196ac0 con 0x7f5754101420 2024-09-13T03:02:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.072+0000 7f575b955700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575419a850 con 0x7f5754101d30 2024-09-13T03:02:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f57596f1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 0x7f5754195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f57596f1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 0x7f5754195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45768/0 (socket says 172.21.15.98:45768) 2024-09-13T03:02:37.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f57596f1700 1 -- 172.21.15.98:0/3514943266 learned_addr learned my addr 172.21.15.98:0/3514943266 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f5758ef0700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5754101d30 0x7f57541963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f57596f1700 1 -- 172.21.15.98:0/3514943266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5754101d30 msgr2=0x7f57541963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f57596f1700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5754101d30 0x7f57541963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f57596f1700 1 -- 172.21.15.98:0/3514943266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57500095f0 con 0x7f5754101420 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f5758ef0700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5754101d30 0x7f57541963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f57596f1700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 0x7f5754195ea0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5750005f50 tx=0x7f575000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f574a7fc700 1 -- 172.21.15.98:0/3514943266 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f575001d070 con 0x7f5754101420 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.073+0000 7f574a7fc700 1 -- 172.21.15.98:0/3514943266 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f575000b610 con 0x7f5754101420 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.074+0000 7f574a7fc700 1 -- 172.21.15.98:0/3514943266 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5750022470 con 0x7f5754101420 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.074+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575419aad0 con 0x7f5754101420 2024-09-13T03:02:37.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.074+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575419af90 con 0x7f5754101420 2024-09-13T03:02:37.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.075+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5754107900 con 0x7f5754101420 2024-09-13T03:02:37.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.076+0000 7f574a7fc700 1 -- 172.21.15.98:0/3514943266 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f575000fba0 con 0x7f5754101420 2024-09-13T03:02:37.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.077+0000 7f574a7fc700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574006e4d0 0x7f5740070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:37.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.077+0000 7f574a7fc700 1 -- 172.21.15.98:0/3514943266 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f575008fa40 con 0x7f5754101420 2024-09-13T03:02:37.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.079+0000 7f5758ef0700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574006e4d0 0x7f5740070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:37.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.079+0000 7f5758ef0700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574006e4d0 0x7f5740070980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f57541974c0 tx=0x7f5744009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:37.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.082+0000 7f574a7fc700 1 -- 172.21.15.98:0/3514943266 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5750058b60 con 0x7f5754101420 2024-09-13T03:02:37.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:36 smithi142 ceph-mon[65447]: from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:37.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:36 smithi142 ceph-mon[65447]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:37.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:36 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/865854578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:37.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:36 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:37.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:36 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T03:02:37.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:36 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:37.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.314+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5754197340 con 0x7f574006e4d0 2024-09-13T03:02:37.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.315+0000 7f574a7fc700 1 -- 172.21.15.98:0/3514943266 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f5744009dc0 con 0x7f574006e4d0 2024-09-13T03:02:37.317 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:02:37.317 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:02:37.317 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": true, 2024-09-13T03:02:37.317 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:02:37.317 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [ 2024-09-13T03:02:37.317 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-13T03:02:37.318 INFO:teuthology.orchestra.run.smithi098.stdout: "mon", 2024-09-13T03:02:37.318 INFO:teuthology.orchestra.run.smithi098.stdout: "mds", 2024-09-13T03:02:37.318 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr", 2024-09-13T03:02:37.318 INFO:teuthology.orchestra.run.smithi098.stdout: "osd" 2024-09-13T03:02:37.318 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-13T03:02:37.318 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": "16/23 daemons upgraded", 2024-09-13T03:02:37.318 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-13T03:02:37.318 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T03:02:37.318 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:02:37.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574006e4d0 msgr2=0x7f5740070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:37.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574006e4d0 0x7f5740070980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f57541974c0 tx=0x7f5744009260 comp rx=0 tx=0).stop 2024-09-13T03:02:37.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 msgr2=0x7f5754195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:37.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 0x7f5754195ea0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5750005f50 tx=0x7f575000f740 comp rx=0 tx=0).stop 2024-09-13T03:02:37.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 shutdown_connections 2024-09-13T03:02:37.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574006e4d0 0x7f5740070980 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5754101420 0x7f5754195ea0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 --2- 172.21.15.98:0/3514943266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5754101d30 0x7f57541963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 >> 172.21.15.98:0/3514943266 conn(0x7f57540fac60 msgr2=0x7f5754104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:37.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 shutdown_connections 2024-09-13T03:02:37.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.318+0000 7f575b955700 1 -- 172.21.15.98:0/3514943266 wait complete. 2024-09-13T03:02:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.426+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/392271780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b481038b0 msgr2=0x7f6b48103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.426+0000 7f6b4ca2d700 1 --2- 172.21.15.98:0/392271780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b481038b0 0x7f6b48103c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009910 tx=0x7f6b38009c20 comp rx=0 tx=0).stop 2024-09-13T03:02:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.426+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/392271780 shutdown_connections 2024-09-13T03:02:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.426+0000 7f6b4ca2d700 1 --2- 172.21.15.98:0/392271780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b480ff350 0x7f6b480ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.426+0000 7f6b4ca2d700 1 --2- 172.21.15.98:0/392271780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b481038b0 0x7f6b48103c80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.426+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/392271780 >> 172.21.15.98:0/392271780 conn(0x7f6b480748b0 msgr2=0x7f6b48074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:37.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.426+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/392271780 shutdown_connections 2024-09-13T03:02:37.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.426+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/392271780 wait complete. 2024-09-13T03:02:37.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.427+0000 7f6b4ca2d700 1 Processor -- start 2024-09-13T03:02:37.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.427+0000 7f6b4ca2d700 1 -- start start 2024-09-13T03:02:37.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4ca2d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b480ff350 0x7f6b481999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:37.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4ca2d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b481038b0 0x7f6b48199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:37.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4ca2d700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4819a5b0 con 0x7f6b480ff350 2024-09-13T03:02:37.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4ca2d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b48193a60 con 0x7f6b481038b0 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b480ff350 0x7f6b481999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b480ff350 0x7f6b481999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45790/0 (socket says 172.21.15.98:45790) 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4659c700 1 -- 172.21.15.98:0/2965329944 learned_addr learned my addr 172.21.15.98:0/2965329944 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b45d9b700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b481038b0 0x7f6b48199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4659c700 1 -- 172.21.15.98:0/2965329944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b481038b0 msgr2=0x7f6b48199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4659c700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b481038b0 0x7f6b48199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4659c700 1 -- 172.21.15.98:0/2965329944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380095f0 con 0x7f6b480ff350 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.428+0000 7f6b4659c700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b480ff350 0x7f6b481999e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800bd70 tx=0x7f6b3800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.429+0000 7f6b377fe700 1 -- 172.21.15.98:0/2965329944 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b3801d070 con 0x7f6b480ff350 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.429+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b48193ce0 con 0x7f6b480ff350 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.429+0000 7f6b377fe700 1 -- 172.21.15.98:0/2965329944 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b38005dc0 con 0x7f6b480ff350 2024-09-13T03:02:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.429+0000 7f6b377fe700 1 -- 172.21.15.98:0/2965329944 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b38017400 con 0x7f6b480ff350 2024-09-13T03:02:37.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.429+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b481941d0 con 0x7f6b480ff350 2024-09-13T03:02:37.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.430+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b48106e20 con 0x7f6b480ff350 2024-09-13T03:02:37.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.431+0000 7f6b377fe700 1 -- 172.21.15.98:0/2965329944 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6b3800f460 con 0x7f6b480ff350 2024-09-13T03:02:37.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.431+0000 7f6b377fe700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6b3006e680 0x7f6b30070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:37.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.431+0000 7f6b377fe700 1 -- 172.21.15.98:0/2965329944 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f6b3808fe40 con 0x7f6b480ff350 2024-09-13T03:02:37.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.432+0000 7f6b45d9b700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6b3006e680 0x7f6b30070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:37.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.432+0000 7f6b45d9b700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6b3006e680 0x7f6b30070b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6b480750d0 tx=0x7f6b3c010040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:37.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.435+0000 7f6b377fe700 1 -- 172.21.15.98:0/2965329944 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6b3805cb30 con 0x7f6b480ff350 2024-09-13T03:02:37.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.737+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6b4804f2a0 con 0x7f6b480ff350 2024-09-13T03:02:37.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.738+0000 7f6b377fe700 1 -- 172.21.15.98:0/2965329944 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6b3805c6c0 con 0x7f6b480ff350 2024-09-13T03:02:37.740 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T03:02:37.740 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:02:37.740 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:02:37.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.740+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6b3006e680 msgr2=0x7f6b30070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.740+0000 7f6b4ca2d700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6b3006e680 0x7f6b30070b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6b480750d0 tx=0x7f6b3c010040 comp rx=0 tx=0).stop 2024-09-13T03:02:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.740+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b480ff350 msgr2=0x7f6b481999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.740+0000 7f6b4ca2d700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b480ff350 0x7f6b481999e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800bd70 tx=0x7f6b3800bda0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.740+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 shutdown_connections 2024-09-13T03:02:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.740+0000 7f6b4ca2d700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f6b3006e680 0x7f6b30070b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.740+0000 7f6b4ca2d700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b480ff350 0x7f6b481999e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.740+0000 7f6b4ca2d700 1 --2- 172.21.15.98:0/2965329944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b481038b0 0x7f6b48199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.740+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 >> 172.21.15.98:0/2965329944 conn(0x7f6b480748b0 msgr2=0x7f6b480fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.741+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 shutdown_connections 2024-09-13T03:02:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:02:37.741+0000 7f6b4ca2d700 1 -- 172.21.15.98:0/2965329944 wait complete. 2024-09-13T03:02:38.125 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:37 smithi142 ceph-mon[65447]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:38.125 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:37 smithi142 ceph-mon[65447]: pgmap v220: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-13T03:02:38.125 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:37 smithi142 ceph-mon[65447]: Upgrade: Updating ceph-exporter.smithi142 (2/2) 2024-09-13T03:02:38.126 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:37 smithi142 ceph-mon[65447]: Deploying daemon ceph-exporter.smithi142 on smithi142 2024-09-13T03:02:38.126 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:37 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3854469496' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:02:38.126 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:37 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2965329944' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:02:38.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:37 smithi098 ceph-mon[87325]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:37 smithi098 ceph-mon[87325]: pgmap v220: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-13T03:02:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:37 smithi098 ceph-mon[87325]: Upgrade: Updating ceph-exporter.smithi142 (2/2) 2024-09-13T03:02:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:37 smithi098 ceph-mon[87325]: Deploying daemon ceph-exporter.smithi142 on smithi142 2024-09-13T03:02:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:37 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3854469496' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:02:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:37 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2965329944' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:02:39.107 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:38 smithi142 ceph-mon[65447]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:39.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:38 smithi098 ceph-mon[87325]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:40.147 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:39 smithi142 ceph-mon[65447]: pgmap v221: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5 op/s 2024-09-13T03:02:40.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:39 smithi098 ceph-mon[87325]: pgmap v221: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5 op/s 2024-09-13T03:02:41.717 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:41 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:41.717 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:41 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:41.717 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:41 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:41.718 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:41 smithi142 ceph-mon[65447]: pgmap v222: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-13T03:02:41.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:41 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:41.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:41 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:41.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:41 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:41.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:41 smithi098 ceph-mon[87325]: pgmap v222: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-13T03:02:43.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:43.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:43.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:43 smithi142 ceph-mon[65447]: pgmap v223: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-13T03:02:43.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:43.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:43 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:43.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:43.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:43.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:43 smithi098 ceph-mon[87325]: pgmap v223: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-13T03:02:43.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:43.734 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:43 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:45.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:45 smithi098 ceph-mon[87325]: pgmap v224: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-13T03:02:45.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:45 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:45.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:45 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:46.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:45 smithi142 ceph-mon[65447]: pgmap v224: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-13T03:02:46.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:45 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:46.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:45 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:46 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:46 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:46 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:47.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:46 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:47.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:46 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:47.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:46 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:47.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:46 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:47.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:46 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:47 smithi098 ceph-mon[87325]: pgmap v225: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-13T03:02:48.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:47 smithi142 ceph-mon[65447]: pgmap v225: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-13T03:02:49.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:49.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:50.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: pgmap v226: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 2 op/s 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.235 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:49 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: pgmap v226: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 2 op/s 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:49 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T03:02:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T03:02:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T03:02:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T03:02:50.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi098"}]: dispatch 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi098"}]': finished 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]: dispatch 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]': finished 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.985 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all iscsi 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all nfs 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:50.986 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T03:02:50.987 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T03:02:50.988 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T03:02:50.988 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:50.988 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T03:02:50.988 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T03:02:50.988 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T03:02:50.988 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T03:02:50.988 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T03:02:50.988 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T03:02:50.988 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:50.989 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:50.990 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:50.990 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:50.990 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:50.990 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T03:02:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T03:02:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: fsmap cephfs:1 {0=cephfs.smithi098.nwzstq=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T03:02:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi098"}]: dispatch 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi098"}]': finished 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]: dispatch 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]': finished 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all iscsi 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all nfs 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:51.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T03:02:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T03:02:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T03:02:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:51 smithi098 ceph-mon[87325]: Upgrade: Setting container_image for all nvmeof 2024-09-13T03:02:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:51 smithi098 ceph-mon[87325]: Upgrade: Finalizing container_image settings 2024-09-13T03:02:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:51 smithi098 ceph-mon[87325]: Upgrade: Complete! 2024-09-13T03:02:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:51 smithi098 ceph-mon[87325]: pgmap v227: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-09-13T03:02:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:51 smithi142 ceph-mon[65447]: Upgrade: Setting container_image for all nvmeof 2024-09-13T03:02:52.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:51 smithi142 ceph-mon[65447]: Upgrade: Finalizing container_image settings 2024-09-13T03:02:52.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:51 smithi142 ceph-mon[65447]: Upgrade: Complete! 2024-09-13T03:02:52.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:51 smithi142 ceph-mon[65447]: pgmap v227: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-09-13T03:02:54.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:53 smithi098 ceph-mon[87325]: pgmap v228: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-13T03:02:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:53 smithi142 ceph-mon[65447]: pgmap v228: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-13T03:02:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:02:56.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:55 smithi098 ceph-mon[87325]: pgmap v229: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:02:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:55 smithi142 ceph-mon[65447]: pgmap v229: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:02:58.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:57 smithi098 ceph-mon[87325]: pgmap v230: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:02:58.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:57 smithi142 ceph-mon[65447]: pgmap v230: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:00.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:02:59 smithi098 ceph-mon[87325]: pgmap v231: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:02:59 smithi142 ceph-mon[65447]: pgmap v231: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:02.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:01 smithi098 ceph-mon[87325]: pgmap v232: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:01 smithi142 ceph-mon[65447]: pgmap v232: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:04.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:03 smithi098 ceph-mon[87325]: pgmap v233: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:03 smithi142 ceph-mon[65447]: pgmap v233: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:06.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:05 smithi142 ceph-mon[65447]: pgmap v234: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:05 smithi098 ceph-mon[87325]: pgmap v234: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:07.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.860+0000 7f059b74b700 1 -- 172.21.15.98:0/111211768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0594100e80 msgr2=0x7f0594104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:07.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.860+0000 7f059b74b700 1 --2- 172.21.15.98:0/111211768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0594100e80 0x7f0594104e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0590009910 tx=0x7f0590009c20 comp rx=0 tx=0).stop 2024-09-13T03:03:07.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.860+0000 7f059b74b700 1 -- 172.21.15.98:0/111211768 shutdown_connections 2024-09-13T03:03:07.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.860+0000 7f059b74b700 1 --2- 172.21.15.98:0/111211768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0594100e80 0x7f0594104e50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:07.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.860+0000 7f059b74b700 1 --2- 172.21.15.98:0/111211768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05941004e0 0x7f05941008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:07.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.860+0000 7f059b74b700 1 -- 172.21.15.98:0/111211768 >> 172.21.15.98:0/111211768 conn(0x7f05940fbda0 msgr2=0x7f05940fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:07.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.860+0000 7f059b74b700 1 -- 172.21.15.98:0/111211768 shutdown_connections 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.860+0000 7f059b74b700 1 -- 172.21.15.98:0/111211768 wait complete. 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.861+0000 7f059b74b700 1 Processor -- start 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.861+0000 7f059b74b700 1 -- start start 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.861+0000 7f059b74b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05941004e0 0x7f0594195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.861+0000 7f059b74b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0594100e80 0x7f0594196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.861+0000 7f059b74b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0594196c10 con 0x7f05941004e0 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f059b74b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059419a9a0 con 0x7f0594100e80 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f05994e7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05941004e0 0x7f0594195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f05994e7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05941004e0 0x7f0594195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55334/0 (socket says 172.21.15.98:55334) 2024-09-13T03:03:07.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f05994e7700 1 -- 172.21.15.98:0/2653143180 learned_addr learned my addr 172.21.15.98:0/2653143180 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f0598ce6700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0594100e80 0x7f0594196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f05994e7700 1 -- 172.21.15.98:0/2653143180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0594100e80 msgr2=0x7f0594196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f05994e7700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0594100e80 0x7f0594196530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f05994e7700 1 -- 172.21.15.98:0/2653143180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05900095f0 con 0x7f05941004e0 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f05994e7700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05941004e0 0x7f0594195ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f058400b4b0 tx=0x7f058400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f058a7fc700 1 -- 172.21.15.98:0/2653143180 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0584011800 con 0x7f05941004e0 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f058a7fc700 1 -- 172.21.15.98:0/2653143180 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0584011e20 con 0x7f05941004e0 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059419ac80 con 0x7f05941004e0 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f058a7fc700 1 -- 172.21.15.98:0/2653143180 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f058400f2e0 con 0x7f05941004e0 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.862+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059419b1d0 con 0x7f05941004e0 2024-09-13T03:03:07.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.863+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0594108780 con 0x7f05941004e0 2024-09-13T03:03:07.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.864+0000 7f058a7fc700 1 -- 172.21.15.98:0/2653143180 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0584010380 con 0x7f05941004e0 2024-09-13T03:03:07.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.864+0000 7f058a7fc700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f058006e680 0x7f0580070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:07.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.864+0000 7f058a7fc700 1 -- 172.21.15.98:0/2653143180 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f058408e350 con 0x7f05941004e0 2024-09-13T03:03:07.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.864+0000 7f0598ce6700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f058006e680 0x7f0580070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:07.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.865+0000 7f0598ce6700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f058006e680 0x7f0580070b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0590006010 tx=0x7f059000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:07.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:07.869+0000 7f058a7fc700 1 -- 172.21.15.98:0/2653143180 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f05840573d0 con 0x7f05941004e0 2024-09-13T03:03:08.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.090+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f059419b450 con 0x7f058006e680 2024-09-13T03:03:08.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.092+0000 7f058a7fc700 1 -- 172.21.15.98:0/2653143180 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f059419b450 con 0x7f058006e680 2024-09-13T03:03:08.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f058006e680 msgr2=0x7f0580070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f058006e680 0x7f0580070b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0590006010 tx=0x7f059000b540 comp rx=0 tx=0).stop 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05941004e0 msgr2=0x7f0594195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05941004e0 0x7f0594195ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f058400b4b0 tx=0x7f058400b870 comp rx=0 tx=0).stop 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 shutdown_connections 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f058006e680 0x7f0580070b30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05941004e0 0x7f0594195ff0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 --2- 172.21.15.98:0/2653143180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0594100e80 0x7f0594196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 >> 172.21.15.98:0/2653143180 conn(0x7f05940fbda0 msgr2=0x7f05940fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 shutdown_connections 2024-09-13T03:03:08.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:08.094+0000 7f059b74b700 1 -- 172.21.15.98:0/2653143180 wait complete. 2024-09-13T03:03:08.135 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:07 smithi098 ceph-mon[87325]: pgmap v235: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:07 smithi142 ceph-mon[65447]: pgmap v235: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:08.824 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch ps' 2024-09-13T03:03:09.031 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:03:09.153 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:08 smithi098 ceph-mon[87325]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:09.153 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:08 smithi098 ceph-mon[87325]: pgmap v236: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:09.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:08 smithi142 ceph-mon[65447]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:09.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:08 smithi142 ceph-mon[65447]: pgmap v236: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:10.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.629+0000 7f78780a7700 1 -- 172.21.15.98:0/1854529121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ffd60 msgr2=0x7f7870103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:10.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.629+0000 7f78780a7700 1 --2- 172.21.15.98:0/1854529121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ffd60 0x7f7870103d30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7864009910 tx=0x7f7864009c20 comp rx=0 tx=0).stop 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.629+0000 7f78780a7700 1 -- 172.21.15.98:0/1854529121 shutdown_connections 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.629+0000 7f78780a7700 1 --2- 172.21.15.98:0/1854529121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ffd60 0x7f7870103d30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.629+0000 7f78780a7700 1 --2- 172.21.15.98:0/1854529121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700ff3c0 0x7f78700ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.629+0000 7f78780a7700 1 -- 172.21.15.98:0/1854529121 >> 172.21.15.98:0/1854529121 conn(0x7f78700fac80 msgr2=0x7f78700fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.629+0000 7f78780a7700 1 -- 172.21.15.98:0/1854529121 shutdown_connections 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.629+0000 7f78780a7700 1 -- 172.21.15.98:0/1854529121 wait complete. 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.629+0000 7f78780a7700 1 Processor -- start 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f78780a7700 1 -- start start 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f78780a7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ff3c0 0x7f7870196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f78780a7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700ffd60 0x7f7870197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f78780a7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78701979b0 con 0x7f78700ff3c0 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f78780a7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7870197af0 con 0x7f78700ffd60 2024-09-13T03:03:10.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f7875e43700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ff3c0 0x7f7870196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f7875e43700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ff3c0 0x7f7870196e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55338/0 (socket says 172.21.15.98:55338) 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f7875e43700 1 -- 172.21.15.98:0/3659396988 learned_addr learned my addr 172.21.15.98:0/3659396988 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f7875642700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700ffd60 0x7f7870197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f7875e43700 1 -- 172.21.15.98:0/3659396988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700ffd60 msgr2=0x7f7870197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f7875e43700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700ffd60 0x7f7870197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f7875e43700 1 -- 172.21.15.98:0/3659396988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78640095f0 con 0x7f78700ff3c0 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.630+0000 7f7875e43700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ff3c0 0x7f7870196e50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f786800ba50 tx=0x7f786800bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.631+0000 7f786effd700 1 -- 172.21.15.98:0/3659396988 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f786800c900 con 0x7f78700ff3c0 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.631+0000 7f786effd700 1 -- 172.21.15.98:0/3659396988 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7868014440 con 0x7f78700ff3c0 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.631+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787019fec0 con 0x7f78700ff3c0 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.631+0000 7f786effd700 1 -- 172.21.15.98:0/3659396988 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78680075a0 con 0x7f78700ff3c0 2024-09-13T03:03:10.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.631+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78701a0330 con 0x7f78700ff3c0 2024-09-13T03:03:10.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.632+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7870107680 con 0x7f78700ff3c0 2024-09-13T03:03:10.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.632+0000 7f786effd700 1 -- 172.21.15.98:0/3659396988 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f78680145b0 con 0x7f78700ff3c0 2024-09-13T03:03:10.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.633+0000 7f786effd700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f785806e680 0x7f7858070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:10.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.633+0000 7f786effd700 1 -- 172.21.15.98:0/3659396988 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f7868006e40 con 0x7f78700ff3c0 2024-09-13T03:03:10.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.633+0000 7f7875642700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f785806e680 0x7f7858070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:10.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.633+0000 7f7875642700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f785806e680 0x7f7858070b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7864009fd0 tx=0x7f786401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:10.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.637+0000 7f786effd700 1 -- 172.21.15.98:0/3659396988 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7868056ef0 con 0x7f78700ff3c0 2024-09-13T03:03:10.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.850+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7870061190 con 0x7f785806e680 2024-09-13T03:03:10.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.860+0000 7f786effd700 1 -- 172.21.15.98:0/3659396988 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7870061190 con 0x7f785806e680 2024-09-13T03:03:10.861 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (8m) 25s ago 18m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (36s) 25s ago 18m 8162k - 19.1.1-322-g7741f7f9 19dc8d659727 6da1f4b10e02 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (30s) 28s ago 17m 7151k - 19.1.1-322-g7741f7f9 19dc8d659727 0883f857c904 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (5m) 25s ago 18m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (5m) 28s ago 17m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (7m) 25s ago 18m 80.8M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (95s) 25s ago 13m 85.4M - 19.1.1-322-g7741f7f9 19dc8d659727 e3d60a038b35 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (114s) 25s ago 13m 85.9M - 19.1.1-322-g7741f7f9 19dc8d659727 8daec38027b8 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (50s) 28s ago 13m 13.8M - 19.1.1-322-g7741f7f9 19dc8d659727 1a7b03062ec8 2024-09-13T03:03:10.862 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (76s) 28s ago 13m 14.0M - 19.1.1-322-g7741f7f9 19dc8d659727 46f9730b3ab7 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (10m) 25s ago 20m 507M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (9m) 28s ago 17m 442M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (6m) 25s ago 20m 60.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (6m) 28s ago 17m 47.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (8m) 25s ago 18m 17.0M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (8m) 28s ago 17m 15.0M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (5m) 25s ago 16m 114M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (4m) 25s ago 16m 108M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (3m) 25s ago 15m 102M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 04c10c8159ba 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (3m) 28s ago 15m 114M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 322e0a9d6b20 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (2m) 28s ago 15m 113M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 087c65ddb960 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (2m) 28s ago 14m 119M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 31b09c7c1472 2024-09-13T03:03:10.863 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (8m) 25s ago 18m 84.6M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T03:03:10.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.862+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f785806e680 msgr2=0x7f7858070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:10.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.862+0000 7f78780a7700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f785806e680 0x7f7858070b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7864009fd0 tx=0x7f786401a040 comp rx=0 tx=0).stop 2024-09-13T03:03:10.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.862+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ff3c0 msgr2=0x7f7870196e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:10.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.862+0000 7f78780a7700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ff3c0 0x7f7870196e50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f786800ba50 tx=0x7f786800bd60 comp rx=0 tx=0).stop 2024-09-13T03:03:10.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.862+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 shutdown_connections 2024-09-13T03:03:10.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.862+0000 7f78780a7700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f785806e680 0x7f7858070b30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:10.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.862+0000 7f78780a7700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78700ff3c0 0x7f7870196e50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:10.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.862+0000 7f78780a7700 1 --2- 172.21.15.98:0/3659396988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700ffd60 0x7f7870197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:10.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.862+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 >> 172.21.15.98:0/3659396988 conn(0x7f78700fac80 msgr2=0x7f78700fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:10.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.863+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 shutdown_connections 2024-09-13T03:03:10.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:10.863+0000 7f78780a7700 1 -- 172.21.15.98:0/3659396988 wait complete. 2024-09-13T03:03:11.589 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch upgrade status' 2024-09-13T03:03:11.795 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:03:11.857 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:11 smithi098 ceph-mon[87325]: pgmap v237: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:11.857 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:11 smithi098 ceph-mon[87325]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:12.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:11 smithi142 ceph-mon[65447]: pgmap v237: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:12.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:11 smithi142 ceph-mon[65447]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:13.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.482+0000 7f350fb45700 1 -- 172.21.15.98:0/3706867514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 msgr2=0x7f3508100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.482+0000 7f350fb45700 1 --2- 172.21.15.98:0/3706867514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 0x7f3508100040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009910 tx=0x7f34f8009c20 comp rx=0 tx=0).stop 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.482+0000 7f350fb45700 1 -- 172.21.15.98:0/3706867514 shutdown_connections 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.482+0000 7f350fb45700 1 --2- 172.21.15.98:0/3706867514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 0x7f3508100040 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.482+0000 7f350fb45700 1 --2- 172.21.15.98:0/3706867514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3508104130 0x7f3508104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.482+0000 7f350fb45700 1 -- 172.21.15.98:0/3706867514 >> 172.21.15.98:0/3706867514 conn(0x7f3508075130 msgr2=0x7f3508075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.482+0000 7f350fb45700 1 -- 172.21.15.98:0/3706867514 shutdown_connections 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.482+0000 7f350fb45700 1 -- 172.21.15.98:0/3706867514 wait complete. 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350fb45700 1 Processor -- start 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350fb45700 1 -- start start 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350fb45700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 0x7f3508196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350fb45700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3508104130 0x7f35081971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350fb45700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3508197770 con 0x7f35080ffbd0 2024-09-13T03:03:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350fb45700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35081978b0 con 0x7f3508104130 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350d8e1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 0x7f3508196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350d8e1700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 0x7f3508196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55356/0 (socket says 172.21.15.98:55356) 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350d8e1700 1 -- 172.21.15.98:0/2540490297 learned_addr learned my addr 172.21.15.98:0/2540490297 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350d0e0700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3508104130 0x7f35081971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350d8e1700 1 -- 172.21.15.98:0/2540490297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3508104130 msgr2=0x7f35081971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350d8e1700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3508104130 0x7f35081971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.483+0000 7f350d8e1700 1 -- 172.21.15.98:0/2540490297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80095f0 con 0x7f35080ffbd0 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.484+0000 7f350d8e1700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 0x7f3508196ca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f350400c930 tx=0x7f350400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.484+0000 7f34feffd700 1 -- 172.21.15.98:0/2540490297 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3504007ad0 con 0x7f35080ffbd0 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.484+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350819fd10 con 0x7f35080ffbd0 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.484+0000 7f34feffd700 1 -- 172.21.15.98:0/2540490297 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3504007c30 con 0x7f35080ffbd0 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.484+0000 7f34feffd700 1 -- 172.21.15.98:0/2540490297 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3504018610 con 0x7f35080ffbd0 2024-09-13T03:03:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.484+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35081a0180 con 0x7f35080ffbd0 2024-09-13T03:03:13.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.485+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350804f2a0 con 0x7f35080ffbd0 2024-09-13T03:03:13.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.485+0000 7f34feffd700 1 -- 172.21.15.98:0/2540490297 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f350400f450 con 0x7f35080ffbd0 2024-09-13T03:03:13.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.486+0000 7f34feffd700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f34f406e680 0x7f34f4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:13.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.486+0000 7f34feffd700 1 -- 172.21.15.98:0/2540490297 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f350408e8c0 con 0x7f35080ffbd0 2024-09-13T03:03:13.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.486+0000 7f350d0e0700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f34f406e680 0x7f34f4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:13.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.486+0000 7f350d0e0700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f34f406e680 0x7f34f4070b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34f8006010 tx=0x7f34f800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:13.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.490+0000 7f34feffd700 1 -- 172.21.15.98:0/2540490297 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f35040579c0 con 0x7f35080ffbd0 2024-09-13T03:03:13.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.709+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35080ff240 con 0x7f34f406e680 2024-09-13T03:03:13.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.710+0000 7f34feffd700 1 -- 172.21.15.98:0/2540490297 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f35080ff240 con 0x7f34f406e680 2024-09-13T03:03:13.712 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:03:13.712 INFO:teuthology.orchestra.run.smithi098.stdout: "target_image": null, 2024-09-13T03:03:13.712 INFO:teuthology.orchestra.run.smithi098.stdout: "in_progress": false, 2024-09-13T03:03:13.712 INFO:teuthology.orchestra.run.smithi098.stdout: "which": "", 2024-09-13T03:03:13.712 INFO:teuthology.orchestra.run.smithi098.stdout: "services_complete": [], 2024-09-13T03:03:13.712 INFO:teuthology.orchestra.run.smithi098.stdout: "progress": null, 2024-09-13T03:03:13.712 INFO:teuthology.orchestra.run.smithi098.stdout: "message": "", 2024-09-13T03:03:13.713 INFO:teuthology.orchestra.run.smithi098.stdout: "is_paused": false 2024-09-13T03:03:13.713 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:03:13.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f34f406e680 msgr2=0x7f34f4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:13.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f34f406e680 0x7f34f4070b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34f8006010 tx=0x7f34f800b540 comp rx=0 tx=0).stop 2024-09-13T03:03:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 msgr2=0x7f3508196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 0x7f3508196ca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f350400c930 tx=0x7f350400ccf0 comp rx=0 tx=0).stop 2024-09-13T03:03:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 shutdown_connections 2024-09-13T03:03:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f34f406e680 0x7f34f4070b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35080ffbd0 0x7f3508196ca0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 --2- 172.21.15.98:0/2540490297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3508104130 0x7f35081971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 >> 172.21.15.98:0/2540490297 conn(0x7f3508075130 msgr2=0x7f35080feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 shutdown_connections 2024-09-13T03:03:13.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:13.713+0000 7f350fb45700 1 -- 172.21.15.98:0/2540490297 wait complete. 2024-09-13T03:03:13.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:13 smithi098 ceph-mon[87325]: pgmap v238: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:14.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:13 smithi142 ceph-mon[65447]: pgmap v238: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:14.364 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph health detail' 2024-09-13T03:03:14.566 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:03:14.946 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:14 smithi098 ceph-mon[87325]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:15.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:14 smithi142 ceph-mon[65447]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:16.086 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:15 smithi098 ceph-mon[87325]: pgmap v239: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.112+0000 7f03e9092700 1 -- 172.21.15.98:0/70963859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ffd60 msgr2=0x7f03e4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.112+0000 7f03e9092700 1 --2- 172.21.15.98:0/70963859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ffd60 0x7f03e4103d30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009910 tx=0x7f03cc009c20 comp rx=0 tx=0).stop 2024-09-13T03:03:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.112+0000 7f03e9092700 1 -- 172.21.15.98:0/70963859 shutdown_connections 2024-09-13T03:03:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.112+0000 7f03e9092700 1 --2- 172.21.15.98:0/70963859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ffd60 0x7f03e4103d30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.112+0000 7f03e9092700 1 --2- 172.21.15.98:0/70963859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03e40ff3c0 0x7f03e40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.112+0000 7f03e9092700 1 -- 172.21.15.98:0/70963859 >> 172.21.15.98:0/70963859 conn(0x7f03e40fac60 msgr2=0x7f03e40fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.112+0000 7f03e9092700 1 -- 172.21.15.98:0/70963859 shutdown_connections 2024-09-13T03:03:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.112+0000 7f03e9092700 1 -- 172.21.15.98:0/70963859 wait complete. 2024-09-13T03:03:16.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e9092700 1 Processor -- start 2024-09-13T03:03:16.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e9092700 1 -- start start 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e9092700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ff3c0 0x7f03e4195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e9092700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03e40ffd60 0x7f03e41963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e9092700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4196ab0 con 0x7f03e40ff3c0 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e9092700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e419a840 con 0x7f03e40ffd60 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ff3c0 0x7f03e4195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e2d9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ff3c0 0x7f03e4195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41628/0 (socket says 172.21.15.98:41628) 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e2d9d700 1 -- 172.21.15.98:0/1644696102 learned_addr learned my addr 172.21.15.98:0/1644696102 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e259c700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03e40ffd60 0x7f03e41963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e2d9d700 1 -- 172.21.15.98:0/1644696102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03e40ffd60 msgr2=0x7f03e41963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:16.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e2d9d700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03e40ffd60 0x7f03e41963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.113+0000 7f03e2d9d700 1 -- 172.21.15.98:0/1644696102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0095f0 con 0x7f03e40ff3c0 2024-09-13T03:03:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.114+0000 7f03e2d9d700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ff3c0 0x7f03e4195e90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f03dc007e90 tx=0x7f03dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.114+0000 7f03dbfff700 1 -- 172.21.15.98:0/1644696102 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03dc00de60 con 0x7f03e40ff3c0 2024-09-13T03:03:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.114+0000 7f03dbfff700 1 -- 172.21.15.98:0/1644696102 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03dc00f040 con 0x7f03e40ff3c0 2024-09-13T03:03:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.114+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e419ab20 con 0x7f03e40ff3c0 2024-09-13T03:03:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.114+0000 7f03dbfff700 1 -- 172.21.15.98:0/1644696102 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03dc004520 con 0x7f03e40ff3c0 2024-09-13T03:03:16.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.114+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e419b070 con 0x7f03e40ff3c0 2024-09-13T03:03:16.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.115+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e4108740 con 0x7f03e40ff3c0 2024-09-13T03:03:16.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.116+0000 7f03dbfff700 1 -- 172.21.15.98:0/1644696102 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f03dc004750 con 0x7f03e40ff3c0 2024-09-13T03:03:16.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.116+0000 7f03dbfff700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f03d006e680 0x7f03d0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:16.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.116+0000 7f03dbfff700 1 -- 172.21.15.98:0/1644696102 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f03dc08e390 con 0x7f03e40ff3c0 2024-09-13T03:03:16.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.116+0000 7f03e259c700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f03d006e680 0x7f03d0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:16.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.117+0000 7f03e259c700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f03d006e680 0x7f03d0070b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f03e41974b0 tx=0x7f03cc01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:16.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.121+0000 7f03dbfff700 1 -- 172.21.15.98:0/1644696102 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f03dc0574f0 con 0x7f03e40ff3c0 2024-09-13T03:03:16.153 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:15 smithi142 ceph-mon[65447]: pgmap v239: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:16.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.408+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f03e419b290 con 0x7f03e40ff3c0 2024-09-13T03:03:16.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.408+0000 7f03dbfff700 1 -- 172.21.15.98:0/1644696102 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f03dc05abb0 con 0x7f03e40ff3c0 2024-09-13T03:03:16.410 INFO:teuthology.orchestra.run.smithi098.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T03:03:16.410 INFO:teuthology.orchestra.run.smithi098.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:03:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:03:16.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.410+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f03d006e680 msgr2=0x7f03d0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:16.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.410+0000 7f03e9092700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f03d006e680 0x7f03d0070b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f03e41974b0 tx=0x7f03cc01a040 comp rx=0 tx=0).stop 2024-09-13T03:03:16.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.410+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ff3c0 msgr2=0x7f03e4195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:16.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.410+0000 7f03e9092700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ff3c0 0x7f03e4195e90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f03dc007e90 tx=0x7f03dc00d3b0 comp rx=0 tx=0).stop 2024-09-13T03:03:16.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.411+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 shutdown_connections 2024-09-13T03:03:16.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.411+0000 7f03e9092700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f03d006e680 0x7f03d0070b30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:16.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.411+0000 7f03e9092700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03e40ff3c0 0x7f03e4195e90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:16.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.411+0000 7f03e9092700 1 --2- 172.21.15.98:0/1644696102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03e40ffd60 0x7f03e41963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:16.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.411+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 >> 172.21.15.98:0/1644696102 conn(0x7f03e40fac60 msgr2=0x7f03e4069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:16.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.411+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 shutdown_connections 2024-09-13T03:03:16.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:16.411+0000 7f03e9092700 1 -- 172.21.15.98:0/1644696102 wait complete. 2024-09-13T03:03:16.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:16 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1644696102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:03:17.053 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions' 2024-09-13T03:03:17.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:16 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1644696102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:03:17.253 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:03:17.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:17 smithi098 ceph-mon[87325]: pgmap v240: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:17 smithi142 ceph-mon[65447]: pgmap v240: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:18.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 -- 172.21.15.98:0/286590373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ffd60 msgr2=0x7f28f8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:18.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 --2- 172.21.15.98:0/286590373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ffd60 0x7f28f8103d30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009910 tx=0x7f28e4009c20 comp rx=0 tx=0).stop 2024-09-13T03:03:18.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 -- 172.21.15.98:0/286590373 shutdown_connections 2024-09-13T03:03:18.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 --2- 172.21.15.98:0/286590373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ffd60 0x7f28f8103d30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:18.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 --2- 172.21.15.98:0/286590373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80ff3c0 0x7f28f80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:18.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 -- 172.21.15.98:0/286590373 >> 172.21.15.98:0/286590373 conn(0x7f28f80fac80 msgr2=0x7f28f80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 -- 172.21.15.98:0/286590373 shutdown_connections 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 -- 172.21.15.98:0/286590373 wait complete. 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 Processor -- start 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.819+0000 7f28ff19f700 1 -- start start 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28ff19f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ff3c0 0x7f28f8196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28ff19f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80ffd60 0x7f28f8197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28ff19f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81979b0 con 0x7f28f80ff3c0 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28ff19f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f8197af0 con 0x7f28f80ffd60 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28fcf3b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ff3c0 0x7f28f8196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28fcf3b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ff3c0 0x7f28f8196e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41638/0 (socket says 172.21.15.98:41638) 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28fcf3b700 1 -- 172.21.15.98:0/3473445514 learned_addr learned my addr 172.21.15.98:0/3473445514 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28fcf3b700 1 -- 172.21.15.98:0/3473445514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80ffd60 msgr2=0x7f28f8197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:18.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28fcf3b700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80ffd60 0x7f28f8197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:18.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28fcf3b700 1 -- 172.21.15.98:0/3473445514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40095f0 con 0x7f28f80ff3c0 2024-09-13T03:03:18.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28fcf3b700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ff3c0 0x7f28f8196e50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00b4b0 tx=0x7f28ec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:18.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28f5ffb700 1 -- 172.21.15.98:0/3473445514 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28ec011800 con 0x7f28f80ff3c0 2024-09-13T03:03:18.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28f5ffb700 1 -- 172.21.15.98:0/3473445514 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f28ec011e20 con 0x7f28f80ff3c0 2024-09-13T03:03:18.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28f5ffb700 1 -- 172.21.15.98:0/3473445514 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28ec00f2e0 con 0x7f28f80ff3c0 2024-09-13T03:03:18.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.820+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f819fec0 con 0x7f28f80ff3c0 2024-09-13T03:03:18.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.821+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f81a0380 con 0x7f28f80ff3c0 2024-09-13T03:03:18.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.822+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f8107660 con 0x7f28f80ff3c0 2024-09-13T03:03:18.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.822+0000 7f28f5ffb700 1 -- 172.21.15.98:0/3473445514 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f28ec010380 con 0x7f28f80ff3c0 2024-09-13T03:03:18.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.822+0000 7f28f5ffb700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f28e806e680 0x7f28e8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:18.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.822+0000 7f28f5ffb700 1 -- 172.21.15.98:0/3473445514 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f28ec08e2a0 con 0x7f28f80ff3c0 2024-09-13T03:03:18.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.822+0000 7f28f7fff700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f28e806e680 0x7f28e8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:18.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.823+0000 7f28f7fff700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f28e806e680 0x7f28e8070b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28e40059d0 tx=0x7f28e4005960 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:18.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:18.827+0000 7f28f5ffb700 1 -- 172.21.15.98:0/3473445514 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f28ec057450 con 0x7f28f80ff3c0 2024-09-13T03:03:19.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.115+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f28f804f2a0 con 0x7f28f80ff3c0 2024-09-13T03:03:19.117 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:19.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.115+0000 7f28f5ffb700 1 -- 172.21.15.98:0/3473445514 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f28ec05ab10 con 0x7f28f80ff3c0 2024-09-13T03:03:19.118 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:03:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T03:03:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:03:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:03:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T03:03:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:03:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:03:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T03:03:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:03:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:03:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T03:03:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T03:03:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:03:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T03:03:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 14 2024-09-13T03:03:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T03:03:19.119 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f28e806e680 msgr2=0x7f28e8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f28e806e680 0x7f28e8070b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28e40059d0 tx=0x7f28e4005960 comp rx=0 tx=0).stop 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ff3c0 msgr2=0x7f28f8196e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ff3c0 0x7f28f8196e50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00b4b0 tx=0x7f28ec00b870 comp rx=0 tx=0).stop 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 shutdown_connections 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f28e806e680 0x7f28e8070b30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28f80ff3c0 0x7f28f8196e50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 --2- 172.21.15.98:0/3473445514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f80ffd60 0x7f28f8197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 >> 172.21.15.98:0/3473445514 conn(0x7f28f80fac80 msgr2=0x7f28f80fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 shutdown_connections 2024-09-13T03:03:19.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:03:19.118+0000 7f28ff19f700 1 -- 172.21.15.98:0/3473445514 wait complete. 2024-09-13T03:03:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:19.744 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T03:03:19.947 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:03:19.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:19 smithi098 ceph-mon[87325]: pgmap v241: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:19.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:19 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3473445514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:03:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:19 smithi142 ceph-mon[65447]: pgmap v241: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:20.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:19 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3473445514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:03:21.559 INFO:teuthology.orchestra.run.smithi098.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T03:03:22.154 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:21 smithi098 ceph-mon[87325]: pgmap v242: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:22.174 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'sleep 60' 2024-09-13T03:03:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:21 smithi142 ceph-mon[65447]: pgmap v242: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:22.381 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:03:23.984 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:23 smithi098 ceph-mon[87325]: pgmap v243: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:23 smithi142 ceph-mon[65447]: pgmap v243: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:25 smithi098 ceph-mon[87325]: pgmap v244: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:25 smithi142 ceph-mon[65447]: pgmap v244: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:27 smithi098 ceph-mon[87325]: pgmap v245: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:28.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:27 smithi142 ceph-mon[65447]: pgmap v245: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:30.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:29 smithi098 ceph-mon[87325]: pgmap v246: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:30.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:29 smithi142 ceph-mon[65447]: pgmap v246: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:32.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:31 smithi098 ceph-mon[87325]: pgmap v247: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:31 smithi142 ceph-mon[65447]: pgmap v247: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:33 smithi098 ceph-mon[87325]: pgmap v248: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:33 smithi142 ceph-mon[65447]: pgmap v248: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:36.215 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:35 smithi142 ceph-mon[65447]: pgmap v249: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:36.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:35 smithi098 ceph-mon[87325]: pgmap v249: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:38.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:37 smithi098 ceph-mon[87325]: pgmap v250: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:38.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:37 smithi142 ceph-mon[65447]: pgmap v250: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:40.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:39 smithi098 ceph-mon[87325]: pgmap v251: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:39 smithi142 ceph-mon[65447]: pgmap v251: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:41.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:41 smithi098 ceph-mon[87325]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:42.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:41 smithi142 ceph-mon[65447]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:44.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:43 smithi098 ceph-mon[87325]: pgmap v253: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:43 smithi142 ceph-mon[65447]: pgmap v253: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:46.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:45 smithi098 ceph-mon[87325]: pgmap v254: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:46.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:45 smithi142 ceph-mon[65447]: pgmap v254: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:48.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:47 smithi098 ceph-mon[87325]: pgmap v255: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:48.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:47 smithi142 ceph-mon[65447]: pgmap v255: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:49.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:49.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:50.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:49 smithi098 ceph-mon[87325]: pgmap v256: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:50.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:49 smithi142 ceph-mon[65447]: pgmap v256: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:51.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:03:51.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:03:51.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:03:51.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:03:51.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:03:51.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:03:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:03:51.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:03:52.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:51 smithi098 ceph-mon[87325]: pgmap v257: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:51 smithi142 ceph-mon[65447]: pgmap v257: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:54.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:53 smithi098 ceph-mon[87325]: pgmap v258: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:53 smithi142 ceph-mon[65447]: pgmap v258: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:03:56.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:55 smithi098 ceph-mon[87325]: pgmap v259: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:55 smithi142 ceph-mon[65447]: pgmap v259: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:58.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:57 smithi098 ceph-mon[87325]: pgmap v260: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:03:58.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:57 smithi142 ceph-mon[65447]: pgmap v260: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:00.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:03:59 smithi098 ceph-mon[87325]: pgmap v261: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:03:59 smithi142 ceph-mon[65447]: pgmap v261: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:02.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:01 smithi098 ceph-mon[87325]: pgmap v262: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:01 smithi142 ceph-mon[65447]: pgmap v262: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:03 smithi098 ceph-mon[87325]: pgmap v263: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:03 smithi142 ceph-mon[65447]: pgmap v263: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:06.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:05 smithi098 ceph-mon[87325]: pgmap v264: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:06.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:05 smithi142 ceph-mon[65447]: pgmap v264: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:08.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:07 smithi098 ceph-mon[87325]: pgmap v265: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:07 smithi142 ceph-mon[65447]: pgmap v265: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:10.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:09 smithi098 ceph-mon[87325]: pgmap v266: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:09 smithi142 ceph-mon[65447]: pgmap v266: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:12.219 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:11 smithi098 ceph-mon[87325]: pgmap v267: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:12.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:11 smithi142 ceph-mon[65447]: pgmap v267: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:14.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:13 smithi098 ceph-mon[87325]: pgmap v268: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:14.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:13 smithi142 ceph-mon[65447]: pgmap v268: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:16.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:15 smithi098 ceph-mon[87325]: pgmap v269: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:15 smithi142 ceph-mon[65447]: pgmap v269: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:18.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:17 smithi098 ceph-mon[87325]: pgmap v270: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:17 smithi142 ceph-mon[65447]: pgmap v270: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:19.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:20.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:19 smithi098 ceph-mon[87325]: pgmap v271: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:19 smithi142 ceph-mon[65447]: pgmap v271: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:22.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:21 smithi098 ceph-mon[87325]: pgmap v272: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:21 smithi142 ceph-mon[65447]: pgmap v272: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:24.151 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:23 smithi098 ceph-mon[87325]: pgmap v273: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:23 smithi142 ceph-mon[65447]: pgmap v273: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:24.552 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch ps' 2024-09-13T03:04:24.759 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:26.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.188+0000 7f575dbbe700 1 -- 172.21.15.98:0/1788480537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ff3c0 msgr2=0x7f57580ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:26.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.188+0000 7f575dbbe700 1 --2- 172.21.15.98:0/1788480537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ff3c0 0x7f57580ff790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f574800b0a0 tx=0x7f574800b3b0 comp rx=0 tx=0).stop 2024-09-13T03:04:26.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.188+0000 7f575dbbe700 1 -- 172.21.15.98:0/1788480537 shutdown_connections 2024-09-13T03:04:26.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.188+0000 7f575dbbe700 1 --2- 172.21.15.98:0/1788480537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57580ffd60 0x7f5758103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:26.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.188+0000 7f575dbbe700 1 --2- 172.21.15.98:0/1788480537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ff3c0 0x7f57580ff790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:26.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.188+0000 7f575dbbe700 1 -- 172.21.15.98:0/1788480537 >> 172.21.15.98:0/1788480537 conn(0x7f57580fac60 msgr2=0x7f57580fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:26.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.188+0000 7f575dbbe700 1 -- 172.21.15.98:0/1788480537 shutdown_connections 2024-09-13T03:04:26.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.188+0000 7f575dbbe700 1 -- 172.21.15.98:0/1788480537 wait complete. 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f575dbbe700 1 Processor -- start 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f575dbbe700 1 -- start start 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f575dbbe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57580ff3c0 0x7f5758195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f575dbbe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ffd60 0x7f57581963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f575dbbe700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758196a90 con 0x7f57580ffd60 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f575dbbe700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575819a820 con 0x7f57580ff3c0 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f5756ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ffd60 0x7f57581963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f5756ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ffd60 0x7f57581963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49168/0 (socket says 172.21.15.98:49168) 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f5756ffd700 1 -- 172.21.15.98:0/3296925406 learned_addr learned my addr 172.21.15.98:0/3296925406 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.189+0000 7f57577fe700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57580ff3c0 0x7f5758195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.190+0000 7f5756ffd700 1 -- 172.21.15.98:0/3296925406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57580ff3c0 msgr2=0x7f5758195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:26.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.190+0000 7f5756ffd700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57580ff3c0 0x7f5758195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:26.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.190+0000 7f5756ffd700 1 -- 172.21.15.98:0/3296925406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748009d00 con 0x7f57580ffd60 2024-09-13T03:04:26.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.190+0000 7f5756ffd700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ffd60 0x7f57581963b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f574000e8f0 tx=0x7f574000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:26.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.190+0000 7f5754ff9700 1 -- 172.21.15.98:0/3296925406 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5740009790 con 0x7f57580ffd60 2024-09-13T03:04:26.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.190+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575819ab00 con 0x7f57580ffd60 2024-09-13T03:04:26.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.190+0000 7f5754ff9700 1 -- 172.21.15.98:0/3296925406 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f574000c810 con 0x7f57580ffd60 2024-09-13T03:04:26.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.190+0000 7f5754ff9700 1 -- 172.21.15.98:0/3296925406 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5740005580 con 0x7f57580ffd60 2024-09-13T03:04:26.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.190+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575819b050 con 0x7f57580ffd60 2024-09-13T03:04:26.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.191+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575804f2a0 con 0x7f57580ffd60 2024-09-13T03:04:26.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.191+0000 7f5754ff9700 1 -- 172.21.15.98:0/3296925406 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f574000c980 con 0x7f57580ffd60 2024-09-13T03:04:26.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.192+0000 7f5754ff9700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574406e680 0x7f5744070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:26.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.192+0000 7f5754ff9700 1 -- 172.21.15.98:0/3296925406 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f5740014070 con 0x7f57580ffd60 2024-09-13T03:04:26.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.192+0000 7f57577fe700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574406e680 0x7f5744070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:26.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.192+0000 7f57577fe700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574406e680 0x7f5744070b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5748000f80 tx=0x7f57480060c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:26.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.196+0000 7f5754ff9700 1 -- 172.21.15.98:0/3296925406 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5740057ab0 con 0x7f57580ffd60 2024-09-13T03:04:26.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:25 smithi098 ceph-mon[87325]: pgmap v274: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:25 smithi142 ceph-mon[65447]: pgmap v274: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:26.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.407+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 --> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f575819b3b0 con 0x7f574406e680 2024-09-13T03:04:26.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.416+0000 7f5754ff9700 1 -- 172.21.15.98:0/3296925406 <== mgr.34102 v2:172.21.15.98:6800/2311940821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f575819b3b0 con 0x7f574406e680 2024-09-13T03:04:26.417 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:alertmanager.smithi098 smithi098 *:9093,9094 running (9m) 101s ago 19m 25.7M - 0.25.0 c8568f914cd2 4c6da1ec1d5e 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi098 smithi098 running (111s) 101s ago 20m 8162k - 19.1.1-322-g7741f7f9 19dc8d659727 6da1f4b10e02 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-exporter.smithi142 smithi142 running (106s) 103s ago 19m 7151k - 19.1.1-322-g7741f7f9 19dc8d659727 0883f857c904 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi098 smithi098 running (6m) 101s ago 20m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 e1c81cb248df 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:crash.smithi142 smithi142 running (6m) 103s ago 19m 6899k - 19.1.1-322-g7741f7f9 19dc8d659727 a7a0d0571dff 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:grafana.smithi098 smithi098 *:3000 running (8m) 101s ago 19m 80.8M - 9.4.12 2bacad6d85d8 5172bf9c0181 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.dioppa smithi098 running (2m) 101s ago 14m 85.4M - 19.1.1-322-g7741f7f9 19dc8d659727 e3d60a038b35 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi098.nwzstq smithi098 running (3m) 101s ago 14m 85.9M - 19.1.1-322-g7741f7f9 19dc8d659727 8daec38027b8 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.hplrrs smithi142 running (2m) 103s ago 14m 13.8M - 19.1.1-322-g7741f7f9 19dc8d659727 1a7b03062ec8 2024-09-13T03:04:26.418 INFO:teuthology.orchestra.run.smithi098.stdout:mds.cephfs.smithi142.wxfmvt smithi142 running (2m) 103s ago 14m 14.0M - 19.1.1-322-g7741f7f9 19dc8d659727 46f9730b3ab7 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi098.ukgenf smithi098 *:8443,9283,8765 running (11m) 101s ago 21m 507M - 19.1.1-322-g7741f7f9 19dc8d659727 9028c2d59887 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.smithi142.jutrvi smithi142 *:8443,9283,8765 running (10m) 103s ago 18m 442M - 19.1.1-322-g7741f7f9 19dc8d659727 c72301bfe118 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi098 smithi098 running (7m) 101s ago 21m 60.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 b700160bc33d 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:mon.smithi142 smithi142 running (7m) 103s ago 18m 47.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 dc3771253acc 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi098 smithi098 *:9100 running (10m) 101s ago 20m 17.0M - 1.5.0 0da6a335fe13 9edd80f51569 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:node-exporter.smithi142 smithi142 *:9100 running (9m) 103s ago 19m 15.0M - 1.5.0 0da6a335fe13 7ce4d52fba89 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (6m) 101s ago 18m 114M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 1252221d152e 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi098 running (5m) 101s ago 17m 108M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 0f8e265c1579 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi098 running (5m) 101s ago 17m 102M 1216M 19.1.1-322-g7741f7f9 19dc8d659727 04c10c8159ba 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi142 running (4m) 103s ago 16m 114M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 322e0a9d6b20 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi142 running (4m) 103s ago 16m 113M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 087c65ddb960 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi142 running (3m) 103s ago 15m 119M 2240M 19.1.1-322-g7741f7f9 19dc8d659727 31b09c7c1472 2024-09-13T03:04:26.419 INFO:teuthology.orchestra.run.smithi098.stdout:prometheus.smithi098 smithi098 *:9095 running (9m) 101s ago 19m 84.6M - 2.43.0 a07b618ecd1d f5b580bc6638 2024-09-13T03:04:26.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574406e680 msgr2=0x7f5744070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:26.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574406e680 0x7f5744070b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5748000f80 tx=0x7f57480060c0 comp rx=0 tx=0).stop 2024-09-13T03:04:26.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ffd60 msgr2=0x7f57581963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:26.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ffd60 0x7f57581963b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f574000e8f0 tx=0x7f574000ec00 comp rx=0 tx=0).stop 2024-09-13T03:04:26.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 shutdown_connections 2024-09-13T03:04:26.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f574406e680 0x7f5744070b30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:26.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57580ff3c0 0x7f5758195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:26.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 --2- 172.21.15.98:0/3296925406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57580ffd60 0x7f57581963b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:26.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 >> 172.21.15.98:0/3296925406 conn(0x7f57580fac60 msgr2=0x7f5758103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:26.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 shutdown_connections 2024-09-13T03:04:26.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:26.418+0000 7f575dbbe700 1 -- 172.21.15.98:0/3296925406 wait complete. 2024-09-13T03:04:27.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions' 2024-09-13T03:04:27.266 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:27 smithi098 ceph-mon[87325]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:04:28.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:27 smithi098 ceph-mon[87325]: pgmap v275: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:28.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:27 smithi142 ceph-mon[65447]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:04:28.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:27 smithi142 ceph-mon[65447]: pgmap v275: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:28.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 -- 172.21.15.98:0/289781305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 msgr2=0x7fd7741008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:28.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 --2- 172.21.15.98:0/289781305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 0x7fd7741008b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd764009910 tx=0x7fd764009c20 comp rx=0 tx=0).stop 2024-09-13T03:04:28.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 -- 172.21.15.98:0/289781305 shutdown_connections 2024-09-13T03:04:28.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 --2- 172.21.15.98:0/289781305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd774100e80 0x7fd774104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:28.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 --2- 172.21.15.98:0/289781305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 0x7fd7741008b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:28.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 -- 172.21.15.98:0/289781305 >> 172.21.15.98:0/289781305 conn(0x7fd7740fbda0 msgr2=0x7fd7740fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:28.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 -- 172.21.15.98:0/289781305 shutdown_connections 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 -- 172.21.15.98:0/289781305 wait complete. 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 Processor -- start 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.889+0000 7fd77944e700 1 -- start start 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd77944e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 0x7fd774195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd77944e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd774100e80 0x7fd774196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd77944e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd774196b10 con 0x7fd7741004e0 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd77944e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77419a8a0 con 0x7fd774100e80 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd772ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 0x7fd774195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd772ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 0x7fd774195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49188/0 (socket says 172.21.15.98:49188) 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd772ffd700 1 -- 172.21.15.98:0/2284506478 learned_addr learned my addr 172.21.15.98:0/2284506478 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd7727fc700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd774100e80 0x7fd774196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:28.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd772ffd700 1 -- 172.21.15.98:0/2284506478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd774100e80 msgr2=0x7fd774196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:28.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd772ffd700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd774100e80 0x7fd774196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:28.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd772ffd700 1 -- 172.21.15.98:0/2284506478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640095f0 con 0x7fd7741004e0 2024-09-13T03:04:28.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd7727fc700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd774100e80 0x7fd774196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:04:28.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd772ffd700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 0x7fd774195ef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd764006010 tx=0x7fd76400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:28.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd75bfff700 1 -- 172.21.15.98:0/2284506478 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd76401d070 con 0x7fd7741004e0 2024-09-13T03:04:28.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.890+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77419ab20 con 0x7fd7741004e0 2024-09-13T03:04:28.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.891+0000 7fd75bfff700 1 -- 172.21.15.98:0/2284506478 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd764004fb0 con 0x7fd7741004e0 2024-09-13T03:04:28.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.891+0000 7fd75bfff700 1 -- 172.21.15.98:0/2284506478 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd76400f690 con 0x7fd7741004e0 2024-09-13T03:04:28.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.891+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77419b010 con 0x7fd7741004e0 2024-09-13T03:04:28.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.892+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7741087f0 con 0x7fd7741004e0 2024-09-13T03:04:28.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.892+0000 7fd75bfff700 1 -- 172.21.15.98:0/2284506478 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd7640228a0 con 0x7fd7741004e0 2024-09-13T03:04:28.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.893+0000 7fd75bfff700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd75c06e680 0x7fd75c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:28.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.893+0000 7fd7727fc700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd75c06e680 0x7fd75c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:28.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.893+0000 7fd75bfff700 1 -- 172.21.15.98:0/2284506478 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fd76408fff0 con 0x7fd7741004e0 2024-09-13T03:04:28.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.893+0000 7fd7727fc700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd75c06e680 0x7fd75c070b30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd774197510 tx=0x7fd768005f50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:28.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:28.897+0000 7fd75bfff700 1 -- 172.21.15.98:0/2284506478 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd764059070 con 0x7fd7741004e0 2024-09-13T03:04:29.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.177+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd77404f2a0 con 0x7fd7741004e0 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.178+0000 7fd75bfff700 1 -- 172.21.15.98:0/2284506478 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fd764027290 con 0x7fd7741004e0 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": { 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": { 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": { 2024-09-13T03:04:29.180 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:04:29.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:04:29.181 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-13T03:04:29.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T03:04:29.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-13T03:04:29.181 INFO:teuthology.orchestra.run.smithi098.stdout: "overall": { 2024-09-13T03:04:29.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 14 2024-09-13T03:04:29.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-13T03:04:29.181 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-13T03:04:29.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd75c06e680 msgr2=0x7fd75c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:29.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd75c06e680 0x7fd75c070b30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd774197510 tx=0x7fd768005f50 comp rx=0 tx=0).stop 2024-09-13T03:04:29.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 msgr2=0x7fd774195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:29.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 0x7fd774195ef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd764006010 tx=0x7fd76400be20 comp rx=0 tx=0).stop 2024-09-13T03:04:29.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 shutdown_connections 2024-09-13T03:04:29.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fd75c06e680 0x7fd75c070b30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:29.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7741004e0 0x7fd774195ef0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:29.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 --2- 172.21.15.98:0/2284506478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd774100e80 0x7fd774196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:29.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 >> 172.21.15.98:0/2284506478 conn(0x7fd7740fbda0 msgr2=0x7fd7740fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:29.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 shutdown_connections 2024-09-13T03:04:29.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:29.180+0000 7fd77944e700 1 -- 172.21.15.98:0/2284506478 wait complete. 2024-09-13T03:04:29.856 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T03:04:30.067 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:30.184 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:29 smithi098 ceph-mon[87325]: pgmap v276: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:30.185 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:29 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2284506478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:30.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:29 smithi142 ceph-mon[65447]: pgmap v276: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:30.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:29 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2284506478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:31.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.680+0000 7fb54cb31700 1 -- 172.21.15.98:0/872739650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 msgr2=0x7fb548100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.680+0000 7fb54cb31700 1 --2- 172.21.15.98:0/872739650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 0x7fb548100040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009910 tx=0x7fb53c009c20 comp rx=0 tx=0).stop 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.680+0000 7fb54cb31700 1 -- 172.21.15.98:0/872739650 shutdown_connections 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.680+0000 7fb54cb31700 1 --2- 172.21.15.98:0/872739650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 0x7fb548100040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.680+0000 7fb54cb31700 1 --2- 172.21.15.98:0/872739650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548104130 0x7fb548104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.680+0000 7fb54cb31700 1 -- 172.21.15.98:0/872739650 >> 172.21.15.98:0/872739650 conn(0x7fb548075130 msgr2=0x7fb548075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.680+0000 7fb54cb31700 1 -- 172.21.15.98:0/872739650 shutdown_connections 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.680+0000 7fb54cb31700 1 -- 172.21.15.98:0/872739650 wait complete. 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.680+0000 7fb54cb31700 1 Processor -- start 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54cb31700 1 -- start start 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54cb31700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 0x7fb548194d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:31.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54cb31700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548104130 0x7fb548195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54cb31700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb548195950 con 0x7fb5480ffbd0 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54cb31700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5481996e0 con 0x7fb548104130 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 0x7fb548194d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 0x7fb548194d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:49200/0 (socket says 172.21.15.98:49200) 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54659c700 1 -- 172.21.15.98:0/3536319920 learned_addr learned my addr 172.21.15.98:0/3536319920 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb545d9b700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548104130 0x7fb548195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54659c700 1 -- 172.21.15.98:0/3536319920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548104130 msgr2=0x7fb548195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54659c700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548104130 0x7fb548195270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54659c700 1 -- 172.21.15.98:0/3536319920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0095f0 con 0x7fb5480ffbd0 2024-09-13T03:04:31.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.681+0000 7fb54659c700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 0x7fb548194d30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb53800e920 tx=0x7fb53800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.682+0000 7fb5377fe700 1 -- 172.21.15.98:0/3536319920 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53800c9d0 con 0x7fb5480ffbd0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.682+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5481999c0 con 0x7fb5480ffbd0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.682+0000 7fb5377fe700 1 -- 172.21.15.98:0/3536319920 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb538010430 con 0x7fb5480ffbd0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.682+0000 7fb5377fe700 1 -- 172.21.15.98:0/3536319920 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb538018630 con 0x7fb5480ffbd0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.682+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb548199f10 con 0x7fb5480ffbd0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.683+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54804f2a0 con 0x7fb5480ffbd0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.683+0000 7fb5377fe700 1 -- 172.21.15.98:0/3536319920 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb5380105a0 con 0x7fb5480ffbd0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.684+0000 7fb5377fe700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb53006e680 0x7fb530070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.684+0000 7fb5377fe700 1 -- 172.21.15.98:0/3536319920 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fb538014070 con 0x7fb5480ffbd0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.684+0000 7fb545d9b700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb53006e680 0x7fb530070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:31.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.684+0000 7fb545d9b700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb53006e680 0x7fb530070b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb548196350 tx=0x7fb53c009f70 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:31.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.688+0000 7fb5377fe700 1 -- 172.21.15.98:0/3536319920 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb5380541b0 con 0x7fb5480ffbd0 2024-09-13T03:04:31.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.974+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb54819a1d0 con 0x7fb5480ffbd0 2024-09-13T03:04:31.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.974+0000 7fb5377fe700 1 -- 172.21.15.98:0/3536319920 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb538057ac0 con 0x7fb5480ffbd0 2024-09-13T03:04:31.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.976+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb53006e680 msgr2=0x7fb530070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:31.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.976+0000 7fb54cb31700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb53006e680 0x7fb530070b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb548196350 tx=0x7fb53c009f70 comp rx=0 tx=0).stop 2024-09-13T03:04:31.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.977+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 msgr2=0x7fb548194d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:31.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.977+0000 7fb54cb31700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 0x7fb548194d30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb53800e920 tx=0x7fb53800ec30 comp rx=0 tx=0).stop 2024-09-13T03:04:31.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.977+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 shutdown_connections 2024-09-13T03:04:31.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.977+0000 7fb54cb31700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb53006e680 0x7fb530070b30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:31.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.977+0000 7fb54cb31700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5480ffbd0 0x7fb548194d30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:31.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.977+0000 7fb54cb31700 1 --2- 172.21.15.98:0/3536319920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548104130 0x7fb548195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:31.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.977+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 >> 172.21.15.98:0/3536319920 conn(0x7fb548075130 msgr2=0x7fb5480feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:31.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.977+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 shutdown_connections 2024-09-13T03:04:31.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:31.977+0000 7fb54cb31700 1 -- 172.21.15.98:0/3536319920 wait complete. 2024-09-13T03:04:31.989 INFO:teuthology.orchestra.run.smithi098.stdout:true 2024-09-13T03:04:32.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:31 smithi098 ceph-mon[87325]: pgmap v277: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:31 smithi142 ceph-mon[65447]: pgmap v277: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:32.638 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T03:04:32.842 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:33.215 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:32 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3536319920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:33.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:32 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3536319920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:34.176 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:33 smithi098 ceph-mon[87325]: pgmap v278: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:34.176 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:33 smithi142 ceph-mon[65447]: pgmap v278: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:34.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.447+0000 7fe734460700 1 -- 172.21.15.98:0/1551456235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 msgr2=0x7fe72c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.447+0000 7fe734460700 1 --2- 172.21.15.98:0/1551456235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 0x7fe72c1008b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe728009910 tx=0x7fe728009c20 comp rx=0 tx=0).stop 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.447+0000 7fe734460700 1 -- 172.21.15.98:0/1551456235 shutdown_connections 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.447+0000 7fe734460700 1 --2- 172.21.15.98:0/1551456235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe72c100e80 0x7fe72c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.447+0000 7fe734460700 1 --2- 172.21.15.98:0/1551456235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 0x7fe72c1008b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.447+0000 7fe734460700 1 -- 172.21.15.98:0/1551456235 >> 172.21.15.98:0/1551456235 conn(0x7fe72c0fbda0 msgr2=0x7fe72c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.447+0000 7fe734460700 1 -- 172.21.15.98:0/1551456235 shutdown_connections 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.447+0000 7fe734460700 1 -- 172.21.15.98:0/1551456235 wait complete. 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe734460700 1 Processor -- start 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe734460700 1 -- start start 2024-09-13T03:04:34.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe734460700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 0x7fe72c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe734460700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe72c100e80 0x7fe72c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe734460700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c196b10 con 0x7fe72c1004e0 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe734460700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c19a8a0 con 0x7fe72c100e80 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe7321fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 0x7fe72c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe7321fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 0x7fe72c195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41610/0 (socket says 172.21.15.98:41610) 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe7321fc700 1 -- 172.21.15.98:0/2258835448 learned_addr learned my addr 172.21.15.98:0/2258835448 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.448+0000 7fe7319fb700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe72c100e80 0x7fe72c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.449+0000 7fe7321fc700 1 -- 172.21.15.98:0/2258835448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe72c100e80 msgr2=0x7fe72c196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.449+0000 7fe7321fc700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe72c100e80 0x7fe72c196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.449+0000 7fe7321fc700 1 -- 172.21.15.98:0/2258835448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280095f0 con 0x7fe72c1004e0 2024-09-13T03:04:34.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.449+0000 7fe7321fc700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 0x7fe72c195ef0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe728006010 tx=0x7fe72800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:34.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.449+0000 7fe7237fe700 1 -- 172.21.15.98:0/2258835448 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe72801d070 con 0x7fe72c1004e0 2024-09-13T03:04:34.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.449+0000 7fe7237fe700 1 -- 172.21.15.98:0/2258835448 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe728004fb0 con 0x7fe72c1004e0 2024-09-13T03:04:34.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.449+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72c19ab20 con 0x7fe72c1004e0 2024-09-13T03:04:34.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.449+0000 7fe7237fe700 1 -- 172.21.15.98:0/2258835448 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe728022ea0 con 0x7fe72c1004e0 2024-09-13T03:04:34.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.449+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72c19b010 con 0x7fe72c1004e0 2024-09-13T03:04:34.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.450+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72c1087f0 con 0x7fe72c1004e0 2024-09-13T03:04:34.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.450+0000 7fe7237fe700 1 -- 172.21.15.98:0/2258835448 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe728022470 con 0x7fe72c1004e0 2024-09-13T03:04:34.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.451+0000 7fe7237fe700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe71806e680 0x7fe718070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:34.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.451+0000 7fe7237fe700 1 -- 172.21.15.98:0/2258835448 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fe72808fc20 con 0x7fe72c1004e0 2024-09-13T03:04:34.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.451+0000 7fe7319fb700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe71806e680 0x7fe718070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:34.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.451+0000 7fe7319fb700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe71806e680 0x7fe718070b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe71c005fd0 tx=0x7fe71c00a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:34.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.455+0000 7fe7237fe700 1 -- 172.21.15.98:0/2258835448 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe728058dd0 con 0x7fe72c1004e0 2024-09-13T03:04:34.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.743+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe72c197350 con 0x7fe72c1004e0 2024-09-13T03:04:34.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.743+0000 7fe7237fe700 1 -- 172.21.15.98:0/2258835448 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fe728027290 con 0x7fe72c1004e0 2024-09-13T03:04:34.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.745+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe71806e680 msgr2=0x7fe718070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:34.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.745+0000 7fe734460700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe71806e680 0x7fe718070b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe71c005fd0 tx=0x7fe71c00a560 comp rx=0 tx=0).stop 2024-09-13T03:04:34.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.745+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 msgr2=0x7fe72c195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:34.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.745+0000 7fe734460700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 0x7fe72c195ef0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe728006010 tx=0x7fe72800be20 comp rx=0 tx=0).stop 2024-09-13T03:04:34.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.746+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 shutdown_connections 2024-09-13T03:04:34.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.746+0000 7fe734460700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe71806e680 0x7fe718070b30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:34.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.746+0000 7fe734460700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe72c1004e0 0x7fe72c195ef0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:34.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.746+0000 7fe734460700 1 --2- 172.21.15.98:0/2258835448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe72c100e80 0x7fe72c196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:34.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.746+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 >> 172.21.15.98:0/2258835448 conn(0x7fe72c0fbda0 msgr2=0x7fe72c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:34.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.746+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 shutdown_connections 2024-09-13T03:04:34.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:34.746+0000 7fe734460700 1 -- 172.21.15.98:0/2258835448 wait complete. 2024-09-13T03:04:34.757 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)" 2024-09-13T03:04:35.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:34 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2258835448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:35.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:34 smithi098 ceph-mon[87325]: pgmap v279: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:35.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:34 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2258835448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:35.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:34 smithi142 ceph-mon[65447]: pgmap v279: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:35.603 DEBUG:teuthology.parallel:result is None 2024-09-13T03:04:35.603 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T03:04:35.615 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T03:04:35.615 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d155f688-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T03:04:35.815 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:37.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 -- 172.21.15.98:0/3598667739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ff3c0 msgr2=0x7f8e3c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:37.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 --2- 172.21.15.98:0/3598667739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ff3c0 0x7f8e3c0ff790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009910 tx=0x7f8e38009c20 comp rx=0 tx=0).stop 2024-09-13T03:04:37.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 -- 172.21.15.98:0/3598667739 shutdown_connections 2024-09-13T03:04:37.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 --2- 172.21.15.98:0/3598667739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c0ffd60 0x7f8e3c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:37.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 --2- 172.21.15.98:0/3598667739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ff3c0 0x7f8e3c0ff790 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:37.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 -- 172.21.15.98:0/3598667739 >> 172.21.15.98:0/3598667739 conn(0x7f8e3c0fac80 msgr2=0x7f8e3c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:37.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 -- 172.21.15.98:0/3598667739 shutdown_connections 2024-09-13T03:04:37.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 -- 172.21.15.98:0/3598667739 wait complete. 2024-09-13T03:04:37.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 Processor -- start 2024-09-13T03:04:37.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.350+0000 7f8e43e74700 1 -- start start 2024-09-13T03:04:37.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e43e74700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c0ff3c0 0x7f8e3c194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:37.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e43e74700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ffd60 0x7f8e3c1952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:37.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e43e74700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c1959a0 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e43e74700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c199730 con 0x7f8e3c0ff3c0 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e4140f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ffd60 0x7f8e3c1952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e4140f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ffd60 0x7f8e3c1952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41636/0 (socket says 172.21.15.98:41636) 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e4140f700 1 -- 172.21.15.98:0/3026211028 learned_addr learned my addr 172.21.15.98:0/3026211028 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e41c10700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c0ff3c0 0x7f8e3c194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e4140f700 1 -- 172.21.15.98:0/3026211028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c0ff3c0 msgr2=0x7f8e3c194d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e4140f700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c0ff3c0 0x7f8e3c194d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e4140f700 1 -- 172.21.15.98:0/3026211028 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380095f0 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e4140f700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ffd60 0x7f8e3c1952c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0098f0 tx=0x7f8e2c009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e32ffd700 1 -- 172.21.15.98:0/3026211028 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c012070 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e32ffd700 1 -- 172.21.15.98:0/3026211028 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e2c00d850 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c1999b0 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e32ffd700 1 -- 172.21.15.98:0/3026211028 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c00c8c0 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.351+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c199f00 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.352+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c04f2a0 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.353+0000 7f8e32ffd700 1 -- 172.21.15.98:0/3026211028 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8e2c016070 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.353+0000 7f8e32ffd700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8e2806e680 0x7f8e28070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:37.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.353+0000 7f8e32ffd700 1 -- 172.21.15.98:0/3026211028 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f8e2c08fa00 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.353+0000 7f8e41c10700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8e2806e680 0x7f8e28070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:37.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.354+0000 7f8e41c10700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8e2806e680 0x7f8e28070b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800b5c0 tx=0x7f8e3801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:37.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.358+0000 7f8e32ffd700 1 -- 172.21.15.98:0/3026211028 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8e2c058a80 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.601+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e3c19a1e0 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.602+0000 7f8e32ffd700 1 -- 172.21.15.98:0/3026211028 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+2002 (secure 0 0 0) 0x7f8e2c05c140 con 0x7f8e3c0ffd60 2024-09-13T03:04:37.603 INFO:teuthology.orchestra.run.smithi098.stdout:e39 2024-09-13T03:04:37.603 INFO:teuthology.orchestra.run.smithi098.stdout:btime 2024-09-13T03:02:49:926472+0000 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 39 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-13T02:49:50.246299+0000 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-13T03:02:49.042304+0000 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-13T03:04:37.604 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 60 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 92 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 1 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:in 0 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=34378} 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-13T03:04:37.605 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data enabled 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 1 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 34378 members: 34378 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.nwzstq{0:34378} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.98:6826/870545712,v1:172.21.15.98:6827/870545712] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi098.dioppa{0:34410} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.98:6828/3981027621,v1:172.21.15.98:6829/3981027621] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-13T03:04:37.606 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:37.607 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.wxfmvt{-1:44315} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6824/2834620980,v1:172.21.15.142:6825/2834620980] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:04:37.607 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.cephfs.smithi142.hplrrs{-1:44339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/3076033085,v1:172.21.15.142:6827/3076033085] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:04:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8e2806e680 msgr2=0x7f8e28070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:37.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8e2806e680 0x7f8e28070b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800b5c0 tx=0x7f8e3801a040 comp rx=0 tx=0).stop 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ffd60 msgr2=0x7f8e3c1952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ffd60 0x7f8e3c1952c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0098f0 tx=0x7f8e2c009cb0 comp rx=0 tx=0).stop 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 shutdown_connections 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f8e2806e680 0x7f8e28070b30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e3c0ff3c0 0x7f8e3c194d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 --2- 172.21.15.98:0/3026211028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e3c0ffd60 0x7f8e3c1952c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 >> 172.21.15.98:0/3026211028 conn(0x7f8e3c0fac80 msgr2=0x7f8e3c0fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 shutdown_connections 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:37.604+0000 7f8e43e74700 1 -- 172.21.15.98:0/3026211028 wait complete. 2024-09-13T03:04:37.608 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 39 2024-09-13T03:04:37.979 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:37 smithi098 ceph-mon[87325]: pgmap v280: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:37.980 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:37 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3026211028' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:04:38.242 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T03:04:38.253 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T03:04:38.253 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:37 smithi142 ceph-mon[65447]: pgmap v280: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:38.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:37 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3026211028' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:04:38.454 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:40.106 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:39 smithi098 ceph-mon[87325]: pgmap v281: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.125+0000 7fcd2029a700 1 -- 172.21.15.98:0/2144761846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100460 msgr2=0x7fcd18100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.125+0000 7fcd2029a700 1 --2- 172.21.15.98:0/2144761846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100460 0x7fcd18100830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009910 tx=0x7fcd08009c20 comp rx=0 tx=0).stop 2024-09-13T03:04:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.125+0000 7fcd2029a700 1 -- 172.21.15.98:0/2144761846 shutdown_connections 2024-09-13T03:04:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.125+0000 7fcd2029a700 1 --2- 172.21.15.98:0/2144761846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd18100d70 0x7fcd181094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.125+0000 7fcd2029a700 1 --2- 172.21.15.98:0/2144761846 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100460 0x7fcd18100830 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.125+0000 7fcd2029a700 1 -- 172.21.15.98:0/2144761846 >> 172.21.15.98:0/2144761846 conn(0x7fcd180748b0 msgr2=0x7fcd18074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.126+0000 7fcd2029a700 1 -- 172.21.15.98:0/2144761846 shutdown_connections 2024-09-13T03:04:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.126+0000 7fcd2029a700 1 -- 172.21.15.98:0/2144761846 wait complete. 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.126+0000 7fcd2029a700 1 Processor -- start 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.126+0000 7fcd2029a700 1 -- start start 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.126+0000 7fcd2029a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd18100460 0x7fcd18194e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.126+0000 7fcd2029a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100d70 0x7fcd181953c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.126+0000 7fcd2029a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18195aa0 con 0x7fcd18100d70 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.126+0000 7fcd2029a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18199830 con 0x7fcd18100460 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd1d835700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100d70 0x7fcd181953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd1d835700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100d70 0x7fcd181953c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41662/0 (socket says 172.21.15.98:41662) 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd1d835700 1 -- 172.21.15.98:0/3031448637 learned_addr learned my addr 172.21.15.98:0/3031448637 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd1e036700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd18100460 0x7fcd18194e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd1d835700 1 -- 172.21.15.98:0/3031448637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd18100460 msgr2=0x7fcd18194e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd1d835700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd18100460 0x7fcd18194e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd1d835700 1 -- 172.21.15.98:0/3031448637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080095f0 con 0x7fcd18100d70 2024-09-13T03:04:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd1d835700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100d70 0x7fcd181953c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400b4b0 tx=0x7fcd1400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/3031448637 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd14011800 con 0x7fcd18100d70 2024-09-13T03:04:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd18199b10 con 0x7fcd18100d70 2024-09-13T03:04:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/3031448637 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd14011e20 con 0x7fcd18100d70 2024-09-13T03:04:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/3031448637 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd1400f2e0 con 0x7fcd18100d70 2024-09-13T03:04:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.127+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1819a060 con 0x7fcd18100d70 2024-09-13T03:04:40.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.128+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd18106bd0 con 0x7fcd18100d70 2024-09-13T03:04:40.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.129+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/3031448637 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcd14011960 con 0x7fcd18100d70 2024-09-13T03:04:40.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.129+0000 7fcd0f7fe700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd0406e680 0x7fcd04070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:40.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.129+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/3031448637 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fcd1408e360 con 0x7fcd18100d70 2024-09-13T03:04:40.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.129+0000 7fcd1e036700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd0406e680 0x7fcd04070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:40.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.130+0000 7fcd1e036700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd0406e680 0x7fcd04070b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd08006010 tx=0x7fcd0801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:40.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.134+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/3031448637 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcd140573e0 con 0x7fcd18100d70 2024-09-13T03:04:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:39 smithi142 ceph-mon[65447]: pgmap v281: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:40.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.379+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd1804f2a0 con 0x7fcd18100d70 2024-09-13T03:04:40.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.379+0000 7fcd0f7fe700 1 -- 172.21.15.98:0/3031448637 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+5260 (secure 0 0 0) 0x7fcd1405aaa0 con 0x7fcd18100d70 2024-09-13T03:04:40.381 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:40.381 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":39,"btime":"2024-09-13T03:02:49:926472+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44339,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/3076033085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3076033085},{"type":"v1","addr":"172.21.15.142:6827","nonce":3076033085}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:49.042304+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":31,"state":"up:active","state_seq":19,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.381+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd0406e680 msgr2=0x7fcd04070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.381+0000 7fcd2029a700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd0406e680 0x7fcd04070b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd08006010 tx=0x7fcd0801a040 comp rx=0 tx=0).stop 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.381+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100d70 msgr2=0x7fcd181953c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.381+0000 7fcd2029a700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100d70 0x7fcd181953c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400b4b0 tx=0x7fcd1400b870 comp rx=0 tx=0).stop 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.381+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 shutdown_connections 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.381+0000 7fcd2029a700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcd0406e680 0x7fcd04070b30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.381+0000 7fcd2029a700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd18100460 0x7fcd18194e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.381+0000 7fcd2029a700 1 --2- 172.21.15.98:0/3031448637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd18100d70 0x7fcd181953c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.381+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 >> 172.21.15.98:0/3031448637 conn(0x7fcd180748b0 msgr2=0x7fcd18103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:40.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.382+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 shutdown_connections 2024-09-13T03:04:40.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:40.382+0000 7fcd2029a700 1 -- 172.21.15.98:0/3031448637 wait complete. 2024-09-13T03:04:40.384 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 39 2024-09-13T03:04:40.911 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:40 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3031448637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T03:04:40.932 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 50} 2024-09-13T03:04:40.932 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 15 2024-09-13T03:04:41.133 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:41.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:40 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3031448637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T03:04:42.193 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:41 smithi098 ceph-mon[87325]: pgmap v282: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:42.227 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:41 smithi142 ceph-mon[65447]: pgmap v282: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:42.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.722+0000 7ff3c290c700 1 -- 172.21.15.98:0/3751590978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 msgr2=0x7ff3bc104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.722+0000 7ff3c290c700 1 --2- 172.21.15.98:0/3751590978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 0x7ff3bc104500 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009910 tx=0x7ff3b0009c20 comp rx=0 tx=0).stop 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.722+0000 7ff3c290c700 1 -- 172.21.15.98:0/3751590978 shutdown_connections 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.722+0000 7ff3c290c700 1 --2- 172.21.15.98:0/3751590978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3bc0ffbd0 0x7ff3bc100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.722+0000 7ff3c290c700 1 --2- 172.21.15.98:0/3751590978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 0x7ff3bc104500 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.722+0000 7ff3c290c700 1 -- 172.21.15.98:0/3751590978 >> 172.21.15.98:0/3751590978 conn(0x7ff3bc075130 msgr2=0x7ff3bc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.722+0000 7ff3c290c700 1 -- 172.21.15.98:0/3751590978 shutdown_connections 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.722+0000 7ff3c290c700 1 -- 172.21.15.98:0/3751590978 wait complete. 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.723+0000 7ff3c290c700 1 Processor -- start 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.723+0000 7ff3c290c700 1 -- start start 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.723+0000 7ff3c290c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3bc0ffbd0 0x7ff3bc195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:42.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.723+0000 7ff3c290c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 0x7ff3bc196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.723+0000 7ff3c290c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc196bf0 con 0x7ff3bc104130 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.723+0000 7ff3c290c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc19a980 con 0x7ff3bc0ffbd0 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.723+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 0x7ff3bc196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.723+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 0x7ff3bc196510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41680/0 (socket says 172.21.15.98:41680) 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/3025490608 learned_addr learned my addr 172.21.15.98:0/3025490608 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3bbfff700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3bc0ffbd0 0x7ff3bc195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/3025490608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3bc0ffbd0 msgr2=0x7ff3bc195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3bc0ffbd0 0x7ff3bc195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3bb7fe700 1 -- 172.21.15.98:0/3025490608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b00095f0 con 0x7ff3bc104130 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3bbfff700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3bc0ffbd0 0x7ff3bc195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3bb7fe700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 0x7ff3bc196510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00b4b0 tx=0x7ff3ac00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3b97fa700 1 -- 172.21.15.98:0/3025490608 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3ac011800 con 0x7ff3bc104130 2024-09-13T03:04:42.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3b97fa700 1 -- 172.21.15.98:0/3025490608 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3ac011e20 con 0x7ff3bc104130 2024-09-13T03:04:42.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc19ac60 con 0x7ff3bc104130 2024-09-13T03:04:42.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3b97fa700 1 -- 172.21.15.98:0/3025490608 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3ac00f2e0 con 0x7ff3bc104130 2024-09-13T03:04:42.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.724+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc19b1b0 con 0x7ff3bc104130 2024-09-13T03:04:42.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.725+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc04f2a0 con 0x7ff3bc104130 2024-09-13T03:04:42.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.726+0000 7ff3b97fa700 1 -- 172.21.15.98:0/3025490608 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff3ac011960 con 0x7ff3bc104130 2024-09-13T03:04:42.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.726+0000 7ff3b97fa700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3a406e680 0x7ff3a4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:42.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.726+0000 7ff3b97fa700 1 -- 172.21.15.98:0/3025490608 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7ff3ac08e360 con 0x7ff3bc104130 2024-09-13T03:04:42.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.726+0000 7ff3bbfff700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3a406e680 0x7ff3a4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:42.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.727+0000 7ff3bbfff700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3a406e680 0x7ff3a4070b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00059d0 tx=0x7ff3b001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.731+0000 7ff3b97fa700 1 -- 172.21.15.98:0/3025490608 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff3ac0573e0 con 0x7ff3bc104130 2024-09-13T03:04:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.983+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7ff3bc19b430 con 0x7ff3bc104130 2024-09-13T03:04:42.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.984+0000 7ff3b97fa700 1 -- 172.21.15.98:0/3025490608 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v39) v1 ==== 107+0+4129 (secure 0 0 0) 0x7ff3ac05aaa0 con 0x7ff3bc104130 2024-09-13T03:04:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:42.986 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":15,"btime":"2024-09-13T03:01:02:301799+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:02.301797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14454":{"gid":14454,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6827/831008890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":831008890},{"type":"v1","addr":"172.21.15.98:6827","nonce":831008890}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14454,"qdb_cluster":[14454]},"id":1}]} 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3a406e680 msgr2=0x7ff3a4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3a406e680 0x7ff3a4070b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00059d0 tx=0x7ff3b001a040 comp rx=0 tx=0).stop 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 msgr2=0x7ff3bc196510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 0x7ff3bc196510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00b4b0 tx=0x7ff3ac00b870 comp rx=0 tx=0).stop 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 shutdown_connections 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3a406e680 0x7ff3a4070b30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3bc0ffbd0 0x7ff3bc195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 --2- 172.21.15.98:0/3025490608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3bc104130 0x7ff3bc196510 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 >> 172.21.15.98:0/3025490608 conn(0x7ff3bc075130 msgr2=0x7ff3bc109220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:42.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 shutdown_connections 2024-09-13T03:04:42.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:42.986+0000 7ff3c290c700 1 -- 172.21.15.98:0/3025490608 wait complete. 2024-09-13T03:04:42.989 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 15 2024-09-13T03:04:43.612 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 15 2024-09-13T03:04:43.613 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-13T03:04:43.812 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:44.171 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:43 smithi098 ceph-mon[87325]: pgmap v283: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:44.171 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:43 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3025490608' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-09-13T03:04:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:43 smithi142 ceph-mon[65447]: pgmap v283: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:43 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3025490608' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.266+0000 7fa12f13b700 1 -- 172.21.15.98:0/470205569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa128104130 msgr2=0x7fa128104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.266+0000 7fa12f13b700 1 --2- 172.21.15.98:0/470205569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa128104130 0x7fa128104500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa12400b0a0 tx=0x7fa12400b3b0 comp rx=0 tx=0).stop 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.266+0000 7fa12f13b700 1 -- 172.21.15.98:0/470205569 shutdown_connections 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.266+0000 7fa12f13b700 1 --2- 172.21.15.98:0/470205569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1280ffbd0 0x7fa128100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.266+0000 7fa12f13b700 1 --2- 172.21.15.98:0/470205569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa128104130 0x7fa128104500 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.266+0000 7fa12f13b700 1 -- 172.21.15.98:0/470205569 >> 172.21.15.98:0/470205569 conn(0x7fa128075130 msgr2=0x7fa128075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.266+0000 7fa12f13b700 1 -- 172.21.15.98:0/470205569 shutdown_connections 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.266+0000 7fa12f13b700 1 -- 172.21.15.98:0/470205569 wait complete. 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12f13b700 1 Processor -- start 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12f13b700 1 -- start start 2024-09-13T03:04:45.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12f13b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1280ffbd0 0x7fa128100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12f13b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128104130 0x7fa128101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12f13b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1281018b0 con 0x7fa1280ffbd0 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12f13b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1281019f0 con 0x7fa128104130 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12ced7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1280ffbd0 0x7fa128100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12ced7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1280ffbd0 0x7fa128100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45728/0 (socket says 172.21.15.98:45728) 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12ced7700 1 -- 172.21.15.98:0/3898420897 learned_addr learned my addr 172.21.15.98:0/3898420897 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa11ffff700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128104130 0x7fa128101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12ced7700 1 -- 172.21.15.98:0/3898420897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128104130 msgr2=0x7fa128101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12ced7700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128104130 0x7fa128101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.267+0000 7fa12ced7700 1 -- 172.21.15.98:0/3898420897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa124009d00 con 0x7fa1280ffbd0 2024-09-13T03:04:45.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.268+0000 7fa12ced7700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1280ffbd0 0x7fa128100e30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa124000f80 tx=0x7fa12400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.268+0000 7fa11dffb700 1 -- 172.21.15.98:0/3898420897 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa12400e040 con 0x7fa1280ffbd0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.268+0000 7fa11dffb700 1 -- 172.21.15.98:0/3898420897 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa124003c10 con 0x7fa1280ffbd0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.268+0000 7fa11dffb700 1 -- 172.21.15.98:0/3898420897 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa12401d6b0 con 0x7fa1280ffbd0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.268+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa128101c70 con 0x7fa1280ffbd0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.268+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1281a2350 con 0x7fa1280ffbd0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.269+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1281086a0 con 0x7fa1280ffbd0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.269+0000 7fa11dffb700 1 -- 172.21.15.98:0/3898420897 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa124004040 con 0x7fa1280ffbd0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.270+0000 7fa11dffb700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa11006e680 0x7fa110070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.270+0000 7fa11dffb700 1 -- 172.21.15.98:0/3898420897 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fa12408fe90 con 0x7fa1280ffbd0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.270+0000 7fa11ffff700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa11006e680 0x7fa110070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:45.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.270+0000 7fa11ffff700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa11006e680 0x7fa110070b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa128102620 tx=0x7fa11800b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:45.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.274+0000 7fa11dffb700 1 -- 172.21.15.98:0/3898420897 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa124058f90 con 0x7fa1280ffbd0 2024-09-13T03:04:45.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.517+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fa128102460 con 0x7fa1280ffbd0 2024-09-13T03:04:45.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.518+0000 7fa11dffb700 1 -- 172.21.15.98:0/3898420897 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v39) v1 ==== 107+0+4908 (secure 0 0 0) 0x7fa12405c650 con 0x7fa1280ffbd0 2024-09-13T03:04:45.520 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:45.520 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"btime":"2024-09-13T03:01:03:313302+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34374,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/2438634369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2438634369},{"type":"v1","addr":"172.21.15.98:6829","nonce":2438634369}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:02.301797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14454":{"gid":14454,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.98:6827/831008890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":831008890},{"type":"v1","addr":"172.21.15.98:6827","nonce":831008890}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14454,"qdb_cluster":[14454]},"id":1}]} 2024-09-13T03:04:45.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.520+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa11006e680 msgr2=0x7fa110070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:45.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.520+0000 7fa12f13b700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa11006e680 0x7fa110070b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa128102620 tx=0x7fa11800b410 comp rx=0 tx=0).stop 2024-09-13T03:04:45.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.520+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1280ffbd0 msgr2=0x7fa128100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:45.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.520+0000 7fa12f13b700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1280ffbd0 0x7fa128100e30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa124000f80 tx=0x7fa12400cd20 comp rx=0 tx=0).stop 2024-09-13T03:04:45.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.520+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 shutdown_connections 2024-09-13T03:04:45.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.520+0000 7fa12f13b700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fa11006e680 0x7fa110070b30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:45.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.520+0000 7fa12f13b700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1280ffbd0 0x7fa128100e30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:45.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.520+0000 7fa12f13b700 1 --2- 172.21.15.98:0/3898420897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128104130 0x7fa128101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:45.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.520+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 >> 172.21.15.98:0/3898420897 conn(0x7fa128075130 msgr2=0x7fa1280fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:45.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.521+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 shutdown_connections 2024-09-13T03:04:45.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:45.521+0000 7fa12f13b700 1 -- 172.21.15.98:0/3898420897 wait complete. 2024-09-13T03:04:45.523 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2024-09-13T03:04:46.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:45 smithi098 ceph-mon[87325]: pgmap v284: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:46.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:45 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3898420897' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-13T03:04:46.213 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 16 2024-09-13T03:04:46.214 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-13T03:04:46.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:45 smithi142 ceph-mon[65447]: pgmap v284: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:46.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:45 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3898420897' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-13T03:04:46.415 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.965+0000 7f019ac6b700 1 -- 172.21.15.98:0/1369804763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ff3c0 msgr2=0x7f01940ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.965+0000 7f019ac6b700 1 --2- 172.21.15.98:0/1369804763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ff3c0 0x7f01940ff790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0188009910 tx=0x7f0188009c20 comp rx=0 tx=0).stop 2024-09-13T03:04:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.965+0000 7f019ac6b700 1 -- 172.21.15.98:0/1369804763 shutdown_connections 2024-09-13T03:04:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.965+0000 7f019ac6b700 1 --2- 172.21.15.98:0/1369804763 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01940ffd60 0x7f0194103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.965+0000 7f019ac6b700 1 --2- 172.21.15.98:0/1369804763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ff3c0 0x7f01940ff790 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.965+0000 7f019ac6b700 1 -- 172.21.15.98:0/1369804763 >> 172.21.15.98:0/1369804763 conn(0x7f01940fac80 msgr2=0x7f01940fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.965+0000 7f019ac6b700 1 -- 172.21.15.98:0/1369804763 shutdown_connections 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.965+0000 7f019ac6b700 1 -- 172.21.15.98:0/1369804763 wait complete. 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f019ac6b700 1 Processor -- start 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f019ac6b700 1 -- start start 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f019ac6b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01940ff3c0 0x7f0194194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f019ac6b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ffd60 0x7f01941952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f019ac6b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01941959a0 con 0x7f01940ffd60 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f019ac6b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194199730 con 0x7f01940ff3c0 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f0193fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ffd60 0x7f01941952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f0193fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ffd60 0x7f01941952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45744/0 (socket says 172.21.15.98:45744) 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f0193fff700 1 -- 172.21.15.98:0/1673404047 learned_addr learned my addr 172.21.15.98:0/1673404047 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:47.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f0198a07700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01940ff3c0 0x7f0194194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f0193fff700 1 -- 172.21.15.98:0/1673404047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01940ff3c0 msgr2=0x7f0194194d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f0193fff700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01940ff3c0 0x7f0194194d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f0193fff700 1 -- 172.21.15.98:0/1673404047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880095f0 con 0x7f01940ffd60 2024-09-13T03:04:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.966+0000 7f0198a07700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01940ff3c0 0x7f0194194d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:04:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.967+0000 7f0193fff700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ffd60 0x7f01941952c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f018000d900 tx=0x7f018000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.967+0000 7f0191ffb700 1 -- 172.21.15.98:0/1673404047 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0180009900 con 0x7f01940ffd60 2024-09-13T03:04:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.967+0000 7f0191ffb700 1 -- 172.21.15.98:0/1673404047 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0180010460 con 0x7f01940ffd60 2024-09-13T03:04:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.967+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0194199a10 con 0x7f01940ffd60 2024-09-13T03:04:47.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.967+0000 7f0191ffb700 1 -- 172.21.15.98:0/1673404047 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f018000f5f0 con 0x7f01940ffd60 2024-09-13T03:04:47.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.967+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0194199f60 con 0x7f01940ffd60 2024-09-13T03:04:47.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.968+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01941076d0 con 0x7f01940ffd60 2024-09-13T03:04:47.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.968+0000 7f0191ffb700 1 -- 172.21.15.98:0/1673404047 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f01800105d0 con 0x7f01940ffd60 2024-09-13T03:04:47.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.969+0000 7f0191ffb700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f018406e680 0x7f0184070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:47.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.969+0000 7f0191ffb700 1 -- 172.21.15.98:0/1673404047 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f018008e5a0 con 0x7f01940ffd60 2024-09-13T03:04:47.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.969+0000 7f0198a07700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f018406e680 0x7f0184070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:47.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.969+0000 7f0198a07700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f018406e680 0x7f0184070b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f018800b5c0 tx=0x7f01880053a0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:47.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:47.973+0000 7f0191ffb700 1 -- 172.21.15.98:0/1673404047 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0180057600 con 0x7f01940ffd60 2024-09-13T03:04:48.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:47 smithi098 ceph-mon[87325]: pgmap v285: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:48.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.233+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f019404f2a0 con 0x7f01940ffd60 2024-09-13T03:04:48.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.234+0000 7f0191ffb700 1 -- 172.21.15.98:0/1673404047 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v39) v1 ==== 107+0+4114 (secure 0 0 0) 0x7f018005acc0 con 0x7f01940ffd60 2024-09-13T03:04:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:48.235 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":17,"btime":"2024-09-13T03:01:05:787528+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34374,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/2438634369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2438634369},{"type":"v1","addr":"172.21.15.98:6829","nonce":2438634369}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:05.787526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f018406e680 msgr2=0x7f0184070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f018406e680 0x7f0184070b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f018800b5c0 tx=0x7f01880053a0 comp rx=0 tx=0).stop 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ffd60 msgr2=0x7f01941952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ffd60 0x7f01941952c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f018000d900 tx=0x7f018000dcc0 comp rx=0 tx=0).stop 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 shutdown_connections 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f018406e680 0x7f0184070b30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01940ff3c0 0x7f0194194d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 --2- 172.21.15.98:0/1673404047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01940ffd60 0x7f01941952c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 >> 172.21.15.98:0/1673404047 conn(0x7f01940fac80 msgr2=0x7f01940fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 shutdown_connections 2024-09-13T03:04:48.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:48.236+0000 7f019ac6b700 1 -- 172.21.15.98:0/1673404047 wait complete. 2024-09-13T03:04:48.239 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 17 2024-09-13T03:04:48.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:47 smithi142 ceph-mon[65447]: pgmap v285: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:48.871 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-13T03:04:48.871 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-13T03:04:49.070 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:49.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:48 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1673404047' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T03:04:49.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:49.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:48 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1673404047' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T03:04:49.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:50.164 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:49 smithi098 ceph-mon[87325]: pgmap v286: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:50.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:49 smithi142 ceph-mon[65447]: pgmap v286: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:50.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.676+0000 7fee9793e700 1 -- 172.21.15.98:0/724068117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee900ff350 msgr2=0x7fee900ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.676+0000 7fee9793e700 1 --2- 172.21.15.98:0/724068117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee900ff350 0x7fee900ff7c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00aa20 tx=0x7fee8c00ad30 comp rx=0 tx=0).stop 2024-09-13T03:04:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.676+0000 7fee9793e700 1 -- 172.21.15.98:0/724068117 shutdown_connections 2024-09-13T03:04:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.676+0000 7fee9793e700 1 --2- 172.21.15.98:0/724068117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee900ff350 0x7fee900ff7c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.676+0000 7fee9793e700 1 --2- 172.21.15.98:0/724068117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee901038b0 0x7fee90103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.676+0000 7fee9793e700 1 -- 172.21.15.98:0/724068117 >> 172.21.15.98:0/724068117 conn(0x7fee900748b0 msgr2=0x7fee90074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.676+0000 7fee9793e700 1 -- 172.21.15.98:0/724068117 shutdown_connections 2024-09-13T03:04:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.676+0000 7fee9793e700 1 -- 172.21.15.98:0/724068117 wait complete. 2024-09-13T03:04:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.677+0000 7fee9793e700 1 Processor -- start 2024-09-13T03:04:50.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.677+0000 7fee9793e700 1 -- start start 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee9793e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee900ff350 0x7fee90199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee9793e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee901038b0 0x7fee90199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee9793e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9019a630 con 0x7fee901038b0 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee9793e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90193ae0 con 0x7fee900ff350 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee94ed9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee901038b0 0x7fee90199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee94ed9700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee901038b0 0x7fee90199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45764/0 (socket says 172.21.15.98:45764) 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee94ed9700 1 -- 172.21.15.98:0/2750674861 learned_addr learned my addr 172.21.15.98:0/2750674861 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee956da700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee900ff350 0x7fee90199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee94ed9700 1 -- 172.21.15.98:0/2750674861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee900ff350 msgr2=0x7fee90199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:50.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee94ed9700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee900ff350 0x7fee90199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee94ed9700 1 -- 172.21.15.98:0/2750674861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c00a700 con 0x7fee901038b0 2024-09-13T03:04:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee94ed9700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee901038b0 0x7fee90199fa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fee8c006010 tx=0x7fee8c004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee827fc700 1 -- 172.21.15.98:0/2750674861 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee8c005720 con 0x7fee901038b0 2024-09-13T03:04:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee827fc700 1 -- 172.21.15.98:0/2750674861 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee8c004de0 con 0x7fee901038b0 2024-09-13T03:04:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90193d60 con 0x7fee901038b0 2024-09-13T03:04:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee827fc700 1 -- 172.21.15.98:0/2750674861 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee8c016920 con 0x7fee901038b0 2024-09-13T03:04:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.678+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee90194250 con 0x7fee901038b0 2024-09-13T03:04:50.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.679+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee90106e20 con 0x7fee901038b0 2024-09-13T03:04:50.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.680+0000 7fee827fc700 1 -- 172.21.15.98:0/2750674861 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fee8c016b00 con 0x7fee901038b0 2024-09-13T03:04:50.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.680+0000 7fee827fc700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fee7c06e680 0x7fee7c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:50.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.680+0000 7fee827fc700 1 -- 172.21.15.98:0/2750674861 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fee8c012070 con 0x7fee901038b0 2024-09-13T03:04:50.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.680+0000 7fee956da700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fee7c06e680 0x7fee7c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:50.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.681+0000 7fee956da700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fee7c06e680 0x7fee7c070b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fee84006fd0 tx=0x7fee84008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:50.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.685+0000 7fee827fc700 1 -- 172.21.15.98:0/2750674861 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fee8c05e450 con 0x7fee901038b0 2024-09-13T03:04:50.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.942+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fee90106800 con 0x7fee901038b0 2024-09-13T03:04:50.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.943+0000 7fee827fc700 1 -- 172.21.15.98:0/2750674861 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v39) v1 ==== 107+0+4125 (secure 0 0 0) 0x7fee8c016db0 con 0x7fee901038b0 2024-09-13T03:04:50.944 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:50.944 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":18,"btime":"2024-09-13T03:01:05:792312+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34374,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/2438634369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2438634369},{"type":"v1","addr":"172.21.15.98:6829","nonce":2438634369}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:05.792302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":0,"incarnation":18,"state":"up:replay","state_seq":3,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:04:50.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fee7c06e680 msgr2=0x7fee7c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:50.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fee7c06e680 0x7fee7c070b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fee84006fd0 tx=0x7fee84008040 comp rx=0 tx=0).stop 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee901038b0 msgr2=0x7fee90199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee901038b0 0x7fee90199fa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fee8c006010 tx=0x7fee8c004970 comp rx=0 tx=0).stop 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 shutdown_connections 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fee7c06e680 0x7fee7c070b30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee900ff350 0x7fee90199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 --2- 172.21.15.98:0/2750674861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee901038b0 0x7fee90199fa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 >> 172.21.15.98:0/2750674861 conn(0x7fee900748b0 msgr2=0x7fee900fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 shutdown_connections 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:50.945+0000 7fee9793e700 1 -- 172.21.15.98:0/2750674861 wait complete. 2024-09-13T03:04:50.947 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 18 2024-09-13T03:04:51.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:50 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:04:51.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:50 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:04:51.584 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-13T03:04:51.584 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-13T03:04:51.795 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:52.217 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:51 smithi098 ceph-mon[87325]: pgmap v287: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:52.217 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:51 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2750674861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T03:04:52.217 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:51 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:04:52.218 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:51 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:04:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:51 smithi142 ceph-mon[65447]: pgmap v287: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:51 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2750674861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T03:04:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:51 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:04:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:51 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:04:53.129 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:04:53.129 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:04:53.129 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:04:53.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:52 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:04:53.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:52 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:04:53.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:52 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:04:53.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.367+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/67946471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 msgr2=0x7fb2c8103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:53.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.367+0000 7fb2cd3f5700 1 --2- 172.21.15.98:0/67946471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 0x7fb2c8103c80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800c210 tx=0x7fb2b800c520 comp rx=0 tx=0).stop 2024-09-13T03:04:53.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.367+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/67946471 shutdown_connections 2024-09-13T03:04:53.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.367+0000 7fb2cd3f5700 1 --2- 172.21.15.98:0/67946471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2c80ff350 0x7fb2c80ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.367+0000 7fb2cd3f5700 1 --2- 172.21.15.98:0/67946471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 0x7fb2c8103c80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.367+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/67946471 >> 172.21.15.98:0/67946471 conn(0x7fb2c80748b0 msgr2=0x7fb2c8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:53.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.367+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/67946471 shutdown_connections 2024-09-13T03:04:53.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.367+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/67946471 wait complete. 2024-09-13T03:04:53.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2cd3f5700 1 Processor -- start 2024-09-13T03:04:53.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2cd3f5700 1 -- start start 2024-09-13T03:04:53.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2cd3f5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2c80ff350 0x7fb2c8195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:53.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2cd3f5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 0x7fb2c8196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:53.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2cd3f5700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c8196a60 con 0x7fb2c81038b0 2024-09-13T03:04:53.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2cd3f5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c819a7f0 con 0x7fb2c80ff350 2024-09-13T03:04:53.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2c67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 0x7fb2c8196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:53.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2c67fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 0x7fb2c8196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45788/0 (socket says 172.21.15.98:45788) 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2c67fc700 1 -- 172.21.15.98:0/1290121940 learned_addr learned my addr 172.21.15.98:0/1290121940 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.368+0000 7fb2c6ffd700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2c80ff350 0x7fb2c8195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.369+0000 7fb2c67fc700 1 -- 172.21.15.98:0/1290121940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2c80ff350 msgr2=0x7fb2c8195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.369+0000 7fb2c67fc700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2c80ff350 0x7fb2c8195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.369+0000 7fb2c67fc700 1 -- 172.21.15.98:0/1290121940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b800ae10 con 0x7fb2c81038b0 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.369+0000 7fb2c67fc700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 0x7fb2c8196380 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c8a0 tx=0x7fb2b000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.369+0000 7fb2bffff700 1 -- 172.21.15.98:0/1290121940 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b00078e0 con 0x7fb2c81038b0 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.369+0000 7fb2bffff700 1 -- 172.21.15.98:0/1290121940 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2b000f450 con 0x7fb2c81038b0 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.369+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c819aad0 con 0x7fb2c81038b0 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.369+0000 7fb2bffff700 1 -- 172.21.15.98:0/1290121940 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b000e5e0 con 0x7fb2c81038b0 2024-09-13T03:04:53.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.369+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c819b020 con 0x7fb2c81038b0 2024-09-13T03:04:53.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.370+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c8106e20 con 0x7fb2c81038b0 2024-09-13T03:04:53.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.371+0000 7fb2bffff700 1 -- 172.21.15.98:0/1290121940 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb2b000f5c0 con 0x7fb2c81038b0 2024-09-13T03:04:53.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.371+0000 7fb2bffff700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb2b406e680 0x7fb2b4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:53.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.371+0000 7fb2bffff700 1 -- 172.21.15.98:0/1290121940 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fb2b008e7b0 con 0x7fb2c81038b0 2024-09-13T03:04:53.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.371+0000 7fb2c6ffd700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb2b406e680 0x7fb2b4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:53.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.371+0000 7fb2c6ffd700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb2b406e680 0x7fb2b4070b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8000f80 tx=0x7fb2b800c920 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:53.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.375+0000 7fb2bffff700 1 -- 172.21.15.98:0/1290121940 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb2b0057830 con 0x7fb2c81038b0 2024-09-13T03:04:53.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.620+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fb2c819b2a0 con 0x7fb2c81038b0 2024-09-13T03:04:53.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.621+0000 7fb2bffff700 1 -- 172.21.15.98:0/1290121940 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v39) v1 ==== 107+0+4130 (secure 0 0 0) 0x7fb2b005aef0 con 0x7fb2c81038b0 2024-09-13T03:04:53.623 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:53.623 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":19,"btime":"2024-09-13T03:01:15:852499+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34374,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/2438634369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2438634369},{"type":"v1","addr":"172.21.15.98:6829","nonce":2438634369}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:15.071266+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":171,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:04:53.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb2b406e680 msgr2=0x7fb2b4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:53.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb2b406e680 0x7fb2b4070b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8000f80 tx=0x7fb2b800c920 comp rx=0 tx=0).stop 2024-09-13T03:04:53.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 msgr2=0x7fb2c8196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:53.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 0x7fb2c8196380 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c8a0 tx=0x7fb2b000cbb0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 shutdown_connections 2024-09-13T03:04:53.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fb2b406e680 0x7fb2b4070b30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2c80ff350 0x7fb2c8195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 --2- 172.21.15.98:0/1290121940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c81038b0 0x7fb2c8196380 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 >> 172.21.15.98:0/1290121940 conn(0x7fb2c80748b0 msgr2=0x7fb2c80fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:53.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 shutdown_connections 2024-09-13T03:04:53.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:53.624+0000 7fb2cd3f5700 1 -- 172.21.15.98:0/1290121940 wait complete. 2024-09-13T03:04:53.626 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 19 2024-09-13T03:04:53.904 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:53 smithi098 ceph-mon[87325]: pgmap v288: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:53.904 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:53 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1290121940' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T03:04:54.208 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-13T03:04:54.209 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-13T03:04:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:53 smithi142 ceph-mon[65447]: pgmap v288: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:04:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:53 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1290121940' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T03:04:54.412 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:55.999 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:55 smithi098 ceph-mon[87325]: pgmap v289: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.007+0000 7ff405fa2700 1 -- 172.21.15.98:0/2324325134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4000687a0 msgr2=0x7ff400068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.007+0000 7ff405fa2700 1 --2- 172.21.15.98:0/2324325134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4000687a0 0x7ff400068b70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000b0a0 tx=0x7ff3f000b3b0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.007+0000 7ff405fa2700 1 -- 172.21.15.98:0/2324325134 shutdown_connections 2024-09-13T03:04:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.007+0000 7ff405fa2700 1 --2- 172.21.15.98:0/2324325134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff400069140 0x7ff400104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.007+0000 7ff405fa2700 1 --2- 172.21.15.98:0/2324325134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4000687a0 0x7ff400068b70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.007+0000 7ff405fa2700 1 -- 172.21.15.98:0/2324325134 >> 172.21.15.98:0/2324325134 conn(0x7ff400075130 msgr2=0x7ff400075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.007+0000 7ff405fa2700 1 -- 172.21.15.98:0/2324325134 shutdown_connections 2024-09-13T03:04:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.007+0000 7ff405fa2700 1 -- 172.21.15.98:0/2324325134 wait complete. 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff405fa2700 1 Processor -- start 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff405fa2700 1 -- start start 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff405fa2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4000687a0 0x7ff400195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff405fa2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff400069140 0x7ff4001964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff405fa2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff400196b80 con 0x7ff400069140 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff405fa2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40019a910 con 0x7ff4000687a0 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff3feffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff400069140 0x7ff4001964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff3feffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff400069140 0x7ff4001964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45180/0 (socket says 172.21.15.98:45180) 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff3feffd700 1 -- 172.21.15.98:0/3639598052 learned_addr learned my addr 172.21.15.98:0/3639598052 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff3ff7fe700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4000687a0 0x7ff400195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff3feffd700 1 -- 172.21.15.98:0/3639598052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4000687a0 msgr2=0x7ff400195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff3feffd700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4000687a0 0x7ff400195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.008+0000 7ff3feffd700 1 -- 172.21.15.98:0/3639598052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0009d00 con 0x7ff400069140 2024-09-13T03:04:56.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.009+0000 7ff3feffd700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff400069140 0x7ff4001964a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800b480 tx=0x7ff3e800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:56.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.009+0000 7ff3fcff9700 1 -- 172.21.15.98:0/3639598052 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e80118c0 con 0x7ff400069140 2024-09-13T03:04:56.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.009+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40019abf0 con 0x7ff400069140 2024-09-13T03:04:56.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.009+0000 7ff3fcff9700 1 -- 172.21.15.98:0/3639598052 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3e8010380 con 0x7ff400069140 2024-09-13T03:04:56.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.009+0000 7ff3fcff9700 1 -- 172.21.15.98:0/3639598052 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e800f4f0 con 0x7ff400069140 2024-09-13T03:04:56.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.009+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40019b140 con 0x7ff400069140 2024-09-13T03:04:56.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.010+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff400108770 con 0x7ff400069140 2024-09-13T03:04:56.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.010+0000 7ff3fcff9700 1 -- 172.21.15.98:0/3639598052 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff3e80104f0 con 0x7ff400069140 2024-09-13T03:04:56.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.011+0000 7ff3fcff9700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3ec06e680 0x7ff3ec070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:56.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.011+0000 7ff3fcff9700 1 -- 172.21.15.98:0/3639598052 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7ff3e808e3e0 con 0x7ff400069140 2024-09-13T03:04:56.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.011+0000 7ff3ff7fe700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3ec06e680 0x7ff3ec070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:56.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.011+0000 7ff3ff7fe700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3ec06e680 0x7ff3ec070b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000b830 tx=0x7ff3f0006000 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:56.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.015+0000 7ff3fcff9700 1 -- 172.21.15.98:0/3639598052 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff3e8057460 con 0x7ff400069140 2024-09-13T03:04:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:55 smithi142 ceph-mon[65447]: pgmap v289: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:56.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.261+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7ff40019b3c0 con 0x7ff400069140 2024-09-13T03:04:56.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.262+0000 7ff3fcff9700 1 -- 172.21.15.98:0/3639598052 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v39) v1 ==== 107+0+4127 (secure 0 0 0) 0x7ff3e805ab20 con 0x7ff400069140 2024-09-13T03:04:56.263 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:56.263 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":20,"btime":"2024-09-13T03:01:16:858090+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34374,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/2438634369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2438634369},{"type":"v1","addr":"172.21.15.98:6829","nonce":2438634369}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:15.860236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":172,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:04:56.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.265+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3ec06e680 msgr2=0x7ff3ec070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:56.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.265+0000 7ff405fa2700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3ec06e680 0x7ff3ec070b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000b830 tx=0x7ff3f0006000 comp rx=0 tx=0).stop 2024-09-13T03:04:56.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.265+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff400069140 msgr2=0x7ff4001964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:56.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.265+0000 7ff405fa2700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff400069140 0x7ff4001964a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800b480 tx=0x7ff3e800b840 comp rx=0 tx=0).stop 2024-09-13T03:04:56.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.265+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 shutdown_connections 2024-09-13T03:04:56.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.265+0000 7ff405fa2700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7ff3ec06e680 0x7ff3ec070b30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.265+0000 7ff405fa2700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4000687a0 0x7ff400195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.265+0000 7ff405fa2700 1 --2- 172.21.15.98:0/3639598052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff400069140 0x7ff4001964a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.265+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 >> 172.21.15.98:0/3639598052 conn(0x7ff400075130 msgr2=0x7ff4000fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:56.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.266+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 shutdown_connections 2024-09-13T03:04:56.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:56.266+0000 7ff405fa2700 1 -- 172.21.15.98:0/3639598052 wait complete. 2024-09-13T03:04:56.268 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 20 2024-09-13T03:04:56.834 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-13T03:04:56.834 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-13T03:04:57.043 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:04:57.165 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:56 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3639598052' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T03:04:57.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:56 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3639598052' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T03:04:58.108 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:57 smithi098 ceph-mon[87325]: pgmap v290: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:58.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:57 smithi142 ceph-mon[65447]: pgmap v290: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:04:58.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.616+0000 7fae83077700 1 -- 172.21.15.98:0/1365833561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 msgr2=0x7fae7c104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:58.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.616+0000 7fae83077700 1 --2- 172.21.15.98:0/1365833561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 0x7fae7c104500 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae70009910 tx=0x7fae70009c20 comp rx=0 tx=0).stop 2024-09-13T03:04:58.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.616+0000 7fae83077700 1 -- 172.21.15.98:0/1365833561 shutdown_connections 2024-09-13T03:04:58.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.616+0000 7fae83077700 1 --2- 172.21.15.98:0/1365833561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae7c0ffbd0 0x7fae7c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.616+0000 7fae83077700 1 --2- 172.21.15.98:0/1365833561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 0x7fae7c104500 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.616+0000 7fae83077700 1 -- 172.21.15.98:0/1365833561 >> 172.21.15.98:0/1365833561 conn(0x7fae7c075130 msgr2=0x7fae7c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:58.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.616+0000 7fae83077700 1 -- 172.21.15.98:0/1365833561 shutdown_connections 2024-09-13T03:04:58.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.616+0000 7fae83077700 1 -- 172.21.15.98:0/1365833561 wait complete. 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.617+0000 7fae83077700 1 Processor -- start 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.617+0000 7fae83077700 1 -- start start 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.617+0000 7fae83077700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae7c0ffbd0 0x7fae7c196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.617+0000 7fae83077700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 0x7fae7c197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.617+0000 7fae83077700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c197870 con 0x7fae7c104130 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.617+0000 7fae83077700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1979b0 con 0x7fae7c0ffbd0 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.617+0000 7fae7bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 0x7fae7c197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.617+0000 7fae7bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 0x7fae7c197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45194/0 (socket says 172.21.15.98:45194) 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.617+0000 7fae7bfff700 1 -- 172.21.15.98:0/2714183925 learned_addr learned my addr 172.21.15.98:0/2714183925 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:04:58.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.618+0000 7fae7bfff700 1 -- 172.21.15.98:0/2714183925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae7c0ffbd0 msgr2=0x7fae7c196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.618+0000 7fae7bfff700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae7c0ffbd0 0x7fae7c196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.618+0000 7fae7bfff700 1 -- 172.21.15.98:0/2714183925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700095f0 con 0x7fae7c104130 2024-09-13T03:04:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.618+0000 7fae7bfff700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 0x7fae7c197190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fae6800d8d0 tx=0x7fae6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.618+0000 7fae79ffb700 1 -- 172.21.15.98:0/2714183925 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae68009940 con 0x7fae7c104130 2024-09-13T03:04:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.618+0000 7fae79ffb700 1 -- 172.21.15.98:0/2714183925 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae68010460 con 0x7fae7c104130 2024-09-13T03:04:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.618+0000 7fae79ffb700 1 -- 172.21.15.98:0/2714183925 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae6800f5f0 con 0x7fae7c104130 2024-09-13T03:04:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.618+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c19fcc0 con 0x7fae7c104130 2024-09-13T03:04:58.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.618+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c1a01e0 con 0x7fae7c104130 2024-09-13T03:04:58.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.619+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c1076a0 con 0x7fae7c104130 2024-09-13T03:04:58.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.619+0000 7fae79ffb700 1 -- 172.21.15.98:0/2714183925 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fae680105d0 con 0x7fae7c104130 2024-09-13T03:04:58.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.620+0000 7fae79ffb700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae6c06e680 0x7fae6c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:58.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.620+0000 7fae79ffb700 1 -- 172.21.15.98:0/2714183925 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fae6808e690 con 0x7fae7c104130 2024-09-13T03:04:58.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.620+0000 7fae80e13700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae6c06e680 0x7fae6c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:58.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.621+0000 7fae80e13700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae6c06e680 0x7fae6c070b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fae7000b5c0 tx=0x7fae70005e20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:58.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.625+0000 7fae79ffb700 1 -- 172.21.15.98:0/2714183925 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fae68057790 con 0x7fae7c104130 2024-09-13T03:04:58.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.878+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fae7c04f2a0 con 0x7fae7c104130 2024-09-13T03:04:58.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.878+0000 7fae79ffb700 1 -- 172.21.15.98:0/2714183925 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v39) v1 ==== 107+0+4980 (secure 0 0 0) 0x7fae6805ae50 con 0x7fae7c104130 2024-09-13T03:04:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:04:58.880 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":21,"btime":"2024-09-13T03:01:17:863323+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34374,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/2438634369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2438634369},{"type":"v1","addr":"172.21.15.98:6829","nonce":2438634369}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:17.863320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":0,"incarnation":18,"state":"up:active","state_seq":173,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24269,"qdb_cluster":[24269]},"id":1}]} 2024-09-13T03:04:58.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae6c06e680 msgr2=0x7fae6c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:58.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae6c06e680 0x7fae6c070b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fae7000b5c0 tx=0x7fae70005e20 comp rx=0 tx=0).stop 2024-09-13T03:04:58.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 msgr2=0x7fae7c197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:58.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 0x7fae7c197190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fae6800d8d0 tx=0x7fae6800dc90 comp rx=0 tx=0).stop 2024-09-13T03:04:58.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 shutdown_connections 2024-09-13T03:04:58.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae6c06e680 0x7fae6c070b30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae7c0ffbd0 0x7fae7c196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 --2- 172.21.15.98:0/2714183925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae7c104130 0x7fae7c197190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 >> 172.21.15.98:0/2714183925 conn(0x7fae7c075130 msgr2=0x7fae7c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:58.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 shutdown_connections 2024-09-13T03:04:58.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:04:58.880+0000 7fae83077700 1 -- 172.21.15.98:0/2714183925 wait complete. 2024-09-13T03:04:58.883 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 21 2024-09-13T03:04:59.179 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:58 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2714183925' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T03:04:59.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:58 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2714183925' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T03:04:59.466 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-13T03:04:59.466 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-13T03:04:59.667 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:00.041 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:04:59 smithi098 ceph-mon[87325]: pgmap v291: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:04:59 smithi142 ceph-mon[65447]: pgmap v291: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:01.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.316+0000 7f2f365b2700 1 -- 172.21.15.98:0/2485812645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f301038b0 msgr2=0x7f2f30103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:01.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.316+0000 7f2f365b2700 1 --2- 172.21.15.98:0/2485812645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f301038b0 0x7f2f30103c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000aa20 tx=0x7f2f2000ad30 comp rx=0 tx=0).stop 2024-09-13T03:05:01.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.316+0000 7f2f365b2700 1 -- 172.21.15.98:0/2485812645 shutdown_connections 2024-09-13T03:05:01.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.316+0000 7f2f365b2700 1 --2- 172.21.15.98:0/2485812645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f300ff350 0x7f2f300ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.316+0000 7f2f365b2700 1 --2- 172.21.15.98:0/2485812645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f301038b0 0x7f2f30103c80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.316+0000 7f2f365b2700 1 -- 172.21.15.98:0/2485812645 >> 172.21.15.98:0/2485812645 conn(0x7f2f300748b0 msgr2=0x7f2f30074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:01.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.316+0000 7f2f365b2700 1 -- 172.21.15.98:0/2485812645 shutdown_connections 2024-09-13T03:05:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.316+0000 7f2f365b2700 1 -- 172.21.15.98:0/2485812645 wait complete. 2024-09-13T03:05:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f365b2700 1 Processor -- start 2024-09-13T03:05:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f365b2700 1 -- start start 2024-09-13T03:05:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f365b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f300ff350 0x7f2f30198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f365b2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f301038b0 0x7f2f30198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f365b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f30198c70 con 0x7f2f300ff350 2024-09-13T03:05:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f365b2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3019ca00 con 0x7f2f301038b0 2024-09-13T03:05:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f2ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f300ff350 0x7f2f30198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f2ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f300ff350 0x7f2f30198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45208/0 (socket says 172.21.15.98:45208) 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f2ffff700 1 -- 172.21.15.98:0/2689670650 learned_addr learned my addr 172.21.15.98:0/2689670650 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f2f7fe700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f301038b0 0x7f2f30198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f2ffff700 1 -- 172.21.15.98:0/2689670650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f301038b0 msgr2=0x7f2f30198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f2ffff700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f301038b0 0x7f2f30198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.317+0000 7f2f2ffff700 1 -- 172.21.15.98:0/2689670650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2000a700 con 0x7f2f300ff350 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.318+0000 7f2f2ffff700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f300ff350 0x7f2f30198050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f200056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.318+0000 7f2f2d7fa700 1 -- 172.21.15.98:0/2689670650 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f20004b70 con 0x7f2f300ff350 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.318+0000 7f2f2d7fa700 1 -- 172.21.15.98:0/2689670650 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f20004cd0 con 0x7f2f300ff350 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.318+0000 7f2f2d7fa700 1 -- 172.21.15.98:0/2689670650 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f200168c0 con 0x7f2f300ff350 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.318+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3019cc80 con 0x7f2f300ff350 2024-09-13T03:05:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.318+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3019d120 con 0x7f2f300ff350 2024-09-13T03:05:01.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.319+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f30192040 con 0x7f2f300ff350 2024-09-13T03:05:01.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.319+0000 7f2f2d7fa700 1 -- 172.21.15.98:0/2689670650 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2f2000ecc0 con 0x7f2f300ff350 2024-09-13T03:05:01.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.320+0000 7f2f2d7fa700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f1806e680 0x7f2f18070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:01.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.320+0000 7f2f2d7fa700 1 -- 172.21.15.98:0/2689670650 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f2f20012070 con 0x7f2f300ff350 2024-09-13T03:05:01.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.320+0000 7f2f2f7fe700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f1806e680 0x7f2f18070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:01.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.320+0000 7f2f2f7fe700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f1806e680 0x7f2f18070b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f24005950 tx=0x7f2f240058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:01.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.324+0000 7f2f2d7fa700 1 -- 172.21.15.98:0/2689670650 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f20059910 con 0x7f2f300ff350 2024-09-13T03:05:01.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.572+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f2f3004f2a0 con 0x7f2f300ff350 2024-09-13T03:05:01.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.573+0000 7f2f2d7fa700 1 -- 172.21.15.98:0/2689670650 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v39) v1 ==== 107+0+4201 (secure 0 0 0) 0x7f2f2005cfd0 con 0x7f2f300ff350 2024-09-13T03:05:01.574 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:01.574 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":22,"btime":"2024-09-13T03:01:29:932248+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:17.863320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":0,"incarnation":18,"state":"up:active","state_seq":173,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24269,"qdb_cluster":[24269]},"id":1}]} 2024-09-13T03:05:01.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f1806e680 msgr2=0x7f2f18070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f1806e680 0x7f2f18070b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f24005950 tx=0x7f2f240058e0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f300ff350 msgr2=0x7f2f30198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f300ff350 0x7f2f30198050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f200056b0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 shutdown_connections 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2f1806e680 0x7f2f18070b30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f300ff350 0x7f2f30198050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 --2- 172.21.15.98:0/2689670650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f301038b0 0x7f2f30198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 >> 172.21.15.98:0/2689670650 conn(0x7f2f300748b0 msgr2=0x7f2f30108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 shutdown_connections 2024-09-13T03:05:01.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:01.575+0000 7f2f365b2700 1 -- 172.21.15.98:0/2689670650 wait complete. 2024-09-13T03:05:01.578 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 22 2024-09-13T03:05:02.145 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:01 smithi098 ceph-mon[87325]: pgmap v292: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:02.145 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:01 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2689670650' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T03:05:02.166 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-13T03:05:02.166 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-13T03:05:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:01 smithi142 ceph-mon[65447]: pgmap v292: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:02.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:01 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2689670650' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T03:05:02.368 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:04.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.057+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3402109885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde780ffbd0 msgr2=0x7fde78100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:04.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.057+0000 7fde7e0b2700 1 --2- 172.21.15.98:0/3402109885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde780ffbd0 0x7fde78100040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fde68009910 tx=0x7fde68009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:04.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.057+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3402109885 shutdown_connections 2024-09-13T03:05:04.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.057+0000 7fde7e0b2700 1 --2- 172.21.15.98:0/3402109885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde780ffbd0 0x7fde78100040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.057+0000 7fde7e0b2700 1 --2- 172.21.15.98:0/3402109885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde78104130 0x7fde78104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.057+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3402109885 >> 172.21.15.98:0/3402109885 conn(0x7fde78075130 msgr2=0x7fde78075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:04.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.057+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3402109885 shutdown_connections 2024-09-13T03:05:04.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.057+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3402109885 wait complete. 2024-09-13T03:05:04.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.058+0000 7fde7e0b2700 1 Processor -- start 2024-09-13T03:05:04.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.058+0000 7fde7e0b2700 1 -- start start 2024-09-13T03:05:04.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.058+0000 7fde7e0b2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde780ffbd0 0x7fde78100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:04.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.058+0000 7fde7e0b2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78104130 0x7fde78101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.058+0000 7fde7e0b2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781018b0 con 0x7fde78104130 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.058+0000 7fde7e0b2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781019f0 con 0x7fde780ffbd0 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.058+0000 7fde76ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78104130 0x7fde78101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.058+0000 7fde76ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78104130 0x7fde78101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45234/0 (socket says 172.21.15.98:45234) 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.058+0000 7fde76ffd700 1 -- 172.21.15.98:0/3240757242 learned_addr learned my addr 172.21.15.98:0/3240757242 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde777fe700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde780ffbd0 0x7fde78100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde76ffd700 1 -- 172.21.15.98:0/3240757242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde780ffbd0 msgr2=0x7fde78100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde76ffd700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde780ffbd0 0x7fde78100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde76ffd700 1 -- 172.21.15.98:0/3240757242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680095f0 con 0x7fde78104130 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde76ffd700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78104130 0x7fde78101370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde6800bd70 tx=0x7fde6800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde74ff9700 1 -- 172.21.15.98:0/3240757242 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6801d070 con 0x7fde78104130 2024-09-13T03:05:04.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde74ff9700 1 -- 172.21.15.98:0/3240757242 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde68004fb0 con 0x7fde78104130 2024-09-13T03:05:04.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde78101c70 con 0x7fde78104130 2024-09-13T03:05:04.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde74ff9700 1 -- 172.21.15.98:0/3240757242 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6800f690 con 0x7fde78104130 2024-09-13T03:05:04.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.059+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde781a2450 con 0x7fde78104130 2024-09-13T03:05:04.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.060+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde781086a0 con 0x7fde78104130 2024-09-13T03:05:04.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.061+0000 7fde74ff9700 1 -- 172.21.15.98:0/3240757242 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fde68022470 con 0x7fde78104130 2024-09-13T03:05:04.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.061+0000 7fde74ff9700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fde6006e680 0x7fde60070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:04.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.061+0000 7fde74ff9700 1 -- 172.21.15.98:0/3240757242 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fde6808fea0 con 0x7fde78104130 2024-09-13T03:05:04.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.061+0000 7fde777fe700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fde6006e680 0x7fde60070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:04.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.062+0000 7fde777fe700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fde6006e680 0x7fde60070b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde6c006fd0 tx=0x7fde6c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:04.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.066+0000 7fde74ff9700 1 -- 172.21.15.98:0/3240757242 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fde68059060 con 0x7fde78104130 2024-09-13T03:05:04.067 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:03 smithi098 ceph-mon[87325]: pgmap v293: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:04.067 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:03 smithi142 ceph-mon[65447]: pgmap v293: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:04.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.314+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fde7804f2a0 con 0x7fde78104130 2024-09-13T03:05:04.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.315+0000 7fde74ff9700 1 -- 172.21.15.98:0/3240757242 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v39) v1 ==== 107+0+5048 (secure 0 0 0) 0x7fde68027090 con 0x7fde78104130 2024-09-13T03:05:04.316 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:04.316 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"btime":"2024-09-13T03:01:35:948484+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:17.863320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24269":{"gid":24269,"name":"cephfs.smithi142.wxfmvt","rank":0,"incarnation":18,"state":"up:active","state_seq":173,"addr":"172.21.15.142:6825/2448398872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2448398872},{"type":"v1","addr":"172.21.15.142:6825","nonce":2448398872}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24269,"qdb_cluster":[24269]},"id":1}]} 2024-09-13T03:05:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fde6006e680 msgr2=0x7fde60070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fde6006e680 0x7fde60070b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde6c006fd0 tx=0x7fde6c008040 comp rx=0 tx=0).stop 2024-09-13T03:05:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78104130 msgr2=0x7fde78101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78104130 0x7fde78101370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde6800bd70 tx=0x7fde6800be50 comp rx=0 tx=0).stop 2024-09-13T03:05:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 shutdown_connections 2024-09-13T03:05:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fde6006e680 0x7fde60070b30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde780ffbd0 0x7fde78100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 --2- 172.21.15.98:0/3240757242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde78104130 0x7fde78101370 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 >> 172.21.15.98:0/3240757242 conn(0x7fde78075130 msgr2=0x7fde780fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 shutdown_connections 2024-09-13T03:05:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:04.317+0000 7fde7e0b2700 1 -- 172.21.15.98:0/3240757242 wait complete. 2024-09-13T03:05:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2024-09-13T03:05:04.933 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-13T03:05:04.934 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-13T03:05:05.132 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:05.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:04 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3240757242' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T03:05:05.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:04 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3240757242' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T03:05:06.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:05 smithi098 ceph-mon[87325]: pgmap v294: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:06.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:05 smithi142 ceph-mon[65447]: pgmap v294: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.933+0000 7f777a780700 1 -- 172.21.15.98:0/4051891267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 msgr2=0x7f7774100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.933+0000 7f777a780700 1 --2- 172.21.15.98:0/4051891267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 0x7f7774100830 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7764009940 tx=0x7f7764009c50 comp rx=0 tx=0).stop 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.933+0000 7f777a780700 1 -- 172.21.15.98:0/4051891267 shutdown_connections 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.933+0000 7f777a780700 1 --2- 172.21.15.98:0/4051891267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7774100d70 0x7f77741094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.933+0000 7f777a780700 1 --2- 172.21.15.98:0/4051891267 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 0x7f7774100830 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.933+0000 7f777a780700 1 -- 172.21.15.98:0/4051891267 >> 172.21.15.98:0/4051891267 conn(0x7f77740748b0 msgr2=0x7f7774074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.933+0000 7f777a780700 1 -- 172.21.15.98:0/4051891267 shutdown_connections 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.933+0000 7f777a780700 1 -- 172.21.15.98:0/4051891267 wait complete. 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f777a780700 1 Processor -- start 2024-09-13T03:05:06.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f777a780700 1 -- start start 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f777a780700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 0x7f7774195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f777a780700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7774100d70 0x7f7774196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f777a780700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77741969e0 con 0x7f7774100460 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f777a780700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777419a720 con 0x7f7774100d70 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f7773fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 0x7f7774195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f7773fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 0x7f7774195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53960/0 (socket says 172.21.15.98:53960) 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f7773fff700 1 -- 172.21.15.98:0/2075965085 learned_addr learned my addr 172.21.15.98:0/2075965085 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f776bfff700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7774100d70 0x7f7774196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f7773fff700 1 -- 172.21.15.98:0/2075965085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7774100d70 msgr2=0x7f7774196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f7773fff700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7774100d70 0x7f7774196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f7773fff700 1 -- 172.21.15.98:0/2075965085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640095f0 con 0x7f7774100460 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.934+0000 7f776bfff700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7774100d70 0x7f7774196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.935+0000 7f7773fff700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 0x7f7774195dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77640055f0 tx=0x7f77640056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:06.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.935+0000 7f7771ffb700 1 -- 172.21.15.98:0/2075965085 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f776401d070 con 0x7f7774100460 2024-09-13T03:05:06.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.935+0000 7f7771ffb700 1 -- 172.21.15.98:0/2075965085 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f776400f460 con 0x7f7774100460 2024-09-13T03:05:06.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.935+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777419aa00 con 0x7f7774100460 2024-09-13T03:05:06.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.935+0000 7f7771ffb700 1 -- 172.21.15.98:0/2075965085 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7764021640 con 0x7f7774100460 2024-09-13T03:05:06.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.935+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777419af50 con 0x7f7774100460 2024-09-13T03:05:06.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.936+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777404f2a0 con 0x7f7774100460 2024-09-13T03:05:06.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.936+0000 7f7771ffb700 1 -- 172.21.15.98:0/2075965085 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f776400fab0 con 0x7f7774100460 2024-09-13T03:05:06.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.937+0000 7f7771ffb700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f776006e680 0x7f7760070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:06.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.937+0000 7f7771ffb700 1 -- 172.21.15.98:0/2075965085 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f776408fa30 con 0x7f7774100460 2024-09-13T03:05:06.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.937+0000 7f776bfff700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f776006e680 0x7f7760070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:06.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.937+0000 7f776bfff700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f776006e680 0x7f7760070b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7774197390 tx=0x7f775c00b5f0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:06.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:06.941+0000 7f7771ffb700 1 -- 172.21.15.98:0/2075965085 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7764058a50 con 0x7f7774100460 2024-09-13T03:05:07.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.187+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f777419b3a0 con 0x7f7774100460 2024-09-13T03:05:07.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.188+0000 7f7771ffb700 1 -- 172.21.15.98:0/2075965085 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v39) v1 ==== 107+0+4244 (secure 0 0 0) 0x7f776405c110 con 0x7f7774100460 2024-09-13T03:05:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:07.190 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-13T03:01:47:103980+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:47.103977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f776006e680 msgr2=0x7f7760070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f776006e680 0x7f7760070b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7774197390 tx=0x7f775c00b5f0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 msgr2=0x7f7774195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 0x7f7774195dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77640055f0 tx=0x7f77640056d0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 shutdown_connections 2024-09-13T03:05:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f776006e680 0x7f7760070b30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7774100460 0x7f7774195dc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 --2- 172.21.15.98:0/2075965085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7774100d70 0x7f7774196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 >> 172.21.15.98:0/2075965085 conn(0x7f77740748b0 msgr2=0x7f77740ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:07.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 shutdown_connections 2024-09-13T03:05:07.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:07.190+0000 7f777a780700 1 -- 172.21.15.98:0/2075965085 wait complete. 2024-09-13T03:05:07.193 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-13T03:05:07.799 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-13T03:05:07.799 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-13T03:05:08.000 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:08.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:07 smithi098 ceph-mon[87325]: pgmap v295: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:08.120 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:07 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2075965085' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T03:05:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:07 smithi142 ceph-mon[65447]: pgmap v295: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:08.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:07 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2075965085' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T03:05:09.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.561+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3950800290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e40ffbd0 msgr2=0x7f43e4100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:09.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.561+0000 7f43ea4d7700 1 --2- 172.21.15.98:0/3950800290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e40ffbd0 0x7f43e4100040 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009910 tx=0x7f43cc009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:09.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.561+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3950800290 shutdown_connections 2024-09-13T03:05:09.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.561+0000 7f43ea4d7700 1 --2- 172.21.15.98:0/3950800290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e40ffbd0 0x7f43e4100040 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:09.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.561+0000 7f43ea4d7700 1 --2- 172.21.15.98:0/3950800290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43e4104130 0x7f43e4104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:09.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.561+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3950800290 >> 172.21.15.98:0/3950800290 conn(0x7f43e4075130 msgr2=0x7f43e4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:09.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.561+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3950800290 shutdown_connections 2024-09-13T03:05:09.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.561+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3950800290 wait complete. 2024-09-13T03:05:09.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.562+0000 7f43ea4d7700 1 Processor -- start 2024-09-13T03:05:09.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.562+0000 7f43ea4d7700 1 -- start start 2024-09-13T03:05:09.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.562+0000 7f43ea4d7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43e40ffbd0 0x7f43e4100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.562+0000 7f43ea4d7700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e4104130 0x7f43e4101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.562+0000 7f43ea4d7700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41018b0 con 0x7f43e4104130 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.562+0000 7f43ea4d7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41019f0 con 0x7f43e40ffbd0 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.562+0000 7f43e37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e4104130 0x7f43e4101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e4104130 0x7f43e4101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53982/0 (socket says 172.21.15.98:53982) 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e37fe700 1 -- 172.21.15.98:0/3883421621 learned_addr learned my addr 172.21.15.98:0/3883421621 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e3fff700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43e40ffbd0 0x7f43e4100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e37fe700 1 -- 172.21.15.98:0/3883421621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43e40ffbd0 msgr2=0x7f43e4100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e37fe700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43e40ffbd0 0x7f43e4100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e37fe700 1 -- 172.21.15.98:0/3883421621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0095f0 con 0x7f43e4104130 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e37fe700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e4104130 0x7f43e4101370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00bd70 tx=0x7f43cc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e17fa700 1 -- 172.21.15.98:0/3883421621 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43cc01d070 con 0x7f43e4104130 2024-09-13T03:05:09.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e17fa700 1 -- 172.21.15.98:0/3883421621 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43cc005dc0 con 0x7f43e4104130 2024-09-13T03:05:09.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43e17fa700 1 -- 172.21.15.98:0/3883421621 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43cc017400 con 0x7f43e4104130 2024-09-13T03:05:09.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e4101c70 con 0x7f43e4104130 2024-09-13T03:05:09.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.563+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e41a22d0 con 0x7f43e4104130 2024-09-13T03:05:09.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.564+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e41086a0 con 0x7f43e4104130 2024-09-13T03:05:09.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.565+0000 7f43e17fa700 1 -- 172.21.15.98:0/3883421621 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f43cc00f460 con 0x7f43e4104130 2024-09-13T03:05:09.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.565+0000 7f43e17fa700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f43d006e680 0x7f43d0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:09.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.565+0000 7f43e17fa700 1 -- 172.21.15.98:0/3883421621 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f43cc08fbd0 con 0x7f43e4104130 2024-09-13T03:05:09.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.565+0000 7f43e3fff700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f43d006e680 0x7f43d0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:09.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.566+0000 7f43e3fff700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f43d006e680 0x7f43d0070b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43d4005950 tx=0x7f43d400b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:09.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.569+0000 7f43e17fa700 1 -- 172.21.15.98:0/3883421621 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f43cc058d10 con 0x7f43e4104130 2024-09-13T03:05:09.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.816+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f43e404f2a0 con 0x7f43e4104130 2024-09-13T03:05:09.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.817+0000 7f43e17fa700 1 -- 172.21.15.98:0/3883421621 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v39) v1 ==== 107+0+4255 (secure 0 0 0) 0x7f43cc05c3d0 con 0x7f43e4104130 2024-09-13T03:05:09.819 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:09.819 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":25,"btime":"2024-09-13T03:01:47:109072+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:47.109058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:09.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.819+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f43d006e680 msgr2=0x7f43d0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:09.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.819+0000 7f43ea4d7700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f43d006e680 0x7f43d0070b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43d4005950 tx=0x7f43d400b410 comp rx=0 tx=0).stop 2024-09-13T03:05:09.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.819+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e4104130 msgr2=0x7f43e4101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:09.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.819+0000 7f43ea4d7700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e4104130 0x7f43e4101370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00bd70 tx=0x7f43cc00bda0 comp rx=0 tx=0).stop 2024-09-13T03:05:09.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.819+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 shutdown_connections 2024-09-13T03:05:09.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.819+0000 7f43ea4d7700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f43d006e680 0x7f43d0070b30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:09.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.819+0000 7f43ea4d7700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43e40ffbd0 0x7f43e4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:09.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.819+0000 7f43ea4d7700 1 --2- 172.21.15.98:0/3883421621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43e4104130 0x7f43e4101370 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:09.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.819+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 >> 172.21.15.98:0/3883421621 conn(0x7f43e4075130 msgr2=0x7f43e40fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:09.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.820+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 shutdown_connections 2024-09-13T03:05:09.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:09.820+0000 7f43ea4d7700 1 -- 172.21.15.98:0/3883421621 wait complete. 2024-09-13T03:05:09.822 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 25 2024-09-13T03:05:10.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:09 smithi098 ceph-mon[87325]: pgmap v296: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:10.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:09 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3883421621' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T03:05:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:09 smithi142 ceph-mon[65447]: pgmap v296: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:10.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:09 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3883421621' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T03:05:10.356 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-13T03:05:10.356 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-13T03:05:10.560 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:12.204 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:11 smithi098 ceph-mon[87325]: pgmap v297: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.205+0000 7f1856969700 1 -- 172.21.15.98:0/295631414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ffc60 msgr2=0x7f185010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.205+0000 7f1856969700 1 --2- 172.21.15.98:0/295631414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ffc60 0x7f185010a6d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1844009910 tx=0x7f1844009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.205+0000 7f1856969700 1 -- 172.21.15.98:0/295631414 shutdown_connections 2024-09-13T03:05:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.205+0000 7f1856969700 1 --2- 172.21.15.98:0/295631414 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ffc60 0x7f185010a6d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:12.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.205+0000 7f1856969700 1 --2- 172.21.15.98:0/295631414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18500ff350 0x7f18500ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:12.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.205+0000 7f1856969700 1 -- 172.21.15.98:0/295631414 >> 172.21.15.98:0/295631414 conn(0x7f18500748b0 msgr2=0x7f1850074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:12.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.205+0000 7f1856969700 1 -- 172.21.15.98:0/295631414 shutdown_connections 2024-09-13T03:05:12.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.205+0000 7f1856969700 1 -- 172.21.15.98:0/295631414 wait complete. 2024-09-13T03:05:12.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.206+0000 7f1856969700 1 Processor -- start 2024-09-13T03:05:12.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.206+0000 7f1856969700 1 -- start start 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.206+0000 7f1856969700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ff350 0x7f1850195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.206+0000 7f1856969700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18500ffc60 0x7f18501964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.206+0000 7f1856969700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1850196ba0 con 0x7f18500ff350 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.206+0000 7f1856969700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185019a8c0 con 0x7f18500ffc60 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.206+0000 7f184ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ff350 0x7f1850195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.206+0000 7f184ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ff350 0x7f1850195f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54004/0 (socket says 172.21.15.98:54004) 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.206+0000 7f184ffff700 1 -- 172.21.15.98:0/628807536 learned_addr learned my addr 172.21.15.98:0/628807536 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f184f7fe700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18500ffc60 0x7f18501964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f184ffff700 1 -- 172.21.15.98:0/628807536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18500ffc60 msgr2=0x7f18501964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f184ffff700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18500ffc60 0x7f18501964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:12.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f184ffff700 1 -- 172.21.15.98:0/628807536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18440095f0 con 0x7f18500ff350 2024-09-13T03:05:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f184ffff700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ff350 0x7f1850195f80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f184000b480 tx=0x7f184000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f184d7fa700 1 -- 172.21.15.98:0/628807536 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18400118c0 con 0x7f18500ff350 2024-09-13T03:05:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185019aba0 con 0x7f18500ff350 2024-09-13T03:05:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f184d7fa700 1 -- 172.21.15.98:0/628807536 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1840010380 con 0x7f18500ff350 2024-09-13T03:05:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f184d7fa700 1 -- 172.21.15.98:0/628807536 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184000f4f0 con 0x7f18500ff350 2024-09-13T03:05:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.207+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185019b0f0 con 0x7f18500ff350 2024-09-13T03:05:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.208+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1850107dd0 con 0x7f18500ff350 2024-09-13T03:05:12.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.209+0000 7f184d7fa700 1 -- 172.21.15.98:0/628807536 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f18400104f0 con 0x7f18500ff350 2024-09-13T03:05:12.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.209+0000 7f184d7fa700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f183806e680 0x7f1838070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:12.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.209+0000 7f184d7fa700 1 -- 172.21.15.98:0/628807536 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f184008e3e0 con 0x7f18500ff350 2024-09-13T03:05:12.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.209+0000 7f184f7fe700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f183806e680 0x7f1838070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:12.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.210+0000 7f184f7fe700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f183806e680 0x7f1838070b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f184400b5c0 tx=0x7f1844005960 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:12.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.213+0000 7f184d7fa700 1 -- 172.21.15.98:0/628807536 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1840057460 con 0x7f18500ff350 2024-09-13T03:05:12.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:11 smithi142 ceph-mon[65447]: pgmap v297: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:12.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.459+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f185019b370 con 0x7f18500ff350 2024-09-13T03:05:12.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.460+0000 7f184d7fa700 1 -- 172.21.15.98:0/628807536 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v39) v1 ==== 107+0+5105 (secure 0 0 0) 0x7f184005ab20 con 0x7f18500ff350 2024-09-13T03:05:12.461 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:12.461 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":26,"btime":"2024-09-13T03:01:54:811278+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:47.109058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f183806e680 msgr2=0x7f1838070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f183806e680 0x7f1838070b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f184400b5c0 tx=0x7f1844005960 comp rx=0 tx=0).stop 2024-09-13T03:05:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ff350 msgr2=0x7f1850195f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:12.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ff350 0x7f1850195f80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f184000b480 tx=0x7f184000b840 comp rx=0 tx=0).stop 2024-09-13T03:05:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 shutdown_connections 2024-09-13T03:05:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f183806e680 0x7f1838070b30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18500ff350 0x7f1850195f80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 --2- 172.21.15.98:0/628807536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18500ffc60 0x7f18501964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 >> 172.21.15.98:0/628807536 conn(0x7f18500748b0 msgr2=0x7f1850104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:12.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 shutdown_connections 2024-09-13T03:05:12.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:12.462+0000 7f1856969700 1 -- 172.21.15.98:0/628807536 wait complete. 2024-09-13T03:05:12.465 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 26 2024-09-13T03:05:13.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:12 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/628807536' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T03:05:13.083 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:12 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/628807536' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T03:05:13.104 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-13T03:05:13.104 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-13T03:05:13.304 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:14.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:13 smithi098 ceph-mon[87325]: pgmap v298: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:14.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:13 smithi142 ceph-mon[65447]: pgmap v298: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:14.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.921+0000 7f2091215700 1 -- 172.21.15.98:0/1031532949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 msgr2=0x7f208c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:14.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.921+0000 7f2091215700 1 --2- 172.21.15.98:0/1031532949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 0x7f208c1008b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f207c009910 tx=0x7f207c009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:14.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.921+0000 7f2091215700 1 -- 172.21.15.98:0/1031532949 shutdown_connections 2024-09-13T03:05:14.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.921+0000 7f2091215700 1 --2- 172.21.15.98:0/1031532949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f208c100e80 0x7f208c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:14.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.921+0000 7f2091215700 1 --2- 172.21.15.98:0/1031532949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 0x7f208c1008b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:14.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.921+0000 7f2091215700 1 -- 172.21.15.98:0/1031532949 >> 172.21.15.98:0/1031532949 conn(0x7f208c0fbda0 msgr2=0x7f208c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:14.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.921+0000 7f2091215700 1 -- 172.21.15.98:0/1031532949 shutdown_connections 2024-09-13T03:05:14.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.921+0000 7f2091215700 1 -- 172.21.15.98:0/1031532949 wait complete. 2024-09-13T03:05:14.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.922+0000 7f2091215700 1 Processor -- start 2024-09-13T03:05:14.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.922+0000 7f2091215700 1 -- start start 2024-09-13T03:05:14.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f2091215700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 0x7f208c195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f2091215700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f208c100e80 0x7f208c1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f2091215700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c196bb0 con 0x7f208c1004e0 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f2091215700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c19a940 con 0x7f208c100e80 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f208ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 0x7f208c195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f208ad9d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 0x7f208c195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59340/0 (socket says 172.21.15.98:59340) 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f208ad9d700 1 -- 172.21.15.98:0/2087953762 learned_addr learned my addr 172.21.15.98:0/2087953762 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f208a59c700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f208c100e80 0x7f208c1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f208ad9d700 1 -- 172.21.15.98:0/2087953762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f208c100e80 msgr2=0x7f208c1964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f208ad9d700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f208c100e80 0x7f208c1964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f208ad9d700 1 -- 172.21.15.98:0/2087953762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c0095f0 con 0x7f208c1004e0 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f208a59c700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f208c100e80 0x7f208c1964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:05:14.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f208ad9d700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 0x7f208c195f90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f207c006010 tx=0x7f207c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:14.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f2073fff700 1 -- 172.21.15.98:0/2087953762 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f207c01d070 con 0x7f208c1004e0 2024-09-13T03:05:14.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208c19abc0 con 0x7f208c1004e0 2024-09-13T03:05:14.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f2073fff700 1 -- 172.21.15.98:0/2087953762 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f207c004fb0 con 0x7f208c1004e0 2024-09-13T03:05:14.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.923+0000 7f2073fff700 1 -- 172.21.15.98:0/2087953762 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f207c022ea0 con 0x7f208c1004e0 2024-09-13T03:05:14.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.924+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c19b0b0 con 0x7f208c1004e0 2024-09-13T03:05:14.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.924+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c1087f0 con 0x7f208c1004e0 2024-09-13T03:05:14.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.925+0000 7f2073fff700 1 -- 172.21.15.98:0/2087953762 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f207c022470 con 0x7f208c1004e0 2024-09-13T03:05:14.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.925+0000 7f2073fff700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f207406e680 0x7f2074070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:14.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.925+0000 7f2073fff700 1 -- 172.21.15.98:0/2087953762 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f207c08fd10 con 0x7f208c1004e0 2024-09-13T03:05:14.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.926+0000 7f208a59c700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f207406e680 0x7f2074070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:14.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.926+0000 7f208a59c700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f207406e680 0x7f2074070b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f208c1975b0 tx=0x7f2080008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:14.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:14.930+0000 7f2073fff700 1 -- 172.21.15.98:0/2087953762 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f207c058e40 con 0x7f208c1004e0 2024-09-13T03:05:15.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.174+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f208c19b390 con 0x7f208c1004e0 2024-09-13T03:05:15.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.175+0000 7f2073fff700 1 -- 172.21.15.98:0/2087953762 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v39) v1 ==== 107+0+5110 (secure 0 0 0) 0x7f207c027090 con 0x7f208c1004e0 2024-09-13T03:05:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:15.177 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":27,"btime":"2024-09-13T03:01:56:816803+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:56.629416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":180,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:15.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.177+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f207406e680 msgr2=0x7f2074070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:15.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.177+0000 7f2091215700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f207406e680 0x7f2074070b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f208c1975b0 tx=0x7f2080008040 comp rx=0 tx=0).stop 2024-09-13T03:05:15.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.177+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 msgr2=0x7f208c195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:15.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.177+0000 7f2091215700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 0x7f208c195f90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f207c006010 tx=0x7f207c00be20 comp rx=0 tx=0).stop 2024-09-13T03:05:15.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.177+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 shutdown_connections 2024-09-13T03:05:15.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.177+0000 7f2091215700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f207406e680 0x7f2074070b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.177+0000 7f2091215700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1004e0 0x7f208c195f90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.177+0000 7f2091215700 1 --2- 172.21.15.98:0/2087953762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f208c100e80 0x7f208c1964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.178+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 >> 172.21.15.98:0/2087953762 conn(0x7f208c0fbda0 msgr2=0x7f208c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.178+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 shutdown_connections 2024-09-13T03:05:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:15.178+0000 7f2091215700 1 -- 172.21.15.98:0/2087953762 wait complete. 2024-09-13T03:05:15.180 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 27 2024-09-13T03:05:15.814 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-13T03:05:15.814 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-13T03:05:16.014 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:16.136 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:15 smithi098 ceph-mon[87325]: pgmap v299: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:16.191 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:15 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2087953762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T03:05:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:15 smithi142 ceph-mon[65447]: pgmap v299: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:15 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2087953762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.659+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3708666160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb80ffbd0 msgr2=0x7fceb8100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.659+0000 7fcebdd8e700 1 --2- 172.21.15.98:0/3708666160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb80ffbd0 0x7fceb8100040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009910 tx=0x7fcea0009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.659+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3708666160 shutdown_connections 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.659+0000 7fcebdd8e700 1 --2- 172.21.15.98:0/3708666160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb80ffbd0 0x7fceb8100040 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.659+0000 7fcebdd8e700 1 --2- 172.21.15.98:0/3708666160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceb8104130 0x7fceb8104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.659+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3708666160 >> 172.21.15.98:0/3708666160 conn(0x7fceb8075130 msgr2=0x7fceb8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.659+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3708666160 shutdown_connections 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.659+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3708666160 wait complete. 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.660+0000 7fcebdd8e700 1 Processor -- start 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.660+0000 7fcebdd8e700 1 -- start start 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.660+0000 7fcebdd8e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceb80ffbd0 0x7fceb8100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.660+0000 7fcebdd8e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb8104130 0x7fceb8101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.660+0000 7fcebdd8e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81018b0 con 0x7fceb8104130 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.660+0000 7fcebdd8e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81019f0 con 0x7fceb80ffbd0 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.660+0000 7fceaffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb8104130 0x7fceb8101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.660+0000 7fceaffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb8104130 0x7fceb8101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59356/0 (socket says 172.21.15.98:59356) 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.660+0000 7fceaffff700 1 -- 172.21.15.98:0/3116813527 learned_addr learned my addr 172.21.15.98:0/3116813527 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fceb77fe700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceb80ffbd0 0x7fceb8100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fceaffff700 1 -- 172.21.15.98:0/3116813527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceb80ffbd0 msgr2=0x7fceb8100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fceaffff700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceb80ffbd0 0x7fceb8100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fceaffff700 1 -- 172.21.15.98:0/3116813527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea00095f0 con 0x7fceb8104130 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fceaffff700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb8104130 0x7fceb8101370 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcea000bd70 tx=0x7fcea000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fceb57fa700 1 -- 172.21.15.98:0/3116813527 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcea001d070 con 0x7fceb8104130 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fceb57fa700 1 -- 172.21.15.98:0/3116813527 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcea000f460 con 0x7fceb8104130 2024-09-13T03:05:17.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb8101c70 con 0x7fceb8104130 2024-09-13T03:05:17.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fceb57fa700 1 -- 172.21.15.98:0/3116813527 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcea0017630 con 0x7fceb8104130 2024-09-13T03:05:17.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.661+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb81a2370 con 0x7fceb8104130 2024-09-13T03:05:17.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.662+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb81086a0 con 0x7fceb8104130 2024-09-13T03:05:17.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.663+0000 7fceb57fa700 1 -- 172.21.15.98:0/3116813527 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcea0003a60 con 0x7fceb8104130 2024-09-13T03:05:17.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.663+0000 7fceb57fa700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcea406e6d0 0x7fcea4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:17.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.663+0000 7fceb57fa700 1 -- 172.21.15.98:0/3116813527 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fcea008fc80 con 0x7fceb8104130 2024-09-13T03:05:17.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.663+0000 7fceb77fe700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcea406e6d0 0x7fcea4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:17.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.664+0000 7fceb77fe700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcea406e6d0 0x7fcea4070b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcea8005950 tx=0x7fcea80058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:17.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.668+0000 7fceb57fa700 1 -- 172.21.15.98:0/3116813527 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcea0058da0 con 0x7fceb8104130 2024-09-13T03:05:17.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.914+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fceb804f2a0 con 0x7fceb8104130 2024-09-13T03:05:17.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.915+0000 7fceb57fa700 1 -- 172.21.15.98:0/3116813527 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v39) v1 ==== 107+0+5107 (secure 0 0 0) 0x7fcea005c460 con 0x7fceb8104130 2024-09-13T03:05:17.916 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:17.916 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":28,"btime":"2024-09-13T03:01:57:822030+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:56.824241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":181,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:17.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcea406e6d0 msgr2=0x7fcea4070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:17.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcea406e6d0 0x7fcea4070b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcea8005950 tx=0x7fcea80058e0 comp rx=0 tx=0).stop 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb8104130 msgr2=0x7fceb8101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb8104130 0x7fceb8101370 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcea000bd70 tx=0x7fcea000be50 comp rx=0 tx=0).stop 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 shutdown_connections 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcea406e6d0 0x7fcea4070b80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceb80ffbd0 0x7fceb8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 --2- 172.21.15.98:0/3116813527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fceb8104130 0x7fceb8101370 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 >> 172.21.15.98:0/3116813527 conn(0x7fceb8075130 msgr2=0x7fceb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 shutdown_connections 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:17.917+0000 7fcebdd8e700 1 -- 172.21.15.98:0/3116813527 wait complete. 2024-09-13T03:05:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 28 2024-09-13T03:05:18.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:17 smithi098 ceph-mon[87325]: pgmap v300: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:18.230 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:17 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3116813527' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T03:05:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:17 smithi142 ceph-mon[65447]: pgmap v300: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:17 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3116813527' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T03:05:18.569 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-13T03:05:18.570 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-13T03:05:18.769 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:19.140 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:20.059 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:19 smithi098 ceph-mon[87325]: pgmap v301: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:19 smithi142 ceph-mon[65447]: pgmap v301: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:20.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 -- 172.21.15.98:0/3303776291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 msgr2=0x7f0e20104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:20.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 --2- 172.21.15.98:0/3303776291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 0x7f0e20104e50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009910 tx=0x7f0e14009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:20.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 -- 172.21.15.98:0/3303776291 shutdown_connections 2024-09-13T03:05:20.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 --2- 172.21.15.98:0/3303776291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 0x7f0e20104e50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:20.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 --2- 172.21.15.98:0/3303776291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e201004e0 0x7f0e201008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:20.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 -- 172.21.15.98:0/3303776291 >> 172.21.15.98:0/3303776291 conn(0x7f0e200fbda0 msgr2=0x7f0e200fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:20.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 -- 172.21.15.98:0/3303776291 shutdown_connections 2024-09-13T03:05:20.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 -- 172.21.15.98:0/3303776291 wait complete. 2024-09-13T03:05:20.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 Processor -- start 2024-09-13T03:05:20.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.312+0000 7f0e25fdf700 1 -- start start 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e25fdf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e201004e0 0x7f0e20073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e25fdf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 0x7f0e20073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e25fdf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e20073ad0 con 0x7f0e20100e80 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e25fdf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e20073c10 con 0x7f0e201004e0 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e1effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 0x7f0e20073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e1effd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 0x7f0e20073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59364/0 (socket says 172.21.15.98:59364) 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e1effd700 1 -- 172.21.15.98:0/1190888972 learned_addr learned my addr 172.21.15.98:0/1190888972 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e1f7fe700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e201004e0 0x7f0e20073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e1effd700 1 -- 172.21.15.98:0/1190888972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e201004e0 msgr2=0x7f0e20073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e1effd700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e201004e0 0x7f0e20073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:20.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e1effd700 1 -- 172.21.15.98:0/1190888972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140095f0 con 0x7f0e20100e80 2024-09-13T03:05:20.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.313+0000 7f0e1effd700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 0x7f0e20073590 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400bd70 tx=0x7f0e1400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:20.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.314+0000 7f0e1cff9700 1 -- 172.21.15.98:0/1190888972 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e1401d070 con 0x7f0e20100e80 2024-09-13T03:05:20.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.314+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e20073e90 con 0x7f0e20100e80 2024-09-13T03:05:20.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.314+0000 7f0e1cff9700 1 -- 172.21.15.98:0/1190888972 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e14005dc0 con 0x7f0e20100e80 2024-09-13T03:05:20.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.314+0000 7f0e1cff9700 1 -- 172.21.15.98:0/1190888972 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e14017400 con 0x7f0e20100e80 2024-09-13T03:05:20.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.314+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e201a2410 con 0x7f0e20100e80 2024-09-13T03:05:20.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.315+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e20108850 con 0x7f0e20100e80 2024-09-13T03:05:20.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.315+0000 7f0e1cff9700 1 -- 172.21.15.98:0/1190888972 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0e1400f460 con 0x7f0e20100e80 2024-09-13T03:05:20.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.316+0000 7f0e1cff9700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0e0806e680 0x7f0e08070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:20.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.316+0000 7f0e1cff9700 1 -- 172.21.15.98:0/1190888972 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f0e1408fc70 con 0x7f0e20100e80 2024-09-13T03:05:20.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.316+0000 7f0e1f7fe700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0e0806e680 0x7f0e08070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:20.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.316+0000 7f0e1f7fe700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0e0806e680 0x7f0e08070b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005950 tx=0x7f0e1000b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:20.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.320+0000 7f0e1cff9700 1 -- 172.21.15.98:0/1190888972 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0e14096080 con 0x7f0e20100e80 2024-09-13T03:05:20.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.567+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f0e2004f2a0 con 0x7f0e20100e80 2024-09-13T03:05:20.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.568+0000 7f0e1cff9700 1 -- 172.21.15.98:0/1190888972 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v39) v1 ==== 107+0+5116 (secure 0 0 0) 0x7f0e14058c50 con 0x7f0e20100e80 2024-09-13T03:05:20.569 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:20.569 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":29,"btime":"2024-09-13T03:01:58:827614+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:01:58.827612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi142.hplrrs","rank":0,"incarnation":25,"state":"up:active","state_seq":182,"addr":"172.21.15.142:6827/837388084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":837388084},{"type":"v1","addr":"172.21.15.142:6827","nonce":837388084}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-09-13T03:05:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0e0806e680 msgr2=0x7f0e08070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0e0806e680 0x7f0e08070b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005950 tx=0x7f0e1000b410 comp rx=0 tx=0).stop 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 msgr2=0x7f0e20073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 0x7f0e20073590 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400bd70 tx=0x7f0e1400bda0 comp rx=0 tx=0).stop 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 shutdown_connections 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f0e0806e680 0x7f0e08070b30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e201004e0 0x7f0e20073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 --2- 172.21.15.98:0/1190888972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e20100e80 0x7f0e20073590 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 >> 172.21.15.98:0/1190888972 conn(0x7f0e200fbda0 msgr2=0x7f0e200fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 shutdown_connections 2024-09-13T03:05:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:20.570+0000 7f0e25fdf700 1 -- 172.21.15.98:0/1190888972 wait complete. 2024-09-13T03:05:20.573 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 29 2024-09-13T03:05:21.147 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:20 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1190888972' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T03:05:21.169 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-13T03:05:21.169 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-13T03:05:21.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:20 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1190888972' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T03:05:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:21 smithi098 ceph-mon[87325]: pgmap v302: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:21 smithi142 ceph-mon[65447]: pgmap v302: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.003+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1018079633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a01004e0 msgr2=0x7f88a01008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.003+0000 7f88a4f3f700 1 --2- 172.21.15.98:0/1018079633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a01004e0 0x7f88a01008b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8888009910 tx=0x7f8888009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.003+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1018079633 shutdown_connections 2024-09-13T03:05:23.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.003+0000 7f88a4f3f700 1 --2- 172.21.15.98:0/1018079633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a0100e80 0x7f88a0104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.003+0000 7f88a4f3f700 1 --2- 172.21.15.98:0/1018079633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a01004e0 0x7f88a01008b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.003+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1018079633 >> 172.21.15.98:0/1018079633 conn(0x7f88a00fbda0 msgr2=0x7f88a00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.003+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1018079633 shutdown_connections 2024-09-13T03:05:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.003+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1018079633 wait complete. 2024-09-13T03:05:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f88a4f3f700 1 Processor -- start 2024-09-13T03:05:23.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f88a4f3f700 1 -- start start 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f88a4f3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a01004e0 0x7f88a0195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f88a4f3f700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a0100e80 0x7f88a0196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f88a4f3f700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0196b10 con 0x7f88a0100e80 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f88a4f3f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a019a8a0 con 0x7f88a01004e0 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f889dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a0100e80 0x7f88a0196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f889dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a0100e80 0x7f88a0196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59382/0 (socket says 172.21.15.98:59382) 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f889dd9b700 1 -- 172.21.15.98:0/1721224552 learned_addr learned my addr 172.21.15.98:0/1721224552 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.004+0000 7f889e59c700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a01004e0 0x7f88a0195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.005+0000 7f889dd9b700 1 -- 172.21.15.98:0/1721224552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a01004e0 msgr2=0x7f88a0195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.005+0000 7f889dd9b700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a01004e0 0x7f88a0195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:23.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.005+0000 7f889dd9b700 1 -- 172.21.15.98:0/1721224552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88880095f0 con 0x7f88a0100e80 2024-09-13T03:05:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.005+0000 7f889dd9b700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a0100e80 0x7f88a0196430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f889000d900 tx=0x7f889000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.005+0000 7f88977fe700 1 -- 172.21.15.98:0/1721224552 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8890009900 con 0x7f88a0100e80 2024-09-13T03:05:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.005+0000 7f88977fe700 1 -- 172.21.15.98:0/1721224552 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8890010460 con 0x7f88a0100e80 2024-09-13T03:05:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.005+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a019ab80 con 0x7f88a0100e80 2024-09-13T03:05:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.005+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a019b0d0 con 0x7f88a0100e80 2024-09-13T03:05:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.005+0000 7f88977fe700 1 -- 172.21.15.98:0/1721224552 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f889000f5f0 con 0x7f88a0100e80 2024-09-13T03:05:23.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.006+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8880005320 con 0x7f88a0100e80 2024-09-13T03:05:23.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.007+0000 7f88977fe700 1 -- 172.21.15.98:0/1721224552 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f889000f820 con 0x7f88a0100e80 2024-09-13T03:05:23.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.007+0000 7f88977fe700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f888c06e680 0x7f888c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:23.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.007+0000 7f88977fe700 1 -- 172.21.15.98:0/1721224552 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f889008e190 con 0x7f88a0100e80 2024-09-13T03:05:23.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.007+0000 7f889e59c700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f888c06e680 0x7f888c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:23.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.008+0000 7f889e59c700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f888c06e680 0x7f888c070b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8888006010 tx=0x7f888801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:23.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.012+0000 7f88977fe700 1 -- 172.21.15.98:0/1721224552 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f889005adc0 con 0x7f88a0100e80 2024-09-13T03:05:23.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.255+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f88800059f0 con 0x7f88a0100e80 2024-09-13T03:05:23.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.256+0000 7f88977fe700 1 -- 172.21.15.98:0/1721224552 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v39) v1 ==== 107+0+4315 (secure 0 0 0) 0x7f889005a950 con 0x7f88a0100e80 2024-09-13T03:05:23.257 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:23.257 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"btime":"2024-09-13T03:02:09:302471+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:09.302467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:23.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f888c06e680 msgr2=0x7f888c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f888c06e680 0x7f888c070b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8888006010 tx=0x7f888801a040 comp rx=0 tx=0).stop 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a0100e80 msgr2=0x7f88a0196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a0100e80 0x7f88a0196430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f889000d900 tx=0x7f889000dc10 comp rx=0 tx=0).stop 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 shutdown_connections 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f888c06e680 0x7f888c070b30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a01004e0 0x7f88a0195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 --2- 172.21.15.98:0/1721224552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88a0100e80 0x7f88a0196430 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 >> 172.21.15.98:0/1721224552 conn(0x7f88a00fbda0 msgr2=0x7f88a00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 shutdown_connections 2024-09-13T03:05:23.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:23.258+0000 7f88a4f3f700 1 -- 172.21.15.98:0/1721224552 wait complete. 2024-09-13T03:05:23.261 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2024-09-13T03:05:23.917 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-13T03:05:23.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-13T03:05:24.118 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:24.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:23 smithi098 ceph-mon[87325]: pgmap v303: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:24.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:23 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1721224552' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T03:05:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:23 smithi142 ceph-mon[65447]: pgmap v303: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:23 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1721224552' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.691+0000 7fe8fd20b700 1 -- 172.21.15.98:0/3636161269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 msgr2=0x7fe8f8104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.691+0000 7fe8fd20b700 1 --2- 172.21.15.98:0/3636161269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 0x7fe8f8104e30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009910 tx=0x7fe8ec009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.692+0000 7fe8fd20b700 1 -- 172.21.15.98:0/3636161269 shutdown_connections 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.692+0000 7fe8fd20b700 1 --2- 172.21.15.98:0/3636161269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 0x7fe8f8104e30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.692+0000 7fe8fd20b700 1 --2- 172.21.15.98:0/3636161269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f81004c0 0x7fe8f8100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.692+0000 7fe8fd20b700 1 -- 172.21.15.98:0/3636161269 >> 172.21.15.98:0/3636161269 conn(0x7fe8f80fbd80 msgr2=0x7fe8f80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.692+0000 7fe8fd20b700 1 -- 172.21.15.98:0/3636161269 shutdown_connections 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.692+0000 7fe8fd20b700 1 -- 172.21.15.98:0/3636161269 wait complete. 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.692+0000 7fe8fd20b700 1 Processor -- start 2024-09-13T03:05:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8fd20b700 1 -- start start 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8fd20b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f81004c0 0x7fe8f8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8fd20b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 0x7fe8f8196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8fd20b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8196a80 con 0x7fe8f8100e60 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8fd20b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8196bc0 con 0x7fe8f81004c0 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8f659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 0x7fe8f8196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8f659c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 0x7fe8f8196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51512/0 (socket says 172.21.15.98:51512) 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8f659c700 1 -- 172.21.15.98:0/4089211191 learned_addr learned my addr 172.21.15.98:0/4089211191 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8f6d9d700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f81004c0 0x7fe8f8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8f659c700 1 -- 172.21.15.98:0/4089211191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f81004c0 msgr2=0x7fe8f8195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8f659c700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f81004c0 0x7fe8f8195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8f659c700 1 -- 172.21.15.98:0/4089211191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec0095f0 con 0x7fe8f8100e60 2024-09-13T03:05:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.693+0000 7fe8f659c700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 0x7fe8f8196430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00bda0 tx=0x7fe8ec00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.694+0000 7fe8dffff700 1 -- 172.21.15.98:0/4089211191 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8ec01d070 con 0x7fe8f8100e60 2024-09-13T03:05:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.694+0000 7fe8dffff700 1 -- 172.21.15.98:0/4089211191 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8ec00f460 con 0x7fe8f8100e60 2024-09-13T03:05:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.694+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f819a9b0 con 0x7fe8f8100e60 2024-09-13T03:05:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.694+0000 7fe8dffff700 1 -- 172.21.15.98:0/4089211191 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8ec017630 con 0x7fe8f8100e60 2024-09-13T03:05:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.694+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f819aea0 con 0x7fe8f8100e60 2024-09-13T03:05:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.695+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f804f2a0 con 0x7fe8f8100e60 2024-09-13T03:05:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.695+0000 7fe8dffff700 1 -- 172.21.15.98:0/4089211191 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe8ec00fab0 con 0x7fe8f8100e60 2024-09-13T03:05:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.696+0000 7fe8dffff700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe8e006e680 0x7fe8e0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.696+0000 7fe8dffff700 1 -- 172.21.15.98:0/4089211191 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fe8ec08fc40 con 0x7fe8f8100e60 2024-09-13T03:05:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.696+0000 7fe8f6d9d700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe8e006e680 0x7fe8e0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.696+0000 7fe8f6d9d700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe8e006e680 0x7fe8e0070b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800ac50 tx=0x7fe8e800a380 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:25.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.700+0000 7fe8dffff700 1 -- 172.21.15.98:0/4089211191 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe8ec058cc0 con 0x7fe8f8100e60 2024-09-13T03:05:25.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.945+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fe8f8197250 con 0x7fe8f8100e60 2024-09-13T03:05:25.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.945+0000 7fe8dffff700 1 -- 172.21.15.98:0/4089211191 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v39) v1 ==== 107+0+4394 (secure 0 0 0) 0x7fe8ec05c380 con 0x7fe8f8100e60 2024-09-13T03:05:25.947 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:25.947 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":31,"btime":"2024-09-13T03:02:09:307814+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:09.307801+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:25.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.947+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe8e006e680 msgr2=0x7fe8e0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:25.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.947+0000 7fe8fd20b700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe8e006e680 0x7fe8e0070b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800ac50 tx=0x7fe8e800a380 comp rx=0 tx=0).stop 2024-09-13T03:05:25.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.947+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 msgr2=0x7fe8f8196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:25.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.947+0000 7fe8fd20b700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 0x7fe8f8196430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00bda0 tx=0x7fe8ec00bdd0 comp rx=0 tx=0).stop 2024-09-13T03:05:25.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.948+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 shutdown_connections 2024-09-13T03:05:25.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.948+0000 7fe8fd20b700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fe8e006e680 0x7fe8e0070b30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:25.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.948+0000 7fe8fd20b700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f81004c0 0x7fe8f8195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:25.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.948+0000 7fe8fd20b700 1 --2- 172.21.15.98:0/4089211191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f8100e60 0x7fe8f8196430 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:25.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.948+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 >> 172.21.15.98:0/4089211191 conn(0x7fe8f80fbd80 msgr2=0x7fe8f80fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:25.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.948+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 shutdown_connections 2024-09-13T03:05:25.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:25.948+0000 7fe8fd20b700 1 -- 172.21.15.98:0/4089211191 wait complete. 2024-09-13T03:05:25.950 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 31 2024-09-13T03:05:26.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:25 smithi098 ceph-mon[87325]: pgmap v304: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:25 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/4089211191' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T03:05:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:25 smithi142 ceph-mon[65447]: pgmap v304: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:25 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/4089211191' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T03:05:26.542 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-13T03:05:26.543 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-13T03:05:26.742 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:28.224 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:27 smithi098 ceph-mon[87325]: pgmap v305: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:28.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:27 smithi142 ceph-mon[65447]: pgmap v305: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:28.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.328+0000 7fae66edf700 1 -- 172.21.15.98:0/2525069720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 msgr2=0x7fae60100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:28.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.328+0000 7fae66edf700 1 --2- 172.21.15.98:0/2525069720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 0x7fae60100040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009910 tx=0x7fae4c009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:28.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.328+0000 7fae66edf700 1 -- 172.21.15.98:0/2525069720 shutdown_connections 2024-09-13T03:05:28.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.328+0000 7fae66edf700 1 --2- 172.21.15.98:0/2525069720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 0x7fae60100040 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:28.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.328+0000 7fae66edf700 1 --2- 172.21.15.98:0/2525069720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae60104130 0x7fae60104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:28.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.328+0000 7fae66edf700 1 -- 172.21.15.98:0/2525069720 >> 172.21.15.98:0/2525069720 conn(0x7fae60075130 msgr2=0x7fae60075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.328+0000 7fae66edf700 1 -- 172.21.15.98:0/2525069720 shutdown_connections 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.328+0000 7fae66edf700 1 -- 172.21.15.98:0/2525069720 wait complete. 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae66edf700 1 Processor -- start 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae66edf700 1 -- start start 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae66edf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 0x7fae60196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae66edf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae60104130 0x7fae60197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae66edf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae60197860 con 0x7fae600ffbd0 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae66edf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae601979a0 con 0x7fae60104130 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae64c7b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 0x7fae60196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae64c7b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 0x7fae60196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51528/0 (socket says 172.21.15.98:51528) 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae64c7b700 1 -- 172.21.15.98:0/3939154378 learned_addr learned my addr 172.21.15.98:0/3939154378 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:28.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae5ffff700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae60104130 0x7fae60197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae64c7b700 1 -- 172.21.15.98:0/3939154378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae60104130 msgr2=0x7fae60197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae64c7b700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae60104130 0x7fae60197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae64c7b700 1 -- 172.21.15.98:0/3939154378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0095f0 con 0x7fae600ffbd0 2024-09-13T03:05:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.329+0000 7fae5ffff700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae60104130 0x7fae60197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:05:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.330+0000 7fae64c7b700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 0x7fae60196c40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c8a0 tx=0x7fae5400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.330+0000 7fae5dffb700 1 -- 172.21.15.98:0/3939154378 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5400cea0 con 0x7fae600ffbd0 2024-09-13T03:05:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.330+0000 7fae5dffb700 1 -- 172.21.15.98:0/3939154378 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae54004830 con 0x7fae600ffbd0 2024-09-13T03:05:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.330+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6019fcb0 con 0x7fae600ffbd0 2024-09-13T03:05:28.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.330+0000 7fae5dffb700 1 -- 172.21.15.98:0/3939154378 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae540055b0 con 0x7fae600ffbd0 2024-09-13T03:05:28.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.330+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae601a01d0 con 0x7fae600ffbd0 2024-09-13T03:05:28.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.331+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6004f2a0 con 0x7fae600ffbd0 2024-09-13T03:05:28.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.332+0000 7fae5dffb700 1 -- 172.21.15.98:0/3939154378 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fae540049a0 con 0x7fae600ffbd0 2024-09-13T03:05:28.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.332+0000 7fae5dffb700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae5006e680 0x7fae50070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:28.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.333+0000 7fae5dffb700 1 -- 172.21.15.98:0/3939154378 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fae5408e340 con 0x7fae600ffbd0 2024-09-13T03:05:28.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.333+0000 7fae5ffff700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae5006e680 0x7fae50070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:28.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.333+0000 7fae5ffff700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae5006e680 0x7fae50070b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae4c005100 tx=0x7fae4c01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:28.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.337+0000 7fae5dffb700 1 -- 172.21.15.98:0/3939154378 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fae54057440 con 0x7fae600ffbd0 2024-09-13T03:05:28.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.598+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fae60068b90 con 0x7fae600ffbd0 2024-09-13T03:05:28.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.598+0000 7fae5dffb700 1 -- 172.21.15.98:0/3939154378 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v39) v1 ==== 107+0+4398 (secure 0 0 0) 0x7fae54004c50 con 0x7fae600ffbd0 2024-09-13T03:05:28.600 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:28.600 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":32,"btime":"2024-09-13T03:02:17:869609+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:17.159954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae5006e680 msgr2=0x7fae50070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae5006e680 0x7fae50070b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae4c005100 tx=0x7fae4c01a040 comp rx=0 tx=0).stop 2024-09-13T03:05:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 msgr2=0x7fae60196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 0x7fae60196c40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c8a0 tx=0x7fae5400cc60 comp rx=0 tx=0).stop 2024-09-13T03:05:28.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 shutdown_connections 2024-09-13T03:05:28.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fae5006e680 0x7fae50070b30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:28.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae600ffbd0 0x7fae60196c40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:28.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 --2- 172.21.15.98:0/3939154378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae60104130 0x7fae60197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:28.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 >> 172.21.15.98:0/3939154378 conn(0x7fae60075130 msgr2=0x7fae600feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:28.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 shutdown_connections 2024-09-13T03:05:28.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:28.601+0000 7fae66edf700 1 -- 172.21.15.98:0/3939154378 wait complete. 2024-09-13T03:05:28.603 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 32 2024-09-13T03:05:29.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:28 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3939154378' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T03:05:29.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:28 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3939154378' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T03:05:29.259 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-13T03:05:29.260 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-13T03:05:29.464 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:30.185 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:29 smithi098 ceph-mon[87325]: pgmap v306: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:30.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:29 smithi142 ceph-mon[65447]: pgmap v306: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 -- 172.21.15.98:0/110297796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 msgr2=0x7f9ee410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 --2- 172.21.15.98:0/110297796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 0x7f9ee410a6d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009910 tx=0x7f9ed4009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 -- 172.21.15.98:0/110297796 shutdown_connections 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 --2- 172.21.15.98:0/110297796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 0x7f9ee410a6d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 --2- 172.21.15.98:0/110297796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee40ff350 0x7f9ee40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 -- 172.21.15.98:0/110297796 >> 172.21.15.98:0/110297796 conn(0x7f9ee40748b0 msgr2=0x7f9ee4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 -- 172.21.15.98:0/110297796 shutdown_connections 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 -- 172.21.15.98:0/110297796 wait complete. 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 Processor -- start 2024-09-13T03:05:31.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.042+0000 7f9eeb27e700 1 -- start start 2024-09-13T03:05:31.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9eeb27e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee40ff350 0x7f9ee4195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:31.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9eeb27e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 0x7f9ee41963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:31.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9eeb27e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee4196ac0 con 0x7f9ee40ffc60 2024-09-13T03:05:31.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9eeb27e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee419a850 con 0x7f9ee40ff350 2024-09-13T03:05:31.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9ee8819700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 0x7f9ee41963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:31.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9ee8819700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 0x7f9ee41963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51560/0 (socket says 172.21.15.98:51560) 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9ee8819700 1 -- 172.21.15.98:0/2374059371 learned_addr learned my addr 172.21.15.98:0/2374059371 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9ee901a700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee40ff350 0x7f9ee4195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9ee8819700 1 -- 172.21.15.98:0/2374059371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee40ff350 msgr2=0x7f9ee4195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9ee8819700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee40ff350 0x7f9ee4195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9ee8819700 1 -- 172.21.15.98:0/2374059371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40095f0 con 0x7f9ee40ffc60 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9ee8819700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 0x7f9ee41963e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40092e0 tx=0x7f9ed40056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9eda7fc700 1 -- 172.21.15.98:0/2374059371 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ed401d070 con 0x7f9ee40ffc60 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9eda7fc700 1 -- 172.21.15.98:0/2374059371 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ed400f460 con 0x7f9ee40ffc60 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.043+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee419ab30 con 0x7f9ee40ffc60 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.044+0000 7f9eda7fc700 1 -- 172.21.15.98:0/2374059371 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ed4021640 con 0x7f9ee40ffc60 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.044+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee419b080 con 0x7f9ee40ffc60 2024-09-13T03:05:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.044+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee4107dd0 con 0x7f9ee40ffc60 2024-09-13T03:05:31.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.045+0000 7f9eda7fc700 1 -- 172.21.15.98:0/2374059371 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9ed400f5d0 con 0x7f9ee40ffc60 2024-09-13T03:05:31.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.045+0000 7f9eda7fc700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f9ed006e680 0x7f9ed0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:31.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.046+0000 7f9eda7fc700 1 -- 172.21.15.98:0/2374059371 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f9ed408fa40 con 0x7f9ee40ffc60 2024-09-13T03:05:31.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.046+0000 7f9ee901a700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f9ed006e680 0x7f9ed0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:31.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.046+0000 7f9ee901a700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f9ed006e680 0x7f9ed0070b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0005950 tx=0x7f9ee00058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:31.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.050+0000 7f9eda7fc700 1 -- 172.21.15.98:0/2374059371 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9ed4058ac0 con 0x7f9ee40ffc60 2024-09-13T03:05:31.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.292+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f9ee404f2a0 con 0x7f9ee40ffc60 2024-09-13T03:05:31.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.292+0000 7f9eda7fc700 1 -- 172.21.15.98:0/2374059371 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v39) v1 ==== 107+0+4395 (secure 0 0 0) 0x7f9ed405c180 con 0x7f9ee40ffc60 2024-09-13T03:05:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:31.294 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":33,"btime":"2024-09-13T03:02:18:870851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:17.874506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":18,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f9ed006e680 msgr2=0x7f9ed0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f9ed006e680 0x7f9ed0070b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0005950 tx=0x7f9ee00058e0 comp rx=0 tx=0).stop 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 msgr2=0x7f9ee41963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 0x7f9ee41963e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40092e0 tx=0x7f9ed40056a0 comp rx=0 tx=0).stop 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 shutdown_connections 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f9ed006e680 0x7f9ed0070b30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee40ff350 0x7f9ee4195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 --2- 172.21.15.98:0/2374059371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ee40ffc60 0x7f9ee41963e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 >> 172.21.15.98:0/2374059371 conn(0x7f9ee40748b0 msgr2=0x7f9ee4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:31.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 shutdown_connections 2024-09-13T03:05:31.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:31.295+0000 7f9eeb27e700 1 -- 172.21.15.98:0/2374059371 wait complete. 2024-09-13T03:05:31.298 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 33 2024-09-13T03:05:31.892 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-13T03:05:31.893 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-13T03:05:32.096 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:32.217 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:31 smithi098 ceph-mon[87325]: pgmap v307: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:32.217 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:31 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2374059371' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T03:05:32.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:31 smithi142 ceph-mon[65447]: pgmap v307: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:32.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:31 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2374059371' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T03:05:33.169 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:33 smithi098 ceph-mon[87325]: pgmap v308: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:33.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:33 smithi142 ceph-mon[65447]: pgmap v308: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:33.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 -- 172.21.15.98:0/217120853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ff3c0 msgr2=0x7f2b380ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 --2- 172.21.15.98:0/217120853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ff3c0 0x7f2b380ff790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009910 tx=0x7f2b34009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 -- 172.21.15.98:0/217120853 shutdown_connections 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 --2- 172.21.15.98:0/217120853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b380ffd60 0x7f2b38103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 --2- 172.21.15.98:0/217120853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ff3c0 0x7f2b380ff790 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 -- 172.21.15.98:0/217120853 >> 172.21.15.98:0/217120853 conn(0x7f2b380fac80 msgr2=0x7f2b380fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 -- 172.21.15.98:0/217120853 shutdown_connections 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 -- 172.21.15.98:0/217120853 wait complete. 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 Processor -- start 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.725+0000 7f2b3f32a700 1 -- start start 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3f32a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b380ff3c0 0x7f2b38194e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3f32a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ffd60 0x7f2b38195380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:33.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3f32a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38195a60 con 0x7f2b380ffd60 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3f32a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b381997f0 con 0x7f2b380ff3c0 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3c8c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ffd60 0x7f2b38195380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3c8c5700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ffd60 0x7f2b38195380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51582/0 (socket says 172.21.15.98:51582) 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3c8c5700 1 -- 172.21.15.98:0/1186900296 learned_addr learned my addr 172.21.15.98:0/1186900296 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3d0c6700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b380ff3c0 0x7f2b38194e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3c8c5700 1 -- 172.21.15.98:0/1186900296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b380ff3c0 msgr2=0x7f2b38194e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3c8c5700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b380ff3c0 0x7f2b38194e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3c8c5700 1 -- 172.21.15.98:0/1186900296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340095f0 con 0x7f2b380ffd60 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3c8c5700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ffd60 0x7f2b38195380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2b28007b50 tx=0x7f2b28007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b2e7fc700 1 -- 172.21.15.98:0/1186900296 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b28011070 con 0x7f2b380ffd60 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b2e7fc700 1 -- 172.21.15.98:0/1186900296 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b2800c2e0 con 0x7f2b380ffd60 2024-09-13T03:05:33.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b38199a70 con 0x7f2b380ffd60 2024-09-13T03:05:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.726+0000 7f2b2e7fc700 1 -- 172.21.15.98:0/1186900296 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2800e810 con 0x7f2b380ffd60 2024-09-13T03:05:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.727+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b38199fc0 con 0x7f2b380ffd60 2024-09-13T03:05:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.728+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3804f2a0 con 0x7f2b380ffd60 2024-09-13T03:05:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.728+0000 7f2b2e7fc700 1 -- 172.21.15.98:0/1186900296 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2b2800ea80 con 0x7f2b380ffd60 2024-09-13T03:05:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.728+0000 7f2b2e7fc700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2b2406e680 0x7f2b24070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.728+0000 7f2b2e7fc700 1 -- 172.21.15.98:0/1186900296 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f2b2808fe40 con 0x7f2b380ffd60 2024-09-13T03:05:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.728+0000 7f2b3d0c6700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2b2406e680 0x7f2b24070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.729+0000 7f2b3d0c6700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2b2406e680 0x7f2b24070b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400b5c0 tx=0x7f2b3401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:33.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.733+0000 7f2b2e7fc700 1 -- 172.21.15.98:0/1186900296 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2b28058ec0 con 0x7f2b380ffd60 2024-09-13T03:05:33.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.997+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f2b3819a280 con 0x7f2b380ffd60 2024-09-13T03:05:33.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:33.998+0000 7f2b2e7fc700 1 -- 172.21.15.98:0/1186900296 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v39) v1 ==== 107+0+4404 (secure 0 0 0) 0x7f2b2805c580 con 0x7f2b380ffd60 2024-09-13T03:05:33.999 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:34.000 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":34,"btime":"2024-09-13T03:02:19:876539+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:19.876536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":31,"state":"up:active","state_seq":19,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-13T03:05:34.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2b2406e680 msgr2=0x7f2b24070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2b2406e680 0x7f2b24070b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400b5c0 tx=0x7f2b3401a040 comp rx=0 tx=0).stop 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ffd60 msgr2=0x7f2b38195380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ffd60 0x7f2b38195380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2b28007b50 tx=0x7f2b28007f10 comp rx=0 tx=0).stop 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 shutdown_connections 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f2b2406e680 0x7f2b24070b30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b380ff3c0 0x7f2b38194e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 --2- 172.21.15.98:0/1186900296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b380ffd60 0x7f2b38195380 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 >> 172.21.15.98:0/1186900296 conn(0x7f2b380fac80 msgr2=0x7f2b380fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 shutdown_connections 2024-09-13T03:05:34.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:34.000+0000 7f2b3f32a700 1 -- 172.21.15.98:0/1186900296 wait complete. 2024-09-13T03:05:34.003 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 34 2024-09-13T03:05:34.361 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:34 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:34.362 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:34 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/1186900296' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T03:05:34.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:34 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:34.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:34 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/1186900296' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T03:05:34.625 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-13T03:05:34.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-13T03:05:34.829 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:35.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:35 smithi098 ceph-mon[87325]: pgmap v309: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:35.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:35 smithi142 ceph-mon[65447]: pgmap v309: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:36.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.441+0000 7efc699f2700 1 -- 172.21.15.98:0/1343332626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 msgr2=0x7efc64068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:36.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.441+0000 7efc699f2700 1 --2- 172.21.15.98:0/1343332626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 0x7efc64068b70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efc54009910 tx=0x7efc54009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:36.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.441+0000 7efc699f2700 1 -- 172.21.15.98:0/1343332626 shutdown_connections 2024-09-13T03:05:36.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.441+0000 7efc699f2700 1 --2- 172.21.15.98:0/1343332626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc64069140 0x7efc64104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:36.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.441+0000 7efc699f2700 1 --2- 172.21.15.98:0/1343332626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 0x7efc64068b70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:36.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.441+0000 7efc699f2700 1 -- 172.21.15.98:0/1343332626 >> 172.21.15.98:0/1343332626 conn(0x7efc64075130 msgr2=0x7efc64075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:36.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.441+0000 7efc699f2700 1 -- 172.21.15.98:0/1343332626 shutdown_connections 2024-09-13T03:05:36.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.441+0000 7efc699f2700 1 -- 172.21.15.98:0/1343332626 wait complete. 2024-09-13T03:05:36.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.441+0000 7efc699f2700 1 Processor -- start 2024-09-13T03:05:36.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc699f2700 1 -- start start 2024-09-13T03:05:36.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc699f2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 0x7efc64195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:36.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc699f2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc64069140 0x7efc64196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:36.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc699f2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc64196b00 con 0x7efc640687a0 2024-09-13T03:05:36.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc699f2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6419a890 con 0x7efc64069140 2024-09-13T03:05:36.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc62ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 0x7efc64195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc62ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 0x7efc64195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34658/0 (socket says 172.21.15.98:34658) 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc62ffd700 1 -- 172.21.15.98:0/322548055 learned_addr learned my addr 172.21.15.98:0/322548055 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc5a7fc700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc64069140 0x7efc64196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc62ffd700 1 -- 172.21.15.98:0/322548055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc64069140 msgr2=0x7efc64196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc62ffd700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc64069140 0x7efc64196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc62ffd700 1 -- 172.21.15.98:0/322548055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540095f0 con 0x7efc640687a0 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.442+0000 7efc5a7fc700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc64069140 0x7efc64196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.443+0000 7efc62ffd700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 0x7efc64195ee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efc54006010 tx=0x7efc5400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.443+0000 7efc689f0700 1 -- 172.21.15.98:0/322548055 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc5401d070 con 0x7efc640687a0 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.443+0000 7efc689f0700 1 -- 172.21.15.98:0/322548055 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc54004fb0 con 0x7efc640687a0 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.443+0000 7efc689f0700 1 -- 172.21.15.98:0/322548055 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc54022ea0 con 0x7efc640687a0 2024-09-13T03:05:36.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.443+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6419ab10 con 0x7efc640687a0 2024-09-13T03:05:36.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.443+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6419b000 con 0x7efc640687a0 2024-09-13T03:05:36.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.444+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc64108790 con 0x7efc640687a0 2024-09-13T03:05:36.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.444+0000 7efc689f0700 1 -- 172.21.15.98:0/322548055 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efc54022470 con 0x7efc640687a0 2024-09-13T03:05:36.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.445+0000 7efc689f0700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efc5006e680 0x7efc50070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:36.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.445+0000 7efc689f0700 1 -- 172.21.15.98:0/322548055 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7efc5408fd10 con 0x7efc640687a0 2024-09-13T03:05:36.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.445+0000 7efc5a7fc700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efc5006e680 0x7efc50070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:36.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.445+0000 7efc5a7fc700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efc5006e680 0x7efc50070b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efc4c005fd0 tx=0x7efc4c005dc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:36.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.449+0000 7efc689f0700 1 -- 172.21.15.98:0/322548055 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efc54058e40 con 0x7efc640687a0 2024-09-13T03:05:36.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.694+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7efc64108170 con 0x7efc640687a0 2024-09-13T03:05:36.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.694+0000 7efc689f0700 1 -- 172.21.15.98:0/322548055 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v39) v1 ==== 107+0+5254 (secure 0 0 0) 0x7efc54027090 con 0x7efc640687a0 2024-09-13T03:05:36.696 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:36.696 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":35,"btime":"2024-09-13T03:02:20:882599+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44339,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/3076033085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3076033085},{"type":"v1","addr":"172.21.15.142:6827","nonce":3076033085}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:19.876536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":31,"state":"up:active","state_seq":19,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-13T03:05:36.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.696+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efc5006e680 msgr2=0x7efc50070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:36.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.696+0000 7efc699f2700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efc5006e680 0x7efc50070b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efc4c005fd0 tx=0x7efc4c005dc0 comp rx=0 tx=0).stop 2024-09-13T03:05:36.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.697+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 msgr2=0x7efc64195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:36.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.697+0000 7efc699f2700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 0x7efc64195ee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efc54006010 tx=0x7efc5400be20 comp rx=0 tx=0).stop 2024-09-13T03:05:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.697+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 shutdown_connections 2024-09-13T03:05:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.697+0000 7efc699f2700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7efc5006e680 0x7efc50070b30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.697+0000 7efc699f2700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc640687a0 0x7efc64195ee0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.697+0000 7efc699f2700 1 --2- 172.21.15.98:0/322548055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc64069140 0x7efc64196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.697+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 >> 172.21.15.98:0/322548055 conn(0x7efc64075130 msgr2=0x7efc640fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.697+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 shutdown_connections 2024-09-13T03:05:36.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:36.697+0000 7efc699f2700 1 -- 172.21.15.98:0/322548055 wait complete. 2024-09-13T03:05:36.700 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 35 2024-09-13T03:05:36.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:36 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/322548055' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T03:05:37.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:36 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/322548055' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T03:05:37.578 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-13T03:05:37.578 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-13T03:05:37.783 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:37.904 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:37 smithi098 ceph-mon[87325]: pgmap v310: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:38.088 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:37 smithi142 ceph-mon[65447]: pgmap v310: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:39.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.372+0000 7f410d2c6700 1 -- 172.21.15.98:0/2860452137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100d70 msgr2=0x7f41081094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:39.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.372+0000 7f410d2c6700 1 --2- 172.21.15.98:0/2860452137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100d70 0x7f41081094d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009940 tx=0x7f40fc009c50 comp rx=0 tx=0).stop 2024-09-13T03:05:39.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.372+0000 7f410d2c6700 1 -- 172.21.15.98:0/2860452137 shutdown_connections 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.372+0000 7f410d2c6700 1 --2- 172.21.15.98:0/2860452137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100d70 0x7f41081094d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.372+0000 7f410d2c6700 1 --2- 172.21.15.98:0/2860452137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4108100460 0x7f4108100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.372+0000 7f410d2c6700 1 -- 172.21.15.98:0/2860452137 >> 172.21.15.98:0/2860452137 conn(0x7f41080748b0 msgr2=0x7f4108074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.372+0000 7f410d2c6700 1 -- 172.21.15.98:0/2860452137 shutdown_connections 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.372+0000 7f410d2c6700 1 -- 172.21.15.98:0/2860452137 wait complete. 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.372+0000 7f410d2c6700 1 Processor -- start 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f410d2c6700 1 -- start start 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f410d2c6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100460 0x7f410819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f410d2c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4108100d70 0x7f410819af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f410d2c6700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410819b530 con 0x7f4108100460 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f410d2c6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108194a70 con 0x7f4108100d70 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f4106ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100460 0x7f410819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:39.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f4106ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100460 0x7f410819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34678/0 (socket says 172.21.15.98:34678) 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f4106ffd700 1 -- 172.21.15.98:0/3680124097 learned_addr learned my addr 172.21.15.98:0/3680124097 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f41067fc700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4108100d70 0x7f410819af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f4106ffd700 1 -- 172.21.15.98:0/3680124097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4108100d70 msgr2=0x7f410819af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f4106ffd700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4108100d70 0x7f410819af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f4106ffd700 1 -- 172.21.15.98:0/3680124097 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc0095f0 con 0x7f4108100460 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.373+0000 7f41067fc700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4108100d70 0x7f410819af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.374+0000 7f4106ffd700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100460 0x7f410819a9f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f40f800c930 tx=0x7f40f800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.374+0000 7f40effff700 1 -- 172.21.15.98:0/3680124097 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f8007ad0 con 0x7f4108100460 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.374+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4108194d50 con 0x7f4108100460 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.374+0000 7f40effff700 1 -- 172.21.15.98:0/3680124097 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40f8007c30 con 0x7f4108100460 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.374+0000 7f40effff700 1 -- 172.21.15.98:0/3680124097 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f8018610 con 0x7f4108100460 2024-09-13T03:05:39.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.374+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41081952a0 con 0x7f4108100460 2024-09-13T03:05:39.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.375+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4108106bd0 con 0x7f4108100460 2024-09-13T03:05:39.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.376+0000 7f40effff700 1 -- 172.21.15.98:0/3680124097 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f40f800f450 con 0x7f4108100460 2024-09-13T03:05:39.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.376+0000 7f40effff700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f40f006e680 0x7f40f0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:39.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.376+0000 7f40effff700 1 -- 172.21.15.98:0/3680124097 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f40f808e8b0 con 0x7f4108100460 2024-09-13T03:05:39.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.376+0000 7f41067fc700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f40f006e680 0x7f40f0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:39.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.377+0000 7f41067fc700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f40f006e680 0x7f40f0070b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41080fde30 tx=0x7f40fc005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:39.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.381+0000 7f40effff700 1 -- 172.21.15.98:0/3680124097 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f40f805b4e0 con 0x7f4108100460 2024-09-13T03:05:39.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.626+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f410804f2a0 con 0x7f4108100460 2024-09-13T03:05:39.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.627+0000 7f40effff700 1 -- 172.21.15.98:0/3680124097 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v39) v1 ==== 107+0+5254 (secure 0 0 0) 0x7f40f805b070 con 0x7f4108100460 2024-09-13T03:05:39.628 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:39.628 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":36,"btime":"2024-09-13T03:02:28:574234+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44339,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/3076033085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3076033085},{"type":"v1","addr":"172.21.15.142:6827","nonce":3076033085}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:27.577199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":31,"state":"up:active","state_seq":19,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-13T03:05:39.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f40f006e680 msgr2=0x7f40f0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f40f006e680 0x7f40f0070b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41080fde30 tx=0x7f40fc005fd0 comp rx=0 tx=0).stop 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100460 msgr2=0x7f410819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100460 0x7f410819a9f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f40f800c930 tx=0x7f40f800ccf0 comp rx=0 tx=0).stop 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 shutdown_connections 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f40f006e680 0x7f40f0070b30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4108100460 0x7f410819a9f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 --2- 172.21.15.98:0/3680124097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4108100d70 0x7f410819af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 >> 172.21.15.98:0/3680124097 conn(0x7f41080748b0 msgr2=0x7f4108103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 shutdown_connections 2024-09-13T03:05:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:39.629+0000 7f410d2c6700 1 -- 172.21.15.98:0/3680124097 wait complete. 2024-09-13T03:05:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 36 2024-09-13T03:05:39.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:39 smithi098 ceph-mon[87325]: pgmap v311: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:39.951 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:39 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/3680124097' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T03:05:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:39 smithi142 ceph-mon[65447]: pgmap v311: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:40.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:39 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/3680124097' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T03:05:40.274 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-13T03:05:40.274 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-13T03:05:40.475 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:42.104 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:41 smithi098 ceph-mon[87325]: pgmap v312: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:42.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.129+0000 7f52dbe9a700 1 -- 172.21.15.98:0/4068495405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d41004e0 msgr2=0x7f52d41008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:42.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.129+0000 7f52dbe9a700 1 --2- 172.21.15.98:0/4068495405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d41004e0 0x7f52d41008b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009910 tx=0x7f52c4009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:42.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.129+0000 7f52dbe9a700 1 -- 172.21.15.98:0/4068495405 shutdown_connections 2024-09-13T03:05:42.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.129+0000 7f52dbe9a700 1 --2- 172.21.15.98:0/4068495405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d4100e80 0x7f52d4104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:42.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.129+0000 7f52dbe9a700 1 --2- 172.21.15.98:0/4068495405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d41004e0 0x7f52d41008b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:42.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.129+0000 7f52dbe9a700 1 -- 172.21.15.98:0/4068495405 >> 172.21.15.98:0/4068495405 conn(0x7f52d40fbda0 msgr2=0x7f52d40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:42.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.130+0000 7f52dbe9a700 1 -- 172.21.15.98:0/4068495405 shutdown_connections 2024-09-13T03:05:42.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.130+0000 7f52dbe9a700 1 -- 172.21.15.98:0/4068495405 wait complete. 2024-09-13T03:05:42.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.130+0000 7f52dbe9a700 1 Processor -- start 2024-09-13T03:05:42.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.130+0000 7f52dbe9a700 1 -- start start 2024-09-13T03:05:42.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.130+0000 7f52dbe9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d41004e0 0x7f52d4195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.130+0000 7f52dbe9a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d4100e80 0x7f52d41964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.130+0000 7f52dbe9a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4196bb0 con 0x7f52d4100e80 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.130+0000 7f52dbe9a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d419a940 con 0x7f52d41004e0 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52d9435700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d4100e80 0x7f52d41964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52d9435700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d4100e80 0x7f52d41964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34696/0 (socket says 172.21.15.98:34696) 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52d9435700 1 -- 172.21.15.98:0/546216864 learned_addr learned my addr 172.21.15.98:0/546216864 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52d9c36700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d41004e0 0x7f52d4195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52d9435700 1 -- 172.21.15.98:0/546216864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d41004e0 msgr2=0x7f52d4195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52d9435700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d41004e0 0x7f52d4195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:42.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52d9435700 1 -- 172.21.15.98:0/546216864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40095f0 con 0x7f52d4100e80 2024-09-13T03:05:42.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52d9c36700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d41004e0 0x7f52d4195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:05:42.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52d9435700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d4100e80 0x7f52d41964d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f52d000b480 tx=0x7f52d000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:42.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52caffd700 1 -- 172.21.15.98:0/546216864 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d00118c0 con 0x7f52d4100e80 2024-09-13T03:05:42.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52caffd700 1 -- 172.21.15.98:0/546216864 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52d0010380 con 0x7f52d4100e80 2024-09-13T03:05:42.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d419ac20 con 0x7f52d4100e80 2024-09-13T03:05:42.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52caffd700 1 -- 172.21.15.98:0/546216864 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d000f4f0 con 0x7f52d4100e80 2024-09-13T03:05:42.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.131+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d419b170 con 0x7f52d4100e80 2024-09-13T03:05:42.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.132+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d41087f0 con 0x7f52d4100e80 2024-09-13T03:05:42.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.133+0000 7f52caffd700 1 -- 172.21.15.98:0/546216864 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f52d00104f0 con 0x7f52d4100e80 2024-09-13T03:05:42.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.133+0000 7f52caffd700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f52c006e680 0x7f52c0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:42.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.133+0000 7f52caffd700 1 -- 172.21.15.98:0/546216864 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f52d008e320 con 0x7f52d4100e80 2024-09-13T03:05:42.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.133+0000 7f52d9c36700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f52c006e680 0x7f52c0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:42.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.134+0000 7f52d9c36700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f52c006e680 0x7f52c0070b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52c40059d0 tx=0x7f52c401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:42.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.137+0000 7f52caffd700 1 -- 172.21.15.98:0/546216864 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f52d0057420 con 0x7f52d4100e80 2024-09-13T03:05:42.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:41 smithi142 ceph-mon[65447]: pgmap v312: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:42.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.381+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f52d419b440 con 0x7f52d4100e80 2024-09-13T03:05:42.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.382+0000 7f52caffd700 1 -- 172.21.15.98:0/546216864 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v39) v1 ==== 107+0+5253 (secure 0 0 0) 0x7f52d005aae0 con 0x7f52d4100e80 2024-09-13T03:05:42.384 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:42.384 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":37,"btime":"2024-09-13T03:02:29:576119+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44339,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/3076033085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3076033085},{"type":"v1","addr":"172.21.15.142:6827","nonce":3076033085}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:28.579755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":31,"state":"up:active","state_seq":19,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-13T03:05:42.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.384+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f52c006e680 msgr2=0x7f52c0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:42.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.384+0000 7f52dbe9a700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f52c006e680 0x7f52c0070b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52c40059d0 tx=0x7f52c401a040 comp rx=0 tx=0).stop 2024-09-13T03:05:42.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.384+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d4100e80 msgr2=0x7f52d41964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:42.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.384+0000 7f52dbe9a700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d4100e80 0x7f52d41964d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f52d000b480 tx=0x7f52d000b840 comp rx=0 tx=0).stop 2024-09-13T03:05:42.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.384+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 shutdown_connections 2024-09-13T03:05:42.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.384+0000 7f52dbe9a700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f52c006e680 0x7f52c0070b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:42.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.384+0000 7f52dbe9a700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d41004e0 0x7f52d4195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:42.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.384+0000 7f52dbe9a700 1 --2- 172.21.15.98:0/546216864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52d4100e80 0x7f52d41964d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:42.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.384+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 >> 172.21.15.98:0/546216864 conn(0x7f52d40fbda0 msgr2=0x7f52d40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:42.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.385+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 shutdown_connections 2024-09-13T03:05:42.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:42.385+0000 7f52dbe9a700 1 -- 172.21.15.98:0/546216864 wait complete. 2024-09-13T03:05:42.387 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 37 2024-09-13T03:05:42.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:42 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/546216864' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T03:05:43.015 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-13T03:05:43.166 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:42 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/546216864' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T03:05:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:43.973 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:43 smithi098 ceph-mon[87325]: pgmap v313: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:43 smithi142 ceph-mon[65447]: pgmap v313: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:44.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.815+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/3756630799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100ed0 msgr2=0x7f4f98104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.815+0000 7f4f9ee0a700 1 --2- 172.21.15.98:0/3756630799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100ed0 0x7f4f98104ea0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b0a0 tx=0x7f4f8800b3b0 comp rx=0 tx=0).stop 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.815+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/3756630799 shutdown_connections 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.815+0000 7f4f9ee0a700 1 --2- 172.21.15.98:0/3756630799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100ed0 0x7f4f98104ea0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.815+0000 7f4f9ee0a700 1 --2- 172.21.15.98:0/3756630799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f98100530 0x7f4f98100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.815+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/3756630799 >> 172.21.15.98:0/3756630799 conn(0x7f4f980fbe10 msgr2=0x7f4f980fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.815+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/3756630799 shutdown_connections 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.815+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/3756630799 wait complete. 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9ee0a700 1 Processor -- start 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9ee0a700 1 -- start start 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9ee0a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100530 0x7f4f98073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9ee0a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f98100ed0 0x7f4f98073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:44.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9ee0a700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f98073ad0 con 0x7f4f98100530 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9ee0a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f98073c10 con 0x7f4f98100ed0 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9cba6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100530 0x7f4f98073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9cba6700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100530 0x7f4f98073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53014/0 (socket says 172.21.15.98:53014) 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9cba6700 1 -- 172.21.15.98:0/2628002059 learned_addr learned my addr 172.21.15.98:0/2628002059 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f97fff700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f98100ed0 0x7f4f98073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9cba6700 1 -- 172.21.15.98:0/2628002059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f98100ed0 msgr2=0x7f4f98073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9cba6700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f98100ed0 0x7f4f98073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9cba6700 1 -- 172.21.15.98:0/2628002059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88009d00 con 0x7f4f98100530 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.816+0000 7f4f9cba6700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100530 0x7f4f98073050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d8d0 tx=0x7f4f9000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.817+0000 7f4f95ffb700 1 -- 172.21.15.98:0/2628002059 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f90009940 con 0x7f4f98100530 2024-09-13T03:05:44.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.817+0000 7f4f95ffb700 1 -- 172.21.15.98:0/2628002059 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f90010460 con 0x7f4f98100530 2024-09-13T03:05:44.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.817+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f981a20c0 con 0x7f4f98100530 2024-09-13T03:05:44.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.817+0000 7f4f95ffb700 1 -- 172.21.15.98:0/2628002059 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f9000f5f0 con 0x7f4f98100530 2024-09-13T03:05:44.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.817+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f981a24d0 con 0x7f4f98100530 2024-09-13T03:05:44.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.818+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f981088a0 con 0x7f4f98100530 2024-09-13T03:05:44.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.818+0000 7f4f95ffb700 1 -- 172.21.15.98:0/2628002059 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4f900105d0 con 0x7f4f98100530 2024-09-13T03:05:44.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.819+0000 7f4f95ffb700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4f8406e680 0x7f4f84070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:44.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.819+0000 7f4f95ffb700 1 -- 172.21.15.98:0/2628002059 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f4f9008e690 con 0x7f4f98100530 2024-09-13T03:05:44.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.819+0000 7f4f97fff700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4f8406e680 0x7f4f84070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:44.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.819+0000 7f4f97fff700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4f8406e680 0x7f4f84070b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4f98074840 tx=0x7f4f880061f0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:44.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:44.823+0000 7f4f95ffb700 1 -- 172.21.15.98:0/2628002059 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f90057790 con 0x7f4f98100530 2024-09-13T03:05:45.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.067+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f4f98108280 con 0x7f4f98100530 2024-09-13T03:05:45.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.068+0000 7f4f95ffb700 1 -- 172.21.15.98:0/2628002059 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v39) v1 ==== 107+0+5260 (secure 0 0 0) 0x7f4f9005ae50 con 0x7f4f98100530 2024-09-13T03:05:45.069 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-13T03:05:45.069 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":38,"btime":"2024-09-13T03:02:29:582796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44315,"name":"cephfs.smithi142.wxfmvt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/2834620980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2834620980},{"type":"v1","addr":"172.21.15.142:6825","nonce":2834620980}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44339,"name":"cephfs.smithi142.hplrrs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/3076033085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3076033085},{"type":"v1","addr":"172.21.15.142:6827","nonce":3076033085}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:49:50.246299+0000","modified":"2024-09-13T03:02:29.582783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi098.nwzstq","rank":0,"incarnation":31,"state":"up:active","state_seq":19,"addr":"172.21.15.98:6827/870545712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":870545712},{"type":"v1","addr":"172.21.15.98:6827","nonce":870545712}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi098.dioppa","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6829/3981027621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":3981027621},{"type":"v1","addr":"172.21.15.98:6829","nonce":3981027621}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4f8406e680 msgr2=0x7f4f84070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4f8406e680 0x7f4f84070b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4f98074840 tx=0x7f4f880061f0 comp rx=0 tx=0).stop 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100530 msgr2=0x7f4f98073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100530 0x7f4f98073050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d8d0 tx=0x7f4f9000dc90 comp rx=0 tx=0).stop 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 shutdown_connections 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f4f8406e680 0x7f4f84070b30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f98100530 0x7f4f98073050 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 --2- 172.21.15.98:0/2628002059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f98100ed0 0x7f4f98073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 >> 172.21.15.98:0/2628002059 conn(0x7f4f980fbe10 msgr2=0x7f4f980fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 shutdown_connections 2024-09-13T03:05:45.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:45.070+0000 7f4f9ee0a700 1 -- 172.21.15.98:0/2628002059 wait complete. 2024-09-13T03:05:45.073 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 38 2024-09-13T03:05:45.632 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T03:05:45.640 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T03:05:45.640 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T03:05:45.640 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:05:45.658 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T03:05:45.658 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:05:45.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T03:05:45.954 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:46.167 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:45 smithi098 ceph-mon[87325]: pgmap v314: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:46.168 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:45 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2628002059' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T03:05:46.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:45 smithi142 ceph-mon[65447]: pgmap v314: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:46.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:45 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2628002059' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T03:05:47.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.548+0000 7fcdd68b8700 1 -- 172.21.15.98:0/989641319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd0100d70 msgr2=0x7fcdd0104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.548+0000 7fcdd68b8700 1 --2- 172.21.15.98:0/989641319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd0100d70 0x7fcdd0104e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009910 tx=0x7fcdb8009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.548+0000 7fcdd68b8700 1 -- 172.21.15.98:0/989641319 shutdown_connections 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.548+0000 7fcdd68b8700 1 --2- 172.21.15.98:0/989641319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd0100d70 0x7fcdd0104e50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.548+0000 7fcdd68b8700 1 --2- 172.21.15.98:0/989641319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd01003d0 0x7fcdd01007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.548+0000 7fcdd68b8700 1 -- 172.21.15.98:0/989641319 >> 172.21.15.98:0/989641319 conn(0x7fcdd00fbcb0 msgr2=0x7fcdd00fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.548+0000 7fcdd68b8700 1 -- 172.21.15.98:0/989641319 shutdown_connections 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.548+0000 7fcdd68b8700 1 -- 172.21.15.98:0/989641319 wait complete. 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.549+0000 7fcdd68b8700 1 Processor -- start 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.549+0000 7fcdd68b8700 1 -- start start 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.549+0000 7fcdd68b8700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd01003d0 0x7fcdd0195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:47.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.549+0000 7fcdd68b8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd0100d70 0x7fcdd0196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.549+0000 7fcdd68b8700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0196980 con 0x7fcdd01003d0 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.549+0000 7fcdd68b8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0196ac0 con 0x7fcdd0100d70 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.549+0000 7fcdcffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd01003d0 0x7fcdd0195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.549+0000 7fcdcffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd01003d0 0x7fcdd0195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53044/0 (socket says 172.21.15.98:53044) 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.549+0000 7fcdcffff700 1 -- 172.21.15.98:0/2505857286 learned_addr learned my addr 172.21.15.98:0/2505857286 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdc7fff700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd0100d70 0x7fcdd0196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdcffff700 1 -- 172.21.15.98:0/2505857286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd0100d70 msgr2=0x7fcdd0196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdcffff700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd0100d70 0x7fcdd0196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdcffff700 1 -- 172.21.15.98:0/2505857286 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb80095f0 con 0x7fcdd01003d0 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdc7fff700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd0100d70 0x7fcdd0196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdcffff700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd01003d0 0x7fcdd0195df0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c930 tx=0x7fcdc000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:47.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdcdffb700 1 -- 172.21.15.98:0/2505857286 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc0007ad0 con 0x7fcdd01003d0 2024-09-13T03:05:47.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd019a910 con 0x7fcdd01003d0 2024-09-13T03:05:47.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdcdffb700 1 -- 172.21.15.98:0/2505857286 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdc0007c30 con 0x7fcdd01003d0 2024-09-13T03:05:47.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdcdffb700 1 -- 172.21.15.98:0/2505857286 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc0018610 con 0x7fcdd01003d0 2024-09-13T03:05:47.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.550+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd019ae60 con 0x7fcdd01003d0 2024-09-13T03:05:47.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.551+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd004f2a0 con 0x7fcdd01003d0 2024-09-13T03:05:47.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.552+0000 7fcdcdffb700 1 -- 172.21.15.98:0/2505857286 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcdc00188b0 con 0x7fcdd01003d0 2024-09-13T03:05:47.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.552+0000 7fcdcdffb700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcdbc06e680 0x7fcdbc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:47.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.552+0000 7fcdcdffb700 1 -- 172.21.15.98:0/2505857286 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7fcdc008e950 con 0x7fcdd01003d0 2024-09-13T03:05:47.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.552+0000 7fcdc7fff700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcdbc06e680 0x7fcdbc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:47.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.553+0000 7fcdc7fff700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcdbc06e680 0x7fcdbc070b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8006010 tx=0x7fcdb8005960 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:47.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.557+0000 7fcdcdffb700 1 -- 172.21.15.98:0/2505857286 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcdc0057ad0 con 0x7fcdd01003d0 2024-09-13T03:05:47.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.775+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcdd0197150 con 0x7fcdd01003d0 2024-09-13T03:05:47.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.776+0000 7fcdcdffb700 1 -- 172.21.15.98:0/2505857286 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v92) v1 ==== 81+0+2051 (secure 0 0 0) 0x7fcdc005b190 con 0x7fcdd01003d0 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6827/837388084 2024-09-14T03:02:09.302098+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6825/2448398872 2024-09-14T03:01:47.103695+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6824/2448398872 2024-09-14T03:01:47.103695+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6827/831008890 2024-09-14T03:01:05.787180+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/4034603056 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/3396829670 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1656599610 2024-09-14T02:44:01.815636+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/143489565 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/442019349 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3235715432 2024-09-14T02:44:01.815636+0000 2024-09-13T03:05:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6826/837388084 2024-09-14T03:02:09.302098+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1707764380 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3693008660 2024-09-14T02:52:07.370437+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6800/2 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/4087496474 2024-09-14T02:45:04.801424+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/2190764559 2024-09-14T02:44:01.815636+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1295276362 2024-09-14T02:45:04.801424+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/3288679718 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/196160400 2024-09-14T02:45:04.801424+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/301321840 2024-09-14T02:52:07.370437+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/1317304211 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6801/2 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:47.779 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3441527919 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/4007119820 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6826/831008890 2024-09-14T03:01:05.787180+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6828/4116480224 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/2898837321 2024-09-14T02:52:07.370437+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/1575533089 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6829/4116480224 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/443411696 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1203436587 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3863292229 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6800/2032110974 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3787037935 2024-09-14T02:52:07.370437+0000 2024-09-13T03:05:47.781 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6801/2032110974 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:47.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcdbc06e680 msgr2=0x7fcdbc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:47.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcdbc06e680 0x7fcdbc070b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8006010 tx=0x7fcdb8005960 comp rx=0 tx=0).stop 2024-09-13T03:05:47.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd01003d0 msgr2=0x7fcdd0195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:47.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd01003d0 0x7fcdd0195df0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c930 tx=0x7fcdc000ccf0 comp rx=0 tx=0).stop 2024-09-13T03:05:47.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 shutdown_connections 2024-09-13T03:05:47.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7fcdbc06e680 0x7fcdbc070b30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:47.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdd01003d0 0x7fcdd0195df0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:47.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 --2- 172.21.15.98:0/2505857286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdd0100d70 0x7fcdd0196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:47.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 >> 172.21.15.98:0/2505857286 conn(0x7fcdd00fbcb0 msgr2=0x7fcdd00fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:47.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.778+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 shutdown_connections 2024-09-13T03:05:47.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:47.779+0000 7fcdd68b8700 1 -- 172.21.15.98:0/2505857286 wait complete. 2024-09-13T03:05:47.786 INFO:teuthology.orchestra.run.smithi098.stderr:listed 35 entries 2024-09-13T03:05:48.142 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:47 smithi098 ceph-mon[87325]: pgmap v315: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:48.142 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:47 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/2505857286' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:05:48.244 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:47 smithi142 ceph-mon[65447]: pgmap v315: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:48.244 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:47 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/2505857286' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:05:48.413 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-13T03:05:48.413 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:05:48.432 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid d155f688-7179-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T03:05:48.672 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/mon.smithi098/config 2024-09-13T03:05:49.066 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:49.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:50.113 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:49 smithi098 ceph-mon[87325]: pgmap v316: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:50.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 -- 172.21.15.98:0/2140353802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a41004e0 msgr2=0x7f02a41008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:50.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 --2- 172.21.15.98:0/2140353802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a41004e0 0x7f02a41008b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0294009910 tx=0x7f0294009c20 comp rx=0 tx=0).stop 2024-09-13T03:05:50.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 -- 172.21.15.98:0/2140353802 shutdown_connections 2024-09-13T03:05:50.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 --2- 172.21.15.98:0/2140353802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02a4100e80 0x7f02a4104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:50.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 --2- 172.21.15.98:0/2140353802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a41004e0 0x7f02a41008b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:50.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 -- 172.21.15.98:0/2140353802 >> 172.21.15.98:0/2140353802 conn(0x7f02a40fbda0 msgr2=0x7f02a40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:50.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 -- 172.21.15.98:0/2140353802 shutdown_connections 2024-09-13T03:05:50.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 -- 172.21.15.98:0/2140353802 wait complete. 2024-09-13T03:05:50.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 Processor -- start 2024-09-13T03:05:50.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 -- start start 2024-09-13T03:05:50.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02a41004e0 0x7f02a41980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:50.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.214+0000 7f02ab8a2700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4100e80 0x7f02a4198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:50.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02ab8a2700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4198d10 con 0x7f02a4100e80 2024-09-13T03:05:50.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02ab8a2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a419caa0 con 0x7f02a41004e0 2024-09-13T03:05:50.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02a8e3d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4100e80 0x7f02a4198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:50.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02a8e3d700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4100e80 0x7f02a4198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53068/0 (socket says 172.21.15.98:53068) 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02a8e3d700 1 -- 172.21.15.98:0/4042288139 learned_addr learned my addr 172.21.15.98:0/4042288139 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02a963e700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02a41004e0 0x7f02a41980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02a8e3d700 1 -- 172.21.15.98:0/4042288139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02a41004e0 msgr2=0x7f02a41980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02a8e3d700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02a41004e0 0x7f02a41980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02a8e3d700 1 -- 172.21.15.98:0/4042288139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02940095f0 con 0x7f02a4100e80 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02a8e3d700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4100e80 0x7f02a4198630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f02a000d900 tx=0x7f02a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f029a7fc700 1 -- 172.21.15.98:0/4042288139 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a0009900 con 0x7f02a4100e80 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f029a7fc700 1 -- 172.21.15.98:0/4042288139 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02a0010460 con 0x7f02a4100e80 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a419cd80 con 0x7f02a4100e80 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f029a7fc700 1 -- 172.21.15.98:0/4042288139 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a000f5f0 con 0x7f02a4100e80 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.215+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a419d2d0 con 0x7f02a4100e80 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.216+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a41045d0 con 0x7f02a4100e80 2024-09-13T03:05:50.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.217+0000 7f029a7fc700 1 -- 172.21.15.98:0/4042288139 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 39) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f02a00105d0 con 0x7f02a4100e80 2024-09-13T03:05:50.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.217+0000 7f029a7fc700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f029006e680 0x7f0290070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:50.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.217+0000 7f029a7fc700 1 -- 172.21.15.98:0/4042288139 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6618+0+0 (secure 0 0 0) 0x7f02a008e240 con 0x7f02a4100e80 2024-09-13T03:05:50.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.217+0000 7f02a963e700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f029006e680 0x7f0290070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:50.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.218+0000 7f02a963e700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f029006e680 0x7f0290070b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0294006010 tx=0x7f029401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:50.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.222+0000 7f029a7fc700 1 -- 172.21.15.98:0/4042288139 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f02a0057340 con 0x7f02a4100e80 2024-09-13T03:05:50.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:49 smithi142 ceph-mon[65447]: pgmap v316: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:50.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.436+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f02a419d540 con 0x7f02a4100e80 2024-09-13T03:05:50.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.437+0000 7f029a7fc700 1 -- 172.21.15.98:0/4042288139 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v92) v1 ==== 81+0+2051 (secure 0 0 0) 0x7f02a0017820 con 0x7f02a4100e80 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6827/837388084 2024-09-14T03:02:09.302098+0000 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6825/2448398872 2024-09-14T03:01:47.103695+0000 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6824/2448398872 2024-09-14T03:01:47.103695+0000 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6827/831008890 2024-09-14T03:01:05.787180+0000 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/4034603056 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/3396829670 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1656599610 2024-09-14T02:44:01.815636+0000 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/143489565 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/442019349 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:50.439 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3235715432 2024-09-14T02:44:01.815636+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6826/837388084 2024-09-14T03:02:09.302098+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1707764380 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3693008660 2024-09-14T02:52:07.370437+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6800/2 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/4087496474 2024-09-14T02:45:04.801424+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/2190764559 2024-09-14T02:44:01.815636+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1295276362 2024-09-14T02:45:04.801424+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/3288679718 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/196160400 2024-09-14T02:45:04.801424+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/301321840 2024-09-14T02:52:07.370437+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/1317304211 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6801/2 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3441527919 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/4007119820 2024-09-14T02:43:29.909353+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6826/831008890 2024-09-14T03:01:05.787180+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6828/4116480224 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/2898837321 2024-09-14T02:52:07.370437+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/1575533089 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:6829/4116480224 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.142:0/443411696 2024-09-14T02:53:25.580554+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1203436587 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3863292229 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6800/2032110974 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3787037935 2024-09-14T02:52:07.370437+0000 2024-09-13T03:05:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6801/2032110974 2024-09-14T02:56:48.672636+0000 2024-09-13T03:05:50.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f029006e680 msgr2=0x7f0290070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:50.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f029006e680 0x7f0290070b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0294006010 tx=0x7f029401a040 comp rx=0 tx=0).stop 2024-09-13T03:05:50.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4100e80 msgr2=0x7f02a4198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:50.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4100e80 0x7f02a4198630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f02a000d900 tx=0x7f02a000dc10 comp rx=0 tx=0).stop 2024-09-13T03:05:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 shutdown_connections 2024-09-13T03:05:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:6800/2311940821,v1:172.21.15.98:6801/2311940821] conn(0x7f029006e680 0x7f0290070b30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02a41004e0 0x7f02a41980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 --2- 172.21.15.98:0/4042288139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f02a4100e80 0x7f02a4198630 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 >> 172.21.15.98:0/4042288139 conn(0x7f02a40fbda0 msgr2=0x7f02a40fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 shutdown_connections 2024-09-13T03:05:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-13T03:05:50.439+0000 7f02ab8a2700 1 -- 172.21.15.98:0/4042288139 wait complete. 2024-09-13T03:05:50.443 INFO:teuthology.orchestra.run.smithi098.stderr:listed 35 entries 2024-09-13T03:05:51.075 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:50 smithi098 ceph-mon[87325]: from='client.? 172.21.15.98:0/4042288139' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:05:51.098 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi098.front.sepia.ceph.com... 2024-09-13T03:05:51.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:05:51.098 DEBUG:teuthology.orchestra.run.smithi098:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T03:05:51.127 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T03:05:51.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:50 smithi142 ceph-mon[65447]: from='client.? 172.21.15.98:0/4042288139' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:05:52.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:51 smithi098 ceph-mon[87325]: pgmap v317: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:51 smithi142 ceph-mon[65447]: pgmap v317: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:53.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:05:53.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:05:53.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:52 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:05:53.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:52 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:05:53.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:52 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:05:53.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:52 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:05:54.158 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:53 smithi098 ceph-mon[87325]: pgmap v318: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:54.158 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:05:54.158 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:05:54.158 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:05:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:53 smithi142 ceph-mon[65447]: pgmap v318: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:05:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:05:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:05:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:05:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:55 smithi098 ceph-mon[87325]: pgmap v319: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:55 smithi142 ceph-mon[65447]: pgmap v319: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:57.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:57 smithi098 ceph-mon[87325]: pgmap v320: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:05:58.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:57 smithi142 ceph-mon[65447]: pgmap v320: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:00.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:05:59 smithi098 ceph-mon[87325]: pgmap v321: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:05:59 smithi142 ceph-mon[65447]: pgmap v321: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:02.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:01 smithi098 ceph-mon[87325]: pgmap v322: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:01 smithi142 ceph-mon[65447]: pgmap v322: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:04.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:03 smithi098 ceph-mon[87325]: pgmap v323: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:06:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:03 smithi142 ceph-mon[65447]: pgmap v323: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:06:06.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:05 smithi098 ceph-mon[87325]: pgmap v324: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:06.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:05 smithi142 ceph-mon[65447]: pgmap v324: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:07 smithi098 ceph-mon[87325]: pgmap v325: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:08.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:07 smithi142 ceph-mon[65447]: pgmap v325: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:10.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:09 smithi098 ceph-mon[87325]: pgmap v326: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:09 smithi142 ceph-mon[65447]: pgmap v326: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:12.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:11 smithi098 ceph-mon[87325]: pgmap v327: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:12.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:11 smithi142 ceph-mon[65447]: pgmap v327: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:14.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:13 smithi098 ceph-mon[87325]: pgmap v328: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:14.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:13 smithi142 ceph-mon[65447]: pgmap v328: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:16.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:15 smithi098 ceph-mon[87325]: pgmap v329: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:15 smithi142 ceph-mon[65447]: pgmap v329: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:18.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:17 smithi098 ceph-mon[87325]: pgmap v330: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:17 smithi142 ceph-mon[65447]: pgmap v330: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:19.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:06:19.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:06:20.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:19 smithi098 ceph-mon[87325]: pgmap v331: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:19 smithi142 ceph-mon[65447]: pgmap v331: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:22.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:21 smithi098 ceph-mon[87325]: pgmap v332: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:21 smithi142 ceph-mon[65447]: pgmap v332: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:24.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:23 smithi098 ceph-mon[87325]: pgmap v333: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:23 smithi142 ceph-mon[65447]: pgmap v333: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:25 smithi098 ceph-mon[87325]: pgmap v334: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:25 smithi142 ceph-mon[65447]: pgmap v334: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:28.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:27 smithi098 ceph-mon[87325]: pgmap v335: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:28.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:27 smithi142 ceph-mon[65447]: pgmap v335: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:30.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:29 smithi098 ceph-mon[87325]: pgmap v336: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:30.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:29 smithi142 ceph-mon[65447]: pgmap v336: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:32.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:31 smithi098 ceph-mon[87325]: pgmap v337: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:31 smithi142 ceph-mon[65447]: pgmap v337: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:33 smithi098 ceph-mon[87325]: pgmap v338: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:06:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:33 smithi142 ceph-mon[65447]: pgmap v338: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:06:36.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:35 smithi098 ceph-mon[87325]: pgmap v339: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:36.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:35 smithi142 ceph-mon[65447]: pgmap v339: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:37 smithi098 ceph-mon[87325]: pgmap v340: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:38.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:37 smithi142 ceph-mon[65447]: pgmap v340: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:40.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:39 smithi098 ceph-mon[87325]: pgmap v341: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:39 smithi142 ceph-mon[65447]: pgmap v341: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:42.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:41 smithi098 ceph-mon[87325]: pgmap v342: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:42.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:41 smithi142 ceph-mon[65447]: pgmap v342: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:44.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:43 smithi098 ceph-mon[87325]: pgmap v343: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:43 smithi142 ceph-mon[65447]: pgmap v343: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:46.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:45 smithi142 ceph-mon[65447]: pgmap v344: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:46.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:45 smithi098 ceph-mon[87325]: pgmap v344: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:48.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:47 smithi142 ceph-mon[65447]: pgmap v345: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:48.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:47 smithi098 ceph-mon[87325]: pgmap v345: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:49.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:06:49.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:06:50.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:49 smithi142 ceph-mon[65447]: pgmap v346: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:50.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:49 smithi098 ceph-mon[87325]: pgmap v346: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:51.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:51 smithi098 ceph-mon[87325]: pgmap v347: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:51.502 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:51 smithi142 ceph-mon[65447]: pgmap v347: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:53 smithi098 ceph-mon[87325]: pgmap v348: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:06:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:06:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:06:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:06:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:53 smithi142 ceph-mon[65447]: pgmap v348: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:06:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:06:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:06:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:06:54.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:06:56.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:55 smithi098 ceph-mon[87325]: pgmap v349: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:55 smithi142 ceph-mon[65447]: pgmap v349: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:58.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:57 smithi098 ceph-mon[87325]: pgmap v350: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:06:58.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:57 smithi142 ceph-mon[65447]: pgmap v350: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:00.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:06:59 smithi098 ceph-mon[87325]: pgmap v351: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:06:59 smithi142 ceph-mon[65447]: pgmap v351: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:02.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:01 smithi098 ceph-mon[87325]: pgmap v352: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:01 smithi142 ceph-mon[65447]: pgmap v352: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:03 smithi098 ceph-mon[87325]: pgmap v353: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:07:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:03 smithi142 ceph-mon[65447]: pgmap v353: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:07:06.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:05 smithi098 ceph-mon[87325]: pgmap v354: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:06.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:05 smithi142 ceph-mon[65447]: pgmap v354: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:08.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:07 smithi098 ceph-mon[87325]: pgmap v355: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:07 smithi142 ceph-mon[65447]: pgmap v355: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:10.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:09 smithi098 ceph-mon[87325]: pgmap v356: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:09 smithi142 ceph-mon[65447]: pgmap v356: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:12.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:11 smithi098 ceph-mon[87325]: pgmap v357: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:12.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:11 smithi142 ceph-mon[65447]: pgmap v357: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:14.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:13 smithi098 ceph-mon[87325]: pgmap v358: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:14.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:13 smithi142 ceph-mon[65447]: pgmap v358: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:15.983 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:15 smithi098 ceph-mon[87325]: pgmap v359: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:15 smithi142 ceph-mon[65447]: pgmap v359: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:18.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:17 smithi098 ceph-mon[87325]: pgmap v360: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:17 smithi142 ceph-mon[65447]: pgmap v360: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:19.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:07:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:07:20.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:19 smithi098 ceph-mon[87325]: pgmap v361: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:19 smithi142 ceph-mon[65447]: pgmap v361: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:22.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:21 smithi098 ceph-mon[87325]: pgmap v362: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:21 smithi142 ceph-mon[65447]: pgmap v362: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:24.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:23 smithi098 ceph-mon[87325]: pgmap v363: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:23 smithi142 ceph-mon[65447]: pgmap v363: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:26.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:25 smithi098 ceph-mon[87325]: pgmap v364: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:25 smithi142 ceph-mon[65447]: pgmap v364: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:28.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:27 smithi098 ceph-mon[87325]: pgmap v365: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:28.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:27 smithi142 ceph-mon[65447]: pgmap v365: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:30.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:29 smithi098 ceph-mon[87325]: pgmap v366: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:30.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:29 smithi142 ceph-mon[65447]: pgmap v366: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:32.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:31 smithi098 ceph-mon[87325]: pgmap v367: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:31 smithi142 ceph-mon[65447]: pgmap v367: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:34.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:33 smithi098 ceph-mon[87325]: pgmap v368: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:07:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:33 smithi142 ceph-mon[65447]: pgmap v368: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:07:36.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:35 smithi098 ceph-mon[87325]: pgmap v369: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:36.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:35 smithi142 ceph-mon[65447]: pgmap v369: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:37 smithi098 ceph-mon[87325]: pgmap v370: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:38.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:37 smithi142 ceph-mon[65447]: pgmap v370: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:40.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:39 smithi098 ceph-mon[87325]: pgmap v371: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:39 smithi142 ceph-mon[65447]: pgmap v371: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:42.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:41 smithi098 ceph-mon[87325]: pgmap v372: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:42.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:41 smithi142 ceph-mon[65447]: pgmap v372: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:44.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:43 smithi098 ceph-mon[87325]: pgmap v373: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:43 smithi142 ceph-mon[65447]: pgmap v373: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:46.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:45 smithi098 ceph-mon[87325]: pgmap v374: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:46.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:45 smithi142 ceph-mon[65447]: pgmap v374: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:47 smithi098 ceph-mon[87325]: pgmap v375: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:48.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:47 smithi142 ceph-mon[65447]: pgmap v375: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:49.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:07:49.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:07:50.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:49 smithi098 ceph-mon[87325]: pgmap v376: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:50.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:49 smithi142 ceph-mon[65447]: pgmap v376: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:51 smithi098 ceph-mon[87325]: pgmap v377: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:51 smithi142 ceph-mon[65447]: pgmap v377: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:54.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:53 smithi098 ceph-mon[87325]: pgmap v378: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:54.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:53 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:07:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:53 smithi142 ceph-mon[65447]: pgmap v378: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:07:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:53 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:07:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:54 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:07:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:54 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:07:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:54 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:07:55.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:54 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:07:55.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:54 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:07:55.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:54 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:07:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:55 smithi098 ceph-mon[87325]: pgmap v379: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:56.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:55 smithi142 ceph-mon[65447]: pgmap v379: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:58.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:57 smithi142 ceph-mon[65447]: pgmap v380: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:07:58.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:57 smithi098 ceph-mon[87325]: pgmap v380: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:07:59 smithi142 ceph-mon[65447]: pgmap v381: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:00.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:07:59 smithi098 ceph-mon[87325]: pgmap v381: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:01 smithi142 ceph-mon[65447]: pgmap v382: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:02.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:01 smithi098 ceph-mon[87325]: pgmap v382: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:03 smithi142 ceph-mon[65447]: pgmap v383: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:08:04.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:03 smithi098 ceph-mon[87325]: pgmap v383: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:04.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:08:06.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:05 smithi142 ceph-mon[65447]: pgmap v384: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:06.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:05 smithi098 ceph-mon[87325]: pgmap v384: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:07 smithi142 ceph-mon[65447]: pgmap v385: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:08.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:07 smithi098 ceph-mon[87325]: pgmap v385: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:10.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:10 smithi142 ceph-mon[65447]: pgmap v386: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:10.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:10 smithi098 ceph-mon[87325]: pgmap v386: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:11.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:11 smithi098 ceph-mon[87325]: pgmap v387: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:11.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:11 smithi142 ceph-mon[65447]: pgmap v387: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:14.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:13 smithi098 ceph-mon[87325]: pgmap v388: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:14.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:13 smithi142 ceph-mon[65447]: pgmap v388: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:16.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:15 smithi098 ceph-mon[87325]: pgmap v389: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:16.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:15 smithi142 ceph-mon[65447]: pgmap v389: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:18.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:17 smithi098 ceph-mon[87325]: pgmap v390: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:18.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:17 smithi142 ceph-mon[65447]: pgmap v390: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:19.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:18 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:08:19.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:18 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:08:20.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:19 smithi098 ceph-mon[87325]: pgmap v391: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:20.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:19 smithi142 ceph-mon[65447]: pgmap v391: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:22.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:21 smithi098 ceph-mon[87325]: pgmap v392: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:22.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:21 smithi142 ceph-mon[65447]: pgmap v392: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:24.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:23 smithi098 ceph-mon[87325]: pgmap v393: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:23 smithi142 ceph-mon[65447]: pgmap v393: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:25 smithi098 ceph-mon[87325]: pgmap v394: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:25 smithi142 ceph-mon[65447]: pgmap v394: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:28.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:27 smithi098 ceph-mon[87325]: pgmap v395: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:28.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:27 smithi142 ceph-mon[65447]: pgmap v395: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:30.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:29 smithi098 ceph-mon[87325]: pgmap v396: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:30.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:29 smithi142 ceph-mon[65447]: pgmap v396: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:32.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:31 smithi098 ceph-mon[87325]: pgmap v397: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:31 smithi142 ceph-mon[65447]: pgmap v397: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:34.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:33 smithi098 ceph-mon[87325]: pgmap v398: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:08:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:33 smithi142 ceph-mon[65447]: pgmap v398: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:08:36.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:35 smithi098 ceph-mon[87325]: pgmap v399: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:36.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:35 smithi142 ceph-mon[65447]: pgmap v399: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:37 smithi098 ceph-mon[87325]: pgmap v400: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:38.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:37 smithi142 ceph-mon[65447]: pgmap v400: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:40.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:39 smithi098 ceph-mon[87325]: pgmap v401: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:39 smithi142 ceph-mon[65447]: pgmap v401: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:42.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:41 smithi098 ceph-mon[87325]: pgmap v402: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:42.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:41 smithi142 ceph-mon[65447]: pgmap v402: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:44.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:43 smithi098 ceph-mon[87325]: pgmap v403: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:43 smithi142 ceph-mon[65447]: pgmap v403: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:45 smithi098 ceph-mon[87325]: pgmap v404: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:46.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:45 smithi142 ceph-mon[65447]: pgmap v404: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:48.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:47 smithi098 ceph-mon[87325]: pgmap v405: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:48.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:47 smithi142 ceph-mon[65447]: pgmap v405: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:49.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:08:49.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:08:50.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:49 smithi098 ceph-mon[87325]: pgmap v406: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:50.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:49 smithi142 ceph-mon[65447]: pgmap v406: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:52.237 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:51 smithi098 ceph-mon[87325]: pgmap v407: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:51 smithi142 ceph-mon[65447]: pgmap v407: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:54.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:53 smithi098 ceph-mon[87325]: pgmap v408: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:53 smithi142 ceph-mon[65447]: pgmap v408: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:08:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:54 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:08:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:54 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:08:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:54 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:08:55.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:54 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:08:55.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:54 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:08:55.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:54 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:08:55.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:54 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:08:55.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:54 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:08:56.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:55 smithi098 ceph-mon[87325]: pgmap v409: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:55 smithi142 ceph-mon[65447]: pgmap v409: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:58.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:57 smithi098 ceph-mon[87325]: pgmap v410: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:08:58.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:57 smithi142 ceph-mon[65447]: pgmap v410: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:00.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:08:59 smithi098 ceph-mon[87325]: pgmap v411: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:08:59 smithi142 ceph-mon[65447]: pgmap v411: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:01 smithi142 ceph-mon[65447]: pgmap v412: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:02.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:01 smithi098 ceph-mon[87325]: pgmap v412: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:03 smithi142 ceph-mon[65447]: pgmap v413: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:04.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:09:04.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:03 smithi098 ceph-mon[87325]: pgmap v413: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:04.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:09:06.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:05 smithi142 ceph-mon[65447]: pgmap v414: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:06.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:05 smithi098 ceph-mon[87325]: pgmap v414: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:08.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:07 smithi098 ceph-mon[87325]: pgmap v415: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:07 smithi142 ceph-mon[65447]: pgmap v415: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:09 smithi142 ceph-mon[65447]: pgmap v416: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:10.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:09 smithi098 ceph-mon[87325]: pgmap v416: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:12.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:12 smithi098 ceph-mon[87325]: pgmap v417: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:12.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:12 smithi142 ceph-mon[65447]: pgmap v417: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:14.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:14 smithi098 ceph-mon[87325]: pgmap v418: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:14 smithi142 ceph-mon[65447]: pgmap v418: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:16.304 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:16 smithi142 ceph-mon[65447]: pgmap v419: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:16.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:16 smithi098 ceph-mon[87325]: pgmap v419: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:18.237 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:18 smithi098 ceph-mon[87325]: pgmap v420: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:18.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:18 smithi142 ceph-mon[65447]: pgmap v420: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:19.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:09:19.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:09:20.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:20 smithi098 ceph-mon[87325]: pgmap v421: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:20.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:20 smithi142 ceph-mon[65447]: pgmap v421: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:21.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:21 smithi098 ceph-mon[87325]: pgmap v422: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:21.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:21 smithi142 ceph-mon[65447]: pgmap v422: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:24.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:23 smithi098 ceph-mon[87325]: pgmap v423: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:24.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:23 smithi142 ceph-mon[65447]: pgmap v423: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:26.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:25 smithi098 ceph-mon[87325]: pgmap v424: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:25 smithi142 ceph-mon[65447]: pgmap v424: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:28.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:27 smithi098 ceph-mon[87325]: pgmap v425: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:28.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:27 smithi142 ceph-mon[65447]: pgmap v425: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:30.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:29 smithi098 ceph-mon[87325]: pgmap v426: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:30.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:29 smithi142 ceph-mon[65447]: pgmap v426: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:32.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:31 smithi142 ceph-mon[65447]: pgmap v427: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:32.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:31 smithi098 ceph-mon[87325]: pgmap v427: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:34.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:33 smithi098 ceph-mon[87325]: pgmap v428: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:09:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:33 smithi142 ceph-mon[65447]: pgmap v428: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:09:36.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:35 smithi098 ceph-mon[87325]: pgmap v429: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:36.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:35 smithi142 ceph-mon[65447]: pgmap v429: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:37 smithi098 ceph-mon[87325]: pgmap v430: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:38.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:37 smithi142 ceph-mon[65447]: pgmap v430: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:40.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:39 smithi098 ceph-mon[87325]: pgmap v431: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:39 smithi142 ceph-mon[65447]: pgmap v431: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:42.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:41 smithi098 ceph-mon[87325]: pgmap v432: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:42.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:41 smithi142 ceph-mon[65447]: pgmap v432: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:44.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:43 smithi098 ceph-mon[87325]: pgmap v433: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:43 smithi142 ceph-mon[65447]: pgmap v433: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:45 smithi098 ceph-mon[87325]: pgmap v434: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:46.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:45 smithi142 ceph-mon[65447]: pgmap v434: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:47 smithi098 ceph-mon[87325]: pgmap v435: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:48.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:47 smithi142 ceph-mon[65447]: pgmap v435: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:49.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:09:49.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:09:50.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:49 smithi098 ceph-mon[87325]: pgmap v436: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:50.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:49 smithi142 ceph-mon[65447]: pgmap v436: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:52.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:51 smithi098 ceph-mon[87325]: pgmap v437: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:52.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:51 smithi142 ceph-mon[65447]: pgmap v437: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:54.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:53 smithi098 ceph-mon[87325]: pgmap v438: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:54.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:53 smithi142 ceph-mon[65447]: pgmap v438: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:09:55.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:54 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:09:55.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:54 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:09:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:55 smithi098 ceph-mon[87325]: pgmap v439: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:09:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:09:56.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:55 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:09:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:55 smithi142 ceph-mon[65447]: pgmap v439: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:09:56.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:09:56.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:55 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' 2024-09-13T03:09:58.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:57 smithi098 ceph-mon[87325]: pgmap v440: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:09:58.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:57 smithi142 ceph-mon[65447]: pgmap v440: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:00.236 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:09:59 smithi098 ceph-mon[87325]: pgmap v441: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:00.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:09:59 smithi142 ceph-mon[65447]: pgmap v441: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:01.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:00 smithi098 ceph-mon[87325]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T03:10:01.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:00 smithi098 ceph-mon[87325]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:10:01.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:00 smithi098 ceph-mon[87325]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:10:01.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:00 smithi142 ceph-mon[65447]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T03:10:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:00 smithi142 ceph-mon[65447]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T03:10:01.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:00 smithi142 ceph-mon[65447]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T03:10:02.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:01 smithi142 ceph-mon[65447]: pgmap v442: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:02.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:01 smithi098 ceph-mon[87325]: pgmap v442: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:04.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:03 smithi098 ceph-mon[87325]: pgmap v443: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:04.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:03 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:10:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:03 smithi142 ceph-mon[65447]: pgmap v443: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:04.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:03 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:10:06.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:05 smithi142 ceph-mon[65447]: pgmap v444: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:06.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:05 smithi098 ceph-mon[87325]: pgmap v444: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:08.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:07 smithi142 ceph-mon[65447]: pgmap v445: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:08.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:07 smithi098 ceph-mon[87325]: pgmap v445: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:10.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:10 smithi142 ceph-mon[65447]: pgmap v446: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:10.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:10 smithi098 ceph-mon[87325]: pgmap v446: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:12.326 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:12 smithi142 ceph-mon[65447]: pgmap v447: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:12.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:12 smithi098 ceph-mon[87325]: pgmap v447: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:14.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:14 smithi098 ceph-mon[87325]: pgmap v448: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:14.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:14 smithi142 ceph-mon[65447]: pgmap v448: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:16.304 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:16 smithi142 ceph-mon[65447]: pgmap v449: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:16.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:16 smithi098 ceph-mon[87325]: pgmap v449: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:18.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:18 smithi098 ceph-mon[87325]: pgmap v450: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:18.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:18 smithi142 ceph-mon[65447]: pgmap v450: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:19.484 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:19 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:10:19.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:19 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:10:20.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:20 smithi098 ceph-mon[87325]: pgmap v451: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:20.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:20 smithi142 ceph-mon[65447]: pgmap v451: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:22.483 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:22 smithi142 ceph-mon[65447]: pgmap v452: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:22.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:22 smithi098 ceph-mon[87325]: pgmap v452: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:23.483 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:23 smithi098 ceph-mon[87325]: pgmap v453: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:23.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:23 smithi142 ceph-mon[65447]: pgmap v453: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:26.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:25 smithi098 ceph-mon[87325]: pgmap v454: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:26.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:25 smithi142 ceph-mon[65447]: pgmap v454: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:28.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:27 smithi098 ceph-mon[87325]: pgmap v455: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:28.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:27 smithi142 ceph-mon[65447]: pgmap v455: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:30.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:29 smithi098 ceph-mon[87325]: pgmap v456: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:30.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:29 smithi142 ceph-mon[65447]: pgmap v456: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:32.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:31 smithi098 ceph-mon[87325]: pgmap v457: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:32.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:31 smithi142 ceph-mon[65447]: pgmap v457: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:34.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:33 smithi098 ceph-mon[87325]: pgmap v458: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:34.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:33 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:10:34.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:33 smithi142 ceph-mon[65447]: pgmap v458: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:34.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:33 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:10:36.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:35 smithi098 ceph-mon[87325]: pgmap v459: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:36.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:35 smithi142 ceph-mon[65447]: pgmap v459: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:38.001 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:37 smithi142 ceph-mon[65447]: pgmap v460: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:38.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:37 smithi098 ceph-mon[87325]: pgmap v460: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:40.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:39 smithi098 ceph-mon[87325]: pgmap v461: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:40.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:39 smithi142 ceph-mon[65447]: pgmap v461: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:42.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:41 smithi098 ceph-mon[87325]: pgmap v462: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:42.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:41 smithi142 ceph-mon[65447]: pgmap v462: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:44.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:43 smithi098 ceph-mon[87325]: pgmap v463: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:44.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:43 smithi142 ceph-mon[65447]: pgmap v463: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:46.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:45 smithi098 ceph-mon[87325]: pgmap v464: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:46.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:45 smithi142 ceph-mon[65447]: pgmap v464: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:48.234 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:47 smithi098 ceph-mon[87325]: pgmap v465: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:48.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:47 smithi142 ceph-mon[65447]: pgmap v465: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T03:10:49.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:48 smithi098 ceph-mon[87325]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:10:49.251 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:48 smithi142 ceph-mon[65447]: from='mgr.34102 172.21.15.98:0/3924743079' entity='mgr.smithi098.ukgenf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:10:50.199 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-13T03:10:50.200 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T03:10:50.202 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T03:10:50.214 INFO:tasks.cephadm:Teardown begin 2024-09-13T03:10:50.214 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T03:10:50.215 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:10:50.233 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:49 smithi098 ceph-mon[87325]: pgmap v466: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:50.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:10:50.252 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:49 smithi142 ceph-mon[65447]: pgmap v466: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T03:10:50.284 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T03:10:50.284 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T03:10:50.306 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T03:10:50.342 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T03:10:50.342 INFO:tasks.cephadm.mon.smithi098:Stopping mon.smithi098... 2024-09-13T03:10:50.342 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098 2024-09-13T03:10:50.675 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:50 smithi098 systemd[1]: Stopping Ceph mon.smithi098 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:10:50.960 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:50 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[87321]: 2024-09-13T03:10:50.673+0000 7f6bf5a06640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi098 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:10:50.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:50 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098[87321]: 2024-09-13T03:10:50.673+0000 7f6bf5a06640 -1 mon.smithi098@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T03:10:50.961 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:50 smithi098 podman[135673]: 2024-09-13 03:10:50.868230914 +0000 UTC m=+0.328409911 container died b700160bc33dc36f1dcae45f1e068d246e66d4ab04601528a6d5238ce5118c14 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T03:10:51.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:51 smithi098 podman[135673]: 2024-09-13 03:10:51.316285353 +0000 UTC m=+0.776464349 container cleanup b700160bc33dc36f1dcae45f1e068d246e66d4ab04601528a6d5238ce5118c14 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T03:10:51.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:51 smithi098 bash[135673]: ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098 2024-09-13T03:10:51.726 INFO:journalctl@ceph.mon.smithi098.smithi098.stdout:Sep 13 03:10:51 smithi098 podman[135696]: 2024-09-13 03:10:51.509838372 +0000 UTC m=+0.633981950 container remove b700160bc33dc36f1dcae45f1e068d246e66d4ab04601528a6d5238ce5118c14 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi098, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f) 2024-09-13T03:10:51.746 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi098.service' 2024-09-13T03:10:51.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:10:51.788 INFO:tasks.cephadm.mon.smithi098:Stopped mon.smithi098 2024-09-13T03:10:51.788 INFO:tasks.cephadm.mon.smithi142:Stopping mon.smithi142... 2024-09-13T03:10:51.788 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi142 2024-09-13T03:10:52.137 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:51 smithi142 systemd[1]: Stopping Ceph mon.smithi142 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:10:52.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:52 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142[65443]: 2024-09-13T03:10:52.135+0000 7f9cf0d26640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi142 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:10:52.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:52 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142[65443]: 2024-09-13T03:10:52.135+0000 7f9cf0d26640 -1 mon.smithi142@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T03:10:52.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:52 smithi142 podman[102669]: 2024-09-13 03:10:52.329772503 +0000 UTC m=+0.343997285 container died dc3771253accc01dfa26dd040edef328863345cb3cbe8898fe9156d809f458da (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-13T03:10:52.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:52 smithi142 podman[102669]: 2024-09-13 03:10:52.836387637 +0000 UTC m=+0.850612457 container cleanup dc3771253accc01dfa26dd040edef328863345cb3cbe8898fe9156d809f458da (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f) 2024-09-13T03:10:52.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:52 smithi142 bash[102669]: ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142 2024-09-13T03:10:53.205 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Sep 13 03:10:53 smithi142 podman[102681]: 2024-09-13 03:10:53.096245251 +0000 UTC m=+0.764218154 container remove dc3771253accc01dfa26dd040edef328863345cb3cbe8898fe9156d809f458da (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-mon-smithi142, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T03:10:53.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@mon.smithi142.service' 2024-09-13T03:10:53.275 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:10:53.275 INFO:tasks.cephadm.mon.smithi142:Stopped mon.smithi142 2024-09-13T03:10:53.275 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T03:10:53.275 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.0 2024-09-13T03:10:53.572 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:53 smithi098 systemd[1]: Stopping Ceph osd.0 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:10:53.983 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:53 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[98479]: 2024-09-13T03:10:53.570+0000 7f80950b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:10:53.984 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:53 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[98479]: 2024-09-13T03:10:53.570+0000 7f80950b0640 -1 osd.0 92 *** Got signal Terminated *** 2024-09-13T03:10:53.984 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:53 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0[98479]: 2024-09-13T03:10:53.570+0000 7f80950b0640 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:10:59.283 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:58 smithi098 podman[135807]: 2024-09-13 03:10:58.988275434 +0000 UTC m=+5.521516649 container died 1252221d152e5d1a9a8be511d3ec49e8631dab02711fc0c828b95093789d68c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T03:10:59.607 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:59 smithi098 podman[135807]: 2024-09-13 03:10:59.372271932 +0000 UTC m=+5.905513144 container cleanup 1252221d152e5d1a9a8be511d3ec49e8631dab02711fc0c828b95093789d68c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0, ceph=True, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:10:59.608 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:59 smithi098 bash[135807]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0 2024-09-13T03:10:59.883 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:59 smithi098 podman[135822]: 2024-09-13 03:10:59.607148206 +0000 UTC m=+0.609857195 container remove 1252221d152e5d1a9a8be511d3ec49e8631dab02711fc0c828b95093789d68c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T03:11:00.203 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:59 smithi098 podman[135914]: 2024-09-13 03:10:59.822990586 +0000 UTC m=+0.016049434 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:11:00.204 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:10:59 smithi098 podman[135914]: 2024-09-13 03:10:59.975211148 +0000 UTC m=+0.168269989 container create 557faed1ab400ffd9cfa8c57bdc3ecd67cf7f8e7b2a935530e9844f3c3979f8b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T03:11:00.204 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:11:00 smithi098 podman[135914]: 2024-09-13 03:11:00.203193076 +0000 UTC m=+0.396251912 container init 557faed1ab400ffd9cfa8c57bdc3ecd67cf7f8e7b2a935530e9844f3c3979f8b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T03:11:00.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:11:00 smithi098 podman[135914]: 2024-09-13 03:11:00.206649938 +0000 UTC m=+0.399708772 container start 557faed1ab400ffd9cfa8c57bdc3ecd67cf7f8e7b2a935530e9844f3c3979f8b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=) 2024-09-13T03:11:00.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:11:00 smithi098 podman[135914]: 2024-09-13 03:11:00.303217939 +0000 UTC m=+0.496276774 container attach 557faed1ab400ffd9cfa8c57bdc3ecd67cf7f8e7b2a935530e9844f3c3979f8b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T03:11:00.484 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 13 03:11:00 smithi098 podman[135914]: 2024-09-13 03:11:00.392381233 +0000 UTC m=+0.585440075 container died 557faed1ab400ffd9cfa8c57bdc3ecd67cf7f8e7b2a935530e9844f3c3979f8b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T03:11:01.001 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T03:11:01.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:11:01.041 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T03:11:01.041 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T03:11:01.041 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.1 2024-09-13T03:11:01.233 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:01 smithi098 systemd[1]: Stopping Ceph osd.1 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:11:01.733 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:01 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[103881]: 2024-09-13T03:11:01.412+0000 7fb083f70640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:11:01.734 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:01 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[103881]: 2024-09-13T03:11:01.412+0000 7fb083f70640 -1 osd.1 92 *** Got signal Terminated *** 2024-09-13T03:11:01.734 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:01 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1[103881]: 2024-09-13T03:11:01.412+0000 7fb083f70640 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:11:07.088 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:06 smithi098 podman[136018]: 2024-09-13 03:11:06.824967211 +0000 UTC m=+5.549176600 container died 0f8e265c15791d27eb14e37206cfba52f7e6331fbeb040bcd2090e5e7c85fedc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T03:11:07.363 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:07 smithi098 podman[136018]: 2024-09-13 03:11:07.161109954 +0000 UTC m=+5.885319343 container cleanup 0f8e265c15791d27eb14e37206cfba52f7e6331fbeb040bcd2090e5e7c85fedc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T03:11:07.363 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:07 smithi098 bash[136018]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1 2024-09-13T03:11:07.733 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:07 smithi098 podman[136044]: 2024-09-13 03:11:07.362666779 +0000 UTC m=+0.529556164 container remove 0f8e265c15791d27eb14e37206cfba52f7e6331fbeb040bcd2090e5e7c85fedc (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T03:11:08.042 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:07 smithi098 podman[136133]: 2024-09-13 03:11:07.675932788 +0000 UTC m=+0.016135232 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:11:08.042 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:07 smithi098 podman[136133]: 2024-09-13 03:11:07.797085253 +0000 UTC m=+0.137287687 container create 18e239b928285ef10a6170c2f82ce9e1bee9ca409397551653d62e4215626eb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T03:11:08.042 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:08 smithi098 podman[136133]: 2024-09-13 03:11:08.04156095 +0000 UTC m=+0.381763390 container init 18e239b928285ef10a6170c2f82ce9e1bee9ca409397551653d62e4215626eb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.license=GPLv2) 2024-09-13T03:11:08.484 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:08 smithi098 podman[136133]: 2024-09-13 03:11:08.04494532 +0000 UTC m=+0.385147758 container start 18e239b928285ef10a6170c2f82ce9e1bee9ca409397551653d62e4215626eb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-13T03:11:08.484 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:08 smithi098 podman[136133]: 2024-09-13 03:11:08.12489025 +0000 UTC m=+0.465092725 container attach 18e239b928285ef10a6170c2f82ce9e1bee9ca409397551653d62e4215626eb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-7741f7f) 2024-09-13T03:11:08.484 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:08 smithi098 podman[136133]: 2024-09-13 03:11:08.241835584 +0000 UTC m=+0.582038033 container died 18e239b928285ef10a6170c2f82ce9e1bee9ca409397551653d62e4215626eb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T03:11:08.775 INFO:journalctl@ceph.osd.1.smithi098.stdout:Sep 13 03:11:08 smithi098 podman[136157]: 2024-09-13 03:11:08.753658835 +0000 UTC m=+0.506377461 container remove 18e239b928285ef10a6170c2f82ce9e1bee9ca409397551653d62e4215626eb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:11:08.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T03:11:08.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:11:08.823 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T03:11:08.823 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T03:11:08.824 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.2 2024-09-13T03:11:09.183 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:08 smithi098 systemd[1]: Stopping Ceph osd.2 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:11:09.483 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:09 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[109548]: 2024-09-13T03:11:09.181+0000 7f54c4075640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:11:09.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:09 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[109548]: 2024-09-13T03:11:09.181+0000 7f54c4075640 -1 osd.2 92 *** Got signal Terminated *** 2024-09-13T03:11:09.484 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:09 smithi098 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2[109548]: 2024-09-13T03:11:09.181+0000 7f54c4075640 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:11:14.984 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:14 smithi098 podman[136236]: 2024-09-13 03:11:14.727356345 +0000 UTC m=+5.682938504 container died 04c10c8159baa6668838e951c7b597d5f5ad582f0b1db07f5d7a5a33fc98bf45 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T03:11:15.376 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:15 smithi098 podman[136236]: 2024-09-13 03:11:15.107144608 +0000 UTC m=+6.062726767 container cleanup 04c10c8159baa6668838e951c7b597d5f5ad582f0b1db07f5d7a5a33fc98bf45 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS) 2024-09-13T03:11:15.376 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:15 smithi098 bash[136236]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2 2024-09-13T03:11:15.719 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:15 smithi098 podman[136252]: 2024-09-13 03:11:15.375573048 +0000 UTC m=+0.649026910 container remove 04c10c8159baa6668838e951c7b597d5f5ad582f0b1db07f5d7a5a33fc98bf45 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:11:15.980 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:15 smithi098 podman[136343]: 2024-09-13 03:11:15.621855438 +0000 UTC m=+0.016225249 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:11:15.981 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:15 smithi098 podman[136343]: 2024-09-13 03:11:15.743592289 +0000 UTC m=+0.137962143 container create cfb50e780391895bdd29530e2e3375317b4c5c5ad57f3ce50d604cb874621d96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T03:11:15.981 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:15 smithi098 podman[136343]: 2024-09-13 03:11:15.979901524 +0000 UTC m=+0.374271344 container init cfb50e780391895bdd29530e2e3375317b4c5c5ad57f3ce50d604cb874621d96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T03:11:16.234 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:15 smithi098 podman[136343]: 2024-09-13 03:11:15.983563364 +0000 UTC m=+0.377933183 container start cfb50e780391895bdd29530e2e3375317b4c5c5ad57f3ce50d604cb874621d96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T03:11:16.234 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:16 smithi098 podman[136343]: 2024-09-13 03:11:16.087887903 +0000 UTC m=+0.482257727 container attach cfb50e780391895bdd29530e2e3375317b4c5c5ad57f3ce50d604cb874621d96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T03:11:16.234 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:16 smithi098 podman[136343]: 2024-09-13 03:11:16.16779378 +0000 UTC m=+0.562163599 container died cfb50e780391895bdd29530e2e3375317b4c5c5ad57f3ce50d604cb874621d96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f) 2024-09-13T03:11:16.638 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T03:11:16.661 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:16 smithi098 podman[136366]: 2024-09-13 03:11:16.616350015 +0000 UTC m=+0.442787912 container remove cfb50e780391895bdd29530e2e3375317b4c5c5ad57f3ce50d604cb874621d96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T03:11:16.661 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:16 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T03:11:16.662 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:16 smithi098 systemd[1]: Stopped Ceph osd.2 for d155f688-7179-11ef-bceb-c7b262605968. 2024-09-13T03:11:16.662 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 13 03:11:16 smithi098 systemd[1]: ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.2.service: Consumed 8.560s CPU time. 2024-09-13T03:11:16.677 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:11:16.677 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T03:11:16.677 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T03:11:16.677 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.3 2024-09-13T03:11:17.001 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:16 smithi142 systemd[1]: Stopping Ceph osd.3 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:11:17.253 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:17 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[75368]: 2024-09-13T03:11:17.229+0000 7faa27876640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:11:17.253 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:17 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[75368]: 2024-09-13T03:11:17.229+0000 7faa27876640 -1 osd.3 92 *** Got signal Terminated *** 2024-09-13T03:11:17.253 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:17 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3[75368]: 2024-09-13T03:11:17.229+0000 7faa27876640 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:11:19.751 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:19 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:19.304+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:20.501 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:20 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:20.317+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:20.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:20 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:20.209+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:21.501 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:21 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:21.227+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:21.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:21 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:21.283+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:22.501 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:22 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:22.271+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:22.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:22 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:22.181+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:22.873 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:22 smithi142 podman[102789]: 2024-09-13 03:11:22.585260585 +0000 UTC m=+5.710025015 container stop 322e0a9d6b20d46cdb971df9ea6a11c39ccf53f8cbfd6f518d30bb54676f16d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-7741f7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T03:11:22.873 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:22 smithi142 podman[102789]: 2024-09-13 03:11:22.611990991 +0000 UTC m=+5.736755412 container died 322e0a9d6b20d46cdb971df9ea6a11c39ccf53f8cbfd6f518d30bb54676f16d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:11:23.179 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:22 smithi142 podman[102789]: 2024-09-13 03:11:22.971331826 +0000 UTC m=+6.096096246 container cleanup 322e0a9d6b20d46cdb971df9ea6a11c39ccf53f8cbfd6f518d30bb54676f16d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:11:23.179 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:22 smithi142 bash[102789]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3 2024-09-13T03:11:23.501 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:23 smithi142 podman[102818]: 2024-09-13 03:11:23.214083738 +0000 UTC m=+0.618176923 container remove 322e0a9d6b20d46cdb971df9ea6a11c39ccf53f8cbfd6f518d30bb54676f16d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f) 2024-09-13T03:11:23.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:23 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:23.271+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:23.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:23 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:23.176+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:23.827 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:23 smithi142 podman[102907]: 2024-09-13 03:11:23.441467737 +0000 UTC m=+0.016008631 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:11:23.827 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:23 smithi142 podman[102907]: 2024-09-13 03:11:23.607277672 +0000 UTC m=+0.181818549 container create 6598e511c8a2d04aa21cdcfca0652aba259d3a1c8bf5d0e3e20fc2deaaf2de44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T03:11:23.827 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:23 smithi142 podman[102907]: 2024-09-13 03:11:23.826251161 +0000 UTC m=+0.400792048 container init 6598e511c8a2d04aa21cdcfca0652aba259d3a1c8bf5d0e3e20fc2deaaf2de44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T03:11:24.177 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:23 smithi142 podman[102907]: 2024-09-13 03:11:23.830437204 +0000 UTC m=+0.404978081 container start 6598e511c8a2d04aa21cdcfca0652aba259d3a1c8bf5d0e3e20fc2deaaf2de44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-7741f7f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T03:11:24.177 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:23 smithi142 podman[102907]: 2024-09-13 03:11:23.934669354 +0000 UTC m=+0.509210240 container attach 6598e511c8a2d04aa21cdcfca0652aba259d3a1c8bf5d0e3e20fc2deaaf2de44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T03:11:24.177 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 13 03:11:24 smithi142 podman[102907]: 2024-09-13 03:11:24.01520345 +0000 UTC m=+0.589744331 container died 6598e511c8a2d04aa21cdcfca0652aba259d3a1c8bf5d0e3e20fc2deaaf2de44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T03:11:24.501 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:24 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:24.316+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:24.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:24 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:24.174+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:24.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T03:11:24.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:11:24.691 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T03:11:24.692 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T03:11:24.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.4 2024-09-13T03:11:25.001 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:24 smithi142 systemd[1]: Stopping Ceph osd.4 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:11:25.360 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:25 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:25.212+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:25.360 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:25 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:25.055+0000 7fa45d9fa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:11:25.360 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:25 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:25.055+0000 7fa45d9fa640 -1 osd.4 92 *** Got signal Terminated *** 2024-09-13T03:11:25.360 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:25 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:25.055+0000 7fa45d9fa640 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:11:25.360 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:25 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:25.357+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:26.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:26 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:26.318+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:26.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:26 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:26.176+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:27.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:27 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:27.331+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:27.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:27 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:27.208+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:28.422 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:28 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:28.315+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:28.422 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:28 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:28.168+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:29.502 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:29 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4[80414]: 2024-09-13T03:11:29.330+0000 7fa455ff7640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:54.892087+0000 front 2024-09-13T03:10:54.891987+0000 (oldest deadline 2024-09-13T03:11:18.992039+0000) 2024-09-13T03:11:29.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:29 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:29.183+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:30.496 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:30 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:30.159+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:30.496 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:30 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:30.159+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.1 since back 2024-09-13T03:11:05.170607+0000 front 2024-09-13T03:11:05.170596+0000 (oldest deadline 2024-09-13T03:11:29.270558+0000) 2024-09-13T03:11:30.751 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:30 smithi142 podman[103011]: 2024-09-13 03:11:30.495052798 +0000 UTC m=+5.572074571 container died 087c65ddb960db597c489550967b795e8ca2143de1dfe80e2a2e6d131b8f8493 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T03:11:31.142 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:30 smithi142 podman[103011]: 2024-09-13 03:11:30.849015127 +0000 UTC m=+5.926036900 container cleanup 087c65ddb960db597c489550967b795e8ca2143de1dfe80e2a2e6d131b8f8493 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T03:11:31.142 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:30 smithi142 bash[103011]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4 2024-09-13T03:11:31.443 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:31 smithi142 podman[103028]: 2024-09-13 03:11:31.142031952 +0000 UTC m=+0.639924934 container remove 087c65ddb960db597c489550967b795e8ca2143de1dfe80e2a2e6d131b8f8493 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T03:11:31.443 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:31 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:31.193+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:31.443 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:31 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:31.193+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.1 since back 2024-09-13T03:11:05.170607+0000 front 2024-09-13T03:11:05.170596+0000 (oldest deadline 2024-09-13T03:11:29.270558+0000) 2024-09-13T03:11:31.738 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:31 smithi142 podman[103116]: 2024-09-13 03:11:31.442727397 +0000 UTC m=+0.097538717 container create 5c55c51eee7b87d9397b094f40593fb43e11fbf030a8d870474c10e9dafd0e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T03:11:31.738 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:31 smithi142 podman[103116]: 2024-09-13 03:11:31.361448001 +0000 UTC m=+0.016259272 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:11:31.738 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:31 smithi142 podman[103116]: 2024-09-13 03:11:31.653472931 +0000 UTC m=+0.308284203 container init 5c55c51eee7b87d9397b094f40593fb43e11fbf030a8d870474c10e9dafd0e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T03:11:31.738 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:31 smithi142 podman[103116]: 2024-09-13 03:11:31.656798025 +0000 UTC m=+0.311609297 container start 5c55c51eee7b87d9397b094f40593fb43e11fbf030a8d870474c10e9dafd0e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T03:11:31.738 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:31 smithi142 podman[103116]: 2024-09-13 03:11:31.736693836 +0000 UTC m=+0.391505120 container attach 5c55c51eee7b87d9397b094f40593fb43e11fbf030a8d870474c10e9dafd0e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T03:11:32.001 INFO:journalctl@ceph.osd.4.smithi142.stdout:Sep 13 03:11:31 smithi142 podman[103116]: 2024-09-13 03:11:31.846394583 +0000 UTC m=+0.501205854 container died 5c55c51eee7b87d9397b094f40593fb43e11fbf030a8d870474c10e9dafd0e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T03:11:32.416 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:32 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:32.159+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:32.416 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:32 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:32.159+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.1 since back 2024-09-13T03:11:05.170607+0000 front 2024-09-13T03:11:05.170596+0000 (oldest deadline 2024-09-13T03:11:29.270558+0000) 2024-09-13T03:11:32.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T03:11:32.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:11:32.479 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T03:11:32.479 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T03:11:32.479 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.5 2024-09-13T03:11:32.751 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:32 smithi142 systemd[1]: Stopping Ceph osd.5 for d155f688-7179-11ef-bceb-c7b262605968... 2024-09-13T03:11:33.183 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:32 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:32.851+0000 7fa2ad56d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:11:33.183 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:32 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:32.851+0000 7fa2ad56d640 -1 osd.5 92 *** Got signal Terminated *** 2024-09-13T03:11:33.183 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:32 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:32.851+0000 7fa2ad56d640 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:11:33.183 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:33 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:33.181+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:33.471 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:33 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:33.181+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.1 since back 2024-09-13T03:11:05.170607+0000 front 2024-09-13T03:11:05.170596+0000 (oldest deadline 2024-09-13T03:11:29.270558+0000) 2024-09-13T03:11:34.501 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:34 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:34.165+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:34.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:34 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:34.165+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.1 since back 2024-09-13T03:11:05.170607+0000 front 2024-09-13T03:11:05.170596+0000 (oldest deadline 2024-09-13T03:11:29.270558+0000) 2024-09-13T03:11:35.501 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:35 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:35.126+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:35.501 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:35 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:35.126+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.1 since back 2024-09-13T03:11:05.170607+0000 front 2024-09-13T03:11:05.170596+0000 (oldest deadline 2024-09-13T03:11:29.270558+0000) 2024-09-13T03:11:36.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:36 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:36.163+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:36.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:36 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:36.163+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.1 since back 2024-09-13T03:11:05.170607+0000 front 2024-09-13T03:11:05.170596+0000 (oldest deadline 2024-09-13T03:11:29.270558+0000) 2024-09-13T03:11:36.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:36 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:36.163+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.2 since back 2024-09-13T03:11:12.771550+0000 front 2024-09-13T03:11:12.771571+0000 (oldest deadline 2024-09-13T03:11:35.671393+0000) 2024-09-13T03:11:37.501 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:37 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:37.128+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-13T03:10:58.169961+0000 front 2024-09-13T03:10:58.170145+0000 (oldest deadline 2024-09-13T03:11:19.269771+0000) 2024-09-13T03:11:37.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:37 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:37.128+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.1 since back 2024-09-13T03:11:05.170607+0000 front 2024-09-13T03:11:05.170596+0000 (oldest deadline 2024-09-13T03:11:29.270558+0000) 2024-09-13T03:11:37.502 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:37 smithi142 ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5[85449]: 2024-09-13T03:11:37.128+0000 7fa2a5b6a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.2 since back 2024-09-13T03:11:12.771550+0000 front 2024-09-13T03:11:12.771571+0000 (oldest deadline 2024-09-13T03:11:35.671393+0000) 2024-09-13T03:11:38.499 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:38 smithi142 podman[103220]: 2024-09-13 03:11:38.214256571 +0000 UTC m=+5.513339899 container died 31b09c7c1472c2edfe2cbae6e1469ababb79d83a23e7cfdd830671c0b2b65fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-13T03:11:38.751 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:38 smithi142 podman[103220]: 2024-09-13 03:11:38.59211288 +0000 UTC m=+5.891196203 container cleanup 31b09c7c1472c2edfe2cbae6e1469ababb79d83a23e7cfdd830671c0b2b65fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T03:11:38.752 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:38 smithi142 bash[103220]: ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5 2024-09-13T03:11:39.144 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:38 smithi142 podman[103236]: 2024-09-13 03:11:38.835063577 +0000 UTC m=+0.613803568 container remove 31b09c7c1472c2edfe2cbae6e1469ababb79d83a23e7cfdd830671c0b2b65fbb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f) 2024-09-13T03:11:39.431 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:39 smithi142 podman[103324]: 2024-09-13 03:11:39.144064176 +0000 UTC m=+0.105483499 container create 89e182c3db17cdc84f7e36fcfa1474be97819f76eb8f98314c58d8b4d7a3ea56 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f) 2024-09-13T03:11:39.431 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:39 smithi142 podman[103324]: 2024-09-13 03:11:39.054334599 +0000 UTC m=+0.015753933 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:11:39.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:39 smithi142 podman[103324]: 2024-09-13 03:11:39.355519539 +0000 UTC m=+0.316938868 container init 89e182c3db17cdc84f7e36fcfa1474be97819f76eb8f98314c58d8b4d7a3ea56 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, io.buildah.version=1.37.2, ceph=True) 2024-09-13T03:11:39.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:39 smithi142 podman[103324]: 2024-09-13 03:11:39.359167535 +0000 UTC m=+0.320586859 container start 89e182c3db17cdc84f7e36fcfa1474be97819f76eb8f98314c58d8b4d7a3ea56 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:11:39.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:39 smithi142 podman[103324]: 2024-09-13 03:11:39.430105806 +0000 UTC m=+0.391525146 container attach 89e182c3db17cdc84f7e36fcfa1474be97819f76eb8f98314c58d8b4d7a3ea56 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T03:11:39.751 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:39 smithi142 podman[103324]: 2024-09-13 03:11:39.551088089 +0000 UTC m=+0.512507407 container died 89e182c3db17cdc84f7e36fcfa1474be97819f76eb8f98314c58d8b4d7a3ea56 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T03:11:40.088 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 13 03:11:40 smithi142 podman[103347]: 2024-09-13 03:11:40.074890503 +0000 UTC m=+0.518126651 container remove 89e182c3db17cdc84f7e36fcfa1474be97819f76eb8f98314c58d8b4d7a3ea56 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-d155f688-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T03:11:40.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d155f688-7179-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T03:11:40.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:11:40.132 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T03:11:40.132 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d155f688-7179-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T03:11:40.301 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T03:11:44.611 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi098.stderr:ceph-fuse[65537]: fuse finished with error 0 and tester_r 0 2024-09-13T03:12:05.126 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d155f688-7179-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T03:12:05.281 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T03:12:21.341 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:12:21.374 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:12:21.401 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T03:12:21.403 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903081/remote/smithi098/crash 2024-09-13T03:12:21.403 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/crash -- . 2024-09-13T03:12:21.441 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T03:12:21.441 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2024-09-13T03:12:21.443 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903081/remote/smithi142/crash 2024-09-13T03:12:21.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/crash -- . 2024-09-13T03:12:21.468 INFO:teuthology.orchestra.run.smithi142.stderr:tar: /var/lib/ceph/d155f688-7179-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T03:12:21.468 INFO:teuthology.orchestra.run.smithi142.stderr:tar: Error is not recoverable: exiting now 2024-09-13T03:12:21.469 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T03:12:21.469 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T03:12:21.523 INFO:teuthology.orchestra.run.smithi098.stdout:2024-09-13T03:00:00.000267+0000 mon.smithi098 (mon.0) 443 : cluster [WRN] pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T03:12:21.524 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-13T03:12:21.524 INFO:tasks.cephadm:Compressing logs... 2024-09-13T03:12:21.524 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T03:12:21.567 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T03:12:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-13T03:12:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:: No such file or directory 2024-09-13T03:12:21.590 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi098.nwzstq.log 2024-09-13T03:12:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mon.smithi098.log 2024-09-13T03:12:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi098.nwzstq.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-13T03:12:21.591 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mon.smithi098.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T03:12:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T03:12:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T03:12:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi098.ukgenf.log 2024-09-13T03:12:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-13T03:12:21.596 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi098.ukgenf.log: 85.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi142.log 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:: No such file or directory 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi142.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mon.smithi142.log 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi142.wxfmvt.log 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mon.smithi142.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi142.wxfmvt.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.log 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr: 94.2% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi142.log.gz 2024-09-13T03:12:21.597 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.5.log: 85.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T03:12:21.598 INFO:teuthology.orchestra.run.smithi142.stderr: 91.6% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T03:12:21.599 INFO:teuthology.orchestra.run.smithi098.stderr: 91.5% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T03:12:21.599 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.log 2024-09-13T03:12:21.602 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T03:12:21.602 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.6% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T03:12:21.605 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi142.jutrvi.log 2024-09-13T03:12:21.606 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi142.hplrrs.log 2024-09-13T03:12:21.606 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi142.jutrvi.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-13T03:12:21.606 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi142.hplrrs.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-13T03:12:21.609 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.3.log: 88.7% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T03:12:21.611 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi098.log 2024-09-13T03:12:21.611 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi098.dioppa.log 2024-09-13T03:12:21.615 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi098.log: 94.2% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi098.log.gz 2024-09-13T03:12:21.615 INFO:teuthology.orchestra.run.smithi098.stderr: 88.6% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T03:12:21.615 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-13T03:12:21.616 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi098.dioppa.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T03:12:21.619 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T03:12:21.647 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T03:12:21.661 INFO:teuthology.orchestra.run.smithi142.stderr: 89.5% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi142.jutrvi.log.gz 2024-09-13T03:12:21.681 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T03:12:22.018 INFO:teuthology.orchestra.run.smithi098.stderr: 88.9% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi098.ukgenf.log.gz 2024-09-13T03:12:22.074 INFO:teuthology.orchestra.run.smithi142.stderr: 92.6% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mon.smithi142.log.gz 2024-09-13T03:12:22.598 INFO:teuthology.orchestra.run.smithi098.stderr: 90.5% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mon.smithi098.log.gz 2024-09-13T03:12:26.201 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-13T03:12:26.311 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-13T03:12:26.453 INFO:teuthology.orchestra.run.smithi098.stderr: 93.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-13T03:12:26.948 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-13T03:12:27.183 INFO:teuthology.orchestra.run.smithi098.stderr: 93.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-13T03:12:27.419 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-13T03:12:29.287 INFO:teuthology.orchestra.run.smithi142.stderr: 94.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi142.hplrrs.log.gz 2024-09-13T03:12:29.411 INFO:teuthology.orchestra.run.smithi142.stderr: 94.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi142.wxfmvt.log.gz 2024-09-13T03:12:35.997 INFO:teuthology.orchestra.run.smithi098.stderr: 94.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi098.dioppa.log.gz 2024-09-13T03:12:36.816 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-13T03:12:36.816 INFO:teuthology.orchestra.run.smithi142.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-13T03:12:36.818 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-13T03:12:36.818 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m15.237s 2024-09-13T03:12:36.818 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m45.704s 2024-09-13T03:12:36.818 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m1.360s 2024-09-13T03:12:37.337 INFO:teuthology.orchestra.run.smithi098.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-13T03:13:54.426 INFO:teuthology.orchestra.run.smithi098.stderr: 92.8% -- replaced with /var/log/ceph/d155f688-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi098.nwzstq.log.gz 2024-09-13T03:13:54.427 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-13T03:13:54.428 INFO:teuthology.orchestra.run.smithi098.stderr:real 1m32.847s 2024-09-13T03:13:54.428 INFO:teuthology.orchestra.run.smithi098.stderr:user 2m14.983s 2024-09-13T03:13:54.428 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m4.246s 2024-09-13T03:13:54.429 INFO:tasks.cephadm:Archiving logs... 2024-09-13T03:13:54.429 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903081/remote/smithi098/log 2024-09-13T03:13:54.430 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T03:14:14.448 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903081/remote/smithi142/log 2024-09-13T03:14:14.449 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T03:14:21.178 INFO:tasks.cephadm:Removing cluster... 2024-09-13T03:14:21.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d155f688-7179-11ef-bceb-c7b262605968 --force 2024-09-13T03:14:21.332 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T03:14:21.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d155f688-7179-11ef-bceb-c7b262605968 --force 2024-09-13T03:14:22.146 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: d155f688-7179-11ef-bceb-c7b262605968 2024-09-13T03:14:22.457 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T03:14:22.458 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T03:14:22.474 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T03:14:22.489 INFO:tasks.cephadm:Teardown complete 2024-09-13T03:14:22.489 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T03:14:22.501 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T03:14:22.501 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T03:14:22.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T03:14:22.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T03:14:22.597 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T03:14:22.608 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T03:14:22.608 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T03:14:22.611 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T03:14:22.623 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-13T03:14:22.625 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-13T03:14:22.627 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T03:14:22.628 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-13T03:14:22.628 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +161us[ +173us] +/- 45ms 2024-09-13T03:14:22.628 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -246us[ -246us] +/- 63ms 2024-09-13T03:14:22.628 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 +39us[ +50us] +/- 62ms 2024-09-13T03:14:22.628 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T03:14:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T03:14:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-13T03:14:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv01.front.sepia.ceph.com 3 6 377 34 +134us[ +139us] +/- 45ms 2024-09-13T03:14:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 -256us[ -256us] +/- 63ms 2024-09-13T03:14:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +44us[ +49us] +/- 62ms 2024-09-13T03:14:22.630 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T03:14:22.630 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T03:14:22.641 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T03:14:22.641 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T03:14:22.670 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T03:14:22.752 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T03:14:22.828 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T03:14:22.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:14:22.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T03:14:22.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:14:22.886 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T03:14:22.898 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T03:14:22.920 INFO:teuthology.task.internal:Duration was 2271.909016 seconds 2024-09-13T03:14:22.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T03:14:22.953 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T03:14:22.954 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T03:14:22.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T03:14:22.992 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T03:14:22.995 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T03:14:23.285 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T03:14:23.286 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-13T03:14:23.286 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T03:14:23.334 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-09-13T03:14:23.334 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T03:14:23.360 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T03:14:23.361 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T03:14:23.377 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T03:14:23.427 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T03:14:23.427 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T03:14:23.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T03:14:24.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T03:14:24.159 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T03:14:24.159 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T03:14:24.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T03:14:24.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T03:14:24.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:14:24.227 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:14:24.247 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-13T03:14:24.274 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-09-13T03:14:24.298 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:14:24.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:14:24.322 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:14:24.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:14:24.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T03:14:24.365 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T03:14:24.366 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903081/remote/smithi098 2024-09-13T03:14:24.366 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T03:14:24.417 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903081/remote/smithi142 2024-09-13T03:14:24.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T03:14:24.459 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T03:14:24.459 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T03:14:24.463 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T03:14:24.506 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T03:14:24.519 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T03:14:24.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T03:14:24.546 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T03:14:24.546 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T03:14:24.548 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T03:14:24.561 INFO:teuthology.orchestra.run.smithi098.stdout: 266063 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 13 03:14 /home/ubuntu/cephtest 2024-09-13T03:14:24.561 INFO:teuthology.orchestra.run.smithi098.stdout: 556307 4 d--------- 2 ubuntu ubuntu 4096 Sep 13 02:50 /home/ubuntu/cephtest/mnt.0 2024-09-13T03:14:24.561 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-13T03:14:24.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:14:24.562 INFO:teuthology.orchestra.run.smithi098.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-13T03:14:24.562 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi098 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-13T03:14:24.563 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T03:14:24.579 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T03:14:24.614 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T03:14:24.617 INFO:teuthology.run:Summary data: description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2271.9090156555176 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-13T03:14:24.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T03:14:24.705 INFO:teuthology.run:FAIL